Folding Forum

Community driven support forum for Folding@home
https://foldingforum.org/

GPU workunits given too short time to complete

https://foldingforum.org/viewtopic.php?t=26319

Page 1 of 1

GPU workunits given too short time to complete

Posted: Mon May 12, 2014 10:43 am
by willfolder
I leave my work computer on for folding overnight( 5pm - 8am) and leave it running over the weekend.
The GPU work units do not have enough time to complete.
e.g. currently have project 13000 and timeout is 15/05 and the ETA is 9.45 days.

Where do I start finding out what is wrong?

Re: GPU workunits given to short time to complete

Posted: Mon May 12, 2014 11:03 am
by PantherX
Welcome to the F@H Forum willfolder,

For starters, please do post your log file and tell us what drivers you are using for your GPU (viewtopic.php?f=61&t=26036).

Re: GPU workunits given to short time to complete

Posted: Mon May 12, 2014 11:38 am
by willfolder
The driver is NVIDIA
320.57


Note, I had to delete some lines to fit in the 60,000 character limit.
Deleted lines of the form
"20:39:54:WU02:FS01:0xa4:Completed 140000 out of 250000 steps (56%)"
which are just showing completion status.

Code: Select all

*********************** Log Started 2014-05-08T15:23:42Z ***********************
15:23:42:************************* Folding@home Client *************************
15:23:42:      Website: http://folding.stanford.edu/
15:23:42:    Copyright: (c) 2009-2014 Stanford University
15:23:42:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:23:42:         Args: --open-web-control
15:23:42:       Config: C:/ProgramData/FAHClient/config.xml
15:23:42:******************************** Build ********************************
15:23:42:      Version: 7.4.4
15:23:42:         Date: Mar 4 2014
15:23:42:         Time: 20:26:54
15:23:42:      SVN Rev: 4130
15:23:42:       Branch: fah/trunk/client
15:23:42:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
15:23:42:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
15:23:42:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
15:23:42:     Platform: win32 XP
15:23:42:         Bits: 32
15:23:42:         Mode: Release
15:23:42:******************************* System ********************************
15:23:42:          CPU: Intel(R) Core(TM) i5-3340 CPU @ 3.10GHz
15:23:42:       CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
15:23:42:         CPUs: 4
15:23:42:       Memory: 7.93GiB
15:23:42:  Free Memory: 5.21GiB
15:23:42:      Threads: WINDOWS_THREADS
15:23:42:   OS Version: 6.1
15:23:42:  Has Battery: false
15:23:42:   On Battery: false
15:23:42:   UTC Offset: 2
15:23:42:          PID: 2320
15:23:42:          CWD: C:/ProgramData/FAHClient
15:23:42:           OS: Windows 7 Professional
15:23:42:      OS Arch: AMD64
15:23:42:         GPUs: 1
15:23:42:        GPU 0: NVIDIA:2 GF119 [GeForce GT 610]
15:23:42:         CUDA: 2.1
15:23:42:  CUDA Driver: 5050
15:23:42:Win32 Service: false
15:23:42:***********************************************************************
15:23:42:<config>
15:23:42:  <!-- Folding Core -->
15:23:42:  <core-priority v='low'/>
15:23:42:
15:23:42:  <!-- Network -->
15:23:42:  <proxy v=':8080'/>
15:23:42:
15:23:42:  <!-- Slot Control -->
15:23:42:  <power v='full'/>
15:23:42:
15:23:42:  <!-- User Information -->
15:23:42:  <user v='willfolder'/>
15:23:42:
15:23:42:  <!-- Folding Slots -->
15:23:42:  <slot id='0' type='GPU'/>
15:23:42:  <slot id='1' type='CPU'/>
15:23:42:</config>
15:23:42:Trying to access database...
15:23:43:Successfully acquired database lock
15:23:43:Enabled folding slot 00: READY gpu:0:GF119 [GeForce GT 610]
15:23:43:Enabled folding slot 01: READY cpu:3
15:23:43:WU00:FS00:Starting
15:23:43:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
15:23:43:WU00:FS00:Started FahCore on PID 2324
15:23:43:WU00:FS00:Core PID:6600
15:23:43:WU00:FS00:FahCore 0x17 started
15:23:43:WU01:FS01:Starting
15:23:44:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 3
15:23:44:WU01:FS01:Started FahCore on PID 5596
15:23:44:WU01:FS01:Core PID:5488
15:23:44:WU01:FS01:FahCore 0xa4 started
15:23:45:WU01:FS01:0xa4:
15:23:45:WU01:FS01:0xa4:*------------------------------*
15:23:45:WU01:FS01:0xa4:Folding@Home Gromacs GB Core
15:23:45:WU01:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
15:23:45:WU01:FS01:0xa4:
15:23:45:WU01:FS01:0xa4:Preparing to commence simulation
15:23:45:WU01:FS01:0xa4:- Ensuring status. Please wait.
15:23:45:WU00:FS00:0x17:*********************** Log Started 2014-05-08T15:23:44Z ***********************
15:23:45:WU00:FS00:0x17:Project: 13000 (Run 1362, Clone 7, Gen 13)
15:23:45:WU00:FS00:0x17:Unit: 0x0000001d538b3db753111cca642ae138
15:23:45:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
15:23:45:WU00:FS00:0x17:Machine: 0
15:23:45:WU00:FS00:0x17:Digital signatures verified
15:23:45:WU00:FS00:0x17:Folding@home GPU core17
15:23:45:WU00:FS00:0x17:Version 0.0.52
15:23:45:WU00:FS00:0x17:  Found a checkpoint file
15:23:48:12:127.0.0.1:New Web connection
15:23:54:WU01:FS01:0xa4:- Looking at optimizations...
15:23:54:WU01:FS01:0xa4:- Working with standard loops on this execution.
15:23:54:WU01:FS01:0xa4:- Previous termination of core was improper.
15:23:54:WU01:FS01:0xa4:- Files status OK
15:23:54:WU01:FS01:0xa4:- Expanded 875336 -> 1434864 (decompressed 163.9 percent)
15:23:54:WU01:FS01:0xa4:Called DecompressByteArray: compressed_data_size=875336 data_size=1434864, decompressed_data_size=1434864 diff=0
15:23:54:WU01:FS01:0xa4:- Digital signature verified
15:23:54:WU01:FS01:0xa4:
15:23:54:WU01:FS01:0xa4:Project: 9006 (Run 1727, Clone 3, Gen 11)
15:23:54:WU01:FS01:0xa4:
15:23:54:WU01:FS01:0xa4:Entering M.D.
15:24:00:WU01:FS01:0xa4:Using Gromacs checkpoints
15:24:00:WU01:FS01:0xa4:Mapping NT from 3 to 3 
15:24:01:WU01:FS01:0xa4:Resuming from checkpoint
15:24:01:WU01:FS01:0xa4:Verified 01/wudata_01.log
15:24:01:WU01:FS01:0xa4:Verified 01/wudata_01.trr
15:24:01:WU01:FS01:0xa4:Verified 01/wudata_01.xtc
15:24:01:WU01:FS01:0xa4:Verified 01/wudata_01.edr
15:24:01:WU01:FS01:0xa4:Completed 62660 out of 250000 steps  (25%)
15:26:24:WU01:FS01:0xa4:Completed 65000 out of 250000 steps  (26%)
15:26:38:WU00:FS00:0x17:Completed 250000 out of 5000000 steps (5%)
15:26:38:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:28:51:WU01:FS01:0xa4:Completed 67500 out of 250000 steps  (27%)
18:24:22:WU01:FS01:0xa4:Completed 247500 out of 250000 steps  (99%)
18:24:23:WU02:FS01:Connecting to 171.67.108.200:8080
18:24:24:WU02:FS01:Assigned to work server 171.64.65.124
18:24:24:WU02:FS01:Requesting new work unit for slot 01: RUNNING cpu:3 from 171.64.65.124
18:24:24:WU02:FS01:Connecting to 171.64.65.124:8080
18:24:27:WU02:FS01:Downloading 808.75KiB
18:24:35:WU02:FS01:Download 23.74%
18:24:42:WU02:FS01:Download 39.57%
18:24:48:WU02:FS01:Download 63.31%
18:24:56:WU02:FS01:Download 79.13%
18:25:02:WU02:FS01:Download 100.00%
18:25:02:WU02:FS01:Download complete
18:25:02:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9007 run:616 clone:1 gen:47 core:0xa4 unit:0x00000034664f2de4533b360f54c78f88
18:26:47:WU01:FS01:0xa4:Completed 250000 out of 250000 steps  (100%)
18:26:48:WU01:FS01:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
18:26:58:WU01:FS01:0xa4:
18:26:58:WU01:FS01:0xa4:Finished Work Unit:
18:26:58:WU01:FS01:0xa4:- Reading up to 870480 from "01/wudata_01.trr": Read 870480
18:26:58:WU01:FS01:0xa4:trr file hash check passed.
18:26:58:WU01:FS01:0xa4:- Reading up to 798040 from "01/wudata_01.xtc": Read 798040
18:26:58:WU01:FS01:0xa4:xtc file hash check passed.
18:26:58:WU01:FS01:0xa4:edr file hash check passed.
18:26:58:WU01:FS01:0xa4:logfile size: 23790
18:26:58:WU01:FS01:0xa4:Leaving Run
18:26:58:WU01:FS01:0xa4:- Writing 1694750 bytes of core data to disk...
18:26:59:WU01:FS01:0xa4:Done: 1694238 -> 1641933 (compressed to 96.9 percent)
18:26:59:WU01:FS01:0xa4:  ... Done.
18:27:00:WU01:FS01:0xa4:- Shutting down core
18:27:00:WU01:FS01:0xa4:
18:27:00:WU01:FS01:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
18:27:00:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
18:27:00:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9006 run:1727 clone:3 gen:11 core:0xa4 unit:0x0000000e664f2de4533b311dc2b8259b
18:27:00:WU01:FS01:Uploading 1.57MiB to 171.64.65.124
18:27:00:WU01:FS01:Connecting to 171.64.65.124:8080
18:27:00:WU02:FS01:Starting
18:27:00:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 3
18:27:00:WU02:FS01:Started FahCore on PID 8108
18:27:00:WU02:FS01:Core PID:5796
18:27:00:WU02:FS01:FahCore 0xa4 started
18:27:01:WU02:FS01:0xa4:
18:27:01:WU02:FS01:0xa4:*------------------------------*
18:27:01:WU02:FS01:0xa4:Folding@Home Gromacs GB Core
18:27:01:WU02:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
18:27:01:WU02:FS01:0xa4:
18:27:01:WU02:FS01:0xa4:Preparing to commence simulation
18:27:01:WU02:FS01:0xa4:- Looking at optimizations...
18:27:01:WU02:FS01:0xa4:- Created dyn
18:27:01:WU02:FS01:0xa4:- Files status OK
18:27:01:WU02:FS01:0xa4:- Expanded 827644 -> 1400900 (decompressed 169.2 percent)
18:27:01:WU02:FS01:0xa4:Called DecompressByteArray: compressed_data_size=827644 data_size=1400900, decompressed_data_size=1400900 diff=0
18:27:01:WU02:FS01:0xa4:- Digital signature verified
18:27:01:WU02:FS01:0xa4:
18:27:01:WU02:FS01:0xa4:Project: 9007 (Run 616, Clone 1, Gen 47)
18:27:01:WU02:FS01:0xa4:
18:27:01:WU02:FS01:0xa4:Assembly optimizations on if available.
18:27:01:WU02:FS01:0xa4:Entering M.D.
18:27:06:WU02:FS01:0xa4:Mapping NT from 3 to 3 
18:27:07:WU02:FS01:0xa4:Completed 0 out of 250000 steps  (0%)
18:27:07:WU01:FS01:Upload 39.90%
18:27:14:WU01:FS01:Upload 87.78%
18:27:17:WU01:FS01:Upload complete
18:27:17:WU01:FS01:Server responded WORK_ACK (400)
18:27:17:WU01:FS01:Final credit estimate, 387.00 points
18:27:17:WU01:FS01:Cleaning up
18:29:31:WU02:FS01:0xa4:Completed 2500 out of 250000 steps  (1%)
21:22:26:WU02:FS01:0xa4:Completed 185000 out of 250000 steps  (74%)
******************************* Date: 2014-05-08 *******************************
21:24:47:WU02:FS01:0xa4:Completed 187500 out of 250000 steps  (75%)
22:21:30:WU02:FS01:0xa4:Completed 247500 out of 250000 steps  (99%)
22:21:30:WU01:FS01:Connecting to 171.67.108.200:8080
22:21:31:WU01:FS01:Assigned to work server 128.143.231.202
22:21:31:WU01:FS01:Requesting new work unit for slot 01: RUNNING cpu:3 from 128.143.231.202
22:21:31:WU01:FS01:Connecting to 128.143.231.202:8080
22:21:33:WU01:FS01:Downloading 3.67MiB
22:21:39:WU01:FS01:Download 8.52%
22:21:45:WU01:FS01:Download 15.33%
22:21:52:WU01:FS01:Download 22.14%
22:21:59:WU01:FS01:Download 30.65%
22:22:06:WU01:FS01:Download 37.47%
22:22:12:WU01:FS01:Download 42.58%
22:22:19:WU01:FS01:Download 51.09%
22:22:26:WU01:FS01:Download 56.20%
22:22:32:WU01:FS01:Download 61.31%
22:22:38:WU01:FS01:Download 66.42%
22:22:45:WU01:FS01:Download 71.53%
22:22:52:WU01:FS01:Download 78.34%
22:22:58:WU01:FS01:Download 83.45%
22:23:05:WU01:FS01:Download 90.26%
22:23:11:WU01:FS01:Download 97.07%
22:23:15:WU01:FS01:Download complete
22:23:15:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:8574 run:1 clone:3 gen:344 core:0xa3 unit:0x0000103c0a3b1e595228859dce87d0d1
22:23:52:WU02:FS01:0xa4:Completed 250000 out of 250000 steps  (100%)
22:23:53:WU02:FS01:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
22:24:03:WU02:FS01:0xa4:
22:24:03:WU02:FS01:0xa4:Finished Work Unit:
22:24:03:WU02:FS01:0xa4:- Reading up to 811800 from "02/wudata_01.trr": Read 811800
22:24:03:WU02:FS01:0xa4:trr file hash check passed.
22:24:03:WU02:FS01:0xa4:- Reading up to 745988 from "02/wudata_01.xtc": Read 745988
22:24:03:WU02:FS01:0xa4:xtc file hash check passed.
22:24:03:WU02:FS01:0xa4:edr file hash check passed.
22:24:03:WU02:FS01:0xa4:logfile size: 23360
22:24:03:WU02:FS01:0xa4:Leaving Run
22:24:07:WU02:FS01:0xa4:- Writing 1583636 bytes of core data to disk...
22:24:08:WU02:FS01:0xa4:Done: 1583124 -> 1538103 (compressed to 97.1 percent)
22:24:08:WU02:FS01:0xa4:  ... Done.
22:24:09:WU02:FS01:0xa4:- Shutting down core
22:24:09:WU02:FS01:0xa4:
22:24:09:WU02:FS01:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
22:24:09:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
22:24:09:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:9007 run:616 clone:1 gen:47 core:0xa4 unit:0x00000034664f2de4533b360f54c78f88
22:24:09:WU02:FS01:Uploading 1.47MiB to 171.64.65.124
22:24:09:WU02:FS01:Connecting to 171.64.65.124:8080
22:24:09:WU01:FS01:Starting
22:24:09:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 01 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 3
22:24:09:WU01:FS01:Started FahCore on PID 7472
22:24:09:WU01:FS01:Core PID:3648
22:24:09:WU01:FS01:FahCore 0xa3 started
22:24:10:WU01:FS01:0xa3:
22:24:10:WU01:FS01:0xa3:*------------------------------*
22:24:10:WU01:FS01:0xa3:Folding@Home Gromacs SMP Core
22:24:10:WU01:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
22:24:10:WU01:FS01:0xa3:
22:24:10:WU01:FS01:0xa3:Preparing to commence simulation
22:24:10:WU01:FS01:0xa3:- Looking at optimizations...
22:24:10:WU01:FS01:0xa3:- Created dyn
22:24:10:WU01:FS01:0xa3:- Files status OK
22:24:10:WU01:FS01:0xa3:- Expanded 3847725 -> 4382420 (decompressed 113.8 percent)
22:24:10:WU01:FS01:0xa3:Called DecompressByteArray: compressed_data_size=3847725 data_size=4382420, decompressed_data_size=4382420 diff=0
22:24:10:WU01:FS01:0xa3:- Digital signature verified
22:24:10:WU01:FS01:0xa3:
22:24:10:WU01:FS01:0xa3:Project: 8574 (Run 1, Clone 3, Gen 344)
22:24:10:WU01:FS01:0xa3:
22:24:10:WU01:FS01:0xa3:Assembly optimizations on if available.
22:24:10:WU01:FS01:0xa3:Entering M.D.
22:24:16:WU01:FS01:0xa3:Mapping NT from 3 to 3 
22:24:16:WU02:FS01:Upload 42.59%
22:24:16:WU01:FS01:0xa3:Completed 0 out of 500000 steps  (0%)
22:24:23:WU02:FS01:Upload 93.71%
22:24:25:WU02:FS01:Upload complete
22:24:25:WU02:FS01:Server responded WORK_ACK (400)
22:24:25:WU02:FS01:Final credit estimate, 1266.00 points
22:24:25:WU02:FS01:Cleaning up
22:44:29:WU01:FS01:0xa3:Completed 5000 out of 500000 steps  (1%)
03:24:07:WU01:FS01:0xa3:Completed 75000 out of 500000 steps  (15%)
******************************* Date: 2014-05-09 *******************************
03:44:00:WU01:FS01:0xa3:Completed 80000 out of 500000 steps  (16%)
06:42:46:WU01:FS01:0xa3:Completed 125000 out of 500000 steps  (25%)
07:01:32:FS01:Shutting core down
07:01:33:FS00:Shutting core down
07:01:34:WU00:FS00:0x17:WARNING:Console control signal 1 on PID 6600
07:01:34:WU00:FS00:0x17:Exiting, please wait. . .
07:01:38:WU00:FS00:0x17:Lost lifeline PID 2324, exiting
07:01:38:WU00:FS00:0x17:ERROR:103: Lost client lifeline
07:01:38:WU00:FS00:0x17:Folding@home Core Shutdown: CLIENT_DIED
07:01:39:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
07:01:39:WU00:FS00:Starting
07:01:39:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
07:01:39:WU00:FS00:Started FahCore on PID 7336
07:01:39:WU00:FS00:Core PID:4120
07:01:39:WU00:FS00:FahCore 0x17 started
07:01:39:WU00:FS00:0x17:*********************** Log Started 2014-05-09T07:01:39Z ***********************
07:01:39:WU00:FS00:0x17:Project: 13000 (Run 1362, Clone 7, Gen 13)
07:01:39:WU00:FS00:0x17:Unit: 0x0000001d538b3db753111cca642ae138
07:01:39:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
07:01:39:WU00:FS00:0x17:Machine: 0
07:01:39:WU00:FS00:0x17:Digital signatures verified
07:01:39:WU00:FS00:0x17:Folding@home GPU core17
07:01:39:WU00:FS00:0x17:Version 0.0.52
07:01:39:WU00:FS00:0x17:  Found a checkpoint file
07:01:40:FS00:Paused
07:01:40:FS01:Paused
07:01:40:FS00:Shutting core down
07:01:40:WU00:FS00:0x17:WARNING:Console control signal 1 on PID 4120
07:01:40:WU00:FS00:0x17:Exiting, please wait. . .
07:01:42:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
07:02:06:Removing old file 'configs/config-20140411-063532.xml'
07:02:06:Saving configuration to config.xml
07:02:06:<config>
07:02:06:  <!-- Folding Core -->
07:02:06:  <core-priority v='low'/>
07:02:06:
07:02:06:  <!-- Network -->
07:02:06:  <proxy v=':8080'/>
07:02:06:
07:02:06:  <!-- Slot Control -->
07:02:06:  <power v='light'/>
07:02:06:
07:02:06:  <!-- User Information -->
07:02:06:  <user v='willfolder'/>
07:02:06:
07:02:06:  <!-- Folding Slots -->
07:02:06:  <slot id='0' type='GPU'>
07:02:06:    <paused v='true'/>
07:02:06:  </slot>
07:02:06:  <slot id='1' type='CPU'>
07:02:06:    <paused v='true'/>
07:02:06:  </slot>
07:02:06:</config>
07:02:25:38:127.0.0.1:New Web connection
07:02:41:WARNING:FS00:Killing WU00
07:02:41:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
******************************* Date: 2014-05-09 *******************************
15:09:06:FS00:Unpaused
15:09:06:FS01:Unpaused
15:09:06:WU01:FS01:Starting
15:09:06:WARNING:WU01:FS01:Changed SMP threads from 3 to 2 this can cause some work units to fail
15:09:06:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 01 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 2
15:09:06:WU01:FS01:Started FahCore on PID 3884
15:09:06:WU01:FS01:Core PID:4736
15:09:06:WU01:FS01:FahCore 0xa3 started
15:09:07:WU01:FS01:0xa3:
15:09:07:WU01:FS01:0xa3:*------------------------------*
15:09:07:WU01:FS01:0xa3:Folding@Home Gromacs SMP Core
15:09:07:WU01:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
15:09:07:WU01:FS01:0xa3:
15:09:07:WU01:FS01:0xa3:Preparing to commence simulation
15:09:07:WU01:FS01:0xa3:- Looking at optimizations...
15:09:07:WU01:FS01:0xa3:- Files status OK
15:09:07:WU01:FS01:0xa3:- Expanded 3847725 -> 4382420 (decompressed 113.8 percent)
15:09:07:WU01:FS01:0xa3:Called DecompressByteArray: compressed_data_size=3847725 data_size=4382420, decompressed_data_size=4382420 diff=0
15:09:07:WU01:FS01:0xa3:- Digital signature verified
15:09:07:WU01:FS01:0xa3:
15:09:07:WU01:FS01:0xa3:Project: 8574 (Run 1, Clone 3, Gen 344)
15:09:07:WU01:FS01:0xa3:
15:09:07:WU01:FS01:0xa3:Assembly optimizations on if available.
15:09:07:WU01:FS01:0xa3:Entering M.D.
15:09:09:FS01:Shutting core down
15:09:09:WU00:FS00:Starting
15:09:09:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
15:09:09:WU00:FS00:Started FahCore on PID 3896
15:09:09:WU00:FS00:Core PID:6068
15:09:09:WU00:FS00:FahCore 0x17 started
15:09:09:WU00:FS00:0x17:*********************** Log Started 2014-05-09T15:09:09Z ***********************
15:09:09:WU00:FS00:0x17:Project: 13000 (Run 1362, Clone 7, Gen 13)
15:09:09:WU00:FS00:0x17:Unit: 0x0000001d538b3db753111cca642ae138
15:09:09:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
15:09:09:WU00:FS00:0x17:Machine: 0
15:09:09:WU00:FS00:0x17:Digital signatures verified
15:09:09:WU00:FS00:0x17:Folding@home GPU core17
15:09:09:WU00:FS00:0x17:Version 0.0.52
15:09:09:WU00:FS00:0x17:  Found a checkpoint file
15:09:13:WU01:FS01:0xa3:Using Gromacs checkpoints
15:09:13:WU01:FS01:0xa3:Mapping NT from 2 to 2 
15:09:13:WU01:FS01:0xa3:Resuming from checkpoint
15:09:13:WU01:FS01:0xa3:Verified 01/wudata_01.log
15:09:13:WU01:FS01:0xa3:Verified 01/wudata_01.trr
15:09:13:WU01:FS01:0xa3:Verified 01/wudata_01.edr
15:09:14:WU01:FS01:0xa3:Completed 127890 out of 500000 steps  (25%)
15:09:17:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
15:10:06:Removing old file 'configs/config-20140411-144451.xml'
15:10:06:Saving configuration to config.xml
15:10:06:<config>
15:10:06:  <!-- Folding Core -->
15:10:06:  <core-priority v='low'/>
15:10:06:
15:10:06:  <!-- Network -->
15:10:06:  <proxy v=':8080'/>
15:10:06:
15:10:06:  <!-- Slot Control -->
15:10:06:  <power v='full'/>
15:10:06:
15:10:06:  <!-- User Information -->
15:10:06:  <user v='willfolder'/>
15:10:06:
15:10:06:  <!-- Folding Slots -->
15:10:06:  <slot id='0' type='GPU'/>
15:10:06:  <slot id='1' type='CPU'/>
15:10:06:</config>
15:10:06:WU01:FS01:Starting
15:10:06:WARNING:WU01:FS01:Changed SMP threads from 2 to 3 this can cause some work units to fail
15:10:06:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 01 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 3
15:10:06:WU01:FS01:Started FahCore on PID 5952
15:10:06:WU01:FS01:Core PID:5380
15:10:06:WU01:FS01:FahCore 0xa3 started
15:10:07:WU01:FS01:0xa3:
15:10:07:WU01:FS01:0xa3:*------------------------------*
15:10:07:WU01:FS01:0xa3:Folding@Home Gromacs SMP Core
15:10:07:WU01:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
15:10:07:WU01:FS01:0xa3:
15:10:07:WU01:FS01:0xa3:Preparing to commence simulation
15:10:07:WU01:FS01:0xa3:- Looking at optimizations...
15:10:07:WU01:FS01:0xa3:- Files status OK
15:10:07:WU01:FS01:0xa3:- Expanded 3847725 -> 4382420 (decompressed 113.8 percent)
15:10:07:WU01:FS01:0xa3:Called DecompressByteArray: compressed_data_size=3847725 data_size=4382420, decompressed_data_size=4382420 diff=0
15:10:07:WU01:FS01:0xa3:- Digital signature verified
15:10:07:WU01:FS01:0xa3:
15:10:07:WU01:FS01:0xa3:Project: 8574 (Run 1, Clone 3, Gen 344)
15:10:07:WU01:FS01:0xa3:
15:10:07:WU01:FS01:0xa3:Assembly optimizations on if available.
15:10:07:WU01:FS01:0xa3:Entering M.D.
15:10:13:WU01:FS01:0xa3:Using Gromacs checkpoints
15:10:13:WU01:FS01:0xa3:Mapping NT from 3 to 3 
15:10:13:WU01:FS01:0xa3:Resuming from checkpoint
15:10:14:WU01:FS01:0xa3:Verified 01/wudata_01.log
15:10:14:WU01:FS01:0xa3:Verified 01/wudata_01.trr
15:10:14:WU01:FS01:0xa3:Verified 01/wudata_01.edr
15:10:14:WU01:FS01:0xa3:Completed 127890 out of 500000 steps  (25%)
15:11:59:WU00:FS00:0x17:Completed 375000 out of 5000000 steps (7%)
15:11:59:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:18:26:WU01:FS01:0xa3:Completed 130000 out of 500000 steps  (26%)

Deleted LInes...

21:05:16:WU01:FS01:0xa3:Completed 220000 out of 500000 steps  (44%)
******************************* Date: 2014-05-09 *******************************
21:24:30:WU01:FS01:0xa3:Completed 225000 out of 500000 steps  (45%)

Deleted LInes...

03:13:55:WU01:FS01:0xa3:Completed 315000 out of 500000 steps  (63%)
******************************* Date: 2014-05-10 *******************************
03:33:07:WU01:FS01:0xa3:Completed 320000 out of 500000 steps  (64%)

Deleted LInes...

09:19:22:WU01:FS01:0xa3:Completed 410000 out of 500000 steps  (82%)
******************************* Date: 2014-05-10 *******************************
09:38:57:WU01:FS01:0xa3:Completed 415000 out of 500000 steps  (83%)

Deleted LInes...

14:46:52:WU01:FS01:0xa3:Completed 495000 out of 500000 steps  (99%)
14:46:53:WU02:FS01:Connecting to 171.67.108.200:8080
14:46:54:WU02:FS01:Assigned to work server 128.143.231.202
14:46:54:WU02:FS01:Requesting new work unit for slot 01: RUNNING cpu:3 from 128.143.231.202
14:46:54:WU02:FS01:Connecting to 128.143.231.202:8080
14:46:56:WU02:FS01:Downloading 3.67MiB
14:47:02:WU02:FS01:Download 23.83%
14:47:08:WU02:FS01:Download 34.05%
14:47:14:WU02:FS01:Download 40.86%
14:47:20:WU02:FS01:Download 47.67%
14:47:26:WU02:FS01:Download 68.09%
14:47:32:WU02:FS01:Download 91.93%
14:47:35:WU02:FS01:Download complete
14:47:35:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8571 run:1 clone:7 gen:381 core:0xa3 unit:0x000013870a3b1e59522883ccb355d1db
14:48:52:WU00:FS00:0x17:Completed 750000 out of 5000000 steps (15%)
15:06:07:WU01:FS01:0xa3:Completed 500000 out of 500000 steps  (100%)
15:06:09:WU01:FS01:0xa3:DynamicWrapper: Finished Work Unit: sleep=10000
15:06:19:WU01:FS01:0xa3:
15:06:19:WU01:FS01:0xa3:Finished Work Unit:
15:06:19:WU01:FS01:0xa3:- Reading up to 8055456 from "01/wudata_01.trr": Read 8055456
15:06:19:WU01:FS01:0xa3:trr file hash check passed.
15:06:19:WU01:FS01:0xa3:edr file hash check passed.
15:06:19:WU01:FS01:0xa3:logfile size: 64619
15:06:19:WU01:FS01:0xa3:Leaving Run
15:06:20:WU01:FS01:0xa3:- Writing 8156907 bytes of core data to disk...
15:06:21:WU01:FS01:0xa3:Done: 8156395 -> 7528410 (compressed to 92.3 percent)
15:06:21:WU01:FS01:0xa3:  ... Done.
15:06:30:WU01:FS01:0xa3:- Shutting down core
15:06:30:WU01:FS01:0xa3:
15:06:30:WU01:FS01:0xa3:Folding@home Core Shutdown: FINISHED_UNIT
15:06:32:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
15:06:32:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8574 run:1 clone:3 gen:344 core:0xa3 unit:0x0000103c0a3b1e595228859dce87d0d1
15:06:32:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
15:06:32:WU01:FS01:Connecting to 128.143.231.202:8080
15:06:32:WU02:FS01:Starting
15:06:32:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 02 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 3
15:06:32:WU02:FS01:Started FahCore on PID 1792
15:06:32:WU02:FS01:Core PID:6184
15:06:32:WU02:FS01:FahCore 0xa3 started
15:06:33:WU02:FS01:0xa3:
15:06:33:WU02:FS01:0xa3:*------------------------------*
15:06:33:WU02:FS01:0xa3:Folding@Home Gromacs SMP Core
15:06:33:WU02:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
15:06:33:WU02:FS01:0xa3:
15:06:33:WU02:FS01:0xa3:Preparing to commence simulation
15:06:33:WU02:FS01:0xa3:- Looking at optimizations...
15:06:33:WU02:FS01:0xa3:- Created dyn
15:06:33:WU02:FS01:0xa3:- Files status OK
15:06:33:WU02:FS01:0xa3:- Expanded 3849184 -> 4383736 (decompressed 113.8 percent)
15:06:33:WU02:FS01:0xa3:Called DecompressByteArray: compressed_data_size=3849184 data_size=4383736, decompressed_data_size=4383736 diff=0
15:06:33:WU02:FS01:0xa3:- Digital signature verified
15:06:33:WU02:FS01:0xa3:
15:06:33:WU02:FS01:0xa3:Project: 8571 (Run 1, Clone 7, Gen 381)
15:06:33:WU02:FS01:0xa3:
15:06:33:WU02:FS01:0xa3:Assembly optimizations on if available.
15:06:33:WU02:FS01:0xa3:Entering M.D.
15:06:38:WU01:FS01:Upload 7.83%
15:06:39:WU02:FS01:0xa3:Mapping NT from 3 to 3 
15:06:39:WU02:FS01:0xa3:Completed 0 out of 500000 steps  (0%)
15:06:44:WU01:FS01:Upload 17.41%
15:06:50:WU01:FS01:Upload 25.24%
15:06:56:WU01:FS01:Upload 33.95%
15:07:02:WU01:FS01:Upload 43.52%
15:07:08:WU01:FS01:Upload 51.36%
15:07:14:WU01:FS01:Upload 60.06%
15:07:21:WU01:FS01:Upload 69.64%
15:07:27:WU01:FS01:Upload 79.21%
15:07:34:WU01:FS01:Upload 88.79%
15:07:40:WU01:FS01:Upload 97.49%
15:07:44:WU01:FS01:Upload complete
15:07:44:WU01:FS01:Server responded WORK_ACK (400)
15:07:44:WU01:FS01:Final credit estimate, 8137.00 points
15:07:44:WU01:FS01:Cleaning up
15:26:08:WU02:FS01:0xa3:Completed 5000 out of 500000 steps  (1%)
******************************* Date: 2014-05-10 *******************************
15:45:44:WU02:FS01:0xa3:Completed 10000 out of 500000 steps  (2%)

Deleted LInes...

21:37:18:WU02:FS01:0xa3:Completed 100000 out of 500000 steps  (20%)
******************************* Date: 2014-05-10 *******************************
21:56:43:WU02:FS01:0xa3:Completed 105000 out of 500000 steps  (21%)
03:49:03:WU02:FS01:0xa3:Completed 195000 out of 500000 steps  (39%)
******************************* Date: 2014-05-11 *******************************
04:08:28:WU02:FS01:0xa3:Completed 200000 out of 500000 steps  (40%)
09:59:16:WU02:FS01:0xa3:Completed 290000 out of 500000 steps  (58%)
******************************* Date: 2014-05-11 *******************************
10:18:40:WU02:FS01:0xa3:Completed 295000 out of 500000 steps  (59%)
16:09:26:WU02:FS01:0xa3:Completed 385000 out of 500000 steps  (77%)
******************************* Date: 2014-05-11 *******************************
16:28:47:WU02:FS01:0xa3:Completed 390000 out of 500000 steps  (78%)
22:20:07:WU02:FS01:0xa3:Completed 480000 out of 500000 steps  (96%)
******************************* Date: 2014-05-11 *******************************
22:40:20:WU02:FS01:0xa3:Completed 485000 out of 500000 steps  (97%)
23:00:02:WU02:FS01:0xa3:Completed 490000 out of 500000 steps  (98%)
23:19:44:WU02:FS01:0xa3:Completed 495000 out of 500000 steps  (99%)
23:19:46:WU01:FS01:Connecting to 171.67.108.200:8080
23:19:47:WU01:FS01:Assigned to work server 128.143.231.202
23:19:47:WU01:FS01:Requesting new work unit for slot 01: RUNNING cpu:3 from 128.143.231.202
23:19:47:WU01:FS01:Connecting to 128.143.231.202:8080
23:19:49:WU01:FS01:Downloading 3.67MiB
23:19:55:WU01:FS01:Download 23.84%
23:20:01:WU01:FS01:Download 42.57%
23:20:07:WU01:FS01:Download 64.70%
23:20:13:WU01:FS01:Download 86.84%
23:20:16:WU01:FS01:Download complete
23:20:16:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:8567 run:1 clone:5 gen:373 core:0xa3 unit:0x000012c80a3b1e5952278a09408cbcfa
23:39:21:WU02:FS01:0xa3:Completed 500000 out of 500000 steps  (100%)
23:39:23:WU02:FS01:0xa3:DynamicWrapper: Finished Work Unit: sleep=10000
23:39:33:WU02:FS01:0xa3:
23:39:33:WU02:FS01:0xa3:Finished Work Unit:
23:39:33:WU02:FS01:0xa3:- Reading up to 8057520 from "02/wudata_01.trr": Read 8057520
23:39:33:WU02:FS01:0xa3:trr file hash check passed.
23:39:33:WU02:FS01:0xa3:edr file hash check passed.
23:39:33:WU02:FS01:0xa3:logfile size: 63978
23:39:33:WU02:FS01:0xa3:Leaving Run
23:39:34:WU02:FS01:0xa3:- Writing 8158330 bytes of core data to disk...
23:39:36:WU02:FS01:0xa3:Done: 8157818 -> 7531910 (compressed to 92.3 percent)
23:39:36:WU02:FS01:0xa3:  ... Done.
23:39:38:WU02:FS01:0xa3:- Shutting down core
23:39:38:WU02:FS01:0xa3:
23:39:38:WU02:FS01:0xa3:Folding@home Core Shutdown: FINISHED_UNIT
23:39:38:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
23:39:38:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:8571 run:1 clone:7 gen:381 core:0xa3 unit:0x000013870a3b1e59522883ccb355d1db
23:39:38:WU02:FS01:Uploading 7.18MiB to 128.143.231.202
23:39:38:WU02:FS01:Connecting to 128.143.231.202:8080
23:39:38:WU01:FS01:Starting
23:39:38:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 01 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 3
23:39:38:WU01:FS01:Started FahCore on PID 7888
23:39:38:WU01:FS01:Core PID:6820
23:39:38:WU01:FS01:FahCore 0xa3 started
23:39:39:WU01:FS01:0xa3:
23:39:39:WU01:FS01:0xa3:*------------------------------*
23:39:39:WU01:FS01:0xa3:Folding@Home Gromacs SMP Core
23:39:39:WU01:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
23:39:39:WU01:FS01:0xa3:
23:39:39:WU01:FS01:0xa3:Preparing to commence simulation
23:39:39:WU01:FS01:0xa3:- Looking at optimizations...
23:39:39:WU01:FS01:0xa3:- Created dyn
23:39:39:WU01:FS01:0xa3:- Files status OK
23:39:39:WU01:FS01:0xa3:- Expanded 3848530 -> 4383072 (decompressed 113.8 percent)
23:39:39:WU01:FS01:0xa3:Called DecompressByteArray: compressed_data_size=3848530 data_size=4383072, decompressed_data_size=4383072 diff=0
23:39:39:WU01:FS01:0xa3:- Digital signature verified
23:39:39:WU01:FS01:0xa3:
23:39:39:WU01:FS01:0xa3:Project: 8567 (Run 1, Clone 5, Gen 373)
23:39:39:WU01:FS01:0xa3:
23:39:39:WU01:FS01:0xa3:Assembly optimizations on if available.
23:39:39:WU01:FS01:0xa3:Entering M.D.
23:39:44:WU02:FS01:Upload 7.83%
23:39:45:WU01:FS01:0xa3:Mapping NT from 3 to 3 
23:39:46:WU01:FS01:0xa3:Completed 0 out of 500000 steps  (0%)
23:39:51:WU02:FS01:Upload 17.40%
23:39:57:WU02:FS01:Upload 26.10%
23:40:04:WU02:FS01:Upload 35.67%
23:40:10:WU02:FS01:Upload 45.24%
23:40:17:WU02:FS01:Upload 54.81%
23:40:23:WU02:FS01:Upload 63.51%
23:40:29:WU02:FS01:Upload 73.08%
23:40:35:WU02:FS01:Upload 80.91%
23:40:41:WU02:FS01:Upload 90.49%
23:40:48:WU02:FS01:Upload 99.19%
23:40:50:WU02:FS01:Upload complete
23:40:50:WU02:FS01:Server responded WORK_ACK (400)
23:40:50:WU02:FS01:Final credit estimate, 9199.00 points
23:40:50:WU02:FS01:Cleaning up
23:59:11:WU01:FS01:0xa3:Completed 5000 out of 500000 steps  (1%)
04:33:27:WU00:FS00:0x17:Completed 1350000 out of 5000000 steps (27%)
******************************* Date: 2014-05-12 *******************************
04:50:44:WU01:FS01:0xa3:Completed 80000 out of 500000 steps  (16%)
06:27:46:WU01:FS01:0xa3:Completed 105000 out of 500000 steps  (21%)
06:37:17:FS00:Paused
06:37:17:FS01:Paused
06:37:17:FS00:Shutting core down
06:37:17:FS01:Shutting core down
06:37:17:WU00:FS00:0x17:WARNING:Console control signal 1 on PID 6068
06:37:17:WU00:FS00:0x17:Exiting, please wait. . .
06:37:18:WU00:FS00:0x17:Lost lifeline PID 3896, exiting
06:37:18:WU00:FS00:0x17:ERROR:103: Lost client lifeline
06:37:18:WU00:FS00:0x17:Folding@home Core Shutdown: CLIENT_DIED
06:37:19:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
06:37:24:WU01:FS01:0xa3:Client no longer detected. Shutting down core 
06:37:24:WU01:FS01:0xa3:
06:37:24:WU01:FS01:0xa3:Folding@home Core Shutdown: CLIENT_DIED
06:37:24:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
06:37:31:Removing old file 'configs/config-20140414-065519.xml'
06:37:31:Saving configuration to config.xml
06:37:31:<config>
06:37:31:  <!-- Folding Core -->
06:37:31:  <core-priority v='low'/>
06:37:31:
06:37:31:  <!-- Network -->
06:37:31:  <proxy v=':8080'/>
06:37:31:
06:37:31:  <!-- Slot Control -->
06:37:31:  <power v='full'/>
06:37:31:
06:37:31:  <!-- User Information -->
06:37:31:  <user v='willfolder'/>
06:37:31:
06:37:31:  <!-- Folding Slots -->
06:37:31:  <slot id='0' type='GPU'>
06:37:31:    <paused v='true'/>
06:37:31:  </slot>
06:37:31:  <slot id='1' type='CPU'>
06:37:31:    <paused v='true'/>
06:37:31:  </slot>
06:37:31:</config>
07:51:03:FS00:Unpaused
07:51:03:FS01:Unpaused
07:51:03:WU00:FS00:Starting
07:51:03:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
07:51:03:WU00:FS00:Started FahCore on PID 7424
07:51:03:WU00:FS00:Core PID:4812
07:51:03:WU00:FS00:FahCore 0x17 started
07:51:03:WU01:FS01:Starting
07:51:03:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 01 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 3
07:51:03:WU01:FS01:Started FahCore on PID 4120
07:51:03:WU01:FS01:Core PID:4224
07:51:03:WU01:FS01:FahCore 0xa3 started
07:51:04:WU00:FS00:0x17:*********************** Log Started 2014-05-12T07:51:03Z ***********************
07:51:04:WU00:FS00:0x17:Project: 13000 (Run 1362, Clone 7, Gen 13)
07:51:04:WU00:FS00:0x17:Unit: 0x0000001d538b3db753111cca642ae138
07:51:04:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
07:51:04:WU00:FS00:0x17:Machine: 0
07:51:04:WU00:FS00:0x17:Digital signatures verified
07:51:04:WU00:FS00:0x17:Folding@home GPU core17
07:51:04:WU00:FS00:0x17:Version 0.0.52
07:51:04:WU00:FS00:0x17:  Found a checkpoint file
07:51:04:WU01:FS01:0xa3:
07:51:04:WU01:FS01:0xa3:*------------------------------*
07:51:04:WU01:FS01:0xa3:Folding@Home Gromacs SMP Core
07:51:04:WU01:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
07:51:04:WU01:FS01:0xa3:
07:51:04:WU01:FS01:0xa3:Preparing to commence simulation
07:51:04:WU01:FS01:0xa3:- Looking at optimizations...
07:51:04:WU01:FS01:0xa3:- Files status OK
07:51:04:WU01:FS01:0xa3:- Expanded 3848530 -> 4383072 (decompressed 113.8 percent)
07:51:04:WU01:FS01:0xa3:Called DecompressByteArray: compressed_data_size=3848530 data_size=4383072, decompressed_data_size=4383072 diff=0
07:51:04:WU01:FS01:0xa3:- Digital signature verified
07:51:04:WU01:FS01:0xa3:
07:51:04:WU01:FS01:0xa3:Project: 8567 (Run 1, Clone 5, Gen 373)
07:51:04:WU01:FS01:0xa3:
07:51:04:WU01:FS01:0xa3:Assembly optimizations on if available.
07:51:04:WU01:FS01:0xa3:Entering M.D.
07:51:10:WU01:FS01:0xa3:Using Gromacs checkpoints
07:51:10:WU01:FS01:0xa3:Mapping NT from 3 to 3 
07:51:10:WU01:FS01:0xa3:Resuming from checkpoint
07:51:10:WU01:FS01:0xa3:Verified 01/wudata_01.log
07:51:10:WU01:FS01:0xa3:Verified 01/wudata_01.trr
07:51:10:WU01:FS01:0xa3:Verified 01/wudata_01.edr
07:51:11:WU01:FS01:0xa3:Completed 104230 out of 500000 steps  (20%)
07:51:44:Removing old file 'configs/config-20140414-145336.xml'
07:51:44:Saving configuration to config.xml
07:51:44:<config>
07:51:44:  <!-- Folding Core -->
07:51:44:  <core-priority v='low'/>
07:51:44:
07:51:44:  <!-- Network -->
07:51:44:  <proxy v=':8080'/>
07:51:44:
07:51:44:  <!-- Slot Control -->
07:51:44:  <power v='full'/>
07:51:44:
07:51:44:  <!-- User Information -->
07:51:44:  <user v='willfolder'/>
07:51:44:
07:51:44:  <!-- Folding Slots -->
07:51:44:  <slot id='0' type='GPU'/>
07:51:44:  <slot id='1' type='CPU'/>
07:51:44:</config>
07:53:55:WU00:FS00:0x17:Completed 1375000 out of 5000000 steps (27%)
07:53:55:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
07:54:17:WU01:FS01:0xa3:Completed 105000 out of 500000 steps  (21%)
07:57:25:FS00:Paused
07:57:25:FS01:Paused
07:57:26:FS00:Shutting core down
07:57:26:FS01:Shutting core down
07:57:26:WU00:FS00:0x17:WARNING:Console control signal 1 on PID 4812
07:57:26:WU00:FS00:0x17:Exiting, please wait. . .
07:57:26:WU00:FS00:0x17:Lost lifeline PID 7424, exiting
07:57:26:WU00:FS00:0x17:ERROR:103: Lost client lifeline
07:57:26:WU00:FS00:0x17:Folding@home Core Shutdown: CLIENT_DIED
07:57:27:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
07:57:35:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
07:57:50:Removing old file 'configs/config-20140415-061226.xml'
07:57:50:Saving configuration to config.xml
07:57:50:<config>
07:57:50:  <!-- Folding Core -->
07:57:50:  <core-priority v='low'/>
07:57:50:
07:57:50:  <!-- Network -->
07:57:50:  <proxy v=':8080'/>
07:57:50:
07:57:50:  <!-- Slot Control -->
07:57:50:  <power v='full'/>
07:57:50:
07:57:50:  <!-- User Information -->
07:57:50:  <user v='willfolder'/>
07:57:50:
07:57:50:  <!-- Folding Slots -->
07:57:50:  <slot id='0' type='GPU'>
07:57:50:    <paused v='true'/>
07:57:50:  </slot>
07:57:50:  <slot id='1' type='CPU'>
07:57:50:    <paused v='true'/>
07:57:50:  </slot>
07:57:50:</config>
08:37:47:FS00:Unpaused
08:37:47:FS01:Unpaused
08:37:47:WU00:FS00:Starting
08:37:47:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
08:37:47:WU00:FS00:Started FahCore on PID 5540
08:37:47:WU00:FS00:Core PID:6052
08:37:47:WU00:FS00:FahCore 0x17 started
08:37:47:WU01:FS01:Starting
08:37:47:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 01 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 3
08:37:47:WU01:FS01:Started FahCore on PID 6936
08:37:47:WU01:FS01:Core PID:6756
08:37:47:WU01:FS01:FahCore 0xa3 started
08:37:48:WU00:FS00:0x17:*********************** Log Started 2014-05-12T08:37:47Z ***********************
08:37:48:WU00:FS00:0x17:Project: 13000 (Run 1362, Clone 7, Gen 13)
08:37:48:WU00:FS0
0:0x17:Unit: 0x0000001d538b3db753111cca642ae138
08:37:48:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
08:37:48:WU00:FS00:0x17:Machine: 0
08:37:48:WU00:FS00:0x17:Digital signatures verified
08:37:48:WU00:FS00:0x17:Folding@home GPU core17
08:37:48:WU00:FS00:0x17:Version 0.0.52
08:37:48:WU00:FS00:0x17:  Found a checkpoint file
08:37:48:WU01:FS01:0xa3:
08:37:48:WU01:FS01:0xa3:*------------------------------*
08:37:48:WU01:FS01:0xa3:Folding@Home Gromacs SMP Core
08:37:48:WU01:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
08:37:48:WU01:FS01:0xa3:
08:37:48:WU01:FS01:0xa3:Preparing to commence simulation
08:37:48:WU01:FS01:0xa3:- Looking at optimizations...
08:37:48:WU01:FS01:0xa3:- Files status OK
08:37:48:WU01:FS01:0xa3:- Expanded 3848530 -> 4383072 (decompressed 113.8 percent)
08:37:48:WU01:FS01:0xa3:Called DecompressByteArray: compressed_data_size=3848530 data_size=4383072, decompressed_data_size=4383072 diff=0
08:37:48:WU01:FS01:0xa3:- Digital signature verified
08:37:48:WU01:FS01:0xa3:
08:37:48:WU01:FS01:0xa3:Project: 8567 (Run 1, Clone 5, Gen 373)
08:37:48:WU01:FS01:0xa3:
08:37:48:WU01:FS01:0xa3:Assembly optimizations on if available.
08:37:48:WU01:FS01:0xa3:Entering M.D.
08:37:54:WU01:FS01:0xa3:Using Gromacs checkpoints
08:37:54:WU01:FS01:0xa3:Mapping NT from 3 to 3 
08:37:55:WU01:FS01:0xa3:Resuming from checkpoint
08:37:55:WU01:FS01:0xa3:Verified 01/wudata_01.log
08:37:55:WU01:FS01:0xa3:Verified 01/wudata_01.trr
08:37:55:WU01:FS01:0xa3:Verified 01/wudata_01.edr
08:37:55:WU01:FS01:0xa3:Completed 104230 out of 500000 steps  (20%)
08:38:30:Removing old file 'configs/config-20140417-071133.xml'
08:38:30:Saving configuration to config.xml
08:38:30:<config>
08:38:30:  <!-- Folding Core -->
08:38:30:  <core-priority v='low'/>
08:38:30:
08:38:30:  <!-- Network -->
08:38:30:  <proxy v=':8080'/>
08:38:30:
08:38:30:  <!-- Slot Control -->
08:38:30:  <power v='full'/>
08:38:30:
08:38:30:  <!-- User Information -->
08:38:30:  <user v='willfolder'/>
08:38:30:
08:38:30:  <!-- Folding Slots -->
08:38:30:  <slot id='0' type='GPU'/>
08:38:30:  <slot id='1' type='CPU'/>
08:38:30:</config>
08:40:43:WU00:FS00:0x17:Completed 1375000 out of 5000000 steps (27%)
08:40:43:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:41:00:WU01:FS01:0xa3:Completed 105000 out of 500000 steps  (21%)
08:48:00:FS00:Paused
08:48:00:FS01:Paused
08:48:00:FS00:Shutting core down
08:48:00:FS01:Shutting core down
08:48:01:WU00:FS00:0x17:WARNING:Console control signal 1 on PID 6052
08:48:01:WU00:FS00:0x17:Exiting, please wait. . .
08:48:01:WU00:FS00:0x17:Folding@home Core Shutdown: INTERRUPTED
08:48:01:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
08:48:09:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
08:48:40:Removing old file 'configs/config-20140417-145610.xml'
08:48:40:Saving configuration to config.xml
08:48:40:<config>
08:48:40:  <!-- Folding Core -->
08:48:40:  <core-priority v='low'/>
08:48:40:
08:48:40:  <!-- Network -->
08:48:40:  <proxy v=':8080'/>
08:48:40:
08:48:40:  <!-- Slot Control -->
08:48:40:  <power v='full'/>
08:48:40:
08:48:40:  <!-- User Information -->
08:48:40:  <user v='willfolder'/>
08:48:40:
08:48:40:  <!-- Folding Slots -->
08:48:40:  <slot id='0' type='GPU'>
08:48:40:    <paused v='true'/>
08:48:40:  </slot>
08:48:40:  <slot id='1' type='CPU'>
08:48:40:    <paused v='true'/>
08:48:40:  </slot>
08:48:40:</config>
09:45:35:FS00:Unpaused
09:45:35:FS01:Unpaused
09:45:35:WU00:FS00:Starting
09:45:35:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
09:45:35:WU00:FS00:Started FahCore on PID 1428
09:45:35:WU00:FS00:Core PID:4868
09:45:35:WU00:FS00:FahCore 0x17 started
09:45:35:WU01:FS01:Starting
09:45:36:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 01 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 3
09:45:36:WU01:FS01:Started FahCore on PID 404
09:45:36:WU01:FS01:Core PID:5152
09:45:36:WU01:FS01:FahCore 0xa3 started
09:45:36:Removing old file 'configs/config-20140425-063228.xml'
09:45:36:Saving configuration to config.xml
09:45:36:<config>
09:45:36:  <!-- Folding Core -->
09:45:36:  <core-priority v='low'/>
09:45:36:
09:45:36:  <!-- Network -->
09:45:36:  <proxy v=':8080'/>
09:45:36:
09:45:36:  <!-- Slot Control -->
09:45:36:  <power v='full'/>
09:45:36:
09:45:36:  <!-- User Information -->
09:45:36:  <user v='willfolder'/>
09:45:36:
09:45:36:  <!-- Folding Slots -->
09:45:36:  <slot id='0' type='GPU'/>
09:45:36:  <slot id='1' type='CPU'/>
09:45:36:</config>
09:45:36:WU00:FS00:0x17:*********************** Log Started 2014-05-12T09:45:36Z ***********************
09:45:36:WU00:FS00:0x17:Project: 13000 (Run 1362, Clone 7, Gen 13)
09:45:36:WU00:FS00:0x17:Unit: 0x0000001d538b3db753111cca642ae138
09:45:36:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
09:45:36:WU00:FS00:0x17:Machine: 0
09:45:36:WU00:FS00:0x17:Digital signatures verified
09:45:36:WU00:FS00:0x17:Folding@home GPU core17
09:45:36:WU00:FS00:0x17:Version 0.0.52
09:45:36:WU00:FS00:0x17:  Found a checkpoint file
09:45:36:WU01:FS01:0xa3:
09:45:36:WU01:FS01:0xa3:*------------------------------*
09:45:36:WU01:FS01:0xa3:Folding@Home Gromacs SMP Core
09:45:36:WU01:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
09:45:36:WU01:FS01:0xa3:
09:45:36:WU01:FS01:0xa3:Preparing to commence simulation
09:45:36:WU01:FS01:0xa3:- Looking at optimizations...
09:45:36:WU01:FS01:0xa3:- Files status OK
09:45:36:WU01:FS01:0xa3:- Expanded 3848530 -> 4383072 (decompressed 113.8 percent)
09:45:36:WU01:FS01:0xa3:Called DecompressByteArray: compressed_data_size=3848530 data_size=4383072, decompressed_data_size=4383072 diff=0
09:45:36:WU01:FS01:0xa3:- Digital signature verified
09:45:36:WU01:FS01:0xa3:
09:45:36:WU01:FS01:0xa3:Project: 8567 (Run 1, Clone 5, Gen 373)
09:45:36:WU01:FS01:0xa3:
09:45:36:WU01:FS01:0xa3:Assembly optimizations on if available.
09:45:36:WU01:FS01:0xa3:Entering M.D.
09:45:42:WU01:FS01:0xa3:Using Gromacs checkpoints
09:45:42:WU01:FS01:0xa3:Mapping NT from 3 to 3 
09:45:43:WU01:FS01:0xa3:Resuming from checkpoint
09:45:43:WU01:FS01:0xa3:Verified 01/wudata_01.log
09:45:43:WU01:FS01:0xa3:Verified 01/wudata_01.trr
09:45:43:WU01:FS01:0xa3:Verified 01/wudata_01.edr
09:45:43:WU01:FS01:0xa3:Completed 104230 out of 500000 steps  (20%)
09:48:27:WU00:FS00:0x17:Completed 1375000 out of 5000000 steps (27%)
09:48:27:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
09:48:50:WU01:FS01:0xa3:Completed 105000 out of 500000 steps  (21%)
10:08:18:WU01:FS01:0xa3:Completed 110000 out of 500000 steps  (22%)
10:10:53:FS00:Paused
10:10:53:FS01:Paused
10:10:53:FS00:Shutting core down
10:10:53:FS01:Shutting core down
10:10:54:WU00:FS00:0x17:WARNING:Console control signal 1 on PID 4868
10:10:54:WU00:FS00:0x17:Exiting, please wait. . .
10:10:59:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
10:11:01:Removing old file 'configs/config-20140425-144937.xml'
10:11:01:Saving configuration to config.xml
10:11:01:<config>
10:11:01:  <!-- Folding Core -->
10:11:01:  <core-priority v='low'/>
10:11:01:
10:11:01:  <!-- Network -->
10:11:01:  <proxy v=':8080'/>
10:11:01:
10:11:01:  <!-- Slot Control -->
10:11:01:  <power v='full'/>
10:11:01:
10:11:01:  <!-- User Information -->
10:11:01:  <user v='willfolder'/>
10:11:01:
10:11:01:  <!-- Folding Slots -->
10:11:01:  <slot id='0' type='GPU'>
10:11:01:    <paused v='true'/>
10:11:01:  </slot>
10:11:01:  <slot id='1' type='CPU'>
10:11:01:    <paused v='true'/>
10:11:01:  </slot>
10:11:01:</config>
10:11:01:WU00:FS00:0x17:Lost lifeline PID 1428, exiting
10:11:01:WU00:FS00:0x17:ERROR:103: Lost client lifeline
10:11:01:WU00:FS00:0x17:Folding@home Core Shutdown: CLIENT_DIED
10:11:02:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
10:15:04:FS00:Unpaused
10:15:04:FS01:Unpaused
10:15:04:WU00:FS00:Starting
10:15:04:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:15:04:WU00:FS00:Started FahCore on PID 3632
10:15:04:WU00:FS00:Core PID:4628
10:15:04:WU00:FS00:FahCore 0x17 started
10:15:04:WU01:FS01:Starting
10:15:04:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 01 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 3
10:15:04:WU01:FS01:Started FahCore on PID 4876
10:15:04:WU01:FS01:Core PID:3108
10:15:04:WU01:FS01:FahCore 0xa3 started
10:15:05:Removing old file 'configs/config-20140429-145515.xml'
10:15:05:Saving configuration to config.xml
10:15:05:<config>
10:15:05:  <!-- Folding Core -->
10:15:05:  <core-priority v='low'/>
10:15:05:
10:15:05:  <!-- Network -->
10:15:05:  <proxy v=':8080'/>
10:15:05:
10:15:05:  <!-- Slot Control -->
10:15:05:  <power v='full'/>
10:15:05:
10:15:05:  <!-- User Information -->
10:15:05:  <user v='willfolder'/>
10:15:05:
10:15:05:  <!-- Folding Slots -->
10:15:05:  <slot id='0' type='GPU'/>
10:15:05:  <slot id='1' type='CPU'/>
10:15:05:</config>
10:15:05:WU00:FS00:0x17:*********************** Log Started 2014-05-12T10:15:04Z ***********************
10:15:05:WU00:FS00:0x17:Project: 13000 (Run 1362, Clone 7, Gen 13)
10:15:05:WU00:FS00:0x17:Unit: 0x0000001d538b3db753111cca642ae138
10:15:05:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
10:15:05:WU00:FS00:0x17:Machine: 0
10:15:05:WU00:FS00:0x17:Digital signatures verified
10:15:05:WU00:FS00:0x17:Folding@home GPU core17
10:15:05:WU00:FS00:0x17:Version 0.0.52
10:15:05:WU00:FS00:0x17:  Found a checkpoint file
10:15:05:WU01:FS01:0xa3:
10:15:05:WU01:FS01:0xa3:*------------------------------*
10:15:05:WU01:FS01:0xa3:Folding@Home Gromacs SMP Core
10:15:05:WU01:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
10:15:05:WU01:FS01:0xa3:
10:15:05:WU01:FS01:0xa3:Preparing to commence simulation
10:15:05:WU01:FS01:0xa3:- Looking at optimizations...
10:15:05:WU01:FS01:0xa3:- Files status OK
10:15:05:WU01:FS01:0xa3:- Expanded 3848530 -> 4383072 (decompressed 113.8 percent)
10:15:05:WU01:FS01:0xa3:Called DecompressByteArray: compressed_data_size=3848530 data_size=4383072, decompressed_data_size=4383072 diff=0
10:15:05:WU01:FS01:0xa3:- Digital signature verified
10:15:05:WU01:FS01:0xa3:
10:15:05:WU01:FS01:0xa3:Project: 8567 (Run 1, Clone 5, Gen 373)
10:15:05:WU01:FS01:0xa3:
10:15:05:WU01:FS01:0xa3:Assembly optimizations on if available.
10:15:05:WU01:FS01:0xa3:Entering M.D.
10:15:11:WU01:FS01:0xa3:Using Gromacs checkpoints
10:15:11:WU01:FS01:0xa3:Mapping NT from 3 to 3 
10:15:12:WU01:FS01:0xa3:Resuming from checkpoint
10:15:12:WU01:FS01:0xa3:Verified 01/wudata_01.log
10:15:12:WU01:FS01:0xa3:Verified 01/wudata_01.trr
10:15:12:WU01:FS01:0xa3:Verified 01/wudata_01.edr
10:15:12:WU01:FS01:0xa3:Completed 108065 out of 500000 steps  (21%)
10:18:02:WU00:FS00:0x17:Completed 1375000 out of 5000000 steps (27%)
10:18:02:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
10:22:45:FS00:Paused
10:22:45:FS01:Paused
10:22:45:FS00:Shutting core down
10:22:45:FS01:Shutting core down
10:22:45:WU00:FS00:0x17:WARNING:Console control signal 1 on PID 4628
10:22:45:WU00:FS00:0x17:Exiting, please wait. . .
10:22:46:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
10:22:51:WU00:FS00:0x17:Lost lifeline PID 3632, exiting
10:22:51:WU00:FS00:0x17:ERROR:103: Lost client lifeline
10:22:51:WU00:FS00:0x17:Folding@home Core Shutdown: CLIENT_DIED
10:22:51:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
10:23:13:Removing old file 'configs/config-20140430-065903.xml'
10:23:13:Saving configuration to config.xml
10:23:13:<config>
10:23:13:  <!-- Folding Core -->
10:23:13:  <core-priority v='low'/>
10:23:13:
10:23:13:  <!-- Network -->
10:23:13:  <proxy v=':8080'/>
10:23:13:
10:23:13:  <!-- Slot Control -->
10:23:13:  <power v='full'/>
10:23:13:
10:23:13:  <!-- User Information -->
10:23:13:  <user v='willfolder'/>
10:23:13:
10:23:13:  <!-- Folding Slots -->
10:23:13:  <slot id='0' type='GPU'>
10:23:13:    <paused v='true'/>
10:23:13:  </slot>
10:23:13:  <slot id='1' type='CPU'>
10:23:13:    <paused v='true'/>
10:23:13:  </slot>
10:23:13:</config>
10:32:23:Removing old file 'configs/config-20140430-070004.xml'
10:32:23:Saving configuration to config.xml
10:32:23:<config>
10:32:23:  <!-- Folding Core -->
10:32:23:  <core-priority v='low'/>
10:32:23:
10:32:23:  <!-- Network -->
10:32:23:  <proxy v=':8080'/>
10:32:23:
10:32:23:  <!-- Slot Control -->
10:32:23:  <pause-on-battery v='false'/>
10:32:23:  <power v='full'/>
10:32:23:
10:32:23:  <!-- User Information -->
10:32:23:  <user v='willfolder'/>
10:32:23:
10:32:23:  <!-- Folding Slots -->
10:32:23:  <slot id='0' type='GPU'>
10:32:23:    <paused v='true'/>
10:32:23:  </slot>
10:32:23:  <slot id='1' type='CPU'>
10:32:23:    <paused v='true'/>
10:32:23:  </slot>
10:32:23:</config>
10:33:23:Removing old file 'configs/config-20140430-145451.xml'
10:33:23:Saving configuration to config.xml
10:33:23:<config>
10:33:23:  <!-- Folding Core -->
10:33:23:  <core-priority v='low'/>
10:33:23:
10:33:23:  <!-- Network -->
10:33:23:  <proxy v=':8080'/>
10:33:23:
10:33:23:  <!-- Slot Control -->
10:33:23:  <pause-on-battery v='false'/>
10:33:23:  <power v='full'/>
10:33:23:
10:33:23:  <!-- User Information -->
10:33:23:  <user v='willfolder'/>
10:33:23:
10:33:23:  <!-- Folding Slots -->
10:33:23:  <slot id='0' type='GPU'>
10:33:23:    <paused v='true'/>
10:33:23:  </slot>
10:33:23:  <slot id='1' type='CPU'>
10:33:23:    <paused v='true'/>
10:33:23:  </slot>
10:33:23:</config>
******************************* Date: 2014-05-12 *******************************
10:55:12:FS00:Unpaused
10:55:12:FS01:Unpaused
10:55:12:WU00:FS00:Starting
10:55:12:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:55:12:WU00:FS00:Started FahCore on PID 1140
10:55:12:WU00:FS00:Core PID:5132
10:55:12:WU00:FS00:FahCore 0x17 started
10:55:12:WU01:FS01:Starting
10:55:12:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 01 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -np 3
10:55:12:WU01:FS01:Started FahCore on PID 3512
10:55:12:WU01:FS01:Core PID:5220
10:55:12:WU01:FS01:FahCore 0xa3 started
10:55:12:WU00:FS00:0x17:*********************** Log Started 2014-05-12T10:55:12Z ***********************
10:55:12:WU00:FS00:0x17:Project: 13000 (Run 1362, Clone 7, Gen 13)
10:55:12:WU00:FS00:0x17:Unit: 0x0000001d538b3db753111cca642ae138
10:55:12:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
10:55:12:WU00:FS00:0x17:Machine: 0
10:55:12:WU00:FS00:0x17:Digital signatures verified
10:55:12:WU00:FS00:0x17:Folding@home GPU core17
10:55:12:WU00:FS00:0x17:Version 0.0.52
10:55:12:WU00:FS00:0x17:  Found a checkpoint file
10:55:12:WU01:FS01:0xa3:
10:55:12:WU01:FS01:0xa3:*------------------------------*
10:55:12:WU01:FS01:0xa3:Folding@Home Gromacs SMP Core
10:55:12:WU01:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
10:55:12:WU01:FS01:0xa3:
10:55:12:WU01:FS01:0xa3:Preparing to commence simulation
10:55:12:WU01:FS01:0xa3:- Looking at optimizations...
10:55:12:WU01:FS01:0xa3:- Files status OK
10:55:12:WU01:FS01:0xa3:- Expanded 3848530 -> 4383072 (decompressed 113.8 percent)
10:55:12:WU01:FS01:0xa3:Called DecompressByteArray: compressed_data_size=3848530 data_size=4383072, decompressed_data_size=4383072 diff=0
10:55:12:WU01:FS01:0xa3:- Digital signature verified
10:55:12:WU01:FS01:0xa3:
10:55:12:WU01:FS01:0xa3:Project: 8567 (Run 1, Clone 5, Gen 373)
10:55:12:WU01:FS01:0xa3:
10:55:12:WU01:FS01:0xa3:Assembly optimizations on if available.
10:55:12:WU01:FS01:0xa3:Entering M.D.
10:55:18:WU01:FS01:0xa3:Using Gromacs checkpoints
10:55:19:WU01:FS01:0xa3:Mapping NT from 3 to 3 
10:55:19:WU01:FS01:0xa3:Resuming from checkpoint
10:55:19:WU01:FS01:0xa3:Verified 01/wudata_01.log
10:55:19:WU01:FS01:0xa3:Verified 01/wudata_01.trr
10:55:19:WU01:FS01:0xa3:Verified 01/wudata_01.edr
10:55:20:WU01:FS01:0xa3:Completed 108065 out of 500000 steps  (21%)
10:55:45:Removing old file 'configs/config-20140506-072949.xml'
10:55:45:Saving configuration to config.xml
10:55:45:<config>
10:55:45:  <!-- Folding Core -->
10:55:45:  <core-priority v='low'/>
10:55:45:
10:55:45:  <!-- Network -->
10:55:45:  <proxy v=':8080'/>
10:55:45:
10:55:45:  <!-- Slot Control -->
10:55:45:  <pause-on-battery v='false'/>
10:55:45:  <power v='full'/>
10:55:45:
10:55:45:  <!-- User Information -->
10:55:45:  <user v='willfolder'/>
10:55:45:
10:55:45:  <!-- Folding Slots -->
10:55:45:  <slot id='0' type='GPU'/>
10:55:45:  <slot id='1' type='CPU'/>
10:55:45:</config>
10:58:05:WU00:FS00:0x17:Completed 1375000 out of 5000000 steps (27%)
10:58:05:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
11:03:13:WU01:FS01:0xa3:Completed 110000 out of 500000 steps  (22%)
11:03:30:FS00:Paused
11:03:30:FS01:Paused
11:03:30:FS00:Shutting core down
11:03:30:FS01:Shutting core down
11:03:30:WU00:FS00:0x17:WARNING:Console control signal 1 on PID 5132
11:03:30:WU00:FS00:0x17:Exiting, please wait. . .
11:03:33:WU01:FS01:0xa3:Client no longer detected. Shutting down core 
11:03:33:WU01:FS01:0xa3:
11:03:33:WU01:FS01:0xa3:Folding@home Core Shutdown: CLIENT_DIED
11:03:34:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
11:03:39:WU00:FS00:0x17:Lost lifeline PID 1140, exiting
11:03:39:WU00:FS00:0x17:ERROR:103: Lost client lifeline
11:03:39:WU00:FS00:0x17:Folding@home Core Shutdown: CLIENT_DIED

Deleted last lines to make log < 60,000

Re: GPU workunits given too short time to complete

Posted: Mon May 12, 2014 7:52 pm
by bruce
Compared to other GPUs, the GT 610 is on the extreme low performace tier of supported GPUs. Over the past year or two, FAH has concentrated on getting the maximum performance out of the high-end GPUs and done little to utilize low-end GPUs. The good news is that there's a plan although I can make no promises about when it will be implemented. I, too, have a mixture of low-end and mid-range GPUs so I understand your predicament.

At the present time, there is no straightforward way to choose WUs from projects with deadlines that you might be able to meet (if there are any). Folding 24x7 would be a step in the right direction but that may not be an option that you choose (and I cannot guarantee that it would solve the problem). The only other option is to (temporarily) suspend folding on your GPU.

As I said, development is working on a plan that will probably deal with this issue. (At its current level of development, I suspect it will be a permanent solution for folks like you.) This will be a radically new method of folding that does not follow the historic pattern of downloading a WU, processing it, and returning it before a deadline. This is currently being developed and is undergoing limited tested on Linux. Once it's working as expected, it will undergo additional beta testing on Windows and then will be available to the general public. It is impossible to predict when it will be rolled out. Personally, I hope it's soon for the sake of you and others who may have a low-end GPUs and/or wish to fold part-time and still wish to contribute to FAH.

Re: GPU workunits given too short time to complete

Posted: Tue May 13, 2014 6:41 am
by willfolder
Thanks for the response. I will disable the GPU and just continue with the CPU. Also, when both CPU and GPU are enabled for folding the computer is unusable for other work.
With the GPU disabled I can still fold in the background while working on the computer.

Surely there are enough of us out there with "low power GPUs" to be worth devoting some time to getting work out of them. Not everyone has a Titan.

Re: GPU workunits given too short time to complete

Posted: Tue May 13, 2014 2:05 pm
by 7im
Low power GPUs work well folding full time. There is a trade off when folding part time. Slightly faster hardware is needed to meet the deadlines.

Re: GPU workunits given too short time to complete

Posted: Tue May 13, 2014 5:15 pm
by bruce
Yes, there are enough low-power GPUs out there to be worth devoting time to this sort of an improvment. It's all a question of priorites.

FAH has very limited developent resources and they have lots of things that could benefit from development time. I also know enough about some of the things they're working on and their relative priority compared to things waiting behind them. (My earlier statement about them working on this issue is a positive sign, because I also know a lot of things they're not yet working on.)

With respect to the potential improvements for low-throughput GPUs, is it fair to assume that you (and "everybody") has an always-on internet connection. The original FAH client was developed during the days of dial-up modems which were often disconnected. I think it's fair to assume that features associated with mostly-offline internet connections are no longer needed.

If you search the forum for discussions of "screen lag" you'll find that folding with GPUs are known to make some systems very sluggish. Is it reasonable to assume that your computer is off-line whenever you're not using it or would there be times when FAH could use the GPU when a screen-saver would be active?

Re: GPU workunits given too short time to complete

Posted: Wed May 14, 2014 6:46 am
by willfolder
My computer is left on 24/7 and is always connected to the internet.

In the past - before disabling the GPU - I was starting the FAH client when I went home at 5pm and stopping it at 8am due to the fact
that if both CPU and GPU were enabled the computer would be too slow to use - primarily being unresponsive after un-locking and trying to log back in to Windows and being very slow even if the FAH client was set to idle mode.

Now that I have disabled the GPU I find that I can have the CPU set to maximum and I can still do normal work on the computer without any
noticeable side effects. I am now running the CPU client 24/7.

Re: GPU workunits given too short time to complete

Posted: Wed May 14, 2014 3:38 pm
by bruce
I call that progress. The next step will be to figure out if running the GPU over night is a desirable thing or something best left for after future developments. My assumption is that you'll want to postpone the use of the GPU for folding, but as always, the choices are yours. If you agree, I recommend you increase the throughput of your CPU client by adjusting the number of CPUs being used from "-1" (which in your case, is the same as "3") to 4. Don't do that if you're going to fold with the GPU, and if you change your mind later, remember to undo this change.
All times are UTC
Page 1 of 1

Powered by phpBB® Forum Software © phpBB Limited