Page 1 of 2
Cancel GPU WU
Posted: Thu Oct 20, 2016 1:42 am
by unluckycandy
Hello,
Is there a way to cancel a work unit it is extremely unstable, is taking forever, and keeps re-starting. I just want to stop it and start a different WU. The one I'm doing now is 9210 (47,20,1)
Re: Cancel GPU WU
Posted: Thu Oct 20, 2016 6:02 am
by ChristianVirtual
Can you share log file showing your system details, config and also when the instability happen ?
Did you overclocked your hardware ? Even if we now just fix the current WU the next one might behave the same way. Better getting down to a root cause and prevent reoccurrence.
Re: Cancel GPU WU
Posted: Thu Oct 20, 2016 7:08 am
by wilding2004
ChristianVirtual wrote:Can you share log file showing your system details, config and also when the instability happen ?
Did you overclocked your hardware ? Even if we now just fix the current WU the next one might behave the same way. Better getting down to a root cause and prevent reoccurrence.
Yes. Unless you have set the beta flag, it's far more likely that it's your system that is unstable, rather than the WU.
Re: Cancel GPU WU
Posted: Thu Oct 20, 2016 10:26 am
by unluckycandy
Code: Select all
*********************** Log Started 2016-10-20T01:30:38Z ***********************
01:30:38:************************* Folding@home Client *************************
01:30:38: Website: http://folding.stanford.edu/
01:30:38: Copyright: (c) 2009-2014 Stanford University
01:30:38: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
01:30:38: Args: --open-web-control
01:30:38: Config: C:/Users/Ben N/AppData/Roaming/FAHClient/config.xml
01:30:38:******************************** Build ********************************
01:30:38: Version: 7.4.4
01:30:38: Date: Mar 4 2014
01:30:38: Time: 20:26:54
01:30:38: SVN Rev: 4130
01:30:38: Branch: fah/trunk/client
01:30:38: Compiler: Intel(R) C++ MSVC 1500 mode 1200
01:30:38: Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
01:30:38: /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
01:30:38: Platform: win32 XP
01:30:38: Bits: 32
01:30:38: Mode: Release
01:30:38:******************************* System ********************************
01:30:38: CPU: Intel(R) Core(TM) i5-4690K CPU @ 3.50GHz
01:30:38: CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
01:30:38: CPUs: 4
01:30:38: Memory: 15.95GiB
01:30:38: Free Memory: 13.31GiB
01:30:38: Threads: WINDOWS_THREADS
01:30:38: OS Version: 6.2
01:30:38: Has Battery: false
01:30:38: On Battery: false
01:30:38: UTC Offset: -4
01:30:38: PID: 2196
01:30:38: CWD: C:/Users/Ben N/AppData/Roaming/FAHClient
01:30:38: OS: Windows 10 Home
01:30:38: OS Arch: AMD64
01:30:38: GPUs: 1
01:30:38: GPU 0: ATI:5 Ellesmere XT [Radeon RX 480]
01:30:38: CUDA: Not detected
01:30:38:Win32 Service: false
01:30:38:***********************************************************************
01:30:38:<config>
01:30:38: <!-- Slot Control -->
01:30:38: <power v='FULL'/>
01:30:38:
01:30:38: <!-- User Information -->
01:30:38: <passkey v='********************************'/>
01:30:38: <team v='224497'/>
01:30:38: <user v='unluckycandy534'/>
01:30:38:
01:30:38: <!-- Folding Slots -->
01:30:38: <slot id='0' type='CPU'>
01:30:38: <paused v='true'/>
01:30:38: </slot>
01:30:38: <slot id='1' type='GPU'>
01:30:38: <paused v='true'/>
01:30:38: </slot>
01:30:38:</config>
01:30:38:Trying to access database...
01:30:38:Successfully acquired database lock
01:30:38:Enabled folding slot 00: PAUSED cpu:3 (by user)
01:30:38:Enabled folding slot 01: PAUSED gpu:0:Ellesmere XT [Radeon RX 480] (by user)
01:30:42:20:127.0.0.1:New Web connection
01:30:50:FS00:Unpaused
01:30:50:FS01:Unpaused
01:30:51:WU02:FS01:Starting
01:30:51:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Ben N/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe" -dir 02 -suffix 01 -version 704 -lifeline 2196 -checkpoint 15 -gpu 0 -gpu-vendor ati
01:30:51:WU02:FS01:Started FahCore on PID 6600
01:30:51:WU02:FS01:Core PID:6620
01:30:51:WU02:FS01:FahCore 0x21 started
01:30:51:WU00:FS00:Starting
01:30:51:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Ben N/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe" -dir 00 -suffix 01 -version 704 -lifeline 2196 -checkpoint 15 -np 3
01:30:51:WU00:FS00:Started FahCore on PID 6352
01:30:51:WU00:FS00:Core PID:5148
01:30:51:WU00:FS00:FahCore 0xa7 started
01:30:51:WU02:FS01:0x21:*********************** Log Started 2016-10-20T01:30:51Z ***********************
01:30:51:WU02:FS01:0x21:Project: 9210 (Run 47, Clone 20, Gen 1)
01:30:51:WU02:FS01:0x21:Unit: 0x00000008ab436c685796c0f1e27b0dfd
01:30:51:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
01:30:51:WU02:FS01:0x21:Machine: 1
01:30:51:WU02:FS01:0x21:Digital signatures verified
01:30:51:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
01:30:51:WU02:FS01:0x21:Version 0.0.17
01:30:51:WU00:FS00:0xa7:*********************** Log Started 2016-10-20T01:30:51Z ***********************
01:30:51:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
01:30:51:WU00:FS00:0xa7: Type: 0xa7
01:30:51:WU00:FS00:0xa7: Core: Gromacs
01:30:51:WU00:FS00:0xa7: Website: http://folding.stanford.edu/
01:30:51:WU00:FS00:0xa7: Copyright: (c) 2009-2016 Stanford University
01:30:51:WU00:FS00:0xa7: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
01:30:51:WU00:FS00:0xa7: Args: -dir 00 -suffix 01 -version 704 -lifeline 6352 -checkpoint 15 -np 3
01:30:51:WU00:FS00:0xa7: Config: <none>
01:30:51:WU00:FS00:0xa7:************************************ Build *************************************
01:30:51:WU00:FS00:0xa7: Version: 0.0.11
01:30:51:WU00:FS00:0xa7: Date: Sep 21 2016
01:30:51:WU00:FS00:0xa7: Time: 01:43:48
01:30:51:WU00:FS00:0xa7: Repository: Git
01:30:51:WU00:FS00:0xa7: Revision: 957bd90e68d95ddcf1594dc15ff6c64cc4555146
01:30:51:WU00:FS00:0xa7: Branch: master
01:30:51:WU00:FS00:0xa7: Compiler: GNU 4.2.1 Compatible Clang 3.9.0 (trunk 274080)
01:30:51:WU00:FS00:0xa7: Options: -std=gnu++98 -O3 -funroll-loops -ffast-math -mfpmath=sse
01:30:51:WU00:FS00:0xa7: -fno-unsafe-math-optimizations -msse2 -I/mingw64/include
01:30:51:WU00:FS00:0xa7: -Wno-inconsistent-dllimport -Wno-parentheses-equality
01:30:51:WU00:FS00:0xa7: -Wno-deprecated-register -Wno-unused-local-typedef
01:30:51:WU00:FS00:0xa7: Platform: linux2 4.6.0-1-amd64
01:30:51:WU00:FS00:0xa7: Bits: 64
01:30:51:WU00:FS00:0xa7: Mode: Release
01:30:51:WU00:FS00:0xa7: SIMD: avx_256
01:30:51:WU00:FS00:0xa7:************************************ System ************************************
01:30:51:WU00:FS00:0xa7: CPU: Intel(R) Core(TM) i5-4690K CPU @ 3.50GHz
01:30:51:WU00:FS00:0xa7: CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
01:30:51:WU00:FS00:0xa7: CPUs: 4
01:30:51:WU00:FS00:0xa7: Memory: 15.95GiB
01:30:51:WU00:FS00:0xa7:Free Memory: 13.27GiB
01:30:51:WU00:FS00:0xa7: Threads: WINDOWS_THREADS
01:30:51:WU00:FS00:0xa7: OS Version: 6.2
01:30:51:WU00:FS00:0xa7:Has Battery: false
01:30:51:WU00:FS00:0xa7: On Battery: false
01:30:51:WU00:FS00:0xa7: UTC Offset: -4
01:30:51:WU00:FS00:0xa7: PID: 5148
01:30:51:WU00:FS00:0xa7: CWD: C:\Users\Ben N\AppData\Roaming\FAHClient\work
01:30:51:WU00:FS00:0xa7: OS: Windows 10 Home
01:30:51:WU00:FS00:0xa7: OS Arch: AMD64
01:30:51:WU00:FS00:0xa7:********************************************************************************
01:30:51:WU00:FS00:0xa7:Project: 11920 (Run 2736, Clone 0, Gen 27)
01:30:51:WU00:FS00:0xa7:Unit: 0x00000026ab40412957bff22b6129a3b9
01:30:51:WU00:FS00:0xa7:Digital signatures verified
01:30:51:WU00:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpi state.cpt -cpt 15 -nt 3
01:30:52:WU00:FS00:0xa7:Steps: first=2160000 total=80000
01:30:56:WU00:FS00:0xa7:Completed 52802 out of 80000 steps (66%)
01:31:34:WU02:FS01:0x21:Completed 0 out of 2500000 steps (0%)
01:31:34:WU02:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:31:39:Saving configuration to config.xml
01:31:39:<config>
01:31:39: <!-- Slot Control -->
01:31:39: <power v='FULL'/>
01:31:39:
01:31:39: <!-- User Information -->
01:31:39: <passkey v='********************************'/>
01:31:39: <team v='224497'/>
01:31:39: <user v='unluckycandy534'/>
01:31:39:
01:31:39: <!-- Folding Slots -->
01:31:39: <slot id='0' type='CPU'/>
01:31:39: <slot id='1' type='GPU'/>
01:31:39:</config>
01:31:57:FS00:Paused
01:31:57:FS01:Paused
01:31:57:FS00:Shutting core down
01:31:57:FS01:Shutting core down
01:31:58:WU02:FS01:0x21:WARNING:Console control signal 1 on PID 6620
01:31:58:WU02:FS01:0x21:Exiting, please wait. . .
01:31:58:WU00:FS00:0xa7:WARNING:Console control signal 1 on PID 5148
01:31:58:WU00:FS00:0xa7:Exiting, please wait. . .
01:31:58:WU02:FS01:0x21:Folding@home Core Shutdown: INTERRUPTED
01:31:59:WU02:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
01:31:59:WU00:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
01:31:59:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
01:32:40:Saving configuration to config.xml
01:32:40:<config>
01:32:40: <!-- Slot Control -->
01:32:40: <power v='FULL'/>
01:32:40:
01:32:40: <!-- User Information -->
01:32:40: <passkey v='********************************'/>
01:32:40: <team v='224497'/>
01:32:40: <user v='unluckycandy534'/>
01:32:40:
01:32:40: <!-- Folding Slots -->
01:32:40: <slot id='0' type='CPU'>
01:32:40: <paused v='true'/>
01:32:40: </slot>
01:32:40: <slot id='1' type='GPU'>
01:32:40: <paused v='true'/>
01:32:40: </slot>
01:32:40:</config>
01:35:23:FS00:Unpaused
01:35:23:FS01:Unpaused
01:35:23:WU02:FS01:Starting
01:35:23:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Ben N/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe" -dir 02 -suffix 01 -version 704 -lifeline 2196 -checkpoint 15 -gpu 0 -gpu-vendor ati
01:35:23:WU02:FS01:Started FahCore on PID 7140
01:35:23:WU02:FS01:Core PID:3720
01:35:23:WU02:FS01:FahCore 0x21 started
01:35:23:WU00:FS00:Starting
01:35:23:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Ben N/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe" -dir 00 -suffix 01 -version 704 -lifeline 2196 -checkpoint 15 -np 3
01:35:23:WU00:FS00:Started FahCore on PID 8716
01:35:23:WU00:FS00:Core PID:7160
01:35:23:WU00:FS00:FahCore 0xa7 started
01:35:24:WU02:FS01:0x21:*********************** Log Started 2016-10-20T01:35:23Z ***********************
01:35:24:WU02:FS01:0x21:Project: 9210 (Run 47, Clone 20, Gen 1)
01:35:24:WU02:FS01:0x21:Unit: 0x00000008ab436c685796c0f1e27b0dfd
01:35:24:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
01:35:24:WU02:FS01:0x21:Machine: 1
01:35:24:WU02:FS01:0x21:Digital signatures verified
01:35:24:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
01:35:24:WU02:FS01:0x21:Version 0.0.17
01:35:24:WU00:FS00:0xa7:*********************** Log Started 2016-10-20T01:35:23Z ***********************
01:35:24:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
01:35:24:WU00:FS00:0xa7: Type: 0xa7
01:35:24:WU00:FS00:0xa7: Core: Gromacs
01:35:24:WU00:FS00:0xa7: Website: http://folding.stanford.edu/
01:35:24:WU00:FS00:0xa7: Copyright: (c) 2009-2016 Stanford University
01:35:24:WU00:FS00:0xa7: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
01:35:24:WU00:FS00:0xa7: Args: -dir 00 -suffix 01 -version 704 -lifeline 8716 -checkpoint 15 -np 3
01:35:24:WU00:FS00:0xa7: Config: <none>
01:35:24:WU00:FS00:0xa7:************************************ Build *************************************
01:35:24:WU00:FS00:0xa7: Version: 0.0.11
01:35:24:WU00:FS00:0xa7: Date: Sep 21 2016
01:35:24:WU00:FS00:0xa7: Time: 01:43:48
01:35:24:WU00:FS00:0xa7: Repository: Git
01:35:24:WU00:FS00:0xa7: Revision: 957bd90e68d95ddcf1594dc15ff6c64cc4555146
01:35:24:WU00:FS00:0xa7: Branch: master
01:35:24:WU00:FS00:0xa7: Compiler: GNU 4.2.1 Compatible Clang 3.9.0 (trunk 274080)
01:35:24:WU00:FS00:0xa7: Options: -std=gnu++98 -O3 -funroll-loops -ffast-math -mfpmath=sse
01:35:24:WU00:FS00:0xa7: -fno-unsafe-math-optimizations -msse2 -I/mingw64/include
01:35:24:WU00:FS00:0xa7: -Wno-inconsistent-dllimport -Wno-parentheses-equality
01:35:24:WU00:FS00:0xa7: -Wno-deprecated-register -Wno-unused-local-typedef
01:35:24:WU00:FS00:0xa7: Platform: linux2 4.6.0-1-amd64
01:35:24:WU00:FS00:0xa7: Bits: 64
01:35:24:WU00:FS00:0xa7: Mode: Release
01:35:24:WU00:FS00:0xa7: SIMD: avx_256
01:35:24:WU00:FS00:0xa7:************************************ System ************************************
01:35:24:WU00:FS00:0xa7: CPU: Intel(R) Core(TM) i5-4690K CPU @ 3.50GHz
01:35:24:WU00:FS00:0xa7: CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
01:35:24:WU00:FS00:0xa7: CPUs: 4
01:35:24:WU00:FS00:0xa7: Memory: 15.95GiB
01:35:24:WU00:FS00:0xa7:Free Memory: 13.53GiB
01:35:24:WU00:FS00:0xa7: Threads: WINDOWS_THREADS
01:35:24:WU00:FS00:0xa7: OS Version: 6.2
01:35:24:WU00:FS00:0xa7:Has Battery: false
01:35:24:WU00:FS00:0xa7: On Battery: false
01:35:24:WU00:FS00:0xa7: UTC Offset: -4
01:35:24:WU00:FS00:0xa7: PID: 7160
01:35:24:WU00:FS00:0xa7: CWD: C:\Users\Ben N\AppData\Roaming\FAHClient\work
01:35:24:WU00:FS00:0xa7: OS: Windows 10 Home
01:35:24:WU00:FS00:0xa7: OS Arch: AMD64
01:35:24:WU00:FS00:0xa7:********************************************************************************
01:35:24:WU00:FS00:0xa7:Project: 11920 (Run 2736, Clone 0, Gen 27)
01:35:24:WU00:FS00:0xa7:Unit: 0x00000026ab40412957bff22b6129a3b9
01:35:24:WU00:FS00:0xa7:Digital signatures verified
01:35:24:WU00:FS00:0xa7:Calling: mdrun -s frame27.tpr -o frame27.trr -cpi state.cpt -cpt 15 -nt 3
01:35:24:WU00:FS00:0xa7:Steps: first=2160000 total=80000
01:35:27:WU00:FS00:0xa7:Completed 53192 out of 80000 steps (66%)
01:35:43:Saving configuration to config.xml
01:35:43:<config>
01:35:43: <!-- Slot Control -->
01:35:43: <power v='FULL'/>
01:35:43:
01:35:43: <!-- User Information -->
01:35:43: <passkey v='********************************'/>
01:35:43: <team v='224497'/>
01:35:43: <user v='unluckycandy534'/>
01:35:43:
01:35:43: <!-- Folding Slots -->
01:35:43: <slot id='0' type='CPU'/>
01:35:43: <slot id='1' type='GPU'/>
01:35:43:</config>
01:35:59:WU02:FS01:0x21:Completed 0 out of 2500000 steps (0%)
01:36:00:WU02:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:36:24:WU00:FS00:0xa7:Completed 53600 out of 80000 steps (67%)
01:37:50:WU00:FS00:0xa7:Completed 54400 out of 80000 steps (68%)
01:39:16:WU00:FS00:0xa7:Completed 55200 out of 80000 steps (69%)
01:40:42:WU00:FS00:0xa7:Completed 56000 out of 80000 steps (70%)
01:42:08:WU00:FS00:0xa7:Completed 56800 out of 80000 steps (71%)
01:43:34:WU00:FS00:0xa7:Completed 57600 out of 80000 steps (72%)
01:45:01:WU00:FS00:0xa7:Completed 58400 out of 80000 steps (73%)
01:46:25:WU02:FS01:0x21:Completed 25000 out of 2500000 steps (1%)
01:46:27:WU00:FS00:0xa7:Completed 59200 out of 80000 steps (74%)
01:47:54:WU00:FS00:0xa7:Completed 60000 out of 80000 steps (75%)
01:49:20:WU00:FS00:0xa7:Completed 60800 out of 80000 steps (76%)
01:50:47:WU00:FS00:0xa7:Completed 61600 out of 80000 steps (77%)
01:52:13:WU00:FS00:0xa7:Completed 62400 out of 80000 steps (78%)
01:53:39:WU00:FS00:0xa7:Completed 63200 out of 80000 steps (79%)
01:55:06:WU00:FS00:0xa7:Completed 64000 out of 80000 steps (80%)
01:56:32:WU00:FS00:0xa7:Completed 64800 out of 80000 steps (81%)
01:56:47:WU02:FS01:0x21:Completed 50000 out of 2500000 steps (2%)
01:57:59:WU00:FS00:0xa7:Completed 65600 out of 80000 steps (82%)
01:59:25:WU00:FS00:0xa7:Completed 66400 out of 80000 steps (83%)
02:00:51:WU00:FS00:0xa7:Completed 67200 out of 80000 steps (84%)
02:02:17:WU00:FS00:0xa7:Completed 68000 out of 80000 steps (85%)
02:03:43:WU00:FS00:0xa7:Completed 68800 out of 80000 steps (86%)
02:05:09:WU00:FS00:0xa7:Completed 69600 out of 80000 steps (87%)
02:06:36:WU00:FS00:0xa7:Completed 70400 out of 80000 steps (88%)
02:07:08:WU02:FS01:0x21:Completed 75000 out of 2500000 steps (3%)
02:08:02:WU00:FS00:0xa7:Completed 71200 out of 80000 steps (89%)
02:09:28:WU00:FS00:0xa7:Completed 72000 out of 80000 steps (90%)
02:10:55:WU00:FS00:0xa7:Completed 72800 out of 80000 steps (91%)
02:12:21:WU00:FS00:0xa7:Completed 73600 out of 80000 steps (92%)
02:13:48:WU00:FS00:0xa7:Completed 74400 out of 80000 steps (93%)
02:15:14:WU00:FS00:0xa7:Completed 75200 out of 80000 steps (94%)
02:16:41:WU00:FS00:0xa7:Completed 76000 out of 80000 steps (95%)
02:17:27:WU02:FS01:0x21:Completed 100000 out of 2500000 steps (4%)
02:18:09:WU00:FS00:0xa7:Completed 76800 out of 80000 steps (96%)
02:19:36:WU00:FS00:0xa7:Completed 77600 out of 80000 steps (97%)
02:21:02:WU00:FS00:0xa7:Completed 78400 out of 80000 steps (98%)
02:22:29:WU00:FS00:0xa7:Completed 79200 out of 80000 steps (99%)
02:22:30:WU01:FS00:Connecting to 171.67.108.45:8080
02:22:31:WU01:FS00:Assigned to work server 171.67.108.158
02:22:31:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.67.108.158
02:22:31:WU01:FS00:Connecting to 171.67.108.158:8080
02:22:32:WU01:FS00:Downloading 807.22KiB
02:22:32:WU01:FS00:Download complete
02:22:32:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9038 run:293 clone:3 gen:108 core:0xa4 unit:0x0000008dab436c9e569829eb04d95697
02:23:56:WU00:FS00:0xa7:Completed 80000 out of 80000 steps (100%)
02:23:58:WU00:FS00:0xa7:Saving result file ..\logfile_01.txt
02:23:58:WU00:FS00:0xa7:Saving result file frame27.trr
02:23:58:WU00:FS00:0xa7:Saving result file md.log
02:23:58:WU00:FS00:0xa7:Saving result file science.log
02:23:58:WU00:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
02:23:59:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:23:59:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:11920 run:2736 clone:0 gen:27 core:0xa7 unit:0x00000026ab40412957bff22b6129a3b9
02:23:59:WU00:FS00:Uploading 19.82MiB to 171.64.65.41
02:23:59:WU00:FS00:Connecting to 171.64.65.41:8080
02:23:59:WU01:FS00:Starting
02:23:59:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Ben N/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe" -dir 01 -suffix 01 -version 704 -lifeline 2196 -checkpoint 15 -np 3
02:23:59:WU01:FS00:Started FahCore on PID 1028
02:23:59:WU01:FS00:Core PID:3616
02:23:59:WU01:FS00:FahCore 0xa4 started
02:23:59:WU01:FS00:0xa4:
02:23:59:WU01:FS00:0xa4:*------------------------------*
02:23:59:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
02:23:59:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
02:23:59:WU01:FS00:0xa4:
02:23:59:WU01:FS00:0xa4:Preparing to commence simulation
02:23:59:WU01:FS00:0xa4:- Looking at optimizations...
02:23:59:WU01:FS00:0xa4:- Created dyn
02:23:59:WU01:FS00:0xa4:- Files status OK
02:23:59:WU01:FS00:0xa4:- Expanded 826082 -> 1402860 (decompressed 169.8 percent)
02:23:59:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826082 data_size=1402860, decompressed_data_size=1402860 diff=0
02:23:59:WU01:FS00:0xa4:- Digital signature verified
02:23:59:WU01:FS00:0xa4:
02:23:59:WU01:FS00:0xa4:Project: 9038 (Run 293, Clone 3, Gen 108)
02:23:59:WU01:FS00:0xa4:
02:23:59:WU01:FS00:0xa4:Assembly optimizations on if available.
02:23:59:WU01:FS00:0xa4:Entering M.D.
02:24:05:WU00:FS00:Upload 16.72%
02:24:05:WU01:FS00:0xa4:Mapping NT from 3 to 3
02:24:05:WU01:FS00:0xa4:Completed 0 out of 250000 steps (0%)
02:24:11:WU00:FS00:Upload 60.56%
02:24:17:WU00:FS00:Upload complete
02:24:17:WU00:FS00:Server responded WORK_ACK (400)
02:24:17:WU00:FS00:Final credit estimate, 2590.00 points
02:24:17:WU00:FS00:Cleaning up
02:26:00:WU01:FS00:0xa4:Completed 2500 out of 250000 steps (1%)
02:27:39:WU02:FS01:0x21:Completed 125000 out of 2500000 steps (5%)
02:27:53:WU01:FS00:0xa4:Completed 5000 out of 250000 steps (2%)
02:29:47:WU01:FS00:0xa4:Completed 7500 out of 250000 steps (3%)
02:31:41:WU01:FS00:0xa4:Completed 10000 out of 250000 steps (4%)
02:33:35:WU01:FS00:0xa4:Completed 12500 out of 250000 steps (5%)
02:35:29:WU01:FS00:0xa4:Completed 15000 out of 250000 steps (6%)
02:37:23:WU01:FS00:0xa4:Completed 17500 out of 250000 steps (7%)
02:37:27:WU02:FS01:0x21:Completed 150000 out of 2500000 steps (6%)
02:39:16:WU01:FS00:0xa4:Completed 20000 out of 250000 steps (8%)
02:41:10:WU01:FS00:0xa4:Completed 22500 out of 250000 steps (9%)
02:43:04:WU01:FS00:0xa4:Completed 25000 out of 250000 steps (10%)
02:44:58:WU01:FS00:0xa4:Completed 27500 out of 250000 steps (11%)
02:46:51:WU01:FS00:0xa4:Completed 30000 out of 250000 steps (12%)
02:47:13:WU02:FS01:0x21:Completed 175000 out of 2500000 steps (7%)
02:48:45:WU01:FS00:0xa4:Completed 32500 out of 250000 steps (13%)
02:50:38:WU01:FS00:0xa4:Completed 35000 out of 250000 steps (14%)
02:52:32:WU01:FS00:0xa4:Completed 37500 out of 250000 steps (15%)
02:54:26:WU01:FS00:0xa4:Completed 40000 out of 250000 steps (16%)
02:56:19:WU01:FS00:0xa4:Completed 42500 out of 250000 steps (17%)
02:57:00:WU02:FS01:0x21:Completed 200000 out of 2500000 steps (8%)
02:58:14:WU01:FS00:0xa4:Completed 45000 out of 250000 steps (18%)
03:00:08:WU01:FS00:0xa4:Completed 47500 out of 250000 steps (19%)
03:02:02:WU01:FS00:0xa4:Completed 50000 out of 250000 steps (20%)
03:03:55:WU01:FS00:0xa4:Completed 52500 out of 250000 steps (21%)
03:05:49:WU01:FS00:0xa4:Completed 55000 out of 250000 steps (22%)
03:06:54:WU02:FS01:0x21:Completed 225000 out of 2500000 steps (9%)
03:07:42:WU01:FS00:0xa4:Completed 57500 out of 250000 steps (23%)
03:09:36:WU01:FS00:0xa4:Completed 60000 out of 250000 steps (24%)
03:11:30:WU01:FS00:0xa4:Completed 62500 out of 250000 steps (25%)
03:13:24:WU01:FS00:0xa4:Completed 65000 out of 250000 steps (26%)
03:15:17:WU01:FS00:0xa4:Completed 67500 out of 250000 steps (27%)
03:16:40:WU02:FS01:0x21:Completed 250000 out of 2500000 steps (10%)
03:17:10:WU01:FS00:0xa4:Completed 70000 out of 250000 steps (28%)
03:19:04:WU01:FS00:0xa4:Completed 72500 out of 250000 steps (29%)
03:20:57:WU01:FS00:0xa4:Completed 75000 out of 250000 steps (30%)
03:22:50:WU01:FS00:0xa4:Completed 77500 out of 250000 steps (31%)
03:24:44:WU01:FS00:0xa4:Completed 80000 out of 250000 steps (32%)
03:26:28:WU02:FS01:0x21:Completed 275000 out of 2500000 steps (11%)
03:26:37:WU01:FS00:0xa4:Completed 82500 out of 250000 steps (33%)
03:28:31:WU01:FS00:0xa4:Completed 85000 out of 250000 steps (34%)
03:30:24:WU01:FS00:0xa4:Completed 87500 out of 250000 steps (35%)
03:32:18:WU01:FS00:0xa4:Completed 90000 out of 250000 steps (36%)
03:34:11:WU01:FS00:0xa4:Completed 92500 out of 250000 steps (37%)
03:36:05:WU01:FS00:0xa4:Completed 95000 out of 250000 steps (38%)
03:36:16:WU02:FS01:0x21:Completed 300000 out of 2500000 steps (12%)
03:38:00:WU01:FS00:0xa4:Completed 97500 out of 250000 steps (39%)
03:39:53:WU01:FS00:0xa4:Completed 100000 out of 250000 steps (40%)
03:41:46:WU01:FS00:0xa4:Completed 102500 out of 250000 steps (41%)
03:43:40:WU01:FS00:0xa4:Completed 105000 out of 250000 steps (42%)
03:45:33:WU01:FS00:0xa4:Completed 107500 out of 250000 steps (43%)
03:46:08:WU02:FS01:0x21:Completed 325000 out of 2500000 steps (13%)
03:47:26:WU01:FS00:0xa4:Completed 110000 out of 250000 steps (44%)
03:49:19:WU01:FS00:0xa4:Completed 112500 out of 250000 steps (45%)
03:51:13:WU01:FS00:0xa4:Completed 115000 out of 250000 steps (46%)
03:53:06:WU01:FS00:0xa4:Completed 117500 out of 250000 steps (47%)
03:55:00:WU01:FS00:0xa4:Completed 120000 out of 250000 steps (48%)
03:55:58:WU02:FS01:0x21:Completed 350000 out of 2500000 steps (14%)
03:56:54:WU01:FS00:0xa4:Completed 122500 out of 250000 steps (49%)
03:58:47:WU01:FS00:0xa4:Completed 125000 out of 250000 steps (50%)
04:00:40:WU01:FS00:0xa4:Completed 127500 out of 250000 steps (51%)
04:02:33:WU01:FS00:0xa4:Completed 130000 out of 250000 steps (52%)
04:04:26:WU01:FS00:0xa4:Completed 132500 out of 250000 steps (53%)
04:05:45:WU02:FS01:0x21:Completed 375000 out of 2500000 steps (15%)
04:06:20:WU01:FS00:0xa4:Completed 135000 out of 250000 steps (54%)
04:08:13:WU01:FS00:0xa4:Completed 137500 out of 250000 steps (55%)
04:10:07:WU01:FS00:0xa4:Completed 140000 out of 250000 steps (56%)
04:12:01:WU01:FS00:0xa4:Completed 142500 out of 250000 steps (57%)
04:13:55:WU01:FS00:0xa4:Completed 145000 out of 250000 steps (58%)
04:15:32:WU02:FS01:0x21:Completed 400000 out of 2500000 steps (16%)
04:15:50:WU01:FS00:0xa4:Completed 147500 out of 250000 steps (59%)
04:17:44:WU01:FS00:0xa4:Completed 150000 out of 250000 steps (60%)
04:19:37:WU01:FS00:0xa4:Completed 152500 out of 250000 steps (61%)
04:21:31:WU01:FS00:0xa4:Completed 155000 out of 250000 steps (62%)
04:23:24:WU01:FS00:0xa4:Completed 157500 out of 250000 steps (63%)
04:25:17:WU01:FS00:0xa4:Completed 160000 out of 250000 steps (64%)
04:25:25:WU02:FS01:0x21:Completed 425000 out of 2500000 steps (17%)
04:27:12:WU01:FS00:0xa4:Completed 162500 out of 250000 steps (65%)
04:29:06:WU01:FS00:0xa4:Completed 165000 out of 250000 steps (66%)
04:31:00:WU01:FS00:0xa4:Completed 167500 out of 250000 steps (67%)
04:32:53:WU01:FS00:0xa4:Completed 170000 out of 250000 steps (68%)
04:34:46:WU01:FS00:0xa4:Completed 172500 out of 250000 steps (69%)
04:35:14:WU02:FS01:0x21:Completed 450000 out of 2500000 steps (18%)
04:36:40:WU01:FS00:0xa4:Completed 175000 out of 250000 steps (70%)
04:38:34:WU01:FS00:0xa4:Completed 177500 out of 250000 steps (71%)
04:40:29:WU01:FS00:0xa4:Completed 180000 out of 250000 steps (72%)
04:42:23:WU01:FS00:0xa4:Completed 182500 out of 250000 steps (73%)
04:44:17:WU01:FS00:0xa4:Completed 185000 out of 250000 steps (74%)
04:45:00:WU02:FS01:0x21:Completed 475000 out of 2500000 steps (19%)
04:46:10:WU01:FS00:0xa4:Completed 187500 out of 250000 steps (75%)
04:48:03:WU01:FS00:0xa4:Completed 190000 out of 250000 steps (76%)
04:49:57:WU01:FS00:0xa4:Completed 192500 out of 250000 steps (77%)
04:51:50:WU01:FS00:0xa4:Completed 195000 out of 250000 steps (78%)
04:53:43:WU01:FS00:0xa4:Completed 197500 out of 250000 steps (79%)
04:54:49:WU02:FS01:0x21:Completed 500000 out of 2500000 steps (20%)
04:55:39:WU01:FS00:0xa4:Completed 200000 out of 250000 steps (80%)
04:57:32:WU01:FS00:0xa4:Completed 202500 out of 250000 steps (81%)
04:59:26:WU01:FS00:0xa4:Completed 205000 out of 250000 steps (82%)
05:01:20:WU01:FS00:0xa4:Completed 207500 out of 250000 steps (83%)
05:03:14:WU01:FS00:0xa4:Completed 210000 out of 250000 steps (84%)
05:04:41:WU02:FS01:0x21:Completed 525000 out of 2500000 steps (21%)
05:05:08:WU01:FS00:0xa4:Completed 212500 out of 250000 steps (85%)
05:07:02:WU01:FS00:0xa4:Completed 215000 out of 250000 steps (86%)
05:08:55:WU01:FS00:0xa4:Completed 217500 out of 250000 steps (87%)
05:10:49:WU01:FS00:0xa4:Completed 220000 out of 250000 steps (88%)
05:12:42:WU01:FS00:0xa4:Completed 222500 out of 250000 steps (89%)
05:14:29:WU02:FS01:0x21:Completed 550000 out of 2500000 steps (22%)
05:14:36:WU01:FS00:0xa4:Completed 225000 out of 250000 steps (90%)
05:16:30:WU01:FS00:0xa4:Completed 227500 out of 250000 steps (91%)
05:18:24:WU01:FS00:0xa4:Completed 230000 out of 250000 steps (92%)
05:20:18:WU01:FS00:0xa4:Completed 232500 out of 250000 steps (93%)
05:22:12:WU01:FS00:0xa4:Completed 235000 out of 250000 steps (94%)
05:24:06:WU01:FS00:0xa4:Completed 237500 out of 250000 steps (95%)
05:24:14:WU02:FS01:0x21:Completed 575000 out of 2500000 steps (23%)
05:26:01:WU01:FS00:0xa4:Completed 240000 out of 250000 steps (96%)
05:27:55:WU01:FS00:0xa4:Completed 242500 out of 250000 steps (97%)
05:29:49:WU01:FS00:0xa4:Completed 245000 out of 250000 steps (98%)
05:31:43:WU01:FS00:0xa4:Completed 247500 out of 250000 steps (99%)
05:31:43:WU00:FS00:Connecting to 171.67.108.45:8080
05:31:43:WU00:FS00:Assigned to work server 171.67.108.158
05:31:43:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.67.108.158
05:31:43:WU00:FS00:Connecting to 171.67.108.158:8080
05:31:44:WU00:FS00:Downloading 806.21KiB
05:31:45:WU00:FS00:Download complete
05:31:46:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9039 run:71 clone:0 gen:224 core:0xa4 unit:0x00000108ab436c9e569828bb5ec1aaeb
05:33:36:WU01:FS00:0xa4:Completed 250000 out of 250000 steps (100%)
05:33:37:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
05:33:47:WU01:FS00:0xa4:
05:33:47:WU01:FS00:0xa4:Finished Work Unit:
05:33:47:WU01:FS00:0xa4:- Reading up to 811536 from "01/wudata_01.trr": Read 811536
05:33:47:WU01:FS00:0xa4:trr file hash check passed.
05:33:47:WU01:FS00:0xa4:- Reading up to 746020 from "01/wudata_01.xtc": Read 746020
05:33:47:WU01:FS00:0xa4:xtc file hash check passed.
05:33:47:WU01:FS00:0xa4:edr file hash check passed.
05:33:47:WU01:FS00:0xa4:logfile size: 23166
05:33:47:WU01:FS00:0xa4:Leaving Run
05:33:50:WU01:FS00:0xa4:- Writing 1583210 bytes of core data to disk...
05:33:50:WU01:FS00:0xa4:Done: 1582698 -> 1537735 (compressed to 97.1 percent)
05:33:50:WU01:FS00:0xa4: ... Done.
05:33:51:WU01:FS00:0xa4:- Shutting down core
05:33:51:WU01:FS00:0xa4:
05:33:51:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
05:33:51:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:33:51:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9038 run:293 clone:3 gen:108 core:0xa4 unit:0x0000008dab436c9e569829eb04d95697
05:33:51:WU01:FS00:Uploading 1.47MiB to 171.67.108.158
05:33:51:WU01:FS00:Connecting to 171.67.108.158:8080
05:33:51:WU00:FS00:Starting
05:33:51:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Ben N/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe" -dir 00 -suffix 01 -version 704 -lifeline 2196 -checkpoint 15 -np 3
05:33:51:WU00:FS00:Started FahCore on PID 4220
05:33:51:WU00:FS00:Core PID:6532
05:33:51:WU00:FS00:FahCore 0xa4 started
05:33:52:WU00:FS00:0xa4:
05:33:52:WU00:FS00:0xa4:*------------------------------*
05:33:52:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
05:33:52:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
05:33:52:WU00:FS00:0xa4:
05:33:52:WU00:FS00:0xa4:Preparing to commence simulation
05:33:52:WU00:FS00:0xa4:- Looking at optimizations...
05:33:52:WU00:FS00:0xa4:- Created dyn
05:33:52:WU00:FS00:0xa4:- Files status OK
05:33:52:WU00:FS00:0xa4:- Expanded 825049 -> 1398040 (decompressed 169.4 percent)
05:33:52:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=825049 data_size=1398040, decompressed_data_size=1398040 diff=0
05:33:52:WU00:FS00:0xa4:- Digital signature verified
05:33:52:WU00:FS00:0xa4:
05:33:52:WU00:FS00:0xa4:Project: 9039 (Run 71, Clone 0, Gen 224)
05:33:52:WU00:FS00:0xa4:
05:33:52:WU00:FS00:0xa4:Assembly optimizations on if available.
05:33:52:WU00:FS00:0xa4:Entering M.D.
05:33:56:WU01:FS00:Upload complete
05:33:56:WU01:FS00:Server responded WORK_ACK (400)
05:33:56:WU01:FS00:Final credit estimate, 1418.00 points
05:33:56:WU01:FS00:Cleaning up
05:33:58:WU00:FS00:0xa4:Mapping NT from 3 to 3
05:33:58:WU00:FS00:0xa4:Completed 0 out of 250000 steps (0%)
05:34:00:WU02:FS01:0x21:Completed 600000 out of 2500000 steps (24%)
05:35:53:WU00:FS00:0xa4:Completed 2500 out of 250000 steps (1%)
05:37:46:WU00:FS00:0xa4:Completed 5000 out of 250000 steps (2%)
05:39:40:WU00:FS00:0xa4:Completed 7500 out of 250000 steps (3%)
05:41:34:WU00:FS00:0xa4:Completed 10000 out of 250000 steps (4%)
05:43:28:WU00:FS00:0xa4:Completed 12500 out of 250000 steps (5%)
05:43:49:WU02:FS01:0x21:Completed 625000 out of 2500000 steps (25%)
05:45:22:WU00:FS00:0xa4:Completed 15000 out of 250000 steps (6%)
05:47:15:WU00:FS00:0xa4:Completed 17500 out of 250000 steps (7%)
05:49:09:WU00:FS00:0xa4:Completed 20000 out of 250000 steps (8%)
05:51:02:WU00:FS00:0xa4:Completed 22500 out of 250000 steps (9%)
05:52:56:WU00:FS00:0xa4:Completed 25000 out of 250000 steps (10%)
05:53:36:WU02:FS01:0x21:Completed 650000 out of 2500000 steps (26%)
05:54:49:WU00:FS00:0xa4:Completed 27500 out of 250000 steps (11%)
05:56:43:WU00:FS00:0xa4:Completed 30000 out of 250000 steps (12%)
05:58:36:WU00:FS00:0xa4:Completed 32500 out of 250000 steps (13%)
06:00:29:WU00:FS00:0xa4:Completed 35000 out of 250000 steps (14%)
06:02:23:WU00:FS00:0xa4:Completed 37500 out of 250000 steps (15%)
06:03:26:WU02:FS01:0x21:Completed 675000 out of 2500000 steps (27%)
06:04:16:WU00:FS00:0xa4:Completed 40000 out of 250000 steps (16%)
06:06:10:WU00:FS00:0xa4:Completed 42500 out of 250000 steps (17%)
06:08:03:WU00:FS00:0xa4:Completed 45000 out of 250000 steps (18%)
06:09:57:WU00:FS00:0xa4:Completed 47500 out of 250000 steps (19%)
06:11:51:WU00:FS00:0xa4:Completed 50000 out of 250000 steps (20%)
06:13:13:WU02:FS01:0x21:Completed 700000 out of 2500000 steps (28%)
06:13:46:WU00:FS00:0xa4:Completed 52500 out of 250000 steps (21%)
06:15:39:WU00:FS00:0xa4:Completed 55000 out of 250000 steps (22%)
06:17:32:WU00:FS00:0xa4:Completed 57500 out of 250000 steps (23%)
06:19:26:WU00:FS00:0xa4:Completed 60000 out of 250000 steps (24%)
06:21:19:WU00:FS00:0xa4:Completed 62500 out of 250000 steps (25%)
06:23:03:WU02:FS01:0x21:Completed 725000 out of 2500000 steps (29%)
06:23:12:WU00:FS00:0xa4:Completed 65000 out of 250000 steps (26%)
06:25:05:WU00:FS00:0xa4:Completed 67500 out of 250000 steps (27%)
06:26:59:WU00:FS00:0xa4:Completed 70000 out of 250000 steps (28%)
06:28:52:WU00:FS00:0xa4:Completed 72500 out of 250000 steps (29%)
06:30:44:WU00:FS00:0xa4:Completed 75000 out of 250000 steps (30%)
06:32:37:WU00:FS00:0xa4:Completed 77500 out of 250000 steps (31%)
06:32:51:WU02:FS01:0x21:Completed 750000 out of 2500000 steps (30%)
06:34:30:WU00:FS00:0xa4:Completed 80000 out of 250000 steps (32%)
06:36:24:WU00:FS00:0xa4:Completed 82500 out of 250000 steps (33%)
06:38:17:WU00:FS00:0xa4:Completed 85000 out of 250000 steps (34%)
06:40:11:WU00:FS00:0xa4:Completed 87500 out of 250000 steps (35%)
06:42:04:WU00:FS00:0xa4:Completed 90000 out of 250000 steps (36%)
06:42:37:WU02:FS01:0x21:Completed 775000 out of 2500000 steps (31%)
06:43:57:WU00:FS00:0xa4:Completed 92500 out of 250000 steps (37%)
06:45:50:WU00:FS00:0xa4:Completed 95000 out of 250000 steps (38%)
06:47:44:WU00:FS00:0xa4:Completed 97500 out of 250000 steps (39%)
06:49:36:WU00:FS00:0xa4:Completed 100000 out of 250000 steps (40%)
06:51:29:WU00:FS00:0xa4:Completed 102500 out of 250000 steps (41%)
06:52:24:WU02:FS01:0x21:Completed 800000 out of 2500000 steps (32%)
06:53:24:WU00:FS00:0xa4:Completed 105000 out of 250000 steps (42%)
06:55:18:WU00:FS00:0xa4:Completed 107500 out of 250000 steps (43%)
06:57:11:WU00:FS00:0xa4:Completed 110000 out of 250000 steps (44%)
06:59:04:WU00:FS00:0xa4:Completed 112500 out of 250000 steps (45%)
07:00:57:WU00:FS00:0xa4:Completed 115000 out of 250000 steps (46%)
07:02:16:WU02:FS01:0x21:Completed 825000 out of 2500000 steps (33%)
07:02:50:WU00:FS00:0xa4:Completed 117500 out of 250000 steps (47%)
07:04:43:WU00:FS00:0xa4:Completed 120000 out of 250000 steps (48%)
07:06:36:WU00:FS00:0xa4:Completed 122500 out of 250000 steps (49%)
07:08:30:WU00:FS00:0xa4:Completed 125000 out of 250000 steps (50%)
07:10:23:WU00:FS00:0xa4:Completed 127500 out of 250000 steps (51%)
07:12:02:WU02:FS01:0x21:Completed 850000 out of 2500000 steps (34%)
07:12:16:WU00:FS00:0xa4:Completed 130000 out of 250000 steps (52%)
07:14:10:WU00:FS00:0xa4:Completed 132500 out of 250000 steps (53%)
07:16:03:WU00:FS00:0xa4:Completed 135000 out of 250000 steps (54%)
07:17:57:WU00:FS00:0xa4:Completed 137500 out of 250000 steps (55%)
07:19:50:WU00:FS00:0xa4:Completed 140000 out of 250000 steps (56%)
07:21:43:WU00:FS00:0xa4:Completed 142500 out of 250000 steps (57%)
07:21:48:WU02:FS01:0x21:Completed 875000 out of 2500000 steps (35%)
07:23:36:WU00:FS00:0xa4:Completed 145000 out of 250000 steps (58%)
07:25:29:WU00:FS00:0xa4:Completed 147500 out of 250000 steps (59%)
07:27:22:WU00:FS00:0xa4:Completed 150000 out of 250000 steps (60%)
07:29:15:WU00:FS00:0xa4:Completed 152500 out of 250000 steps (61%)
******************************* Date: 2016-10-20 *******************************
07:31:08:WU00:FS00:0xa4:Completed 155000 out of 250000 steps (62%)
07:31:36:WU02:FS01:0x21:Completed 900000 out of 2500000 steps (36%)
07:33:03:WU00:FS00:0xa4:Completed 157500 out of 250000 steps (63%)
07:34:59:WU00:FS00:0xa4:Completed 160000 out of 250000 steps (64%)
07:36:53:WU00:FS00:0xa4:Completed 162500 out of 250000 steps (65%)
07:38:46:WU00:FS00:0xa4:Completed 165000 out of 250000 steps (66%)
07:40:40:WU00:FS00:0xa4:Completed 167500 out of 250000 steps (67%)
07:41:27:WU02:FS01:0x21:Completed 925000 out of 2500000 steps (37%)
07:42:34:WU00:FS00:0xa4:Completed 170000 out of 250000 steps (68%)
07:44:27:WU00:FS00:0xa4:Completed 172500 out of 250000 steps (69%)
07:46:21:WU00:FS00:0xa4:Completed 175000 out of 250000 steps (70%)
07:48:14:WU00:FS00:0xa4:Completed 177500 out of 250000 steps (71%)
07:50:08:WU00:FS00:0xa4:Completed 180000 out of 250000 steps (72%)
07:51:13:WU02:FS01:0x21:Completed 950000 out of 2500000 steps (38%)
07:52:02:WU00:FS00:0xa4:Completed 182500 out of 250000 steps (73%)
07:53:55:WU00:FS00:0xa4:Completed 185000 out of 250000 steps (74%)
07:55:49:WU00:FS00:0xa4:Completed 187500 out of 250000 steps (75%)
07:57:42:WU00:FS00:0xa4:Completed 190000 out of 250000 steps (76%)
07:59:35:WU00:FS00:0xa4:Completed 192500 out of 250000 steps (77%)
08:01:01:WU02:FS01:0x21:Completed 975000 out of 2500000 steps (39%)
08:01:28:WU00:FS00:0xa4:Completed 195000 out of 250000 steps (78%)
08:03:21:WU00:FS00:0xa4:Completed 197500 out of 250000 steps (79%)
08:05:14:WU00:FS00:0xa4:Completed 200000 out of 250000 steps (80%)
08:07:08:WU00:FS00:0xa4:Completed 202500 out of 250000 steps (81%)
08:09:01:WU00:FS00:0xa4:Completed 205000 out of 250000 steps (82%)
08:10:47:WU02:FS01:0x21:Completed 1000000 out of 2500000 steps (40%)
08:10:56:WU00:FS00:0xa4:Completed 207500 out of 250000 steps (83%)
08:12:49:WU00:FS00:0xa4:Completed 210000 out of 250000 steps (84%)
08:14:43:WU00:FS00:0xa4:Completed 212500 out of 250000 steps (85%)
08:16:36:WU00:FS00:0xa4:Completed 215000 out of 250000 steps (86%)
08:18:29:WU00:FS00:0xa4:Completed 217500 out of 250000 steps (87%)
08:20:23:WU00:FS00:0xa4:Completed 220000 out of 250000 steps (88%)
08:20:38:WU02:FS01:0x21:Completed 1025000 out of 2500000 steps (41%)
08:22:16:WU00:FS00:0xa4:Completed 222500 out of 250000 steps (89%)
08:24:09:WU00:FS00:0xa4:Completed 225000 out of 250000 steps (90%)
08:26:03:WU00:FS00:0xa4:Completed 227500 out of 250000 steps (91%)
08:27:56:WU00:FS00:0xa4:Completed 230000 out of 250000 steps (92%)
08:29:50:WU00:FS00:0xa4:Completed 232500 out of 250000 steps (93%)
08:30:24:WU02:FS01:0x21:Completed 1050000 out of 2500000 steps (42%)
08:31:43:WU00:FS00:0xa4:Completed 235000 out of 250000 steps (94%)
08:33:37:WU00:FS00:0xa4:Completed 237500 out of 250000 steps (95%)
08:35:30:WU00:FS00:0xa4:Completed 240000 out of 250000 steps (96%)
08:37:23:WU00:FS00:0xa4:Completed 242500 out of 250000 steps (97%)
08:39:17:WU00:FS00:0xa4:Completed 245000 out of 250000 steps (98%)
08:40:10:WU02:FS01:0x21:Completed 1075000 out of 2500000 steps (43%)
08:41:10:WU00:FS00:0xa4:Completed 247500 out of 250000 steps (99%)
08:41:11:WU01:FS00:Connecting to 171.67.108.45:8080
08:41:11:WU01:FS00:Assigned to work server 171.67.108.158
08:41:11:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.67.108.158
08:41:11:WU01:FS00:Connecting to 171.67.108.158:8080
08:41:13:WU01:FS00:Downloading 807.32KiB
08:41:13:WU01:FS00:Download complete
08:41:13:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9038 run:303 clone:0 gen:520 core:0xa4 unit:0x0000023dab436c9e569829e7468437c4
08:43:03:WU00:FS00:0xa4:Completed 250000 out of 250000 steps (100%)
08:43:04:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
08:43:14:WU00:FS00:0xa4:
08:43:14:WU00:FS00:0xa4:Finished Work Unit:
08:43:14:WU00:FS00:0xa4:- Reading up to 811440 from "00/wudata_01.trr": Read 811440
08:43:14:WU00:FS00:0xa4:trr file hash check passed.
08:43:14:WU00:FS00:0xa4:- Reading up to 745764 from "00/wudata_01.xtc": Read 745764
08:43:14:WU00:FS00:0xa4:xtc file hash check passed.
08:43:14:WU00:FS00:0xa4:edr file hash check passed.
08:43:14:WU00:FS00:0xa4:logfile size: 23173
08:43:14:WU00:FS00:0xa4:Leaving Run
08:43:18:WU00:FS00:0xa4:- Writing 1582865 bytes of core data to disk...
08:43:18:WU00:FS00:0xa4:Done: 1582353 -> 1537322 (compressed to 97.1 percent)
08:43:18:WU00:FS00:0xa4: ... Done.
08:43:18:WU00:FS00:0xa4:- Shutting down core
08:43:18:WU00:FS00:0xa4:
08:43:18:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
08:43:19:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
08:43:19:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:9039 run:71 clone:0 gen:224 core:0xa4 unit:0x00000108ab436c9e569828bb5ec1aaeb
08:43:19:WU00:FS00:Uploading 1.47MiB to 171.67.108.158
08:43:19:WU00:FS00:Connecting to 171.67.108.158:8080
08:43:19:WU01:FS00:Starting
08:43:19:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Ben N/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe" -dir 01 -suffix 01 -version 704 -lifeline 2196 -checkpoint 15 -np 3
08:43:19:WU01:FS00:Started FahCore on PID 1064
08:43:19:WU01:FS00:Core PID:4268
08:43:19:WU01:FS00:FahCore 0xa4 started
08:43:19:WU01:FS00:0xa4:
08:43:19:WU01:FS00:0xa4:*------------------------------*
08:43:19:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
08:43:19:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
08:43:19:WU01:FS00:0xa4:
08:43:19:WU01:FS00:0xa4:Preparing to commence simulation
08:43:19:WU01:FS00:0xa4:- Looking at optimizations...
08:43:19:WU01:FS00:0xa4:- Created dyn
08:43:19:WU01:FS00:0xa4:- Files status OK
08:43:19:WU01:FS00:0xa4:- Expanded 826183 -> 1402860 (decompressed 169.8 percent)
08:43:19:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826183 data_size=1402860, decompressed_data_size=1402860 diff=0
08:43:19:WU01:FS00:0xa4:- Digital signature verified
08:43:19:WU01:FS00:0xa4:
08:43:19:WU01:FS00:0xa4:Project: 9038 (Run 303, Clone 0, Gen 520)
08:43:19:WU01:FS00:0xa4:
08:43:19:WU01:FS00:0xa4:Assembly optimizations on if available.
08:43:19:WU01:FS00:0xa4:Entering M.D.
08:43:20:WU00:FS00:Upload complete
08:43:20:WU00:FS00:Server responded WORK_ACK (400)
08:43:20:WU00:FS00:Final credit estimate, 1417.00 points
08:43:20:WU00:FS00:Cleaning up
08:43:25:WU01:FS00:0xa4:Mapping NT from 3 to 3
08:43:25:WU01:FS00:0xa4:Completed 0 out of 250000 steps (0%)
08:45:20:WU01:FS00:0xa4:Completed 2500 out of 250000 steps (1%)
08:47:15:WU01:FS00:0xa4:Completed 5000 out of 250000 steps (2%)
08:49:10:WU01:FS00:0xa4:Completed 7500 out of 250000 steps (3%)
08:49:56:WU02:FS01:0x21:Completed 1100000 out of 2500000 steps (44%)
08:51:05:WU01:FS00:0xa4:Completed 10000 out of 250000 steps (4%)
08:52:59:WU01:FS00:0xa4:Completed 12500 out of 250000 steps (5%)
08:54:53:WU01:FS00:0xa4:Completed 15000 out of 250000 steps (6%)
08:56:48:WU01:FS00:0xa4:Completed 17500 out of 250000 steps (7%)
08:58:42:WU01:FS00:0xa4:Completed 20000 out of 250000 steps (8%)
08:59:46:WU02:FS01:0x21:Completed 1125000 out of 2500000 steps (45%)
09:00:36:WU01:FS00:0xa4:Completed 22500 out of 250000 steps (9%)
09:02:31:WU01:FS00:0xa4:Completed 25000 out of 250000 steps (10%)
09:04:26:WU01:FS00:0xa4:Completed 27500 out of 250000 steps (11%)
09:06:20:WU01:FS00:0xa4:Completed 30000 out of 250000 steps (12%)
09:08:14:WU01:FS00:0xa4:Completed 32500 out of 250000 steps (13%)
09:09:33:WU02:FS01:0x21:Completed 1150000 out of 2500000 steps (46%)
09:10:07:WU01:FS00:0xa4:Completed 35000 out of 250000 steps (14%)
09:12:01:WU01:FS00:0xa4:Completed 37500 out of 250000 steps (15%)
09:13:55:WU01:FS00:0xa4:Completed 40000 out of 250000 steps (16%)
09:15:50:WU01:FS00:0xa4:Completed 42500 out of 250000 steps (17%)
09:17:43:WU01:FS00:0xa4:Completed 45000 out of 250000 steps (18%)
09:19:19:WU02:FS01:0x21:Completed 1175000 out of 2500000 steps (47%)
09:19:38:WU01:FS00:0xa4:Completed 47500 out of 250000 steps (19%)
09:21:32:WU01:FS00:0xa4:Completed 50000 out of 250000 steps (20%)
09:23:25:WU01:FS00:0xa4:Completed 52500 out of 250000 steps (21%)
09:25:19:WU01:FS00:0xa4:Completed 55000 out of 250000 steps (22%)
09:27:14:WU01:FS00:0xa4:Completed 57500 out of 250000 steps (23%)
09:29:06:WU02:FS01:0x21:Completed 1200000 out of 2500000 steps (48%)
09:29:09:WU01:FS00:0xa4:Completed 60000 out of 250000 steps (24%)
09:31:03:WU01:FS00:0xa4:Completed 62500 out of 250000 steps (25%)
09:32:57:WU01:FS00:0xa4:Completed 65000 out of 250000 steps (26%)
09:34:51:WU01:FS00:0xa4:Completed 67500 out of 250000 steps (27%)
09:36:44:WU01:FS00:0xa4:Completed 70000 out of 250000 steps (28%)
09:38:38:WU01:FS00:0xa4:Completed 72500 out of 250000 steps (29%)
09:38:57:WU02:FS01:0x21:Completed 1225000 out of 2500000 steps (49%)
09:40:33:WU01:FS00:0xa4:Completed 75000 out of 250000 steps (30%)
09:42:28:WU01:FS00:0xa4:Completed 77500 out of 250000 steps (31%)
09:44:22:WU01:FS00:0xa4:Completed 80000 out of 250000 steps (32%)
09:46:16:WU01:FS00:0xa4:Completed 82500 out of 250000 steps (33%)
09:48:10:WU01:FS00:0xa4:Completed 85000 out of 250000 steps (34%)
09:48:44:WU02:FS01:0x21:Completed 1250000 out of 2500000 steps (50%)
09:50:04:WU01:FS00:0xa4:Completed 87500 out of 250000 steps (35%)
09:51:58:WU01:FS00:0xa4:Completed 90000 out of 250000 steps (36%)
09:53:51:WU01:FS00:0xa4:Completed 92500 out of 250000 steps (37%)
09:55:47:WU01:FS00:0xa4:Completed 95000 out of 250000 steps (38%)
09:57:41:WU01:FS00:0xa4:Completed 97500 out of 250000 steps (39%)
09:58:30:WU02:FS01:0x21:Completed 1275000 out of 2500000 steps (51%)
09:59:35:WU01:FS00:0xa4:Completed 100000 out of 250000 steps (40%)
10:01:31:WU01:FS00:0xa4:Completed 102500 out of 250000 steps (41%)
10:03:25:WU01:FS00:0xa4:Completed 105000 out of 250000 steps (42%)
10:05:19:WU01:FS00:0xa4:Completed 107500 out of 250000 steps (43%)
10:07:14:WU01:FS00:0xa4:Completed 110000 out of 250000 steps (44%)
10:08:17:WU02:FS01:0x21:Completed 1300000 out of 2500000 steps (52%)
10:09:10:WU01:FS00:0xa4:Completed 112500 out of 250000 steps (45%)
10:11:04:WU01:FS00:0xa4:Completed 115000 out of 250000 steps (46%)
10:12:58:WU01:FS00:0xa4:Completed 117500 out of 250000 steps (47%)
10:14:52:WU01:FS00:0xa4:Completed 120000 out of 250000 steps (48%)
10:16:47:WU01:FS00:0xa4:Completed 122500 out of 250000 steps (49%)
10:18:07:WU02:FS01:0x21:Completed 1325000 out of 2500000 steps (53%)
10:18:41:WU01:FS00:0xa4:Completed 125000 out of 250000 steps (50%)
10:20:35:WU01:FS00:0xa4:Completed 127500 out of 250000 steps (51%)
10:22:29:WU01:FS00:0xa4:Completed 130000 out of 250000 steps (52%)
10:24:07:51:127.0.0.1:New Web connection
10:24:26:WU01:FS00:0xa4:Completed 132500 out of 250000 steps (53%)
Mod edit: added Code tags to log listing, please use them
Re: Cancel GPU WU
Posted: Thu Oct 20, 2016 10:59 am
by wilding2004
I don't see any errors. You've successfully completed a number of cpu WU's and returned them, and the log shows a gpu WU running smoothly all the way to 53%.
Re: Cancel GPU WU
Posted: Thu Oct 20, 2016 11:41 am
by ChristianVirtual
... and a stable TPF of ~10min
Looking good; what makes you think it's unstable ? I saw on my GTX 970 it had TPF of 6m44s; on 980TI somewhere between 4 and 5 min.
I would not suggest to cancel that WU. It harm the science as you waste your work progress; you might harm your passkey and QRB eligibility plus the next WU might be worst
Re: Cancel GPU WU
Posted: Thu Oct 20, 2016 1:53 pm
by Duce H_K_
167KPPD only?.. I can't believe an RX480 is so slow. It draws power much more than a GTX970. meanwhile GTX970 showed TPF 6:31 & PPD 313 231 in OC mode.
The second p9210 calculated with GTX 1070 had finished with around 509 000 PPD. Actually projects 92xx don't give best PPD, be patient I'm sure you will get better one in other projects.
Re: Cancel GPU WU
Posted: Sat Oct 22, 2016 7:07 am
by bruce
Early RX 480 cards were famous for exceeding the PCI Express power limit. AMD "fixed" that problem in the drivers by limiting the power under load which slowed things down.
I'm not sure if that's your problem. Does you care have an auxiliary plug that provides extra 12v power?
Re: Cancel GPU WU
Posted: Sat Oct 22, 2016 10:02 pm
by unluckycandy
bruce wrote:Early RX 480 cards were famous for exceeding the PCI Express power limit. AMD "fixed" that problem in the drivers by limiting the power under load which slowed things down.
I'm not sure if that's your problem. Does you care have an auxiliary plug that provides extra 12v power?
It is very weird.... I got another 480 and it is folding sround 260k ppd while the other one is still at 160k.....
Re: Cancel GPU WU
Posted: Sun Oct 23, 2016 12:32 am
by SteveWillis
Let me throw this in. I'm folding on three nvidia gtx 1080 cards. No overclock. No over heating. Most WUs give me about 700 - 800 estimated PPD. With around 1/2 to two minutes per fold. In the last couple of days I have noticed 3 WUs in the 92xx range, 9210, 9212, and 9208. All run by Jade SHi. These all run significantly longer, give about half the PPD, and have TPFs of 5 to 7 minutes. Just wanted to let you know you aren't alone.
Re: Cancel GPU WU
Posted: Sun Oct 23, 2016 1:49 am
by ChristianVirtual
@SteveWillis,
can you please post part of the log files where the completion is mentioned; there where cases recently with another project where the total steps to complete a WU got wrong.
Ideally you can find in your log a WU from the impacted project which run well (and post few completion log lines) and find a WU with longer completions time (please post in all case the full Project-Run-Clone-Gen information)
Re: Cancel GPU WU
Posted: Sun Oct 23, 2016 7:36 am
by SteveWillis
@SteveWillis,
can you please post part of the log files where the completion is mentioned; there where cases recently with another project where the total steps to complete a WU got wrong.
Ideally you can find in your log a WU from the impacted project which run well (and post few completion log lines) and find a WU with longer completions time (please post in all case the full Project-Run-Clone-Gen information)
I hope this is what you want
Code: Select all
22:29:46:WU02:FS03:0x21:*********************** Log Started 2016-10-21T22:29:46Z ***********************
22:29:46:WU02:FS03:0x21:Project: 9208 (Run 25, Clone 9, Gen 12)
22:29:46:WU02:FS03:0x21:Unit: 0x00000028ab436c685796c0cd78c5fc69
22:29:46:WU02:FS03:0x21:CPU: 0x00000000000000000000000000000000
22:29:46:WU02:FS03:0x21:Machine: 3
22:29:46:WU02:FS03:0x21:Reading tar file core.xml
22:29:46:WU02:FS03:0x21:Reading tar file integrator.xml
22:29:46:WU02:FS03:0x21:Reading tar file state.xml
22:29:46:WU02:FS03:0x21:Reading tar file system.xml
22:29:46:WU02:FS03:0x21:Digital signatures verified
22:29:46:WU02:FS03:0x21:Folding@home GPU Core21 Folding@home Core
22:29:46:WU02:FS03:0x21:Version 0.0.17
22:29:51:WU04:FS03:Upload 49.22%
22:29:57:WU00:FS01:0x21:Completed 3800000 out of 5000000 steps (76%)
22:29:59:WU04:FS03:Upload complete
22:29:59:WU04:FS03:Server responded WORK_ACK (400)
22:29:59:WU04:FS03:Final credit estimate, 79111.00 points
22:29:59:WU04:FS03:Cleaning up
22:30:03:WU01:FS02:0x21:Completed 1650000 out of 5000000 steps (33%)
22:30:17:WU02:FS03:0x21:Completed 0 out of 2500000 steps (0%)
22:30:17:WU02:FS03:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
22:31:35:WU00:FS01:0x21:Completed 3850000 out of 5000000 steps (77%)
22:32:01:WU01:FS02:0x21:Completed 1700000 out of 5000000 steps (34%)
22:33:16:WU00:FS01:0x21:Completed 3900000 out of 5000000 steps (78%)
22:33:58:WU01:FS02:0x21:Completed 1750000 out of 5000000 steps (35%)
22:34:54:WU00:FS01:0x21:Completed 3950000 out of 5000000 steps (79%)
22:35:17:WU02:FS03:0x21:Completed 25000 out of 2500000 steps (1%)
22:35:58:WU01:FS02:0x21:Completed 1800000 out of 5000000 steps (36%)
22:36:33:WU00:FS01:0x21:Completed 4000000 out of 5000000 steps (80%)
22:37:55:WU01:FS02:0x21:Completed 1850000 out of 5000000 steps (37%)
22:38:13:WU00:FS01:0x21:Completed 4050000 out of 5000000 steps (81%)
22:39:52:WU00:FS01:0x21:Completed 4100000 out of 5000000 steps (82%)
22:39:54:WU01:FS02:0x21:Completed 1900000 out of 5000000 steps (38%)
22:40:16:WU02:FS03:0x21:Completed 50000 out of 2500000 steps (2%)
22:41:32:WU00:FS01:0x21:Completed 4150000 out of 5000000 steps (83%)
22:41:51:WU01:FS02:0x21:Completed 1950000 out of 5000000 steps (39%)
22:43:11:WU00:FS01:0x21:Completed 4200000 out of 5000000 steps (84%)
22:43:49:WU01:FS02:0x21:Completed 2000000 out of 5000000 steps (40%)
22:44:50:WU00:FS01:0x21:Completed 4250000 out of 5000000 steps (85%)
22:45:14:WU02:FS03:0x21:Completed 75000 out of 2500000 steps (3%)
22:45:48:WU01:FS02:0x21:Completed 2050000 out of 5000000 steps (41%)
22:46:30:WU00:FS01:0x21:Completed 4300000 out of 5000000 steps (86%)
22:47:46:WU01:FS02:0x21:Completed 2100000 out of 5000000 steps (42%)
22:48:09:WU00:FS01:0x21:Completed 4350000 out of 5000000 steps (87%)
22:49:45:WU01:FS02:0x21:Completed 2150000 out of 5000000 steps (43%)
22:49:50:WU00:FS01:0x21:Completed 4400000 out of 5000000 steps (88%)
22:50:14:WU02:FS03:0x21:Completed 100000 out of 2500000 steps (4%)
22:51:28:WU00:FS01:0x21:Completed 4450000 out of 5000000 steps (89%)
22:51:42:WU01:FS02:0x21:Completed 2200000 out of 5000000 steps (44%)
22:53:07:WU00:FS01:0x21:Completed 4500000 out of 5000000 steps (90%)
22:53:40:WU01:FS02:0x21:Completed 2250000 out of 5000000 steps (45%)
22:54:47:WU00:FS01:0x21:Completed 4550000 out of 5000000 steps (91%)
22:55:17:WU02:FS03:0x21:Completed 125000 out of 2500000 steps (5%)
22:55:39:WU01:FS02:0x21:Completed 2300000 out of 5000000 steps (46%)
22:56:26:WU00:FS01:0x21:Completed 4600000 out of 5000000 steps (92%)
22:57:36:WU01:FS02:0x21:Completed 2350000 out of 5000000 steps (47%)
22:58:07:WU00:FS01:0x21:Completed 4650000 out of 5000000 steps (93%)
22:59:36:WU01:FS02:0x21:Completed 2400000 out of 5000000 steps (48%)
22:59:45:WU00:FS01:0x21:Completed 4700000 out of 5000000 steps (94%)
23:00:16:WU02:FS03:0x21:Completed 150000 out of 2500000 steps (6%)
23:01:24:WU00:FS01:0x21:Completed 4750000 out of 5000000 steps (95%)
23:01:33:WU01:FS02:0x21:Completed 2450000 out of 5000000 steps (49%)
23:03:05:WU00:FS01:0x21:Completed 4800000 out of 5000000 steps (96%)
23:03:30:WU01:FS02:0x21:Completed 2500000 out of 5000000 steps (50%)
23:04:43:WU00:FS01:0x21:Completed 4850000 out of 5000000 steps (97%)
23:05:15:WU02:FS03:0x21:Completed 175000 out of 2500000 steps (7%)
23:05:30:WU01:FS02:0x21:Completed 2550000 out of 5000000 steps (51%)
23:06:24:WU00:FS01:0x21:Completed 4900000 out of 5000000 steps (98%)
23:07:27:WU01:FS02:0x21:Completed 2600000 out of 5000000 steps (52%)
23:08:02:WU00:FS01:0x21:Completed 4950000 out of 5000000 steps (99%)
23:08:03:WU03:FS01:Connecting to 171.67.108.45:80
23:08:03:WU03:FS01:Assigned to work server 140.163.4.243
23:08:03:WU03:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GP104 [GeForce GTX 1080] from 140.163.4.243
23:08:03:WU03:FS01:Connecting to 140.163.4.243:8080
23:08:04:WU03:FS01:Downloading 2.67MiB
23:08:05:WU03:FS01:Download complete
23:08:05:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:11707 run:63 clone:7 gen:28 core:0x21 unit:0x000000298ca304f357e9eb3bde5b4896
23:09:26:WU01:FS02:0x21:Completed 2650000 out of 5000000 steps (53%)
23:09:41:WU00:FS01:0x21:Completed 5000000 out of 5000000 steps (100%)
23:09:43:WU00:FS01:0x21:Saving result file logfile_01.txt
23:09:43:WU00:FS01:0x21:Saving result file checkpointState.xml
23:09:44:WU00:FS01:0x21:Saving result file checkpt.crc
23:09:44:WU00:FS01:0x21:Saving result file log.txt
23:09:44:WU00:FS01:0x21:Saving result file positions.xtc
23:09:45:WU00:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
23:09:46:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
23:09:46:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:11407 run:0 clone:32 gen:251 core:0x21 unit:0x0000013d8ca304f25686b245cecde7fe
23:09:46:WU00:FS01:Uploading 9.04MiB to 140.163.4.242
23:09:46:WU00:FS01:Connecting to 140.163.4.242:8080
23:09:46:WU03:FS01:Starting
23:09:46:WU03:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 03 -suffix 01 -version 704 -lifeline 1798 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:09:46:WU03:FS01:Started FahCore on PID 20038
23:09:46:WU03:FS01:Core PID:20042
23:09:46:WU03:FS01:FahCore 0x21 started
23:09:47:WU03:FS01:0x21:*********************** Log Started 2016-10-21T23:09:46Z ***********************
23:09:47:WU03:FS01:0x21:Project: 11707 (Run 63, Clone 7, Gen 28)
23:09:47:WU03:FS01:0x21:Unit: 0x000000298ca304f357e9eb3bde5b4896
23:09:47:WU03:FS01:0x21:CPU: 0x00000000000000000000000000000000
23:09:47:WU03:FS01:0x21:Machine: 1
23:09:47:WU03:FS01:0x21:Reading tar file core.xml
23:09:47:WU03:FS01:0x21:Reading tar file system.xml
23:09:47:WU03:FS01:0x21:Reading tar file integrator.xml
23:09:47:WU03:FS01:0x21:Reading tar file state.xml
23:09:47:WU03:FS01:0x21:Digital signatures verified
23:09:47:WU03:FS01:0x21:Folding@home GPU Core21 Folding@home Core
23:09:47:WU03:FS01:0x21:Version 0.0.17
23:09:51:WU03:FS01:0x21:Completed 0 out of 7500000 steps (0%)
23:09:51:WU03:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:09:52:WU00:FS01:Upload 85.71%
23:09:59:WU00:FS01:Upload complete
23:09:59:WU00:FS01:Server responded WORK_ACK (400)
23:09:59:WU00:FS01:Final credit estimate, 95740.00 points
23:09:59:WU00:FS01:Cleaning up
23:10:14:WU02:FS03:0x21:Completed 200000 out of 2500000 steps (8%)
23:11:24:WU01:FS02:0x21:Completed 2700000 out of 5000000 steps (54%)
23:11:55:WU03:FS01:0x21:Completed 75000 out of 7500000 steps (1%)
23:13:21:WU01:FS02:0x21:Completed 2750000 out of 5000000 steps (55%)
23:13:58:WU03:FS01:0x21:Completed 150000 out of 7500000 steps (2%)
23:15:18:WU02:FS03:0x21:Completed 225000 out of 2500000 steps (9%)
23:15:21:WU01:FS02:0x21:Completed 2800000 out of 5000000 steps (56%)
23:16:00:WU03:FS01:0x21:Completed 225000 out of 7500000 steps (3%)
23:17:18:WU01:FS02:0x21:Completed 2850000 out of 5000000 steps (57%)
23:18:04:WU03:FS01:0x21:Completed 300000 out of 7500000 steps (4%)
23:19:17:WU01:FS02:0x21:Completed 2900000 out of 5000000 steps (58%)
23:20:06:WU03:FS01:0x21:Completed 375000 out of 7500000 steps (5%)
23:20:17:WU02:FS03:0x21:Completed 250000 out of 2500000 steps (10%)
23:21:14:WU01:FS02:0x21:Completed 2950000 out of 5000000 steps (59%)
23:22:08:WU03:FS01:0x21:Completed 450000 out of 7500000 steps (6%)
23:23:12:WU01:FS02:0x21:Completed 3000000 out of 5000000 steps (60%)
23:24:11:WU03:FS01:0x21:Completed 525000 out of 7500000 steps (7%)
23:25:11:WU01:FS02:0x21:Completed 3050000 out of 5000000 steps (61%)
23:25:15:WU02:FS03:0x21:Completed 275000 out of 2500000 steps (11%)
23:26:13:WU03:FS01:0x21:Completed 600000 out of 7500000 steps (8%)
23:27:08:WU01:FS02:0x21:Completed 3100000 out of 5000000 steps (62%)
23:28:14:WU03:FS01:0x21:Completed 675000 out of 7500000 steps (9%)
23:29:07:WU01:FS02:0x21:Completed 3150000 out of 5000000 steps (63%)
23:30:13:WU02:FS03:0x21:Completed 300000 out of 2500000 steps (12%)
23:30:16:WU03:FS01:0x21:Completed 750000 out of 7500000 steps (10%)
23:31:05:WU01:FS02:0x21:Completed 3200000 out of 5000000 steps (64%)
23:32:20:WU03:FS01:0x21:Completed 825000 out of 7500000 steps (11%)
23:33:02:WU01:FS02:0x21:Completed 3250000 out of 5000000 steps (65%)
23:34:22:WU03:FS01:0x21:Completed 900000 out of 7500000 steps (12%)
23:35:01:WU01:FS02:0x21:Completed 3300000 out of 5000000 steps (66%)
23:35:17:WU02:FS03:0x21:Completed 325000 out of 2500000 steps (13%)
23:36:24:WU03:FS01:0x21:Completed 975000 out of 7500000 steps (13%)
23:36:59:WU01:FS02:0x21:Completed 3350000 out of 5000000 steps (67%)
23:38:28:WU03:FS01:0x21:Completed 1050000 out of 7500000 steps (14%)
23:38:58:WU01:FS02:0x21:Completed 3400000 out of 5000000 steps (68%)
23:40:16:WU02:FS03:0x21:Completed 350000 out of 2500000 steps (14%)
23:40:31:WU03:FS01:0x21:Completed 1125000 out of 7500000 steps (15%)
23:40:56:WU01:FS02:0x21:Completed 3450000 out of 5000000 steps (69%)
23:42:34:WU03:FS01:0x21:Completed 1200000 out of 7500000 steps (16%)
23:42:53:WU01:FS02:0x21:Completed 3500000 out of 5000000 steps (70%)
23:44:38:WU03:FS01:0x21:Completed 1275000 out of 7500000 steps (17%)
23:44:52:WU01:FS02:0x21:Completed 3550000 out of 5000000 steps (71%)
23:45:15:WU02:FS03:0x21:Completed 375000 out of 2500000 steps (15%)
23:46:41:WU03:FS01:0x21:Completed 1350000 out of 7500000 steps (18%)
23:46:50:WU01:FS02:0x21:Completed 3600000 out of 5000000 steps (72%)
23:48:43:WU03:FS01:0x21:Completed 1425000 out of 7500000 steps (19%)
23:48:49:WU01:FS02:0x21:Completed 3650000 out of 5000000 steps (73%)
23:50:13:WU02:FS03:0x21:Completed 400000 out of 2500000 steps (16%)
23:50:46:WU03:FS01:0x21:Completed 1500000 out of 7500000 steps (20%)
23:50:47:WU01:FS02:0x21:Completed 3700000 out of 5000000 steps (74%)
23:52:44:WU01:FS02:0x21:Completed 3750000 out of 5000000 steps (75%)
23:52:50:WU03:FS01:0x21:Completed 1575000 out of 7500000 steps (21%)
23:54:43:WU01:FS02:0x21:Completed 3800000 out of 5000000 steps (76%)
23:54:53:WU03:FS01:0x21:Completed 1650000 out of 7500000 steps (22%)
23:55:17:WU02:FS03:0x21:Completed 425000 out of 2500000 steps (17%)
23:56:41:WU01:FS02:0x21:Completed 3850000 out of 5000000 steps (77%)
23:56:56:WU03:FS01:0x21:Completed 1725000 out of 7500000 steps (23%)
23:58:40:WU01:FS02:0x21:Completed 3900000 out of 5000000 steps (78%)
23:59:00:WU03:FS01:0x21:Completed 1800000 out of 7500000 steps (24%)
00:00:15:WU02:FS03:0x21:Completed 450000 out of 2500000 steps (18%)
00:00:38:WU01:FS02:0x21:Completed 3950000 out of 5000000 steps (79%)
00:01:02:WU03:FS01:0x21:Completed 1875000 out of 7500000 steps (25%)
00:02:35:WU01:FS02:0x21:Completed 4000000 out of 5000000 steps (80%)
00:03:04:WU03:FS01:0x21:Completed 1950000 out of 7500000 steps (26%)
00:04:34:WU01:FS02:0x21:Completed 4050000 out of 5000000 steps (81%)
00:05:07:WU03:FS01:0x21:Completed 2025000 out of 7500000 steps (27%)
00:05:14:WU02:FS03:0x21:Completed 475000 out of 2500000 steps (19%)
00:06:31:WU01:FS02:0x21:Completed 4100000 out of 5000000 steps (82%)
00:07:08:WU03:FS01:0x21:Completed 2100000 out of 7500000 steps (28%)
00:08:31:WU01:FS02:0x21:Completed 4150000 out of 5000000 steps (83%)
00:09:10:WU03:FS01:0x21:Completed 2175000 out of 7500000 steps (29%)
00:10:12:WU02:FS03:0x21:Completed 500000 out of 2500000 steps (20%)
00:10:28:WU01:FS02:0x21:Completed 4200000 out of 5000000 steps (84%)
00:11:11:WU03:FS01:0x21:Completed 2250000 out of 7500000 steps (30%)
00:12:25:WU01:FS02:0x21:Completed 4250000 out of 5000000 steps (85%)
00:13:15:WU03:FS01:0x21:Completed 2325000 out of 7500000 steps (31%)
00:14:25:WU01:FS02:0x21:Completed 4300000 out of 5000000 steps (86%)
00:15:16:WU02:FS03:0x21:Completed 525000 out of 2500000 steps (21%)
00:15:17:WU03:FS01:0x21:Completed 2400000 out of 7500000 steps (32%)
00:16:22:WU01:FS02:0x21:Completed 4350000 out of 5000000 steps (87%)
00:17:19:WU03:FS01:0x21:Completed 2475000 out of 7500000 steps (33%)
00:18:21:WU01:FS02:0x21:Completed 4400000 out of 5000000 steps (88%)
00:19:23:WU03:FS01:0x21:Completed 2550000 out of 7500000 steps (34%)
00:20:14:WU02:FS03:0x21:Completed 550000 out of 2500000 steps (22%)
00:20:19:WU01:FS02:0x21:Completed 4450000 out of 5000000 steps (89%)
00:21:25:WU03:FS01:0x21:Completed 2625000 out of 7500000 steps (35%)
00:22:16:WU01:FS02:0x21:Completed 4500000 out of 5000000 steps (90%)
00:23:27:WU03:FS01:0x21:Completed 2700000 out of 7500000 steps (36%)
00:24:15:WU01:FS02:0x21:Completed 4550000 out of 5000000 steps (91%)
00:25:13:WU02:FS03:0x21:Completed 575000 out of 2500000 steps (23%)
00:25:31:WU03:FS01:0x21:Completed 2775000 out of 7500000 steps (37%)
00:26:12:WU01:FS02:0x21:Completed 4600000 out of 5000000 steps (92%)
00:27:33:WU03:FS01:0x21:Completed 2850000 out of 7500000 steps (38%)
00:28:12:WU01:FS02:0x21:Completed 4650000 out of 5000000 steps (93%)
00:29:35:WU03:FS01:0x21:Completed 2925000 out of 7500000 steps (39%)
00:30:09:WU01:FS02:0x21:Completed 4700000 out of 5000000 steps (94%)
00:30:11:WU02:FS03:0x21:Completed 600000 out of 2500000 steps (24%)
00:31:36:WU03:FS01:0x21:Completed 3000000 out of 7500000 steps (40%)
00:32:06:WU01:FS02:0x21:Completed 4750000 out of 5000000 steps (95%)
00:33:40:WU03:FS01:0x21:Completed 3075000 out of 7500000 steps (41%)
00:34:06:WU01:FS02:0x21:Completed 4800000 out of 5000000 steps (96%)
00:35:14:WU02:FS03:0x21:Completed 625000 out of 2500000 steps (25%)
00:35:42:WU03:FS01:0x21:Completed 3150000 out of 7500000 steps (42%)
00:36:03:WU01:FS02:0x21:Completed 4850000 out of 5000000 steps (97%)
00:37:44:WU03:FS01:0x21:Completed 3225000 out of 7500000 steps (43%)
00:38:02:WU01:FS02:0x21:Completed 4900000 out of 5000000 steps (98%)
00:39:47:WU03:FS01:0x21:Completed 3300000 out of 7500000 steps (44%)
00:40:00:WU01:FS02:0x21:Completed 4950000 out of 5000000 steps (99%)
00:40:00:WU00:FS02:Connecting to 171.67.108.45:80
00:40:00:WU00:FS02:Assigned to work server 171.67.108.105
00:40:00:WU00:FS02:Requesting new work unit for slot 02: RUNNING gpu:2:GP104 [GeForce GTX 1080] from 171.67.108.105
00:40:00:WU00:FS02:Connecting to 171.67.108.105:8080
00:40:01:WU00:FS02:Downloading 21.67MiB
00:40:03:WU00:FS02:Download complete
00:40:03:WU00:FS02:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9177 run:24 clone:6 gen:80 core:0x21 unit:0x00000062ab436c6957b24c298442ee2f
00:40:13:WU02:FS03:0x21:Completed 650000 out of 2500000 steps (26%)
00:41:50:WU03:FS01:0x21:Completed 3375000 out of 7500000 steps (45%)
00:41:57:WU01:FS02:0x21:Completed 5000000 out of 5000000 steps (100%)
00:41:59:WU01:FS02:0x21:Saving result file logfile_01.txt
00:41:59:WU01:FS02:0x21:Saving result file checkpointState.xml
00:42:00:WU01:FS02:0x21:Saving result file checkpt.crc
00:42:00:WU01:FS02:0x21:Saving result file log.txt
00:42:00:WU01:FS02:0x21:Saving result file positions.xtc
00:42:02:WU01:FS02:0x21:Folding@home Core Shutdown: FINISHED_UNIT
00:42:02:WU01:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
00:42:02:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:11401 run:86 clone:34 gen:2 core:0x21 unit:0x000000048ca304f257c5cdb358ffe9f4
00:42:02:WU01:FS02:Uploading 10.76MiB to 140.163.4.242
00:42:02:WU01:FS02:Connecting to 140.163.4.242:8080
00:42:02:WU00:FS02:Starting
00:42:02:WU00:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 00 -suffix 01 -version 704 -lifeline 1798 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
00:42:02:WU00:FS02:Started FahCore on PID 20560
00:42:02:WU00:FS02:Core PID:20564
00:42:02:WU00:FS02:FahCore 0x21 started
00:42:03:WU00:FS02:0x21:*********************** Log Started 2016-10-22T00:42:02Z ***********************
00:42:03:WU00:FS02:0x21:Project: 9177 (Run 24, Clone 6, Gen 80)
00:42:03:WU00:FS02:0x21:Unit: 0x00000062ab436c6957b24c298442ee2f
00:42:03:WU00:FS02:0x21:CPU: 0x00000000000000000000000000000000
00:42:03:WU00:FS02:0x21:Machine: 2
00:42:03:WU00:FS02:0x21:Reading tar file core.xml
00:42:03:WU00:FS02:0x21:Reading tar file integrator.xml
00:42:03:WU00:FS02:0x21:Reading tar file state.xml
00:42:03:WU00:FS02:0x21:Reading tar file system.xml
00:42:03:WU00:FS02:0x21:Digital signatures verified
00:42:03:WU00:FS02:0x21:Folding@home GPU Core21 Folding@home Core
00:42:03:WU00:FS02:0x21:Version 0.0.17
00:42:08:WU01:FS02:Upload 31.95%
00:42:11:WU00:FS02:0x21:Completed 0 out of 2500000 steps (0%)
00:42:11:WU00:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:42:19:WU01:FS02:Upload complete
00:42:19:WU01:FS02:Server responded WORK_ACK (400)
00:42:19:WU01:FS02:Final credit estimate, 115122.00 points
00:42:19:WU01:FS02:Cleaning up
00:43:01:WU00:FS02:0x21:Completed 25000 out of 2500000 steps (1%)
00:43:50:WU00:FS02:0x21:Completed 50000 out of 2500000 steps (2%)
00:43:52:WU03:FS01:0x21:Completed 3450000 out of 7500000 steps (46%)
00:44:40:WU00:FS02:0x21:Completed 75000 out of 2500000 steps (3%)
00:45:11:WU02:FS03:0x21:Completed 675000 out of 2500000 steps (27%)
00:45:29:WU00:FS02:0x21:Completed 100000 out of 2500000 steps (4%)
00:45:56:WU03:FS01:0x21:Completed 3525000 out of 7500000 steps (47%)
00:46:21:WU00:FS02:0x21:Completed 125000 out of 2500000 steps (5%)
00:47:10:WU00:FS02:0x21:Completed 150000 out of 2500000 steps (6%)
00:47:58:WU03:FS01:0x21:Completed 3600000 out of 7500000 steps (48%)
00:48:00:WU00:FS02:0x21:Completed 175000 out of 2500000 steps (7%)
00:48:50:WU00:FS02:0x21:Completed 200000 out of 2500000 steps (8%)
00:49:41:WU00:FS02:0x21:Completed 225000 out of 2500000 steps (9%)
00:50:01:WU03:FS01:0x21:Completed 3675000 out of 7500000 steps (49%)
00:50:10:WU02:FS03:0x21:Completed 700000 out of 2500000 steps (28%)
00:50:31:WU00:FS02:0x21:Completed 250000 out of 2500000 steps (10%)
00:51:20:WU00:FS02:0x21:Completed 275000 out of 2500000 steps (11%)
00:52:04:WU03:FS01:0x21:Completed 3750000 out of 7500000 steps (50%)
00:52:10:WU00:FS02:0x21:Completed 300000 out of 2500000 steps (12%)
00:53:01:WU00:FS02:0x21:Completed 325000 out of 2500000 steps (13%)
00:53:51:WU00:FS02:0x21:Completed 350000 out of 2500000 steps (14%)
00:54:08:WU03:FS01:0x21:Completed 3825000 out of 7500000 steps (51%)
00:54:40:WU00:FS02:0x21:Completed 375000 out of 2500000 steps (15%)
00:55:14:WU02:FS03:0x21:Completed 725000 out of 2500000 steps (29%)
00:55:30:WU00:FS02:0x21:Completed 400000 out of 2500000 steps (16%)
00:56:10:WU03:FS01:0x21:Completed 3900000 out of 7500000 steps (52%)
00:56:21:WU00:FS02:0x21:Completed 425000 out of 2500000 steps (17%)
00:57:11:WU00:FS02:0x21:Completed 450000 out of 2500000 steps (18%)
00:58:00:WU00:FS02:0x21:Completed 475000 out of 2500000 steps (19%)
00:58:12:WU03:FS01:0x21:Completed 3975000 out of 7500000 steps (53%)
00:58:50:WU00:FS02:0x21:Completed 500000 out of 2500000 steps (20%)
00:59:41:WU00:FS02:0x21:Completed 525000 out of 2500000 steps (21%)
01:00:13:WU02:FS03:0x21:Completed 750000 out of 2500000 steps (30%)
01:00:16:WU03:FS01:0x21:Completed 4050000 out of 7500000 steps (54%)
01:00:30:WU00:FS02:0x21:Completed 550000 out of 2500000 steps (22%)
01:01:20:WU00:FS02:0x21:Completed 575000 out of 2500000 steps (23%)
01:02:10:WU00:FS02:0x21:Completed 600000 out of 2500000 steps (24%)
01:02:18:WU03:FS01:0x21:Completed 4125000 out of 7500000 steps (55%)
01:03:01:WU00:FS02:0x21:Completed 625000 out of 2500000 steps (25%)
01:03:50:WU00:FS02:0x21:Completed 650000 out of 2500000 steps (26%)
01:04:21:WU03:FS01:0x21:Completed 4200000 out of 7500000 steps (56%)
01:04:40:WU00:FS02:0x21:Completed 675000 out of 2500000 steps (27%)
01:05:11:WU02:FS03:0x21:Completed 775000 out of 2500000 steps (31%)
01:05:29:WU00:FS02:0x21:Completed 700000 out of 2500000 steps (28%)
01:06:21:WU00:FS02:0x21:Completed 725000 out of 2500000 steps (29%)
01:06:25:WU03:FS01:0x21:Completed 4275000 out of 7500000 steps (57%)
01:07:10:WU00:FS02:0x21:Completed 750000 out of 2500000 steps (30%)
01:08:00:WU00:FS02:0x21:Completed 775000 out of 2500000 steps (31%)
01:08:27:WU03:FS01:0x21:Completed 4350000 out of 7500000 steps (58%)
01:08:49:WU00:FS02:0x21:Completed 800000 out of 2500000 steps (32%)
01:09:40:WU00:FS02:0x21:Completed 825000 out of 2500000 steps (33%)
01:10:10:WU02:FS03:0x21:Completed 800000 out of 2500000 steps (32%)
01:10:29:WU03:FS01:0x21:Completed 4425000 out of 7500000 steps (59%)
01:10:30:WU00:FS02:0x21:Completed 850000 out of 2500000 steps (34%)
01:11:19:WU00:FS02:0x21:Completed 875000 out of 2500000 steps (35%)
01:12:09:WU00:FS02:0x21:Completed 900000 out of 2500000 steps (36%)
01:12:32:WU03:FS01:0x21:Completed 4500000 out of 7500000 steps (60%)
01:13:00:WU00:FS02:0x21:Completed 925000 out of 2500000 steps (37%)
01:13:50:WU00:FS02:0x21:Completed 950000 out of 2500000 steps (38%)
01:14:35:WU03:FS01:0x21:Completed 4575000 out of 7500000 steps (61%)
01:14:39:WU00:FS02:0x21:Completed 975000 out of 2500000 steps (39%)
01:15:14:WU02:FS03:0x21:Completed 825000 out of 2500000 steps (33%)
01:15:29:WU00:FS02:0x21:Completed 1000000 out of 2500000 steps (40%)
01:16:20:WU00:FS02:0x21:Completed 1025000 out of 2500000 steps (41%)
01:16:37:WU03:FS01:0x21:Completed 4650000 out of 7500000 steps (62%)
01:17:10:WU00:FS02:0x21:Completed 1050000 out of 2500000 steps (42%)
01:17:59:WU00:FS02:0x21:Completed 1075000 out of 2500000 steps (43%)
01:18:40:WU03:FS01:0x21:Completed 4725000 out of 7500000 steps (63%)
01:18:49:WU00:FS02:0x21:Completed 1100000 out of 2500000 steps (44%)
01:19:40:WU00:FS02:0x21:Completed 1125000 out of 2500000 steps (45%)
01:20:12:WU02:FS03:0x21:Completed 850000 out of 2500000 steps (34%)
01:20:30:WU00:FS02:0x21:Completed 1150000 out of 2500000 steps (46%)
01:20:43:WU03:FS01:0x21:Completed 4800000 out of 7500000 steps (64%)
01:21:19:WU00:FS02:0x21:Completed 1175000 out of 2500000 steps (47%)
01:22:09:WU00:FS02:0x21:Completed 1200000 out of 2500000 steps (48%)
01:22:44:WU03:FS01:0x21:Completed 4875000 out of 7500000 steps (65%)
01:23:00:WU00:FS02:0x21:Completed 1225000 out of 2500000 steps (49%)
01:23:49:WU00:FS02:0x21:Completed 1250000 out of 2500000 steps (50%)
01:24:39:WU00:FS02:0x21:Completed 1275000 out of 2500000 steps (51%)
01:24:45:WU03:FS01:0x21:Completed 4950000 out of 7500000 steps (66%)
01:25:11:WU02:FS03:0x21:Completed 875000 out of 2500000 steps (35%)
01:25:29:WU00:FS02:0x21:Completed 1300000 out of 2500000 steps (52%)
01:26:20:WU00:FS02:0x21:Completed 1325000 out of 2500000 steps (53%)
01:26:48:WU03:FS01:0x21:Completed 5025000 out of 7500000 steps (67%)
01:27:10:WU00:FS02:0x21:Completed 1350000 out of 2500000 steps (54%)
01:27:59:WU00:FS02:0x21:Completed 1375000 out of 2500000 steps (55%)
01:28:49:WU00:FS02:0x21:Completed 1400000 out of 2500000 steps (56%)
01:28:50:WU03:FS01:0x21:Completed 5100000 out of 7500000 steps (68%)
01:29:40:WU00:FS02:0x21:Completed 1425000 out of 2500000 steps (57%)
01:30:09:WU02:FS03:0x21:Completed 900000 out of 2500000 steps (36%)
01:30:30:WU00:FS02:0x21:Completed 1450000 out of 2500000 steps (58%)
01:30:51:WU03:FS01:0x21:Completed 5175000 out of 7500000 steps (69%)
01:31:19:WU00:FS02:0x21:Completed 1475000 out of 2500000 steps (59%)
01:32:09:WU00:FS02:0x21:Completed 1500000 out of 2500000 steps (60%)
01:32:53:WU03:FS01:0x21:Completed 5250000 out of 7500000 steps (70%)
01:33:00:WU00:FS02:0x21:Completed 1525000 out of 2500000 steps (61%)
01:33:49:WU00:FS02:0x21:Completed 1550000 out of 2500000 steps (62%)
01:34:39:WU00:FS02:0x21:Completed 1575000 out of 2500000 steps (63%)
01:34:55:WU03:FS01:0x21:Completed 5325000 out of 7500000 steps (71%)
01:35:13:WU02:FS03:0x21:Completed 925000 out of 2500000 steps (37%)
01:35:28:WU00:FS02:0x21:Completed 1600000 out of 2500000 steps (64%)
01:36:19:WU00:FS02:0x21:Completed 1625000 out of 2500000 steps (65%)
01:36:57:WU03:FS01:0x21:Completed 5400000 out of 7500000 steps (72%)
01:37:09:WU00:FS02:0x21:Completed 1650000 out of 2500000 steps (66%)
01:37:59:WU00:FS02:0x21:Completed 1675000 out of 2500000 steps (67%)
01:38:48:WU00:FS02:0x21:Completed 1700000 out of 2500000 steps (68%)
01:38:58:WU03:FS01:0x21:Completed 5475000 out of 7500000 steps (73%)
01:39:39:WU00:FS02:0x21:Completed 1725000 out of 2500000 steps (69%)
01:40:11:WU02:FS03:0x21:Completed 950000 out of 2500000 steps (38%)
01:40:29:WU00:FS02:0x21:Completed 1750000 out of 2500000 steps (70%)
01:41:01:WU03:FS01:0x21:Completed 5550000 out of 7500000 steps (74%)
01:41:18:WU00:FS02:0x21:Completed 1775000 out of 2500000 steps (71%)
01:42:08:WU00:FS02:0x21:Completed 1800000 out of 2500000 steps (72%)
01:42:59:WU00:FS02:0x21:Completed 1825000 out of 2500000 steps (73%)
01:43:03:WU03:FS01:0x21:Completed 5625000 out of 7500000 steps (75%)
01:43:48:WU00:FS02:0x21:Completed 1850000 out of 2500000 steps (74%)
01:44:38:WU00:FS02:0x21:Completed 1875000 out of 2500000 steps (75%)
01:45:04:WU03:FS01:0x21:Completed 5700000 out of 7500000 steps (76%)
01:45:10:WU02:FS03:0x21:Completed 975000 out of 2500000 steps (39%)
01:45:27:WU00:FS02:0x21:Completed 1900000 out of 2500000 steps (76%)
01:46:18:WU00:FS02:0x21:Completed 1925000 out of 2500000 steps (77%)
01:47:07:WU03:FS01:0x21:Completed 5775000 out of 7500000 steps (77%)
01:47:08:WU00:FS02:0x21:Completed 1950000 out of 2500000 steps (78%)
01:47:57:WU00:FS02:0x21:Completed 1975000 out of 2500000 steps (79%)
01:48:47:WU00:FS02:0x21:Completed 2000000 out of 2500000 steps (80%)
01:49:09:WU03:FS01:0x21:Completed 5850000 out of 7500000 steps (78%)
01:49:38:WU00:FS02:0x21:Completed 2025000 out of 2500000 steps (81%)
01:50:08:WU02:FS03:0x21:Completed 1000000 out of 2500000 steps (40%)
01:50:28:WU00:FS02:0x21:Completed 2050000 out of 2500000 steps (82%)
01:51:10:WU03:FS01:0x21:Completed 5925000 out of 7500000 steps (79%)
01:51:17:WU00:FS02:0x21:Completed 2075000 out of 2500000 steps (83%)
01:52:07:WU00:FS02:0x21:Completed 2100000 out of 2500000 steps (84%)
01:52:58:WU00:FS02:0x21:Completed 2125000 out of 2500000 steps (85%)
01:53:11:WU03:FS01:0x21:Completed 6000000 out of 7500000 steps (80%)
01:53:47:WU00:FS02:0x21:Completed 2150000 out of 2500000 steps (86%)
01:54:37:WU00:FS02:0x21:Completed 2175000 out of 2500000 steps (87%)
01:55:13:WU02:FS03:0x21:Completed 1025000 out of 2500000 steps (41%)
01:55:14:WU03:FS01:0x21:Completed 6075000 out of 7500000 steps (81%)
01:55:26:WU00:FS02:0x21:Completed 2200000 out of 2500000 steps (88%)
01:56:17:WU00:FS02:0x21:Completed 2225000 out of 2500000 steps (89%)
01:57:07:WU00:FS02:0x21:Completed 2250000 out of 2500000 steps (90%)
01:57:15:WU03:FS01:0x21:Completed 6150000 out of 7500000 steps (82%)
01:57:56:WU00:FS02:0x21:Completed 2275000 out of 2500000 steps (91%)
01:58:46:WU00:FS02:0x21:Completed 2300000 out of 2500000 steps (92%)
01:59:17:WU03:FS01:0x21:Completed 6225000 out of 7500000 steps (83%)
01:59:37:WU00:FS02:0x21:Completed 2325000 out of 2500000 steps (93%)
02:00:11:WU02:FS03:0x21:Completed 1050000 out of 2500000 steps (42%)
02:00:26:WU00:FS02:0x21:Completed 2350000 out of 2500000 steps (94%)
02:01:16:WU00:FS02:0x21:Completed 2375000 out of 2500000 steps (95%)
02:01:19:WU03:FS01:0x21:Completed 6300000 out of 7500000 steps (84%)
02:02:06:WU00:FS02:0x21:Completed 2400000 out of 2500000 steps (96%)
02:02:57:WU00:FS02:0x21:Completed 2425000 out of 2500000 steps (97%)
02:03:21:WU03:FS01:0x21:Completed 6375000 out of 7500000 steps (85%)
02:03:46:WU00:FS02:0x21:Completed 2450000 out of 2500000 steps (98%)
02:04:36:WU00:FS02:0x21:Completed 2475000 out of 2500000 steps (99%)
02:04:37:WU01:FS02:Connecting to 171.67.108.45:80
02:04:37:WU01:FS02:Assigned to work server 171.64.65.84
02:04:37:WU01:FS02:Requesting new work unit for slot 02: RUNNING gpu:2:GP104 [GeForce GTX 1080] from 171.64.65.84
02:04:37:WU01:FS02:Connecting to 171.64.65.84:8080
02:04:38:WU01:FS02:Downloading 3.18MiB
02:04:40:WU01:FS02:Download complete
02:04:41:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9192 run:1 clone:49 gen:50 core:0x21 unit:0x0000003aab40415457cb2d4b06e7f3e1
02:05:09:WU02:FS03:0x21:Completed 1075000 out of 2500000 steps (43%)
02:05:22:WU03:FS01:0x21:Completed 6450000 out of 7500000 steps (86%)
02:05:25:WU00:FS02:0x21:Completed 2500000 out of 2500000 steps (100%)
02:05:27:WU00:FS02:0x21:Saving result file logfile_01.txt
02:05:27:WU00:FS02:0x21:Saving result file checkpointState.xml
02:05:27:WU00:FS02:0x21:Saving result file checkpt.crc
02:05:27:WU00:FS02:0x21:Saving result file log.txt
02:05:27:WU00:FS02:0x21:Saving result file positions.xtc
02:05:27:WU00:FS02:0x21:Folding@home Core Shutdown: FINISHED_UNIT
02:05:27:WU00:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:05:27:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:9177 run:24 clone:6 gen:80 core:0x21 unit:0x00000062ab436c6957b24c298442ee2f
02:05:27:WU00:FS02:Uploading 13.11MiB to 171.67.108.105
02:05:27:WU00:FS02:Connecting to 171.67.108.105:8080
02:05:27:WU01:FS02:Starting
02:05:27:WU01:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1798 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
02:05:27:WU01:FS02:Started FahCore on PID 21076
02:05:27:WU01:FS02:Core PID:21080
02:05:27:WU01:FS02:FahCore 0x21 started
02:05:28:WU01:FS02:0x21:*********************** Log Started 2016-10-22T02:05:27Z ***********************
02:05:28:WU01:FS02:0x21:Project: 9192 (Run 1, Clone 49, Gen 50)
02:05:28:WU01:FS02:0x21:Unit: 0x0000003aab40415457cb2d4b06e7f3e1
02:05:28:WU01:FS02:0x21:CPU: 0x00000000000000000000000000000000
02:05:28:WU01:FS02:0x21:Machine: 2
02:05:28:WU01:FS02:0x21:Reading tar file core.xml
02:05:28:WU01:FS02:0x21:Reading tar file system.xml
02:05:28:WU01:FS02:0x21:Reading tar file integrator.xml
02:05:28:WU01:FS02:0x21:Reading tar file state.xml
02:05:28:WU01:FS02:0x21:Digital signatures verified
02:05:28:WU01:FS02:0x21:Folding@home GPU Core21 Folding@home Core
02:05:28:WU01:FS02:0x21:Version 0.0.17
02:05:33:WU00:FS02:Upload 59.61%
02:05:34:WU01:FS02:0x21:Completed 0 out of 2500000 steps (0%)
02:05:34:WU01:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
02:05:37:WU00:FS02:Upload complete
02:05:37:WU00:FS02:Server responded WORK_ACK (400)
02:05:37:WU00:FS02:Final credit estimate, 42586.00 points
02:05:37:WU00:FS02:Cleaning up
Re: Cancel GPU WU
Posted: Sun Oct 23, 2016 7:37 am
by SteveWillis
Code: Select all
02:06:22:WU01:FS02:0x21:Completed 25000 out of 2500000 steps (1%)
02:07:10:WU01:FS02:0x21:Completed 50000 out of 2500000 steps (2%)
02:07:25:WU03:FS01:0x21:Completed 6525000 out of 7500000 steps (87%)
02:07:59:WU01:FS02:0x21:Completed 75000 out of 2500000 steps (3%)
02:08:47:WU01:FS02:0x21:Completed 100000 out of 2500000 steps (4%)
02:09:26:WU03:FS01:0x21:Completed 6600000 out of 7500000 steps (88%)
02:09:36:WU01:FS02:0x21:Completed 125000 out of 2500000 steps (5%)
02:10:06:WU02:FS03:0x21:Completed 1100000 out of 2500000 steps (44%)
02:10:25:WU01:FS02:0x21:Completed 150000 out of 2500000 steps (6%)
02:11:13:WU01:FS02:0x21:Completed 175000 out of 2500000 steps (7%)
02:11:27:WU03:FS01:0x21:Completed 6675000 out of 7500000 steps (89%)
02:12:01:WU01:FS02:0x21:Completed 200000 out of 2500000 steps (8%)
02:12:51:WU01:FS02:0x21:Completed 225000 out of 2500000 steps (9%)
02:13:28:WU03:FS01:0x21:Completed 6750000 out of 7500000 steps (90%)
02:13:39:WU01:FS02:0x21:Completed 250000 out of 2500000 steps (10%)
02:14:27:WU01:FS02:0x21:Completed 275000 out of 2500000 steps (11%)
02:15:09:WU02:FS03:0x21:Completed 1125000 out of 2500000 steps (45%)
02:15:15:WU01:FS02:0x21:Completed 300000 out of 2500000 steps (12%)
02:15:32:WU03:FS01:0x21:Completed 6825000 out of 7500000 steps (91%)
02:16:05:WU01:FS02:0x21:Completed 325000 out of 2500000 steps (13%)
02:16:53:WU01:FS02:0x21:Completed 350000 out of 2500000 steps (14%)
02:17:33:WU03:FS01:0x21:Completed 6900000 out of 7500000 steps (92%)
02:17:41:WU01:FS02:0x21:Completed 375000 out of 2500000 steps (15%)
02:18:29:WU01:FS02:0x21:Completed 400000 out of 2500000 steps (16%)
02:19:19:WU01:FS02:0x21:Completed 425000 out of 2500000 steps (17%)
02:19:34:WU03:FS01:0x21:Completed 6975000 out of 7500000 steps (93%)
02:20:07:WU02:FS03:0x21:Completed 1150000 out of 2500000 steps (46%)
02:20:07:WU01:FS02:0x21:Completed 450000 out of 2500000 steps (18%)
02:20:55:WU01:FS02:0x21:Completed 475000 out of 2500000 steps (19%)
02:21:36:WU03:FS01:0x21:Completed 7050000 out of 7500000 steps (94%)
02:21:43:WU01:FS02:0x21:Completed 500000 out of 2500000 steps (20%)
02:22:33:WU01:FS02:0x21:Completed 525000 out of 2500000 steps (21%)
02:23:21:WU01:FS02:0x21:Completed 550000 out of 2500000 steps (22%)
02:23:37:WU03:FS01:0x21:Completed 7125000 out of 7500000 steps (95%)
02:24:10:WU01:FS02:0x21:Completed 575000 out of 2500000 steps (23%)
02:24:58:WU01:FS02:0x21:Completed 600000 out of 2500000 steps (24%)
02:25:04:WU02:FS03:0x21:Completed 1175000 out of 2500000 steps (47%)
02:25:38:WU03:FS01:0x21:Completed 7200000 out of 7500000 steps (96%)
02:25:47:WU01:FS02:0x21:Completed 625000 out of 2500000 steps (25%)
02:26:35:WU01:FS02:0x21:Completed 650000 out of 2500000 steps (26%)
02:27:24:WU01:FS02:0x21:Completed 675000 out of 2500000 steps (27%)
02:27:41:WU03:FS01:0x21:Completed 7275000 out of 7500000 steps (97%)
02:28:12:WU01:FS02:0x21:Completed 700000 out of 2500000 steps (28%)
02:29:01:WU01:FS02:0x21:Completed 725000 out of 2500000 steps (29%)
02:29:42:WU03:FS01:0x21:Completed 7350000 out of 7500000 steps (98%)
02:29:49:WU01:FS02:0x21:Completed 750000 out of 2500000 steps (30%)
02:30:01:WU02:FS03:0x21:Completed 1200000 out of 2500000 steps (48%)
02:30:38:WU01:FS02:0x21:Completed 775000 out of 2500000 steps (31%)
02:31:26:WU01:FS02:0x21:Completed 800000 out of 2500000 steps (32%)
02:31:43:WU03:FS01:0x21:Completed 7425000 out of 7500000 steps (99%)
02:31:44:WU00:FS01:Connecting to 171.67.108.45:80
02:31:44:WU00:FS01:Assigned to work server 171.67.108.104
02:31:44:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GP104 [GeForce GTX 1080] from 171.67.108.104
02:31:44:WU00:FS01:Connecting to 171.67.108.104:8080
02:31:45:WU00:FS01:Downloading 80.26MiB
02:31:51:WU00:FS01:Download 58.79%
02:31:54:WU00:FS01:Download complete
02:31:55:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9212 run:12 clone:22 gen:4 core:0x21 unit:0x00000014ab436c685796c0fd7e309d92
02:32:15:WU01:FS02:0x21:Completed 825000 out of 2500000 steps (33%)
02:33:03:WU01:FS02:0x21:Completed 850000 out of 2500000 steps (34%)
02:33:44:WU03:FS01:0x21:Completed 7500000 out of 7500000 steps (100%)
02:33:46:WU03:FS01:0x21:Saving result file logfile_01.txt
02:33:46:WU03:FS01:0x21:Saving result file checkpointState.xml
02:33:46:WU03:FS01:0x21:Saving result file checkpt.crc
02:33:46:WU03:FS01:0x21:Saving result file log.txt
02:33:46:WU03:FS01:0x21:Saving result file positions.xtc
02:33:47:WU03:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
02:33:48:WU03:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:33:48:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:11707 run:63 clone:7 gen:28 core:0x21 unit:0x000000298ca304f357e9eb3bde5b4896
02:33:48:WU03:FS01:Uploading 5.85MiB to 140.163.4.243
02:33:48:WU03:FS01:Connecting to 140.163.4.243:8080
02:33:48:WU00:FS01:Starting
02:33:48:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 00 -suffix 01 -version 704 -lifeline 1798 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
02:33:48:WU00:FS01:Started FahCore on PID 21200
02:33:48:WU00:FS01:Core PID:21204
02:33:48:WU00:FS01:FahCore 0x21 started
02:33:48:WU00:FS01:0x21:*********************** Log Started 2016-10-22T02:33:48Z ***********************
02:33:48:WU00:FS01:0x21:Project: 9212 (Run 12, Clone 22, Gen 4)
02:33:48:WU00:FS01:0x21:Unit: 0x00000014ab436c685796c0fd7e309d92
02:33:48:WU00:FS01:0x21:CPU: 0x00000000000000000000000000000000
02:33:48:WU00:FS01:0x21:Machine: 1
02:33:48:WU00:FS01:0x21:Reading tar file core.xml
02:33:48:WU00:FS01:0x21:Reading tar file integrator.xml
02:33:48:WU00:FS01:0x21:Reading tar file state.xml
02:33:48:WU00:FS01:0x21:Reading tar file system.xml
02:33:48:WU00:FS01:0x21:Digital signatures verified
02:33:48:WU00:FS01:0x21:Folding@home GPU Core21 Folding@home Core
02:33:48:WU00:FS01:0x21:Version 0.0.17
02:33:52:WU01:FS02:0x21:Completed 875000 out of 2500000 steps (35%)
02:33:54:WU03:FS01:Upload 76.87%
02:33:58:WU03:FS01:Upload complete
02:33:58:WU03:FS01:Server responded WORK_ACK (400)
02:33:58:WU03:FS01:Final credit estimate, 115620.00 points
02:33:58:WU03:FS01:Cleaning up
02:34:21:WU00:FS01:0x21:Completed 0 out of 2500000 steps (0%)
02:34:21:WU00:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
02:34:40:WU01:FS02:0x21:Completed 900000 out of 2500000 steps (36%)
02:35:04:WU02:FS03:0x21:Completed 1225000 out of 2500000 steps (49%)
02:35:30:WU01:FS02:0x21:Completed 925000 out of 2500000 steps (37%)
02:36:18:WU01:FS02:0x21:Completed 950000 out of 2500000 steps (38%)
02:37:06:WU01:FS02:0x21:Completed 975000 out of 2500000 steps (39%)
02:37:54:WU01:FS02:0x21:Completed 1000000 out of 2500000 steps (40%)
02:38:44:WU01:FS02:0x21:Completed 1025000 out of 2500000 steps (41%)
******************************* Date: 2016-10-22 *******************************
02:39:32:WU01:FS02:0x21:Completed 1050000 out of 2500000 steps (42%)
02:40:03:WU02:FS03:0x21:Completed 1250000 out of 2500000 steps (50%)
02:40:20:WU01:FS02:0x21:Completed 1075000 out of 2500000 steps (43%)
02:41:08:WU01:FS02:0x21:Completed 1100000 out of 2500000 steps (44%)
02:41:33:WU00:FS01:0x21:Completed 25000 out of 2500000 steps (1%)
02:41:58:WU01:FS02:0x21:Completed 1125000 out of 2500000 steps (45%)
02:42:46:WU01:FS02:0x21:Completed 1150000 out of 2500000 steps (46%)
02:43:34:WU01:FS02:0x21:Completed 1175000 out of 2500000 steps (47%)
02:44:22:WU01:FS02:0x21:Completed 1200000 out of 2500000 steps (48%)
02:45:02:WU02:FS03:0x21:Completed 1275000 out of 2500000 steps (51%)
02:45:12:WU01:FS02:0x21:Completed 1225000 out of 2500000 steps (49%)
02:46:00:WU01:FS02:0x21:Completed 1250000 out of 2500000 steps (50%)
02:46:48:WU01:FS02:0x21:Completed 1275000 out of 2500000 steps (51%)
02:47:36:WU01:FS02:0x21:Completed 1300000 out of 2500000 steps (52%)
02:48:26:WU01:FS02:0x21:Completed 1325000 out of 2500000 steps (53%)
02:48:44:WU00:FS01:0x21:Completed 50000 out of 2500000 steps (2%)
02:49:15:WU01:FS02:0x21:Completed 1350000 out of 2500000 steps (54%)
02:50:00:WU02:FS03:0x21:Completed 1300000 out of 2500000 steps (52%)
02:50:03:WU01:FS02:0x21:Completed 1375000 out of 2500000 steps (55%)
02:50:51:WU01:FS02:0x21:Completed 1400000 out of 2500000 steps (56%)
02:51:41:WU01:FS02:0x21:Completed 1425000 out of 2500000 steps (57%)
02:52:29:WU01:FS02:0x21:Completed 1450000 out of 2500000 steps (58%)
02:53:17:WU01:FS02:0x21:Completed 1475000 out of 2500000 steps (59%)
02:54:05:WU01:FS02:0x21:Completed 1500000 out of 2500000 steps (60%)
02:54:55:WU01:FS02:0x21:Completed 1525000 out of 2500000 steps (61%)
02:55:04:WU02:FS03:0x21:Completed 1325000 out of 2500000 steps (53%)
02:55:43:WU01:FS02:0x21:Completed 1550000 out of 2500000 steps (62%)
02:55:55:WU00:FS01:0x21:Completed 75000 out of 2500000 steps (3%)
02:56:31:WU01:FS02:0x21:Completed 1575000 out of 2500000 steps (63%)
02:57:19:WU01:FS02:0x21:Completed 1600000 out of 2500000 steps (64%)
02:58:08:WU01:FS02:0x21:Completed 1625000 out of 2500000 steps (65%)
02:58:56:WU01:FS02:0x21:Completed 1650000 out of 2500000 steps (66%)
02:59:44:WU01:FS02:0x21:Completed 1675000 out of 2500000 steps (67%)
03:00:03:WU02:FS03:0x21:Completed 1350000 out of 2500000 steps (54%)
03:00:32:WU01:FS02:0x21:Completed 1700000 out of 2500000 steps (68%)
03:01:22:WU01:FS02:0x21:Completed 1725000 out of 2500000 steps (69%)
03:02:10:WU01:FS02:0x21:Completed 1750000 out of 2500000 steps (70%)
03:02:58:WU01:FS02:0x21:Completed 1775000 out of 2500000 steps (71%)
03:03:06:WU00:FS01:0x21:Completed 100000 out of 2500000 steps (4%)
03:03:46:WU01:FS02:0x21:Completed 1800000 out of 2500000 steps (72%)
03:04:36:WU01:FS02:0x21:Completed 1825000 out of 2500000 steps (73%)
03:05:01:WU02:FS03:0x21:Completed 1375000 out of 2500000 steps (55%)
03:05:24:WU01:FS02:0x21:Completed 1850000 out of 2500000 steps (74%)
03:06:12:WU01:FS02:0x21:Completed 1875000 out of 2500000 steps (75%)
03:07:00:WU01:FS02:0x21:Completed 1900000 out of 2500000 steps (76%)
03:07:50:WU01:FS02:0x21:Completed 1925000 out of 2500000 steps (77%)
03:08:38:WU01:FS02:0x21:Completed 1950000 out of 2500000 steps (78%)
03:09:26:WU01:FS02:0x21:Completed 1975000 out of 2500000 steps (79%)
03:10:00:WU02:FS03:0x21:Completed 1400000 out of 2500000 steps (56%)
03:10:14:WU01:FS02:0x21:Completed 2000000 out of 2500000 steps (80%)
03:10:22:WU00:FS01:0x21:Completed 125000 out of 2500000 steps (5%)
03:11:04:WU01:FS02:0x21:Completed 2025000 out of 2500000 steps (81%)
03:11:52:WU01:FS02:0x21:Completed 2050000 out of 2500000 steps (82%)
03:12:40:WU01:FS02:0x21:Completed 2075000 out of 2500000 steps (83%)
03:13:28:WU01:FS02:0x21:Completed 2100000 out of 2500000 steps (84%)
03:14:18:WU01:FS02:0x21:Completed 2125000 out of 2500000 steps (85%)
03:15:04:WU02:FS03:0x21:Completed 1425000 out of 2500000 steps (57%)
03:15:06:WU01:FS02:0x21:Completed 2150000 out of 2500000 steps (86%)
03:15:54:WU01:FS02:0x21:Completed 2175000 out of 2500000 steps (87%)
03:16:42:WU01:FS02:0x21:Completed 2200000 out of 2500000 steps (88%)
03:17:32:WU01:FS02:0x21:Completed 2225000 out of 2500000 steps (89%)
03:17:33:WU00:FS01:0x21:Completed 150000 out of 2500000 steps (6%)
03:18:20:WU01:FS02:0x21:Completed 2250000 out of 2500000 steps (90%)
03:19:08:WU01:FS02:0x21:Completed 2275000 out of 2500000 steps (91%)
03:19:56:WU01:FS02:0x21:Completed 2300000 out of 2500000 steps (92%)
03:20:02:WU02:FS03:0x21:Completed 1450000 out of 2500000 steps (58%)
03:20:46:WU01:FS02:0x21:Completed 2325000 out of 2500000 steps (93%)
03:21:34:WU01:FS02:0x21:Completed 2350000 out of 2500000 steps (94%)
03:22:22:WU01:FS02:0x21:Completed 2375000 out of 2500000 steps (95%)
03:23:10:WU01:FS02:0x21:Completed 2400000 out of 2500000 steps (96%)
03:23:59:WU01:FS02:0x21:Completed 2425000 out of 2500000 steps (97%)
03:24:43:WU00:FS01:0x21:Completed 175000 out of 2500000 steps (7%)
03:24:47:WU01:FS02:0x21:Completed 2450000 out of 2500000 steps (98%)
03:25:01:WU02:FS03:0x21:Completed 1475000 out of 2500000 steps (59%)
03:25:36:WU01:FS02:0x21:Completed 2475000 out of 2500000 steps (99%)
03:25:36:WU03:FS02:Connecting to 171.67.108.45:80
03:25:36:WU03:FS02:Assigned to work server 140.163.4.244
03:25:36:WU03:FS02:Requesting new work unit for slot 02: RUNNING gpu:2:GP104 [GeForce GTX 1080] from 140.163.4.244
03:25:36:WU03:FS02:Connecting to 140.163.4.244:8080
03:25:37:WU03:FS02:Downloading 2.77MiB
03:25:37:WU03:FS02:Download complete
03:25:38:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13500 run:0 clone:858 gen:23 core:0x21 unit:0x000000198ca304f457a358d234957cd4
03:26:24:WU01:FS02:0x21:Completed 2500000 out of 2500000 steps (100%)
03:26:26:WU01:FS02:0x21:Saving result file logfile_01.txt
03:26:26:WU01:FS02:0x21:Saving result file checkpointState.xml
03:26:27:WU01:FS02:0x21:Saving result file checkpt.crc
03:26:27:WU01:FS02:0x21:Saving result file log.txt
03:26:27:WU01:FS02:0x21:Saving result file positions.xtc
03:26:28:WU01:FS02:0x21:Folding@home Core Shutdown: FINISHED_UNIT
03:26:28:WU01:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
03:26:28:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9192 run:1 clone:49 gen:50 core:0x21 unit:0x0000003aab40415457cb2d4b06e7f3e1
03:26:28:WU01:FS02:Uploading 5.95MiB to 171.64.65.84
03:26:28:WU01:FS02:Connecting to 171.64.65.84:8080
03:26:28:WU03:FS02:Starting
03:26:28:WU03:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 03 -suffix 01 -version 704 -lifeline 1798 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
03:26:28:WU03:FS02:Started FahCore on PID 21434
03:26:28:WU03:FS02:Core PID:21438
03:26:28:WU03:FS02:FahCore 0x21 started
03:26:29:WU03:FS02:0x21:*********************** Log Started 2016-10-22T03:26:28Z ***********************
03:26:29:WU03:FS02:0x21:Project: 13500 (Run 0, Clone 858, Gen 23)
03:26:29:WU03:FS02:0x21:Unit: 0x000000198ca304f457a358d234957cd4
03:26:29:WU03:FS02:0x21:CPU: 0x00000000000000000000000000000000
03:26:29:WU03:FS02:0x21:Machine: 2
03:26:29:WU03:FS02:0x21:Reading tar file core.xml
03:26:29:WU03:FS02:0x21:Reading tar file system.xml
03:26:29:WU03:FS02:0x21:Reading tar file integrator.xml
03:26:29:WU03:FS02:0x21:Reading tar file state.xml
03:26:29:WU03:FS02:0x21:Digital signatures verified
03:26:29:WU03:FS02:0x21:Folding@home GPU Core21 Folding@home Core
03:26:29:WU03:FS02:0x21:Version 0.0.17
03:26:34:WU03:FS02:0x21:Completed 0 out of 5000000 steps (0%)
03:26:34:WU03:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
03:26:38:WU01:FS02:Upload complete
03:26:38:WU01:FS02:Server responded WORK_ACK (400)
03:26:38:WU01:FS02:Final credit estimate, 43610.00 points
03:26:38:WU01:FS02:Cleaning up
03:27:59:WU03:FS02:0x21:Completed 50000 out of 5000000 steps (1%)
03:29:24:WU03:FS02:0x21:Completed 100000 out of 5000000 steps (2%)
03:29:59:WU02:FS03:0x21:Completed 1500000 out of 2500000 steps (60%)
03:30:51:WU03:FS02:0x21:Completed 150000 out of 5000000 steps (3%)
03:31:53:WU00:FS01:0x21:Completed 200000 out of 2500000 steps (8%)
03:32:17:WU03:FS02:0x21:Completed 200000 out of 5000000 steps (4%)
03:33:42:WU03:FS02:0x21:Completed 250000 out of 5000000 steps (5%)
03:35:03:WU02:FS03:0x21:Completed 1525000 out of 2500000 steps (61%)
03:35:09:WU03:FS02:0x21:Completed 300000 out of 5000000 steps (6%)
03:36:34:WU03:FS02:0x21:Completed 350000 out of 5000000 steps (7%)
03:38:01:WU03:FS02:0x21:Completed 400000 out of 5000000 steps (8%)
03:39:09:WU00:FS01:0x21:Completed 225000 out of 2500000 steps (9%)
03:39:26:WU03:FS02:0x21:Completed 450000 out of 5000000 steps (9%)
03:40:03:WU02:FS03:0x21:Completed 1550000 out of 2500000 steps (62%)
03:40:52:WU03:FS02:0x21:Completed 500000 out of 5000000 steps (10%)
03:42:19:WU03:FS02:0x21:Completed 550000 out of 5000000 steps (11%)
03:43:44:WU03:FS02:0x21:Completed 600000 out of 5000000 steps (12%)
03:45:02:WU02:FS03:0x21:Completed 1575000 out of 2500000 steps (63%)
03:45:11:WU03:FS02:0x21:Completed 650000 out of 5000000 steps (13%)
03:46:19:WU00:FS01:0x21:Completed 250000 out of 2500000 steps (10%)
03:46:37:WU03:FS02:0x21:Completed 700000 out of 5000000 steps (14%)
03:48:02:WU03:FS02:0x21:Completed 750000 out of 5000000 steps (15%)
03:49:29:WU03:FS02:0x21:Completed 800000 out of 5000000 steps (16%)
03:50:01:WU02:FS03:0x21:Completed 1600000 out of 2500000 steps (64%)
03:50:54:WU03:FS02:0x21:Completed 850000 out of 5000000 steps (17%)
03:52:21:WU03:FS02:0x21:Completed 900000 out of 5000000 steps (18%)
03:53:28:WU00:FS01:0x21:Completed 275000 out of 2500000 steps (11%)
03:53:47:WU03:FS02:0x21:Completed 950000 out of 5000000 steps (19%)
03:55:05:WU02:FS03:0x21:Completed 1625000 out of 2500000 steps (65%)
03:55:12:WU03:FS02:0x21:Completed 1000000 out of 5000000 steps (20%)
03:56:39:WU03:FS02:0x21:Completed 1050000 out of 5000000 steps (21%)
03:58:04:WU03:FS02:0x21:Completed 1100000 out of 5000000 steps (22%)
03:59:31:WU03:FS02:0x21:Completed 1150000 out of 5000000 steps (23%)
04:00:04:WU02:FS03:0x21:Completed 1650000 out of 2500000 steps (66%)
04:00:39:WU00:FS01:0x21:Completed 300000 out of 2500000 steps (12%)
04:00:57:WU03:FS02:0x21:Completed 1200000 out of 5000000 steps (24%)
04:02:22:WU03:FS02:0x21:Completed 1250000 out of 5000000 steps (25%)
04:03:49:WU03:FS02:0x21:Completed 1300000 out of 5000000 steps (26%)
04:05:03:WU02:FS03:0x21:Completed 1675000 out of 2500000 steps (67%)
04:05:15:WU03:FS02:0x21:Completed 1350000 out of 5000000 steps (27%)
04:06:42:WU03:FS02:0x21:Completed 1400000 out of 5000000 steps (28%)
04:07:55:WU00:FS01:0x21:Completed 325000 out of 2500000 steps (13%)
04:08:07:WU03:FS02:0x21:Completed 1450000 out of 5000000 steps (29%)
04:09:32:WU03:FS02:0x21:Completed 1500000 out of 5000000 steps (30%)
04:10:03:WU02:FS03:0x21:Completed 1700000 out of 2500000 steps (68%)
04:10:59:WU03:FS02:0x21:Completed 1550000 out of 5000000 steps (31%)
04:12:25:WU03:FS02:0x21:Completed 1600000 out of 5000000 steps (32%)
04:13:52:WU03:FS02:0x21:Completed 1650000 out of 5000000 steps (33%)
04:15:05:WU00:FS01:0x21:Completed 350000 out of 2500000 steps (14%)
04:15:07:WU02:FS03:0x21:Completed 1725000 out of 2500000 steps (69%)
04:15:17:WU03:FS02:0x21:Completed 1700000 out of 5000000 steps (34%)
04:16:42:WU03:FS02:0x21:Completed 1750000 out of 5000000 steps (35%)
04:18:09:WU03:FS02:0x21:Completed 1800000 out of 5000000 steps (36%)
04:19:35:WU03:FS02:0x21:Completed 1850000 out of 5000000 steps (37%)
04:20:06:WU02:FS03:0x21:Completed 1750000 out of 2500000 steps (70%)
04:21:02:WU03:FS02:0x21:Completed 1900000 out of 5000000 steps (38%)
04:22:15:WU00:FS01:0x21:Completed 375000 out of 2500000 steps (15%)
04:22:27:WU03:FS02:0x21:Completed 1950000 out of 5000000 steps (39%)
04:23:53:WU03:FS02:0x21:Completed 2000000 out of 5000000 steps (40%)
04:25:06:WU02:FS03:0x21:Completed 1775000 out of 2500000 steps (71%)
04:25:19:WU03:FS02:0x21:Completed 2050000 out of 5000000 steps (41%)
04:26:45:WU03:FS02:0x21:Completed 2100000 out of 5000000 steps (42%)
04:28:12:WU03:FS02:0x21:Completed 2150000 out of 5000000 steps (43%)
04:29:26:WU00:FS01:0x21:Completed 400000 out of 2500000 steps (16%)
04:29:37:WU03:FS02:0x21:Completed 2200000 out of 5000000 steps (44%)
04:30:05:WU02:FS03:0x21:Completed 1800000 out of 2500000 steps (72%)
04:31:03:WU03:FS02:0x21:Completed 2250000 out of 5000000 steps (45%)
04:32:30:WU03:FS02:0x21:Completed 2300000 out of 5000000 steps (46%)
04:33:55:WU03:FS02:0x21:Completed 2350000 out of 5000000 steps (47%)
04:35:09:WU02:FS03:0x21:Completed 1825000 out of 2500000 steps (73%)
04:35:22:WU03:FS02:0x21:Completed 2400000 out of 5000000 steps (48%)
04:36:41:WU00:FS01:0x21:Completed 425000 out of 2500000 steps (17%)
04:36:47:WU03:FS02:0x21:Completed 2450000 out of 5000000 steps (49%)
04:38:13:WU03:FS02:0x21:Completed 2500000 out of 5000000 steps (50%)
04:39:39:WU03:FS02:0x21:Completed 2550000 out of 5000000 steps (51%)
04:40:08:WU02:FS03:0x21:Completed 1850000 out of 2500000 steps (74%)
04:41:05:WU03:FS02:0x21:Completed 2600000 out of 5000000 steps (52%)
04:42:32:WU03:FS02:0x21:Completed 2650000 out of 5000000 steps (53%)
04:43:51:WU00:FS01:0x21:Completed 450000 out of 2500000 steps (18%)
04:43:57:WU03:FS02:0x21:Completed 2700000 out of 5000000 steps (54%)
04:45:08:WU02:FS03:0x21:Completed 1875000 out of 2500000 steps (75%)
04:45:23:WU03:FS02:0x21:Completed 2750000 out of 5000000 steps (55%)
04:46:50:WU03:FS02:0x21:Completed 2800000 out of 5000000 steps (56%)
04:48:15:WU03:FS02:0x21:Completed 2850000 out of 5000000 steps (57%)
04:49:42:WU03:FS02:0x21:Completed 2900000 out of 5000000 steps (58%)
04:50:07:WU02:FS03:0x21:Completed 1900000 out of 2500000 steps (76%)
04:51:02:WU00:FS01:0x21:Completed 475000 out of 2500000 steps (19%)
04:51:07:WU03:FS02:0x21:Completed 2950000 out of 5000000 steps (59%)
04:52:32:WU03:FS02:0x21:Completed 3000000 out of 5000000 steps (60%)
04:53:59:WU03:FS02:0x21:Completed 3050000 out of 5000000 steps (61%)
04:55:11:WU02:FS03:0x21:Completed 1925000 out of 2500000 steps (77%)
04:55:25:WU03:FS02:0x21:Completed 3100000 out of 5000000 steps (62%)
04:56:52:WU03:FS02:0x21:Completed 3150000 out of 5000000 steps (63%)
04:58:12:WU00:FS01:0x21:Completed 500000 out of 2500000 steps (20%)
04:58:17:WU03:FS02:0x21:Completed 3200000 out of 5000000 steps (64%)
04:59:42:WU03:FS02:0x21:Completed 3250000 out of 5000000 steps (65%)
05:00:09:WU02:FS03:0x21:Completed 1950000 out of 2500000 steps (78%)
05:01:09:WU03:FS02:0x21:Completed 3300000 out of 5000000 steps (66%)
05:02:34:WU03:FS02:0x21:Completed 3350000 out of 5000000 steps (67%)
05:04:01:WU03:FS02:0x21:Completed 3400000 out of 5000000 steps (68%)
05:05:08:WU02:FS03:0x21:Completed 1975000 out of 2500000 steps (79%)
05:05:27:WU03:FS02:0x21:Completed 3450000 out of 5000000 steps (69%)
05:05:27:WU00:FS01:0x21:Completed 525000 out of 2500000 steps (21%)
05:06:52:WU03:FS02:0x21:Completed 3500000 out of 5000000 steps (70%)
05:08:19:WU03:FS02:0x21:Completed 3550000 out of 5000000 steps (71%)
05:09:45:WU03:FS02:0x21:Completed 3600000 out of 5000000 steps (72%)
05:10:07:WU02:FS03:0x21:Completed 2000000 out of 2500000 steps (80%)
05:11:11:WU03:FS02:0x21:Completed 3650000 out of 5000000 steps (73%)
05:12:37:WU03:FS02:0x21:Completed 3700000 out of 5000000 steps (74%)
05:12:37:WU00:FS01:0x21:Completed 550000 out of 2500000 steps (22%)
05:14:02:WU03:FS02:0x21:Completed 3750000 out of 5000000 steps (75%)
05:15:11:WU02:FS03:0x21:Completed 2025000 out of 2500000 steps (81%)
05:15:29:WU03:FS02:0x21:Completed 3800000 out of 5000000 steps (76%)
05:16:54:WU03:FS02:0x21:Completed 3850000 out of 5000000 steps (77%)
05:18:21:WU03:FS02:0x21:Completed 3900000 out of 5000000 steps (78%)
05:19:47:WU03:FS02:0x21:Completed 3950000 out of 5000000 steps (79%)
05:19:48:WU00:FS01:0x21:Completed 575000 out of 2500000 steps (23%)
05:20:11:WU02:FS03:0x21:Completed 2050000 out of 2500000 steps (82%)
05:21:12:WU03:FS02:0x21:Completed 4000000 out of 5000000 steps (80%)
05:22:39:WU03:FS02:0x21:Completed 4050000 out of 5000000 steps (81%)
05:24:05:WU03:FS02:0x21:Completed 4100000 out of 5000000 steps (82%)
05:25:10:WU02:FS03:0x21:Completed 2075000 out of 2500000 steps (83%)
05:25:31:WU03:FS02:0x21:Completed 4150000 out of 5000000 steps (83%)
05:26:57:WU03:FS02:0x21:Completed 4200000 out of 5000000 steps (84%)
05:26:58:WU00:FS01:0x21:Completed 600000 out of 2500000 steps (24%)
05:28:22:WU03:FS02:0x21:Completed 4250000 out of 5000000 steps (85%)
05:29:49:WU03:FS02:0x21:Completed 4300000 out of 5000000 steps (86%)
05:30:09:WU02:FS03:0x21:Completed 2100000 out of 2500000 steps (84%)
05:31:14:WU03:FS02:0x21:Completed 4350000 out of 5000000 steps (87%)
05:32:41:WU03:FS02:0x21:Completed 4400000 out of 5000000 steps (88%)
05:34:07:WU03:FS02:0x21:Completed 4450000 out of 5000000 steps (89%)
05:34:13:WU00:FS01:0x21:Completed 625000 out of 2500000 steps (25%)
05:35:13:WU02:FS03:0x21:Completed 2125000 out of 2500000 steps (85%)
05:35:32:WU03:FS02:0x21:Completed 4500000 out of 5000000 steps (90%)
05:36:59:WU03:FS02:0x21:Completed 4550000 out of 5000000 steps (91%)
05:38:24:WU03:FS02:0x21:Completed 4600000 out of 5000000 steps (92%)
05:39:51:WU03:FS02:0x21:Completed 4650000 out of 5000000 steps (93%)
05:40:12:WU02:FS03:0x21:Completed 2150000 out of 2500000 steps (86%)
05:41:16:WU03:FS02:0x21:Completed 4700000 out of 5000000 steps (94%)
05:41:23:WU00:FS01:0x21:Completed 650000 out of 2500000 steps (26%)
05:42:42:WU03:FS02:0x21:Completed 4750000 out of 5000000 steps (95%)
05:44:08:WU03:FS02:0x21:Completed 4800000 out of 5000000 steps (96%)
05:45:11:WU02:FS03:0x21:Completed 2175000 out of 2500000 steps (87%)
05:45:34:WU03:FS02:0x21:Completed 4850000 out of 5000000 steps (97%)
05:47:01:WU03:FS02:0x21:Completed 4900000 out of 5000000 steps (98%)
05:48:27:WU03:FS02:0x21:Completed 4950000 out of 5000000 steps (99%)
05:48:27:WU01:FS02:Connecting to 171.67.108.45:80
05:48:27:WU01:FS02:Assigned to work server 171.67.108.105
05:48:27:WU01:FS02:Requesting new work unit for slot 02: RUNNING gpu:2:GP104 [GeForce GTX 1080] from 171.67.108.105
05:48:27:WU01:FS02:Connecting to 171.67.108.105:8080
05:48:28:WU01:FS02:Downloading 20.63MiB
05:48:30:WU01:FS02:Download complete
05:48:30:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9175 run:19 clone:0 gen:18 core:0x21 unit:0x0000001bab436c6957b24c28ba8bde5e
05:48:34:WU00:FS01:0x21:Completed 675000 out of 2500000 steps (27%)
05:49:52:WU03:FS02:0x21:Completed 5000000 out of 5000000 steps (100%)
05:49:54:WU03:FS02:0x21:Saving result file logfile_01.txt
05:49:54:WU03:FS02:0x21:Saving result file checkpointState.xml
05:49:55:WU03:FS02:0x21:Saving result file checkpt.crc
05:49:55:WU03:FS02:0x21:Saving result file log.txt
05:49:55:WU03:FS02:0x21:Saving result file positions.xtc
05:49:56:WU03:FS02:0x21:Folding@home Core Shutdown: FINISHED_UNIT
05:49:56:WU03:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:49:56:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:13500 run:0 clone:858 gen:23 core:0x21 unit:0x000000198ca304f457a358d234957cd4
05:49:56:WU03:FS02:Uploading 7.32MiB to 140.163.4.244
05:49:56:WU03:FS02:Connecting to 140.163.4.244:8080
05:49:56:WU01:FS02:Starting
05:49:56:WU01:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1798 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
05:49:56:WU01:FS02:Started FahCore on PID 21917
05:49:56:WU01:FS02:Core PID:21921
05:49:56:WU01:FS02:FahCore 0x21 started
05:49:57:WU01:FS02:0x21:*********************** Log Started 2016-10-22T05:49:56Z ***********************
05:49:57:WU01:FS02:0x21:Project: 9175 (Run 19, Clone 0, Gen 18)
05:49:57:WU01:FS02:0x21:Unit: 0x0000001bab436c6957b24c28ba8bde5e
05:49:57:WU01:FS02:0x21:CPU: 0x00000000000000000000000000000000
05:49:57:WU01:FS02:0x21:Machine: 2
05:49:57:WU01:FS02:0x21:Reading tar file core.xml
05:49:57:WU01:FS02:0x21:Reading tar file integrator.xml
05:49:57:WU01:FS02:0x21:Reading tar file state.xml
05:49:57:WU01:FS02:0x21:Reading tar file system.xml
05:49:57:WU01:FS02:0x21:Digital signatures verified
05:49:57:WU01:FS02:0x21:Folding@home GPU Core21 Folding@home Core
05:49:57:WU01:FS02:0x21:Version 0.0.17
05:50:02:WU03:FS02:Upload 98.18%
05:50:05:WU01:FS02:0x21:Completed 0 out of 2500000 steps (0%)
05:50:05:WU01:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
05:50:06:WU03:FS02:Upload complete
05:50:06:WU03:FS02:Server responded WORK_ACK (400)
05:50:06:WU03:FS02:Final credit estimate, 81351.00 points
05:50:06:WU03:FS02:Cleaning up
05:50:10:WU02:FS03:0x21:Completed 2200000 out of 2500000 steps (88%)
05:50:50:WU01:FS02:0x21:Completed 25000 out of 2500000 steps (1%)
05:51:35:WU01:FS02:0x21:Completed 50000 out of 2500000 steps (2%)
05:52:20:WU01:FS02:0x21:Completed 75000 out of 2500000 steps (3%)
05:53:05:WU01:FS02:0x21:Completed 100000 out of 2500000 steps (4%)
05:53:52:WU01:FS02:0x21:Completed 125000 out of 2500000 steps (5%)
05:54:37:WU01:FS02:0x21:Completed 150000 out of 2500000 steps (6%)
05:55:15:WU02:FS03:0x21:Completed 2225000 out of 2500000 steps (89%)
05:55:23:WU01:FS02:0x21:Completed 175000 out of 2500000 steps (7%)
05:55:43:WU00:FS01:0x21:Completed 700000 out of 2500000 steps (28%)
05:56:08:WU01:FS02:0x21:Completed 200000 out of 2500000 steps (8%)
05:56:55:WU01:FS02:0x21:Completed 225000 out of 2500000 steps (9%)
05:57:40:WU01:FS02:0x21:Completed 250000 out of 2500000 steps (10%)
05:58:25:WU01:FS02:0x21:Completed 275000 out of 2500000 steps (11%)
05:59:10:WU01:FS02:0x21:Completed 300000 out of 2500000 steps (12%)
05:59:57:WU01:FS02:0x21:Completed 325000 out of 2500000 steps (13%)
06:00:14:WU02:FS03:0x21:Completed 2250000 out of 2500000 steps (90%)
06:00:42:WU01:FS02:0x21:Completed 350000 out of 2500000 steps (14%)
06:01:27:WU01:FS02:0x21:Completed 375000 out of 2500000 steps (15%)
06:02:12:WU01:FS02:0x21:Completed 400000 out of 2500000 steps (16%)
06:02:58:WU00:FS01:0x21:Completed 725000 out of 2500000 steps (29%)
06:02:59:WU01:FS02:0x21:Completed 425000 out of 2500000 steps (17%)
06:03:44:WU01:FS02:0x21:Completed 450000 out of 2500000 steps (18%)
06:04:30:WU01:FS02:0x21:Completed 475000 out of 2500000 steps (19%)
06:05:13:WU02:FS03:0x21:Completed 2275000 out of 2500000 steps (91%)
06:05:15:WU01:FS02:0x21:Completed 500000 out of 2500000 steps (20%)
06:06:02:WU01:FS02:0x21:Completed 525000 out of 2500000 steps (21%)
06:06:47:WU01:FS02:0x21:Completed 550000 out of 2500000 steps (22%)
06:07:32:WU01:FS02:0x21:Completed 575000 out of 2500000 steps (23%)
06:08:17:WU01:FS02:0x21:Completed 600000 out of 2500000 steps (24%)
06:09:04:WU01:FS02:0x21:Completed 625000 out of 2500000 steps (25%)
06:09:49:WU01:FS02:0x21:Completed 650000 out of 2500000 steps (26%)
06:10:08:WU00:FS01:0x21:Completed 750000 out of 2500000 steps (30%)
06:10:12:WU02:FS03:0x21:Completed 2300000 out of 2500000 steps (92%)
06:10:34:WU01:FS02:0x21:Completed 675000 out of 2500000 steps (27%)
06:11:20:WU01:FS02:0x21:Completed 700000 out of 2500000 steps (28%)
06:12:06:WU01:FS02:0x21:Completed 725000 out of 2500000 steps (29%)
06:12:51:WU01:FS02:0x21:Completed 750000 out of 2500000 steps (30%)
06:13:36:WU01:FS02:0x21:Completed 775000 out of 2500000 steps (31%)
06:14:22:WU01:FS02:0x21:Completed 800000 out of 2500000 steps (32%)
06:15:08:WU01:FS02:0x21:Completed 825000 out of 2500000 steps (33%)
06:15:16:WU02:FS03:0x21:Completed 2325000 out of 2500000 steps (93%)
06:15:53:WU01:FS02:0x21:Completed 850000 out of 2500000 steps (34%)
06:16:38:WU01:FS02:0x21:Completed 875000 out of 2500000 steps (35%)
06:17:18:WU00:FS01:0x21:Completed 775000 out of 2500000 steps (31%)
06:17:24:WU01:FS02:0x21:Completed 900000 out of 2500000 steps (36%)
06:18:10:WU01:FS02:0x21:Completed 925000 out of 2500000 steps (37%)
06:18:55:WU01:FS02:0x21:Completed 950000 out of 2500000 steps (38%)
06:19:40:WU01:FS02:0x21:Completed 975000 out of 2500000 steps (39%)
06:20:14:WU02:FS03:0x21:Completed 2350000 out of 2500000 steps (94%)
06:20:26:WU01:FS02:0x21:Completed 1000000 out of 2500000 steps (40%)
06:21:12:WU01:FS02:0x21:Completed 1025000 out of 2500000 steps (41%)
06:21:57:WU01:FS02:0x21:Completed 1050000 out of 2500000 steps (42%)
06:22:42:WU01:FS02:0x21:Completed 1075000 out of 2500000 steps (43%)
06:23:28:WU01:FS02:0x21:Completed 1100000 out of 2500000 steps (44%)
06:24:14:WU01:FS02:0x21:Completed 1125000 out of 2500000 steps (45%)
06:24:28:WU00:FS01:0x21:Completed 800000 out of 2500000 steps (32%)
06:24:59:WU01:FS02:0x21:Completed 1150000 out of 2500000 steps (46%)
06:25:13:WU02:FS03:0x21:Completed 2375000 out of 2500000 steps (95%)
06:25:44:WU01:FS02:0x21:Completed 1175000 out of 2500000 steps (47%)
06:26:30:WU01:FS02:0x21:Completed 1200000 out of 2500000 steps (48%)
06:27:16:WU01:FS02:0x21:Completed 1225000 out of 2500000 steps (49%)
06:28:01:WU01:FS02:0x21:Completed 1250000 out of 2500000 steps (50%)
06:28:46:WU01:FS02:0x21:Completed 1275000 out of 2500000 steps (51%)
06:29:32:WU01:FS02:0x21:Completed 1300000 out of 2500000 steps (52%)
06:30:12:WU02:FS03:0x21:Completed 2400000 out of 2500000 steps (96%)
06:30:18:WU01:FS02:0x21:Completed 1325000 out of 2500000 steps (53%)
06:31:03:WU01:FS02:0x21:Completed 1350000 out of 2500000 steps (54%)
06:31:43:WU00:FS01:0x21:Completed 825000 out of 2500000 steps (33%)
06:31:48:WU01:FS02:0x21:Completed 1375000 out of 2500000 steps (55%)
06:32:34:WU01:FS02:0x21:Completed 1400000 out of 2500000 steps (56%)
06:33:20:WU01:FS02:0x21:Completed 1425000 out of 2500000 steps (57%)
06:34:05:WU01:FS02:0x21:Completed 1450000 out of 2500000 steps (58%)
06:34:50:WU01:FS02:0x21:Completed 1475000 out of 2500000 steps (59%)
06:35:16:WU02:FS03:0x21:Completed 2425000 out of 2500000 steps (97%)
06:35:36:WU01:FS02:0x21:Completed 1500000 out of 2500000 steps (60%)
06:36:22:WU01:FS02:0x21:Completed 1525000 out of 2500000 steps (61%)
06:37:07:WU01:FS02:0x21:Completed 1550000 out of 2500000 steps (62%)
06:37:52:WU01:FS02:0x21:Completed 1575000 out of 2500000 steps (63%)
06:38:37:WU01:FS02:0x21:Completed 1600000 out of 2500000 steps (64%)
06:38:54:WU00:FS01:0x21:Completed 850000 out of 2500000 steps (34%)
06:39:24:WU01:FS02:0x21:Completed 1625000 out of 2500000 steps (65%)
06:40:09:WU01:FS02:0x21:Completed 1650000 out of 2500000 steps (66%)
06:40:15:WU02:FS03:0x21:Completed 2450000 out of 2500000 steps (98%)
06:40:54:WU01:FS02:0x21:Completed 1675000 out of 2500000 steps (67%)
06:41:39:WU01:FS02:0x21:Completed 1700000 out of 2500000 steps (68%)
06:42:26:WU01:FS02:0x21:Completed 1725000 out of 2500000 steps (69%)
06:43:11:WU01:FS02:0x21:Completed 1750000 out of 2500000 steps (70%)
06:43:56:WU01:FS02:0x21:Completed 1775000 out of 2500000 steps (71%)
06:44:41:WU01:FS02:0x21:Completed 1800000 out of 2500000 steps (72%)
06:45:13:WU02:FS03:0x21:Completed 2475000 out of 2500000 steps (99%)
06:45:14:WU03:FS03:Connecting to 171.67.108.45:80
06:45:14:WU03:FS03:Assigned to work server 140.163.4.242
06:45:14:WU03:FS03:Requesting new work unit for slot 03: RUNNING gpu:4:GP104 [GeForce GTX 1080] from 140.163.4.242
06:45:14:WU03:FS03:Connecting to 140.163.4.242:8080
06:45:14:WU03:FS03:Downloading 4.37MiB
06:45:16:WU03:FS03:Download complete
06:45:16:WU03:FS03:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:11401 run:94 clone:28 gen:0 core:0x21 unit:0x000000008ca304f257c5cdefb542f569
06:45:28:WU01:FS02:0x21:Completed 1825000 out of 2500000 steps (73%)
06:46:05:WU00:FS01:0x21:Completed 875000 out of 2500000 steps (35%)
06:46:13:WU01:FS02:0x21:Completed 1850000 out of 2500000 steps (74%)
06:46:58:WU01:FS02:0x21:Completed 1875000 out of 2500000 steps (75%)
06:47:44:WU01:FS02:0x21:Completed 1900000 out of 2500000 steps (76%)
06:48:30:WU01:FS02:0x21:Completed 1925000 out of 2500000 steps (77%)
06:49:15:WU01:FS02:0x21:Completed 1950000 out of 2500000 steps (78%)
06:50:00:WU01:FS02:0x21:Completed 1975000 out of 2500000 steps (79%)
06:50:12:WU02:FS03:0x21:Completed 2500000 out of 2500000 steps (100%)
06:50:18:WU02:FS03:0x21:Saving result file logfile_01.txt
06:50:18:WU02:FS03:0x21:Saving result file checkpointState.xml
06:50:18:WU02:FS03:0x21:Saving result file checkpt.crc
06:50:18:WU02:FS03:0x21:Saving result file log.txt
06:50:18:WU02:FS03:0x21:Saving result file positions.xtc
06:50:18:WU02:FS03:0x21:Folding@home Core Shutdown: FINISHED_UNIT
06:50:18:WU02:FS03:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:50:18:WU02:FS03:Sending unit results: id:02 state:SEND error:NO_ERROR project:9208 run:25 clone:9 gen:12 core:0x21 unit:0x00000028ab436c685796c0cd78c5fc69
06:50:18:WU02:FS03:Uploading 37.94MiB to 171.67.108.104
06:50:18:WU02:FS03:Connecting to 171.67.108.104:8080
06:50:19:WU03:FS03:Starting
06:50:19:WU03:FS03:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21 -dir 03 -suffix 01 -version 704 -lifeline 1798 -checkpoint 15 -gpu 2 -gpu-vendor nvidia
06:50:19:WU03:FS03:Started FahCore on PID 22149
06:50:19:WU03:FS03:Core PID:22153
06:50:19:WU03:FS03:FahCore 0x21 started
06:50:19:WU03:FS03:0x21:*********************** Log Started 2016-10-22T06:50:19Z ***********************
06:50:19:WU03:FS03:0x21:Project: 11401 (Run 94, Clone 28, Gen 0)
06:50:19:WU03:FS03:0x21:Unit: 0x000000008ca304f257c5cdefb542f569
06:50:19:WU03:FS03:0x21:CPU: 0x00000000000000000000000000000000
06:50:19:WU03:FS03:0x21:Machine: 3
06:50:19:WU03:FS03:0x21:Reading tar file core.xml
06:50:19:WU03:FS03:0x21:Reading tar file system.xml
06:50:19:WU03:FS03:0x21:Reading tar file integrator.xml
06:50:19:WU03:FS03:0x21:Reading tar file state.xml
06:50:20:WU03:FS03:0x21:Digital signatures verified
06:50:20:WU03:FS03:0x21:Folding@home GPU Core21 Folding@home Core
06:50:20:WU03:FS03:0x21:Version 0.0.17
06:50:24:WU02:FS03:Upload 20.76%
06:50:26:WU03:FS03:0x21:Completed 0 out of 5000000 steps (0%)
06:50:26:WU03:FS03:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
06:50:30:WU02:FS03:Upload 42.83%
06:50:36:WU02:FS03:Upload 65.89%
06:50:42:WU02:FS03:Upload 87.97%
06:50:46:WU01:FS02:0x21:Completed 2000000 out of 2500000 steps (80%)
06:50:46:WU02:FS03:Upload complete
06:50:46:WU02:FS03:Server responded WORK_ACK (400)
06:50:46:WU02:FS03:Final credit estimate, 161417.00 points
06:50:46:WU02:FS03:Cleaning up
06:51:32:WU01:FS02:0x21:Completed 2025000 out of 2500000 steps (81%)
Re: Cancel GPU WU
Posted: Sun Oct 23, 2016 2:56 pm
by SteveWillis
ChristianVirtual wrote:@SteveWillis,
can you please post part of the log files where the completion is mentioned; there where cases recently with another project where the total steps to complete a WU got wrong.
Ideally you can find in your log a WU from the impacted project which run well (and post few completion log lines) and find a WU with longer completions time (please post in all case the full Project-Run-Clone-Gen information)
I just re-read your post. I never noticed the total steps being wrong. The TPF was way too high.
Re: Cancel GPU WU
Posted: Sun Oct 23, 2016 3:22 pm
by foldy
bruce wrote:Early RX 480 cards were famous for exceeding the PCI Express power limit. AMD "fixed" that problem in the drivers by limiting the power under load which slowed things down.
That is not correct. They fixed it by moving the power load from pcie slot to 6pin power plug. That does not hurt performance.