GTX 970 failing with FahCore 0x21 work units
Posted: Fri Jul 29, 2016 3:50 pm
A Teammate is asking for help with regards to his GTX970 failing and 'hanging' while trying to process 0x21 wu's. The client had been working flawlessly since the installation of the GTX970, however over the last few days he's been experiencing the problem indicated in his log below. It appears that 0x18 units are working fine, but the 0x21 units seem to repeatedly fail and ultimately the GPU portion of the client just stops responding and no further communication between the client and WS occurs.
Any suggestions or comments would be appreciated.
Any suggestions or comments would be appreciated.
Code: Select all
09:57:28:WU01:FS01:Started FahCore on PID 2252
09:57:28:Started thread 27 on PID 5696
09:57:28:WU01:FS01:Core PID:9560
09:57:28:WU01:FS01:FahCore 0x21 started
09:57:28:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
09:58:28:WU01:FS01:Starting
09:58:28:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
09:58:28:WU01:FS01:Started FahCore on PID 9352
09:58:28:Started thread 28 on PID 5696
09:58:28:WU01:FS01:Core PID:2856
09:58:28:WU01:FS01:FahCore 0x21 started
09:58:28:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
09:58:28:WARNING:WU01:FS01:Too many errors, failing
09:58:29:WU01:FS01:Sending unit results: id:01 state:SEND error:FAILED project:11418 run:4 clone:16 gen:46 core:0x21 unit:0x0000003d8ca304f1570697d4a506f16b
09:58:29:WU01:FS01:Connecting to 140.163.4.241:8080
09:58:29:WU01:FS01:Server responded WORK_ACK (400)
09:58:29:WU00:FS01:Connecting to 171.67.108.45:80
09:58:29:WU01:FS01:Cleaning up
09:58:30:WU00:FS01:Assigned to work server 140.163.4.241
09:58:30:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 970] from 140.163.4.241
09:58:30:WU00:FS01:Connecting to 140.163.4.241:8080
09:58:31:WU00:FS01:Downloading 3.66MiB
09:58:35:WU00:FS01:Download complete
09:58:35:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:11429 run:3 clone:13 gen:22 core:0x21 unit:0x0000001b8ca304f1575841ec11fb191a
09:58:35:WU00:FS01:Starting
09:58:35:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
09:58:35:WU00:FS01:Started FahCore on PID 9636
09:58:35:Started thread 29 on PID 5696
09:58:35:WU00:FS01:Core PID:3816
09:58:35:WU00:FS01:FahCore 0x21 started
09:58:36:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
09:58:36:WU00:FS01:Starting
09:58:36:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
09:58:36:WU00:FS01:Started FahCore on PID 5264
09:58:36:Started thread 30 on PID 5696
09:58:36:WU00:FS01:Core PID:400
09:58:36:WU00:FS01:FahCore 0x21 started
09:58:36:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
09:58:45:WU02:FS00:0xa4:Completed 5600 out of 80000 steps (7%)
09:59:36:WU00:FS01:Starting
09:59:36:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
09:59:36:WU00:FS01:Started FahCore on PID 5704
09:59:36:Started thread 31 on PID 5696
09:59:36:WU00:FS01:Core PID:4040
09:59:36:WU00:FS01:FahCore 0x21 started
09:59:36:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:00:13:WU02:FS00:0xa4:Completed 6400 out of 80000 steps (8%)
10:00:36:WU00:FS01:Starting
10:00:36:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:00:36:WU00:FS01:Started FahCore on PID 5452
10:00:36:Started thread 32 on PID 5696
10:00:36:WU00:FS01:Core PID:3416
10:00:36:WU00:FS01:FahCore 0x21 started
10:00:37:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:01:36:WU00:FS01:Starting
10:01:36:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:01:36:WU00:FS01:Started FahCore on PID 4432
10:01:36:Started thread 33 on PID 5696
10:01:37:WU00:FS01:Core PID:9616
10:01:37:WU00:FS01:FahCore 0x21 started
10:01:37:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:01:37:WARNING:WU00:FS01:Too many errors, failing
10:01:37:WU00:FS01:Sending unit results: id:00 state:SEND error:FAILED project:11429 run:3 clone:13 gen:22 core:0x21 unit:0x0000001b8ca304f1575841ec11fb191a
10:01:37:WU00:FS01:Connecting to 140.163.4.241:8080
10:01:37:WU01:FS01:Connecting to 171.67.108.45:80
10:01:37:WU00:FS01:Server responded WORK_ACK (400)
10:01:38:WU00:FS01:Cleaning up
10:01:38:WU01:FS01:Assigned to work server 140.163.4.245
10:01:38:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 970] from 140.163.4.245
10:01:38:WU01:FS01:Connecting to 140.163.4.245:8080
10:01:39:WU01:FS01:Downloading 20.68MiB
10:01:42:WU02:FS00:0xa4:Completed 7200 out of 80000 steps (9%)
10:01:45:WU01:FS01:Download 21.46%
10:01:51:WU01:FS01:Download 45.94%
10:01:57:WU01:FS01:Download 69.22%
10:02:03:WU01:FS01:Download 82.82%
10:02:08:WU01:FS01:Download complete
10:02:08:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:10494 run:7 clone:31 gen:103 core:0x21 unit:0x000000978ca304f555de93d88a4845db
10:02:08:WU01:FS01:Starting
10:02:08:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:02:08:WU01:FS01:Started FahCore on PID 480
10:02:08:Started thread 34 on PID 5696
10:02:08:WU01:FS01:Core PID:4440
10:02:08:WU01:FS01:FahCore 0x21 started
10:02:09:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:02:09:WU01:FS01:Starting
10:02:09:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:02:09:WU01:FS01:Started FahCore on PID 7764
10:02:09:Started thread 35 on PID 5696
10:02:09:WU01:FS01:Core PID:7300
10:02:09:WU01:FS01:FahCore 0x21 started
10:02:10:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:03:09:WU01:FS01:Starting
10:03:09:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:03:09:WU01:FS01:Started FahCore on PID 9036
10:03:09:Started thread 36 on PID 5696
10:03:09:WU01:FS01:Core PID:408
10:03:09:WU01:FS01:FahCore 0x21 started
10:03:10:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:03:14:WU02:FS00:0xa4:Completed 8000 out of 80000 steps (10%)
10:04:09:WU01:FS01:Starting
10:04:09:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:04:09:WU01:FS01:Started FahCore on PID 9444
10:04:09:Started thread 37 on PID 5696
10:04:09:WU01:FS01:Core PID:372
10:04:09:WU01:FS01:FahCore 0x21 started
10:04:10:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:04:43:WU02:FS00:0xa4:Completed 8800 out of 80000 steps (11%)
10:05:10:WU01:FS01:Starting
10:05:10:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:05:10:WU01:FS01:Started FahCore on PID 5332
10:05:10:Started thread 38 on PID 5696
10:05:10:WU01:FS01:Core PID:8640
10:05:10:WU01:FS01:FahCore 0x21 started
10:05:10:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:05:10:WARNING:WU01:FS01:Too many errors, failing
10:05:10:WU01:FS01:Sending unit results: id:01 state:SEND error:FAILED project:10494 run:7 clone:31 gen:103 core:0x21 unit:0x000000978ca304f555de93d88a4845db
10:05:11:WU01:FS01:Connecting to 140.163.4.245:8080
10:05:11:WU00:FS01:Connecting to 171.67.108.45:80
10:05:11:WU01:FS01:Server responded WORK_ACK (400)
10:05:11:WU01:FS01:Cleaning up
10:05:12:WU00:FS01:Assigned to work server 171.67.108.104
10:05:12:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 970] from 171.67.108.104
10:05:12:WU00:FS01:Connecting to 171.67.108.104:8080
10:05:13:WU00:FS01:Downloading 79.98MiB
10:05:19:WU00:FS01:Download 5.55%
10:05:25:WU00:FS01:Download 11.80%
10:05:31:WU00:FS01:Download 18.13%
10:05:37:WU00:FS01:Download 24.46%
10:05:43:WU00:FS01:Download 30.79%
10:05:49:WU00:FS01:Download 37.04%
10:05:55:WU00:FS01:Download 43.37%
10:06:01:WU00:FS01:Download 49.70%
10:06:07:WU00:FS01:Download 55.33%
10:06:11:WU02:FS00:0xa4:Completed 9600 out of 80000 steps (12%)
10:06:13:WU00:FS01:Download 61.66%
10:06:19:WU00:FS01:Download 67.99%
10:06:25:WU00:FS01:Download 74.24%
10:06:31:WU00:FS01:Download 80.57%
10:06:37:WU00:FS01:Download 86.90%
10:06:43:WU00:FS01:Download 93.23%
10:06:49:WU00:FS01:Download 99.24%
10:06:49:WU00:FS01:Download complete
10:06:49:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9205 run:12 clone:1 gen:1 core:0x21 unit:0x00000005ab436c685796c0afc62a3510
10:06:49:WU00:FS01:Downloading core from http://web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah
10:06:49:WU00:FS01:Connecting to web.stanford.edu:80
10:06:50:WU00:FS01:FahCore 21: Downloading 3.47MiB
10:06:55:WU00:FS01:FahCore 21: Download complete
10:06:55:WU00:FS01:Valid core signature
10:06:55:WARNING:WU00:FS01:FahCore has not changed since last download, aborting core update
10:06:55:WU00:FS01:Starting
10:06:55:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:06:55:WU00:FS01:Started FahCore on PID 8396
10:06:55:Started thread 39 on PID 5696
10:06:55:WU00:FS01:Core PID:7512
10:06:55:WU00:FS01:FahCore 0x21 started
10:06:55:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:06:56:WU00:FS01:Starting
10:06:56:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:06:56:WU00:FS01:Started FahCore on PID 400
10:06:56:Started thread 40 on PID 5696
10:06:56:WU00:FS01:Core PID:7776
10:06:56:WU00:FS01:FahCore 0x21 started
10:06:56:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:07:39:WU02:FS00:0xa4:Completed 10400 out of 80000 steps (13%)
10:07:56:WU00:FS01:Starting
10:07:56:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:07:56:WU00:FS01:Started FahCore on PID 712
10:07:56:Started thread 41 on PID 5696
10:07:56:WU00:FS01:Core PID:9500
10:07:56:WU00:FS01:FahCore 0x21 started
10:07:56:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:08:56:WU00:FS01:Starting
10:08:56:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:08:56:WU00:FS01:Started FahCore on PID 4836
10:08:56:Started thread 42 on PID 5696
10:08:56:WU00:FS01:Core PID:9704
10:08:56:WU00:FS01:FahCore 0x21 started
10:08:56:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:09:07:WU02:FS00:0xa4:Completed 11200 out of 80000 steps (14%)
10:09:56:WU00:FS01:Starting
10:09:56:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:09:56:WU00:FS01:Started FahCore on PID 6868
10:09:56:Started thread 43 on PID 5696
10:09:56:WU00:FS01:Core PID:4656
10:09:56:WU00:FS01:FahCore 0x21 started
10:09:57:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:09:57:WARNING:WU00:FS01:Too many errors, failing
10:09:57:WU00:FS01:Sending unit results: id:00 state:SEND error:FAILED project:9205 run:12 clone:1 gen:1 core:0x21 unit:0x00000005ab436c685796c0afc62a3510
10:09:57:WU00:FS01:Connecting to 171.67.108.104:8080
10:09:57:WU01:FS01:Connecting to 171.67.108.45:80
10:09:57:WU00:FS01:Server responded WORK_ACK (400)
10:09:57:WU00:FS01:Cleaning up
10:09:58:WU01:FS01:Assigned to work server 140.163.4.245
10:09:58:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 970] from 140.163.4.245
10:09:58:WU01:FS01:Connecting to 140.163.4.245:8080
10:09:59:WU01:FS01:Downloading 6.04MiB
10:10:05:WU01:FS01:Download 56.93%
10:10:08:WU01:FS01:Download complete
10:10:08:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:10493 run:4 clone:8 gen:166 core:0x21 unit:0x000000c88ca304f555d6168ef7af2a7b
10:10:08:WU01:FS01:Starting
10:10:08:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:10:08:WU01:FS01:Started FahCore on PID 784
10:10:08:Started thread 44 on PID 5696
10:10:08:WU01:FS01:Core PID:2264
10:10:08:WU01:FS01:FahCore 0x21 started
10:10:08:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:10:09:WU01:FS01:Starting
10:10:09:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:10:09:WU01:FS01:Started FahCore on PID 4868
10:10:09:Started thread 45 on PID 5696
10:10:09:WU01:FS01:Core PID:2096
10:10:09:WU01:FS01:FahCore 0x21 started
10:10:09:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:10:36:WU02:FS00:0xa4:Completed 12000 out of 80000 steps (15%)
10:11:09:WU01:FS01:Starting
10:11:09:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:11:09:WU01:FS01:Started FahCore on PID 1508
10:11:09:Started thread 46 on PID 5696
10:11:09:WU01:FS01:Core PID:7436
10:11:09:WU01:FS01:FahCore 0x21 started
10:11:09:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:12:06:WU02:FS00:0xa4:Completed 12800 out of 80000 steps (16%)
10:12:09:WU01:FS01:Starting
10:12:09:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:12:09:WU01:FS01:Started FahCore on PID 8616
10:12:09:Started thread 47 on PID 5696
10:12:09:WU01:FS01:Core PID:10200
10:12:09:WU01:FS01:FahCore 0x21 started
10:12:10:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:13:09:WU01:FS01:Starting
10:13:09:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:13:09:WU01:FS01:Started FahCore on PID 6920
10:13:09:Started thread 48 on PID 5696
10:13:09:WU01:FS01:Core PID:8220
10:13:09:WU01:FS01:FahCore 0x21 started
10:13:10:WARNING:WU01:FS01:FahCore returned: FAILED_1 (0 = 0x0)
10:13:10:WARNING:WU01:FS01:Too many errors, failing
10:13:10:WU01:FS01:Sending unit results: id:01 state:SEND error:FAILED project:10493 run:4 clone:8 gen:166 core:0x21 unit:0x000000c88ca304f555d6168ef7af2a7b
10:13:10:WU01:FS01:Connecting to 140.163.4.245:8080
10:13:10:WU00:FS01:Connecting to 171.67.108.45:80
10:13:10:WU01:FS01:Server responded WORK_ACK (400)
10:13:10:WU01:FS01:Cleaning up
10:13:11:WU00:FS01:Assigned to work server 171.67.108.159
10:13:11:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 970] from 171.67.108.159
10:13:11:WU00:FS01:Connecting to 171.67.108.159:8080
10:13:12:WU00:FS01:Downloading 19.65MiB
10:13:18:WU00:FS01:Download 24.17%
10:13:24:WU00:FS01:Download 49.93%
10:13:30:WU00:FS01:Download 75.37%
10:13:35:WU00:FS01:Download complete
10:13:35:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9152 run:12 clone:8 gen:402 core:0x18 unit:0x000001c2ab436c9f56623c60ff11436a
10:13:35:WU00:FS01:Starting
10:13:35:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:13:35:WU00:FS01:Started FahCore on PID 9672
10:13:35:Started thread 49 on PID 5696
10:13:36:WU00:FS01:Core PID:708
10:13:36:WU00:FS01:FahCore 0x18 started
10:13:36:WU02:FS00:0xa4:Completed 13600 out of 80000 steps (17%)
10:13:36:WU00:FS01:0x18:*********************** Log Started 2016-07-28T10:13:36Z ***********************
10:13:36:WU00:FS01:0x18:Project: 9152 (Run 12, Clone 8, Gen 402)
10:13:36:WU00:FS01:0x18:Unit: 0x000001c2ab436c9f56623c60ff11436a
10:13:36:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
10:13:36:WU00:FS01:0x18:Machine: 1
10:13:36:WU00:FS01:0x18:Reading tar file core.xml
10:13:36:WU00:FS01:0x18:Reading tar file integrator.xml
10:13:36:WU00:FS01:0x18:Reading tar file state.xml
10:13:36:WU00:FS01:0x18:Reading tar file system.xml
10:13:36:WU00:FS01:0x18:Digital signatures verified
10:13:36:WU00:FS01:0x18:Folding@home GPU core18
10:13:36:WU00:FS01:0x18:Version 0.0.4
10:13:54:WU00:FS01:0x18:Completed 0 out of 2500000 steps (0%)
10:13:54:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
10:15:10:WU02:FS00:0xa4:Completed 14400 out of 80000 steps (18%)
10:15:27:WU00:FS01:0x18:Completed 25000 out of 2500000 steps (1%)
10:16:42:WU02:FS00:0xa4:Completed 15200 out of 80000 steps (19%)
10:16:56:WU00:FS01:0x18:Completed 50000 out of 2500000 steps (2%)
10:18:14:WU02:FS00:0xa4:Completed 16000 out of 80000 steps (20%)
10:18:24:WU00:FS01:0x18:Completed 75000 out of 2500000 steps (3%)
10:19:47:WU02:FS00:0xa4:Completed 16800 out of 80000 steps (21%)
10:19:53:WU00:FS01:0x18:Completed 100000 out of 2500000 steps (4%)
10:21:18:WU02:FS00:0xa4:Completed 17600 out of 80000 steps (22%)
10:21:27:WU00:FS01:0x18:Completed 125000 out of 2500000 steps (5%)
10:22:51:WU02:FS00:0xa4:Completed 18400 out of 80000 steps (23%)
10:22:56:WU00:FS01:0x18:Completed 150000 out of 2500000 steps (6%)
10:24:23:WU02:FS00:0xa4:Completed 19200 out of 80000 steps (24%)
10:24:25:WU00:FS01:0x18:Completed 175000 out of 2500000 steps (7%)
10:25:53:WU00:FS01:0x18:Completed 200000 out of 2500000 steps (8%)
10:25:55:WU02:FS00:0xa4:Completed 20000 out of 80000 steps (25%)
10:27:27:WU02:FS00:0xa4:Completed 20800 out of 80000 steps (26%)
10:27:28:WU00:FS01:0x18:Completed 225000 out of 2500000 steps (9%)
10:28:57:WU00:FS01:0x18:Completed 250000 out of 2500000 steps (10%)
10:28:58:WU02:FS00:0xa4:Completed 21600 out of 80000 steps (27%)
10:30:25:WU00:FS01:0x18:Completed 275000 out of 2500000 steps (11%)
10:30:31:WU02:FS00:0xa4:Completed 22400 out of 80000 steps (28%)
10:31:54:WU00:FS01:0x18:Completed 300000 out of 2500000 steps (12%)
10:32:03:WU02:FS00:0xa4:Completed 23200 out of 80000 steps (29%)
10:33:28:WU00:FS01:0x18:Completed 325000 out of 2500000 steps (13%)
10:33:35:WU02:FS00:0xa4:Completed 24000 out of 80000 steps (30%)
10:34:57:WU00:FS01:0x18:Completed 350000 out of 2500000 steps (14%)
10:35:07:WU02:FS00:0xa4:Completed 24800 out of 80000 steps (31%)
10:36:26:WU00:FS01:0x18:Completed 375000 out of 2500000 steps (15%)
10:36:39:WU02:FS00:0xa4:Completed 25600 out of 80000 steps (32%)
10:37:54:WU00:FS01:0x18:Completed 400000 out of 2500000 steps (16%)
10:38:10:WU02:FS00:0xa4:Completed 26400 out of 80000 steps (33%)
10:39:29:WU00:FS01:0x18:Completed 425000 out of 2500000 steps (17%)
10:39:43:WU02:FS00:0xa4:Completed 27200 out of 80000 steps (34%)
10:40:58:WU00:FS01:0x18:Completed 450000 out of 2500000 steps (18%)
10:41:14:WU02:FS00:0xa4:Completed 28000 out of 80000 steps (35%)
10:42:26:WU00:FS01:0x18:Completed 475000 out of 2500000 steps (19%)
10:42:46:WU02:FS00:0xa4:Completed 28800 out of 80000 steps (36%)
10:43:55:WU00:FS01:0x18:Completed 500000 out of 2500000 steps (20%)
10:44:18:WU02:FS00:0xa4:Completed 29600 out of 80000 steps (37%)
10:45:29:WU00:FS01:0x18:Completed 525000 out of 2500000 steps (21%)
10:45:51:WU02:FS00:0xa4:Completed 30400 out of 80000 steps (38%)
10:46:58:WU00:FS01:0x18:Completed 550000 out of 2500000 steps (22%)
10:47:24:WU02:FS00:0xa4:Completed 31200 out of 80000 steps (39%)
10:48:27:WU00:FS01:0x18:Completed 575000 out of 2500000 steps (23%)
10:48:56:WU02:FS00:0xa4:Completed 32000 out of 80000 steps (40%)
10:49:55:WU00:FS01:0x18:Completed 600000 out of 2500000 steps (24%)
10:50:28:WU02:FS00:0xa4:Completed 32800 out of 80000 steps (41%)
10:51:30:WU00:FS01:0x18:Completed 625000 out of 2500000 steps (25%)
10:52:00:WU02:FS00:0xa4:Completed 33600 out of 80000 steps (42%)
10:52:59:WU00:FS01:0x18:Completed 650000 out of 2500000 steps (26%)
10:53:32:WU02:FS00:0xa4:Completed 34400 out of 80000 steps (43%)
10:54:27:WU00:FS01:0x18:Completed 675000 out of 2500000 steps (27%)
10:55:04:WU02:FS00:0xa4:Completed 35200 out of 80000 steps (44%)
10:55:56:WU00:FS01:0x18:Completed 700000 out of 2500000 steps (28%)
10:56:36:WU02:FS00:0xa4:Completed 36000 out of 80000 steps (45%)
10:57:31:WU00:FS01:0x18:Completed 725000 out of 2500000 steps (29%)
10:58:09:WU02:FS00:0xa4:Completed 36800 out of 80000 steps (46%)
10:58:59:WU00:FS01:0x18:Completed 750000 out of 2500000 steps (30%)
10:59:41:WU02:FS00:0xa4:Completed 37600 out of 80000 steps (47%)
11:00:28:WU00:FS01:0x18:Completed 775000 out of 2500000 steps (31%)
11:01:14:WU02:FS00:0xa4:Completed 38400 out of 80000 steps (48%)
11:01:56:WU00:FS01:0x18:Completed 800000 out of 2500000 steps (32%)
11:02:46:WU02:FS00:0xa4:Completed 39200 out of 80000 steps (49%)
11:03:31:WU00:FS01:0x18:Completed 825000 out of 2500000 steps (33%)
11:04:18:WU02:FS00:0xa4:Completed 40000 out of 80000 steps (50%)
11:04:59:WU00:FS01:0x18:Completed 850000 out of 2500000 steps (34%)
11:05:50:WU02:FS00:0xa4:Completed 40800 out of 80000 steps (51%)
11:06:28:WU00:FS01:0x18:Completed 875000 out of 2500000 steps (35%)
11:07:22:WU02:FS00:0xa4:Completed 41600 out of 80000 steps (52%)
11:07:57:WU00:FS01:0x18:Completed 900000 out of 2500000 steps (36%)
11:08:57:WU02:FS00:0xa4:Completed 42400 out of 80000 steps (53%)
11:09:32:WU00:FS01:0x18:Completed 925000 out of 2500000 steps (37%)
11:10:36:WU02:FS00:0xa4:Completed 43200 out of 80000 steps (54%)
11:11:01:WU00:FS01:0x18:Completed 950000 out of 2500000 steps (38%)
11:12:14:WU02:FS00:0xa4:Completed 44000 out of 80000 steps (55%)
11:12:29:WU00:FS01:0x18:Completed 975000 out of 2500000 steps (39%)
11:13:53:WU02:FS00:0xa4:Completed 44800 out of 80000 steps (56%)
11:13:58:WU00:FS01:0x18:Completed 1000000 out of 2500000 steps (40%)
11:15:32:WU02:FS00:0xa4:Completed 45600 out of 80000 steps (57%)
11:15:35:WU00:FS01:0x18:Completed 1025000 out of 2500000 steps (41%)
11:17:04:WU00:FS01:0x18:Completed 1050000 out of 2500000 steps (42%)
11:17:13:WU02:FS00:0xa4:Completed 46400 out of 80000 steps (58%)
11:18:33:WU00:FS01:0x18:Completed 1075000 out of 2500000 steps (43%)
11:18:57:WU02:FS00:0xa4:Completed 47200 out of 80000 steps (59%)
11:20:02:WU00:FS01:0x18:Completed 1100000 out of 2500000 steps (44%)
11:20:36:WU02:FS00:0xa4:Completed 48000 out of 80000 steps (60%)
11:21:38:WU00:FS01:0x18:Completed 1125000 out of 2500000 steps (45%)
11:22:16:WU02:FS00:0xa4:Completed 48800 out of 80000 steps (61%)
11:23:07:WU00:FS01:0x18:Completed 1150000 out of 2500000 steps (46%)
11:23:55:WU02:FS00:0xa4:Completed 49600 out of 80000 steps (62%)
11:24:36:WU00:FS01:0x18:Completed 1175000 out of 2500000 steps (47%)
11:25:34:WU02:FS00:0xa4:Completed 50400 out of 80000 steps (63%)
11:26:06:WU00:FS01:0x18:Completed 1200000 out of 2500000 steps (48%)
11:27:14:WU02:FS00:0xa4:Completed 51200 out of 80000 steps (64%)
11:27:41:WU00:FS01:0x18:Completed 1225000 out of 2500000 steps (49%)
11:28:52:WU02:FS00:0xa4:Completed 52000 out of 80000 steps (65%)
11:29:11:WU00:FS01:0x18:Completed 1250000 out of 2500000 steps (50%)
11:30:31:WU02:FS00:0xa4:Completed 52800 out of 80000 steps (66%)
11:30:40:WU00:FS01:0x18:Completed 1275000 out of 2500000 steps (51%)
11:32:08:WU00:FS01:0x18:Completed 1300000 out of 2500000 steps (52%)
11:32:10:WU02:FS00:0xa4:Completed 53600 out of 80000 steps (67%)
11:33:44:WU00:FS01:0x18:Completed 1325000 out of 2500000 steps (53%)
11:33:48:WU02:FS00:0xa4:Completed 54400 out of 80000 steps (68%)
11:35:13:WU00:FS01:0x18:Completed 1350000 out of 2500000 steps (54%)
11:35:27:WU02:FS00:0xa4:Completed 55200 out of 80000 steps (69%)
11:36:42:WU00:FS01:0x18:Completed 1375000 out of 2500000 steps (55%)
11:37:07:WU02:FS00:0xa4:Completed 56000 out of 80000 steps (70%)
11:38:11:WU00:FS01:0x18:Completed 1400000 out of 2500000 steps (56%)
11:38:48:WU02:FS00:0xa4:Completed 56800 out of 80000 steps (71%)
11:39:47:WU00:FS01:0x18:Completed 1425000 out of 2500000 steps (57%)
11:40:27:WU02:FS00:0xa4:Completed 57600 out of 80000 steps (72%)
11:41:17:WU00:FS01:0x18:Completed 1450000 out of 2500000 steps (58%)
11:42:05:WU02:FS00:0xa4:Completed 58400 out of 80000 steps (73%)
11:42:45:WU00:FS01:0x18:Completed 1475000 out of 2500000 steps (59%)
11:43:39:WU02:FS00:0xa4:Completed 59200 out of 80000 steps (74%)
11:44:14:WU00:FS01:0x18:Completed 1500000 out of 2500000 steps (60%)
11:45:10:WU02:FS00:0xa4:Completed 60000 out of 80000 steps (75%)
11:45:49:WU00:FS01:0x18:Completed 1525000 out of 2500000 steps (61%)
11:46:43:WU02:FS00:0xa4:Completed 60800 out of 80000 steps (76%)
11:47:17:WU00:FS01:0x18:Completed 1550000 out of 2500000 steps (62%)
11:48:15:WU02:FS00:0xa4:Completed 61600 out of 80000 steps (77%)
11:48:46:WU00:FS01:0x18:Completed 1575000 out of 2500000 steps (63%)
11:49:47:WU02:FS00:0xa4:Completed 62400 out of 80000 steps (78%)
11:50:14:WU00:FS01:0x18:Completed 1600000 out of 2500000 steps (64%)
11:51:19:WU02:FS00:0xa4:Completed 63200 out of 80000 steps (79%)
11:51:49:WU00:FS01:0x18:Completed 1625000 out of 2500000 steps (65%)
11:52:51:WU02:FS00:0xa4:Completed 64000 out of 80000 steps (80%)
11:53:18:WU00:FS01:0x18:Completed 1650000 out of 2500000 steps (66%)
11:54:23:WU02:FS00:0xa4:Completed 64800 out of 80000 steps (81%)
11:54:46:WU00:FS01:0x18:Completed 1675000 out of 2500000 steps (67%)
11:55:58:WU02:FS00:0xa4:Completed 65600 out of 80000 steps (82%)
11:56:15:WU00:FS01:0x18:Completed 1700000 out of 2500000 steps (68%)
11:57:30:WU02:FS00:0xa4:Completed 66400 out of 80000 steps (83%)
11:57:50:WU00:FS01:0x18:Completed 1725000 out of 2500000 steps (69%)
11:59:03:WU02:FS00:0xa4:Completed 67200 out of 80000 steps (84%)
11:59:18:WU00:FS01:0x18:Completed 1750000 out of 2500000 steps (70%)
12:00:35:WU02:FS00:0xa4:Completed 68000 out of 80000 steps (85%)
12:00:47:WU00:FS01:0x18:Completed 1775000 out of 2500000 steps (71%)
12:02:10:WU02:FS00:0xa4:Completed 68800 out of 80000 steps (86%)
12:02:15:WU00:FS01:0x18:Completed 1800000 out of 2500000 steps (72%)
12:03:42:WU02:FS00:0xa4:Completed 69600 out of 80000 steps (87%)
12:03:50:WU00:FS01:0x18:Completed 1825000 out of 2500000 steps (73%)
12:05:14:WU02:FS00:0xa4:Completed 70400 out of 80000 steps (88%)
12:05:19:WU00:FS01:0x18:Completed 1850000 out of 2500000 steps (74%)
12:06:47:WU02:FS00:0xa4:Completed 71200 out of 80000 steps (89%)
12:06:47:WU00:FS01:0x18:Completed 1875000 out of 2500000 steps (75%)
12:08:16:WU00:FS01:0x18:Completed 1900000 out of 2500000 steps (76%)
12:08:19:WU02:FS00:0xa4:Completed 72000 out of 80000 steps (90%)
12:09:51:WU00:FS01:0x18:Completed 1925000 out of 2500000 steps (77%)
12:09:51:WU02:FS00:0xa4:Completed 72800 out of 80000 steps (91%)
12:11:19:WU00:FS01:0x18:Completed 1950000 out of 2500000 steps (78%)
12:11:23:WU02:FS00:0xa4:Completed 73600 out of 80000 steps (92%)
12:12:48:WU00:FS01:0x18:Completed 1975000 out of 2500000 steps (79%)
12:12:56:WU02:FS00:0xa4:Completed 74400 out of 80000 steps (93%)
12:14:16:WU00:FS01:0x18:Completed 2000000 out of 2500000 steps (80%)
12:14:29:WU02:FS00:0xa4:Completed 75200 out of 80000 steps (94%)
12:15:51:WU00:FS01:0x18:Completed 2025000 out of 2500000 steps (81%)
12:16:02:WU02:FS00:0xa4:Completed 76000 out of 80000 steps (95%)
12:17:19:WU00:FS01:0x18:Completed 2050000 out of 2500000 steps (82%)
12:17:35:WU02:FS00:0xa4:Completed 76800 out of 80000 steps (96%)
12:18:48:WU00:FS01:0x18:Completed 2075000 out of 2500000 steps (83%)
12:19:07:WU02:FS00:0xa4:Completed 77600 out of 80000 steps (97%)
12:20:17:WU00:FS01:0x18:Completed 2100000 out of 2500000 steps (84%)
12:20:39:WU02:FS00:0xa4:Completed 78400 out of 80000 steps (98%)
12:21:51:WU00:FS01:0x18:Completed 2125000 out of 2500000 steps (85%)
12:22:11:WU02:FS00:0xa4:Completed 79200 out of 80000 steps (99%)
12:22:11:WU01:FS00:Connecting to 171.67.108.45:8080
12:22:12:WU01:FS00:Assigned to work server 171.64.65.99
12:22:12:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:6 from 171.64.65.99
12:22:12:WU01:FS00:Connecting to 171.64.65.99:8080
12:22:15:WU01:FS00:Downloading 6.23MiB
12:22:21:WU01:FS00:Download 33.09%
12:22:27:WU01:FS00:Download 69.18%
12:22:33:WU01:FS00:Download 93.24%
12:22:34:WU01:FS00:Download complete
12:22:34:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9752 run:1050 clone:0 gen:962 core:0xa4 unit:0x00000476ab40416355417316919321ab
12:23:20:WU00:FS01:0x18:Completed 2150000 out of 2500000 steps (86%)
12:23:43:WU02:FS00:0xa4:Completed 80000 out of 80000 steps (100%)
12:23:45:WU02:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
12:23:55:WU02:FS00:0xa4:
12:23:55:WU02:FS00:0xa4:Finished Work Unit:
12:23:55:WU02:FS00:0xa4:- Reading up to 4123296 from "02/wudata_01.trr": Read 4123296
12:23:55:WU02:FS00:0xa4:trr file hash check passed.
12:23:55:WU02:FS00:0xa4:- Reading up to 3193756 from "02/wudata_01.xtc": Read 3193756
12:23:55:WU02:FS00:0xa4:xtc file hash check passed.
12:23:55:WU02:FS00:0xa4:edr file hash check passed.
12:23:55:WU02:FS00:0xa4:logfile size: 19877
12:23:55:WU02:FS00:0xa4:Leaving Run
12:23:57:WU02:FS00:0xa4:- Writing 7339321 bytes of core data to disk...
12:23:58:WU02:FS00:0xa4:Done: 7338809 -> 7067941 (compressed to 96.3 percent)
12:23:58:WU02:FS00:0xa4: ... Done.
12:23:59:WU02:FS00:0xa4:- Shutting down core
12:23:59:WU02:FS00:0xa4:
12:23:59:WU02:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
12:23:59:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
12:23:59:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:9752 run:1343 clone:0 gen:974 core:0xa4 unit:0x000004a6ab4041635541737a28361450
12:23:59:WU02:FS00:Uploading 6.74MiB to 171.64.65.99
12:23:59:WU01:FS00:Starting
12:23:59:WU02:FS00:Connecting to 171.64.65.99:8080
12:23:59:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -np 6
12:23:59:WU01:FS00:Started FahCore on PID 2264
12:23:59:Started thread 50 on PID 5696
12:23:59:WU01:FS00:Core PID:8664
12:23:59:WU01:FS00:FahCore 0xa4 started
12:24:00:WU01:FS00:0xa4:
12:24:00:WU01:FS00:0xa4:*------------------------------*
12:24:00:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
12:24:00:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
12:24:00:WU01:FS00:0xa4:
12:24:00:WU01:FS00:0xa4:Preparing to commence simulation
12:24:00:WU01:FS00:0xa4:- Looking at optimizations...
12:24:00:WU01:FS00:0xa4:- Created dyn
12:24:00:WU01:FS00:0xa4:- Files status OK
12:24:02:WU01:FS00:0xa4:- Expanded 6536190 -> 22431316 (decompressed 343.1 percent)
12:24:02:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=6536190 data_size=22431316, decompressed_data_size=22431316 diff=0
12:24:02:WU01:FS00:0xa4:- Digital signature verified
12:24:02:WU01:FS00:0xa4:
12:24:02:WU01:FS00:0xa4:Project: 9752 (Run 1050, Clone 0, Gen 962)
12:24:02:WU01:FS00:0xa4:
12:24:02:WU01:FS00:0xa4:Assembly optimizations on if available.
12:24:02:WU01:FS00:0xa4:Entering M.D.
12:24:05:WU02:FS00:Upload 10.20%
12:24:08:WU01:FS00:0xa4:Mapping NT from 6 to 6
12:24:09:WU01:FS00:0xa4:Completed 0 out of 80000 steps (0%)
12:24:11:WU02:FS00:Upload 22.25%
12:24:17:WU02:FS00:Upload 32.45%
12:24:23:WU02:FS00:Upload 42.65%
12:24:29:WU02:FS00:Upload 53.78%
12:24:35:WU02:FS00:Upload 63.97%
12:24:41:WU02:FS00:Upload 75.10%
12:24:47:WU02:FS00:Upload 85.30%
12:24:48:WU00:FS01:0x18:Completed 2175000 out of 2500000 steps (87%)
12:24:53:WU02:FS00:Upload 96.42%
12:24:59:WU02:FS00:Upload complete
12:24:59:WU02:FS00:Server responded WORK_ACK (400)
12:24:59:WU02:FS00:Final credit estimate, 2609.00 points
12:24:59:WU02:FS00:Cleaning up
12:25:42:WU01:FS00:0xa4:Completed 800 out of 80000 steps (1%)
12:26:17:WU00:FS01:0x18:Completed 2200000 out of 2500000 steps (88%)
12:27:15:WU01:FS00:0xa4:Completed 1600 out of 80000 steps (2%)
12:27:52:WU00:FS01:0x18:Completed 2225000 out of 2500000 steps (89%)
12:28:48:WU01:FS00:0xa4:Completed 2400 out of 80000 steps (3%)
12:29:20:WU00:FS01:0x18:Completed 2250000 out of 2500000 steps (90%)
12:30:20:WU01:FS00:0xa4:Completed 3200 out of 80000 steps (4%)
12:30:48:WU00:FS01:0x18:Completed 2275000 out of 2500000 steps (91%)
12:31:53:WU01:FS00:0xa4:Completed 4000 out of 80000 steps (5%)
12:32:17:WU00:FS01:0x18:Completed 2300000 out of 2500000 steps (92%)
12:33:26:WU01:FS00:0xa4:Completed 4800 out of 80000 steps (6%)
12:33:52:WU00:FS01:0x18:Completed 2325000 out of 2500000 steps (93%)
12:34:59:WU01:FS00:0xa4:Completed 5600 out of 80000 steps (7%)
12:35:21:WU00:FS01:0x18:Completed 2350000 out of 2500000 steps (94%)
12:36:31:WU01:FS00:0xa4:Completed 6400 out of 80000 steps (8%)
12:36:49:WU00:FS01:0x18:Completed 2375000 out of 2500000 steps (95%)
12:38:04:WU01:FS00:0xa4:Completed 7200 out of 80000 steps (9%)
12:38:18:WU00:FS01:0x18:Completed 2400000 out of 2500000 steps (96%)
12:39:37:WU01:FS00:0xa4:Completed 8000 out of 80000 steps (10%)
12:39:52:WU00:FS01:0x18:Completed 2425000 out of 2500000 steps (97%)
12:41:10:WU01:FS00:0xa4:Completed 8800 out of 80000 steps (11%)
12:41:21:WU00:FS01:0x18:Completed 2450000 out of 2500000 steps (98%)
12:42:42:WU01:FS00:0xa4:Completed 9600 out of 80000 steps (12%)
12:42:49:WU00:FS01:0x18:Completed 2475000 out of 2500000 steps (99%)
12:44:15:WU01:FS00:0xa4:Completed 10400 out of 80000 steps (13%)
12:44:18:WU00:FS01:0x18:Completed 2500000 out of 2500000 steps (100%)
12:44:19:WU02:FS01:Connecting to 171.67.108.45:80
12:44:20:WU02:FS01:Assigned to work server 171.67.108.104
12:44:20:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GM204 [GeForce GTX 970] from 171.67.108.104
12:44:20:WU02:FS01:Connecting to 171.67.108.104:8080
12:44:21:WU02:FS01:Downloading 80.23MiB
12:44:25:WU00:FS01:0x18:Saving result file logfile_01.txt
12:44:25:WU00:FS01:0x18:Saving result file checkpointState.xml
12:44:25:WU00:FS01:0x18:Saving result file checkpt.crc
12:44:25:WU00:FS01:0x18:Saving result file log.txt
12:44:25:WU00:FS01:0x18:Saving result file positions.xtc
12:44:25:WU00:FS01:0x18:Folding@home Core Shutdown: FINISHED_UNIT
12:44:25:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
12:44:25:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:9152 run:12 clone:8 gen:402 core:0x18 unit:0x000001c2ab436c9f56623c60ff11436a
12:44:25:WU00:FS01:Uploading 11.69MiB to 171.67.108.159
12:44:25:WU00:FS01:Connecting to 171.67.108.159:8080
12:44:27:WU02:FS01:Download 6.39%
12:44:31:WU00:FS01:Upload 5.88%
12:44:33:WU02:FS01:Download 12.39%
12:44:37:WU00:FS01:Upload 11.23%
12:44:39:WU02:FS01:Download 18.31%
12:44:43:WU00:FS01:Upload 16.57%
12:44:45:WU02:FS01:Download 24.15%
12:44:49:WU00:FS01:Upload 22.99%
12:44:51:WU02:FS01:Download 30.38%
12:44:55:WU00:FS01:Upload 28.87%
12:44:57:WU02:FS01:Download 36.62%
12:45:01:WU00:FS01:Upload 34.75%
12:45:03:WU02:FS01:Download 42.85%
12:45:08:WU00:FS01:Upload 40.63%
12:45:09:WU02:FS01:Download 49.00%
12:45:14:WU00:FS01:Upload 46.52%
12:45:15:WU02:FS01:Download 55.23%
12:45:20:WU00:FS01:Upload 52.40%
12:45:21:WU02:FS01:Download 61.55%
12:45:26:WU00:FS01:Upload 58.28%
12:45:27:WU02:FS01:Download 67.78%
12:45:32:WU00:FS01:Upload 64.16%
12:45:33:WU02:FS01:Download 74.01%
12:45:38:WU00:FS01:Upload 70.04%
12:45:39:WU02:FS01:Download 80.16%
12:45:43:WU01:FS00:0xa4:Completed 11200 out of 80000 steps (14%)
12:45:44:WU00:FS01:Upload 75.92%
12:45:45:WU02:FS01:Download 85.93%
12:45:50:WU00:FS01:Upload 81.80%
12:45:51:WU02:FS01:Download 92.16%
12:45:56:WU00:FS01:Upload 88.22%
12:45:57:WU02:FS01:Download 98.32%
12:45:58:WU02:FS01:Download complete
12:45:58:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9213 run:52 clone:0 gen:4 core:0x21 unit:0x0000000aab436c685796c11e320118cf
12:45:58:WU02:FS01:Starting
12:45:58:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:45:58:WU02:FS01:Started FahCore on PID 7444
12:45:58:Started thread 51 on PID 5696
12:45:59:WU02:FS01:Core PID:8744
12:45:59:WU02:FS01:FahCore 0x21 started
12:45:59:WARNING:WU02:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:45:59:WU02:FS01:Starting
12:45:59:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:45:59:WU02:FS01:Started FahCore on PID 6820
12:45:59:Started thread 52 on PID 5696
12:45:59:WU02:FS01:Core PID:6264
12:45:59:WU02:FS01:FahCore 0x21 started
12:46:00:WARNING:WU02:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:46:02:WU00:FS01:Upload 94.10%
12:46:08:WU00:FS01:Upload 99.98%
12:46:11:WU00:FS01:Upload complete
12:46:11:WU00:FS01:Server responded WORK_ACK (400)
12:46:11:WU00:FS01:Final credit estimate, 31855.00 points
12:46:11:WU00:FS01:Cleaning up
12:46:59:WU02:FS01:Starting
12:46:59:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:46:59:WU02:FS01:Started FahCore on PID 3672
12:46:59:Started thread 53 on PID 5696
12:46:59:WU02:FS01:Core PID:9432
12:46:59:WU02:FS01:FahCore 0x21 started
12:47:00:WARNING:WU02:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:47:11:WU01:FS00:0xa4:Completed 12000 out of 80000 steps (15%)
12:47:59:WU02:FS01:Starting
12:47:59:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:47:59:WU02:FS01:Started FahCore on PID 10144
12:47:59:Started thread 54 on PID 5696
12:48:00:WU02:FS01:Core PID:4144
12:48:00:WU02:FS01:FahCore 0x21 started
12:48:00:WARNING:WU02:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:48:38:WU01:FS00:0xa4:Completed 12800 out of 80000 steps (16%)
12:49:00:WU02:FS01:Starting
12:49:00:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:49:00:WU02:FS01:Started FahCore on PID 3584
12:49:00:Started thread 55 on PID 5696
12:49:00:WU02:FS01:Core PID:9164
12:49:00:WU02:FS01:FahCore 0x21 started
12:49:00:WARNING:WU02:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:49:00:WARNING:WU02:FS01:Too many errors, failing
12:49:00:WU02:FS01:Sending unit results: id:02 state:SEND error:FAILED project:9213 run:52 clone:0 gen:4 core:0x21 unit:0x0000000aab436c685796c11e320118cf
12:49:00:WU02:FS01:Connecting to 171.67.108.104:8080
12:49:01:WU00:FS01:Connecting to 171.67.108.45:80
12:49:01:WU02:FS01:Server responded WORK_ACK (400)
12:49:01:WU02:FS01:Cleaning up
12:49:02:WU00:FS01:Assigned to work server 140.163.4.242
12:49:02:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 970] from 140.163.4.242
12:49:02:WU00:FS01:Connecting to 140.163.4.242:8080
12:49:02:WU00:FS01:Downloading 3.48MiB
12:49:06:WU00:FS01:Download complete
12:49:06:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:11407 run:1 clone:29 gen:171 core:0x21 unit:0x000000da8ca304f25686b24f75baf7e5
12:49:06:WU00:FS01:Starting
12:49:06:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:49:06:WU00:FS01:Started FahCore on PID 8368
12:49:06:Started thread 56 on PID 5696
12:49:06:WU00:FS01:Core PID:7556
12:49:06:WU00:FS01:FahCore 0x21 started
12:49:07:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:49:07:WU00:FS01:Starting
12:49:07:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:49:07:WU00:FS01:Started FahCore on PID 8172
12:49:07:Started thread 57 on PID 5696
12:49:07:WU00:FS01:Core PID:6792
12:49:07:WU00:FS01:FahCore 0x21 started
12:49:08:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:50:05:WU01:FS00:0xa4:Completed 13600 out of 80000 steps (17%)
12:50:07:WU00:FS01:Starting
12:50:07:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:50:07:WU00:FS01:Started FahCore on PID 7116
12:50:07:Started thread 58 on PID 5696
12:50:07:WU00:FS01:Core PID:4152
12:50:07:WU00:FS01:FahCore 0x21 started
12:50:08:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:51:07:WU00:FS01:Starting
12:51:07:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:51:07:WU00:FS01:Started FahCore on PID 3004
12:51:07:Started thread 59 on PID 5696
12:51:07:WU00:FS01:Core PID:7580
12:51:07:WU00:FS01:FahCore 0x21 started
12:51:08:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:51:32:WU01:FS00:0xa4:Completed 14400 out of 80000 steps (18%)
12:52:07:WU00:FS01:Starting
12:52:07:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:52:07:WU00:FS01:Started FahCore on PID 4828
12:52:07:Started thread 60 on PID 5696
12:52:07:WU00:FS01:Core PID:9812
12:52:07:WU00:FS01:FahCore 0x21 started
12:52:08:WARNING:WU00:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:52:08:WARNING:WU00:FS01:Too many errors, failing
12:52:08:WU00:FS01:Sending unit results: id:00 state:SEND error:FAILED project:11407 run:1 clone:29 gen:171 core:0x21 unit:0x000000da8ca304f25686b24f75baf7e5
12:52:08:WU00:FS01:Connecting to 140.163.4.242:8080
12:52:08:WU00:FS01:Server responded WORK_ACK (400)
12:52:08:WU02:FS01:Connecting to 171.67.108.45:80
12:52:09:WU00:FS01:Cleaning up
12:52:09:WU02:FS01:Assigned to work server 171.64.65.98
12:52:09:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 970] from 171.64.65.98
12:52:09:WU02:FS01:Connecting to 171.64.65.98:8080
12:52:11:WU02:FS01:Downloading 15.70MiB
12:52:17:WU02:FS01:Download 16.32%
12:52:23:WU02:FS01:Download 29.86%
12:52:29:WU02:FS01:Download 42.20%
12:52:35:WU02:FS01:Download 54.14%
12:52:41:WU02:FS01:Download 66.48%
12:52:47:WU02:FS01:Download 78.83%
12:52:53:WU02:FS01:Download 90.77%
12:52:57:WU02:FS01:Download complete
12:52:57:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9704 run:28 clone:11 gen:220 core:0x21 unit:0x0000012eab404162553ebfff23bb12b7
12:52:57:WU02:FS01:Starting
12:52:57:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:52:57:WU02:FS01:Started FahCore on PID 10072
12:52:57:Started thread 61 on PID 5696
12:52:57:WU02:FS01:Core PID:6996
12:52:57:WU02:FS01:FahCore 0x21 started
12:52:58:WARNING:WU02:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:52:58:WU02:FS01:Starting
12:52:58:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:52:58:WU02:FS01:Started FahCore on PID 6352
12:52:58:Started thread 62 on PID 5696
12:52:58:WU02:FS01:Core PID:6824
12:52:58:WU02:FS01:FahCore 0x21 started
12:52:59:WARNING:WU02:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:52:59:WU01:FS00:0xa4:Completed 15200 out of 80000 steps (19%)
12:53:58:WU02:FS01:Starting
12:53:58:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:53:58:WU02:FS01:Started FahCore on PID 5280
12:53:58:Started thread 63 on PID 5696
12:53:58:WU02:FS01:Core PID:4040
12:53:58:WU02:FS01:FahCore 0x21 started
12:53:59:WARNING:WU02:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:54:27:WU01:FS00:0xa4:Completed 16000 out of 80000 steps (20%)
12:54:58:WU02:FS01:Starting
12:54:58:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:54:58:WU02:FS01:Started FahCore on PID 2568
12:54:58:Started thread 64 on PID 5696
12:54:58:WU02:FS01:Core PID:5516
12:54:58:WU02:FS01:FahCore 0x21 started
12:54:59:WARNING:WU02:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:55:54:WU01:FS00:0xa4:Completed 16800 out of 80000 steps (21%)
12:55:58:WU02:FS01:Starting
12:55:58:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/WINDOWS/system32/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5696 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:55:58:WU02:FS01:Started FahCore on PID 7328
12:55:58:Started thread 65 on PID 5696
12:55:58:WU02:FS01:Core PID:1484
12:55:58:WU02:FS01:FahCore 0x21 started
12:55:59:WARNING:WU02:FS01:FahCore returned: FAILED_1 (0 = 0x0)
12:55:59:WARNING:WU02:FS01:Too many errors, failing
12:55:59:WU02:FS01:Sending unit results: id:02 state:SEND error:FAILED project:9704 run:28 clone:11 gen:220 core:0x21 unit:0x0000012eab404162553ebfff23bb12b7
12:55:59:WU02:FS01:Connecting to 171.64.65.98:8080
12:56:00:WU00:FS01:Connecting to 171.67.108.45:80
12:56:00:WU02:FS01:Server responded WORK_ACK (400)
12:56:00:WU02:FS01:Cleaning up
12:56:01:WU00:FS01:Assigned to work server 171.67.108.155
12:56:01:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 970] from 171.67.108.155
12:56:01:WU00:FS01:Connecting to 171.67.108.155:8080
12:56:03:WU00:FS01:Downloading 390.65KiB
12:57:21:WU01:FS00:0xa4:Completed 17600 out of 80000 steps (22%)
12:58:49:WU01:FS00:0xa4:Completed 18400 out of 80000 steps (23%)
13:00:16:WU01:FS00:0xa4:Completed 19200 out of 80000 steps (24%)
13:01:43:WU01:FS00:0xa4:Completed 20000 out of 80000 steps (25%)
13:03:11:WU01:FS00:0xa4:Completed 20800 out of 80000 steps (26%)
13:04:37:WU01:FS00:0xa4:Completed 21600 out of 80000 steps (27%)
13:06:05:WU01:FS00:0xa4:Completed 22400 out of 80000 steps (28%)
13:07:32:WU01:FS00:0xa4:Completed 23200 out of 80000 steps (29%)
13:08:58:WU01:FS00:0xa4:Completed 24000 out of 80000 steps (30%)
13:10:25:WU01:FS00:0xa4:Completed 24800 out of 80000 steps (31%)
13:11:53:WU01:FS00:0xa4:Completed 25600 out of 80000 steps (32%)
13:13:20:WU01:FS00:0xa4:Completed 26400 out of 80000 steps (33%)
13:14:47:WU01:FS00:0xa4:Completed 27200 out of 80000 steps (34%)
13:16:14:WU01:FS00:0xa4:Completed 28000 out of 80000 steps (35%)
13:17:41:WU01:FS00:0xa4:Completed 28800 out of 80000 steps (36%)
13:19:08:WU01:FS00:0xa4:Completed 29600 out of 80000 steps (37%)
13:20:35:WU01:FS00:0xa4:Completed 30400 out of 80000 steps (38%)
13:22:02:WU01:FS00:0xa4:Completed 31200 out of 80000 steps (39%)
******************************* Date: 2016-07-28 *******************************