Computer has stopped computations in the middle of a WU

If you're new to FAH and need help getting started or you have very basic questions, start here.

Moderators: Site Moderators, FAHC Science Team

Post Reply
Konan
Posts: 12
Joined: Thu Mar 05, 2015 5:56 pm

Computer has stopped computations in the middle of a WU

Post by Konan »

I was checking today and I noticed that my team has slowed down. While checking into it I see 4 computers have stopped for one reason or another. I have not checked all of them yet but the first one I have checked has stopped in the middle of a WU and says ready it says it is at 93%. The computer gets rebooted every Monday so was just rebooted 2 days ago and when I check this computer has not turned anything in for 11 days. The computer has been rebooted twice in that period and does not seem to fix the issue. What do I have to do to make it start working again. I have included the log file.

Thanks for your help

Code: Select all

******************************* Date: 2015-03-17 *******************************
21:22:25:WU01:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
21:24:36:WU01:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
21:26:46:WU01:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
21:28:56:WU01:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
21:31:05:WU01:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
21:33:15:WU01:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
21:35:24:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
21:35:25:WU00:FS00:Connecting to 171.67.108.200:8080
21:35:25:WU00:FS00:Assigned to work server 171.64.65.124
21:35:25:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.64.65.124
21:35:25:WU00:FS00:Connecting to 171.64.65.124:8080
21:35:26:WU00:FS00:Downloading 902.55KiB
21:35:27:WU00:FS00:Download complete
21:35:27:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9014 run:172 clone:1 gen:208 core:0xa4 unit:0x000000f7664f2de453e5580f5cf3a361
21:37:34:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
21:37:35:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
21:37:45:WU01:FS00:0xa4:
21:37:45:WU01:FS00:0xa4:Finished Work Unit:
21:37:45:WU01:FS00:0xa4:- Reading up to 916296 from "01/wudata_01.trr": Read 916296
21:37:45:WU01:FS00:0xa4:trr file hash check passed.
21:37:45:WU01:FS00:0xa4:- Reading up to 839924 from "01/wudata_01.xtc": Read 839924
21:37:45:WU01:FS00:0xa4:xtc file hash check passed.
21:37:45:WU01:FS00:0xa4:edr file hash check passed.
21:37:45:WU01:FS00:0xa4:logfile size: 23296
21:37:45:WU01:FS00:0xa4:Leaving Run
21:37:46:WU01:FS00:0xa4:- Writing 1782004 bytes of core data to disk...
21:37:46:WU01:FS00:0xa4:Done: 1781492 -> 1722217 (compressed to 96.6 percent)
21:37:46:WU01:FS00:0xa4:  ... Done.
21:37:46:WU01:FS00:0xa4:- Shutting down core
21:37:46:WU01:FS00:0xa4:
21:37:46:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
21:37:47:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
21:37:47:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9015 run:762 clone:2 gen:95 core:0xa4 unit:0x00000077664f2de453e920b16ecc9e2c
21:37:47:WU01:FS00:Uploading 1.64MiB to 171.64.65.124
21:37:47:WU01:FS00:Connecting to 171.64.65.124:8080
21:37:47:WU00:FS00:Starting
21:37:47:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
21:37:47:WU00:FS00:Started FahCore on PID 7404
21:37:47:WU00:FS00:Core PID:8928
21:37:47:WU00:FS00:FahCore 0xa4 started
21:37:47:WU00:FS00:0xa4:
21:37:47:WU00:FS00:0xa4:*------------------------------*
21:37:47:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
21:37:47:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
21:37:47:WU00:FS00:0xa4:
21:37:47:WU00:FS00:0xa4:Preparing to commence simulation
21:37:47:WU00:FS00:0xa4:- Looking at optimizations...
21:37:47:WU00:FS00:0xa4:- Created dyn
21:37:47:WU00:FS00:0xa4:- Files status OK
21:37:47:WU00:FS00:0xa4:- Expanded 923697 -> 1534204 (decompressed 166.0 percent)
21:37:47:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=923697 data_size=1534204, decompressed_data_size=1534204 diff=0
21:37:47:WU00:FS00:0xa4:- Digital signature verified
21:37:47:WU00:FS00:0xa4:
21:37:47:WU00:FS00:0xa4:Project: 9014 (Run 172, Clone 1, Gen 208)
21:37:47:WU00:FS00:0xa4:
21:37:47:WU00:FS00:0xa4:Assembly optimizations on if available.
21:37:47:WU00:FS00:0xa4:Entering M.D.
21:37:53:WU01:FS00:Upload 72.28%
21:37:53:WU00:FS00:0xa4:Mapping NT from 3 to 3 
21:37:53:WU00:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
21:37:56:WU01:FS00:Upload complete
21:37:56:WU01:FS00:Server responded WORK_ACK (400)
21:37:56:WU01:FS00:Final credit estimate, 1438.00 points
21:37:56:WU01:FS00:Cleaning up
21:40:07:WU00:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
23:17:10:WU00:FS00:0xa4:Completed 112500 out of 250000 steps  (45%)
23:19:22:WU00:FS00:0xa4:Completed
115000 out of 250000 steps  (46%)
23:21:35:WU00:FS00:0xa4:Completed 117500 out of 250000 steps  (47%)
01:16:09:WU00:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
01:16:10:WU01:FS00:Connecting to 171.67.108.200:8080
01:16:11:WU01:FS00:Assigned to work server 171.64.65.124
01:16:11:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.64.65.124
01:16:11:WU01:FS00:Connecting to 171.64.65.124:8080
01:16:11:WU01:FS00:Downloading 807.32KiB
01:16:13:WU01:FS00:Download complete
01:16:13:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9016 run:231 clone:5 gen:129 core:0xa4 unit:0x0000008f664f2de45491d7c69f3cd034
01:18:22:WU00:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
01:18:22:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
01:18:32:WU00:FS00:0xa4:
01:18:32:WU00:FS00:0xa4:Finished Work Unit:
01:18:32:WU00:FS00:0xa4:- Reading up to 915792 from "00/wudata_01.trr": Read 915792
01:18:32:WU00:FS00:0xa4:trr file hash check passed.
01:18:32:WU00:FS00:0xa4:- Reading up to 838620 from "00/wudata_01.xtc": Read 838620
01:18:32:WU00:FS00:0xa4:xtc file hash check passed.
01:18:32:WU00:FS00:0xa4:edr file hash check passed.
01:18:32:WU00:FS00:0xa4:logfile size: 23292
01:18:32:WU00:FS00:0xa4:Leaving Run
01:18:33:WU00:FS00:0xa4:- Writing 1780192 bytes of core data to disk...
01:18:33:WU00:FS00:0xa4:Done: 1779680 -> 1720636 (compressed to 96.6 percent)
01:18:33:WU00:FS00:0xa4:  ... Done.
01:18:33:WU00:FS00:0xa4:- Shutting down core
01:18:33:WU00:FS00:0xa4:
01:18:33:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
01:18:34:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
01:18:34:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:9014 run:172 clone:1 gen:208 core:0xa4 unit:0x000000f7664f2de453e5580f5cf3a361
01:18:34:WU00:FS00:Uploading 1.64MiB to 171.64.65.124
01:18:34:WU01:FS00:Starting
01:18:34:WU00:FS00:Connecting to 171.64.65.124:8080
01:18:34:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
01:18:34:WU01:FS00:Started FahCore on PID 5320
01:18:34:WU01:FS00:Core PID:1904
01:18:34:WU01:FS00:FahCore 0xa4 started
01:18:34:WU01:FS00:0xa4:
01:18:34:WU01:FS00:0xa4:*------------------------------*
01:18:34:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
01:18:34:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
01:18:34:WU01:FS00:0xa4:
01:18:34:WU01:FS00:0xa4:Preparing to commence simulation
01:18:34:WU01:FS00:0xa4:- Looking at optimizations...
01:18:34:WU01:FS00:0xa4:- Created dyn
01:18:34:WU01:FS00:0xa4:- Files status OK
01:18:34:WU01:FS00:0xa4:- Expanded 826179 -> 1397548 (decompressed 169.1 percent)
01:18:34:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826179 data_size=1397548, decompressed_data_size=1397548 diff=0
01:18:34:WU01:FS00:0xa4:- Digital signature verified
01:18:34:WU01:FS00:0xa4:
01:18:34:WU01:FS00:0xa4:Project: 9016 (Run 231, Clone 5, Gen 129)
01:18:34:WU01:FS00:0xa4:
01:18:34:WU01:FS00:0xa4:Assembly optimizations on if available.
01:18:34:WU01:FS00:0xa4:Entering M.D.
01:18:40:WU00:FS00:Upload 68.54%
01:18:40:WU01:FS00:0xa4:Mapping NT from 3 to 3 
01:18:40:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
01:18:43:WU00:FS00:Upload complete
01:18:44:WU00:FS00:Server responded WORK_ACK (400)
01:18:44:WU00:FS00:Final credit estimate, 1426.00 points
01:18:44:WU00:FS00:Cleaning up
01:20:43:WU01:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
03:20:58:WU01:FS00:0xa4:Completed 150000 out of 250000 steps  (60%)
******************************* Date: 2015-03-18 *******************************
03:23:00:WU01:FS00:0xa4:Completed 152500 out of 250000 steps  (61%)
04:40:27:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
04:40:28:WU00:FS00:Connecting to 171.67.108.200:8080
04:40:28:WU00:FS00:Assigned to work server 155.247.166.219
04:40:28:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 155.247.166.219
04:40:28:WU00:FS00:Connecting to 155.247.166.219:8080
04:40:29:WU00:FS00:Downloading 117.01KiB
04:40:29:WU00:FS00:Download complete
04:40:29:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8600 run:59 clone:8 gen:75 core:0xa4 unit:0x0000005c0002894b5462cd94be6ab318
04:42:30:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
04:42:30:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
04:42:40:WU01:FS00:0xa4:
04:42:40:WU01:FS00:0xa4:Finished Work Unit:
04:42:40:WU01:FS00:0xa4:- Reading up to 811488 from "01/wudata_01.trr": Read 811488
04:42:40:WU01:FS00:0xa4:trr file hash check passed.
04:42:40:WU01:FS00:0xa4:- Reading up to 746036 from "01/wudata_01.xtc": Read 746036
04:42:40:WU01:FS00:0xa4:xtc file hash check passed.
04:42:40:WU01:FS00:0xa4:edr file hash check passed.
04:42:40:WU01:FS00:0xa4:logfile size: 23236
04:42:40:WU01:FS00:0xa4:Leaving Run
04:42:43:WU01:FS00:0xa4:- Writing 1583248 bytes of core data to disk...
04:42:43:WU01:FS00:0xa4:Done: 1582736 -> 1537758 (compressed to 97.1 percent)
04:42:43:WU01:FS00:0xa4:  ... Done.
04:42:43:WU01:FS00:0xa4:- Shutting down core
04:42:43:WU01:FS00:0xa4:
04:42:43:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
04:42:43:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
04:42:43:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9016 run:231 clone:5 gen:129 core:0xa4 unit:0x0000008f664f2de45491d7c69f3cd034
04:42:43:WU01:FS00:Uploading 1.47MiB to 171.64.65.124
04:42:43:WU01:FS00:Connecting to 171.64.65.124:8080
04:42:43:WU00:FS00:Starting
04:42:43:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
04:42:43:WU00:FS00:Started FahCore on PID 7948
04:42:43:WU00:FS00:Core PID:6904
04:42:43:WU00:FS00:FahCore 0xa4 started
04:42:44:WU00:FS00:0xa4:
04:42:44:WU00:FS00:0xa4:*------------------------------*
04:42:44:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
04:42:44:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
04:42:44:WU00:FS00:0xa4:
04:42:44:WU00:FS00:0xa4:Preparing to commence simulation
04:42:44:WU00:FS00:0xa4:- Looking at optimizations...
04:42:44:WU00:FS00:0xa4:- Created dyn
04:42:44:WU00:FS00:0xa4:- Files status OK
04:42:44:WU00:FS00:0xa4:- Expanded 119307 -> 271368 (decompressed 227.4 percent)
04:42:44:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=119307 data_size=271368, decompressed_data_size=271368 diff=0
04:42:44:WU00:FS00:0xa4:- Digital signature verified
04:42:44:WU00:FS00:0xa4:
04:42:44:WU00:FS00:0xa4:Project: 8600 (Run 59, Clone 8, Gen 75)
04:42:44:WU00:FS00:0xa4:
04:42:44:WU00:FS00:0xa4:Assembly optimizations on if available.
04:42:44:WU00:FS00:0xa4:Entering M.D.
04:42:49:WU01:FS00:Upload 72.43%
04:42:49:WU00:FS00:0xa4:Mapping NT from 3 to 3 
04:42:49:WU00:FS00:0xa4:Completed 0 out of 5000000 steps  (0%)
04:42:51:WU01:FS00:Upload complete
04:42:52:WU01:FS00:Server responded WORK_ACK (400)
04:42:52:WU01:FS00:Final credit estimate, 1364.00 points
04:42:52:WU01:FS00:Cleaning up
04:45:37:WU00:FS00:0xa4:Completed 50000 out of 5000000 steps  (1%)
09:20:46:WU00:FS00:0xa4:Completed 4950000 out of 5000000 steps  (99%)
09:20:46:WU01:FS00:Connecting to 171.67.108.200:8080
09:20:46:WU01:FS00:Assigned to work server 171.64.65.124
09:20:46:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.64.65.124
09:20:46:WU01:FS00:Connecting to 171.64.65.124:8080
09:20:47:WU01:FS00:Downloading 860.90KiB
09:20:49:WU01:FS00:Download complete
09:20:49:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9008 run:955 clone:0 gen:234 core:0xa4 unit:0x00000111664f2de453826f480c1fa2c5
******************************* Date: 2015-03-18 *******************************
09:23:34:WU00:FS00:0xa4:Completed 5000000 out of 5000000 steps  (100%)
09:23:34:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
09:23:44:WU00:FS00:0xa4:
09:23:44:WU00:FS00:0xa4:Finished Work Unit:
09:23:44:WU00:FS00:0xa4:- Reading up to 1255848 from "00/wudata_01.trr": Read 1255848
09:23:44:WU00:FS00:0xa4:trr file hash check passed.
09:23:44:WU00:FS00:0xa4:- Reading up to 111300 from "00/wudata_01.xtc": Read 111300
09:23:44:WU00:FS00:0xa4:xtc file hash check passed.
09:23:44:WU00:FS00:0xa4:edr file hash check passed.
09:23:44:WU00:FS00:0xa4:logfile size: 87181
09:23:44:WU00:FS00:0xa4:Leaving Run
09:23:47:WU00:FS00:0xa4:- Writing 1526229 bytes of core data to disk...
09:23:48:WU00:FS00:0xa4:Done: 1525717 -> 1292592 (compressed to 84.7 percent)
09:23:48:WU00:FS00:0xa4:  ... Done.
09:23:48:WU00:FS00:0xa4:- Shutting down core
09:23:48:WU00:FS00:0xa4:
09:23:48:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
09:23:48:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:23:48:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:8600 run:59 clone:8 gen:75 core:0xa4 unit:0x0000005c0002894b5462cd94be6ab318
09:23:48:WU00:FS00:Uploading 1.23MiB to 155.247.166.219
09:23:48:WU01:FS00:Starting
09:23:48:WU00:FS00:Connecting to 155.247.166.219:8080
09:23:48:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
09:23:48:WU01:FS00:Started FahCore on PID 12172
09:23:48:WU01:FS00:Core PID:6024
09:23:48:WU01:FS00:FahCore 0xa4 started
09:23:49:WU01:FS00:0xa4:
09:23:49:WU01:FS00:0xa4:*------------------------------*
09:23:49:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
09:23:49:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
09:23:49:WU01:FS00:0xa4:
09:23:49:WU01:FS00:0xa4:Preparing to commence simulation
09:23:49:WU01:FS00:0xa4:- Looking at optimizations...
09:23:49:WU01:FS00:0xa4:- Created dyn
09:23:49:WU01:FS00:0xa4:- Files status OK
09:23:49:WU01:FS00:0xa4:- Expanded 881049 -> 1463992 (decompressed 166.1 percent)
09:23:49:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=881049 data_size=1463992, decompressed_data_size=1463992 diff=0
09:23:49:WU01:FS00:0xa4:- Digital signature verified
09:23:49:WU01:FS00:0xa4:
09:23:49:WU01:FS00:0xa4:Project: 9008 (Run 955, Clone 0, Gen 234)
09:23:49:WU01:FS00:0xa4:
09:23:49:WU01:FS00:0xa4:Assembly optimizations on if available.
09:23:49:WU01:FS00:0xa4:Entering M.D.
09:23:53:WU00:FS00:Upload complete
09:23:53:WU00:FS00:Server responded WORK_ACK (400)
09:23:53:WU00:FS00:Final credit estimate, 1811.00 points
09:23:53:WU00:FS00:Cleaning up
09:23:54:WU01:FS00:0xa4:Mapping NT from 3 to 3 
09:23:54:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
11:58:45:WU01:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
12:00:07:WU00:FS01:Connecting to 171.67.108.200:80
12:00:08:WU00:FS01:Assigned to work server 140.163.4.235
12:00:08:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GF119 [GeForce GT 610] from 140.163.4.235
12:00:08:WU00:FS01:Connecting to 140.163.4.235:8080
12:00:08:WU00:FS01:Downloading 3.78MiB
12:00:13:WU00:FS01:Download complete
12:00:13:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:10485 run:1 clone:24 gen:8 core:0x18 unit:0x0000000d538b3dbb54aeba73d4c5bbe4
12:00:13:WU00:FS01:Starting
12:00:13:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:00:13:WU00:FS01:Started FahCore on PID 6292
12:00:13:WU00:FS01:Core PID:11060
12:00:13:WU00:FS01:FahCore 0x18 started
12:00:14:WU00:FS01:0x18:*********************** Log Started 2015-03-18T12:00:13Z ***********************
12:00:14:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
12:00:14:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
12:00:14:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
12:00:14:WU00:FS01:0x18:Machine: 1
12:00:14:WU00:FS01:0x18:Reading tar file state.xml
12:00:14:WU00:FS01:0x18:Reading tar file system.xml
12:00:14:WU00:FS01:0x18:Reading tar file integrator.xml
12:00:14:WU00:FS01:0x18:Reading tar file core.xml
12:00:14:WU00:FS01:0x18:Digital signatures verified
12:00:14:WU00:FS01:0x18:Folding@home GPU core18
12:00:14:WU00:FS01:0x18:Version 0.0.3
12:00:34:Saving configuration to config.xml
12:00:34:<config>
12:00:34:  <!-- Folding Slot Configuration -->
12:00:34:  <cause v='CANCER'/>
12:00:34:
12:00:34:  <!-- Network -->
12:00:34:  <proxy v=':8080'/>
12:00:34:
12:00:34:  <!-- Slot Control -->
12:00:34:  <power v='full'/>
12:00:34:
12:00:34:  <!-- User Information -->
12:00:34:  <passkey v='********************************'/>
12:00:34:  <team v='227768'/>
12:00:34:  <user v='Engineer_Cruncher'/>
12:00:34:
12:00:34:  <!-- Folding Slots -->
12:00:34:  <slot id='0' type='CPU'/>
12:00:34:  <slot id='1' type='GPU'/>
12:00:34:</config>
12:00:46:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
12:00:46:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
12:00:55:WU01:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
12:03:05:WU01:FS00:0xa4:Completed 187500 out of 250000 steps  (75%)
12:05:15:WU01:FS00:0xa4:Completed 190000 out of 250000 steps  (76%)
12:07:24:WU01:FS00:0xa4:Completed 192500 out of 250000 steps  (77%)
12:09:33:WU01:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
12:11:29:FS01:Shutting core down
12:11:30:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 11060
12:11:30:WU00:FS01:0x18:Exiting, please wait. . .
12:11:31:WU00:FS01:0x18:Lost lifeline PID 6292, exiting
12:11:31:WU00:FS01:0x18:ERROR:103: Lost client lifeline
12:11:31:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
12:11:31:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
12:11:44:WU01:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
12:11:45:Saving configuration to config.xml
12:11:45:<config>
12:11:45:  <!-- Folding Slot Configuration -->
12:11:45:  <cause v='CANCER'/>
12:11:45:
12:11:45:  <!-- Network -->
12:11:45:  <proxy v=':8080'/>
12:11:45:
12:11:45:  <!-- Slot Control -->
12:11:45:  <power v='full'/>
12:11:45:
12:11:45:  <!-- User Information -->
12:11:45:  <passkey v='********************************'/>
12:11:45:  <team v='227768'/>
12:11:45:  <user v='Engineer_Cruncher'/>
12:11:45:
12:11:45:  <!-- Folding Slots -->
12:11:45:  <slot id='0' type='CPU'/>
12:11:45:  <slot id='1' type='GPU'>
12:11:45:    <idle v='true'/>
12:11:45:  </slot>
12:11:45:</config>
12:13:52:WU01:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
12:16:03:WU01:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
12:18:10:WU01:FS00:0xa4:Completed 205000 out of 250000 steps  (82%)
12:20:17:WU01:FS00:0xa4:Completed 207500 out of 250000 steps  (83%)
12:22:24:WU01:FS00:0xa4:Completed 210000 out of 250000 steps  (84%)
12:24:32:WU01:FS00:0xa4:Completed 212500 out of 250000 steps  (85%)
12:26:40:WU01:FS00:0xa4:Completed 215000 out of 250000 steps  (86%)
12:28:49:WU01:FS00:0xa4:Completed 217500 out of 250000 steps  (87%)
12:30:58:WU01:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
12:33:06:WU01:FS00:0xa4:Completed 222500 out of 250000 steps  (89%)
12:35:12:WU01:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
12:37:19:WU01:FS00:0xa4:Completed 227500 out of 250000 steps  (91%)
12:39:26:WU01:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
12:41:33:WU01:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
12:43:39:WU01:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
12:45:46:WU01:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
12:46:27:WU00:FS01:Starting
12:46:27:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:46:27:WU00:FS01:Started FahCore on PID 5956
12:46:27:WU00:FS01:Core PID:7420
12:46:27:WU00:FS01:FahCore 0x18 started
12:46:27:WU00:FS01:0x18:*********************** Log Started 2015-03-18T12:46:27Z ***********************
12:46:27:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
12:46:27:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
12:46:27:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
12:46:27:WU00:FS01:0x18:Machine: 1
12:46:27:WU00:FS01:0x18:Digital signatures verified
12:46:27:WU00:FS01:0x18:Folding@home GPU core18
12:46:27:WU00:FS01:0x18:Version 0.0.3
12:46:52:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
12:46:52:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
12:47:42:FS01:Shutting core down
12:47:42:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 7420
12:47:42:WU00:FS01:0x18:Exiting, please wait. . .
12:47:51:WU00:FS01:0x18:Lost lifeline PID 5956, exiting
12:47:51:WU00:FS01:0x18:ERROR:103: Lost client lifeline
12:47:51:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
12:47:51:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
12:47:56:WU01:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
12:50:05:WU01:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
12:52:13:WU01:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
12:54:20:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
12:54:20:WU02:FS00:Connecting to 171.67.108.200:8080
12:54:21:WU02:FS00:Assigned to work server 155.247.166.219
12:54:21:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 155.247.166.219
12:54:21:WU02:FS00:Connecting to 155.247.166.219:8080
12:54:21:WU02:FS00:Downloading 116.43KiB
12:54:21:WU02:FS00:Download complete
12:54:21:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:6397 run:108 clone:0 gen:76 core:0xa4 unit:0x0000005b0002894b5462ca395873000d
12:56:26:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
12:56:27:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
12:56:37:WU01:FS00:0xa4:
12:56:37:WU01:FS00:0xa4:Finished Work Unit:
12:56:37:WU01:FS00:0xa4:- Reading up to 871872 from "01/wudata_01.trr": Read 871872
12:56:37:WU01:FS00:0xa4:trr file hash check passed.
12:56:37:WU01:FS00:0xa4:- Reading up to 799816 from "01/wudata_01.xtc": Read 799816
12:56:37:WU01:FS00:0xa4:xtc file hash check passed.
12:56:37:WU01:FS00:0xa4:edr file hash check passed.
12:56:37:WU01:FS00:0xa4:logfile size: 23457
12:56:37:WU01:FS00:0xa4:Leaving Run
12:56:38:WU01:FS00:0xa4:- Writing 1697633 bytes of core data to disk...
12:56:39:WU01:FS00:0xa4:Done: 1697121 -> 1645323 (compressed to 96.9 percent)
12:56:39:WU01:FS00:0xa4:  ... Done.
12:56:39:WU01:FS00:0xa4:- Shutting down core
12:56:39:WU01:FS00:0xa4:
12:56:39:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
12:56:39:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
12:56:39:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9008 run:955 clone:0 gen:234 core:0xa4 unit:0x00000111664f2de453826f480c1fa2c5
12:56:39:WU01:FS00:Uploading 1.57MiB to 171.64.65.124
12:56:39:WU01:FS00:Connecting to 171.64.65.124:8080
12:56:39:WU02:FS00:Starting
12:56:39:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
12:56:39:WU02:FS00:Started FahCore on PID 12208
12:56:39:WU02:FS00:Core PID:4976
12:56:39:WU02:FS00:FahCore 0xa4 started
12:56:40:WU02:FS00:0xa4:
12:56:40:WU02:FS00:0xa4:*------------------------------*
12:56:40:WU02:FS00:0xa4:Folding@Home Gromacs GB Core
12:56:40:WU02:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
12:56:40:WU02:FS00:0xa4:
12:56:40:WU02:FS00:0xa4:Preparing to commence simulation
12:56:40:WU02:FS00:0xa4:- Looking at optimizations...
12:56:40:WU02:FS00:0xa4:- Created dyn
12:56:40:WU02:FS00:0xa4:- Files status OK
12:56:40:WU02:FS00:0xa4:- Expanded 118712 -> 268860 (decompressed 226.4 percent)
12:56:40:WU02:FS00:0xa4:Called DecompressByteArray: compressed_data_size=118712 data_size=268860, decompressed_data_size=268860 diff=0
12:56:40:WU02:FS00:0xa4:- Digital signature verified
12:56:40:WU02:FS00:0xa4:
12:56:40:WU02:FS00:0xa4:Project: 6397 (Run 108, Clone 0, Gen 76)
12:56:40:WU02:FS00:0xa4:
12:56:40:WU02:FS00:0xa4:Assembly optimizations on if available.
12:56:40:WU02:FS00:0xa4:Entering M.D.
12:56:45:WU01:FS00:Upload 71.67%
12:56:45:WU02:FS00:0xa4:Mapping NT from 3 to 3 
12:56:45:WU02:FS00:0xa4:Completed 0 out of 5000000 steps  (0%)
12:56:47:WU01:FS00:Upload complete
12:56:48:WU01:FS00:Server responded WORK_ACK (400)
12:56:48:WU01:FS00:Final credit estimate, 1390.00 points
12:56:48:WU01:FS00:Cleaning up
12:59:34:WU02:FS00:0xa4:Completed 50000 out of 5000000 steps  (1%)
15:06:15:WU02:FS00:0xa4:Completed 2250000 out of 5000000 steps  (45%)
15:07:58:WU00:FS01:Starting
15:07:58:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
15:07:58:WU00:FS01:Started FahCore on PID 12264
15:07:58:WU00:FS01:Core PID:7632
15:07:58:WU00:FS01:FahCore 0x18 started
15:07:59:WU00:FS01:0x18:*********************** Log Started 2015-03-18T15:07:58Z ***********************
15:07:59:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
15:07:59:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
15:07:59:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
15:07:59:WU00:FS01:0x18:Machine: 1
15:07:59:WU00:FS01:0x18:Digital signatures verified
15:07:59:WU00:FS01:0x18:Folding@home GPU core18
15:07:59:WU00:FS01:0x18:Version 0.0.3
15:08:23:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
15:08:23:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:09:07:WU02:FS00:0xa4:Completed 2300000 out of 5000000 steps  (46%)
15:12:05:WU02:FS00:0xa4:Completed 2350000 out of 5000000 steps  (47%)
15:15:02:WU02:FS00:0xa4:Completed 2400000 out of 5000000 steps  (48%)
15:16:03:FS01:Shutting core down
15:16:03:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 7632
15:16:03:WU00:FS01:0x18:Exiting, please wait. . .
15:16:07:WU00:FS01:0x18:Lost lifeline PID 12264, exiting
15:16:07:WU00:FS01:0x18:ERROR:103: Lost client lifeline
15:16:07:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
15:16:08:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
15:17:56:WU02:FS00:0xa4:Completed 2450000 out of 5000000 steps  (49%)
15:20:48:WU02:FS00:0xa4:Completed 2500000 out of 5000000 steps  (50%)
******************************* Date: 2015-03-18 *******************************
15:23:39:WU02:FS00:0xa4:Completed 2550000 out of 5000000 steps  (51%)
15:43:35:WU02:FS00:0xa4:Completed 2900000 out of 5000000 steps  (58%)
15:45:11:WU00:FS01:Starting
15:45:11:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
15:45:11:WU00:FS01:Started FahCore on PID 5124
15:45:11:WU00:FS01:Core PID:4172
15:45:11:WU00:FS01:FahCore 0x18 started
15:45:12:WU00:FS01:0x18:*********************** Log Started 2015-03-18T15:45:11Z ***********************
15:45:12:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
15:45:12:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
15:45:12:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
15:45:12:WU00:FS01:0x18:Machine: 1
15:45:12:WU00:FS01:0x18:Digital signatures verified
15:45:12:WU00:FS01:0x18:Folding@home GPU core18
15:45:12:WU00:FS01:0x18:Version 0.0.3
15:45:36:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
15:45:36:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:46:27:WU02:FS00:0xa4:Completed 2950000 out of 5000000 steps  (59%)
15:49:25:WU02:FS00:0xa4:Completed 3000000 out of 5000000 steps  (60%)
15:51:22:FS01:Shutting core down
15:51:23:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 4172
15:51:23:WU00:FS01:0x18:Exiting, please wait. . .
15:51:31:WU00:FS01:0x18:Lost lifeline PID 5124, exiting
15:51:31:WU00:FS01:0x18:ERROR:103: Lost client lifeline
15:51:31:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
15:51:31:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
15:52:21:WU02:FS00:0xa4:Completed 3050000 out of 5000000 steps  (61%)
16:12:15:WU02:FS00:0xa4:Completed 3400000 out of 5000000 steps  (68%)
16:14:21:WU00:FS01:Starting
16:14:21:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
16:14:21:WU00:FS01:Started FahCore on PID 2940
16:14:21:WU00:FS01:Core PID:4172
16:14:21:WU00:FS01:FahCore 0x18 started
16:14:21:WU00:FS01:0x18:*********************** Log Started 2015-03-18T16:14:21Z ***********************
16:14:21:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
16:14:21:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
16:14:21:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
16:14:21:WU00:FS01:0x18:Machine: 1
16:14:21:WU00:FS01:0x18:Digital signatures verified
16:14:21:WU00:FS01:0x18:Folding@home GPU core18
16:14:21:WU00:FS01:0x18:Version 0.0.3
16:14:45:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
16:14:45:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
16:15:08:WU02:FS00:0xa4:Completed 3450000 out of 5000000 steps  (69%)
16:18:05:WU02:FS00:0xa4:Completed 3500000 out of 5000000 steps  (70%)
16:21:03:WU02:FS00:0xa4:Completed 3550000 out of 5000000 steps  (71%)
16:23:33:FS01:Shutting core down
16:23:33:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 4172
16:23:33:WU00:FS01:0x18:Exiting, please wait. . .
16:23:38:WU00:FS01:0x18:Lost lifeline PID 2940, exiting
16:23:38:WU00:FS01:0x18:ERROR:103: Lost client lifeline
16:23:38:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
16:23:38:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
16:24:00:WU02:FS00:0xa4:Completed 3600000 out of 5000000 steps  (72%)
16:38:12:WU02:FS00:0xa4:Completed 3850000 out of 5000000 steps  (77%)
16:38:49:WU00:FS01:Starting
16:38:49:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
16:38:49:WU00:FS01:Started FahCore on PID 4316
16:38:49:WU00:FS01:Core PID:7940
16:38:49:WU00:FS01:FahCore 0x18 started
16:38:49:WU00:FS01:0x18:*********************** Log Started 2015-03-18T16:38:49Z ***********************
16:38:49:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
16:38:49:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
16:38:49:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
16:38:49:WU00:FS01:0x18:Machine: 1
16:38:49:WU00:FS01:0x18:Digital signatures verified
16:38:49:WU00:FS01:0x18:Folding@home GPU core18
16:38:49:WU00:FS01:0x18:Version 0.0.3
16:39:14:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
16:39:14:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
16:41:08:WU02:FS00:0xa4:Completed 3900000 out of 5000000 steps  (78%)
17:43:01:WU02:FS00:0xa4:Completed 4950000 out of 5000000 steps  (99%)
17:43:02:WU01:FS00:Connecting to 171.67.108.200:8080
17:43:02:WU01:FS00:Assigned to work server 171.64.65.124
17:43:02:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.64.65.124
17:43:02:WU01:FS00:Connecting to 171.64.65.124:8080
17:43:03:WU01:FS00:Downloading 808.34KiB
17:43:04:WU01:FS00:Download complete
17:43:05:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9007 run:412 clone:3 gen:231 core:0xa4 unit:0x00000108664f2de4533b3520fdaa8d2d
17:45:59:WU02:FS00:0xa4:Completed 5000000 out of 5000000 steps  (100%)
17:45:59:WU02:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
17:46:09:WU02:FS00:0xa4:
17:46:09:WU02:FS00:0xa4:Finished Work Unit:
17:46:09:WU02:FS00:0xa4:- Reading up to 1254528 from "02/wudata_01.trr": Read 1254528
17:46:09:WU02:FS00:0xa4:trr file hash check passed.
17:46:09:WU02:FS00:0xa4:- Reading up to 109080 from "02/wudata_01.xtc": Read 109080
17:46:09:WU02:FS00:0xa4:xtc file hash check passed.
17:46:09:WU02:FS00:0xa4:edr file hash check passed.
17:46:09:WU02:FS00:0xa4:logfile size: 87248
17:46:09:WU02:FS00:0xa4:Leaving Run
17:46:14:WU02:FS00:0xa4:- Writing 1522756 bytes of core data to disk...
17:46:14:WU02:FS00:0xa4:Done: 1522244 -> 1288567 (compressed to 84.6 percent)
17:46:14:WU02:FS00:0xa4:  ... Done.
17:46:14:WU02:FS00:0xa4:- Shutting down core
17:46:14:WU02:FS00:0xa4:
17:46:14:WU02:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
17:46:14:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
17:46:14:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:6397 run:108 clone:0 gen:76 core:0xa4 unit:0x0000005b0002894b5462ca395873000d
17:46:14:WU02:FS00:Uploading 1.23MiB to 155.247.166.219
17:46:14:WU02:FS00:Connecting to 155.247.166.219:8080
17:46:15:WU01:FS00:Starting
17:46:15:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
17:46:15:WU01:FS00:Started FahCore on PID 10384
17:46:15:WU01:FS00:Core PID:5352
17:46:15:WU01:FS00:FahCore 0xa4 started
17:46:15:WU01:FS00:0xa4:
17:46:15:WU01:FS00:0xa4:*------------------------------*
17:46:15:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
17:46:15:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
17:46:15:WU01:FS00:0xa4:
17:46:15:WU01:FS00:0xa4:Preparing to commence simulation
17:46:15:WU01:FS00:0xa4:- Looking at optimizations...
17:46:15:WU01:FS00:0xa4:- Created dyn
17:46:15:WU01:FS00:0xa4:- Files status OK
17:46:15:WU01:FS00:0xa4:- Expanded 827227 -> 1400900 (decompressed 169.3 percent)
17:46:15:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=827227 data_size=1400900, decompressed_data_size=1400900 diff=0
17:46:15:WU01:FS00:0xa4:- Digital signature verified
17:46:15:WU01:FS00:0xa4:
17:46:15:WU01:FS00:0xa4:Project: 9007 (Run 412, Clone 3, Gen 231)
17:46:15:WU01:FS00:0xa4:
17:46:15:WU01:FS00:0xa4:Assembly optimizations on if available.
17:46:15:WU01:FS00:0xa4:Entering M.D.
17:46:19:WU02:FS00:Upload complete
17:46:19:WU02:FS00:Server responded WORK_ACK (400)
17:46:19:WU02:FS00:Final credit estimate, 1785.00 points
17:46:19:WU02:FS00:Cleaning up
17:46:21:WU01:FS00:0xa4:Mapping NT from 3 to 3 
17:46:21:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
17:48:29:WU01:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
20:56:41:WU01:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
20:58:52:WU01:FS00:0xa4:Completed 222500 out of 250000 steps
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Computer has stopped computations in the middle of a WU

Post by bruce »

You didn't include the first few pages of your log which is important to diagnosing the problem.

For example, I can't see the name that should be credited for the WUs which have been returned, nor did you specify which team you're talking about. It turns out that all of the WUs I've checked seem to have been returned by the same person, but that's not someone called "Konan" so I'd have to guess if it's you or someone else.
Top
Konan
Posts: 12
Joined: Thu Mar 05, 2015 5:56 pm

Re: Computer has stopped computations in the middle of a WU

Post by Konan »

It yelled at me about the log file being 420K characters so I chopped all but the bottom end off and took out all the percentages completed except the first and last one in a group, next time I will make sure to keep the top couple of pages. Team ID is 227768 and the name is Joel for who the key is registered to. I found that one computer it was uninstalled so got that one up and running again. The other two both were just sitting in the ready position one was the log I posted. The other one said the WU was empty and it could not retrieve another. I ended up shutting down the process in the task manager and restarting them and that seemed to work for both computers. Is there another more subtle way to get them to start working again or shall I just restart them like that every time?
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Computer has stopped computations in the middle of a WU

Post by bruce »

Donor Names are not the same as the registrant of the key. You team has 8 Donors, none of which are either Joel or Konan. The required information appears near the top of the log. See the "how to" in the sig of my previous post. Please post the preamble to the log now.

All six of the WUs shown in your log have been credited to someone on your team. What makes you think that nothing has been turned in for 11 days?

Hi ******* (team 227768),
Your WU (P9015 R762 C2 G95) was added to the stats database on 2015-03-17 15:06:33 for 1438.83 points of credit.
Your WU (P9014 R172 C1 G208) was added to the stats database on 2015-03-17 19:06:52 for 1426.35 points of credit.
Your WU (P9016 R231 C5 G129) was added to the stats database on 2015-03-17 22:06:13 for 1364.75 points of credit.
Your WU (P8600 R59 C8 G75) was added to the stats database on 2015-03-18 03:07:24 for 1811.89 points of credit.
Your WU (P9008 R955 C0 G234) was added to the stats database on 2015-03-18 06:06:52 for 1390.89 points of credit.
Your WU (P6397 R108 C0 G76) was added to the stats database on 2015-03-18 11:09:47 for 1785.05 points of credit.
Top
Konan
Posts: 12
Joined: Thu Mar 05, 2015 5:56 pm

Re: Computer has stopped computations in the middle of a WU

Post by Konan »

The donor name was Engineer_Cruncher on team 227768 and the reason I believed that computer did not turn in anything for 11 days. At the time I clicked inside the FAH Control on the team number which opens the browser to the team stats then I clicked on his individual computer. It said that the last turned in WU was 11 days ago. I did get it to restart by shutting down the process and starting it again. Is there a nicer way to get them to start up again when they are just sitting in the ready position doing nothing without shutting down the whole process? I have reposted the log file hopefully it has all the info you are looking for. And the way the log files just stops is exactly how it was.

Code: Select all

*********************** Log Started 2015-03-12T14:56:49Z ***********************
14:56:49:************************* Folding@home Client *************************
14:56:49:      Website: http://folding.stanford.edu/
14:56:49:    Copyright: (c) 2009-2014 Stanford University
14:56:49:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:56:49:         Args: 
14:56:49:       Config: C:/Users/bbillings/AppData/Roaming/FAHClient/config.xml
14:56:49:******************************** Build ********************************
14:56:49:      Version: 7.4.4
14:56:49:         Date: Mar 4 2014
14:56:49:         Time: 20:26:54
14:56:49:      SVN Rev: 4130
14:56:49:       Branch: fah/trunk/client
14:56:49:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
14:56:49:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
14:56:49:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
14:56:49:     Platform: win32 XP
14:56:49:         Bits: 32
14:56:49:         Mode: Release
14:56:49:******************************* System ********************************
14:56:49:          CPU: Intel(R) Core(TM) i5-4570S CPU @ 2.90GHz
14:56:49:       CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
14:56:49:         CPUs: 4
14:56:49:       Memory: 7.95GiB
14:56:49:  Free Memory: 6.78GiB
14:56:49:      Threads: WINDOWS_THREADS
14:56:49:   OS Version: 6.1
14:56:49:  Has Battery: false
14:56:49:   On Battery: false
14:56:49:   UTC Offset: -5
14:56:49:          PID: 4288
14:56:49:          CWD: C:/Users/bbillings/AppData/Roaming/FAHClient
14:56:49:           OS: Windows 7 Professional
14:56:49:      OS Arch: AMD64
14:56:49:         GPUs: 1
14:56:49:        GPU 0: NVIDIA:2 GF119 [GeForce GT 610]
14:56:49:         CUDA: 2.1
14:56:49:  CUDA Driver: 6050
14:56:49:Win32 Service: false
14:56:49:***********************************************************************
14:56:49:<config>
14:56:49:  <!-- Folding Slot Configuration -->
14:56:49:  <cause v='CANCER'/>
14:56:49:
14:56:49:  <!-- Network -->
14:56:49:  <proxy v=':8080'/>
14:56:49:
14:56:49:  <!-- Slot Control -->
14:56:49:  <power v='full'/>
14:56:49:
14:56:49:  <!-- User Information -->
14:56:49:  <passkey v='********************************'/>
14:56:49:  <team v='227768'/>
14:56:49:  <user v='Engineer_Cruncher'/>
14:56:49:
14:56:49:  <!-- Folding Slots -->
14:56:49:  <slot id='0' type='CPU'/>
14:56:49:  <slot id='1' type='GPU'>
14:56:49:    <idle v='true'/>
14:56:49:  </slot>
14:56:49:</config>
14:56:49:Trying to access database...
14:56:49:Successfully acquired database lock
14:56:49:Enabled folding slot 00: READY cpu:3
14:56:49:Enabled folding slot 01: PAUSED gpu:0:GF119 [GeForce GT 610] (waiting for idle)
14:56:49:WU00:FS00:Starting
14:56:49:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
14:56:50:WU00:FS00:Started FahCore on PID 4012
14:56:50:WU00:FS00:Core PID:3388
14:56:50:WU00:FS00:FahCore 0xa4 started
14:56:50:WU00:FS00:0xa4:
14:56:50:WU00:FS00:0xa4:*------------------------------*
14:56:50:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
14:56:50:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
14:56:50:WU00:FS00:0xa4:
14:56:50:WU00:FS00:0xa4:Preparing to commence simulation
14:56:50:WU00:FS00:0xa4:- Ensuring status. Please wait.
14:57:00:WU00:FS00:0xa4:- Looking at optimizations...
14:57:00:WU00:FS00:0xa4:- Working with standard loops on this execution.
14:57:00:WU00:FS00:0xa4:- Previous termination of core was improper.
14:57:00:WU00:FS00:0xa4:- Files status OK
14:57:00:WU00:FS00:0xa4:- Expanded 118871 -> 270156 (decompressed 227.2 percent)
14:57:00:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=118871 data_size=270156, decompressed_data_size=270156 diff=0
14:57:00:WU00:FS00:0xa4:- Digital signature verified
14:57:00:WU00:FS00:0xa4:
14:57:00:WU00:FS00:0xa4:Project: 6394 (Run 142, Clone 5, Gen 58)
14:57:00:WU00:FS00:0xa4:
14:57:00:WU00:FS00:0xa4:Entering M.D.
14:57:06:WU00:FS00:0xa4:Using Gromacs checkpoints
14:57:06:WU00:FS00:0xa4:Mapping NT from 3 to 3 
14:57:06:WU00:FS00:0xa4:Resuming from checkpoint
14:57:06:WU00:FS00:0xa4:Verified 00/wudata_01.log
14:57:06:WU00:FS00:0xa4:Verified 00/wudata_01.trr
14:57:06:WU00:FS00:0xa4:Verified 00/wudata_01.xtc
14:57:06:WU00:FS00:0xa4:Verified 00/wudata_01.edr
13:54:40:WU00:FS01:Server responded WORK_ACK (400)
13:54:40:WU00:FS01:Cleaning up
13:54:40:WU01:FS01:Connecting to 171.67.108.200:80
13:54:40:WU01:FS01:Assigned to work server 140.163.4.235
13:54:40:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GF119 [GeForce GT 610] from 140.163.4.235
13:54:40:WU01:FS01:Connecting to 140.163.4.235:8080
13:54:40:WU01:FS01:Downloading 4.96MiB
13:54:46:WU01:FS01:Download 90.80%
13:54:46:WU01:FS01:Download complete
13:54:46:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:10486 run:0 clone:5 gen:5 core:0x18 unit:0x0000000e538b3dbb54aec8feff9d57df
13:54:46:WU01:FS01:Starting
13:54:46:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 01 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
13:54:46:WU01:FS01:Started FahCore on PID 8932
13:54:46:WU01:FS01:Core PID:11096
13:54:46:WU01:FS01:FahCore 0x18 started
13:54:47:WU01:FS01:0x18:*********************** Log Started 2015-03-17T13:54:46Z ***********************
13:54:47:WU01:FS01:0x18:Project: 10486 (Run 0, Clone 5, Gen 5)
13:54:47:WU01:FS01:0x18:Unit: 0x0000000e538b3dbb54aec8feff9d57df
13:54:47:WU01:FS01:0x18:CPU: 0x00000000000000000000000000000000
13:54:47:WU01:FS01:0x18:Machine: 1
13:54:47:WU01:FS01:0x18:Reading tar file state.xml
13:54:47:WU01:FS01:0x18:Reading tar file system.xml
13:54:48:WU01:FS01:0x18:Reading tar file integrator.xml
13:54:48:WU01:FS01:0x18:Reading tar file core.xml
13:54:48:WU01:FS01:0x18:Digital signatures verified
13:54:48:WU01:FS01:0x18:Folding@home GPU core18
13:54:48:WU01:FS01:0x18:Version 0.0.3
13:54:48:WU01:FS01:0x18:ERROR:exception: Bad platformId size.
13:54:48:WU01:FS01:0x18:Saving result file logfile_01.txt
13:54:48:WU01:FS01:0x18:Saving result file log.txt
13:54:48:WU01:FS01:0x18:Folding@home Core Shutdown: BAD_WORK_UNIT
13:54:48:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:54:48:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:10486 run:0 clone:5 gen:5 core:0x18 unit:0x0000000e538b3dbb54aec8feff9d57df
13:54:48:WU01:FS01:Uploading 1.98KiB to 140.163.4.235
13:54:48:WU01:FS01:Connecting to 140.163.4.235:8080
13:54:48:WU01:FS01:Upload complete
13:54:48:WU01:FS01:Server responded WORK_ACK (400)
13:54:48:WU01:FS01:Cleaning up
13:54:48:WU00:FS01:Connecting to 171.67.108.200:80
13:54:49:WU00:FS01:Assigned to work server 171.64.65.84
13:54:49:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GF119 [GeForce GT 610] from 171.64.65.84
13:54:49:WU00:FS01:Connecting to 171.64.65.84:8080
13:54:49:WU00:FS01:Downloading 3.40MiB
13:54:53:WU00:FS01:Download complete
13:54:53:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9104 run:13 clone:3 gen:49 core:0x18 unit:0x0000003e0a3b1e78546a58a41bc97b4a
13:54:53:WU00:FS01:Starting
13:54:53:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
13:54:53:WU00:FS01:Started FahCore on PID 1524
13:54:53:WU00:FS01:Core PID:7480
13:54:53:WU00:FS01:FahCore 0x18 started
13:54:54:WU00:FS01:0x18:*********************** Log Started 2015-03-17T13:54:53Z ***********************
13:54:54:WU00:FS01:0x18:Project: 9104 (Run 13, Clone 3, Gen 49)
13:54:54:WU00:FS01:0x18:Unit: 0x0000003e0a3b1e78546a58a41bc97b4a
13:54:54:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
13:54:54:WU00:FS01:0x18:Machine: 1
13:54:54:WU00:FS01:0x18:Reading tar file state.xml
13:54:54:WU00:FS01:0x18:Reading tar file system.xml
13:54:54:WU00:FS01:0x18:Reading tar file integrator.xml
13:54:54:WU00:FS01:0x18:Reading tar file core.xml
13:54:54:WU00:FS01:0x18:Digital signatures verified
13:54:54:WU00:FS01:0x18:Folding@home GPU core18
13:54:54:WU00:FS01:0x18:Version 0.0.3
13:54:54:WU00:FS01:0x18:ERROR:exception: Bad platformId size.
13:54:54:WU00:FS01:0x18:Saving result file logfile_01.txt
13:54:54:WU00:FS01:0x18:Saving result file log.txt
13:54:54:WU00:FS01:0x18:Folding@home Core Shutdown: BAD_WORK_UNIT
13:54:55:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:54:55:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:9104 run:13 clone:3 gen:49 core:0x18 unit:0x0000003e0a3b1e78546a58a41bc97b4a
13:54:55:WU00:FS01:Uploading 2.00KiB to 171.64.65.84
13:54:55:WU00:FS01:Connecting to 171.64.65.84:8080
13:54:55:WU00:FS01:Upload complete
13:54:55:WU00:FS01:Server responded WORK_ACK (400)
13:54:55:WU00:FS01:Cleaning up
13:54:55:WU01:FS01:Connecting to 171.67.108.200:80
13:54:55:WU01:FS01:Assigned to work server 171.64.65.92
13:54:55:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GF119 [GeForce GT 610] from 171.64.65.92
13:54:55:WU01:FS01:Connecting to 171.64.65.92:8080
13:54:55:WU01:FS01:Downloading 3.46MiB
13:54:59:WU01:FS01:Download complete
13:54:59:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9110 run:4 clone:1 gen:59 core:0x18 unit:0x0000004f0a3b1e80546a9871318378f9
13:54:59:WU01:FS01:Starting
13:54:59:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 01 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
13:54:59:WU01:FS01:Started FahCore on PID 8864
13:54:59:WU01:FS01:Core PID:4144
13:54:59:WU01:FS01:FahCore 0x18 started
13:55:00:WU01:FS01:0x18:*********************** Log Started 2015-03-17T13:55:00Z ***********************
13:55:00:WU01:FS01:0x18:Project: 9110 (Run 4, Clone 1, Gen 59)
13:55:00:WU01:FS01:0x18:Unit: 0x0000004f0a3b1e80546a9871318378f9
13:55:00:WU01:FS01:0x18:CPU: 0x00000000000000000000000000000000
13:55:00:WU01:FS01:0x18:Machine: 1
13:55:00:WU01:FS01:0x18:Reading tar file state.xml
13:55:00:WU01:FS01:0x18:Reading tar file system.xml
13:55:00:WU01:FS01:0x18:Reading tar file integrator.xml
13:55:00:WU01:FS01:0x18:Reading tar file core.xml
13:55:00:WU01:FS01:0x18:Digital signatures verified
13:55:00:WU01:FS01:0x18:Folding@home GPU core18
13:55:00:WU01:FS01:0x18:Version 0.0.3
13:55:01:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:55:01:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9110 run:4 clone:1 gen:59 core:0x18 unit:0x0000004f0a3b1e80546a9871318378f9
13:55:01:WU01:FS01:Uploading 1.99KiB to 171.64.65.92
13:55:01:WU01:FS01:Connecting to 171.64.65.92:8080
13:55:01:WU01:FS01:Upload complete
13:55:01:WU01:FS01:Server responded WORK_ACK (400)
13:55:01:WU01:FS01:Cleaning up
13:56:42:WU02:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
14:15:12:WU02:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
14:15:13:WU00:FS00:Connecting to 171.67.108.200:8080
14:15:13:WU00:FS00:Assigned to work server 171.64.65.124
14:15:13:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.64.65.124
14:15:13:WU00:FS00:Connecting to 171.64.65.124:8080
14:15:14:WU00:FS00:Downloading 902.21KiB
14:15:15:WU00:FS00:Download complete
14:15:15:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9015 run:583 clone:0 gen:176 core:0xa4 unit:0x000000cf664f2de453e91f82338bc3f1
14:17:15:WU02:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
14:17:15:WU02:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
14:17:25:WU02:FS00:0xa4:
14:17:25:WU02:FS00:0xa4:Finished Work Unit:
14:17:25:WU02:FS00:0xa4:- Reading up to 811488 from "02/wudata_01.trr": Read 811488
14:17:25:WU02:FS00:0xa4:trr file hash check passed.
14:17:25:WU02:FS00:0xa4:- Reading up to 746228 from "02/wudata_01.xtc": Read 746228
14:17:25:WU02:FS00:0xa4:xtc file hash check passed.
14:17:25:WU02:FS00:0xa4:edr file hash check passed.
14:17:25:WU02:FS00:0xa4:logfile size: 23229
14:17:25:WU02:FS00:0xa4:Leaving Run
14:17:28:WU02:FS00:0xa4:- Writing 1583433 bytes of core data to disk...
14:17:29:WU02:FS00:0xa4:Done: 1582921 -> 1538234 (compressed to 97.1 percent)
14:17:29:WU02:FS00:0xa4:  ... Done.
14:17:29:WU02:FS00:0xa4:- Shutting down core
14:17:29:WU02:FS00:0xa4:
14:17:29:WU02:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
14:17:29:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
14:17:29:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:9016 run:157 clone:2 gen:97 core:0xa4 unit:0x00000074664f2de45491d70b1b5cc804
14:17:29:WU02:FS00:Uploading 1.47MiB to 171.64.65.124
14:17:29:WU00:FS00:Starting
14:17:29:WU02:FS00:Connecting to 171.64.65.124:8080
14:17:29:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
14:17:29:WU00:FS00:Started FahCore on PID 11220
14:17:29:WU00:FS00:Core PID:3208
14:17:29:WU00:FS00:FahCore 0xa4 started
14:17:30:WU00:FS00:0xa4:
14:17:30:WU00:FS00:0xa4:*------------------------------*
14:17:30:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
14:17:30:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
14:17:30:WU00:FS00:0xa4:
14:17:30:WU00:FS00:0xa4:Preparing to commence simulation
14:17:30:WU00:FS00:0xa4:- Looking at optimizations...
14:17:30:WU00:FS00:0xa4:- Created dyn
14:17:30:WU00:FS00:0xa4:- Files status OK
14:17:30:WU00:FS00:0xa4:- Expanded 923350 -> 1526808 (decompressed 165.3 percent)
14:17:30:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=923350 data_size=1526808, decompressed_data_size=1526808 diff=0
14:17:30:WU00:FS00:0xa4:- Digital signature verified
14:17:30:WU00:FS00:0xa4:
14:17:30:WU00:FS00:0xa4:Project: 9015 (Run 583, Clone 0, Gen 176)
14:17:30:WU00:FS00:0xa4:
14:17:30:WU00:FS00:0xa4:Assembly optimizations on if available.
14:17:30:WU00:FS00:0xa4:Entering M.D.
14:17:35:WU02:FS00:Upload 76.66%
14:17:36:WU00:FS00:0xa4:Mapping NT from 3 to 3 
14:17:36:WU00:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
14:17:38:WU02:FS00:Upload complete
14:17:38:WU02:FS00:Server responded WORK_ACK (400)
14:17:38:WU02:FS00:Final credit estimate, 1350.00 points
14:17:38:WU02:FS00:Cleaning up
14:19:50:WU00:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
******************************* Date: 2015-03-17 *******************************
17:58:30:WU00:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
17:58:31:WU01:FS00:Connecting to 171.67.108.200:8080
17:58:31:WU01:FS00:Assigned to work server 171.64.65.124
17:58:31:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.64.65.124
17:58:31:WU01:FS00:Connecting to 171.64.65.124:8080
17:58:32:WU01:FS00:Downloading 901.86KiB
17:58:33:WU01:FS00:Download complete
17:58:33:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9015 run:762 clone:2 gen:95 core:0xa4 unit:0x00000077664f2de453e920b16ecc9e2c
18:00:43:WU00:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
18:00:44:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
18:00:54:WU00:FS00:0xa4:
18:00:54:WU00:FS00:0xa4:Finished Work Unit:
18:00:54:WU00:FS00:0xa4:- Reading up to 916296 from "00/wudata_01.trr": Read 916296
18:00:54:WU00:FS00:0xa4:trr file hash check passed.
18:00:54:WU00:FS00:0xa4:- Reading up to 839840 from "00/wudata_01.xtc": Read 839840
18:00:54:WU00:FS00:0xa4:xtc file hash check passed.
18:00:54:WU00:FS00:0xa4:edr file hash check passed.
18:00:54:WU00:FS00:0xa4:logfile size: 23289
18:00:54:WU00:FS00:0xa4:Leaving Run
18:00:55:WU00:FS00:0xa4:- Writing 1781913 bytes of core data to disk...
18:00:56:WU00:FS00:0xa4:Done: 1781401 -> 1722402 (compressed to 96.6 percent)
18:00:56:WU00:FS00:0xa4:  ... Done.
18:00:56:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
18:00:56:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:9015 run:583 clone:0 gen:176 core:0xa4 unit:0x000000cf664f2de453e91f82338bc3f1
18:00:56:WU00:FS00:Uploading 1.64MiB to 171.64.65.124
18:00:56:WU00:FS00:Connecting to 171.64.65.124:8080
18:00:56:WU01:FS00:Starting
18:00:56:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
18:00:56:WU01:FS00:Started FahCore on PID 10912
18:00:56:WU01:FS00:Core PID:7204
18:00:56:WU01:FS00:FahCore 0xa4 started
18:00:57:WU01:FS00:0xa4:
18:00:57:WU01:FS00:0xa4:*------------------------------*
18:00:57:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
18:00:57:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
18:00:57:WU01:FS00:0xa4:
18:00:57:WU01:FS00:0xa4:Preparing to commence simulation
18:00:57:WU01:FS00:0xa4:- Looking at optimizations...
18:00:57:WU01:FS00:0xa4:- Created dyn
18:00:57:WU01:FS00:0xa4:- Files status OK
18:00:57:WU01:FS00:0xa4:- Expanded 922991 -> 1526808 (decompressed 165.4 percent)
18:00:57:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=922991 data_size=1526808, decompressed_data_size=1526808 diff=0
18:00:57:WU01:FS00:0xa4:- Digital signature verified
18:00:57:WU01:FS00:0xa4:
18:00:57:WU01:FS00:0xa4:Project: 9015 (Run 762, Clone 2, Gen 95)
18:00:57:WU01:FS00:0xa4:
18:00:57:WU01:FS00:0xa4:Assembly optimizations on if available.
18:00:57:WU01:FS00:0xa4:Entering M.D.
18:01:02:WU00:FS00:Upload 72.27%
18:01:02:WU01:FS00:0xa4:Mapping NT from 3 to 3 
18:01:03:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
18:01:05:WU00:FS00:Upload complete
18:01:05:WU00:FS00:Server responded WORK_ACK (400)
18:01:05:WU00:FS00:Final credit estimate, 1418.00 points
18:01:05:WU00:FS00:Cleaning up
18:03:12:WU01:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
******************************* Date: 2015-03-17 *******************************
21:35:24:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
21:35:25:WU00:FS00:Connecting to 171.67.108.200:8080
21:35:25:WU00:FS00:Assigned to work server 171.64.65.124
21:35:25:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.64.65.124
21:35:25:WU00:FS00:Connecting to 171.64.65.124:8080
21:35:26:WU00:FS00:Downloading 902.55KiB
21:35:27:WU00:FS00:Download complete
21:35:27:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9014 run:172 clone:1 gen:208 core:0xa4 unit:0x000000f7664f2de453e5580f5cf3a361
21:37:34:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
21:37:35:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
21:37:45:WU01:FS00:0xa4:
21:37:45:WU01:FS00:0xa4:Finished Work Unit:
21:37:45:WU01:FS00:0xa4:- Reading up to 916296 from "01/wudata_01.trr": Read 916296
21:37:45:WU01:FS00:0xa4:trr file hash check passed.
21:37:45:WU01:FS00:0xa4:- Reading up to 839924 from "01/wudata_01.xtc": Read 839924
21:37:45:WU01:FS00:0xa4:xtc file hash check passed.
21:37:45:WU01:FS00:0xa4:edr file hash check passed.
21:37:45:WU01:FS00:0xa4:logfile size: 23296
21:37:45:WU01:FS00:0xa4:Leaving Run
21:37:46:WU01:FS00:0xa4:- Writing 1782004 bytes of core data to disk...
21:37:46:WU01:FS00:0xa4:Done: 1781492 -> 1722217 (compressed to 96.6 percent)
21:37:46:WU01:FS00:0xa4:  ... Done.
21:37:46:WU01:FS00:0xa4:- Shutting down core
21:37:46:WU01:FS00:0xa4:
21:37:46:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
21:37:47:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
21:37:47:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9015 run:762 clone:2 gen:95 core:0xa4 unit:0x00000077664f2de453e920b16ecc9e2c
21:37:47:WU01:FS00:Uploading 1.64MiB to 171.64.65.124
21:37:47:WU01:FS00:Connecting to 171.64.65.124:8080
21:37:47:WU00:FS00:Starting
21:37:47:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
21:37:47:WU00:FS00:Started FahCore on PID 7404
21:37:47:WU00:FS00:Core PID:8928
21:37:47:WU00:FS00:FahCore 0xa4 started
21:37:47:WU00:FS00:0xa4:
21:37:47:WU00:FS00:0xa4:*------------------------------*
21:37:47:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
21:37:47:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
21:37:47:WU00:FS00:0xa4:
21:37:47:WU00:FS00:0xa4:Preparing to commence simulation
21:37:47:WU00:FS00:0xa4:- Looking at optimizations...
21:37:47:WU00:FS00:0xa4:- Created dyn
21:37:47:WU00:FS00:0xa4:- Files status OK
21:37:47:WU00:FS00:0xa4:- Expanded 923697 -> 1534204 (decompressed 166.0 percent)
21:37:47:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=923697 data_size=1534204, decompressed_data_size=1534204 diff=0
21:37:47:WU00:FS00:0xa4:- Digital signature verified
21:37:47:WU00:FS00:0xa4:
21:37:47:WU00:FS00:0xa4:Project: 9014 (Run 172, Clone 1, Gen 208)
21:37:47:WU00:FS00:0xa4:
21:37:47:WU00:FS00:0xa4:Assembly optimizations on if available.
21:37:47:WU00:FS00:0xa4:Entering M.D.
21:37:53:WU01:FS00:Upload 72.28%
21:37:53:WU00:FS00:0xa4:Mapping NT from 3 to 3 
21:37:53:WU00:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
21:37:56:WU01:FS00:Upload complete
21:37:56:WU01:FS00:Server responded WORK_ACK (400)
21:37:56:WU01:FS00:Final credit estimate, 1438.00 points
21:37:56:WU01:FS00:Cleaning up
21:40:07:WU00:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
01:16:09:WU00:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
01:16:10:WU01:FS00:Connecting to 171.67.108.200:8080
01:16:11:WU01:FS00:Assigned to work server 171.64.65.124
01:16:11:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.64.65.124
01:16:11:WU01:FS00:Connecting to 171.64.65.124:8080
01:16:11:WU01:FS00:Downloading 807.32KiB
01:16:13:WU01:FS00:Download complete
01:16:13:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9016 run:231 clone:5 gen:129 core:0xa4 unit:0x0000008f664f2de45491d7c69f3cd034
01:18:22:WU00:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
01:18:22:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
01:18:32:WU00:FS00:0xa4:
01:18:32:WU00:FS00:0xa4:Finished Work Unit:
01:18:32:WU00:FS00:0xa4:- Reading up to 915792 from "00/wudata_01.trr": Read 915792
01:18:32:WU00:FS00:0xa4:trr file hash check passed.
01:18:32:WU00:FS00:0xa4:- Reading up to 838620 from "00/wudata_01.xtc": Read 838620
01:18:32:WU00:FS00:0xa4:xtc file hash check passed.
01:18:32:WU00:FS00:0xa4:edr file hash check passed.
01:18:32:WU00:FS00:0xa4:logfile size: 23292
01:18:32:WU00:FS00:0xa4:Leaving Run
01:18:33:WU00:FS00:0xa4:- Writing 1780192 bytes of core data to disk...
01:18:33:WU00:FS00:0xa4:Done: 1779680 -> 1720636 (compressed to 96.6 percent)
01:18:33:WU00:FS00:0xa4:  ... Done.
01:18:33:WU00:FS00:0xa4:- Shutting down core
01:18:33:WU00:FS00:0xa4:
01:18:33:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
01:18:34:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
01:18:34:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:9014 run:172 clone:1 gen:208 core:0xa4 unit:0x000000f7664f2de453e5580f5cf3a361
01:18:34:WU00:FS00:Uploading 1.64MiB to 171.64.65.124
01:18:34:WU01:FS00:Starting
01:18:34:WU00:FS00:Connecting to 171.64.65.124:8080
01:18:34:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
01:18:34:WU01:FS00:Started FahCore on PID 5320
01:18:34:WU01:FS00:Core PID:1904
01:18:34:WU01:FS00:FahCore 0xa4 started
01:18:34:WU01:FS00:0xa4:
01:18:34:WU01:FS00:0xa4:*------------------------------*
01:18:34:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
01:18:34:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
01:18:34:WU01:FS00:0xa4:
01:18:34:WU01:FS00:0xa4:Preparing to commence simulation
01:18:34:WU01:FS00:0xa4:- Looking at optimizations...
01:18:34:WU01:FS00:0xa4:- Created dyn
01:18:34:WU01:FS00:0xa4:- Files status OK
01:18:34:WU01:FS00:0xa4:- Expanded 826179 -> 1397548 (decompressed 169.1 percent)
01:18:34:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826179 data_size=1397548, decompressed_data_size=1397548 diff=0
01:18:34:WU01:FS00:0xa4:- Digital signature verified
01:18:34:WU01:FS00:0xa4:
01:18:34:WU01:FS00:0xa4:Project: 9016 (Run 231, Clone 5, Gen 129)
01:18:34:WU01:FS00:0xa4:
01:18:34:WU01:FS00:0xa4:Assembly optimizations on if available.
01:18:34:WU01:FS00:0xa4:Entering M.D.
01:18:40:WU00:FS00:Upload 68.54%
01:18:40:WU01:FS00:0xa4:Mapping NT from 3 to 3 
01:18:40:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
01:18:43:WU00:FS00:Upload complete
01:18:44:WU00:FS00:Server responded WORK_ACK (400)
01:18:44:WU00:FS00:Final credit estimate, 1426.00 points
01:18:44:WU00:FS00:Cleaning up
01:20:43:WU01:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
******************************* Date: 2015-03-18 *******************************
04:40:27:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
04:40:28:WU00:FS00:Connecting to 171.67.108.200:8080
04:40:28:WU00:FS00:Assigned to work server 155.247.166.219
04:40:28:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 155.247.166.219
04:40:28:WU00:FS00:Connecting to 155.247.166.219:8080
04:40:29:WU00:FS00:Downloading 117.01KiB
04:40:29:WU00:FS00:Download complete
04:40:29:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8600 run:59 clone:8 gen:75 core:0xa4 unit:0x0000005c0002894b5462cd94be6ab318
04:42:30:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
04:42:30:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
04:42:40:WU01:FS00:0xa4:
04:42:40:WU01:FS00:0xa4:Finished Work Unit:
04:42:40:WU01:FS00:0xa4:- Reading up to 811488 from "01/wudata_01.trr": Read 811488
04:42:40:WU01:FS00:0xa4:trr file hash check passed.
04:42:40:WU01:FS00:0xa4:- Reading up to 746036 from "01/wudata_01.xtc": Read 746036
04:42:40:WU01:FS00:0xa4:xtc file hash check passed.
04:42:40:WU01:FS00:0xa4:edr file hash check passed.
04:42:40:WU01:FS00:0xa4:logfile size: 23236
04:42:40:WU01:FS00:0xa4:Leaving Run
04:42:43:WU01:FS00:0xa4:- Writing 1583248 bytes of core data to disk...
04:42:43:WU01:FS00:0xa4:Done: 1582736 -> 1537758 (compressed to 97.1 percent)
04:42:43:WU01:FS00:0xa4:  ... Done.
04:42:43:WU01:FS00:0xa4:- Shutting down core
04:42:43:WU01:FS00:0xa4:
04:42:43:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
04:42:43:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
04:42:43:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9016 run:231 clone:5 gen:129 core:0xa4 unit:0x0000008f664f2de45491d7c69f3cd034
04:42:43:WU01:FS00:Uploading 1.47MiB to 171.64.65.124
04:42:43:WU01:FS00:Connecting to 171.64.65.124:8080
04:42:43:WU00:FS00:Starting
04:42:43:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
04:42:43:WU00:FS00:Started FahCore on PID 7948
04:42:43:WU00:FS00:Core PID:6904
04:42:43:WU00:FS00:FahCore 0xa4 started
04:42:44:WU00:FS00:0xa4:
04:42:44:WU00:FS00:0xa4:*------------------------------*
04:42:44:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
04:42:44:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
04:42:44:WU00:FS00:0xa4:
04:42:44:WU00:FS00:0xa4:Preparing to commence simulation
04:42:44:WU00:FS00:0xa4:- Looking at optimizations...
04:42:44:WU00:FS00:0xa4:- Created dyn
04:42:44:WU00:FS00:0xa4:- Files status OK
04:42:44:WU00:FS00:0xa4:- Expanded 119307 -> 271368 (decompressed 227.4 percent)
04:42:44:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=119307 data_size=271368, decompressed_data_size=271368 diff=0
04:42:44:WU00:FS00:0xa4:- Digital signature verified
04:42:44:WU00:FS00:0xa4:
04:42:44:WU00:FS00:0xa4:Project: 8600 (Run 59, Clone 8, Gen 75)
04:42:44:WU00:FS00:0xa4:
04:42:44:WU00:FS00:0xa4:Assembly optimizations on if available.
04:42:44:WU00:FS00:0xa4:Entering M.D.
04:42:49:WU01:FS00:Upload 72.43%
04:42:49:WU00:FS00:0xa4:Mapping NT from 3 to 3 
04:42:49:WU00:FS00:0xa4:Completed 0 out of 5000000 steps  (0%)
04:42:51:WU01:FS00:Upload complete
04:42:52:WU01:FS00:Server responded WORK_ACK (400)
04:42:52:WU01:FS00:Final credit estimate, 1364.00 points
04:42:52:WU01:FS00:Cleaning up
04:45:37:WU00:FS00:0xa4:Completed 50000 out of 5000000 steps  (1%)
09:20:46:WU00:FS00:0xa4:Completed 4950000 out of 5000000 steps  (99%)
09:20:46:WU01:FS00:Connecting to 171.67.108.200:8080
09:20:46:WU01:FS00:Assigned to work server 171.64.65.124
09:20:46:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.64.65.124
09:20:46:WU01:FS00:Connecting to 171.64.65.124:8080
09:20:47:WU01:FS00:Downloading 860.90KiB
09:20:49:WU01:FS00:Download complete
09:20:49:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9008 run:955 clone:0 gen:234 core:0xa4 unit:0x00000111664f2de453826f480c1fa2c5
******************************* Date: 2015-03-18 *******************************
09:23:34:WU00:FS00:0xa4:Completed 5000000 out of 5000000 steps  (100%)
09:23:34:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
09:23:44:WU00:FS00:0xa4:
09:23:44:WU00:FS00:0xa4:Finished Work Unit:
09:23:44:WU00:FS00:0xa4:- Reading up to 1255848 from "00/wudata_01.trr": Read 1255848
09:23:44:WU00:FS00:0xa4:trr file hash check passed.
09:23:44:WU00:FS00:0xa4:- Reading up to 111300 from "00/wudata_01.xtc": Read 111300
09:23:44:WU00:FS00:0xa4:xtc file hash check passed.
09:23:44:WU00:FS00:0xa4:edr file hash check passed.
09:23:44:WU00:FS00:0xa4:logfile size: 87181
09:23:44:WU00:FS00:0xa4:Leaving Run
09:23:47:WU00:FS00:0xa4:- Writing 1526229 bytes of core data to disk...
09:23:48:WU00:FS00:0xa4:Done: 1525717 -> 1292592 (compressed to 84.7 percent)
09:23:48:WU00:FS00:0xa4:  ... Done.
09:23:48:WU00:FS00:0xa4:- Shutting down core
09:23:48:WU00:FS00:0xa4:
09:23:48:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
09:23:48:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:23:48:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:8600 run:59 clone:8 gen:75 core:0xa4 unit:0x0000005c0002894b5462cd94be6ab318
09:23:48:WU00:FS00:Uploading 1.23MiB to 155.247.166.219
09:23:48:WU01:FS00:Starting
09:23:48:WU00:FS00:Connecting to 155.247.166.219:8080
09:23:48:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
09:23:48:WU01:FS00:Started FahCore on PID 12172
09:23:48:WU01:FS00:Core PID:6024
09:23:48:WU01:FS00:FahCore 0xa4 started
09:23:49:WU01:FS00:0xa4:
09:23:49:WU01:FS00:0xa4:*------------------------------*
09:23:49:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
09:23:49:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
09:23:49:WU01:FS00:0xa4:
09:23:49:WU01:FS00:0xa4:Preparing to commence simulation
09:23:49:WU01:FS00:0xa4:- Looking at optimizations...
09:23:49:WU01:FS00:0xa4:- Created dyn
09:23:49:WU01:FS00:0xa4:- Files status OK
09:23:49:WU01:FS00:0xa4:- Expanded 881049 -> 1463992 (decompressed 166.1 percent)
09:23:49:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=881049 data_size=1463992, decompressed_data_size=1463992 diff=0
09:23:49:WU01:FS00:0xa4:- Digital signature verified
09:23:49:WU01:FS00:0xa4:
09:23:49:WU01:FS00:0xa4:Project: 9008 (Run 955, Clone 0, Gen 234)
09:23:49:WU01:FS00:0xa4:
09:23:49:WU01:FS00:0xa4:Assembly optimizations on if available.
09:23:49:WU01:FS00:0xa4:Entering M.D.
09:23:53:WU00:FS00:Upload complete
09:23:53:WU00:FS00:Server responded WORK_ACK (400)
09:23:53:WU00:FS00:Final credit estimate, 1811.00 points
09:23:53:WU00:FS00:Cleaning up
09:23:54:WU01:FS00:0xa4:Mapping NT from 3 to 3 
09:23:54:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
11:58:45:WU01:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
12:00:07:WU00:FS01:Connecting to 171.67.108.200:80
12:00:08:WU00:FS01:Assigned to work server 140.163.4.235
12:00:08:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GF119 [GeForce GT 610] from 140.163.4.235
12:00:08:WU00:FS01:Connecting to 140.163.4.235:8080
12:00:08:WU00:FS01:Downloading 3.78MiB
12:00:13:WU00:FS01:Download complete
12:00:13:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:10485 run:1 clone:24 gen:8 core:0x18 unit:0x0000000d538b3dbb54aeba73d4c5bbe4
12:00:13:WU00:FS01:Starting
12:00:13:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:00:13:WU00:FS01:Started FahCore on PID 6292
12:00:13:WU00:FS01:Core PID:11060
12:00:13:WU00:FS01:FahCore 0x18 started
12:00:14:WU00:FS01:0x18:*********************** Log Started 2015-03-18T12:00:13Z ***********************
12:00:14:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
12:00:14:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
12:00:14:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
12:00:14:WU00:FS01:0x18:Machine: 1
12:00:14:WU00:FS01:0x18:Reading tar file state.xml
12:00:14:WU00:FS01:0x18:Reading tar file system.xml
12:00:14:WU00:FS01:0x18:Reading tar file integrator.xml
12:00:14:WU00:FS01:0x18:Reading tar file core.xml
12:00:14:WU00:FS01:0x18:Digital signatures verified
12:00:14:WU00:FS01:0x18:Folding@home GPU core18
12:00:14:WU00:FS01:0x18:Version 0.0.3
12:00:34:Saving configuration to config.xml
12:00:34:<config>
12:00:34:  <!-- Folding Slot Configuration -->
12:00:34:  <cause v='CANCER'/>
12:00:34:
12:00:34:  <!-- Network -->
12:00:34:  <proxy v=':8080'/>
12:00:34:
12:00:34:  <!-- Slot Control -->
12:00:34:  <power v='full'/>
12:00:34:
12:00:34:  <!-- User Information -->
12:00:34:  <passkey v='********************************'/>
12:00:34:  <team v='227768'/>
12:00:34:  <user v='Engineer_Cruncher'/>
12:00:34:
12:00:34:  <!-- Folding Slots -->
12:00:34:  <slot id='0' type='CPU'/>
12:00:34:  <slot id='1' type='GPU'/>
12:00:34:</config>
12:00:46:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
12:00:46:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
12:00:55:WU01:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
12:09:33:WU01:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
12:11:29:FS01:Shutting core down
12:11:30:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 11060
12:11:30:WU00:FS01:0x18:Exiting, please wait. . .
12:11:31:WU00:FS01:0x18:Lost lifeline PID 6292, exiting
12:11:31:WU00:FS01:0x18:ERROR:103: Lost client lifeline
12:11:31:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
12:11:31:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
12:11:44:WU01:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
12:11:45:Saving configuration to config.xml
12:11:45:<config>
12:11:45:  <!-- Folding Slot Configuration -->
12:11:45:  <cause v='CANCER'/>
12:11:45:
12:11:45:  <!-- Network -->
12:11:45:  <proxy v=':8080'/>
12:11:45:
12:11:45:  <!-- Slot Control -->
12:11:45:  <power v='full'/>
12:11:45:
12:11:45:  <!-- User Information -->
12:11:45:  <passkey v='********************************'/>
12:11:45:  <team v='227768'/>
12:11:45:  <user v='Engineer_Cruncher'/>
12:11:45:
12:11:45:  <!-- Folding Slots -->
12:11:45:  <slot id='0' type='CPU'/>
12:11:45:  <slot id='1' type='GPU'>
12:11:45:    <idle v='true'/>
12:11:45:  </slot>
12:11:45:</config>
12:13:52:WU01:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
12:16:03:WU01:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
12:45:46:WU01:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
12:46:27:WU00:FS01:Starting
12:46:27:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
12:46:27:WU00:FS01:Started FahCore on PID 5956
12:46:27:WU00:FS01:Core PID:7420
12:46:27:WU00:FS01:FahCore 0x18 started
12:46:27:WU00:FS01:0x18:*********************** Log Started 2015-03-18T12:46:27Z ***********************
12:46:27:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
12:46:27:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
12:46:27:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
12:46:27:WU00:FS01:0x18:Machine: 1
12:46:27:WU00:FS01:0x18:Digital signatures verified
12:46:27:WU00:FS01:0x18:Folding@home GPU core18
12:46:27:WU00:FS01:0x18:Version 0.0.3
12:46:52:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
12:46:52:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
12:47:42:FS01:Shutting core down
12:47:42:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 7420
12:47:42:WU00:FS01:0x18:Exiting, please wait. . .
12:47:51:WU00:FS01:0x18:Lost lifeline PID 5956, exiting
12:47:51:WU00:FS01:0x18:ERROR:103: Lost client lifeline
12:47:51:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
12:47:51:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
12:47:56:WU01:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
12:50:05:WU01:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
12:52:13:WU01:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
12:54:20:WU01:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
12:54:20:WU02:FS00:Connecting to 171.67.108.200:8080
12:54:21:WU02:FS00:Assigned to work server 155.247.166.219
12:54:21:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 155.247.166.219
12:54:21:WU02:FS00:Connecting to 155.247.166.219:8080
12:54:21:WU02:FS00:Downloading 116.43KiB
12:54:21:WU02:FS00:Download complete
12:54:21:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:6397 run:108 clone:0 gen:76 core:0xa4 unit:0x0000005b0002894b5462ca395873000d
12:56:26:WU01:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
12:56:27:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
12:56:37:WU01:FS00:0xa4:
12:56:37:WU01:FS00:0xa4:Finished Work Unit:
12:56:37:WU01:FS00:0xa4:- Reading up to 871872 from "01/wudata_01.trr": Read 871872
12:56:37:WU01:FS00:0xa4:trr file hash check passed.
12:56:37:WU01:FS00:0xa4:- Reading up to 799816 from "01/wudata_01.xtc": Read 799816
12:56:37:WU01:FS00:0xa4:xtc file hash check passed.
12:56:37:WU01:FS00:0xa4:edr file hash check passed.
12:56:37:WU01:FS00:0xa4:logfile size: 23457
12:56:37:WU01:FS00:0xa4:Leaving Run
12:56:38:WU01:FS00:0xa4:- Writing 1697633 bytes of core data to disk...
12:56:39:WU01:FS00:0xa4:Done: 1697121 -> 1645323 (compressed to 96.9 percent)
12:56:39:WU01:FS00:0xa4:  ... Done.
12:56:39:WU01:FS00:0xa4:- Shutting down core
12:56:39:WU01:FS00:0xa4:
12:56:39:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
12:56:39:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
12:56:39:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:9008 run:955 clone:0 gen:234 core:0xa4 unit:0x00000111664f2de453826f480c1fa2c5
12:56:39:WU01:FS00:Uploading 1.57MiB to 171.64.65.124
12:56:39:WU01:FS00:Connecting to 171.64.65.124:8080
12:56:39:WU02:FS00:Starting
12:56:39:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
12:56:39:WU02:FS00:Started FahCore on PID 12208
12:56:39:WU02:FS00:Core PID:4976
12:56:39:WU02:FS00:FahCore 0xa4 started
12:56:40:WU02:FS00:0xa4:
12:56:40:WU02:FS00:0xa4:*------------------------------*
12:56:40:WU02:FS00:0xa4:Folding@Home Gromacs GB Core
12:56:40:WU02:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
12:56:40:WU02:FS00:0xa4:
12:56:40:WU02:FS00:0xa4:Preparing to commence simulation
12:56:40:WU02:FS00:0xa4:- Looking at optimizations...
12:56:40:WU02:FS00:0xa4:- Created dyn
12:56:40:WU02:FS00:0xa4:- Files status OK
12:56:40:WU02:FS00:0xa4:- Expanded 118712 -> 268860 (decompressed 226.4 percent)
12:56:40:WU02:FS00:0xa4:Called DecompressByteArray: compressed_data_size=118712 data_size=268860, decompressed_data_size=268860 diff=0
12:56:40:WU02:FS00:0xa4:- Digital signature verified
12:56:40:WU02:FS00:0xa4:
12:56:40:WU02:FS00:0xa4:Project: 6397 (Run 108, Clone 0, Gen 76)
12:56:40:WU02:FS00:0xa4:
12:56:40:WU02:FS00:0xa4:Assembly optimizations on if available.
12:56:40:WU02:FS00:0xa4:Entering M.D.
12:56:45:WU01:FS00:Upload 71.67%
12:56:45:WU02:FS00:0xa4:Mapping NT from 3 to 3 
12:56:45:WU02:FS00:0xa4:Completed 0 out of 5000000 steps  (0%)
12:56:47:WU01:FS00:Upload complete
12:56:48:WU01:FS00:Server responded WORK_ACK (400)
12:56:48:WU01:FS00:Final credit estimate, 1390.00 points
12:56:48:WU01:FS00:Cleaning up
12:59:34:WU02:FS00:0xa4:Completed 50000 out of 5000000 steps  (1%)
15:06:15:WU02:FS00:0xa4:Completed 2250000 out of 5000000 steps  (45%)
15:07:58:WU00:FS01:Starting
15:07:58:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
15:07:58:WU00:FS01:Started FahCore on PID 12264
15:07:58:WU00:FS01:Core PID:7632
15:07:58:WU00:FS01:FahCore 0x18 started
15:07:59:WU00:FS01:0x18:*********************** Log Started 2015-03-18T15:07:58Z ***********************
15:07:59:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
15:07:59:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
15:07:59:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
15:07:59:WU00:FS01:0x18:Machine: 1
15:07:59:WU00:FS01:0x18:Digital signatures verified
15:07:59:WU00:FS01:0x18:Folding@home GPU core18
15:07:59:WU00:FS01:0x18:Version 0.0.3
15:08:23:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
15:08:23:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:09:07:WU02:FS00:0xa4:Completed 2300000 out of 5000000 steps  (46%)
15:15:02:WU02:FS00:0xa4:Completed 2400000 out of 5000000 steps  (48%)
15:16:03:FS01:Shutting core down
15:16:03:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 7632
15:16:03:WU00:FS01:0x18:Exiting, please wait. . .
15:16:07:WU00:FS01:0x18:Lost lifeline PID 12264, exiting
15:16:07:WU00:FS01:0x18:ERROR:103: Lost client lifeline
15:16:07:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
15:16:08:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
15:17:56:WU02:FS00:0xa4:Completed 2450000 out of 5000000 steps  (49%)
******************************* Date: 2015-03-18 *******************************
15:43:35:WU02:FS00:0xa4:Completed 2900000 out of 5000000 steps  (58%)
15:45:11:WU00:FS01:Starting
15:45:11:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
15:45:11:WU00:FS01:Started FahCore on PID 5124
15:45:11:WU00:FS01:Core PID:4172
15:45:11:WU00:FS01:FahCore 0x18 started
15:45:12:WU00:FS01:0x18:*********************** Log Started 2015-03-18T15:45:11Z ***********************
15:45:12:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
15:45:12:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
15:45:12:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
15:45:12:WU00:FS01:0x18:Machine: 1
15:45:12:WU00:FS01:0x18:Digital signatures verified
15:45:12:WU00:FS01:0x18:Folding@home GPU core18
15:45:12:WU00:FS01:0x18:Version 0.0.3
15:45:36:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
15:45:36:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:46:27:WU02:FS00:0xa4:Completed 2950000 out of 5000000 steps  (59%)
15:49:25:WU02:FS00:0xa4:Completed 3000000 out of 5000000 steps  (60%)
15:51:22:FS01:Shutting core down
15:51:23:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 4172
15:51:23:WU00:FS01:0x18:Exiting, please wait. . .
15:51:31:WU00:FS01:0x18:Lost lifeline PID 5124, exiting
15:51:31:WU00:FS01:0x18:ERROR:103: Lost client lifeline
15:51:31:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
15:51:31:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
15:52:21:WU02:FS00:0xa4:Completed 3050000 out of 5000000 steps  (61%)
16:12:15:WU02:FS00:0xa4:Completed 3400000 out of 5000000 steps  (68%)
16:14:21:WU00:FS01:Starting
16:14:21:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
16:14:21:WU00:FS01:Started FahCore on PID 2940
16:14:21:WU00:FS01:Core PID:4172
16:14:21:WU00:FS01:FahCore 0x18 started
16:14:21:WU00:FS01:0x18:*********************** Log Started 2015-03-18T16:14:21Z ***********************
16:14:21:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
16:14:21:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
16:14:21:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
16:14:21:WU00:FS01:0x18:Machine: 1
16:14:21:WU00:FS01:0x18:Digital signatures verified
16:14:21:WU00:FS01:0x18:Folding@home GPU core18
16:14:21:WU00:FS01:0x18:Version 0.0.3
16:14:45:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
16:14:45:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
16:15:08:WU02:FS00:0xa4:Completed 3450000 out of 5000000 steps  (69%)
16:21:03:WU02:FS00:0xa4:Completed 3550000 out of 5000000 steps  (71%)
16:23:33:FS01:Shutting core down
16:23:33:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 4172
16:23:33:WU00:FS01:0x18:Exiting, please wait. . .
16:23:38:WU00:FS01:0x18:Lost lifeline PID 2940, exiting
16:23:38:WU00:FS01:0x18:ERROR:103: Lost client lifeline
16:23:38:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
16:23:38:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
16:24:00:WU02:FS00:0xa4:Completed 3600000 out of 5000000 steps  (72%)
16:38:12:WU02:FS00:0xa4:Completed 3850000 out of 5000000 steps  (77%)
16:38:49:WU00:FS01:Starting
16:38:49:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
16:38:49:WU00:FS01:Started FahCore on PID 4316
16:38:49:WU00:FS01:Core PID:7940
16:38:49:WU00:FS01:FahCore 0x18 started
16:38:49:WU00:FS01:0x18:*********************** Log Started 2015-03-18T16:38:49Z ***********************
16:38:49:WU00:FS01:0x18:Project: 10485 (Run 1, Clone 24, Gen 8)
16:38:49:WU00:FS01:0x18:Unit: 0x0000000d538b3dbb54aeba73d4c5bbe4
16:38:49:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
16:38:49:WU00:FS01:0x18:Machine: 1
16:38:49:WU00:FS01:0x18:Digital signatures verified
16:38:49:WU00:FS01:0x18:Folding@home GPU core18
16:38:49:WU00:FS01:0x18:Version 0.0.3
16:39:14:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
16:39:14:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
16:41:08:WU02:FS00:0xa4:Completed 3900000 out of 5000000 steps  (78%)
17:43:01:WU02:FS00:0xa4:Completed 4950000 out of 5000000 steps  (99%)
17:43:02:WU01:FS00:Connecting to 171.67.108.200:8080
17:43:02:WU01:FS00:Assigned to work server 171.64.65.124
17:43:02:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.64.65.124
17:43:02:WU01:FS00:Connecting to 171.64.65.124:8080
17:43:03:WU01:FS00:Downloading 808.34KiB
17:43:04:WU01:FS00:Download complete
17:43:05:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9007 run:412 clone:3 gen:231 core:0xa4 unit:0x00000108664f2de4533b3520fdaa8d2d
17:45:59:WU02:FS00:0xa4:Completed 5000000 out of 5000000 steps  (100%)
17:45:59:WU02:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
17:46:09:WU02:FS00:0xa4:
17:46:09:WU02:FS00:0xa4:Finished Work Unit:
17:46:09:WU02:FS00:0xa4:- Reading up to 1254528 from "02/wudata_01.trr": Read 1254528
17:46:09:WU02:FS00:0xa4:trr file hash check passed.
17:46:09:WU02:FS00:0xa4:- Reading up to 109080 from "02/wudata_01.xtc": Read 109080
17:46:09:WU02:FS00:0xa4:xtc file hash check passed.
17:46:09:WU02:FS00:0xa4:edr file hash check passed.
17:46:09:WU02:FS00:0xa4:logfile size: 87248
17:46:09:WU02:FS00:0xa4:Leaving Run
17:46:14:WU02:FS00:0xa4:- Writing 1522756 bytes of core data to disk...
17:46:14:WU02:FS00:0xa4:Done: 1522244 -> 1288567 (compressed to 84.6 percent)
17:46:14:WU02:FS00:0xa4:  ... Done.
17:46:14:WU02:FS00:0xa4:- Shutting down core
17:46:14:WU02:FS00:0xa4:
17:46:14:WU02:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
17:46:14:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
17:46:14:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:6397 run:108 clone:0 gen:76 core:0xa4 unit:0x0000005b0002894b5462ca395873000d
17:46:14:WU02:FS00:Uploading 1.23MiB to 155.247.166.219
17:46:14:WU02:FS00:Connecting to 155.247.166.219:8080
17:46:15:WU01:FS00:Starting
17:46:15:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/bbillings/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 4288 -checkpoint 15 -np 3
17:46:15:WU01:FS00:Started FahCore on PID 10384
17:46:15:WU01:FS00:Core PID:5352
17:46:15:WU01:FS00:FahCore 0xa4 started
17:46:15:WU01:FS00:0xa4:
17:46:15:WU01:FS00:0xa4:*------------------------------*
17:46:15:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
17:46:15:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
17:46:15:WU01:FS00:0xa4:
17:46:15:WU01:FS00:0xa4:Preparing to commence simulation
17:46:15:WU01:FS00:0xa4:- Looking at optimizations...
17:46:15:WU01:FS00:0xa4:- Created dyn
17:46:15:WU01:FS00:0xa4:- Files status OK
17:46:15:WU01:FS00:0xa4:- Expanded 827227 -> 1400900 (decompressed 169.3 percent)
17:46:15:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=827227 data_size=1400900, decompressed_data_size=1400900 diff=0
17:46:15:WU01:FS00:0xa4:- Digital signature verified
17:46:15:WU01:FS00:0xa4:
17:46:15:WU01:FS00:0xa4:Project: 9007 (Run 412, Clone 3, Gen 231)
17:46:15:WU01:FS00:0xa4:
17:46:15:WU01:FS00:0xa4:Assembly optimizations on if available.
17:46:15:WU01:FS00:0xa4:Entering M.D.
17:46:19:WU02:FS00:Upload complete
17:46:19:WU02:FS00:Server responded WORK_ACK (400)
17:46:19:WU02:FS00:Final credit estimate, 1785.00 points
17:46:19:WU02:FS00:Cleaning up
17:46:21:WU01:FS00:0xa4:Mapping NT from 3 to 3 
17:46:21:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
20:56:41:WU01:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
20:58:52:WU01:FS00:0xa4:Completed 222500 out of 250000 steps
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Computer has stopped computations in the middle of a WU

Post by bruce »

Perhaps this is your problem: There is a known bug in FAHClient 7.4.4 (and earlier) whereby an internet failure during upload or download will permanently hang the client's internet communications. The only cure for it is to restart FAHClient. There's no anticipated date for a fix. This can be duplicated by unplugging the ethernet cable during FAH file transfer but the same thing can be caused by other things including a problem at your ISP or a router reboot while data is being transferred.

This would NOT cause computations to stop in the middle of a WU.
Top
Post Reply

Return to “New Donors start here”