Page 1 of 1

Deadline problem with Core21 on Fermi

Posted: Wed Sep 23, 2015 6:43 pm
by Kebast
Here's another log of a fermi card pulling a 9206 core21 WU though. At the bottom. This same machine is currently working on a 9205. I only post this questioning if these cards should be assigned these WUs. It looks like the time to finish will be very close to the deadline, if not over. I cut some %complete lines to get under the 60k limit.

Code: Select all

*********************** Log Started 2015-09-18T13:37:01Z ***********************
13:37:01:************************* Folding@home Client *************************
13:37:01:      Website: http://folding.stanford.edu/
13:37:01:    Copyright: (c) 2009-2014 Stanford University
13:37:01:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
13:37:01:         Args: 
13:37:01:       Config: C:/Users/Mandli_06/AppData/Roaming/FAHClient/config.xml
13:37:01:******************************** Build ********************************
13:37:01:      Version: 7.4.4
13:37:01:         Date: Mar 4 2014
13:37:01:         Time: 20:26:54
13:37:01:      SVN Rev: 4130
13:37:01:       Branch: fah/trunk/client
13:37:01:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
13:37:01:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
13:37:01:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
13:37:01:     Platform: win32 XP
13:37:01:         Bits: 32
13:37:01:         Mode: Release
13:37:01:******************************* System ********************************
13:37:01:          CPU: Intel(R) Xeon(R) CPU E5603 @ 1.60GHz
13:37:01:       CPU ID: GenuineIntel Family 6 Model 44 Stepping 2
13:37:01:         CPUs: 8
13:37:01:       Memory: 3.50GiB
13:37:01:  Free Memory: 2.28GiB
13:37:01:      Threads: WINDOWS_THREADS
13:37:01:   OS Version: 6.1
13:37:01:  Has Battery: false
13:37:01:   On Battery: false
13:37:01:   UTC Offset: -4
13:37:01:          PID: 2936
13:37:01:          CWD: C:/Users/Mandli_06/AppData/Roaming/FAHClient
13:37:01:           OS: Windows 7 Professional Service Pack 1
13:37:01:      OS Arch: X86
13:37:01:         GPUs: 1
13:37:01:        GPU 0: NVIDIA:2 GF108 [Quadro 600]
13:37:01:         CUDA: 2.1
13:37:01:  CUDA Driver: 7050
13:37:01:Win32 Service: false
13:37:01:***********************************************************************
13:37:01:<config>
13:37:01:  <!-- Network -->
13:37:01:  <proxy v=':8080'/>
13:37:01:
13:37:01:  <!-- Slot Control -->
13:37:01:  <power v='full'/>
13:37:01:
13:37:01:  <!-- User Information -->
13:37:01:  <passkey v='********************************'/>
13:37:01:  <team v='229226'/>
13:37:01:  <user v='Kebast'/>
13:37:01:
13:37:01:  <!-- Folding Slots -->
13:37:01:  <slot id='0' type='CPU'>
13:37:01:    <client-type v='advanced'/>
13:37:01:    <cpus v='8'/>
13:37:01:    <paused v='true'/>
13:37:01:  </slot>
13:37:01:  <slot id='1' type='GPU'>
13:37:01:    <client-type v='beta'/>
13:37:01:    <max-packet-size v='small'/>
13:37:01:    <paused v='true'/>
13:37:01:  </slot>
13:37:01:</config>
13:37:01:Trying to access database...
13:37:01:Successfully acquired database lock
13:37:01:Enabled folding slot 00: PAUSED cpu:8 (by user)
13:37:01:Enabled folding slot 01: PAUSED gpu:0:GF108 [Quadro 600] (by user)
13:37:23:FS00:Unpaused
13:37:23:FS01:Unpaused
13:37:23:WU01:FS01:Starting
13:37:23:WU01:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/beta/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
13:37:23:WU01:FS01:Started FahCore on PID 5640
13:37:23:WU01:FS01:Core PID:5652
13:37:23:WU01:FS01:FahCore 0x15 started
13:37:23:WU00:FS00:Starting
13:37:23:WU00:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -np 8
13:37:23:WU00:FS00:Started FahCore on PID 5660
13:37:23:WU00:FS00:Core PID:5672
13:37:23:WU00:FS00:FahCore 0xa4 started
13:37:23:WU01:FS01:0x15:
13:37:23:WU01:FS01:0x15:*------------------------------*
13:37:23:WU01:FS01:0x15:Folding@Home GPU Core
13:37:23:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
13:37:23:WU01:FS01:0x15:Build host             AmoebaRemote
13:37:23:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
13:37:23:WU01:FS01:0x15:Core                   15
13:37:23:WU01:FS01:0x15:
13:37:23:WU01:FS01:0x15:Window's signal control handler registered.
13:37:23:WU01:FS01:0x15:Preparing to commence simulation
13:37:23:WU01:FS01:0x15:- Looking at optimizations...
13:37:23:WU01:FS01:0x15:- Files status OK
13:37:23:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
13:37:23:WU01:FS01:0x15:- Expanded 124315 -> 501826 (decompressed 403.6 percent)
13:37:23:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=124315 data_size=501826, decompressed_data_size=501826 diff=0
13:37:23:WU01:FS01:0x15:- Digital signature verified
13:37:23:WU01:FS01:0x15:
13:37:23:WU01:FS01:0x15:Project: 7623 (Run 142, Clone 0, Gen 518)
13:37:23:WU01:FS01:0x15:
13:37:23:WU01:FS01:0x15:Assembly optimizations on if available.
13:37:23:WU01:FS01:0x15:Entering M.D.
13:37:23:WU00:FS00:0xa4:
13:37:23:WU00:FS00:0xa4:*------------------------------*
13:37:23:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
13:37:23:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
13:37:23:WU00:FS00:0xa4:
13:37:23:WU00:FS00:0xa4:Preparing to commence simulation
13:37:23:WU00:FS00:0xa4:- Looking at optimizations...
13:37:23:WU00:FS00:0xa4:- Files status OK
13:37:23:WU00:FS00:0xa4:- Expanded 564650 -> 1381464 (decompressed 244.6 percent)
13:37:23:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=564650 data_size=1381464, decompressed_data_size=1381464 diff=0
13:37:23:WU00:FS00:0xa4:- Digital signature verified
13:37:23:WU00:FS00:0xa4:
13:37:23:WU00:FS00:0xa4:Project: 6381 (Run 4, Clone 4, Gen 377)
13:37:23:WU00:FS00:0xa4:
13:37:23:WU00:FS00:0xa4:Assembly optimizations on if available.
13:37:23:WU00:FS00:0xa4:Entering M.D.
13:37:25:WU01:FS01:0x15:Will resume from checkpoint file 01/wudata_01.ckp
13:37:25:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  2242949038 1808653799 4010898038 1757713042 3182045138
13:37:25:WU01:FS01:0x15:GPU device id=0
13:37:25:WU01:FS01:0x15:Working on Protein
13:37:25:WU01:FS01:0x15:Client config unavailable.
13:37:25:WU01:FS01:0x15:Starting GUI Server
13:37:30:WU00:FS00:0xa4:Using Gromacs checkpoints
13:37:30:WU00:FS00:0xa4:Mapping NT from 8 to 8 
13:37:31:WU00:FS00:0xa4:Resuming from checkpoint
13:37:31:WU00:FS00:0xa4:Verified 00/wudata_01.log
13:37:31:WU00:FS00:0xa4:Verified 00/wudata_01.trr
13:37:31:WU00:FS00:0xa4:Verified 00/wudata_01.xtc
13:37:31:WU00:FS00:0xa4:Verified 00/wudata_01.edr
13:37:31:WU00:FS00:0xa4:Completed 1492730 out of 2500000 steps  (59%)
13:38:02:Removing old file 'configs/config-20150811-170246.xml'
13:38:02:Saving configuration to config.xml
13:38:02:<config>
13:38:02:  <!-- Network -->
13:38:02:  <proxy v=':8080'/>
13:38:02:
13:38:02:  <!-- Slot Control -->
13:38:02:  <power v='full'/>
13:38:02:
13:38:02:  <!-- User Information -->
13:38:02:  <passkey v='********************************'/>
13:38:02:  <team v='229226'/>
13:38:02:  <user v='Kebast'/>
13:38:02:
13:38:02:  <!-- Folding Slots -->
13:38:02:  <slot id='0' type='CPU'>
13:38:02:    <client-type v='advanced'/>
13:38:02:    <cpus v='8'/>
13:38:02:  </slot>
13:38:02:  <slot id='1' type='GPU'>
13:38:02:    <client-type v='beta'/>
13:38:02:    <max-packet-size v='small'/>
13:38:02:  </slot>
13:38:02:</config>
13:38:41:WU01:FS01:0x15:Resuming from checkpoint
13:38:42:WU01:FS01:0x15:fcCheckPointResume: retreived and current tpr file hash:
13:38:42:WU01:FS01:0x15:   0   2242949038   2242949038
13:38:42:WU01:FS01:0x15:   1   1808653799   1808653799
13:38:42:WU01:FS01:0x15:   2   4010898038   4010898038
13:38:42:WU01:FS01:0x15:   3   1757713042   1757713042
13:38:42:WU01:FS01:0x15:   4   3182045138   3182045138
13:38:42:WU01:FS01:0x15:fcCheckPointResume: file hashes same.
13:38:42:WU01:FS01:0x15:fcCheckPointResume: state restored.
13:38:42:WU01:FS01:0x15:fcCheckPointResume: name 01/wudata_01.log Verified 01/wudata_01.log
13:38:42:WU01:FS01:0x15:fcCheckPointResume: name 01/wudata_01.trr Verified 01/wudata_01.trr
13:38:42:WU01:FS01:0x15:fcCheckPointResume: name 01/wudata_01.xtc Verified 01/wudata_01.xtc
13:38:42:WARNING:WU01:FS01:Detected clock skew (1 mins 19 secs), adjusting time estimates
13:38:42:WU01:FS01:0x15:fcCheckPointResume: name 01/wudata_01.edr Verified 01/wudata_01.edr
13:38:42:WU01:FS01:0x15:fcCheckPointResume: state restored 2
13:38:42:WU01:FS01:0x15:Resumed from checkpoint
13:38:42:WU01:FS01:0x15:Setting checkpoint frequency: 400000
13:38:42:WU01:FS01:0x15:Completed  24000001 out of 40000000 steps (60%).
13:39:50:WU00:FS00:0xa4:Completed 1500000 out of 2500000 steps  (60%)
13:47:35:WU00:FS00:0xa4:Completed 1525000 out of 2500000 steps  (61%)
13:55:33:WU00:FS00:0xa4:Completed 1550000 out of 2500000 steps  (62%)
14:04:17:WU00:FS00:0xa4:Completed 1575000 out of 2500000 steps  (63%)
14:10:16:WU01:FS01:0x15:Completed  24400000 out of 40000000 steps (61%).
14:12:12:WU00:FS00:0xa4:Completed 1600000 out of 2500000 steps  (64%)
14:19:09:WU00:FS00:0xa4:Completed 1625000 out of 2500000 steps  (65%)
14:26:05:WU00:FS00:0xa4:Completed 1650000 out of 2500000 steps  (66%)
14:33:00:WU00:FS00:0xa4:Completed 1675000 out of 2500000 steps  (67%)
14:40:28:WU00:FS00:0xa4:Completed 1700000 out of 2500000 steps  (68%)
14:41:51:WU01:FS01:0x15:Completed  24800000 out of 40000000 steps (62%).
14:47:26:WU00:FS00:0xa4:Completed 1725000 out of 2500000 steps  (69%)
14:54:20:WU00:FS00:0xa4:Completed 1750000 out of 2500000 steps  (70%)
15:01:16:WU00:FS00:0xa4:Completed 1775000 out of 2500000 steps  (71%)
15:08:11:WU00:FS00:0xa4:Completed 1800000 out of 2500000 steps  (72%)
15:13:26:WU01:FS01:0x15:Completed  25200000 out of 40000000 steps (63%).
15:15:06:WU00:FS00:0xa4:Completed 1825000 out of 2500000 steps  (73%)
15:22:01:WU00:FS00:0xa4:Completed 1850000 out of 2500000 steps  (74%)
15:28:56:WU00:FS00:0xa4:Completed 1875000 out of 2500000 steps  (75%)
15:35:49:WU00:FS00:0xa4:Completed 1900000 out of 2500000 steps  (76%)
15:42:44:WU00:FS00:0xa4:Completed 1925000 out of 2500000 steps  (77%)
15:45:01:WU01:FS01:0x15:Completed  25600000 out of 40000000 steps (64%).
15:49:40:WU00:FS00:0xa4:Completed 1950000 out of 2500000 steps  (78%)
15:56:32:WU00:FS00:0xa4:Completed 1975000 out of 2500000 steps  (79%)
16:03:26:WU00:FS00:0xa4:Completed 2000000 out of 2500000 steps  (80%)
16:10:21:WU00:FS00:0xa4:Completed 2025000 out of 2500000 steps  (81%)
16:16:36:WU01:FS01:0x15:Completed  26000000 out of 40000000 steps (65%).
16:17:17:WU00:FS00:0xa4:Completed 2050000 out of 2500000 steps  (82%)
16:24:15:WU00:FS00:0xa4:Completed 2075000 out of 2500000 steps  (83%)
16:31:09:WU00:FS00:0xa4:Completed 2100000 out of 2500000 steps  (84%)
16:38:04:WU00:FS00:0xa4:Completed 2125000 out of 2500000 steps  (85%)
16:44:57:WU00:FS00:0xa4:Completed 2150000 out of 2500000 steps  (86%)
16:48:11:WU01:FS01:0x15:Completed  26400000 out of 40000000 steps (66%).
16:51:52:WU00:FS00:0xa4:Completed 2175000 out of 2500000 steps  (87%)
16:58:47:WU00:FS00:0xa4:Completed 2200000 out of 2500000 steps  (88%)
17:05:40:WU00:FS00:0xa4:Completed 2225000 out of 2500000 steps  (89%)
17:12:36:WU00:FS00:0xa4:Completed 2250000 out of 2500000 steps  (90%)
17:19:30:WU00:FS00:0xa4:Completed 2275000 out of 2500000 steps  (91%)
17:19:46:WU01:FS01:0x15:Completed  26800000 out of 40000000 steps (67%).
17:26:26:WU00:FS00:0xa4:Completed 2300000 out of 2500000 steps  (92%)
17:33:21:WU00:FS00:0xa4:Completed 2325000 out of 2500000 steps  (93%)
17:40:17:WU00:FS00:0xa4:Completed 2350000 out of 2500000 steps  (94%)
17:47:11:WU00:FS00:0xa4:Completed 2375000 out of 2500000 steps  (95%)
17:51:21:WU01:FS01:0x15:Completed  27200000 out of 40000000 steps (68%).
17:54:06:WU00:FS00:0xa4:Completed 2400000 out of 2500000 steps  (96%)
18:01:01:WU00:FS00:0xa4:Completed 2425000 out of 2500000 steps  (97%)
18:07:59:WU00:FS00:0xa4:Completed 2450000 out of 2500000 steps  (98%)
18:14:53:WU00:FS00:0xa4:Completed 2475000 out of 2500000 steps  (99%)
18:14:54:WU02:FS00:Connecting to 171.67.108.200:8080
18:14:55:WU02:FS00:Assigned to work server 171.64.65.124
18:14:55:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:8 from 171.64.65.124
18:14:55:WU02:FS00:Connecting to 171.64.65.124:8080
18:14:56:WU02:FS00:Downloading 806.63KiB
18:14:57:WU02:FS00:Download complete
18:14:58:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9018 run:7 clone:0 gen:31 core:0xa4 unit:0x00000027ab40417c55b2ce4dde1f0516
18:21:48:WU00:FS00:0xa4:Completed 2500000 out of 2500000 steps  (100%)
18:21:49:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
18:21:59:WU00:FS00:0xa4:
18:21:59:WU00:FS00:0xa4:Finished Work Unit:
18:21:59:WU00:FS00:0xa4:- Reading up to 3368160 from "00/wudata_01.trr": Read 3368160
18:21:59:WU00:FS00:0xa4:trr file hash check passed.
18:21:59:WU00:FS00:0xa4:- Reading up to 326692 from "00/wudata_01.xtc": Read 326692
18:21:59:WU00:FS00:0xa4:xtc file hash check passed.
18:21:59:WU00:FS00:0xa4:edr file hash check passed.
18:21:59:WU00:FS00:0xa4:logfile size: 58698
18:21:59:WU00:FS00:0xa4:Leaving Run
18:22:02:WU00:FS00:0xa4:- Writing 3790650 bytes of core data to disk...
18:22:03:WU00:FS00:0xa4:Done: 3790138 -> 3248244 (compressed to 85.7 percent)
18:22:03:WU00:FS00:0xa4:  ... Done.
18:22:04:WU00:FS00:0xa4:- Shutting down core
18:22:04:WU00:FS00:0xa4:
18:22:04:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
18:22:04:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
18:22:04:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:6381 run:4 clone:4 gen:377 core:0xa4 unit:0x000001980002894c53d260c54325b5f2
18:22:04:WU00:FS00:Uploading 3.10MiB to 155.247.166.220
18:22:04:WU00:FS00:Connecting to 155.247.166.220:8080
18:22:04:WU02:FS00:Starting
18:22:04:WU02:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -np 8
18:22:04:WU02:FS00:Started FahCore on PID 4276
18:22:04:WU02:FS00:Core PID:688
18:22:04:WU02:FS00:FahCore 0xa4 started
18:22:05:WU02:FS00:0xa4:
18:22:05:WU02:FS00:0xa4:*------------------------------*
18:22:05:WU02:FS00:0xa4:Folding@Home Gromacs GB Core
18:22:05:WU02:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
18:22:05:WU02:FS00:0xa4:
18:22:05:WU02:FS00:0xa4:Preparing to commence simulation
18:22:05:WU02:FS00:0xa4:- Looking at optimizations...
18:22:05:WU02:FS00:0xa4:- Created dyn
18:22:05:WU02:FS00:0xa4:- Files status OK
18:22:05:WU02:FS00:0xa4:- Expanded 825477 -> 1399936 (decompressed 169.5 percent)
18:22:05:WU02:FS00:0xa4:Called DecompressByteArray: compressed_data_size=825477 data_size=1399936, decompressed_data_size=1399936 diff=0
18:22:05:WU02:FS00:0xa4:- Digital signature verified
18:22:05:WU02:FS00:0xa4:
18:22:05:WU02:FS00:0xa4:Project: 9018 (Run 7, Clone 0, Gen 31)
18:22:05:WU02:FS00:0xa4:
18:22:05:WU02:FS00:0xa4:Assembly optimizations on if available.
18:22:05:WU02:FS00:0xa4:Entering M.D.
18:22:10:WU00:FS00:Upload 40.35%
18:22:11:WU02:FS00:0xa4:Mapping NT from 8 to 8 
18:22:11:WU02:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
18:22:16:WU00:FS00:Upload 86.74%
18:22:18:WU00:FS00:Upload complete
18:22:18:WU00:FS00:Server responded WORK_ACK (400)
18:22:18:WU00:FS00:Final credit estimate, 1092.00 points
18:22:19:WU00:FS00:Cleaning up
18:22:57:WU01:FS01:0x15:Completed  27600000 out of 40000000 steps (69%).
21:32:27:WU01:FS01:0x15:Completed  30000000 out of 40000000 steps (75%).
21:33:17:WU02:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
21:35:17:WU02:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
21:37:17:WU02:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
21:39:19:WU02:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
21:41:20:WU02:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
21:43:20:WU02:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
21:43:22:WU00:FS00:Connecting to 171.67.108.200:8080
21:43:23:WU00:FS00:Assigned to work server 155.247.166.220
21:43:23:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:8 from 155.247.166.220
21:43:23:WU00:FS00:Connecting to 155.247.166.220:8080
21:43:24:WU00:FS00:Downloading 199.08KiB
21:43:25:WU00:FS00:Download complete
21:43:25:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:6387 run:42 clone:9 gen:118 core:0xa4 unit:0x0000008b0002894c541755d4f5f016f7
21:45:21:WU02:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
21:45:22:WU02:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
21:45:32:WU02:FS00:0xa4:
21:45:32:WU02:FS00:0xa4:Finished Work Unit:
21:45:32:WU02:FS00:0xa4:- Reading up to 811680 from "02/wudata_01.trr": Read 811680
21:45:32:WU02:FS00:0xa4:trr file hash check passed.
21:45:32:WU02:FS00:0xa4:- Reading up to 746032 from "02/wudata_01.xtc": Read 746032
21:45:32:WU02:FS00:0xa4:xtc file hash check passed.
21:45:32:WU02:FS00:0xa4:edr file hash check passed.
21:45:32:WU02:FS00:0xa4:logfile size: 23280
21:45:32:WU02:FS00:0xa4:Leaving Run
21:45:35:WU02:FS00:0xa4:- Writing 1583480 bytes of core data to disk...
21:45:36:WU02:FS00:0xa4:Done: 1582968 -> 1537797 (compressed to 97.1 percent)
21:45:36:WU02:FS00:0xa4:  ... Done.
21:45:37:WU02:FS00:0xa4:- Shutting down core
21:45:37:WU02:FS00:0xa4:
21:45:37:WU02:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
21:45:37:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
21:45:37:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:9018 run:7 clone:0 gen:31 core:0xa4 unit:0x00000027ab40417c55b2ce4dde1f0516
21:45:37:WU02:FS00:Uploading 1.47MiB to 171.64.65.124
21:45:37:WU00:FS00:Starting
21:45:37:WU02:FS00:Connecting to 171.64.65.124:8080
21:45:37:WU00:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -np 8
21:45:37:WU00:FS00:Started FahCore on PID 716
21:45:37:WU00:FS00:Core PID:4700
21:45:37:WU00:FS00:FahCore 0xa4 started
21:45:38:WU00:FS00:0xa4:
21:45:38:WU00:FS00:0xa4:*------------------------------*
21:45:38:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
21:45:38:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
21:45:38:WU00:FS00:0xa4:
21:45:38:WU00:FS00:0xa4:Preparing to commence simulation
21:45:38:WU00:FS00:0xa4:- Looking at optimizations...
21:45:38:WU00:FS00:0xa4:- Created dyn
21:45:38:WU00:FS00:0xa4:- Files status OK
21:45:38:WU00:FS00:0xa4:- Expanded 203344 -> 427800 (decompressed 210.3 percent)
21:45:38:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=203344 data_size=427800, decompressed_data_size=427800 diff=0
21:45:38:WU00:FS00:0xa4:- Digital signature verified
21:45:38:WU00:FS00:0xa4:
21:45:38:WU00:FS00:0xa4:Project: 6387 (Run 42, Clone 9, Gen 118)
21:45:38:WU00:FS00:0xa4:
21:45:38:WU00:FS00:0xa4:Assembly optimizations on if available.
21:45:38:WU00:FS00:0xa4:Entering M.D.
21:45:43:WU02:FS00:Upload 55.38%
21:45:43:WU00:FS00:0xa4:Mapping NT from 8 to 8 
21:45:44:WU00:FS00:0xa4:Completed 0 out of 2500000 steps  (0%)
21:45:48:WU02:FS00:Upload complete
21:45:48:WU02:FS00:Server responded WORK_ACK (400)
21:45:48:WU02:FS00:Final credit estimate, 1351.00 points
21:45:48:WU02:FS00:Cleaning up
21:48:14:WU00:FS00:0xa4:Completed 25000 out of 2500000 steps  (1%)
21:50:43:WU00:FS00:0xa4:Completed 50000 out of 2500000 steps  (2%)
21:53:13:WU00:FS00:0xa4:Completed 75000 out of 2500000 steps  (3%)
21:55:41:WU00:FS00:0xa4:Completed 100000 out of 2500000 steps  (4%)
21:58:11:WU00:FS00:0xa4:Completed 125000 out of 2500000 steps  (5%)
22:00:39:WU00:FS00:0xa4:Completed 150000 out of 2500000 steps  (6%)
22:03:09:WU00:FS00:0xa4:Completed 175000 out of 2500000 steps  (7%)
22:04:02:WU01:FS01:0x15:Completed  30400000 out of 40000000 steps (76%).
22:05:43:WU00:FS00:0xa4:Completed 200000 out of 2500000 steps  (8%)
01:35:59:WU00:FS00:0xa4:Completed 2350000 out of 2500000 steps  (94%)
******************************* Date: 2015-09-19 *******************************
01:38:25:WU00:FS00:0xa4:Completed 2375000 out of 2500000 steps  (95%)
01:40:51:WU00:FS00:0xa4:Completed 2400000 out of 2500000 steps  (96%)
01:43:15:WU00:FS00:0xa4:Completed 2425000 out of 2500000 steps  (97%)
01:45:06:WU01:FS01:0x15:Completed  33200000 out of 40000000 steps (83%).
01:45:43:WU00:FS00:0xa4:Completed 2450000 out of 2500000 steps  (98%)
01:48:08:WU00:FS00:0xa4:Completed 2475000 out of 2500000 steps  (99%)
01:48:08:WU02:FS00:Connecting to 171.67.108.200:8080
01:48:09:WU02:FS00:Assigned to work server 171.64.65.124
01:48:09:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:8 from 171.64.65.124
01:48:09:WU02:FS00:Connecting to 171.64.65.124:8080
01:48:10:WU02:FS00:Downloading 807.26KiB
01:48:11:WU02:FS00:Download complete
01:48:11:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9027 run:890 clone:1 gen:7 core:0xa4 unit:0x00000007ab40417c55f396a6406b44fd
01:50:33:WU00:FS00:0xa4:Completed 2500000 out of 2500000 steps  (100%)
01:50:33:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
01:50:43:WU00:FS00:0xa4:
01:50:43:WU00:FS00:0xa4:Finished Work Unit:
01:50:43:WU00:FS00:0xa4:- Reading up to 1285776 from "00/wudata_01.trr": Read 1285776
01:50:43:WU00:FS00:0xa4:trr file hash check passed.
01:50:43:WU00:FS00:0xa4:- Reading up to 52024 from "00/wudata_01.xtc": Read 52024
01:50:43:WU00:FS00:0xa4:xtc file hash check passed.
01:50:43:WU00:FS00:0xa4:edr file hash check passed.
01:50:43:WU00:FS00:0xa4:logfile size: 54517
01:50:43:WU00:FS00:0xa4:Leaving Run
01:50:45:WU00:FS00:0xa4:- Writing 1429417 bytes of core data to disk...
01:50:45:WU00:FS00:0xa4:Done: 1428905 -> 1217129 (compressed to 85.1 percent)
01:50:45:WU00:FS00:0xa4:  ... Done.
01:50:46:WU00:FS00:0xa4:- Shutting down core
01:50:46:WU00:FS00:0xa4:
01:50:46:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
01:50:46:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
01:50:46:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:6387 run:42 clone:9 gen:118 core:0xa4 unit:0x0000008b0002894c541755d4f5f016f7
01:50:46:WU00:FS00:Uploading 1.16MiB to 155.247.166.220
01:50:46:WU00:FS00:Connecting to 155.247.166.220:8080
01:50:46:WU02:FS00:Starting
01:50:46:WU02:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -np 8
01:50:46:WU02:FS00:Started FahCore on PID 3524
01:50:46:WU02:FS00:Core PID:5624
01:50:46:WU02:FS00:FahCore 0xa4 started
01:50:47:WU02:FS00:0xa4:
01:50:47:WU02:FS00:0xa4:*------------------------------*
01:50:47:WU02:FS00:0xa4:Folding@Home Gromacs GB Core
01:50:47:WU02:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
01:50:47:WU02:FS00:0xa4:
01:50:47:WU02:FS00:0xa4:Preparing to commence simulation
01:50:47:WU02:FS00:0xa4:- Looking at optimizations...
01:50:47:WU02:FS00:0xa4:- Created dyn
01:50:47:WU02:FS00:0xa4:- Files status OK
01:50:47:WU02:FS00:0xa4:- Expanded 826127 -> 1403472 (decompressed 169.8 percent)
01:50:47:WU02:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826127 data_size=1403472, decompressed_data_size=1403472 diff=0
01:50:47:WU02:FS00:0xa4:- Digital signature verified
01:50:47:WU02:FS00:0xa4:
01:50:47:WU02:FS00:0xa4:Project: 9027 (Run 890, Clone 1, Gen 7)
01:50:47:WU02:FS00:0xa4:
01:50:47:WU02:FS00:0xa4:Assembly optimizations on if available.
01:50:47:WU02:FS00:0xa4:Entering M.D.
01:50:51:WU00:FS00:Upload complete
01:50:51:WU00:FS00:Server responded WORK_ACK (400)
01:50:51:WU00:FS00:Final credit estimate, 1620.00 points
01:50:51:WU00:FS00:Cleaning up
01:50:53:WU02:FS00:0xa4:Mapping NT from 8 to 8 
01:50:53:WU02:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
01:52:55:WU02:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
01:54:57:WU02:FS00:0xa4:Completed 5000 out of 250000 steps  (2%)
01:56:58:WU02:FS00:0xa4:Completed 7500 out of 250000 steps  (3%)
01:59:03:WU02:FS00:0xa4:Completed 10000 out of 250000 steps  (4%)
02:01:06:WU02:FS00:0xa4:Completed 12500 out of 250000 steps  (5%)
02:03:09:WU02:FS00:0xa4:Completed 15000 out of 250000 steps  (6%)
02:05:11:WU02:FS00:0xa4:Completed 17500 out of 250000 steps  (7%)
02:07:14:WU02:FS00:0xa4:Completed 20000 out of 250000 steps  (8%)
02:09:16:WU02:FS00:0xa4:Completed 22500 out of 250000 steps  (9%)
02:11:18:WU02:FS00:0xa4:Completed 25000 out of 250000 steps  (10%)
02:13:21:WU02:FS00:0xa4:Completed 27500 out of 250000 steps  (11%)
02:15:27:WU02:FS00:0xa4:Completed 30000 out of 250000 steps  (12%)
02:16:41:WU01:FS01:0x15:Completed  33600000 out of 40000000 steps (84%).
02:17:36:WU02:FS00:0xa4:Completed 32500 out of 250000 steps  (13%)
02:19:40:WU02:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
02:21:45:WU02:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
02:23:46:WU02:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
02:25:49:WU02:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
02:27:53:WU02:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
05:16:43:WU02:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
05:16:44:WU00:FS00:Connecting to 171.67.108.200:8080
05:16:45:WU00:FS00:Assigned to work server 155.247.166.220
05:16:45:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:8 from 155.247.166.220
05:16:45:WU00:FS00:Connecting to 155.247.166.220:8080
05:16:46:WU00:FS00:Downloading 199.88KiB
05:16:46:WU00:FS00:Download complete
05:16:46:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:6389 run:78 clone:3 gen:96 core:0xa4 unit:0x0000007c0002894c5417566b1b1f2fcd
05:18:51:WU02:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
05:18:54:WU02:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
05:19:04:WU02:FS00:0xa4:
05:19:04:WU02:FS00:0xa4:Finished Work Unit:
05:19:04:WU02:FS00:0xa4:- Reading up to 811560 from "02/wudata_01.trr": Read 811560
05:19:04:WU02:FS00:0xa4:trr file hash check passed.
05:19:04:WU02:FS00:0xa4:- Reading up to 746012 from "02/wudata_01.xtc": Read 746012
05:19:04:WU02:FS00:0xa4:xtc file hash check passed.
05:19:04:WU02:FS00:0xa4:edr file hash check passed.
05:19:04:WU02:FS00:0xa4:logfile size: 23284
05:19:04:WU02:FS00:0xa4:Leaving Run
05:19:05:WU02:FS00:0xa4:- Writing 1583344 bytes of core data to disk...
05:19:06:WU02:FS00:0xa4:Done: 1582832 -> 1537923 (compressed to 97.1 percent)
05:19:06:WU02:FS00:0xa4:  ... Done.
05:19:06:WU02:FS00:0xa4:- Shutting down core
05:19:06:WU02:FS00:0xa4:
05:19:06:WU02:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
05:19:07:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:19:07:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:9027 run:890 clone:1 gen:7 core:0xa4 unit:0x00000007ab40417c55f396a6406b44fd
05:19:07:WU02:FS00:Uploading 1.47MiB to 171.64.65.124
05:19:07:WU02:FS00:Connecting to 171.64.65.124:8080
05:19:07:WU00:FS00:Starting
05:19:07:WU00:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -np 8
05:19:07:WU00:FS00:Started FahCore on PID 1692
05:19:07:WU00:FS00:Core PID:1192
05:19:07:WU00:FS00:FahCore 0xa4 started
05:19:07:WU00:FS00:0xa4:
05:19:07:WU00:FS00:0xa4:*------------------------------*
05:19:07:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
05:19:07:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
05:19:07:WU00:FS00:0xa4:
05:19:07:WU00:FS00:0xa4:Preparing to commence simulation
05:19:07:WU00:FS00:0xa4:- Looking at optimizations...
05:19:07:WU00:FS00:0xa4:- Created dyn
05:19:07:WU00:FS00:0xa4:- Files status OK
05:19:07:WU00:FS00:0xa4:- Expanded 204162 -> 430180 (decompressed 210.7 percent)
05:19:07:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=204162 data_size=430180, decompressed_data_size=430180 diff=0
05:19:07:WU00:FS00:0xa4:- Digital signature verified
05:19:07:WU00:FS00:0xa4:
05:19:07:WU00:FS00:0xa4:Project: 6389 (Run 78, Clone 3, Gen 96)
05:19:07:WU00:FS00:0xa4:
05:19:07:WU00:FS00:0xa4:Assembly optimizations on if available.
05:19:07:WU00:FS00:0xa4:Entering M.D.
05:19:13:WU02:FS00:Upload 51.12%
05:19:13:WU00:FS00:0xa4:Mapping NT from 8 to 8 
05:19:13:WU00:FS00:0xa4:Completed 0 out of 2500000 steps  (0%)
05:19:18:WU02:FS00:Upload complete
05:19:18:WU02:FS00:Server responded WORK_ACK (400)
05:19:18:WU02:FS00:Final credit estimate, 1350.00 points
05:19:18:WU02:FS00:Cleaning up
05:21:41:WU00:FS00:0xa4:Completed 25000 out of 2500000 steps  (1%)
05:24:10:WU00:FS00:0xa4:Completed 50000 out of 2500000 steps  (2%)
05:26:10:WU01:FS01:0x15:Completed  36000000 out of 40000000 steps (90%).
05:26:38:WU00:FS00:0xa4:Completed 75000 out of 2500000 steps  (3%)
05:29:45:WU00:FS00:0xa4:Completed 100000 out of 2500000 steps  (4%)
05:32:11:WU00:FS00:0xa4:Completed 125000 out of 2500000 steps  (5%)
05:34:37:WU00:FS00:0xa4:Completed 150000 out of 2500000 steps  (6%)
09:25:13:WU00:FS00:0xa4:Completed 2475000 out of 2500000 steps  (99%)
09:25:16:WU02:FS00:Connecting to 171.67.108.200:8080
09:25:18:WU02:FS00:Assigned to work server 128.143.199.97
09:25:18:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:8 from 128.143.199.97
09:25:18:WU02:FS00:Connecting to 128.143.199.97:8080
09:25:19:WU02:FS00:Downloading 1.88MiB
09:25:20:WU02:FS00:Download complete
09:25:20:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:7527 run:44 clone:5 gen:106 core:0xa4 unit:0x0000008bfbcb017d558d524ab6fce56f
09:27:39:WU00:FS00:0xa4:Completed 2500000 out of 2500000 steps  (100%)
09:27:39:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
09:27:49:WU00:FS00:0xa4:
09:27:49:WU00:FS00:0xa4:Finished Work Unit:
09:27:49:WU00:FS00:0xa4:- Reading up to 1287072 from "00/wudata_01.trr": Read 1287072
09:27:49:WU00:FS00:0xa4:trr file hash check passed.
09:27:49:WU00:FS00:0xa4:- Reading up to 54160 from "00/wudata_01.xtc": Read 54160
09:27:49:WU00:FS00:0xa4:xtc file hash check passed.
09:27:49:WU00:FS00:0xa4:edr file hash check passed.
09:27:49:WU00:FS00:0xa4:logfile size: 53632
09:27:49:WU00:FS00:0xa4:Leaving Run
09:27:50:WU00:FS00:0xa4:- Writing 1431964 bytes of core data to disk...
09:27:51:WU00:FS00:0xa4:Done: 1431452 -> 1220394 (compressed to 85.2 percent)
09:27:51:WU00:FS00:0xa4:  ... Done.
09:27:51:WU00:FS00:0xa4:- Shutting down core
09:27:51:WU00:FS00:0xa4:
09:27:51:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
09:27:51:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:27:51:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:6389 run:78 clone:3 gen:96 core:0xa4 unit:0x0000007c0002894c5417566b1b1f2fcd
09:27:51:WU00:FS00:Uploading 1.16MiB to 155.247.166.220
09:27:51:WU00:FS00:Connecting to 155.247.166.220:8080
09:27:51:WU02:FS00:Starting
09:27:51:WU02:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -np 8
09:27:51:WU02:FS00:Started FahCore on PID 5824
09:27:51:WU02:FS00:Core PID:4756
09:27:51:WU02:FS00:FahCore 0xa4 started
09:27:52:WU02:FS00:0xa4:
09:27:52:WU02:FS00:0xa4:*------------------------------*
09:27:52:WU02:FS00:0xa4:Folding@Home Gromacs GB Core
09:27:52:WU02:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
09:27:52:WU02:FS00:0xa4:
09:27:52:WU02:FS00:0xa4:Preparing to commence simulation
09:27:52:WU02:FS00:0xa4:- Looking at optimizations...
09:27:52:WU02:FS00:0xa4:- Created dyn
09:27:52:WU02:FS00:0xa4:- Files status OK
09:27:52:WU02:FS00:0xa4:- Expanded 1971222 -> 2918352 (decompressed 148.0 percent)
09:27:52:WU02:FS00:0xa4:Called DecompressByteArray: compressed_data_size=1971222 data_size=2918352, decompressed_data_size=2918352 diff=0
09:27:52:WU02:FS00:0xa4:- Digital signature verified
09:27:52:WU02:FS00:0xa4:
09:27:52:WU02:FS00:0xa4:Project: 7527 (Run 44, Clone 5, Gen 106)
09:27:52:WU02:FS00:0xa4:
09:27:52:WU02:FS00:0xa4:Assembly optimizations on if available.
09:27:52:WU02:FS00:0xa4:Entering M.D.
09:27:56:WU00:FS00:Upload complete
09:27:56:WU00:FS00:Server responded WORK_ACK (400)
09:27:56:WU00:FS00:Final credit estimate, 1608.00 points
09:27:56:WU00:FS00:Cleaning up
09:27:58:WU02:FS00:0xa4:Mapping NT from 8 to 8 
09:27:58:WU02:FS00:0xa4:Completed 0 out of 500000 steps  (0%)
09:34:56:WU02:FS00:0xa4:Completed 5000 out of 500000 steps  (1%)
09:39:07:WU01:FS01:0x15:Completed  39200000 out of 40000000 steps (98%).
09:41:32:WU02:FS00:0xa4:Completed 10000 out of 500000 steps  (2%)
09:48:05:WU02:FS00:0xa4:Completed 15000 out of 500000 steps  (3%)
09:54:38:WU02:FS00:0xa4:Completed 20000 out of 500000 steps  (4%)
10:01:11:WU02:FS00:0xa4:Completed 25000 out of 500000 steps  (5%)
10:07:43:WU02:FS00:0xa4:Completed 30000 out of 500000 steps  (6%)
10:10:42:WU01:FS01:0x15:Completed  39600000 out of 40000000 steps (99%).
10:10:43:WU00:FS01:Connecting to 171.67.108.200:80
10:10:44:WU00:FS01:Assigned to work server 171.64.65.104
10:10:44:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GF108 [Quadro 600] from 171.64.65.104
10:10:44:WU00:FS01:Connecting to 171.64.65.104:8080
10:10:44:WU00:FS01:Downloading 9.84MiB
10:10:49:WU00:FS01:Download complete
10:10:49:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9205 run:0 clone:54 gen:12 core:0x21 unit:0x0000000f664f2dd055d4c82ef7273971
10:10:49:WU00:FS01:Downloading core from http://web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/beta/Core_21.fah
10:10:49:WU00:FS01:Connecting to web.stanford.edu:80
10:10:53:WU00:FS01:FahCore 21: Downloading 2.72MiB
10:10:54:WU00:FS01:FahCore 21: Download complete
10:10:55:WU00:FS01:Valid core signature
10:10:55:WU00:FS01:Unpacked 9.03MiB to cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe
10:14:21:WU02:FS00:0xa4:Completed 35000 out of 500000 steps  (7%)
10:20:54:WU02:FS00:0xa4:Completed 40000 out of 500000 steps  (8%)
10:27:26:WU02:FS00:0xa4:Completed 45000 out of 500000 steps  (9%)
10:34:00:WU02:FS00:0xa4:Completed 50000 out of 500000 steps  (10%)
10:40:33:WU02:FS00:0xa4:Completed 55000 out of 500000 steps  (11%)
10:42:16:WU01:FS01:0x15:Completed  40000000 out of 40000000 steps (100%).
10:42:19:WU01:FS01:0x15:Finished fah_main status=0
10:42:19:WU01:FS01:0x15:Successful run
10:42:19:WU01:FS01:0x15:DynamicWrapper: Finished Work Unit: sleep=10000
10:42:29:WU01:FS01:0x15:Reserved 761208 bytes for xtc file; Cosm status=0
10:42:29:WU01:FS01:0x15:Allocated 761208 bytes for xtc file
10:42:29:WU01:FS01:0x15:- Reading up to 761208 from "01/wudata_01.xtc": Read 761208
10:42:29:WU01:FS01:0x15:Read 761208 bytes from xtc file; available packet space=785669256
10:42:29:WU01:FS01:0x15:xtc file hash check passed.
10:42:29:WU01:FS01:0x15:Reserved 47688 47688 785669256 bytes for arc file=<01/wudata_01.trr> Cosm status=0
10:42:29:WU01:FS01:0x15:Allocated 47688 bytes for arc file
10:42:29:WU01:FS01:0x15:- Reading up to 47688 from "01/wudata_01.trr": Read 47688
10:42:29:WU01:FS01:0x15:Read 47688 bytes from arc file; available packet space=785621568
10:42:29:WU01:FS01:0x15:trr file hash check passed.
10:42:29:WU01:FS01:0x15:Allocated 544 bytes for edr file
10:42:29:WU01:FS01:0x15:Read bedfile
10:42:29:WU01:FS01:0x15:edr file hash check passed.
10:42:29:WU01:FS01:0x15:Allocated 37357 bytes for logfile
10:42:29:WU01:FS01:0x15:Read logfile
10:42:29:WU01:FS01:0x15:GuardedRun: success in DynamicWrapper
10:42:29:WU01:FS01:0x15:GuardedRun: done
10:42:29:WU01:FS01:0x15:Run: GuardedRun completed.
10:42:29:WU01:FS01:0x15:+ Opened results file
10:42:29:WU01:FS01:0x15:- Writing 847309 bytes of core data to disk...
10:42:30:WU01:FS01:0x15:Done: 846797 -> 818337 (compressed to 96.6 percent)
10:42:30:WU01:FS01:0x15:  ... Done.
10:42:30:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
10:42:30:WU01:FS01:0x15:Shutting down core 
10:42:30:WU01:FS01:0x15:
10:42:30:WU01:FS01:0x15:Folding@home Core Shutdown: FINISHED_UNIT
10:42:30:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
10:42:30:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:7623 run:142 clone:0 gen:518 core:0x15 unit:0x000002db664f2dd14fe4f945c46af6ee
10:42:30:WU01:FS01:Uploading 799.66KiB to 171.64.65.105
10:42:30:WU00:FS01:Starting
10:42:30:WU01:FS01:Connecting to 171.64.65.105:8080
10:42:30:WU00:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:42:30:WU00:FS01:Started FahCore on PID 2644
10:42:30:WU00:FS01:Core PID:2696
10:42:30:WU00:FS01:FahCore 0x21 started
10:42:31:WU00:FS01:0x21:*********************** Log Started 2015-09-19T10:42:30Z ***********************
10:42:31:WU00:FS01:0x21:Project: 9205 (Run 0, Clone 54, Gen 12)
10:42:31:WU00:FS01:0x21:Unit: 0x0000000f664f2dd055d4c82ef7273971
10:42:31:WU00:FS01:0x21:CPU: 0x00000000000000000000000000000000
10:42:31:WU00:FS01:0x21:Machine: 1
10:42:31:WU00:FS01:0x21:Reading tar file core.xml
10:42:31:WU00:FS01:0x21:Reading tar file system.xml
10:42:34:WU00:FS01:0x21:Reading tar file integrator.xml
10:42:34:WU00:FS01:0x21:Reading tar file state.xml
10:42:36:WU01:FS01:Upload 80.03%
10:42:37:WU00:FS01:0x21:Digital signatures verified
10:42:37:WU00:FS01:0x21:Folding@home GPU Core21 Folding@home Core
10:42:37:WU00:FS01:0x21:Version 0.0.12
10:42:38:WU01:FS01:Upload complete
10:42:38:WU01:FS01:Server responded WORK_ACK (400)
10:42:38:WU01:FS01:Final credit estimate, 14093.00 points
10:42:39:WU01:FS01:Cleaning up
10:44:09:WU00:FS01:0x21:ERROR:exception: bad allocation
10:44:09:WU00:FS01:0x21:Saving result file logfile_01.txt
10:44:09:WU00:FS01:0x21:Saving result file log.txt
10:44:09:WU00:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
10:44:09:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
10:44:09:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:9205 run:0 clone:54 gen:12 core:0x21 unit:0x0000000f664f2dd055d4c82ef7273971
10:44:09:WU00:FS01:Uploading 2.23KiB to 171.64.65.104
10:44:09:WU00:FS01:Connecting to 171.64.65.104:8080
10:44:10:WU00:FS01:Upload complete
10:44:10:WU01:FS01:Connecting to 171.67.108.200:80
10:44:10:WU00:FS01:Server responded WORK_ACK (400)
10:44:10:WU00:FS01:Cleaning up
10:44:11:WU01:FS01:Assigned to work server 171.64.65.104
10:44:11:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GF108 [Quadro 600] from 171.64.65.104
10:44:11:WU01:FS01:Connecting to 171.64.65.104:8080
10:44:12:WU01:FS01:Downloading 9.83MiB
10:44:18:WU01:FS01:Download 80.09%
10:44:19:WU01:FS01:Download complete
10:44:19:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9206 run:0 clone:30 gen:16 core:0x21 unit:0x00000017664f2dd055db8904b6c47243
10:44:19:WU01:FS01:Starting
10:44:19:WU01:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:44:19:WU01:FS01:Started FahCore on PID 2716
10:44:19:WU01:FS01:Core PID:5804
10:44:19:WU01:FS01:FahCore 0x21 started
10:44:20:WU01:FS01:0x21:*********************** Log Started 2015-09-19T10:44:19Z ***********************
10:44:20:WU01:FS01:0x21:Project: 9206 (Run 0, Clone 30, Gen 16)
10:44:20:WU01:FS01:0x21:Unit: 0x00000017664f2dd055db8904b6c47243
10:44:20:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
10:44:20:WU01:FS01:0x21:Machine: 1
10:44:20:WU01:FS01:0x21:Reading tar file core.xml
10:44:20:WU01:FS01:0x21:Reading tar file system.xml
10:44:23:WU01:FS01:0x21:Reading tar file integrator.xml
10:44:23:WU01:FS01:0x21:Reading tar file state.xml
10:44:26:WU01:FS01:0x21:Digital signatures verified
10:44:26:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
10:44:26:WU01:FS01:0x21:Version 0.0.12
10:45:53:WU01:FS01:0x21:ERROR:exception: bad allocation
10:45:53:WU01:FS01:0x21:Saving result file logfile_01.txt
10:45:53:WU01:FS01:0x21:Saving result file log.txt
10:45:53:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
10:45:53:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
10:45:53:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9206 run:0 clone:30 gen:16 core:0x21 unit:0x00000017664f2dd055db8904b6c47243
10:45:54:WU01:FS01:Uploading 2.25KiB to 171.64.65.104
10:45:54:WU01:FS01:Connecting to 171.64.65.104:8080
10:45:54:WU00:FS01:Connecting to 171.67.108.200:80
10:45:54:WU01:FS01:Upload complete
10:45:54:WU01:FS01:Server responded WORK_ACK (400)
10:45:54:WU01:FS01:Cleaning up
10:45:54:WU00:FS01:Assigned to work server 171.64.65.104
10:45:54:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GF108 [Quadro 600] from 171.64.65.104
10:45:54:WU00:FS01:Connecting to 171.64.65.104:8080
10:45:55:WU00:FS01:Downloading 9.84MiB
10:46:01:WU00:FS01:Download 40.02%
10:46:07:WU00:FS01:Download 81.31%
10:46:09:WU00:FS01:Download complete
10:46:09:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9205 run:0 clone:39 gen:13 core:0x21 unit:0x00000014664f2dd055d4c817a79c054e
10:46:09:WU00:FS01:Starting
10:46:09:WU00:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:46:09:WU00:FS01:Started FahCore on PID 5140
10:46:09:WU00:FS01:Core PID:5620
10:46:09:WU00:FS01:FahCore 0x21 started
10:46:10:WU00:FS01:0x21:*********************** Log Started 2015-09-19T10:46:10Z ***********************
10:46:10:WU00:FS01:0x21:Project: 9205 (Run 0, Clone 39, Gen 13)
10:46:10:WU00:FS01:0x21:Unit: 0x00000014664f2dd055d4c817a79c054e
10:46:10:WU00:FS01:0x21:CPU: 0x00000000000000000000000000000000
10:46:10:WU00:FS01:0x21:Machine: 1
10:46:10:WU00:FS01:0x21:Reading tar file core.xml
10:46:10:WU00:FS01:0x21:Reading tar file system.xml
10:46:13:WU00:FS01:0x21:Reading tar file integrator.xml
10:46:13:WU00:FS01:0x21:Reading tar file state.xml
10:46:16:WU00:FS01:0x21:Digital signatures verified
10:46:16:WU00:FS01:0x21:Folding@home GPU Core21 Folding@home Core
10:46:16:WU00:FS01:0x21:Version 0.0.12
10:47:37:WU00:FS01:0x21:ERROR:exception: bad allocation
10:47:37:WU00:FS01:0x21:Saving result file logfile_01.txt
10:47:37:WU00:FS01:0x21:Saving result file log.txt
10:47:37:WU00:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
10:47:37:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
10:47:38:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:9205 run:0 clone:39 gen:13 core:0x21 unit:0x00000014664f2dd055d4c817a79c054e
10:47:38:WU00:FS01:Uploading 2.25KiB to 171.64.65.104
10:47:38:WU00:FS01:Connecting to 171.64.65.104:8080
10:47:38:WU01:FS01:Connecting to 171.67.108.200:80
10:47:39:WU00:FS01:Upload complete
10:47:39:WU00:FS01:Server responded WORK_ACK (400)
10:47:39:WU00:FS01:Cleaning up
10:47:40:WU01:FS01:Assigned to work server 171.64.65.104
10:47:40:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GF108 [Quadro 600] from 171.64.65.104
10:47:40:WU01:FS01:Connecting to 171.64.65.104:8080
10:47:41:WU01:FS01:Downloading 9.83MiB
10:47:47:WU01:FS01:Download 60.40%
10:47:51:WU01:FS01:Download complete
10:47:51:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9206 run:0 clone:86 gen:6 core:0x21 unit:0x00000009664f2dd055db893e1b92e6f9
10:47:51:WU01:FS01:Starting
10:47:51:WU01:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:47:51:WU01:FS01:Started FahCore on PID 5908
10:47:51:WU01:FS01:Core PID:160
10:47:51:WU01:FS01:FahCore 0x21 started
10:47:51:WU01:FS01:0x21:*********************** Log Started 2015-09-19T10:47:51Z ***********************
10:47:51:WU01:FS01:0x21:Project: 9206 (Run 0, Clone 86, Gen 6)
10:47:51:WU01:FS01:0x21:Unit: 0x00000009664f2dd055db893e1b92e6f9
10:47:51:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
10:47:51:WU01:FS01:0x21:Machine: 1
10:47:51:WU01:FS01:0x21:Reading tar file core.xml
10:47:51:WU01:FS01:0x21:Reading tar file system.xml
10:47:54:WU01:FS01:0x21:Reading tar file integrator.xml
10:47:54:WU01:FS01:0x21:Reading tar file state.xml
10:47:58:WU01:FS01:0x21:Digital signatures verified
10:47:58:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
10:47:58:WU01:FS01:0x21:Version 0.0.12
10:51:14:WU01:FS01:0x21:Completed 0 out of 2500000 steps (0%)
10:51:14:WU01:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
10:52:48:WU02:FS00:0xa4:Completed 60000 out of 500000 steps  (12%)
12:33:39:WU02:FS00:0xa4:Completed 125000 out of 500000 steps  (25%)
12:41:24:WU02:FS00:0xa4:Completed 130000 out of 500000 steps  (26%)
12:47:59:WU01:FS01:0x21:Completed 25000 out of 2500000 steps (1%)
13:35:39:WU02:FS00:0xa4:Completed 165000 out of 500000 steps  (33%)
******************************* Date: 2015-09-19 *******************************
13:43:27:WU02:FS00:0xa4:Completed 170000 out of 500000 steps  (34%)
21:52:00:WU02:FS00:0xa4:Completed 485000 out of 500000 steps  (97%)
21:59:45:WU02:FS00:0xa4:Completed 490000 out of 500000 steps  (98%)
22:07:29:WU02:FS00:0xa4:Completed 495000 out of 500000 steps  (99%)
22:07:30:WU00:FS00:Connecting to 171.67.108.200:8080
22:07:31:WU00:FS00:Assigned to work server 155.247.166.220
22:07:31:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:8 from 155.247.166.220
22:07:31:WU00:FS00:Connecting to 155.247.166.220:8080
22:07:31:WU00:FS00:Downloading 241.40KiB
22:07:31:WU00:FS00:Download complete
22:07:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8607 run:12 clone:6 gen:104 core:0xa4 unit:0x000000880002894c55a952144ae95f11
22:15:15:WU02:FS00:0xa4:Completed 500000 out of 500000 steps  (100%)
22:15:16:WU02:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
22:15:26:WU02:FS00:0xa4:
22:15:26:WU02:FS00:0xa4:Finished Work Unit:
22:15:26:WU02:FS00:0xa4:- Reading up to 5697144 from "02/wudata_01.trr": Read 5697144
22:15:26:WU02:FS00:0xa4:trr file hash check passed.
22:15:26:WU02:FS00:0xa4:- Reading up to 6112676 from "02/wudata_01.xtc": Read 6112676
22:15:26:WU02:FS00:0xa4:xtc file hash check passed.
22:15:26:WU02:FS00:0xa4:edr file hash check passed.
22:15:26:WU02:FS00:0xa4:logfile size: 341250
22:15:26:WU02:FS00:0xa4:Leaving Run
22:15:27:WU02:FS00:0xa4:- Writing 12184098 bytes of core data to disk...
22:15:33:WU02:FS00:0xa4:Done: 12183586 -> 11575622 (compressed to 95.0 percent)
22:15:33:WU02:FS00:0xa4:  ... Done.
22:15:34:WU02:FS00:0xa4:- Shutting down core
22:15:34:WU02:FS00:0xa4:
22:15:34:WU02:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
22:15:35:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
22:15:35:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:7527 run:44 clone:5 gen:106 core:0xa4 unit:0x0000008bfbcb017d558d524ab6fce56f
22:15:35:WU02:FS00:Uploading 11.04MiB to 128.143.199.97
22:15:35:WU02:FS00:Connecting to 128.143.199.97:8080
22:15:35:WU00:FS00:Starting
22:15:35:WU00:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/Users/Mandli_06/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 2936 -checkpoint 15 -np 8
22:15:35:WU00:FS00:Started FahCore on PID 2920
22:15:35:WU00:FS00:Core PID:3436
22:15:35:WU00:FS00:FahCore 0xa4 started
22:15:36:WU00:FS00:0xa4:
22:15:36:WU00:FS00:0xa4:*------------------------------*
22:15:36:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
22:15:36:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
22:15:36:WU00:FS00:0xa4:
22:15:36:WU00:FS00:0xa4:Preparing to commence simulation
22:15:36:WU00:FS00:0xa4:- Looking at optimizations...
22:15:36:WU00:FS00:0xa4:- Created dyn
22:15:36:WU00:FS00:0xa4:- Files status OK
22:15:36:WU00:FS00:0xa4:- Expanded 246682 -> 524512 (decompressed 212.6 percent)
22:15:36:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=246682 data_size=524512, decompressed_data_size=524512 diff=0
22:15:36:WU00:FS00:0xa4:- Digital signature verified
22:15:36:WU00:FS00:0xa4:
22:15:36:WU00:FS00:0xa4:Project: 8607 (Run 12, Clone 6, Gen 104)
22:15:36:WU00:FS00:0xa4:
22:15:36:WU00:FS00:0xa4:Assembly optimizations on if available.
22:15:36:WU00:FS00:0xa4:Entering M.D.
22:15:41:WU02:FS00:Upload 10.19%
22:15:41:WU00:FS00:0xa4:Mapping NT from 8 to 8 
22:15:42:WU00:FS00:0xa4:Completed 0 out of 2500000 steps  (0%)
22:15:47:WU02:FS00:Upload 20.38%
22:15:53:WU02:FS00:Upload 30.57%
22:15:59:WU02:FS00:Upload 41.33%
22:16:05:WU02:FS00:Upload 51.52%
22:16:11:WU02:FS00:Upload 62.27%
22:16:17:WU02:FS00:Upload 73.03%
22:16:23:WU02:FS00:Upload 83.22%
22:16:29:WU02:FS00:Upload 92.85%
22:16:35:WU02:FS00:Upload complete
22:16:36:WU02:FS00:Server responded WORK_ACK (400)
22:16:36:WU02:FS00:Final credit estimate, 3067.00 points
22:16:36:WU02:FS00:Cleaning up
22:19:02:WU00:FS00:0xa4:Completed 25000 out of 2500000 steps  (1%)
22:22:23:WU00:FS00:0xa4:Completed 50000 out of 2500000 steps  (2%)
22:25:41:WU00:FS00:0xa4:Completed 75000 out of 2500000 steps  (3%)
22:27:48:WU01:FS01:0x21:Completed 150000 out of 2500000 steps (6%)
22:29:00:WU00:FS00:0xa4:Completed 100000 out of 2500000 steps  (4%)
22:32:22:WU00:FS00:0xa4:Completed 125000 out of 2500000 steps  (5%)

Re: Deadline problem with Core21 on Fermi

Posted: Wed Sep 23, 2015 8:01 pm
by davidcoton
My guess is there is an error on the assignment server code, or possibly just an unintended consequence. Flagging "Beta" and "Small" should not result in the assignment of Beta WUs, but older (Core15) ones that the older GPUs can cope with. It's a deliberate misuse of Beta (by PG, not by users) but here the 9205/6 WUs seem to think they qualify for this config, when they should not. I'll try to point the project team at your post....

Re: Deadline problem with Core21 on Fermi

Posted: Wed Sep 23, 2015 10:08 pm
by davidcoton
@bruce: The log extract above does show the Beta/Small config and subsequent d/l of a 9205 and a 9206. Of course the log could have been edited to exclude removal of Small, but that seems unlikely.

Re: Deadline problem with Core21 on Fermi

Posted: Thu Sep 24, 2015 12:19 am
by 7im
Not sure the Beta/Small option works to force core_15 on Fermi and above cards.

It might be only for the older cards that cannot accept anything else. Newer cards can accept other types of work.

Re: Deadline problem with Core21 on Fermi

Posted: Thu Sep 24, 2015 1:44 am
by jadeshi
Thanks for the heads up, and apologies. I think this was due to some incorrect AS settings on my end. These should be fixed now.

@Kebast, let me know if you get any further x21 assigns.

Re: Deadline problem with Core21 on Fermi

Posted: Thu Sep 24, 2015 3:18 am
by Kebast
Will do, thanks!

Re: Deadline problem with Core21 on Fermi

Posted: Thu Sep 24, 2015 5:21 pm
by Kebast
Sounds like this has been resolved, but thought I'd post the original log that started me looking into this. My GF108 returned 13 9205/9206 WU as faulty in about a 10 hour span. When I noticed it, I think the slot was colored red in Control and I had to remove it and add again to start it folding.

Code: Select all

*********************** Log Started 2015-09-09T10:35:51Z ***********************
10:35:51:************************* Folding@home Client *************************
10:35:51:      Website: http://folding.stanford.edu/
10:35:51:    Copyright: (c) 2009-2014 Stanford University
10:35:51:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
10:35:51:         Args: 
10:35:51:       Config: C:/ProgramData/FAHClient/config.xml
10:35:51:******************************** Build ********************************
10:35:51:      Version: 7.4.4
10:35:51:         Date: Mar 4 2014
10:35:51:         Time: 20:26:54
10:35:51:      SVN Rev: 4130
10:35:51:       Branch: fah/trunk/client
10:35:51:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
10:35:51:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
10:35:51:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
10:35:51:     Platform: win32 XP
10:35:51:         Bits: 32
10:35:51:         Mode: Release
10:35:51:******************************* System ********************************
10:35:51:          CPU: Intel(R) Xeon(R) CPU E5603 @ 1.60GHz
10:35:51:       CPU ID: GenuineIntel Family 6 Model 44 Stepping 2
10:35:51:         CPUs: 8
10:35:51:       Memory: 4.00GiB
10:35:51:  Free Memory: 3.10GiB
10:35:51:      Threads: WINDOWS_THREADS
10:35:51:   OS Version: 6.1
10:35:51:  Has Battery: false
10:35:51:   On Battery: false
10:35:51:   UTC Offset: -4
10:35:51:          PID: 2636
10:35:51:          CWD: C:/ProgramData/FAHClient
10:35:51:           OS: Windows 7 Professional
10:35:51:      OS Arch: AMD64
10:35:51:         GPUs: 2
10:35:51:        GPU 0: NVIDIA:1 G92 [Quadro FX 3700]
10:35:51:        GPU 1: NVIDIA:2 GF108 [Quadro 600]
10:35:51:         CUDA: 1.1
10:35:51:  CUDA Driver: 6050
10:35:51:Win32 Service: false
10:35:51:***********************************************************************
10:35:51:<config>
10:35:51:  <!-- Network -->
10:35:51:  <proxy v=':8080'/>
10:35:51:
10:35:51:  <!-- Slot Control -->
10:35:51:  <power v='full'/>
10:35:51:
10:35:51:  <!-- User Information -->
10:35:51:  <passkey v='********************************'/>
10:35:51:  <team v='229226'/>
10:35:51:  <user v='Kebast'/>
10:35:51:
10:35:51:  <!-- Folding Slots -->
10:35:51:  <slot id='0' type='CPU'/>
10:35:51:  <slot id='1' type='GPU'>
10:35:51:    <client-type v='beta'/>
10:35:51:    <max-packet-size v='small'/>
10:35:51:  </slot>
10:35:51:  <slot id='2' type='GPU'>
10:35:51:    <client-type v='beta'/>
10:35:51:    <max-packet-size v='small'/>
10:35:51:  </slot>
10:35:51:</config>
10:35:51:Trying to access database...
10:35:52:Successfully acquired database lock
10:35:52:Enabled folding slot 00: READY cpu:6
10:35:52:Enabled folding slot 01: READY gpu:0:G92 [Quadro FX 3700]
10:35:52:Enabled folding slot 02: READY gpu:1:GF108 [Quadro 600]
10:35:52:WU01:FS01:Starting
10:35:52:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/G80/beta/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:35:52:WU01:FS01:Started FahCore on PID 2700
10:35:53:WU01:FS01:Core PID:2784
10:35:53:WU01:FS01:FahCore 0x15 started
10:35:53:WU00:FS00:Starting
10:35:53:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -np 6
10:35:53:WU00:FS00:Started FahCore on PID 2824
10:35:54:WU00:FS00:Core PID:2920
10:35:54:WU00:FS00:FahCore 0xa4 started
10:35:54:WU01:FS01:0x15:
10:35:54:WU01:FS01:0x15:*------------------------------*
10:35:54:WU01:FS01:0x15:Folding@Home GPU Core
10:35:54:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
10:35:54:WU01:FS01:0x15:Build host             AmoebaRemote
10:35:54:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
10:35:54:WU01:FS01:0x15:Core                   15
10:35:54:WU01:FS01:0x15:
10:35:54:WU01:FS01:0x15:Window's signal control handler registered.
10:35:54:WU01:FS01:0x15:Preparing to commence simulation
10:35:54:WU01:FS01:0x15:- Ensuring status. Please wait.
10:35:54:WU03:FS02:Starting
10:35:54:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 03 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
10:35:54:WU03:FS02:Started FahCore on PID 2440
10:35:54:WU03:FS02:Core PID:2988
10:35:54:WU03:FS02:FahCore 0x21 started
10:35:54:WU00:FS00:0xa4:
10:35:54:WU00:FS00:0xa4:*------------------------------*
10:35:54:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
10:35:54:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
10:35:54:WU00:FS00:0xa4:
10:35:54:WU00:FS00:0xa4:Preparing to commence simulation
10:35:54:WU00:FS00:0xa4:- Ensuring status. Please wait.
10:35:55:WU03:FS02:0x21:*********************** Log Started 2015-09-09T10:35:55Z ***********************
10:35:55:WU03:FS02:0x21:Project: 9206 (Run 0, Clone 50, Gen 0)
10:35:55:WU03:FS02:0x21:Unit: 0x00000000664f2dd055db89207359cab9
10:35:55:WU03:FS02:0x21:CPU: 0x00000000000000000000000000000000
10:35:55:WU03:FS02:0x21:Machine: 2
10:35:55:WU03:FS02:0x21:Digital signatures verified
10:35:55:WU03:FS02:0x21:Folding@home GPU Core21 Folding@home Core
10:35:55:WU03:FS02:0x21:Version 0.0.11
10:36:03:WU01:FS01:0x15:- Looking at optimizations...
10:36:03:WU01:FS01:0x15:- Working with standard loops on this execution.
10:36:03:WU01:FS01:0x15:- Previous termination of core was improper.
10:36:03:WU01:FS01:0x15:- Files status OK
10:36:03:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
10:36:03:WU01:FS01:0x15:- Expanded 125295 -> 503186 (decompressed 401.6 percent)
10:36:03:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=125295 data_size=503186, decompressed_data_size=503186 diff=0
10:36:03:WU01:FS01:0x15:- Digital signature verified
10:36:03:WU01:FS01:0x15:
10:36:03:WU01:FS01:0x15:Project: 7627 (Run 76, Clone 0, Gen 510)
10:36:03:WU01:FS01:0x15:
10:36:03:WU01:FS01:0x15:Entering M.D.
10:36:03:WU00:FS00:0xa4:- Looking at optimizations...
10:36:03:WU00:FS00:0xa4:- Working with standard loops on this execution.
10:36:03:WU00:FS00:0xa4:- Previous termination of core was improper.
10:36:03:WU00:FS00:0xa4:- Files status OK
10:36:03:WU00:FS00:0xa4:- Expanded 246999 -> 524512 (decompressed 212.3 percent)
10:36:03:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=246999 data_size=524512, decompressed_data_size=524512 diff=0
10:36:03:WU00:FS00:0xa4:- Digital signature verified
10:36:03:WU00:FS00:0xa4:
10:36:03:WU00:FS00:0xa4:Project: 8607 (Run 6, Clone 78, Gen 81)
10:36:03:WU00:FS00:0xa4:
10:36:03:WU00:FS00:0xa4:Entering M.D.
10:36:05:WU01:FS01:0x15:Will resume from checkpoint file 01/wudata_01.ckp
10:36:05:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  2525151301 421532481 3646946503 196754345 525167830
10:36:05:WU01:FS01:0x15:GPU device id=0
10:36:05:WU01:FS01:0x15:Working on Protein
10:36:05:WU01:FS01:0x15:Client config unavailable.
10:36:05:WU01:FS01:0x15:Starting GUI Server
10:36:09:WU00:FS00:0xa4:Using Gromacs checkpoints
10:36:09:WU00:FS00:0xa4:Mapping NT from 6 to 6 
10:36:10:WU00:FS00:0xa4:Resuming from checkpoint
10:36:10:WU00:FS00:0xa4:Verified 00/wudata_01.log
10:36:10:WU00:FS00:0xa4:Verified 00/wudata_01.trr
10:36:10:WU00:FS00:0xa4:Verified 00/wudata_01.xtc
10:36:10:WU00:FS00:0xa4:Verified 00/wudata_01.edr
10:36:10:WU00:FS00:0xa4:Completed 816500 out of 2500000 steps  (32%)
10:37:16:WU01:FS01:0x15:Resuming from checkpoint
10:37:16:WU01:FS01:0x15:fcCheckPointResume: retreived and current tpr file hash:
10:37:16:WU01:FS01:0x15:   0   2525151301   2525151301
10:37:16:WU01:FS01:0x15:   1    421532481    421532481
10:37:16:WU01:FS01:0x15:   2   3646946503   3646946503
10:37:16:WU01:FS01:0x15:   3    196754345    196754345
10:37:16:WU01:FS01:0x15:   4    525167830    525167830
10:37:16:WU01:FS01:0x15:fcCheckPointResume: file hashes same.
10:37:16:WU01:FS01:0x15:fcCheckPointResume: state restored.
10:37:16:WU01:FS01:0x15:fcCheckPointResume: name 01/wudata_01.log Verified 01/wudata_01.log
10:37:16:WU01:FS01:0x15:fcCheckPointResume: name 01/wudata_01.trr Verified 01/wudata_01.trr
10:37:16:WU01:FS01:0x15:fcCheckPointResume: name 01/wudata_01.xtc Verified 01/wudata_01.xtc
10:37:16:WU01:FS01:0x15:fcCheckPointResume: name 01/wudata_01.edr Verified 01/wudata_01.edr
10:37:16:WU01:FS01:0x15:fcCheckPointResume: state restored 2
10:37:16:WU01:FS01:0x15:Resumed from checkpoint
10:37:16:WU01:FS01:0x15:Setting checkpoint frequency: 400000
10:37:16:WU01:FS01:0x15:Completed  10000001 out of 40000000 steps (25%).
10:37:17:WARNING:WU01:FS01:Detected clock skew (1 mins 14 secs), adjusting time estimates
10:37:38:WU00:FS00:0xa4:Completed 825000 out of 2500000 steps  (33%)
10:38:37:WU03:FS02:0x21:Completed 0 out of 2500000 steps (0%)
10:38:37:WU03:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
10:44:21:WU00:FS00:0xa4:Completed 850000 out of 2500000 steps  (34%)
10:48:18:WU00:FS00:0xa4:Completed 875000 out of 2500000 steps  (35%)
10:52:09:WU00:FS00:0xa4:Completed 900000 out of 2500000 steps  (36%)
10:56:00:WU00:FS00:0xa4:Completed 925000 out of 2500000 steps  (37%)
10:59:51:WU00:FS00:0xa4:Completed 950000 out of 2500000 steps  (38%)
11:03:12:WU01:FS01:0x15:Completed  10400000 out of 40000000 steps (26%).
11:03:43:WU00:FS00:0xa4:Completed 975000 out of 2500000 steps  (39%)
11:07:34:WU00:FS00:0xa4:Completed 1000000 out of 2500000 steps  (40%)
11:11:27:WU00:FS00:0xa4:Completed 1025000 out of 2500000 steps  (41%)
11:15:21:WU00:FS00:0xa4:Completed 1050000 out of 2500000 steps  (42%)
11:19:02:WU00:FS00:0xa4:Completed 1075000 out of 2500000 steps  (43%)
11:22:43:WU00:FS00:0xa4:Completed 1100000 out of 2500000 steps  (44%)
11:26:22:WU00:FS00:0xa4:Completed 1125000 out of 2500000 steps  (45%)
11:28:52:WU01:FS01:0x15:Completed  10800000 out of 40000000 steps (27%).
11:30:02:WU00:FS00:0xa4:Completed 1150000 out of 2500000 steps  (46%)
11:33:42:WU00:FS00:0xa4:Completed 1175000 out of 2500000 steps  (47%)
11:37:23:WU00:FS00:0xa4:Completed 1200000 out of 2500000 steps  (48%)
11:41:02:WU00:FS00:0xa4:Completed 1225000 out of 2500000 steps  (49%)
11:44:42:WU00:FS00:0xa4:Completed 1250000 out of 2500000 steps  (50%)
11:48:22:WU00:FS00:0xa4:Completed 1275000 out of 2500000 steps  (51%)
11:52:03:WU00:FS00:0xa4:Completed 1300000 out of 2500000 steps  (52%)
11:54:31:WU01:FS01:0x15:Completed  11200000 out of 40000000 steps (28%).
11:55:42:WU00:FS00:0xa4:Completed 1325000 out of 2500000 steps  (53%)
11:59:22:WU00:FS00:0xa4:Completed 1350000 out of 2500000 steps  (54%)
12:03:03:WU00:FS00:0xa4:Completed 1375000 out of 2500000 steps  (55%)
12:06:43:WU00:FS00:0xa4:Completed 1400000 out of 2500000 steps  (56%)
12:10:24:WU00:FS00:0xa4:Completed 1425000 out of 2500000 steps  (57%)
12:14:04:WU00:FS00:0xa4:Completed 1450000 out of 2500000 steps  (58%)
12:17:44:WU00:FS00:0xa4:Completed 1475000 out of 2500000 steps  (59%)
12:20:11:WU01:FS01:0x15:Completed  11600000 out of 40000000 steps (29%).
12:21:25:WU00:FS00:0xa4:Completed 1500000 out of 2500000 steps  (60%)
12:23:46:WU03:FS02:0x21:Completed 25000 out of 2500000 steps (1%)
12:25:05:WU00:FS00:0xa4:Completed 1525000 out of 2500000 steps  (61%)
12:28:46:WU00:FS00:0xa4:Completed 1550000 out of 2500000 steps  (62%)
12:32:26:WU00:FS00:0xa4:Completed 1575000 out of 2500000 steps  (63%)
12:36:07:WU00:FS00:0xa4:Completed 1600000 out of 2500000 steps  (64%)
12:39:48:WU00:FS00:0xa4:Completed 1625000 out of 2500000 steps  (65%)
12:43:29:WU00:FS00:0xa4:Completed 1650000 out of 2500000 steps  (66%)
12:45:51:WU01:FS01:0x15:Completed  12000000 out of 40000000 steps (30%).
12:47:10:WU00:FS00:0xa4:Completed 1675000 out of 2500000 steps  (67%)
12:50:52:WU00:FS00:0xa4:Completed 1700000 out of 2500000 steps  (68%)
12:54:33:WU00:FS00:0xa4:Completed 1725000 out of 2500000 steps  (69%)
12:58:14:WU00:FS00:0xa4:Completed 1750000 out of 2500000 steps  (70%)
13:01:55:WU00:FS00:0xa4:Completed 1775000 out of 2500000 steps  (71%)
13:05:36:WU00:FS00:0xa4:Completed 1800000 out of 2500000 steps  (72%)
13:09:17:WU00:FS00:0xa4:Completed 1825000 out of 2500000 steps  (73%)
13:11:30:WU01:FS01:0x15:Completed  12400000 out of 40000000 steps (31%).
13:12:57:WU00:FS00:0xa4:Completed 1850000 out of 2500000 steps  (74%)
13:16:38:WU00:FS00:0xa4:Completed 1875000 out of 2500000 steps  (75%)
13:20:19:WU00:FS00:0xa4:Completed 1900000 out of 2500000 steps  (76%)
13:24:00:WU00:FS00:0xa4:Completed 1925000 out of 2500000 steps  (77%)
13:27:41:WU00:FS00:0xa4:Completed 1950000 out of 2500000 steps  (78%)
13:31:21:WU00:FS00:0xa4:Completed 1975000 out of 2500000 steps  (79%)
13:35:02:WU00:FS00:0xa4:Completed 2000000 out of 2500000 steps  (80%)
13:37:10:WU01:FS01:0x15:Completed  12800000 out of 40000000 steps (32%).
13:38:43:WU00:FS00:0xa4:Completed 2025000 out of 2500000 steps  (81%)
13:42:24:WU00:FS00:0xa4:Completed 2050000 out of 2500000 steps  (82%)
13:46:04:WU00:FS00:0xa4:Completed 2075000 out of 2500000 steps  (83%)
13:49:44:WU00:FS00:0xa4:Completed 2100000 out of 2500000 steps  (84%)
13:53:25:WU00:FS00:0xa4:Completed 2125000 out of 2500000 steps  (85%)
13:57:05:WU00:FS00:0xa4:Completed 2150000 out of 2500000 steps  (86%)
14:00:46:WU00:FS00:0xa4:Completed 2175000 out of 2500000 steps  (87%)
14:02:50:WU01:FS01:0x15:Completed  13200000 out of 40000000 steps (33%).
14:04:27:WU00:FS00:0xa4:Completed 2200000 out of 2500000 steps  (88%)
14:08:08:WU00:FS00:0xa4:Completed 2225000 out of 2500000 steps  (89%)
14:11:49:WU00:FS00:0xa4:Completed 2250000 out of 2500000 steps  (90%)
14:13:47:WU03:FS02:0x21:Completed 50000 out of 2500000 steps (2%)
14:15:30:WU00:FS00:0xa4:Completed 2275000 out of 2500000 steps  (91%)
14:19:11:WU00:FS00:0xa4:Completed 2300000 out of 2500000 steps  (92%)
14:22:52:WU00:FS00:0xa4:Completed 2325000 out of 2500000 steps  (93%)
14:26:33:WU00:FS00:0xa4:Completed 2350000 out of 2500000 steps  (94%)
14:28:30:WU01:FS01:0x15:Completed  13600000 out of 40000000 steps (34%).
14:30:13:WU00:FS00:0xa4:Completed 2375000 out of 2500000 steps  (95%)
14:33:54:WU00:FS00:0xa4:Completed 2400000 out of 2500000 steps  (96%)
14:37:36:WU00:FS00:0xa4:Completed 2425000 out of 2500000 steps  (97%)
14:41:19:WU00:FS00:0xa4:Completed 2450000 out of 2500000 steps  (98%)
14:45:00:WU00:FS00:0xa4:Completed 2475000 out of 2500000 steps  (99%)
14:45:13:WARNING:WU02:FS00:Exception: Could not get IP address for assign3.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server. 
14:45:13:ERROR:WU02:FS00:Exception: Could not get an assignment
14:45:25:WARNING:WU02:FS00:Exception: Could not get IP address for assign3.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server. 
14:45:25:ERROR:WU02:FS00:Exception: Could not get an assignment
14:46:26:WARNING:WU02:FS00:Exception: Could not get IP address for assign4.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server. 
14:46:26:WU02:FS00:Connecting to 171.67.108.200:8080
14:46:27:WU02:FS00:Assigned to work server 171.64.65.99
14:46:27:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:6 from 171.64.65.99
14:46:27:WU02:FS00:Connecting to 171.64.65.99:8080
14:46:30:WU02:FS00:Downloading 6.23MiB
14:46:36:WU02:FS00:Download 93.24%
14:46:36:WU02:FS00:Download complete
14:46:36:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9752 run:1516 clone:0 gen:295 core:0xa4 unit:0x00000189ab404163554173acc3812a0a
14:48:41:WU00:FS00:0xa4:Completed 2500000 out of 2500000 steps  (100%)
14:48:41:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
14:48:51:WU00:FS00:0xa4:
14:48:51:WU00:FS00:0xa4:Finished Work Unit:
14:48:51:WU00:FS00:0xa4:- Reading up to 1553760 from "00/wudata_01.trr": Read 1553760
14:48:51:WU00:FS00:0xa4:trr file hash check passed.
14:48:51:WU00:FS00:0xa4:- Reading up to 66940 from "00/wudata_01.xtc": Read 66940
14:48:51:WU00:FS00:0xa4:xtc file hash check passed.
14:48:51:WU00:FS00:0xa4:edr file hash check passed.
14:48:51:WU00:FS00:0xa4:logfile size: 54752
14:48:51:WU00:FS00:0xa4:Leaving Run
14:48:53:WU00:FS00:0xa4:- Writing 1712552 bytes of core data to disk...
14:48:54:WU00:FS00:0xa4:Done: 1712040 -> 1452338 (compressed to 84.8 percent)
14:48:54:WU00:FS00:0xa4:  ... Done.
14:48:54:WU00:FS00:0xa4:- Shutting down core
14:48:54:WU00:FS00:0xa4:
14:48:54:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
14:48:55:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
14:48:55:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:8607 run:6 clone:78 gen:81 core:0xa4 unit:0x000000650002894c55a951ec7038a244
14:48:55:WU00:FS00:Uploading 1.39MiB to 155.247.166.220
14:48:55:WU00:FS00:Connecting to 155.247.166.220:8080
14:48:55:WU02:FS00:Starting
14:48:55:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -np 6
14:48:55:WU02:FS00:Started FahCore on PID 2524
14:48:55:WU02:FS00:Core PID:1424
14:48:55:WU02:FS00:FahCore 0xa4 started
14:48:56:WU02:FS00:0xa4:
14:48:56:WU02:FS00:0xa4:*------------------------------*
14:48:56:WU02:FS00:0xa4:Folding@Home Gromacs GB Core
14:48:56:WU02:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
14:48:56:WU02:FS00:0xa4:
14:48:56:WU02:FS00:0xa4:Preparing to commence simulation
14:48:56:WU02:FS00:0xa4:- Looking at optimizations...
14:48:56:WU02:FS00:0xa4:- Created dyn
14:48:56:WU02:FS00:0xa4:- Files status OK
14:49:00:WU02:FS00:0xa4:- Expanded 6535892 -> 22431316 (decompressed 343.2 percent)
14:49:00:WU02:FS00:0xa4:Called DecompressByteArray: compressed_data_size=6535892 data_size=22431316, decompressed_data_size=22431316 diff=0
14:49:00:WU02:FS00:0xa4:- Digital signature verified
14:49:00:WU02:FS00:0xa4:
14:49:00:WU02:FS00:0xa4:Project: 9752 (Run 1516, Clone 0, Gen 295)
14:49:00:WU02:FS00:0xa4:
14:49:00:WU02:FS00:0xa4:Assembly optimizations on if available.
14:49:00:WU02:FS00:0xa4:Entering M.D.
14:49:01:WU00:FS00:Upload 90.22%
14:49:01:WU00:FS00:Upload complete
14:49:02:WU00:FS00:Server responded WORK_ACK (400)
14:49:02:WU00:FS00:Final credit estimate, 1676.00 points
14:49:02:WU00:FS00:Cleaning up
14:49:06:WU02:FS00:0xa4:Mapping NT from 6 to 6 
14:49:09:WU02:FS00:0xa4:Completed 0 out of 80000 steps  (0%)
14:52:31:WU02:FS00:0xa4:Completed 800 out of 80000 steps  (1%)
14:54:09:WU01:FS01:0x15:Completed  14000000 out of 40000000 steps (35%).
14:55:54:WU02:FS00:0xa4:Completed 1600 out of 80000 steps  (2%)
14:59:16:WU02:FS00:0xa4:Completed 2400 out of 80000 steps  (3%)
15:02:39:WU02:FS00:0xa4:Completed 3200 out of 80000 steps  (4%)
15:06:02:WU02:FS00:0xa4:Completed 4000 out of 80000 steps  (5%)
15:09:24:WU02:FS00:0xa4:Completed 4800 out of 80000 steps  (6%)
15:12:47:WU02:FS00:0xa4:Completed 5600 out of 80000 steps  (7%)
15:16:10:WU02:FS00:0xa4:Completed 6400 out of 80000 steps  (8%)
15:19:34:WU02:FS00:0xa4:Completed 7200 out of 80000 steps  (9%)
15:19:49:WU01:FS01:0x15:Completed  14400000 out of 40000000 steps (36%).
15:22:58:WU02:FS00:0xa4:Completed 8000 out of 80000 steps  (10%)
15:26:21:WU02:FS00:0xa4:Completed 8800 out of 80000 steps  (11%)
15:29:43:WU02:FS00:0xa4:Completed 9600 out of 80000 steps  (12%)
15:33:06:WU02:FS00:0xa4:Completed 10400 out of 80000 steps  (13%)
15:36:30:WU02:FS00:0xa4:Completed 11200 out of 80000 steps  (14%)
15:39:54:WU02:FS00:0xa4:Completed 12000 out of 80000 steps  (15%)
15:43:17:WU02:FS00:0xa4:Completed 12800 out of 80000 steps  (16%)
15:44:03:WU03:FS02:0x21:ERROR:exception: Error downloading array energyBuffer: clEnqueueReadBuffer (-36)
15:44:03:WU03:FS02:0x21:Saving result file logfile_01.txt
15:44:03:WU03:FS02:0x21:Saving result file log.txt
15:44:03:WU03:FS02:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
15:44:04:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
15:44:04:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:9206 run:0 clone:50 gen:0 core:0x21 unit:0x00000000664f2dd055db89207359cab9
15:44:04:WU03:FS02:Uploading 2.77KiB to 171.64.65.104
15:44:04:WU03:FS02:Connecting to 171.64.65.104:8080
15:44:04:WU03:FS02:Upload complete
15:44:16:WARNING:WU00:FS02:Exception: Could not get IP address for assign-GPU.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server. 
15:44:16:ERROR:WU00:FS02:Exception: Could not get an assignment
15:44:16:WU03:FS02:Server responded WORK_ACK (400)
15:44:16:WU03:FS02:Cleaning up
15:44:29:WARNING:WU00:FS02:Exception: Could not get IP address for assign-GPU.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server. 
15:44:29:ERROR:WU00:FS02:Exception: Could not get an assignment
15:45:29:WARNING:WU00:FS02:Exception: Could not get IP address for assign-GPU2.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server. 
15:45:29:WU00:FS02:Connecting to 171.67.108.200:80
15:45:30:WU01:FS01:0x15:Completed  14800000 out of 40000000 steps (37%).
15:45:30:WU00:FS02:Assigned to work server 171.64.65.104
15:45:30:WU00:FS02:Requesting new work unit for slot 02: READY gpu:1:GF108 [Quadro 600] from 171.64.65.104
15:45:30:WU00:FS02:Connecting to 171.64.65.104:8080
15:45:31:WU00:FS02:Downloading 9.84MiB
15:45:34:WU00:FS02:Download complete
15:45:34:WU00:FS02:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9205 run:0 clone:13 gen:3 core:0x21 unit:0x00000003664f2dd055d4c7f12731352a
15:45:34:WU00:FS02:Starting
15:45:34:WU00:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
15:45:34:WU00:FS02:Started FahCore on PID 292
15:45:34:WU00:FS02:Core PID:912
15:45:34:WU00:FS02:FahCore 0x21 started
15:45:35:WU00:FS02:0x21:*********************** Log Started 2015-09-09T15:45:34Z ***********************
15:45:35:WU00:FS02:0x21:Project: 9205 (Run 0, Clone 13, Gen 3)
15:45:35:WU00:FS02:0x21:Unit: 0x00000003664f2dd055d4c7f12731352a
15:45:35:WU00:FS02:0x21:CPU: 0x00000000000000000000000000000000
15:45:35:WU00:FS02:0x21:Machine: 2
15:45:35:WU00:FS02:0x21:Reading tar file core.xml
15:45:35:WU00:FS02:0x21:Reading tar file system.xml
15:45:37:WU00:FS02:0x21:Reading tar file integrator.xml
15:45:37:WU00:FS02:0x21:Reading tar file state.xml
15:45:39:WU00:FS02:0x21:Digital signatures verified
15:45:39:WU00:FS02:0x21:Folding@home GPU Core21 Folding@home Core
15:45:39:WU00:FS02:0x21:Version 0.0.11
15:46:40:WU02:FS00:0xa4:Completed 13600 out of 80000 steps  (17%)
15:46:43:WU00:FS02:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-36)
15:46:43:WU00:FS02:0x21:Saving result file logfile_01.txt
15:46:43:WU00:FS02:0x21:Saving result file log.txt
15:46:43:WU00:FS02:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
15:46:43:WARNING:WU00:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
15:46:43:WU00:FS02:Sending unit results: id:00 state:SEND error:FAULTY project:9205 run:0 clone:13 gen:3 core:0x21 unit:0x00000003664f2dd055d4c7f12731352a
15:46:44:WU00:FS02:Uploading 2.27KiB to 171.64.65.104
15:46:44:WU00:FS02:Connecting to 171.64.65.104:8080
15:46:44:WU03:FS02:Connecting to 171.67.108.200:80
15:46:44:WU00:FS02:Upload complete
15:46:44:WU00:FS02:Server responded WORK_ACK (400)
15:46:44:WU00:FS02:Cleaning up
15:46:45:WU03:FS02:Assigned to work server 171.64.65.104
15:46:45:WU03:FS02:Requesting new work unit for slot 02: READY gpu:1:GF108 [Quadro 600] from 171.64.65.104
15:46:45:WU03:FS02:Connecting to 171.64.65.104:8080
15:46:45:WU03:FS02:Downloading 9.83MiB
15:46:48:WU03:FS02:Download complete
15:46:48:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:9206 run:0 clone:10 gen:8 core:0x21 unit:0x00000008664f2dd055db88e97e1e6481
15:46:48:WU03:FS02:Starting
15:46:48:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 03 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
15:46:48:WU03:FS02:Started FahCore on PID 2560
15:46:48:WU03:FS02:Core PID:1120
15:46:48:WU03:FS02:FahCore 0x21 started
15:46:49:WU03:FS02:0x21:*********************** Log Started 2015-09-09T15:46:48Z ***********************
15:46:49:WU03:FS02:0x21:Project: 9206 (Run 0, Clone 10, Gen 8)
15:46:49:WU03:FS02:0x21:Unit: 0x00000008664f2dd055db88e97e1e6481
15:46:49:WU03:FS02:0x21:CPU: 0x00000000000000000000000000000000
15:46:49:WU03:FS02:0x21:Machine: 2
15:46:49:WU03:FS02:0x21:Reading tar file core.xml
15:46:49:WU03:FS02:0x21:Reading tar file system.xml
15:46:51:WU03:FS02:0x21:Reading tar file integrator.xml
15:46:51:WU03:FS02:0x21:Reading tar file state.xml
15:46:53:WU03:FS02:0x21:Digital signatures verified
15:46:53:WU03:FS02:0x21:Folding@home GPU Core21 Folding@home Core
15:46:53:WU03:FS02:0x21:Version 0.0.11
15:47:57:WU03:FS02:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-36)
15:47:57:WU03:FS02:0x21:Saving result file logfile_01.txt
15:47:57:WU03:FS02:0x21:Saving result file log.txt
15:47:57:WU03:FS02:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
15:47:58:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
15:47:58:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:9206 run:0 clone:10 gen:8 core:0x21 unit:0x00000008664f2dd055db88e97e1e6481
15:47:58:WU03:FS02:Uploading 2.27KiB to 171.64.65.104
15:47:58:WU03:FS02:Connecting to 171.64.65.104:8080
15:47:58:WU00:FS02:Connecting to 171.67.108.200:80
15:47:59:WU03:FS02:Upload complete
15:47:59:WU03:FS02:Server responded WORK_ACK (400)
15:47:59:WU03:FS02:Cleaning up
15:47:59:WU00:FS02:Assigned to work server 171.64.65.104
15:47:59:WU00:FS02:Requesting new work unit for slot 02: READY gpu:1:GF108 [Quadro 600] from 171.64.65.104
15:47:59:WU00:FS02:Connecting to 171.64.65.104:8080
15:48:00:WU00:FS02:Downloading 9.84MiB
15:48:04:WU00:FS02:Download complete
15:48:04:WU00:FS02:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9205 run:0 clone:16 gen:1 core:0x21 unit:0x00000001664f2dd055d4c7f3381a99db
15:48:04:WU00:FS02:Starting
15:48:04:WU00:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
15:48:04:WU00:FS02:Started FahCore on PID 2432
15:48:04:WU00:FS02:Core PID:1700
15:48:04:WU00:FS02:FahCore 0x21 started
15:48:04:WU00:FS02:0x21:*********************** Log Started 2015-09-09T15:48:04Z ***********************
15:48:04:WU00:FS02:0x21:Project: 9205 (Run 0, Clone 16, Gen 1)
15:48:04:WU00:FS02:0x21:Unit: 0x00000001664f2dd055d4c7f3381a99db
15:48:04:WU00:FS02:0x21:CPU: 0x00000000000000000000000000000000
15:48:04:WU00:FS02:0x21:Machine: 2
15:48:04:WU00:FS02:0x21:Reading tar file core.xml
15:48:04:WU00:FS02:0x21:Reading tar file system.xml
15:48:06:WU00:FS02:0x21:Reading tar file integrator.xml
15:48:06:WU00:FS02:0x21:Reading tar file state.xml
15:48:09:WU00:FS02:0x21:Digital signatures verified
15:48:09:WU00:FS02:0x21:Folding@home GPU Core21 Folding@home Core
15:48:09:WU00:FS02:0x21:Version 0.0.11
15:49:15:WU00:FS02:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-36)
15:49:15:WU00:FS02:0x21:Saving result file logfile_01.txt
15:49:15:WU00:FS02:0x21:Saving result file log.txt
15:49:15:WU00:FS02:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
15:49:22:WARNING:WU00:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
15:49:22:WU00:FS02:Sending unit results: id:00 state:SEND error:FAULTY project:9205 run:0 clone:16 gen:1 core:0x21 unit:0x00000001664f2dd055d4c7f3381a99db
15:49:22:WU00:FS02:Uploading 2.26KiB to 171.64.65.104
15:49:22:WU00:FS02:Connecting to 171.64.65.104:8080
15:49:22:WU03:FS02:Connecting to 171.67.108.200:80
15:49:23:WU00:FS02:Upload complete
15:49:23:WU00:FS02:Server responded WORK_ACK (400)
15:49:23:WU00:FS02:Cleaning up
15:49:23:WU03:FS02:Assigned to work server 171.64.65.104
15:49:23:WU03:FS02:Requesting new work unit for slot 02: READY gpu:1:GF108 [Quadro 600] from 171.64.65.104
15:49:23:WU03:FS02:Connecting to 171.64.65.104:8080
15:49:24:WU03:FS02:Downloading 9.84MiB
15:49:28:WU03:FS02:Download complete
15:49:28:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:9205 run:0 clone:25 gen:1 core:0x21 unit:0x00000001664f2dd055d4c80a88cb3875
15:49:28:WU03:FS02:Starting
15:49:28:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 03 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
15:49:28:WU03:FS02:Started FahCore on PID 1868
15:49:28:WU03:FS02:Core PID:1928
15:49:28:WU03:FS02:FahCore 0x21 started
15:49:28:WU03:FS02:0x21:*********************** Log Started 2015-09-09T15:49:28Z ***********************
15:49:28:WU03:FS02:0x21:Project: 9205 (Run 0, Clone 25, Gen 1)
15:49:28:WU03:FS02:0x21:Unit: 0x00000001664f2dd055d4c80a88cb3875
15:49:28:WU03:FS02:0x21:CPU: 0x00000000000000000000000000000000
15:49:28:WU03:FS02:0x21:Machine: 2
15:49:28:WU03:FS02:0x21:Reading tar file core.xml
15:49:28:WU03:FS02:0x21:Reading tar file system.xml
15:49:30:WU03:FS02:0x21:Reading tar file integrator.xml
15:49:30:WU03:FS02:0x21:Reading tar file state.xml
15:49:33:WU03:FS02:0x21:Digital signatures verified
15:49:33:WU03:FS02:0x21:Folding@home GPU Core21 Folding@home Core
15:49:33:WU03:FS02:0x21:Version 0.0.11
15:50:07:WU02:FS00:0xa4:Completed 14400 out of 80000 steps  (18%)
15:50:37:WU03:FS02:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-36)
15:50:37:WU03:FS02:0x21:Saving result file logfile_01.txt
15:50:37:WU03:FS02:0x21:Saving result file log.txt
15:50:37:WU03:FS02:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
15:50:37:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
15:50:37:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:9205 run:0 clone:25 gen:1 core:0x21 unit:0x00000001664f2dd055d4c80a88cb3875
15:50:37:WU03:FS02:Uploading 2.26KiB to 171.64.65.104
15:50:37:WU03:FS02:Connecting to 171.64.65.104:8080
15:50:38:WU00:FS02:Connecting to 171.67.108.200:80
15:50:38:WU03:FS02:Upload complete
15:50:38:WU03:FS02:Server responded WORK_ACK (400)
15:50:38:WU03:FS02:Cleaning up
15:50:39:WU00:FS02:Assigned to work server 171.64.65.104
15:50:39:WU00:FS02:Requesting new work unit for slot 02: READY gpu:1:GF108 [Quadro 600] from 171.64.65.104
15:50:39:WU00:FS02:Connecting to 171.64.65.104:8080
15:50:39:WU00:FS02:Downloading 9.84MiB
15:50:42:WU00:FS02:Download complete
15:50:42:WU00:FS02:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9205 run:0 clone:27 gen:1 core:0x21 unit:0x00000001664f2dd055d4c80f13df2622
15:50:42:WU00:FS02:Starting
15:50:42:WU00:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
15:50:42:WU00:FS02:Started FahCore on PID 1772
15:50:42:WU00:FS02:Core PID:1696
15:50:42:WU00:FS02:FahCore 0x21 started
15:50:43:WU00:FS02:0x21:*********************** Log Started 2015-09-09T15:50:42Z ***********************
15:50:43:WU00:FS02:0x21:Project: 9205 (Run 0, Clone 27, Gen 1)
15:50:43:WU00:FS02:0x21:Unit: 0x00000001664f2dd055d4c80f13df2622
15:50:43:WU00:FS02:0x21:CPU: 0x00000000000000000000000000000000
15:50:43:WU00:FS02:0x21:Machine: 2
15:50:43:WU00:FS02:0x21:Reading tar file core.xml
15:50:43:WU00:FS02:0x21:Reading tar file system.xml
15:50:45:WU00:FS02:0x21:Reading tar file integrator.xml
15:50:45:WU00:FS02:0x21:Reading tar file state.xml
15:50:47:WU00:FS02:0x21:Digital signatures verified
15:50:47:WU00:FS02:0x21:Folding@home GPU Core21 Folding@home Core
15:50:47:WU00:FS02:0x21:Version 0.0.11
15:51:53:WU00:FS02:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-36)
15:51:53:WU00:FS02:0x21:Saving result file logfile_01.txt
15:51:53:WU00:FS02:0x21:Saving result file log.txt
15:51:53:WU00:FS02:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
15:52:00:WARNING:WU00:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
15:52:00:WU00:FS02:Sending unit results: id:00 state:SEND error:FAULTY project:9205 run:0 clone:27 gen:1 core:0x21 unit:0x00000001664f2dd055d4c80f13df2622
15:52:00:WU00:FS02:Uploading 2.27KiB to 171.64.65.104
15:52:00:WU00:FS02:Connecting to 171.64.65.104:8080
15:52:01:WU03:FS02:Connecting to 171.67.108.200:80
15:52:01:WU00:FS02:Upload complete
15:52:01:WU00:FS02:Server responded WORK_ACK (400)
15:52:01:WU00:FS02:Cleaning up
15:52:01:WU03:FS02:Assigned to work server 171.64.65.104
15:52:01:WU03:FS02:Requesting new work unit for slot 02: READY gpu:1:GF108 [Quadro 600] from 171.64.65.104
15:52:01:WU03:FS02:Connecting to 171.64.65.104:8080
15:52:02:WU03:FS02:Downloading 9.77MiB
15:52:06:WU03:FS02:Download complete
15:52:06:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:9206 run:0 clone:57 gen:0 core:0x21 unit:0x00000000664f2dd055db892495d57fe2
15:52:06:WU03:FS02:Starting
15:52:06:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 03 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
15:52:06:WU03:FS02:Started FahCore on PID 1472
15:52:06:WU03:FS02:Core PID:952
15:52:06:WU03:FS02:FahCore 0x21 started
15:52:07:WU03:FS02:0x21:*********************** Log Started 2015-09-09T15:52:06Z ***********************
15:52:07:WU03:FS02:0x21:Project: 9206 (Run 0, Clone 57, Gen 0)
15:52:07:WU03:FS02:0x21:Unit: 0x00000000664f2dd055db892495d57fe2
15:52:07:WU03:FS02:0x21:CPU: 0x00000000000000000000000000000000
15:52:07:WU03:FS02:0x21:Machine: 2
15:52:07:WU03:FS02:0x21:Reading tar file core.xml
15:52:07:WU03:FS02:0x21:Reading tar file system.xml
15:52:09:WU03:FS02:0x21:Reading tar file integrator.xml
15:52:09:WU03:FS02:0x21:Reading tar file state.xml
15:52:11:WU03:FS02:0x21:Digital signatures verified
15:52:11:WU03:FS02:0x21:Folding@home GPU Core21 Folding@home Core
15:52:11:WU03:FS02:0x21:Version 0.0.11
15:53:32:WU02:FS00:0xa4:Completed 15200 out of 80000 steps  (19%)
15:54:51:WU03:FS02:0x21:Completed 0 out of 2500000 steps (0%)
15:54:51:WU03:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:56:55:WU02:FS00:0xa4:Completed 16000 out of 80000 steps  (20%)
16:00:17:WU02:FS00:0xa4:Completed 16800 out of 80000 steps  (21%)
16:03:40:WU02:FS00:0xa4:Completed 17600 out of 80000 steps  (22%)
16:07:03:WU02:FS00:0xa4:Completed 18400 out of 80000 steps  (23%)
16:10:26:WU02:FS00:0xa4:Completed 19200 out of 80000 steps  (24%)
16:11:09:WU01:FS01:0x15:Completed  15200000 out of 40000000 steps (38%).
16:13:49:WU02:FS00:0xa4:Completed 20000 out of 80000 steps  (25%)
16:17:11:WU02:FS00:0xa4:Completed 20800 out of 80000 steps  (26%)
16:20:34:WU02:FS00:0xa4:Completed 21600 out of 80000 steps  (27%)
16:23:57:WU02:FS00:0xa4:Completed 22400 out of 80000 steps  (28%)
16:27:19:WU02:FS00:0xa4:Completed 23200 out of 80000 steps  (29%)
16:30:41:WU02:FS00:0xa4:Completed 24000 out of 80000 steps  (30%)
16:34:04:WU02:FS00:0xa4:Completed 24800 out of 80000 steps  (31%)
******************************* Date: 2015-09-09 *******************************
16:36:49:WU01:FS01:0x15:Completed  15600000 out of 40000000 steps (39%).
16:37:26:WU02:FS00:0xa4:Completed 25600 out of 80000 steps  (32%)
16:40:49:WU02:FS00:0xa4:Completed 26400 out of 80000 steps  (33%)
16:44:11:WU02:FS00:0xa4:Completed 27200 out of 80000 steps  (34%)
16:47:33:WU02:FS00:0xa4:Completed 28000 out of 80000 steps  (35%)
16:50:56:WU02:FS00:0xa4:Completed 28800 out of 80000 steps  (36%)
16:54:18:WU02:FS00:0xa4:Completed 29600 out of 80000 steps  (37%)
16:57:40:WU02:FS00:0xa4:Completed 30400 out of 80000 steps  (38%)
17:01:02:WU02:FS00:0xa4:Completed 31200 out of 80000 steps  (39%)
17:02:29:WU01:FS01:0x15:Completed  16000000 out of 40000000 steps (40%).
17:04:24:WU02:FS00:0xa4:Completed 32000 out of 80000 steps  (40%)
17:07:46:WU02:FS00:0xa4:Completed 32800 out of 80000 steps  (41%)
17:11:08:WU02:FS00:0xa4:Completed 33600 out of 80000 steps  (42%)
17:14:30:WU02:FS00:0xa4:Completed 34400 out of 80000 steps  (43%)
17:17:52:WU02:FS00:0xa4:Completed 35200 out of 80000 steps  (44%)
17:21:15:WU02:FS00:0xa4:Completed 36000 out of 80000 steps  (45%)
17:24:37:WU02:FS00:0xa4:Completed 36800 out of 80000 steps  (46%)
17:27:59:WU02:FS00:0xa4:Completed 37600 out of 80000 steps  (47%)
17:28:08:WU01:FS01:0x15:Completed  16400000 out of 40000000 steps (41%).
17:31:22:WU02:FS00:0xa4:Completed 38400 out of 80000 steps  (48%)
17:34:45:WU02:FS00:0xa4:Completed 39200 out of 80000 steps  (49%)
17:38:08:WU02:FS00:0xa4:Completed 40000 out of 80000 steps  (50%)
17:41:29:WU02:FS00:0xa4:Completed 40800 out of 80000 steps  (51%)
17:44:51:WU02:FS00:0xa4:Completed 41600 out of 80000 steps  (52%)
17:48:14:WU02:FS00:0xa4:Completed 42400 out of 80000 steps  (53%)
17:51:38:WU02:FS00:0xa4:Completed 43200 out of 80000 steps  (54%)
17:52:32:WU03:FS02:0x21:Completed 25000 out of 2500000 steps (1%)
17:53:48:WU01:FS01:0x15:Completed  16800000 out of 40000000 steps (42%).
17:54:59:WU02:FS00:0xa4:Completed 44000 out of 80000 steps  (55%)
17:58:22:WU02:FS00:0xa4:Completed 44800 out of 80000 steps  (56%)
18:01:45:WU02:FS00:0xa4:Completed 45600 out of 80000 steps  (57%)
18:05:09:WU02:FS00:0xa4:Completed 46400 out of 80000 steps  (58%)
18:08:32:WU02:FS00:0xa4:Completed 47200 out of 80000 steps  (59%)
18:11:55:WU02:FS00:0xa4:Completed 48000 out of 80000 steps  (60%)
18:15:18:WU02:FS00:0xa4:Completed 48800 out of 80000 steps  (61%)
18:18:40:WU02:FS00:0xa4:Completed 49600 out of 80000 steps  (62%)
18:19:28:WU01:FS01:0x15:Completed  17200000 out of 40000000 steps (43%).
18:22:03:WU02:FS00:0xa4:Completed 50400 out of 80000 steps  (63%)
18:25:26:WU02:FS00:0xa4:Completed 51200 out of 80000 steps  (64%)
18:28:49:WU02:FS00:0xa4:Completed 52000 out of 80000 steps  (65%)
18:32:12:WU02:FS00:0xa4:Completed 52800 out of 80000 steps  (66%)
18:35:35:WU02:FS00:0xa4:Completed 53600 out of 80000 steps  (67%)
18:38:57:WU02:FS00:0xa4:Completed 54400 out of 80000 steps  (68%)
18:42:19:WU02:FS00:0xa4:Completed 55200 out of 80000 steps  (69%)
18:45:08:WU01:FS01:0x15:Completed  17600000 out of 40000000 steps (44%).
18:45:42:WU02:FS00:0xa4:Completed 56000 out of 80000 steps  (70%)
18:49:05:WU02:FS00:0xa4:Completed 56800 out of 80000 steps  (71%)
18:52:28:WU02:FS00:0xa4:Completed 57600 out of 80000 steps  (72%)
18:55:50:WU02:FS00:0xa4:Completed 58400 out of 80000 steps  (73%)
18:59:13:WU02:FS00:0xa4:Completed 59200 out of 80000 steps  (74%)
19:02:36:WU02:FS00:0xa4:Completed 60000 out of 80000 steps  (75%)
19:05:59:WU02:FS00:0xa4:Completed 60800 out of 80000 steps  (76%)
19:09:21:WU02:FS00:0xa4:Completed 61600 out of 80000 steps  (77%)
19:10:48:WU01:FS01:0x15:Completed  18000000 out of 40000000 steps (45%).
19:12:43:WU02:FS00:0xa4:Completed 62400 out of 80000 steps  (78%)
19:16:06:WU02:FS00:0xa4:Completed 63200 out of 80000 steps  (79%)
19:19:29:WU02:FS00:0xa4:Completed 64000 out of 80000 steps  (80%)
19:22:52:WU02:FS00:0xa4:Completed 64800 out of 80000 steps  (81%)
19:26:14:WU02:FS00:0xa4:Completed 65600 out of 80000 steps  (82%)
19:29:37:WU02:FS00:0xa4:Completed 66400 out of 80000 steps  (83%)
19:33:00:WU02:FS00:0xa4:Completed 67200 out of 80000 steps  (84%)
19:36:23:WU02:FS00:0xa4:Completed 68000 out of 80000 steps  (85%)
19:36:28:WU01:FS01:0x15:Completed  18400000 out of 40000000 steps (46%).
19:39:45:WU02:FS00:0xa4:Completed 68800 out of 80000 steps  (86%)
19:43:07:WU02:FS00:0xa4:Completed 69600 out of 80000 steps  (87%)
19:46:29:WU02:FS00:0xa4:Completed 70400 out of 80000 steps  (88%)
19:49:53:WU02:FS00:0xa4:Completed 71200 out of 80000 steps  (89%)
19:53:15:WU02:FS00:0xa4:Completed 72000 out of 80000 steps  (90%)
19:56:25:WU03:FS02:0x21:Completed 50000 out of 2500000 steps (2%)
19:56:37:WU02:FS00:0xa4:Completed 72800 out of 80000 steps  (91%)
19:59:58:WU02:FS00:0xa4:Completed 73600 out of 80000 steps  (92%)
20:02:08:WU01:FS01:0x15:Completed  18800000 out of 40000000 steps (47%).
20:03:20:WU02:FS00:0xa4:Completed 74400 out of 80000 steps  (93%)
20:06:43:WU02:FS00:0xa4:Completed 75200 out of 80000 steps  (94%)
20:10:05:WU02:FS00:0xa4:Completed 76000 out of 80000 steps  (95%)
20:13:28:WU02:FS00:0xa4:Completed 76800 out of 80000 steps  (96%)
20:16:50:WU02:FS00:0xa4:Completed 77600 out of 80000 steps  (97%)
20:20:14:WU02:FS00:0xa4:Completed 78400 out of 80000 steps  (98%)
20:23:37:WU02:FS00:0xa4:Completed 79200 out of 80000 steps  (99%)
20:23:50:WARNING:WU00:FS00:Exception: Could not get IP address for assign3.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server. 
20:23:50:ERROR:WU00:FS00:Exception: Could not get an assignment
20:24:02:WARNING:WU00:FS00:Exception: Could not get IP address for assign4.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server. 
20:24:02:WU00:FS00:Connecting to 171.67.108.200:8080
20:24:04:WU00:FS00:Assigned to work server 171.64.65.99
20:24:04:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:6 from 171.64.65.99
20:24:04:WU00:FS00:Connecting to 171.64.65.99:8080
20:24:07:WU00:FS00:Downloading 6.22MiB
20:24:10:WU00:FS00:Download complete
20:24:10:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9752 run:599 clone:0 gen:156 core:0xa4 unit:0x000000d1ab4041635541727176081065
20:26:59:WU02:FS00:0xa4:Completed 80000 out of 80000 steps  (100%)
20:27:02:WU02:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
20:27:13:WU02:FS00:0xa4:
20:27:13:WU02:FS00:0xa4:Finished Work Unit:
20:27:13:WU02:FS00:0xa4:- Reading up to 4123296 from "02/wudata_01.trr": Read 4123296
20:27:13:WU02:FS00:0xa4:trr file hash check passed.
20:27:13:WU02:FS00:0xa4:- Reading up to 3193420 from "02/wudata_01.xtc": Read 3193420
20:27:13:WU02:FS00:0xa4:xtc file hash check passed.
20:27:13:WU02:FS00:0xa4:edr file hash check passed.
20:27:13:WU02:FS00:0xa4:logfile size: 20652
20:27:13:WU02:FS00:0xa4:Leaving Run
20:27:17:WU02:FS00:0xa4:- Writing 7339760 bytes of core data to disk...
20:27:20:WU02:FS00:0xa4:Done: 7339248 -> 7067805 (compressed to 96.3 percent)
20:27:20:WU02:FS00:0xa4:  ... Done.
20:27:22:WU02:FS00:0xa4:- Shutting down core
20:27:22:WU02:FS00:0xa4:
20:27:22:WU02:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
20:27:23:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
20:27:23:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:9752 run:1516 clone:0 gen:295 core:0xa4 unit:0x00000189ab404163554173acc3812a0a
20:27:23:WU02:FS00:Uploading 6.74MiB to 171.64.65.99
20:27:23:WU02:FS00:Connecting to 171.64.65.99:8080
20:27:23:WU00:FS00:Starting
20:27:23:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -np 6
20:27:23:WU00:FS00:Started FahCore on PID 2740
20:27:23:WU00:FS00:Core PID:1872
20:27:23:WU00:FS00:FahCore 0xa4 started
20:27:23:WU00:FS00:0xa4:
20:27:23:WU00:FS00:0xa4:*------------------------------*
20:27:23:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
20:27:23:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
20:27:23:WU00:FS00:0xa4:
20:27:23:WU00:FS00:0xa4:Preparing to commence simulation
20:27:23:WU00:FS00:0xa4:- Looking at optimizations...
20:27:23:WU00:FS00:0xa4:- Created dyn
20:27:23:WU00:FS00:0xa4:- Files status OK
20:27:28:WU00:FS00:0xa4:- Expanded 6523471 -> 22366436 (decompressed 342.8 percent)
20:27:28:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=6523471 data_size=22366436, decompressed_data_size=22366436 diff=0
20:27:28:WU00:FS00:0xa4:- Digital signature verified
20:27:28:WU00:FS00:0xa4:
20:27:28:WU00:FS00:0xa4:Project: 9752 (Run 599, Clone 0, Gen 156)
20:27:28:WU00:FS00:0xa4:
20:27:28:WU00:FS00:0xa4:Assembly optimizations on if available.
20:27:28:WU00:FS00:0xa4:Entering M.D.
20:27:29:WU02:FS00:Upload 12.98%
20:27:34:WU00:FS00:0xa4:Mapping NT from 6 to 6 
20:27:35:WU02:FS00:Upload 26.89%
20:27:37:WU00:FS00:0xa4:Completed 0 out of 80000 steps  (0%)
20:27:41:WU02:FS00:Upload 40.80%
20:27:47:WU02:FS00:Upload 54.70%
20:27:47:WU01:FS01:0x15:Completed  19200000 out of 40000000 steps (48%).
20:27:53:WU02:FS00:Upload 68.61%
20:27:59:WU02:FS00:Upload 81.59%
20:28:05:WU02:FS00:Upload 96.43%
20:28:08:WU02:FS00:Upload complete
20:28:08:WU02:FS00:Server responded WORK_ACK (400)
20:28:08:WU02:FS00:Final credit estimate, 1777.00 points
20:28:08:WU02:FS00:Cleaning up
20:30:55:WU00:FS00:0xa4:Completed 800 out of 80000 steps  (1%)
20:34:13:WU00:FS00:0xa4:Completed 1600 out of 80000 steps  (2%)
20:37:31:WU00:FS00:0xa4:Completed 2400 out of 80000 steps  (3%)
20:40:49:WU00:FS00:0xa4:Completed 3200 out of 80000 steps  (4%)
20:44:09:WU00:FS00:0xa4:Completed 4000 out of 80000 steps  (5%)
20:47:27:WU00:FS00:0xa4:Completed 4800 out of 80000 steps  (6%)
20:50:45:WU00:FS00:0xa4:Completed 5600 out of 80000 steps  (7%)
20:53:27:WU01:FS01:0x15:Completed  19600000 out of 40000000 steps (49%).
20:54:02:WU00:FS00:0xa4:Completed 6400 out of 80000 steps  (8%)
20:57:20:WU00:FS00:0xa4:Completed 7200 out of 80000 steps  (9%)
21:00:39:WU00:FS00:0xa4:Completed 8000 out of 80000 steps  (10%)
21:03:57:WU00:FS00:0xa4:Completed 8800 out of 80000 steps  (11%)
21:04:03:WU03:FS02:0x21:ERROR:exception: Error downloading array energyBuffer: clEnqueueReadBuffer (-36)
21:04:03:WU03:FS02:0x21:Saving result file logfile_01.txt
21:04:03:WU03:FS02:0x21:Saving result file log.txt
21:04:03:WU03:FS02:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
21:04:04:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:04:04:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:9206 run:0 clone:57 gen:0 core:0x21 unit:0x00000000664f2dd055db892495d57fe2
21:04:04:WU03:FS02:Uploading 2.47KiB to 171.64.65.104
21:04:04:WU03:FS02:Connecting to 171.64.65.104:8080
21:04:05:WU03:FS02:Upload complete
21:04:17:WARNING:WU02:FS02:Exception: Could not get IP address for assign-GPU.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server. 
21:04:17:ERROR:WU02:FS02:Exception: Could not get an assignment
21:04:17:WU03:FS02:Server responded WORK_ACK (400)
21:04:17:WU03:FS02:Cleaning up
21:04:29:WARNING:WU02:FS02:Exception: Could not get IP address for assign-GPU.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server. 
21:04:29:ERROR:WU02:FS02:Exception: Could not get an assignment
21:05:29:WARNING:WU02:FS02:Exception: Could not get IP address for assign-GPU2.stanford.edu: This is usually a temporary error during hostname resolution and means that the local server did not receive a response from an authoritative server. 
21:05:29:WU02:FS02:Connecting to 171.67.108.200:80
21:05:30:WU02:FS02:Assigned to work server 171.64.65.104
21:05:30:WU02:FS02:Requesting new work unit for slot 02: READY gpu:1:GF108 [Quadro 600] from 171.64.65.104
21:05:30:WU02:FS02:Connecting to 171.64.65.104:8080
21:05:32:WU02:FS02:Downloading 9.84MiB
21:05:34:WU02:FS02:Download complete
21:05:35:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9205 run:0 clone:11 gen:5 core:0x21 unit:0x00000005664f2dd055d4c7f0d1e85e28
21:05:35:WU02:FS02:Starting
21:05:35:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
21:05:35:WU02:FS02:Started FahCore on PID 1080
21:05:35:WU02:FS02:Core PID:2088
21:05:35:WU02:FS02:FahCore 0x21 started
21:05:35:WU02:FS02:0x21:*********************** Log Started 2015-09-09T21:05:35Z ***********************
21:05:35:WU02:FS02:0x21:Project: 9205 (Run 0, Clone 11, Gen 5)
21:05:35:WU02:FS02:0x21:Unit: 0x00000005664f2dd055d4c7f0d1e85e28
21:05:35:WU02:FS02:0x21:CPU: 0x00000000000000000000000000000000
21:05:35:WU02:FS02:0x21:Machine: 2
21:05:35:WU02:FS02:0x21:Reading tar file core.xml
21:05:35:WU02:FS02:0x21:Reading tar file system.xml
21:05:37:WU02:FS02:0x21:Reading tar file integrator.xml
21:05:37:WU02:FS02:0x21:Reading tar file state.xml
21:05:40:WU02:FS02:0x21:Digital signatures verified
21:05:40:WU02:FS02:0x21:Folding@home GPU Core21 Folding@home Core
21:05:40:WU02:FS02:0x21:Version 0.0.11
21:06:44:WU02:FS02:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-36)
21:06:44:WU02:FS02:0x21:Saving result file logfile_01.txt
21:06:44:WU02:FS02:0x21:Saving result file log.txt
21:06:44:WU02:FS02:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
21:06:52:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:06:52:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:9205 run:0 clone:11 gen:5 core:0x21 unit:0x00000005664f2dd055d4c7f0d1e85e28
21:06:52:WU02:FS02:Uploading 2.28KiB to 171.64.65.104
21:06:52:WU02:FS02:Connecting to 171.64.65.104:8080
21:06:52:WU03:FS02:Connecting to 171.67.108.200:80
21:06:53:WU02:FS02:Upload complete
21:06:53:WU02:FS02:Server responded WORK_ACK (400)
21:06:53:WU02:FS02:Cleaning up
21:06:53:WU03:FS02:Assigned to work server 171.64.65.104
21:06:53:WU03:FS02:Requesting new work unit for slot 02: READY gpu:1:GF108 [Quadro 600] from 171.64.65.104
21:06:53:WU03:FS02:Connecting to 171.64.65.104:8080
21:06:54:WU03:FS02:Downloading 9.83MiB
21:06:56:WU03:FS02:Download complete
21:06:56:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:9206 run:0 clone:6 gen:3 core:0x21 unit:0x00000004664f2dd055db88ea2809e97e
21:06:56:WU03:FS02:Starting
21:06:56:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 03 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
21:06:56:WU03:FS02:Started FahCore on PID 1396
21:06:56:WU03:FS02:Core PID:1228
21:06:56:WU03:FS02:FahCore 0x21 started
21:06:57:WU03:FS02:0x21:*********************** Log Started 2015-09-09T21:06:56Z ***********************
21:06:57:WU03:FS02:0x21:Project: 9206 (Run 0, Clone 6, Gen 3)
21:06:57:WU03:FS02:0x21:Unit: 0x00000004664f2dd055db88ea2809e97e
21:06:57:WU03:FS02:0x21:CPU: 0x00000000000000000000000000000000
21:06:57:WU03:FS02:0x21:Machine: 2
21:06:57:WU03:FS02:0x21:Reading tar file core.xml
21:06:57:WU03:FS02:0x21:Reading tar file system.xml
21:06:59:WU03:FS02:0x21:Reading tar file integrator.xml
21:06:59:WU03:FS02:0x21:Reading tar file state.xml
21:07:01:WU03:FS02:0x21:Digital signatures verified
21:07:01:WU03:FS02:0x21:Folding@home GPU Core21 Folding@home Core
21:07:01:WU03:FS02:0x21:Version 0.0.11
21:07:17:WU00:FS00:0xa4:Completed 9600 out of 80000 steps  (12%)
21:08:06:WU03:FS02:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-36)
21:08:06:WU03:FS02:0x21:Saving result file logfile_01.txt
21:08:06:WU03:FS02:0x21:Saving result file log.txt
21:08:07:WU03:FS02:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
21:08:07:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:08:07:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:9206 run:0 clone:6 gen:3 core:0x21 unit:0x00000004664f2dd055db88ea2809e97e
21:08:07:WU03:FS02:Uploading 2.27KiB to 171.64.65.104
21:08:07:WU03:FS02:Connecting to 171.64.65.104:8080
21:08:08:WU02:FS02:Connecting to 171.67.108.200:80
21:08:08:WU03:FS02:Upload complete
21:08:08:WU03:FS02:Server responded WORK_ACK (400)
21:08:08:WU03:FS02:Cleaning up
21:08:08:WU02:FS02:Assigned to work server 171.64.65.104
21:08:08:WU02:FS02:Requesting new work unit for slot 02: READY gpu:1:GF108 [Quadro 600] from 171.64.65.104
21:08:08:WU02:FS02:Connecting to 171.64.65.104:8080
21:08:09:WU02:FS02:Downloading 9.83MiB
21:08:12:WU02:FS02:Download complete
21:08:12:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9206 run:0 clone:55 gen:1 core:0x21 unit:0x00000001664f2dd055db892163cf7612
21:08:12:WU02:FS02:Starting
21:08:12:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 2636 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
21:08:12:WU02:FS02:Started FahCore on PID 2596
21:08:12:WU02:FS02:Core PID:3048
21:08:12:WU02:FS02:FahCore 0x21 started
21:08:13:WU02:FS02:0x21:*********************** Log Started 2015-09-09T21:08:12Z ***********************
21:08:13:WU02:FS02:0x21:Project: 9206 (Run 0, Clone 55, Gen 1)
21:08:13:WU02:FS02:0x21:Unit: 0x00000001664f2dd055db892163cf7612
21:08:13:WU02:FS02:0x21:CPU: 0x00000000000000000000000000000000
21:08:13:WU02:FS02:0x21:Machine: 2
21:08:13:WU02:FS02:0x21:Reading tar file core.xml
21:08:13:WU02:FS02:0x21:Reading tar file system.xml
21:08:15:WU02:FS02:0x21:Reading tar file integrator.xml
21:08:15:WU02:FS02:0x21:Reading tar file state.xml
21:08:17:WU02:FS02:0x21:Digital signatures verified
21:08:17:WU02:FS02:0x21:Folding@home GPU Core21 Folding@home Core
21:08:17:WU02:FS02:0x21:Version 0.0.11
21:09:22:WU02:FS02:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-36)
21:09:22:WU02:FS02:0x21:Saving result file logfile_01.txt
21:09:22:WU02:FS02:0x21:Saving result file log.txt
21:09:22:WU02:FS02:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
21:09:30:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:09:30:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:9206 run:0 clone:55 gen:1 core:0x21 unit:0x00000001664f2dd055db892163cf7612
21:09:30:WU02:FS02:Uploading 2.27KiB to 171.64.65.104
21:09:30:WU02:FS02:Connecting to 171.64.65.104:8080
21:09:30:WU02:FS02:Upload complete
21:09:30:WU02:FS02:Server responded WORK_ACK (400)
21:09:30:WU02:FS02:Cleaning up
21:10:37:WU00:FS00:0xa4:Completed 10400 out of 80000 steps  (13%)
21:13:56:WU00:FS00:0xa4:Completed 11200 out of 80000 steps  (14%)
21:17:14:WU00:FS00:0xa4:Completed 12000 out of 80000 steps  (15%)
21:19:07:WU01:FS01:0x15:Completed  20000000 out of 40000000 steps (50%).
21:20:32:WU00:FS00:0xa4:Completed 12800 out of 80000 steps  (16%)
21:23:50:WU00:FS00:0xa4:Completed 13600 out of 80000 steps  (17%)
21:27:08:WU00:FS00:0xa4:Completed 14400 out of 80000 steps  (18%)
21:30:27:WU00:FS00:0xa4:Completed 15200 out of 80000 steps  (19%)
21:33:45:WU00:FS00:0xa4:Completed 16000 out of 80000 steps  (20%)
21:37:03:WU00:FS00:0xa4:Completed 16800 out of 80000 steps  (21%)
21:40:22:WU00:FS00:0xa4:Completed 17600 out of 80000 steps  (22%)
21:43:40:WU00:FS00:0xa4:Completed 18400 out of 80000 steps  (23%)
21:44:47:WU01:FS01:0x15:Completed  20400000 out of 40000000 steps (51%).
21:46:59:WU00:FS00:0xa4:Completed 19200 out of 80000 steps  (24%)
21:50:17:WU00:FS00:0xa4:Completed 20000 out of 80000 steps  (25%)
21:53:35:WU00:FS00:0xa4:Completed 20800 out of 80000 steps  (26%)
21:56:53:WU00:FS00:0xa4:Completed 21600 out of 80000 steps  (27%)
22:00:13:WU00:FS00:0xa4:Completed 22400 out of 80000 steps  (28%)
22:03:31:WU00:FS00:0xa4:Completed 23200 out of 80000 steps  (29%)
22:06:49:WU00:FS00:0xa4:Completed 24000 out of 80000 steps  (30%)
22:10:06:WU00:FS00:0xa4:Completed 24800 out of 80000 steps  (31%)
22:10:28:WU01:FS01:0x15:Completed  20800000 out of 40000000 steps (52%).
22:13:24:WU00:FS00:0xa4:Completed 25600 out of 80000 steps  (32%)
22:16:42:WU00:FS00:0xa4:Completed 26400 out of 80000 steps  (33%)
22:20:00:WU00:FS00:0xa4:Completed 27200 out of 80000 steps  (34%)
22:23:18:WU00:FS00:0xa4:Completed 28000 out of 80000 steps  (35%)
22:26:36:WU00:FS00:0xa4:Completed 28800 out of 80000 steps  (36%)
22:29:54:WU00:FS00:0xa4:Completed 29600 out of 80000 steps  (37%)
22:33:12:WU00:FS00:0xa4:Completed 30400 out of 80000 steps  (38%)
22:36:08:WU01:FS01:0x15:Completed  21200000 out of 40000000 steps (53%).
22:36:30:WU00:FS00:0xa4:Completed 31200 out of 80000 steps  (39%)

Re: Deadline problem with Core21 on Fermi

Posted: Thu Sep 24, 2015 9:18 pm
by bruce
You probably don't fully understand the issues here., so let me explain.

You have two GPUs which are very different.
10:35:51: GPUs: 2
10:35:51: GPU 0: NVIDIA:1 G92 [Quadro FX 3700]
10:35:51: GPU 1: NVIDIA:2 GF108 [Quadro 600]

We currently see four generations of NVIDIA GPUs with many entries in each generation:
A) Tesla [or more commonly, G80/G92) -- No longer supported
B) Fermi
C) Kepler
D) Maxwell 1
E) Maxwell 2
F) (Future developments: TBD)

Your Quadro 600 is fully supported and should be able to handle assignments from any of the current projects.

End-of-life was announced for your Quadro FX 3700, along with quite a number of other GPUs of that generation. After considerable discussion, a method was worked out to provide a limited number of older projects to be assigned to Tesla hardware. At some point FAH will end for those GPUs.

The only way to tell the server that you want these older projects is to add the two settings
. . . <client-type v='beta'/>
. . . <max-packet-size v='small'/>

These settings should only be used for your Tesla and NOT be used for you Fermi hardware.

Re: Deadline problem with Core21 on Fermi

Posted: Fri Sep 25, 2015 3:07 am
by Kebast
Thanks! That really does help to clear things up. I've thought all along that the G92 cards were in the fermi series, and I guess also thought that the fermi cards were past support and needed the flag tweaks to get WUs. I'll remove all flags from the GF108 cards then.

Re: Deadline problem with Core21 on Fermi

Posted: Fri Sep 25, 2015 4:26 am
by bruce
The F in GF108 is an important clue that it's a Fermi.