Bad GPU's ?
Posted: Sat Nov 09, 2013 8:28 am
I think I have problems!
Started a new system and it was running just fine until I stopped it and added a new card from another system.
new system hd 7990 and hd 7970 added gtx 780. FAHControl when turned on saw the hd7970, gtx 780 and half of the hd7990.
I added a slot and started FAHControl only to have one of the WU's ignored and a new one started.
HD 7970
Started a new system and it was running just fine until I stopped it and added a new card from another system.
new system hd 7990 and hd 7970 added gtx 780. FAHControl when turned on saw the hd7970, gtx 780 and half of the hd7990.
I added a slot and started FAHControl only to have one of the WU's ignored and a new one started.
Code: Select all
*********************** Log Started 2013-11-09T23:38:52Z ***********************
23:38:52:************************* Folding@home Client *************************
23:38:52: Website: http://folding.stanford.edu/
23:38:52: Copyright: (c) 2009-2013 Stanford University
23:38:52: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:38:52: Args: --open-web-control
23:38:52: Config: e:/Users/Roswell_ET/AppData/Roaming/FAHClient/config.xml
23:38:52:******************************** Build ********************************
23:38:52: Version: 7.3.6
23:38:52: Date: Feb 18 2013
23:38:52: Time: 15:25:17
23:38:52: SVN Rev: 3923
23:38:52: Branch: fah/trunk/client
23:38:52: Compiler: Intel(R) C++ MSVC 1500 mode 1200
23:38:52: Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
23:38:52: /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
23:38:52: Platform: win32 XP
23:38:52: Bits: 32
23:38:52: Mode: Release
23:38:52:******************************* System ********************************
23:38:52: CPU: Intel(R) Core(TM) i7-4820K CPU @ 3.70GHz
23:38:52: CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
23:38:52: CPUs: 8
23:38:52: Memory: 31.92GiB
23:38:52: Free Memory: 26.75GiB
23:38:52: Threads: WINDOWS_THREADS
23:38:52: Has Battery: false
23:38:52: On Battery: false
23:38:52: UTC offset: -8
23:38:52: PID: 3904
23:38:52: CWD: e:/Users/Roswell_ET/AppData/Roaming/FAHClient
23:38:52: OS: Windows 8
23:38:52: OS Arch: AMD64
23:38:52: GPUs: 4
23:38:52: GPU 0: ATI:5 Tahiti [Radeon HD 7900 Series]
23:38:52: GPU 1: ATI:5 Tahiti XT [Radeon HD 7970]
23:38:52: GPU 2: NVIDIA:3 GK110 [GeForce GTX 780]
23:38:52: GPU 3: ATI:5 Tahiti [Radeon HD 7900 Series]
23:38:52: CUDA: 3.5
23:38:52: CUDA Driver: 5050
23:38:52:Win32 Service: false
23:38:52:***********************************************************************
23:38:52:<config>
23:38:52: <!-- Folding Slot Configuration -->
23:38:52: <client-type v='advanced'/>
23:38:52: <power v='full'/>
23:38:52:
23:38:52: <!-- Network -->
23:38:52: <proxy v=':8080'/>
23:38:52:
23:38:52: <!-- Slot Control -->
23:38:52: <pause-on-start v='true'/>
23:38:52:
23:38:52: <!-- User Information -->
23:38:52: <passkey v='********************************'/>
23:38:52: <team v='69411'/>
23:38:52: <user v='Roswell_ET'/>
23:38:52:
23:38:52: <!-- Folding Slots -->
23:38:52: <slot id='0' type='GPU'/>
23:38:52: <slot id='1' type='GPU'/>
23:38:52: <slot id='3' type='GPU'/>
23:38:52: <slot id='2' type='GPU'/>
23:38:52:</config>
23:38:52:Trying to access database...
23:38:52:Successfully acquired database lock
23:38:52:Enabled folding slot 00: PAUSED gpu:0:Tahiti [Radeon HD 7900 Series] (paused)
23:38:52:Enabled folding slot 01: PAUSED gpu:1:Tahiti XT [Radeon HD 7970] (paused)
23:38:52:Enabled folding slot 03: PAUSED gpu:2:GK110 [GeForce GTX 780] (paused)
23:38:52:Enabled folding slot 02: PAUSED gpu:3:Tahiti [Radeon HD 7900 Series] (paused)
23:38:57:3:127.0.0.1:New Web connection
23:39:46:FS00:Unpaused
23:39:46:FS01:Unpaused
23:39:46:FS03:Unpaused
23:39:46:FS02:Unpaused
23:39:57:WU03:FS03:Starting
23:39:57:WU03:FS03:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 03 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:39:57:WU03:FS03:Started FahCore on PID 2288
23:39:57:WU03:FS03:Core PID:3696
23:39:57:WU03:FS03:FahCore 0x15 started
23:39:57:WU02:FS02:Starting
23:39:57:WU02:FS02:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 3 -gpu-vendor ati
23:39:57:WU02:FS02:Started FahCore on PID 4712
23:39:57:WU02:FS02:Core PID:2448
23:39:57:WU02:FS02:FahCore 0x17 started
23:39:57:WU05:FS01:Starting
23:39:57:WU05:FS01:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 05 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 1 -gpu-vendor ati
23:39:57:WU05:FS01:Started FahCore on PID 3792
23:39:57:WU05:FS01:Core PID:4180
23:39:57:WU05:FS01:FahCore 0x17 started
23:39:57:WU00:FS00:Starting
23:39:57:WU00:FS00:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 0 -gpu-vendor ati
23:39:57:WU00:FS00:Started FahCore on PID 3980
23:39:57:WU00:FS00:Core PID:3604
23:39:57:WU00:FS00:FahCore 0x17 started
23:39:58:WU03:FS03:0x15:
23:39:58:WU03:FS03:0x15:*------------------------------*
23:39:58:WU03:FS03:0x15:Folding@Home GPU Core
23:39:58:WU03:FS03:0x15:Version 2.25 (Wed May 9 17:03:01 EDT 2012)
23:39:58:WU03:FS03:0x15:Build host AmoebaRemote
23:39:58:WU03:FS03:0x15:Board Type NVIDIA/CUDA
23:39:58:WU03:FS03:0x15:Core 15
23:39:58:WU03:FS03:0x15:
23:39:58:WU03:FS03:0x15:Window's signal control handler registered.
23:39:58:WU03:FS03:0x15:Preparing to commence simulation
23:39:58:WU03:FS03:0x15:- Looking at optimizations...
23:39:58:WU03:FS03:0x15:DeleteFrameFiles: successfully deleted file=03/wudata_01.ckp
23:39:58:WU03:FS03:0x15:- Created dyn
23:39:58:WU03:FS03:0x15:- Files status OK
23:39:58:WU03:FS03:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
23:39:58:WU03:FS03:0x15:- Expanded 145704 -> 660986 (decompressed 453.6 percent)
23:39:58:WU03:FS03:0x15:Called DecompressByteArray: compressed_data_size=145704 data_size=660986, decompressed_data_size=660986 diff=0
23:39:58:WU03:FS03:0x15:- Digital signature verified
23:39:58:WU03:FS03:0x15:
23:39:58:WU03:FS03:0x15:Project: 8018 (Run 293, Clone 0, Gen 193)
23:39:58:WU03:FS03:0x15:
23:39:58:WU03:FS03:0x15:Assembly optimizations on if available.
23:39:58:WU02:FS02:0x17:*********************** Log Started 2013-11-09T23:39:57Z ***********************
23:39:58:WU03:FS03:0x15:Entering M.D.
23:39:58:WU02:FS02:0x17:Project: 8900 (Run 595, Clone 4, Gen 1)
23:39:58:WU02:FS02:0x17:Unit: 0x00000004028c126651a6ab0f937fc86e
23:39:58:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
23:39:58:WU02:FS02:0x17:Machine: 2
23:39:58:WU05:FS01:0x17:*********************** Log Started 2013-11-09T23:39:57Z ***********************
23:39:58:WU02:FS02:0x17:Digital signatures verified
23:39:58:WU05:FS01:0x17:Project: 8900 (Run 563, Clone 0, Gen 231)
23:39:58:WU05:FS01:0x17:Unit: 0x00000114028c126651a6a3df7bb66762
23:39:58:WU00:FS00:0x17:*********************** Log Started 2013-11-09T23:39:57Z ***********************
23:39:58:WU05:FS01:0x17:CPU: 0x00000000000000000000000000000000
23:39:58:WU00:FS00:0x17:Project: 8900 (Run 14, Clone 3, Gen 193)
23:39:58:WU05:FS01:0x17:Machine: 1
23:39:58:WU00:FS00:0x17:Unit: 0x000000ec028c1266519a622ff3c71540
23:39:58:WU05:FS01:0x17:Digital signatures verified
23:39:58:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:39:58:WU00:FS00:0x17:Machine: 2
23:39:58:WU00:FS00:0x17:Digital signatures verified
23:39:58:WU02:FS02:0x17: Found a checkpoint file
23:39:58:WU05:FS01:0x17: Found a checkpoint file
23:39:58:WU00:FS00:0x17: Found a checkpoint file
23:39:59:WU03:FS03:0x15:Tpr hash 03/wudata_01.tpr: 1771790457 1201405876 2890240536 2776289624 289497086
23:39:59:WU03:FS03:0x15:GPU device id=0
23:39:59:WU03:FS03:0x15:Working on GRowing Old MAkes el Chrono Sweat
23:39:59:WU03:FS03:0x15:Client config unavailable.
23:40:00:WU03:FS03:0x15:Starting GUI Server
23:40:00:WU03:FS03:0x15:Finished fah_main status=59
23:40:00:WU03:FS03:0x15:mdrun_gpu returned 59
23:40:00:WU03:FS03:0x15:GPU memtest failure
23:40:00:WU03:FS03:0x15:
23:40:00:WU03:FS03:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
23:40:00:WARNING:WU03:FS03:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
23:40:00:WU03:FS03:Starting
23:40:00:WU03:FS03:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 03 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:40:00:WU03:FS03:Started FahCore on PID 320
23:40:00:WU03:FS03:Core PID:1132
23:40:00:WU03:FS03:FahCore 0x15 started
23:40:01:WU03:FS03:0x15:
23:40:01:WU03:FS03:0x15:*------------------------------*
23:40:01:WU03:FS03:0x15:Folding@Home GPU Core
23:40:01:WU03:FS03:0x15:Version 2.25 (Wed May 9 17:03:01 EDT 2012)
23:40:01:WU03:FS03:0x15:Build host AmoebaRemote
23:40:01:WU03:FS03:0x15:Board Type NVIDIA/CUDA
23:40:01:WU03:FS03:0x15:Core 15
23:40:01:WU03:FS03:0x15:
23:40:01:WU03:FS03:0x15:Window's signal control handler registered.
23:40:01:WU03:FS03:0x15:Preparing to commence simulation
23:40:01:WU03:FS03:0x15:- Looking at optimizations...
23:40:01:WU03:FS03:0x15:DeleteFrameFiles: successfully deleted file=03/wudata_01.ckp
23:40:01:WU03:FS03:0x15:- Created dyn
23:40:01:WU03:FS03:0x15:- Files status OK
23:40:01:WU03:FS03:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
23:40:01:WU03:FS03:0x15:- Expanded 145704 -> 660986 (decompressed 453.6 percent)
23:40:01:WU03:FS03:0x15:Called DecompressByteArray: compressed_data_size=145704 data_size=660986, decompressed_data_size=660986 diff=0
23:40:01:WU03:FS03:0x15:- Digital signature verified
23:40:01:WU03:FS03:0x15:
23:40:01:WU03:FS03:0x15:Project: 8018 (Run 293, Clone 0, Gen 193)
23:40:01:WU03:FS03:0x15:
23:40:01:WU03:FS03:0x15:Assembly optimizations on if available.
23:40:01:WU03:FS03:0x15:Entering M.D.
23:40:02:WU03:FS03:0x15:Tpr hash 03/wudata_01.tpr: 1771790457 1201405876 2890240536 2776289624 289497086
23:40:02:WU03:FS03:0x15:GPU device id=0
23:40:02:WU03:FS03:0x15:Working on GRowing Old MAkes el Chrono Sweat
23:40:02:WU03:FS03:0x15:Client config unavailable.
23:40:02:WU03:FS03:0x15:Finished fah_main status=59
23:40:02:WU03:FS03:0x15:mdrun_gpu returned 59
23:40:02:WU03:FS03:0x15:GPU memtest failure
23:40:02:WU03:FS03:0x15:
23:40:02:WU03:FS03:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
23:40:03:WARNING:WU03:FS03:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
23:40:03:WARNING:WU03:FS03:Too many errors, failing
23:40:03:WU03:FS03:Sending unit results: id:03 state:SEND error:FAILED project:8018 run:293 clone:0 gen:193 core:0x15 unit:0x000000df6953ee2e500f1c4cd44837a9
23:40:03:WU03:FS03:Connecting to 171.67.108.142:8080
23:40:03:WU03:FS03:Server responded WORK_QUIT (404)
23:40:03:WARNING:WU03:FS03:Server did not like results, dumping
23:40:03:WU03:FS03:Cleaning up
23:40:03:WU06:FS03:Connecting to assign-GPU.stanford.edu:80
23:40:04:WU06:FS03:News: Welcome to Folding@Home
23:40:04:WU06:FS03:Assigned to work server 171.67.108.142
23:40:04:WU06:FS03:Requesting new work unit for slot 03: READY gpu:2:GK110 [GeForce GTX 780] from 171.67.108.142
23:40:04:WU06:FS03:Connecting to 171.67.108.142:8080
23:40:04:WU06:FS03:Downloading 142.68KiB
23:40:05:WU06:FS03:Download complete
23:40:05:WU06:FS03:Received Unit: id:06 state:DOWNLOAD error:NO_ERROR project:8018 run:688 clone:0 gen:161 core:0x15 unit:0x000000ca6953ee2e500f1db099770038
23:40:05:WU06:FS03:Starting
23:40:05:WU06:FS03:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 06 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:40:05:WU06:FS03:Started FahCore on PID 3976
23:40:05:WU06:FS03:Core PID:4280
23:40:05:WU06:FS03:FahCore 0x15 started
23:40:06:WU06:FS03:0x15:
23:40:06:WU06:FS03:0x15:*------------------------------*
23:40:06:WU06:FS03:0x15:Folding@Home GPU Core
23:40:06:WU06:FS03:0x15:Version 2.25 (Wed May 9 17:03:01 EDT 2012)
23:40:06:WU06:FS03:0x15:Build host AmoebaRemote
23:40:06:WU06:FS03:0x15:Board Type NVIDIA/CUDA
23:40:06:WU06:FS03:0x15:Core 15
23:40:06:WU06:FS03:0x15:
23:40:06:WU06:FS03:0x15:Window's signal control handler registered.
23:40:06:WU06:FS03:0x15:Preparing to commence simulation
23:40:06:WU06:FS03:0x15:- Looking at optimizations...
23:40:06:WU06:FS03:0x15:DeleteFrameFiles: successfully deleted file=06/wudata_01.ckp
23:40:06:WU06:FS03:0x15:- Created dyn
23:40:06:WU06:FS03:0x15:- Files status OK
23:40:06:WU06:FS03:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
23:40:06:WU06:FS03:0x15:- Expanded 145590 -> 660986 (decompressed 454.0 percent)
23:40:06:WU06:FS03:0x15:Called DecompressByteArray: compressed_data_size=145590 data_size=660986, decompressed_data_size=660986 diff=0
23:40:06:WU06:FS03:0x15:- Digital signature verified
23:40:06:WU06:FS03:0x15:
23:40:06:WU06:FS03:0x15:Project: 8018 (Run 688, Clone 0, Gen 161)
23:40:06:WU06:FS03:0x15:
23:40:06:WU06:FS03:0x15:Assembly optimizations on if available.
23:40:06:WU06:FS03:0x15:Entering M.D.
23:40:07:WU06:FS03:0x15:Tpr hash 06/wudata_01.tpr: 625628606 2325468089 3963734056 328330338 643951421
23:40:07:WU06:FS03:0x15:GPU device id=0
23:40:07:WU06:FS03:0x15:Working on GRowing Old MAkes el Chrono Sweat
23:40:07:WU06:FS03:0x15:Client config unavailable.
23:40:07:WU06:FS03:0x15:Finished fah_main status=59
23:40:07:WU06:FS03:0x15:mdrun_gpu returned 59
23:40:07:WU06:FS03:0x15:GPU memtest failure
23:40:07:WU06:FS03:0x15:
23:40:07:WU06:FS03:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
23:40:08:WARNING:WU06:FS03:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
23:40:08:WU06:FS03:Starting
23:40:08:WU06:FS03:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 06 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:40:08:WU06:FS03:Started FahCore on PID 2520
23:40:08:WU06:FS03:Core PID:3068
23:40:08:WU06:FS03:FahCore 0x15 started
23:40:08:WU06:FS03:0x15:
23:40:08:WU06:FS03:0x15:*------------------------------*
23:40:08:WU06:FS03:0x15:Folding@Home GPU Core
23:40:08:WU06:FS03:0x15:Version 2.25 (Wed May 9 17:03:01 EDT 2012)
23:40:08:WU06:FS03:0x15:Build host AmoebaRemote
23:40:08:WU06:FS03:0x15:Board Type NVIDIA/CUDA
23:40:08:WU06:FS03:0x15:Core 15
23:40:08:WU06:FS03:0x15:
23:40:08:WU06:FS03:0x15:Window's signal control handler registered.
23:40:08:WU06:FS03:0x15:Preparing to commence simulation
23:40:08:WU06:FS03:0x15:- Looking at optimizations...
23:40:08:WU06:FS03:0x15:DeleteFrameFiles: successfully deleted file=06/wudata_01.ckp
23:40:08:WU06:FS03:0x15:- Created dyn
23:40:08:WU06:FS03:0x15:- Files status OK
23:40:08:WU06:FS03:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
23:40:08:WU06:FS03:0x15:- Expanded 145590 -> 660986 (decompressed 454.0 percent)
23:40:08:WU06:FS03:0x15:Called DecompressByteArray: compressed_data_size=145590 data_size=660986, decompressed_data_size=660986 diff=0
23:40:08:WU06:FS03:0x15:- Digital signature verified
23:40:08:WU06:FS03:0x15:
23:40:08:WU06:FS03:0x15:Project: 8018 (Run 688, Clone 0, Gen 161)
23:40:08:WU06:FS03:0x15:
23:40:08:WU06:FS03:0x15:Assembly optimizations on if available.
23:40:08:WU06:FS03:0x15:Entering M.D.
23:40:10:WU06:FS03:0x15:Tpr hash 06/wudata_01.tpr: 625628606 2325468089 3963734056 328330338 643951421
23:40:10:WU06:FS03:0x15:GPU device id=0
23:40:10:WU06:FS03:0x15:Working on GRowing Old MAkes el Chrono Sweat
23:40:10:WU06:FS03:0x15:Client config unavailable.
23:40:10:WU06:FS03:0x15:Finished fah_main status=59
23:40:10:WU06:FS03:0x15:mdrun_gpu returned 59
23:40:10:WU06:FS03:0x15:GPU memtest failure
23:40:10:WU06:FS03:0x15:
23:40:10:WU06:FS03:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
23:40:10:WARNING:WU06:FS03:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
23:40:58:Saving configuration to config.xml
23:40:58:<config>
23:40:58: <!-- Folding Slot Configuration -->
23:40:58: <client-type v='advanced'/>
23:40:58: <power v='full'/>
23:40:58:
23:40:58: <!-- Network -->
23:40:58: <proxy v=':8080'/>
23:40:58:
23:40:58: <!-- Slot Control -->
23:40:58: <pause-on-start v='true'/>
23:40:58:
23:40:58: <!-- User Information -->
23:40:58: <passkey v='********************************'/>
23:40:58: <team v='69411'/>
23:40:58: <user v='Roswell_ET'/>
23:40:58:
23:40:58: <!-- Folding Slots -->
23:40:58: <slot id='0' type='GPU'/>
23:40:58: <slot id='1' type='GPU'/>
23:40:58: <slot id='3' type='GPU'/>
23:40:58: <slot id='2' type='GPU'/>
23:40:58:</config>
23:41:08:WU06:FS03:Starting
23:41:08:WU06:FS03:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 06 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:41:08:WU06:FS03:Started FahCore on PID 2788
23:41:08:WU06:FS03:Core PID:832
23:41:08:WU06:FS03:FahCore 0x15 started
23:41:08:WU06:FS03:0x15:
23:41:08:WU06:FS03:0x15:*------------------------------*
23:41:08:WU06:FS03:0x15:Folding@Home GPU Core
23:41:08:WU06:FS03:0x15:Version 2.25 (Wed May 9 17:03:01 EDT 2012)
23:41:08:WU06:FS03:0x15:Build host AmoebaRemote
23:41:08:WU06:FS03:0x15:Board Type NVIDIA/CUDA
23:41:08:WU06:FS03:0x15:Core 15
23:41:08:WU06:FS03:0x15:
23:41:08:WU06:FS03:0x15:Window's signal control handler registered.
23:41:08:WU06:FS03:0x15:Preparing to commence simulation
23:41:08:WU06:FS03:0x15:- Looking at optimizations...
23:41:08:WU06:FS03:0x15:DeleteFrameFiles: successfully deleted file=06/wudata_01.ckp
23:41:08:WU06:FS03:0x15:- Created dyn
23:41:08:WU06:FS03:0x15:- Files status OK
23:41:08:WU06:FS03:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
23:41:08:WU06:FS03:0x15:- Expanded 145590 -> 660986 (decompressed 454.0 percent)
23:41:08:WU06:FS03:0x15:Called DecompressByteArray: compressed_data_size=145590 data_size=660986, decompressed_data_size=660986 diff=0
23:41:08:WU06:FS03:0x15:- Digital signature verified
23:41:08:WU06:FS03:0x15:
23:41:08:WU06:FS03:0x15:Project: 8018 (Run 688, Clone 0, Gen 161)
23:41:08:WU06:FS03:0x15:
23:41:08:WU06:FS03:0x15:Assembly optimizations on if available.
23:41:08:WU06:FS03:0x15:Entering M.D.
23:41:10:WU06:FS03:0x15:Tpr hash 06/wudata_01.tpr: 625628606 2325468089 3963734056 328330338 643951421
23:41:10:WU06:FS03:0x15:GPU device id=0
23:41:10:WU06:FS03:0x15:Working on GRowing Old MAkes el Chrono Sweat
23:41:10:WU06:FS03:0x15:Client config unavailable.
23:41:10:WU06:FS03:0x15:Finished fah_main status=59
23:41:10:WU06:FS03:0x15:mdrun_gpu returned 59
23:41:10:WU06:FS03:0x15:GPU memtest failure
23:41:10:WU06:FS03:0x15:
23:41:10:WU06:FS03:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
23:41:10:WARNING:WU06:FS03:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
23:41:27:FS03:Paused
23:41:51:WU05:FS01:0x17:Completed 650000 out of 2500000 steps (26%)
23:41:51:WU00:FS00:0x17:Completed 700000 out of 2500000 steps (28%)
23:42:13:WU02:FS02:0x17:ERROR:exception: Force RMSE error of 176.033 with threshold of 5
23:42:13:WU02:FS02:0x17:Saving result file logfile_01.txt
23:42:13:WU02:FS02:0x17:Saving result file badStateCheckpoint_41
23:42:14:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Core.xml
23:42:16:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Ref.xml
23:42:17:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Core.xml
23:42:19:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Ref.xml
23:42:20:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Core.xml
23:42:22:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Ref.xml
23:42:23:WU02:FS02:0x17:Saving result file log.txt
23:42:23:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:42:23:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:595 clone:4 gen:1 core:0x17 unit:0x00000004028c126651a6ab0f937fc86e
23:42:23:WU02:FS02:Uploading 20.69MiB to 171.64.65.69
23:42:23:WU02:FS02:Connecting to 171.64.65.69:8080
23:42:24:WU03:FS02:Connecting to assign-GPU.stanford.edu:80
23:42:24:WU03:FS02:News: Welcome to Folding@Home
23:42:24:WU03:FS02:Assigned to work server 171.64.65.69
23:42:24:WU03:FS02:Requesting new work unit for slot 02: READY gpu:3:Tahiti [Radeon HD 7900 Series] from 171.64.65.69
23:42:24:WU03:FS02:Connecting to 171.64.65.69:8080
23:42:27:WU03:FS02:Downloading 4.18MiB
23:42:29:WU02:FS02:Upload 19.93%
23:42:33:WU03:FS02:Download 5.99%
23:42:35:WU02:FS02:Upload 39.87%
23:42:39:WU03:FS02:Download 23.95%
23:42:41:WU02:FS02:Upload 59.80%
23:42:45:WU03:FS02:Download 68.86%
23:42:47:WU02:FS02:Upload 79.74%
23:42:48:WU03:FS02:Download complete
23:42:48:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:8900 run:107 clone:2 gen:6 core:0x17 unit:0x0000000d028c126651a63e46af239a33
23:42:48:WU03:FS02:Starting
23:42:48:WU03:FS02:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 3 -gpu-vendor ati
23:42:48:WU03:FS02:Started FahCore on PID 3020
23:42:48:WU03:FS02:Core PID:1428
23:42:48:WU03:FS02:FahCore 0x17 started
23:42:48:WU03:FS02:0x17:*********************** Log Started 2013-11-09T23:42:48Z ***********************
23:42:48:WU03:FS02:0x17:Project: 8900 (Run 107, Clone 2, Gen 6)
23:42:48:WU03:FS02:0x17:Unit: 0x0000000d028c126651a63e46af239a33
23:42:48:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
23:42:48:WU03:FS02:0x17:Machine: 2
23:42:48:WU03:FS02:0x17:Reading tar file state.xml
23:42:49:WU03:FS02:0x17:Reading tar file system.xml
23:42:49:WU03:FS02:0x17:Reading tar file integrator.xml
23:42:49:WU03:FS02:0x17:Reading tar file core.xml
23:42:49:WU03:FS02:0x17:Digital signatures verified
23:42:53:WU02:FS02:Upload 99.67%
23:42:54:WU02:FS02:Upload complete
23:42:54:WU02:FS02:Server responded WORK_ACK (400)
23:42:54:WU02:FS02:Cleaning up
23:45:02:WU03:FS02:0x17:ERROR:exception: Force RMSE error of 180.161 with threshold of 5
23:45:02:WU03:FS02:0x17:Saving result file logfile_01.txt
23:45:02:WU03:FS02:0x17:Saving result file badStateCheckpoint_41
23:45:02:WU03:FS02:0x17:Saving result file badStateForceGroup0_41Core.xml
23:45:04:WU03:FS02:0x17:Saving result file badStateForceGroup0_41Ref.xml
23:45:06:WU03:FS02:0x17:Saving result file badStateForceGroup1_41Core.xml
23:45:08:WU03:FS02:0x17:Saving result file badStateForceGroup1_41Ref.xml
23:45:09:WU03:FS02:0x17:Saving result file badStateForceGroup2_41Core.xml
23:45:10:WU03:FS02:0x17:Saving result file badStateForceGroup2_41Ref.xml
23:45:12:WU03:FS02:0x17:Saving result file log.txt
23:45:12:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:45:12:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:45:12:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:8900 run:107 clone:2 gen:6 core:0x17 unit:0x0000000d028c126651a63e46af239a33
23:45:12:WU03:FS02:Uploading 20.66MiB to 171.64.65.69
23:45:12:WU03:FS02:Connecting to 171.64.65.69:8080
23:45:13:WU02:FS02:Connecting to assign-GPU.stanford.edu:80
23:45:13:WU02:FS02:News: Welcome to Folding@Home
23:45:13:WU02:FS02:Assigned to work server 171.64.65.69
23:45:13:WU02:FS02:Requesting new work unit for slot 02: READY gpu:3:Tahiti [Radeon HD 7900 Series] from 171.64.65.69
23:45:13:WU02:FS02:Connecting to 171.64.65.69:8080
23:45:16:WU02:FS02:Downloading 4.51MiB
23:45:18:WU03:FS02:Upload 14.22%
23:45:24:WU02:FS02:Download 18.03%
23:45:24:WU03:FS02:Upload 30.85%
23:45:30:WU03:FS02:Upload 50.82%
23:45:30:WU02:FS02:Download 33.28%
23:45:36:WU03:FS02:Upload 70.48%
23:45:36:WU02:FS02:Download 59.63%
23:45:40:WU02:FS02:Download complete
23:45:40:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:512 clone:5 gen:0 core:0x17 unit:0x00000001028c126651a698a8a23a841b
23:45:40:WU02:FS02:Starting
23:45:40:WU02:FS02:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 3 -gpu-vendor ati
23:45:40:WU02:FS02:Started FahCore on PID 1336
23:45:40:WU02:FS02:Core PID:736
23:45:40:WU02:FS02:FahCore 0x17 started
23:45:40:WU02:FS02:0x17:*********************** Log Started 2013-11-09T23:45:40Z ***********************
23:45:40:WU02:FS02:0x17:Project: 8900 (Run 512, Clone 5, Gen 0)
23:45:40:WU02:FS02:0x17:Unit: 0x00000001028c126651a698a8a23a841b
23:45:40:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
23:45:40:WU02:FS02:0x17:Machine: 2
23:45:40:WU02:FS02:0x17:Reading tar file system.xml
23:45:41:WU02:FS02:0x17:Reading tar file integrator.xml
23:45:41:WU02:FS02:0x17:Reading tar file state.xml
23:45:41:WU02:FS02:0x17:Reading tar file core.xml
23:45:41:WU02:FS02:0x17:Digital signatures verified
23:45:42:WU03:FS02:Upload 90.75%
23:45:46:WU03:FS02:Upload complete
23:45:46:WU03:FS02:Server responded WORK_ACK (400)
23:45:46:WU03:FS02:Cleaning up
23:45:58:WU05:FS01:0x17:Completed 675000 out of 2500000 steps (27%)
23:46:01:WU00:FS00:0x17:Completed 725000 out of 2500000 steps (29%)
23:47:53:WU02:FS02:0x17:ERROR:exception: Force RMSE error of 173.113 with threshold of 5
23:47:53:WU02:FS02:0x17:Saving result file logfile_01.txt
23:47:53:WU02:FS02:0x17:Saving result file badStateCheckpoint_41
23:47:54:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Core.xml
23:47:55:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Ref.xml
23:47:57:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Core.xml
23:47:59:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Ref.xml
23:48:00:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Core.xml
23:48:02:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Ref.xml
23:48:03:WU02:FS02:0x17:Saving result file log.txt
23:48:03:WU02:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:48:04:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:48:04:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:512 clone:5 gen:0 core:0x17 unit:0x00000001028c126651a698a8a23a841b
23:48:04:WU02:FS02:Uploading 20.61MiB to 171.64.65.69
23:48:04:WU02:FS02:Connecting to 171.64.65.69:8080
23:48:04:WU03:FS02:Connecting to assign-GPU.stanford.edu:80
23:48:04:WU03:FS02:News: Welcome to Folding@Home
23:48:04:WU03:FS02:Assigned to work server 171.64.65.69
23:48:04:WU03:FS02:Requesting new work unit for slot 02: READY gpu:3:Tahiti [Radeon HD 7900 Series] from 171.64.65.69
23:48:04:WU03:FS02:Connecting to 171.64.65.69:8080
23:48:06:WU03:FS02:Downloading 4.18MiB
23:48:10:WU02:FS02:Upload 22.44%
23:48:12:WU03:FS02:Download 7.48%
23:48:16:WU02:FS02:Upload 42.45%
23:48:18:WU03:FS02:Download 25.44%
23:48:22:WU02:FS02:Upload 62.47%
23:48:24:WU03:FS02:Download 49.39%
23:48:28:WU02:FS02:Upload 82.48%
23:48:30:WU03:FS02:Download 83.81%
23:48:32:WU03:FS02:Download complete
23:48:32:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:8900 run:736 clone:2 gen:5 core:0x17 unit:0x00000013028c126651a6ca5e7e3afebe
23:48:32:WU03:FS02:Starting
23:48:32:WU03:FS02:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 3 -gpu-vendor ati
23:48:32:WU03:FS02:Started FahCore on PID 3728
23:48:32:WU03:FS02:Core PID:2144
23:48:32:WU03:FS02:FahCore 0x17 started
23:48:33:WU03:FS02:0x17:*********************** Log Started 2013-11-09T23:48:32Z ***********************
23:48:33:WU03:FS02:0x17:Project: 8900 (Run 736, Clone 2, Gen 5)
23:48:33:WU03:FS02:0x17:Unit: 0x00000013028c126651a6ca5e7e3afebe
23:48:33:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
23:48:33:WU03:FS02:0x17:Machine: 2
23:48:33:WU03:FS02:0x17:Reading tar file state.xml
23:48:33:WU03:FS02:0x17:Reading tar file system.xml
23:48:34:WU03:FS02:0x17:Reading tar file integrator.xml
23:48:34:WU03:FS02:0x17:Reading tar file core.xml
23:48:34:WU03:FS02:0x17:Digital signatures verified
23:48:34:WU02:FS02:Upload complete
23:48:34:WU02:FS02:Server responded WORK_ACK (400)
23:48:34:WU02:FS02:Cleaning up
23:49:54:WU05:FS01:0x17:Completed 700000 out of 2500000 steps (28%)
23:50:01:WU00:FS00:0x17:Completed 750000 out of 2500000 steps (30%)
23:50:48:WU03:FS02:0x17:ERROR:exception: Force RMSE error of 174.286 with threshold of 5
23:50:48:WU03:FS02:0x17:Saving result file logfile_01.txt
23:50:48:WU03:FS02:0x17:Saving result file badStateCheckpoint_41
23:50:48:WU03:FS02:0x17:Saving result file badStateForceGroup0_41Core.xml
23:50:50:WU03:FS02:0x17:Saving result file badStateForceGroup0_41Ref.xml
23:50:52:WU03:FS02:0x17:Saving result file badStateForceGroup1_41Core.xml
23:50:53:WU03:FS02:0x17:Saving result file badStateForceGroup1_41Ref.xml
23:50:55:WU03:FS02:0x17:Saving result file badStateForceGroup2_41Core.xml
23:50:56:WU03:FS02:0x17:Saving result file badStateForceGroup2_41Ref.xml
23:50:58:WU03:FS02:0x17:Saving result file log.txt
23:50:58:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:50:58:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:50:58:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:8900 run:736 clone:2 gen:5 core:0x17 unit:0x00000013028c126651a6ca5e7e3afebe
23:50:58:WU03:FS02:Uploading 20.67MiB to 171.64.65.69
23:50:58:WU03:FS02:Connecting to 171.64.65.69:8080
23:50:58:WU02:FS02:Connecting to assign-GPU.stanford.edu:80
23:50:59:WU02:FS02:News: Welcome to Folding@Home
23:50:59:WU02:FS02:Assigned to work server 171.64.65.69
23:50:59:WU02:FS02:Requesting new work unit for slot 02: READY gpu:3:Tahiti [Radeon HD 7900 Series] from 171.64.65.69
23:50:59:WU02:FS02:Connecting to 171.64.65.69:8080
23:51:00:WU02:FS02:Downloading 4.17MiB
23:51:04:WU03:FS02:Upload 21.77%
23:51:06:WU02:FS02:Download 7.49%
23:51:10:WU03:FS02:Upload 41.73%
23:51:12:WU02:FS02:Download 28.46%
23:51:16:WU03:FS02:Upload 61.69%
23:51:18:WU02:FS02:Download 76.39%
23:51:19:WU02:FS02:Download complete
23:51:19:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:365 clone:4 gen:6 core:0x17 unit:0x0000000a028c126651a677db0c00984f
23:51:19:WU02:FS02:Starting
23:51:19:WU02:FS02:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 3 -gpu-vendor ati
23:51:19:WU02:FS02:Started FahCore on PID 4116
23:51:19:WU02:FS02:Core PID:4736
23:51:19:WU02:FS02:FahCore 0x17 started
23:51:20:WU02:FS02:0x17:*********************** Log Started 2013-11-09T23:51:19Z ***********************
23:51:20:WU02:FS02:0x17:Project: 8900 (Run 365, Clone 4, Gen 6)
23:51:20:WU02:FS02:0x17:Unit: 0x0000000a028c126651a677db0c00984f
23:51:20:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
23:51:20:WU02:FS02:0x17:Machine: 2
23:51:20:WU02:FS02:0x17:Reading tar file state.xml
23:51:20:WU02:FS02:0x17:Reading tar file system.xml
23:51:21:WU02:FS02:0x17:Reading tar file integrator.xml
23:51:21:WU02:FS02:0x17:Reading tar file core.xml
23:51:21:WU02:FS02:0x17:Digital signatures verified
23:51:22:WU03:FS02:Upload 81.64%
23:51:29:WU03:FS02:Upload complete
23:51:29:WU03:FS02:Server responded WORK_ACK (400)
23:51:29:WU03:FS02:Cleaning up
23:53:33:WU02:FS02:0x17:ERROR:exception: Force RMSE error of 181.694 with threshold of 5
23:53:33:WU02:FS02:0x17:Saving result file logfile_01.txt
23:53:33:WU02:FS02:0x17:Saving result file badStateCheckpoint_41
23:53:34:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Core.xml
23:53:35:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Ref.xml
23:53:37:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Core.xml
23:53:39:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Ref.xml
23:53:40:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Core.xml
23:53:42:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Ref.xml
23:53:43:WU02:FS02:0x17:Saving result file log.txt
23:53:43:WU02:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:53:44:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:53:44:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:365 clone:4 gen:6 core:0x17 unit:0x0000000a028c126651a677db0c00984f
23:53:44:WU02:FS02:Uploading 20.64MiB to 171.64.65.69
23:53:44:WU02:FS02:Connecting to 171.64.65.69:8080
23:53:50:WU02:FS02:Upload 13.93%
23:53:56:WU02:FS02:Upload 34.52%
23:54:02:WU02:FS02:Upload 54.20%
23:54:07:WU05:FS01:0x17:Completed 725000 out of 2500000 steps (29%)
23:54:08:WU02:FS02:Upload 74.49%
23:54:14:WU02:FS02:Upload 94.47%
23:54:17:WU00:FS00:0x17:Completed 775000 out of 2500000 steps (31%)
23:54:17:WU02:FS02:Upload complete
23:54:17:WU02:FS02:Server responded WORK_ACK (400)
23:54:17:WU02:FS02:Cleaning up
23:58:07:WU05:FS01:0x17:Completed 750000 out of 2500000 steps (30%)
23:58:19:WU00:FS00:0x17:Completed 800000 out of 2500000 steps (32%)
00:02:19:WU05:FS01:0x17:Completed 775000 out of 2500000 steps (31%)
00:02:34:WU00:FS00:0x17:Completed 825000 out of 2500000 steps (33%)
Code: Select all
*********************** Log Started 2013-11-09T23:38:52Z ***********************
23:39:46:FS02:Unpaused
23:39:57:WU02:FS02:Starting
23:39:57:WU02:FS02:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 3 -gpu-vendor ati
23:39:57:WU02:FS02:Started FahCore on PID 4712
23:39:57:WU02:FS02:Core PID:2448
23:39:57:WU02:FS02:FahCore 0x17 started
23:39:58:WU02:FS02:0x17:*********************** Log Started 2013-11-09T23:39:57Z ***********************
23:39:58:WU02:FS02:0x17:Project: 8900 (Run 595, Clone 4, Gen 1)
23:39:58:WU02:FS02:0x17:Unit: 0x00000004028c126651a6ab0f937fc86e
23:39:58:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
23:39:58:WU02:FS02:0x17:Machine: 2
23:39:58:WU02:FS02:0x17:Digital signatures verified
23:39:58:WU02:FS02:0x17: Found a checkpoint file
23:42:13:WU02:FS02:0x17:ERROR:exception: Force RMSE error of 176.033 with threshold of 5
23:42:13:WU02:FS02:0x17:Saving result file logfile_01.txt
23:42:13:WU02:FS02:0x17:Saving result file badStateCheckpoint_41
23:42:14:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Core.xml
23:42:16:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Ref.xml
23:42:17:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Core.xml
23:42:19:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Ref.xml
23:42:20:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Core.xml
23:42:22:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Ref.xml
23:42:23:WU02:FS02:0x17:Saving result file log.txt
23:42:23:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:42:23:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:595 clone:4 gen:1 core:0x17 unit:0x00000004028c126651a6ab0f937fc86e
23:42:23:WU02:FS02:Uploading 20.69MiB to 171.64.65.69
23:42:23:WU02:FS02:Connecting to 171.64.65.69:8080
23:42:24:WU03:FS02:Connecting to assign-GPU.stanford.edu:80
23:42:24:WU03:FS02:News: Welcome to Folding@Home
23:42:24:WU03:FS02:Assigned to work server 171.64.65.69
23:42:24:WU03:FS02:Requesting new work unit for slot 02: READY gpu:3:Tahiti [Radeon HD 7900 Series] from 171.64.65.69
23:42:24:WU03:FS02:Connecting to 171.64.65.69:8080
23:42:27:WU03:FS02:Downloading 4.18MiB
23:42:29:WU02:FS02:Upload 19.93%
23:42:33:WU03:FS02:Download 5.99%
23:42:35:WU02:FS02:Upload 39.87%
23:42:39:WU03:FS02:Download 23.95%
23:42:41:WU02:FS02:Upload 59.80%
23:42:45:WU03:FS02:Download 68.86%
23:42:47:WU02:FS02:Upload 79.74%
23:42:48:WU03:FS02:Download complete
23:42:48:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:8900 run:107 clone:2 gen:6 core:0x17 unit:0x0000000d028c126651a63e46af239a33
23:42:48:WU03:FS02:Starting
23:42:48:WU03:FS02:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 3 -gpu-vendor ati
23:42:48:WU03:FS02:Started FahCore on PID 3020
23:42:48:WU03:FS02:Core PID:1428
23:42:48:WU03:FS02:FahCore 0x17 started
23:42:48:WU03:FS02:0x17:*********************** Log Started 2013-11-09T23:42:48Z ***********************
23:42:48:WU03:FS02:0x17:Project: 8900 (Run 107, Clone 2, Gen 6)
23:42:48:WU03:FS02:0x17:Unit: 0x0000000d028c126651a63e46af239a33
23:42:48:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
23:42:48:WU03:FS02:0x17:Machine: 2
23:42:48:WU03:FS02:0x17:Reading tar file state.xml
23:42:49:WU03:FS02:0x17:Reading tar file system.xml
23:42:49:WU03:FS02:0x17:Reading tar file integrator.xml
23:42:49:WU03:FS02:0x17:Reading tar file core.xml
23:42:49:WU03:FS02:0x17:Digital signatures verified
23:42:53:WU02:FS02:Upload 99.67%
23:42:54:WU02:FS02:Upload complete
23:42:54:WU02:FS02:Server responded WORK_ACK (400)
23:42:54:WU02:FS02:Cleaning up
23:45:02:WU03:FS02:0x17:ERROR:exception: Force RMSE error of 180.161 with threshold of 5
23:45:02:WU03:FS02:0x17:Saving result file logfile_01.txt
23:45:02:WU03:FS02:0x17:Saving result file badStateCheckpoint_41
23:45:02:WU03:FS02:0x17:Saving result file badStateForceGroup0_41Core.xml
23:45:04:WU03:FS02:0x17:Saving result file badStateForceGroup0_41Ref.xml
23:45:06:WU03:FS02:0x17:Saving result file badStateForceGroup1_41Core.xml
23:45:08:WU03:FS02:0x17:Saving result file badStateForceGroup1_41Ref.xml
23:45:09:WU03:FS02:0x17:Saving result file badStateForceGroup2_41Core.xml
23:45:10:WU03:FS02:0x17:Saving result file badStateForceGroup2_41Ref.xml
23:45:12:WU03:FS02:0x17:Saving result file log.txt
23:45:12:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:45:12:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:45:12:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:8900 run:107 clone:2 gen:6 core:0x17 unit:0x0000000d028c126651a63e46af239a33
23:45:12:WU03:FS02:Uploading 20.66MiB to 171.64.65.69
23:45:12:WU03:FS02:Connecting to 171.64.65.69:8080
23:45:13:WU02:FS02:Connecting to assign-GPU.stanford.edu:80
23:45:13:WU02:FS02:News: Welcome to Folding@Home
23:45:13:WU02:FS02:Assigned to work server 171.64.65.69
23:45:13:WU02:FS02:Requesting new work unit for slot 02: READY gpu:3:Tahiti [Radeon HD 7900 Series] from 171.64.65.69
23:45:13:WU02:FS02:Connecting to 171.64.65.69:8080
23:45:16:WU02:FS02:Downloading 4.51MiB
23:45:18:WU03:FS02:Upload 14.22%
23:45:24:WU02:FS02:Download 18.03%
23:45:24:WU03:FS02:Upload 30.85%
23:45:30:WU03:FS02:Upload 50.82%
23:45:30:WU02:FS02:Download 33.28%
23:45:36:WU03:FS02:Upload 70.48%
23:45:36:WU02:FS02:Download 59.63%
23:45:40:WU02:FS02:Download complete
23:45:40:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:512 clone:5 gen:0 core:0x17 unit:0x00000001028c126651a698a8a23a841b
23:45:40:WU02:FS02:Starting
23:45:40:WU02:FS02:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 3 -gpu-vendor ati
23:45:40:WU02:FS02:Started FahCore on PID 1336
23:45:40:WU02:FS02:Core PID:736
23:45:40:WU02:FS02:FahCore 0x17 started
23:45:40:WU02:FS02:0x17:*********************** Log Started 2013-11-09T23:45:40Z ***********************
23:45:40:WU02:FS02:0x17:Project: 8900 (Run 512, Clone 5, Gen 0)
23:45:40:WU02:FS02:0x17:Unit: 0x00000001028c126651a698a8a23a841b
23:45:40:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
23:45:40:WU02:FS02:0x17:Machine: 2
23:45:40:WU02:FS02:0x17:Reading tar file system.xml
23:45:41:WU02:FS02:0x17:Reading tar file integrator.xml
23:45:41:WU02:FS02:0x17:Reading tar file state.xml
23:45:41:WU02:FS02:0x17:Reading tar file core.xml
23:45:41:WU02:FS02:0x17:Digital signatures verified
23:45:42:WU03:FS02:Upload 90.75%
23:45:46:WU03:FS02:Upload complete
23:45:46:WU03:FS02:Server responded WORK_ACK (400)
23:45:46:WU03:FS02:Cleaning up
23:47:53:WU02:FS02:0x17:ERROR:exception: Force RMSE error of 173.113 with threshold of 5
23:47:53:WU02:FS02:0x17:Saving result file logfile_01.txt
23:47:53:WU02:FS02:0x17:Saving result file badStateCheckpoint_41
23:47:54:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Core.xml
23:47:55:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Ref.xml
23:47:57:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Core.xml
23:47:59:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Ref.xml
23:48:00:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Core.xml
23:48:02:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Ref.xml
23:48:03:WU02:FS02:0x17:Saving result file log.txt
23:48:03:WU02:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:48:04:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:48:04:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:512 clone:5 gen:0 core:0x17 unit:0x00000001028c126651a698a8a23a841b
23:48:04:WU02:FS02:Uploading 20.61MiB to 171.64.65.69
23:48:04:WU02:FS02:Connecting to 171.64.65.69:8080
23:48:04:WU03:FS02:Connecting to assign-GPU.stanford.edu:80
23:48:04:WU03:FS02:News: Welcome to Folding@Home
23:48:04:WU03:FS02:Assigned to work server 171.64.65.69
23:48:04:WU03:FS02:Requesting new work unit for slot 02: READY gpu:3:Tahiti [Radeon HD 7900 Series] from 171.64.65.69
23:48:04:WU03:FS02:Connecting to 171.64.65.69:8080
23:48:06:WU03:FS02:Downloading 4.18MiB
23:48:10:WU02:FS02:Upload 22.44%
23:48:12:WU03:FS02:Download 7.48%
23:48:16:WU02:FS02:Upload 42.45%
23:48:18:WU03:FS02:Download 25.44%
23:48:22:WU02:FS02:Upload 62.47%
23:48:24:WU03:FS02:Download 49.39%
23:48:28:WU02:FS02:Upload 82.48%
23:48:30:WU03:FS02:Download 83.81%
23:48:32:WU03:FS02:Download complete
23:48:32:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:8900 run:736 clone:2 gen:5 core:0x17 unit:0x00000013028c126651a6ca5e7e3afebe
23:48:32:WU03:FS02:Starting
23:48:32:WU03:FS02:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 3 -gpu-vendor ati
23:48:32:WU03:FS02:Started FahCore on PID 3728
23:48:32:WU03:FS02:Core PID:2144
23:48:32:WU03:FS02:FahCore 0x17 started
23:48:33:WU03:FS02:0x17:*********************** Log Started 2013-11-09T23:48:32Z ***********************
23:48:33:WU03:FS02:0x17:Project: 8900 (Run 736, Clone 2, Gen 5)
23:48:33:WU03:FS02:0x17:Unit: 0x00000013028c126651a6ca5e7e3afebe
23:48:33:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
23:48:33:WU03:FS02:0x17:Machine: 2
23:48:33:WU03:FS02:0x17:Reading tar file state.xml
23:48:33:WU03:FS02:0x17:Reading tar file system.xml
23:48:34:WU03:FS02:0x17:Reading tar file integrator.xml
23:48:34:WU03:FS02:0x17:Reading tar file core.xml
23:48:34:WU03:FS02:0x17:Digital signatures verified
23:48:34:WU02:FS02:Upload complete
23:48:34:WU02:FS02:Server responded WORK_ACK (400)
23:48:34:WU02:FS02:Cleaning up
23:50:48:WU03:FS02:0x17:ERROR:exception: Force RMSE error of 174.286 with threshold of 5
23:50:48:WU03:FS02:0x17:Saving result file logfile_01.txt
23:50:48:WU03:FS02:0x17:Saving result file badStateCheckpoint_41
23:50:48:WU03:FS02:0x17:Saving result file badStateForceGroup0_41Core.xml
23:50:50:WU03:FS02:0x17:Saving result file badStateForceGroup0_41Ref.xml
23:50:52:WU03:FS02:0x17:Saving result file badStateForceGroup1_41Core.xml
23:50:53:WU03:FS02:0x17:Saving result file badStateForceGroup1_41Ref.xml
23:50:55:WU03:FS02:0x17:Saving result file badStateForceGroup2_41Core.xml
23:50:56:WU03:FS02:0x17:Saving result file badStateForceGroup2_41Ref.xml
23:50:58:WU03:FS02:0x17:Saving result file log.txt
23:50:58:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:50:58:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:50:58:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:8900 run:736 clone:2 gen:5 core:0x17 unit:0x00000013028c126651a6ca5e7e3afebe
23:50:58:WU03:FS02:Uploading 20.67MiB to 171.64.65.69
23:50:58:WU03:FS02:Connecting to 171.64.65.69:8080
23:50:58:WU02:FS02:Connecting to assign-GPU.stanford.edu:80
23:50:59:WU02:FS02:News: Welcome to Folding@Home
23:50:59:WU02:FS02:Assigned to work server 171.64.65.69
23:50:59:WU02:FS02:Requesting new work unit for slot 02: READY gpu:3:Tahiti [Radeon HD 7900 Series] from 171.64.65.69
23:50:59:WU02:FS02:Connecting to 171.64.65.69:8080
23:51:00:WU02:FS02:Downloading 4.17MiB
23:51:04:WU03:FS02:Upload 21.77%
23:51:06:WU02:FS02:Download 7.49%
23:51:10:WU03:FS02:Upload 41.73%
23:51:12:WU02:FS02:Download 28.46%
23:51:16:WU03:FS02:Upload 61.69%
23:51:18:WU02:FS02:Download 76.39%
23:51:19:WU02:FS02:Download complete
23:51:19:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:365 clone:4 gen:6 core:0x17 unit:0x0000000a028c126651a677db0c00984f
23:51:19:WU02:FS02:Starting
23:51:19:WU02:FS02:Running FahCore: "e:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" e:/Users/Roswell_ET/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 3904 -checkpoint 15 -gpu 3 -gpu-vendor ati
23:51:19:WU02:FS02:Started FahCore on PID 4116
23:51:19:WU02:FS02:Core PID:4736
23:51:19:WU02:FS02:FahCore 0x17 started
23:51:20:WU02:FS02:0x17:*********************** Log Started 2013-11-09T23:51:19Z ***********************
23:51:20:WU02:FS02:0x17:Project: 8900 (Run 365, Clone 4, Gen 6)
23:51:20:WU02:FS02:0x17:Unit: 0x0000000a028c126651a677db0c00984f
23:51:20:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
23:51:20:WU02:FS02:0x17:Machine: 2
23:51:20:WU02:FS02:0x17:Reading tar file state.xml
23:51:20:WU02:FS02:0x17:Reading tar file system.xml
23:51:21:WU02:FS02:0x17:Reading tar file integrator.xml
23:51:21:WU02:FS02:0x17:Reading tar file core.xml
23:51:21:WU02:FS02:0x17:Digital signatures verified
23:51:22:WU03:FS02:Upload 81.64%
23:51:29:WU03:FS02:Upload complete
23:51:29:WU03:FS02:Server responded WORK_ACK (400)
23:51:29:WU03:FS02:Cleaning up
23:53:33:WU02:FS02:0x17:ERROR:exception: Force RMSE error of 181.694 with threshold of 5
23:53:33:WU02:FS02:0x17:Saving result file logfile_01.txt
23:53:33:WU02:FS02:0x17:Saving result file badStateCheckpoint_41
23:53:34:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Core.xml
23:53:35:WU02:FS02:0x17:Saving result file badStateForceGroup0_41Ref.xml
23:53:37:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Core.xml
23:53:39:WU02:FS02:0x17:Saving result file badStateForceGroup1_41Ref.xml
23:53:40:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Core.xml
23:53:42:WU02:FS02:0x17:Saving result file badStateForceGroup2_41Ref.xml
23:53:43:WU02:FS02:0x17:Saving result file log.txt
23:53:43:WU02:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:53:44:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:53:44:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:365 clone:4 gen:6 core:0x17 unit:0x0000000a028c126651a677db0c00984f
23:53:44:WU02:FS02:Uploading 20.64MiB to 171.64.65.69
23:53:44:WU02:FS02:Connecting to 171.64.65.69:8080
23:53:50:WU02:FS02:Upload 13.93%
23:53:56:WU02:FS02:Upload 34.52%
23:54:02:WU02:FS02:Upload 54.20%
23:54:08:WU02:FS02:Upload 74.49%
23:54:14:WU02:FS02:Upload 94.47%
23:54:17:WU02:FS02:Upload complete
23:54:17:WU02:FS02:Server responded WORK_ACK (400)
23:54:17:WU02:FS02:Cleaning up