Yeah, I just noticed that I got partial for that one, but the previous ones, I think were an issue with my client; it was doing some really weird things at one point. such as the FAHClient.exe opening command prompt window and log that if I closed, would close the client.exe and somehow result in a lost WU, but below are the logs I have starting from the most recent, right before this WU failed
Code: Select all
23:33:59:WU00:FS00:0x17:Completed 2850000 out of 5000000 steps (57%)
23:55:12:WU00:FS00:0x17:Completed 2900000 out of 5000000 steps (58%)
00:01:10:FS00:Finishing
00:15:56:WU00:FS00:0x17:Completed 2950000 out of 5000000 steps (59%)
00:23:03:FS00:Paused
00:23:03:FS00:Shutting core down
00:23:04:WU00:FS00:0x17:WARNING:Console control signal 1 on PID 6700
00:23:04:WU00:FS00:0x17:Exiting, please wait. . .
00:23:04:WU00:FS00:0x17:Folding@home Core Shutdown: INTERRUPTED
00:23:05:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
00:54:20:FS00:Unpaused
00:54:20:WU00:FS00:Starting
00:54:20:WU00:FS00:Running FahCore: "G:\Program Files\FAHClient/FAHCoreWrapper.exe" G:/Users/Family/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 703 -lifeline 6512 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
00:54:20:WU00:FS00:Started FahCore on PID 7944
00:54:20:WU00:FS00:Core PID:3040
00:54:20:WU00:FS00:FahCore 0x17 started
00:54:20:WU00:FS00:0x17:*********************** Log Started 2014-09-04T00:54:20Z ***********************
00:54:20:WU00:FS00:0x17:Project: 13000 (Run 2194, Clone 0, Gen 45)
00:54:20:WU00:FS00:0x17:Unit: 0x0000005a538b3db75312084de9f585f6
00:54:20:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:54:20:WU00:FS00:0x17:Machine: 0
00:54:20:WU00:FS00:0x17:Digital signatures verified
00:54:20:WU00:FS00:0x17:Folding@home GPU core17
00:54:20:WU00:FS00:0x17:Version 0.0.52
00:54:20:WU00:FS00:0x17: Found a checkpoint file
00:58:29:WU00:FS00:0x17:Completed 2875000 out of 5000000 steps (57%)
00:58:29:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:04:43:WU00:FS00:0x17:Completed 2900000 out of 5000000 steps (58%)
01:16:20:WU00:FS00:0x17:Completed 2950000 out of 5000000 steps (59%)
01:27:56:WU00:FS00:0x17:Completed 3000000 out of 5000000 steps (60%)
Somehow when from 59%, back to 57% which probably caused the issue this time.
Code: Select all
23:45:34:WU00:FS00:0x17:Completed 1800000 out of 2000000 steps (90%)
23:57:33:WU00:FS00:0x17:Completed 1820000 out of 2000000 steps (91%)
00:09:05:WU00:FS00:0x17:Completed 1840000 out of 2000000 steps (92%)
00:17:23:FS00:Paused
00:17:23:FS00:Shutting core down
00:17:23:WU00:FS00:0x17:WARNING:Console control signal 1 on PID 4580
00:17:23:WU00:FS00:0x17:Exiting, please wait. . .
00:17:23:WU00:FS00:0x17:Lost lifeline PID 9208, exiting
00:17:23:WU00:FS00:0x17:ERROR:103: Lost client lifeline
00:17:23:WU00:FS00:0x17:Folding@home Core Shutdown: CLIENT_DIED
00:17:24:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
02:16:39:FS00:Unpaused
02:16:39:WU00:FS00:Starting
02:16:39:WU00:FS00:Running FahCore: "G:\Program Files\FAHClient/FAHCoreWrapper.exe" G:/Users/Family/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 703 -lifeline 5736 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
02:16:39:WU00:FS00:Started FahCore on PID 1664
02:16:39:WU00:FS00:Core PID:7272
02:16:39:WU00:FS00:FahCore 0x17 started
02:16:39:WU00:FS00:0x17:*********************** Log Started 2014-08-30T02:16:39Z ***********************
02:16:39:WU00:FS00:0x17:Project: 9406 (Run 933, Clone 0, Gen 52)
02:16:39:WU00:FS00:0x17:Unit: 0x000000550a3b1e5c533e941301c7d11b
02:16:39:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
02:16:39:WU00:FS00:0x17:Machine: 0
02:16:39:WU00:FS00:0x17:Digital signatures verified
02:16:39:WU00:FS00:0x17:Folding@home GPU core17
02:16:39:WU00:FS00:0x17:Version 0.0.52
02:16:39:WU00:FS00:0x17: Found a checkpoint file
02:16:51:WU00:FS00:0x17:ERROR:exception: Invoked getForces() on a State which does not contain forces.
02:16:51:WU00:FS00:0x17:Saving result file logfile_01.txt
02:16:51:WU00:FS00:0x17:Saving result file log.txt
02:16:51:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
02:16:51:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
02:16:51:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:9406 run:933 clone:0 gen:52 core:0x17 unit:0x000000550a3b1e5c533e941301c7d11b
02:16:51:WU00:FS00:Uploading 4.61KiB to 171.64.65.56
So I guess I'm not allowed to pause?
Code: Select all
*********************** Log Started 2014-09-01T23:15:28Z ***********************
23:15:28:************************* Folding@home Client *************************
23:15:28: Website: http://folding.stanford.edu/
23:15:28: Copyright: (c) 2009-2013 Stanford University
23:15:28: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:15:28: Args:
23:15:28: Config: G:/Users/Family/AppData/Roaming/FAHClient/config.xml
23:15:28:******************************** Build ********************************
23:15:28: Version: 7.3.6
23:15:28: Date: Feb 18 2013
23:15:28: Time: 15:24:05
23:15:28: SVN Rev: 3923
23:15:28: Branch: fah/trunk/client
23:15:28: Compiler: Intel(R) C++ MSVC 1500 mode 1200
23:15:28: Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE2
23:15:28: /QaxSSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
23:15:28: Platform: win32 Vista
23:15:28: Bits: 32
23:15:28: Mode: Release
23:15:28:******************************* System ********************************
23:15:28: CPU: Intel(R) Xeon(R) CPU X5460 @ 3.16GHz
23:15:28: CPU ID: GenuineIntel Family 6 Model 23 Stepping 6
23:15:28: CPUs: 4
23:15:28: Memory: 8.00GiB
23:15:28: Free Memory: 5.86GiB
23:15:28: Threads: WINDOWS_THREADS
23:15:28: Has Battery: false
23:15:28: On Battery: false
23:15:28: UTC offset: -4
23:15:28: PID: 7676
23:15:28: CWD: G:/Users/Family/AppData/Roaming/FAHClient
23:15:28: OS: Windows 7 Home Premium
23:15:28: OS Arch: AMD64
23:15:28: GPUs: 2
23:15:28: GPU 0: NVIDIA:2 GF110 [GeForce GTX 570]
23:15:28: GPU 1: NVIDIA:3 GK104 [GeForce GTX 660 Ti]
23:15:28: CUDA: 2.0
23:15:28: CUDA Driver: 6050
23:15:28:Win32 Service: false
23:15:28:***********************************************************************
23:15:28:<config>
23:15:28: <!-- Folding Slot Configuration -->
23:15:28: <power v='full'/>
23:15:28:
23:15:28: <!-- Network -->
23:15:28: <proxy v=':8080'/>
23:15:28:
23:15:28: <!-- User Information -->
23:15:28: <passkey v='********************************'/>
23:15:28: <team v='37726'/>
23:15:28: <user v='DownshiftArtist'/>
23:15:28:
23:15:28: <!-- Folding Slots -->
23:15:28: <slot id='0' type='GPU'>
23:15:28: <cuda-index v='1'/>
23:15:28: <gpu-index v='1'/>
23:15:28: <opencl-index v='1'/>
23:15:28: </slot>
23:15:28: <slot id='2' type='GPU'>
23:15:28: <cuda-index v='0'/>
23:15:28: <gpu-index v='0'/>
23:15:28: <opencl-index v='0'/>
23:15:28: <pause-on-start v='true'/>
23:15:28: </slot>
23:15:28:</config>
23:15:28:Trying to access database...
23:15:28:Successfully acquired database lock
23:15:28:Enabled folding slot 00: READY gpu:1:GK104 [GeForce GTX 660 Ti]
23:15:28:Enabled folding slot 02: PAUSED gpu:0:GF110 [GeForce GTX 570] (paused)
23:15:29:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
23:15:29:WU00:FS00:News: Welcome to Folding@Home
23:15:29:WU00:FS00:Assigned to work server 140.163.4.231
23:15:29:WU00:FS00:Requesting new work unit for slot 00: READY gpu:1:GK104 [GeForce GTX 660 Ti] from 140.163.4.231
23:15:29:WU00:FS00:Connecting to 140.163.4.231:8080
23:15:30:WU00:FS00:Downloading 4.84MiB
23:15:31:WU00:FS00:Download complete
23:15:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13000 run:2194 clone:0 gen:45 core:0x17 unit:0x0000005a538b3db75312084de9f585f6
23:15:31:WU00:FS00:Starting
23:15:31:WU00:FS00:Running FahCore: "G:\Program Files\FAHClient/FAHCoreWrapper.exe" G:/Users/Family/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 703 -lifeline 7676 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
23:15:31:WU00:FS00:Started FahCore on PID 5976
23:15:31:WU00:FS00:Core PID:5952
23:15:31:WU00:FS00:FahCore 0x17 started
23:15:33:FS00:Paused
23:15:33:FS00:Shutting core down
23:15:33:WARNING:WU00:FS00:FahCore returned an unknown error code which probably indicates that it crashed
23:15:33:WARNING:WU00:FS00:FahCore returned: UNKNOWN_ENUM (-1073741510 = 0xc000013a)
Code: Select all
*********************** Log Started 2014-08-28T07:17:15Z ***********************
07:17:15:************************* Folding@home Client *************************
07:17:15: Website: http://folding.stanford.edu/
07:17:15: Copyright: (c) 2009-2013 Stanford University
07:17:15: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
07:17:15: Args:
07:17:15: Config: G:/Users/Family/AppData/Roaming/FAHClient/config.xml
07:17:15:******************************** Build ********************************
07:17:15: Version: 7.3.6
07:17:15: Date: Feb 18 2013
07:17:15: Time: 15:24:05
07:17:15: SVN Rev: 3923
07:17:15: Branch: fah/trunk/client
07:17:15: Compiler: Intel(R) C++ MSVC 1500 mode 1200
07:17:15: Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE2
07:17:15: /QaxSSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
07:17:15: Platform: win32 Vista
07:17:15: Bits: 32
07:17:15: Mode: Release
07:17:15:******************************* System ********************************
07:17:15: CPU: Intel(R) Xeon(R) CPU X5460 @ 3.16GHz
07:17:15: CPU ID: GenuineIntel Family 6 Model 23 Stepping 6
07:17:15: CPUs: 4
07:17:15: Memory: 8.00GiB
07:17:15: Free Memory: 6.04GiB
07:17:15: Threads: WINDOWS_THREADS
07:17:15: Has Battery: false
07:17:15: On Battery: false
07:17:15: UTC offset: -4
07:17:15: PID: 6236
07:17:15: CWD: G:/Users/Family/AppData/Roaming/FAHClient
07:17:15: OS: Windows 7 Home Premium
07:17:15: OS Arch: AMD64
07:17:15: GPUs: 2
07:17:15: GPU 0: NVIDIA:2 GF110 [GeForce GTX 570]
07:17:15: GPU 1: NVIDIA:3 GK104 [GeForce GTX 660 Ti]
07:17:15: CUDA: 2.0
07:17:15: CUDA Driver: 6050
07:17:15:Win32 Service: false
07:17:15:***********************************************************************
07:17:15:<config>
07:17:15: <!-- Folding Slot Configuration -->
07:17:15: <power v='full'/>
07:17:15:
07:17:15: <!-- Network -->
07:17:15: <proxy v=':8080'/>
07:17:15:
07:17:15: <!-- User Information -->
07:17:15: <passkey v='********************************'/>
07:17:15: <team v='37726'/>
07:17:15: <user v='DownshiftArtist'/>
07:17:15:
07:17:15: <!-- Folding Slots -->
07:17:15: <slot id='0' type='GPU'>
07:17:15: <cuda-index v='1'/>
07:17:15: <opencl-index v='1'/>
07:17:15: </slot>
07:17:15: <slot id='1' type='GPU'>
07:17:15: <cuda-index v='0'/>
07:17:15: <opencl-index v='0'/>
07:17:15: </slot>
07:17:15:</config>
07:17:15:Trying to access database...
07:17:15:Successfully acquired database lock
07:17:15:Enabled folding slot 00: READY gpu:0:GF110 [GeForce GTX 570]
07:17:15:Enabled folding slot 01: READY gpu:1:GK104 [GeForce GTX 660 Ti]
07:17:15:WU02:FS00:Starting
07:17:15:WU02:FS00:Running FahCore: "G:\Program Files\FAHClient/FAHCoreWrapper.exe" G:/Users/Family/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 6236 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
07:17:15:WU02:FS00:Started FahCore on PID 6540
07:17:16:WU02:FS00:Core PID:6680
07:17:16:WU02:FS00:FahCore 0x17 started
07:17:16:WU01:FS01:Starting
07:17:16:WU01:FS01:Running FahCore: "G:\Program Files\FAHClient/FAHCoreWrapper.exe" G:/Users/Family/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 6236 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
07:17:16:WU01:FS01:Started FahCore on PID 4204
07:17:16:WU01:FS01:Core PID:5980
07:17:16:WU01:FS01:FahCore 0x17 started
07:17:17:WU01:FS01:0x17:*********************** Log Started 2014-08-28T07:17:16Z ***********************
07:17:17:WU01:FS01:0x17:Project: 9406 (Run 218, Clone 0, Gen 124)
07:17:17:WU01:FS01:0x17:Unit: 0x000000b90a3b1e5c533df1273839f875
07:17:17:WU01:FS01:0x17:CPU: 0x00000000000000000000000000000000
07:17:17:WU01:FS01:0x17:Machine: 1
07:17:17:WU01:FS01:0x17:Digital signatures verified
07:17:17:WU01:FS01:0x17:Folding@home GPU core17
07:17:17:WU01:FS01:0x17:Version 0.0.52
07:17:17:WU02:FS00:0x17:*********************** Log Started 2014-08-28T07:17:16Z ***********************
07:17:17:WU02:FS00:0x17:Project: 9406 (Run 107, Clone 0, Gen 108)
07:17:17:WU02:FS00:0x17:Unit: 0x000000a60a3b1e5c533ddc0cb1e5814a
07:17:17:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
07:17:17:WU02:FS00:0x17:Machine: 0
07:17:17:WU02:FS00:0x17:Reading tar file state.xml
07:17:18:WU02:FS00:0x17:Reading tar file system.xml
07:17:18:WU01:FS01:0x17: Found a checkpoint file
07:17:18:WU02:FS00:0x17:Reading tar file integrator.xml
07:17:18:WU02:FS00:0x17:Reading tar file core.xml
07:17:18:WU02:FS00:0x17:Digital signatures verified
07:17:18:WU02:FS00:0x17:Folding@home GPU core17
07:17:18:WU02:FS00:0x17:Version 0.0.52
07:17:32:WU02:FS00:0x17:ERROR:exception: Invoked getPositions() on a State which does not contain positions.
07:17:32:WU02:FS00:0x17:Saving result file logfile_01.txt
07:17:32:WU02:FS00:0x17:Saving result file log.txt
07:17:32:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
07:17:32:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
07:17:33:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:9406 run:107 clone:0 gen:108 core:0x17 unit:0x000000a60a3b1e5c533ddc0cb1e5814a
07:17:33:WU02:FS00:Uploading 3.51KiB to 171.64.65.56
Code: Select all
03:52:06:WU01:FS01:0x17:Completed 80000 out of 2000000 steps (4%)
04:02:04:WU01:FS01:0x17:Completed 100000 out of 2000000 steps (5%)
04:12:26:WU01:FS01:0x17:Completed 120000 out of 2000000 steps (6%)
04:22:23:WU01:FS01:0x17:Completed 140000 out of 2000000 steps (7%)
04:32:44:WU01:FS01:0x17:Completed 160000 out of 2000000 steps (8%)
04:42:41:WU01:FS01:0x17:Completed 180000 out of 2000000 steps (9%)
04:52:37:WU01:FS01:0x17:Completed 200000 out of 2000000 steps (10%)
05:02:57:WU01:FS01:0x17:Completed 220000 out of 2000000 steps (11%)
05:12:53:WU01:FS01:0x17:Completed 240000 out of 2000000 steps (12%)
05:23:13:WU01:FS01:0x17:Completed 260000 out of 2000000 steps (13%)
05:33:10:WU01:FS01:0x17:Completed 280000 out of 2000000 steps (14%)
05:43:06:WU01:FS01:0x17:Completed 300000 out of 2000000 steps (15%)
05:53:27:WU01:FS01:0x17:Completed 320000 out of 2000000 steps (16%)
06:03:23:WU01:FS01:0x17:Completed 340000 out of 2000000 steps (17%)
06:13:44:WU01:FS01:0x17:Completed 360000 out of 2000000 steps (18%)
06:23:41:WU01:FS01:0x17:Completed 380000 out of 2000000 steps (19%)
06:33:37:WU01:FS01:0x17:Completed 400000 out of 2000000 steps (20%)
06:43:57:WU01:FS01:0x17:Completed 420000 out of 2000000 steps (21%)
06:53:54:WU01:FS01:0x17:Completed 440000 out of 2000000 steps (22%)
07:04:14:WU01:FS01:0x17:Completed 460000 out of 2000000 steps (23%)
07:14:11:WU01:FS01:0x17:Completed 480000 out of 2000000 steps (24%)
07:15:21:WARNING:WU01:FS01:FahCore crashed with Windows unhandled exception code 0xUNKNOWN_ENUM, searching for this code online may provide more information
07:15:21:WARNING:WU01:FS01:FahCore returned: UNKNOWN_ENUM (1073807364 = 0x40010004)
07:15:21:WU01:FS01:Starting
Assuming this is a Windows error
It seems to be a variety of causes for issues, all stemming from upgrading my GPU. Didn't have any of these problems with my 570