Page 3 of 4

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Wed Mar 12, 2014 3:36 am
by PantherX
Turbo_T wrote:Correct, the second GPU is failing in all folding operations and the primary does also if the SLI is enabled. iwhen SLI is disabled and the sli connectors are disconnected the primary GPU is able to fold all Cores fine. The second GPU passes all memory and cuda benchmark tests fine but will not fold successfully. The errors quoted above repeat and the unit fails.
Can you please provide us with a fresh log which includes:
1) The initial section which contains the system configuration and F@H settings
2) The errors that is generated by the FahCore

Also, please tell us the driver being used and if the GPU Model is factory overclocked or not?

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Thu Mar 13, 2014 3:24 am
by Turbo_T
I have not been invited nor am I (to my knowledge) running a beta process/flag. I have enclosed the log from my failures today. The computer in question is not overclocked in any way and has been completely stable during folding since my start in 2011. my only recent addition to the system was a second GPU, which has proven to be unable to fold at all. This GPU has been a steady producer since the PC was built(by me).

Code: Select all

*********************** Log Started 2014-03-12T23:29:27Z ***********************
23:29:28:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
23:29:28:WU00:FS00:News: Welcome to Folding@Home
23:29:28:WU00:FS00:Assigned to work server 171.64.65.69
23:29:28:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:29:28:WU00:FS00:Connecting to 171.64.65.69:8080
23:29:29:WU00:FS00:Downloading 4.17MiB
23:29:31:WU00:FS00:Download complete
23:29:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:29:31:WU00:FS00:Starting
23:29:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:29:31:WU00:FS00:Started FahCore on PID 4056
23:29:32:WU00:FS00:Core PID:5296
23:29:32:WU00:FS00:FahCore 0x17 started
23:29:32:WU00:FS00:0x17:*********************** Log Started 2014-03-12T23:29:32Z ***********************
23:29:32:WU00:FS00:0x17:Project: 8900 (Run 198, Clone 5, Gen 41)
23:29:32:WU00:FS00:0x17:Unit: 0x0000004b028c126651a652ad5cdceb60
23:29:32:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:29:32:WU00:FS00:0x17:Machine: 0
23:29:32:WU00:FS00:0x17:Reading tar file state.xml
23:29:33:WU00:FS00:0x17:Reading tar file system.xml
23:29:33:WU00:FS00:0x17:Reading tar file integrator.xml
23:29:33:WU00:FS00:0x17:Reading tar file core.xml
23:29:33:WU00:FS00:0x17:Digital signatures verified
23:29:33:WU00:FS00:0x17:Folding@home GPU core17
23:29:33:WU00:FS00:0x17:Version 0.0.52
23:33:00:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:33:00:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:53:40:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
23:53:40:WU00:FS00:0x17:Saving result file logfile_01.txt
23:53:40:WU00:FS00:0x17:Saving result file log.txt
23:53:40:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:53:40:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:53:41:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:53:41:WU00:FS00:Uploading 2.47KiB to 171.64.65.69
23:53:41:WU00:FS00:Connecting to 171.64.65.69:8080
23:53:41:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
23:53:41:WU00:FS00:Upload complete
23:53:41:WU00:FS00:Server responded WORK_ACK (400)
23:53:41:WU00:FS00:Cleaning up
23:53:42:WU02:FS00:News: Welcome to Folding@Home
23:53:42:WU02:FS00:Assigned to work server 171.64.65.69
23:53:42:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:53:42:WU02:FS00:Connecting to 171.64.65.69:8080
23:53:42:WU02:FS00:Downloading 4.17MiB
23:53:45:WU02:FS00:Download complete
23:53:45:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:Starting
23:53:45:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:53:45:WU02:FS00:Started FahCore on PID 4192
23:53:45:WU02:FS00:Core PID:6880
23:53:45:WU02:FS00:FahCore 0x17 started
23:53:45:WU02:FS00:0x17:*********************** Log Started 2014-03-12T23:53:45Z ***********************
23:53:45:WU02:FS00:0x17:Project: 8900 (Run 449, Clone 10, Gen 25)
23:53:45:WU02:FS00:0x17:Unit: 0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:53:45:WU02:FS00:0x17:Machine: 0
23:53:45:WU02:FS00:0x17:Reading tar file state.xml
23:53:46:WU02:FS00:0x17:Reading tar file system.xml
23:53:47:WU02:FS00:0x17:Reading tar file integrator.xml
23:53:47:WU02:FS00:0x17:Reading tar file core.xml
23:53:47:WU02:FS00:0x17:Digital signatures verified
23:53:47:WU02:FS00:0x17:Folding@home GPU core17
23:53:47:WU02:FS00:0x17:Version 0.0.52
23:57:16:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:57:16:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:17:59:WU02:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
00:20:10:WU02:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
00:20:10:WU02:FS00:0x17:Saving result file logfile_01.txt
00:20:10:WU02:FS00:0x17:Saving result file log.txt
00:20:10:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:20:10:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:20:10:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
00:20:10:WU02:FS00:Uploading 2.50KiB to 171.64.65.69
00:20:10:WU02:FS00:Connecting to 171.64.65.69:8080
00:20:10:WU02:FS00:Upload complete
00:20:10:WU02:FS00:Server responded WORK_ACK (400)
00:20:10:WU02:FS00:Cleaning up
00:20:10:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
00:20:11:WU00:FS00:News: Welcome to Folding@Home
00:20:11:WU00:FS00:Assigned to work server 171.64.65.69
00:20:11:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:20:11:WU00:FS00:Connecting to 171.64.65.69:8080
00:20:11:WU00:FS00:Downloading 4.17MiB
00:20:14:WU00:FS00:Download complete
00:20:14:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:20:14:WU00:FS00:Starting
00:20:14:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:20:14:WU00:FS00:Started FahCore on PID 5148
00:20:14:WU00:FS00:Core PID:7016
00:20:14:WU00:FS00:FahCore 0x17 started
00:20:15:WU00:FS00:0x17:*********************** Log Started 2014-03-13T00:20:14Z ***********************
00:20:15:WU00:FS00:0x17:Project: 8900 (Run 861, Clone 8, Gen 25)
00:20:15:WU00:FS00:0x17:Unit: 0x00000030028c126651a6e657e0fa077a
00:20:15:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:20:15:WU00:FS00:0x17:Machine: 0
00:20:15:WU00:FS00:0x17:Reading tar file state.xml
00:20:15:WU00:FS00:0x17:Reading tar file system.xml
00:20:16:WU00:FS00:0x17:Reading tar file integrator.xml
00:20:16:WU00:FS00:0x17:Reading tar file core.xml
00:20:16:WU00:FS00:0x17:Digital signatures verified
00:20:16:WU00:FS00:0x17:Folding@home GPU core17
00:20:16:WU00:FS00:0x17:Version 0.0.52
00:23:44:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:23:44:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:43:21:WU00:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
00:43:21:WU00:FS00:0x17:Saving result file logfile_01.txt
00:43:21:WU00:FS00:0x17:Saving result file log.txt
00:43:21:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:43:21:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:43:21:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:43:21:WU00:FS00:Uploading 2.45KiB to 171.64.65.69
00:43:21:WU00:FS00:Connecting to 171.64.65.69:8080
00:43:21:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
00:43:22:WU00:FS00:Upload complete
00:43:22:WU00:FS00:Server responded WORK_ACK (400)
00:43:22:WU00:FS00:Cleaning up
00:43:22:WU02:FS00:News: Welcome to Folding@Home
00:43:22:WU02:FS00:Assigned to work server 171.64.65.69
00:43:22:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:43:22:WU02:FS00:Connecting to 171.64.65.69:8080
00:43:23:WU02:FS00:Downloading 4.18MiB
00:43:25:WU02:FS00:Download complete
00:43:26:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:Starting
00:43:26:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:43:26:WU02:FS00:Started FahCore on PID 3876
00:43:26:WU02:FS00:Core PID:1108
00:43:26:WU02:FS00:FahCore 0x17 started
00:43:26:WU02:FS00:0x17:*********************** Log Started 2014-03-13T00:43:26Z ***********************
00:43:26:WU02:FS00:0x17:Project: 8900 (Run 302, Clone 7, Gen 38)
00:43:26:WU02:FS00:0x17:Unit: 0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:43:26:WU02:FS00:0x17:Machine: 0
00:43:26:WU02:FS00:0x17:Reading tar file state.xml
00:43:27:WU02:FS00:0x17:Reading tar file system.xml
00:43:28:WU02:FS00:0x17:Reading tar file integrator.xml
00:43:28:WU02:FS00:0x17:Reading tar file core.xml
00:43:28:WU02:FS00:0x17:Digital signatures verified
00:43:28:WU02:FS00:0x17:Folding@home GPU core17
00:43:28:WU02:FS00:0x17:Version 0.0.52
00:46:55:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:46:55:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:02:26:WU02:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
01:02:26:WU02:FS00:0x17:Saving result file logfile_01.txt
01:02:26:WU02:FS00:0x17:Saving result file log.txt
01:02:26:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:02:26:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:02:26:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
01:02:26:WU02:FS00:Uploading 2.45KiB to 171.64.65.69
01:02:26:WU02:FS00:Connecting to 171.64.65.69:8080
01:02:27:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
01:02:27:WU02:FS00:Upload complete
01:02:27:WU02:FS00:Server responded WORK_ACK (400)
01:02:27:WU02:FS00:Cleaning up
01:02:27:WU00:FS00:News: Welcome to Folding@Home
01:02:27:WU00:FS00:Assigned to work server 171.64.65.69
01:02:27:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
01:02:27:WU00:FS00:Connecting to 171.64.65.69:8080
01:02:28:WU00:FS00:Downloading 4.18MiB
01:02:30:WU00:FS00:Download complete
01:02:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:Starting
01:02:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
01:02:31:WU00:FS00:Started FahCore on PID 4068
01:02:31:WU00:FS00:Core PID:6876
01:02:31:WU00:FS00:FahCore 0x17 started
01:02:31:WU00:FS00:0x17:*********************** Log Started 2014-03-13T01:02:31Z ***********************
01:02:31:WU00:FS00:0x17:Project: 8900 (Run 220, Clone 7, Gen 24)
01:02:31:WU00:FS00:0x17:Unit: 0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
01:02:31:WU00:FS00:0x17:Machine: 0
01:02:31:WU00:FS00:0x17:Reading tar file state.xml
01:02:32:WU00:FS00:0x17:Reading tar file system.xml
01:02:33:WU00:FS00:0x17:Reading tar file integrator.xml
01:02:33:WU00:FS00:0x17:Reading tar file core.xml
01:02:33:WU00:FS00:0x17:Digital signatures verified
01:02:33:WU00:FS00:0x17:Folding@home GPU core17
01:02:33:WU00:FS00:0x17:Version 0.0.52
01:06:01:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
01:06:01:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:26:40:WU00:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
01:29:00:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
01:29:00:WU00:FS00:0x17:Saving result file logfile_01.txt
01:29:01:WU00:FS00:0x17:Saving result file log.txt
01:29:01:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:29:01:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:29:01:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:29:01:WU00:FS00:Uploading 2.48KiB to 171.64.65.69
01:29:01:WU00:FS00:Connecting to 171.64.65.69:8080
01:29:01:WU00:FS00:Upload complete
01:29:01:WU00:FS00:Server responded WORK_ACK (400)
01:29:01:WU00:FS00:Cleaning up
03:16:31:FS00:Finishing
03:16:41:FS00:Paused
03:16:45:FS00:Unpaused
03:16:45:FS00:Finishing
Mod edit: Added code tags to log file

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Thu Mar 13, 2014 5:13 am
by P5-133XL
PantherX wrote: Can you please provide us with a fresh log which includes:
1) The initial section which contains the system configuration and F@H settings
2) The errors that is generated by the FahCore

Also, please tell us the driver being used and if the GPU Model is factory overclocked or not?
If necessary, click the refresh button before copy/Paste.

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Thu Mar 13, 2014 11:14 pm
by Turbo_T
I am using the recommended drivers 327.23. The latest log is below. I have disabled the secondary GPU and been able to fold all day on the CPU and Primary GPU it appears.

Code: Select all

*********************** Log Started 2014-03-12T23:29:27Z ***********************
23:29:27:************************* Folding@home Client *************************
23:29:27:      Website: http://folding.stanford.edu/
23:29:27:    Copyright: (c) 2009-2013 Stanford University
23:29:27:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:29:27:         Args: --open-web-control
23:29:27:       Config: E:/Stanford FAH/config.xml
23:29:27:******************************** Build ********************************
23:29:27:      Version: 7.3.6
23:29:27:         Date: Feb 18 2013
23:29:27:         Time: 15:25:17
23:29:27:      SVN Rev: 3923
23:29:27:       Branch: fah/trunk/client
23:29:27:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
23:29:27:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
23:29:27:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
23:29:27:     Platform: win32 XP
23:29:27:         Bits: 32
23:29:27:         Mode: Release
23:29:27:******************************* System ********************************
23:29:27:          CPU: Intel(R) Core(TM) i7 CPU X 980 @ 3.33GHz
23:29:27:       CPU ID: GenuineIntel Family 6 Model 44 Stepping 2
23:29:27:         CPUs: 12
23:29:27:       Memory: 11.99GiB
23:29:27:  Free Memory: 9.81GiB
23:29:27:      Threads: WINDOWS_THREADS
23:29:27:  Has Battery: false
23:29:27:   On Battery: false
23:29:27:   UTC offset: -4
23:29:27:          PID: 4444
23:29:27:          CWD: E:/Stanford FAH
23:29:27:           OS: Windows 7 Professional
23:29:27:      OS Arch: AMD64
23:29:27:         GPUs: 2
23:29:27:        GPU 0: NVIDIA:2 GF100 [GeForce GTX 480]
23:29:27:        GPU 1: NVIDIA:2 GF100 [GeForce GTX 480]
23:29:27:         CUDA: 2.0
23:29:27:  CUDA Driver: 5050
23:29:27:Win32 Service: false
23:29:27:***********************************************************************
23:29:27:<config>
23:29:27:  <service-description v='Folding@home Client'/>
23:29:27:  <service-restart v='true'/>
23:29:27:  <service-restart-delay v='5000'/>
23:29:27:
23:29:27:  <!-- Client Control -->
23:29:27:  <client-threads v='4'/>
23:29:27:  <cycle-rate v='4'/>
23:29:27:  <cycles v='-1'/>
23:29:27:  <data-directory v='.'/>
23:29:27:  <disable-sleep-when-active v='true'/>
23:29:27:  <exec-directory v='E:\Stanford FAH\FAHClient'/>
23:29:27:  <exit-when-done v='false'/>
23:29:27:  <fold-anon v='false'/>
23:29:27:  <open-web-control v='true'/>
23:29:27:
23:29:27:  <!-- Configuration -->
23:29:27:  <config-rotate v='true'/>
23:29:27:  <config-rotate-dir v='configs'/>
23:29:27:  <config-rotate-max v='16'/>
23:29:27:
23:29:27:  <!-- Debugging -->
23:29:27:  <assignment-servers>
23:29:27:    assign3.stanford.edu:8080 assign4.stanford.edu:80
23:29:27:  </assignment-servers>
23:29:27:  <capture-directory v='capture'/>
23:29:27:  <capture-on-error v='false'/>
23:29:27:  <capture-packets v='false'/>
23:29:27:  <capture-requests v='false'/>
23:29:27:  <capture-responses v='false'/>
23:29:27:  <capture-sockets v='false'/>
23:29:27:  <debug-sockets v='false'/>
23:29:27:  <exception-locations v='true'/>
23:29:27:  <gpu-assignment-servers>
23:29:27:    assign-GPU.stanford.edu:80 assign-GPU.stanford.edu:8080
23:29:27:  </gpu-assignment-servers>
23:29:27:  <stack-traces v='false'/>
23:29:27:
23:29:27:  <!-- Error Handling -->
23:29:27:  <max-slot-errors v='5'/>
23:29:27:  <max-unit-errors v='5'/>
23:29:27:
23:29:27:  <!-- Folding Core -->
23:29:27:  <checkpoint v='3'/>
23:29:27:  <core-dir v='cores'/>
23:29:27:  <core-priority v='idle'/>
23:29:27:  <cpu-affinity v='false'/>
23:29:27:  <cpu-usage v='100'/>
23:29:27:  <gpu-usage v='100'/>
23:29:27:  <no-assembly v='false'/>
23:29:27:
23:29:27:  <!-- Folding Slot Configuration -->
23:29:27:  <cause v='ANY'/>
23:29:27:  <client-subtype v='STDCLI'/>
23:29:27:  <client-type v='normal'/>
23:29:27:  <cpu-species v='X86_PENTIUM_II'/>
23:29:27:  <cpu-type v='AMD64'/>
23:29:27:  <cpus v='-1'/>
23:29:27:  <cuda-index v='0'/>
23:29:27:  <gpu v='true'/>
23:29:27:  <max-packet-size v='normal'/>
23:29:27:  <opencl-index v='0'/>
23:29:27:  <os-species v='UNKNOWN'/>
23:29:27:  <os-type v='WIN32'/>
23:29:27:  <power v='full'/>
23:29:27:  <project-key v='0'/>
23:29:27:  <smp v='true'/>
23:29:27:
23:29:27:  <!-- HTTP Server -->
23:29:27:  <allow v='127.0.0.1 192.168.1.100/25'/>
23:29:27:  <connection-timeout v='60'/>
23:29:27:  <deny v='0/0'/>
23:29:27:  <http-addresses v='0:7396'/>
23:29:27:  <https-addresses v=''/>
23:29:27:  <max-connect-time v='900'/>
23:29:27:  <max-connections v='800'/>
23:29:27:  <max-request-length v='52428800'/>
23:29:27:  <min-connect-time v='300'/>
23:29:27:  <threads v='12'/>
23:29:27:
23:29:27:  <!-- Logging -->
23:29:27:  <log v='log.txt'/>
23:29:27:  <log-color v='false'/>
23:29:27:  <log-crlf v='true'/>
23:29:27:  <log-date v='false'/>
23:29:27:  <log-date-periodically v='21600'/>
23:29:27:  <log-debug v='true'/>
23:29:27:  <log-domain v='false'/>
23:29:27:  <log-header v='true'/>
23:29:27:  <log-level v='true'/>
23:29:27:  <log-no-info-header v='true'/>
23:29:27:  <log-redirect v='false'/>
23:29:27:  <log-rotate v='true'/>
23:29:27:  <log-rotate-dir v='logs'/>
23:29:27:  <log-rotate-max v='16'/>
23:29:27:  <log-short-level v='false'/>
23:29:27:  <log-simple-domains v='true'/>
23:29:27:  <log-thread-id v='false'/>
23:29:27:  <log-thread-prefix v='true'/>
23:29:27:  <log-time v='true'/>
23:29:27:  <log-to-screen v='true'/>
23:29:27:  <log-truncate v='false'/>
23:29:27:  <verbosity v='4'/>
23:29:27:
23:29:27:  <!-- Network -->
23:29:27:  <proxy v=':8080'/>
23:29:27:  <proxy-enable v='false'/>
23:29:27:  <proxy-pass v=''/>
23:29:27:  <proxy-user v=''/>
23:29:27:
23:29:27:  <!-- Process Control -->
23:29:27:  <child v='false'/>
23:29:27:  <daemon v='false'/>
23:29:27:  <pid v='false'/>
23:29:27:  <pid-file v='Folding@home Client.pid'/>
23:29:27:  <respawn v='false'/>
23:29:27:  <service v='false'/>
23:29:27:
23:29:27:  <!-- Remote Command Server -->
23:29:27:  <command-address v='0.0.0.0'/>
23:29:27:  <command-allow-no-pass v='127.0.0.1 192.168.1.100/25'/>
23:29:27:  <command-deny-no-pass v='0/0'/>
23:29:27:  <command-port v='36330'/>
23:29:27:  <password v=''/>
23:29:27:
23:29:27:  <!-- Slot Control -->
23:29:27:  <idle v='false'/>
23:29:27:  <max-shutdown-wait v='60'/>
23:29:27:  <pause-on-battery v='false'/>
23:29:27:  <pause-on-start v='false'/>
23:29:27:
23:29:27:  <!-- User Information -->
23:29:27:  <machine-id v='0'/>
23:29:27:  <passkey v='********************************'/>
23:29:27:  <team v='111065'/>
23:29:27:  <user v='Turbo_T'/>
23:29:27:
23:29:27:  <!-- Web Server -->
23:29:27:  <session-timeout v='3600'/>
23:29:27:  <web-allow v='127.0.0.1'/>
23:29:27:  <web-deny v='0/0'/>
23:29:27:
23:29:27:  <!-- Work Unit Control -->
23:29:27:  <dump-after-deadline v='true'/>
23:29:27:  <max-queue v='16'/>
23:29:27:  <max-units v='0'/>
23:29:27:  <next-unit-percentage v='99'/>
23:29:27:
23:29:27:  <!-- Folding Slots -->
23:29:27:  <slot id='2' type='CPU'>
23:29:27:    <cpus v='10'/>
23:29:27:  </slot>
23:29:27:  <slot id='0' type='GPU'/>
23:29:27:</config>
23:29:27:Trying to access database...
23:29:27:Successfully acquired database lock
23:29:27:Enabled folding slot 02: READY cpu:10
23:29:27:Enabled folding slot 00: READY gpu:0:GF100 [GeForce GTX 480]
23:29:27:WU01:FS02:Starting
23:29:27:WU01:FS02:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe" -dir 01 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -np 10
23:29:27:WU01:FS02:Started FahCore on PID 7080
23:29:27:WU01:FS02:Core PID:2592
23:29:27:WU01:FS02:FahCore 0xa3 started
23:29:28:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
23:29:28:1:127.0.0.1 GET /ping?_=1394666968358&callback=jQuery19009469368797726929_1394666968357
23:29:28:WU01:FS02:0xa3:
23:29:28:WU01:FS02:0xa3:*------------------------------*
23:29:28:WU01:FS02:0xa3:Folding@Home Gromacs SMP Core
23:29:28:WU01:FS02:0xa3:Version 2.27 (Dec. 15, 2010)
23:29:28:WU01:FS02:0xa3:
23:29:28:WU01:FS02:0xa3:Preparing to commence simulation
23:29:28:WU01:FS02:0xa3:- Looking at optimizations...
23:29:28:WU01:FS02:0xa3:- Files status OK
23:29:28:WU00:FS00:News: Welcome to Folding@Home
23:29:28:WU00:FS00:Assigned to work server 171.64.65.69
23:29:28:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:29:28:WU00:FS00:Connecting to 171.64.65.69:8080
23:29:28:2:127.0.0.1 GET /?nocache=0.802401150809601
23:29:29:WU01:FS02:0xa3:- Expanded 3848665 -> 4392432 (decompressed 114.1 percent)
23:29:29:WU01:FS02:0xa3:Called DecompressByteArray: compressed_data_size=3848665 data_size=4392432, decompressed_data_size=4392432 diff=0
23:29:29:WU01:FS02:0xa3:- Digital signature verified
23:29:29:WU01:FS02:0xa3:
23:29:29:WU01:FS02:0xa3:Project: 8581 (Run 0, Clone 2, Gen 473)
23:29:29:WU01:FS02:0xa3:
23:29:29:WU01:FS02:0xa3:Assembly optimizations on if available.
23:29:29:WU01:FS02:0xa3:Entering M.D.
23:29:29:WU00:FS00:Downloading 4.17MiB
23:29:29:3:127.0.0.1 GET /js/main.js?nocache=0.11671217205002904
23:29:29:3:127.0.0.1:New Web connection
23:29:29:4:127.0.0.1 GET /css/style.css?nocache=0.6547354967333376
23:29:30:5:127.0.0.1 GET /api/updates/set?sid=0xc41c3813eea1ba24b5e64715a8a294ae&update_id=0&update_path=/api/basic&update_rate=1
23:29:30:6:127.0.0.1 GET /api/updates/set?sid=0xc41c3813eea1ba24b5e64715a8a294ae&update_id=1&update_path=/api/slots&update_rate=1
23:29:30:7:127.0.0.1 GET /api/configured?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:30:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:30:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:31:WU00:FS00:Download complete
23:29:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:29:31:WU00:FS00:Starting
23:29:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:29:31:WU00:FS00:Started FahCore on PID 4056
23:29:32:WU00:FS00:Core PID:5296
23:29:32:WU00:FS00:FahCore 0x17 started
23:29:32:WU00:FS00:0x17:*********************** Log Started 2014-03-12T23:29:32Z ***********************
23:29:32:WU00:FS00:0x17:Project: 8900 (Run 198, Clone 5, Gen 41)
23:29:32:WU00:FS00:0x17:Unit: 0x0000004b028c126651a652ad5cdceb60
23:29:32:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:29:32:WU00:FS00:0x17:Machine: 0
23:29:32:WU00:FS00:0x17:Reading tar file state.xml
23:29:33:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:33:WU00:FS00:0x17:Reading tar file system.xml
23:29:33:WU00:FS00:0x17:Reading tar file integrator.xml
23:29:33:WU00:FS00:0x17:Reading tar file core.xml
23:29:33:WU00:FS00:0x17:Digital signatures verified
23:29:33:WU00:FS00:0x17:Folding@home GPU core17
23:29:33:WU00:FS00:0x17:Version 0.0.52
23:29:34:WU01:FS02:0xa3:Using Gromacs checkpoints
23:29:35:WU01:FS02:0xa3:Mapping NT from 10 to 10 
23:29:35:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:37:WU01:FS02:0xa3:Resuming from checkpoint
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.log
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.trr
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.edr
23:29:38:WU01:FS02:0xa3:Completed 240595 out of 500000 steps  (48%)
23:29:40:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:44:WARNING:Exception: 8:127.0.0.1: Send error: 10053: An established connection was aborted by the software in your host machine.
23:33:00:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:33:00:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:37:27:WU01:FS02:0xa3:Completed 245000 out of 500000 steps  (49%)
23:46:13:WU01:FS02:0xa3:Completed 250000 out of 500000 steps  (50%)
23:53:40:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
23:53:40:WU00:FS00:0x17:Saving result file logfile_01.txt
23:53:40:WU00:FS00:0x17:Saving result file log.txt
23:53:40:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:53:40:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:53:41:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:53:41:WU00:FS00:Uploading 2.47KiB to 171.64.65.69
23:53:41:WU00:FS00:Connecting to 171.64.65.69:8080
23:53:41:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
23:53:41:WU00:FS00:Upload complete
23:53:41:WU00:FS00:Server responded WORK_ACK (400)
23:53:41:WU00:FS00:Cleaning up
23:53:42:WU02:FS00:News: Welcome to Folding@Home
23:53:42:WU02:FS00:Assigned to work server 171.64.65.69
23:53:42:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:53:42:WU02:FS00:Connecting to 171.64.65.69:8080
23:53:42:WU02:FS00:Downloading 4.17MiB
23:53:45:WU02:FS00:Download complete
23:53:45:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:Starting
23:53:45:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:53:45:WU02:FS00:Started FahCore on PID 4192
23:53:45:WU02:FS00:Core PID:6880
23:53:45:WU02:FS00:FahCore 0x17 started
23:53:45:WU02:FS00:0x17:*********************** Log Started 2014-03-12T23:53:45Z ***********************
23:53:45:WU02:FS00:0x17:Project: 8900 (Run 449, Clone 10, Gen 25)
23:53:45:WU02:FS00:0x17:Unit: 0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:53:45:WU02:FS00:0x17:Machine: 0
23:53:45:WU02:FS00:0x17:Reading tar file state.xml
23:53:46:WU02:FS00:0x17:Reading tar file system.xml
23:53:47:WU02:FS00:0x17:Reading tar file integrator.xml
23:53:47:WU02:FS00:0x17:Reading tar file core.xml
23:53:47:WU02:FS00:0x17:Digital signatures verified
23:53:47:WU02:FS00:0x17:Folding@home GPU core17
23:53:47:WU02:FS00:0x17:Version 0.0.52
23:55:02:WU01:FS02:0xa3:Completed 255000 out of 500000 steps  (51%)
23:57:16:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:57:16:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:03:50:WU01:FS02:0xa3:Completed 260000 out of 500000 steps  (52%)
00:12:36:WU01:FS02:0xa3:Completed 265000 out of 500000 steps  (53%)
00:17:59:WU02:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
00:20:10:WU02:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
00:20:10:WU02:FS00:0x17:Saving result file logfile_01.txt
00:20:10:WU02:FS00:0x17:Saving result file log.txt
00:20:10:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:20:10:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:20:10:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
00:20:10:WU02:FS00:Uploading 2.50KiB to 171.64.65.69
00:20:10:WU02:FS00:Connecting to 171.64.65.69:8080
00:20:10:WU02:FS00:Upload complete
00:20:10:WU02:FS00:Server responded WORK_ACK (400)
00:20:10:WU02:FS00:Cleaning up
00:20:10:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
00:20:11:WU00:FS00:News: Welcome to Folding@Home
00:20:11:WU00:FS00:Assigned to work server 171.64.65.69
00:20:11:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:20:11:WU00:FS00:Connecting to 171.64.65.69:8080
00:20:11:WU00:FS00:Downloading 4.17MiB
00:20:14:WU00:FS00:Download complete
00:20:14:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:20:14:WU00:FS00:Starting
00:20:14:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:20:14:WU00:FS00:Started FahCore on PID 5148
00:20:14:WU00:FS00:Core PID:7016
00:20:14:WU00:FS00:FahCore 0x17 started
00:20:15:WU00:FS00:0x17:*********************** Log Started 2014-03-13T00:20:14Z ***********************
00:20:15:WU00:FS00:0x17:Project: 8900 (Run 861, Clone 8, Gen 25)
00:20:15:WU00:FS00:0x17:Unit: 0x00000030028c126651a6e657e0fa077a
00:20:15:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:20:15:WU00:FS00:0x17:Machine: 0
00:20:15:WU00:FS00:0x17:Reading tar file state.xml
00:20:15:WU00:FS00:0x17:Reading tar file system.xml
00:20:16:WU00:FS00:0x17:Reading tar file integrator.xml
00:20:16:WU00:FS00:0x17:Reading tar file core.xml
00:20:16:WU00:FS00:0x17:Digital signatures verified
00:20:16:WU00:FS00:0x17:Folding@home GPU core17
00:20:16:WU00:FS00:0x17:Version 0.0.52
00:21:24:WU01:FS02:0xa3:Completed 270000 out of 500000 steps  (54%)
00:23:44:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:23:44:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:30:12:WU01:FS02:0xa3:Completed 275000 out of 500000 steps  (55%)
00:38:59:WU01:FS02:0xa3:Completed 280000 out of 500000 steps  (56%)
00:43:21:WU00:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
00:43:21:WU00:FS00:0x17:Saving result file logfile_01.txt
00:43:21:WU00:FS00:0x17:Saving result file log.txt
00:43:21:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:43:21:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:43:21:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:43:21:WU00:FS00:Uploading 2.45KiB to 171.64.65.69
00:43:21:WU00:FS00:Connecting to 171.64.65.69:8080
00:43:21:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
00:43:22:WU00:FS00:Upload complete
00:43:22:WU00:FS00:Server responded WORK_ACK (400)
00:43:22:WU00:FS00:Cleaning up
00:43:22:WU02:FS00:News: Welcome to Folding@Home
00:43:22:WU02:FS00:Assigned to work server 171.64.65.69
00:43:22:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:43:22:WU02:FS00:Connecting to 171.64.65.69:8080
00:43:23:WU02:FS00:Downloading 4.18MiB
00:43:25:WU02:FS00:Download complete
00:43:26:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:Starting
00:43:26:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:43:26:WU02:FS00:Started FahCore on PID 3876
00:43:26:WU02:FS00:Core PID:1108
00:43:26:WU02:FS00:FahCore 0x17 started
00:43:26:WU02:FS00:0x17:*********************** Log Started 2014-03-13T00:43:26Z ***********************
00:43:26:WU02:FS00:0x17:Project: 8900 (Run 302, Clone 7, Gen 38)
00:43:26:WU02:FS00:0x17:Unit: 0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:43:26:WU02:FS00:0x17:Machine: 0
00:43:26:WU02:FS00:0x17:Reading tar file state.xml
00:43:27:WU02:FS00:0x17:Reading tar file system.xml
00:43:28:WU02:FS00:0x17:Reading tar file integrator.xml
00:43:28:WU02:FS00:0x17:Reading tar file core.xml
00:43:28:WU02:FS00:0x17:Digital signatures verified
00:43:28:WU02:FS00:0x17:Folding@home GPU core17
00:43:28:WU02:FS00:0x17:Version 0.0.52
00:46:55:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:46:55:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:47:50:WU01:FS02:0xa3:Completed 285000 out of 500000 steps  (57%)
00:56:36:WU01:FS02:0xa3:Completed 290000 out of 500000 steps  (58%)
01:02:26:WU02:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
01:02:26:WU02:FS00:0x17:Saving result file logfile_01.txt
01:02:26:WU02:FS00:0x17:Saving result file log.txt
01:02:26:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:02:26:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:02:26:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
01:02:26:WU02:FS00:Uploading 2.45KiB to 171.64.65.69
01:02:26:WU02:FS00:Connecting to 171.64.65.69:8080
01:02:27:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
01:02:27:WU02:FS00:Upload complete
01:02:27:WU02:FS00:Server responded WORK_ACK (400)
01:02:27:WU02:FS00:Cleaning up
01:02:27:WU00:FS00:News: Welcome to Folding@Home
01:02:27:WU00:FS00:Assigned to work server 171.64.65.69
01:02:27:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
01:02:27:WU00:FS00:Connecting to 171.64.65.69:8080
01:02:28:WU00:FS00:Downloading 4.18MiB
01:02:30:WU00:FS00:Download complete
01:02:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:Starting
01:02:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
01:02:31:WU00:FS00:Started FahCore on PID 4068
01:02:31:WU00:FS00:Core PID:6876
01:02:31:WU00:FS00:FahCore 0x17 started
01:02:31:WU00:FS00:0x17:*********************** Log Started 2014-03-13T01:02:31Z ***********************
01:02:31:WU00:FS00:0x17:Project: 8900 (Run 220, Clone 7, Gen 24)
01:02:31:WU00:FS00:0x17:Unit: 0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
01:02:31:WU00:FS00:0x17:Machine: 0
01:02:31:WU00:FS00:0x17:Reading tar file state.xml
01:02:32:WU00:FS00:0x17:Reading tar file system.xml
01:02:33:WU00:FS00:0x17:Reading tar file integrator.xml
01:02:33:WU00:FS00:0x17:Reading tar file core.xml
01:02:33:WU00:FS00:0x17:Digital signatures verified
01:02:33:WU00:FS00:0x17:Folding@home GPU core17
01:02:33:WU00:FS00:0x17:Version 0.0.52
01:05:27:WU01:FS02:0xa3:Completed 295000 out of 500000 steps  (59%)
01:06:01:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
01:06:01:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:14:14:WU01:FS02:0xa3:Completed 300000 out of 500000 steps  (60%)
01:23:01:WU01:FS02:0xa3:Completed 305000 out of 500000 steps  (61%)
01:26:40:WU00:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
01:29:00:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
01:29:00:WU00:FS00:0x17:Saving result file logfile_01.txt
01:29:01:WU00:FS00:0x17:Saving result file log.txt
01:29:01:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:29:01:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:29:01:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:29:01:WU00:FS00:Uploading 2.48KiB to 171.64.65.69
01:29:01:WU00:FS00:Connecting to 171.64.65.69:8080
01:29:01:WU00:FS00:Upload complete
01:29:01:WU00:FS00:Server responded WORK_ACK (400)
01:29:01:WU00:FS00:Cleaning up
01:31:48:WU01:FS02:0xa3:Completed 310000 out of 500000 steps  (62%)
01:40:30:WU01:FS02:0xa3:Completed 315000 out of 500000 steps  (63%)
01:49:12:WU01:FS02:0xa3:Completed 320000 out of 500000 steps  (64%)
01:57:54:WU01:FS02:0xa3:Completed 325000 out of 500000 steps  (65%)
02:06:36:WU01:FS02:0xa3:Completed 330000 out of 500000 steps  (66%)
02:15:18:WU01:FS02:0xa3:Completed 335000 out of 500000 steps  (67%)
02:24:01:WU01:FS02:0xa3:Completed 340000 out of 500000 steps  (68%)
02:32:43:WU01:FS02:0xa3:Completed 345000 out of 500000 steps  (69%)
02:41:26:WU01:FS02:0xa3:Completed 350000 out of 500000 steps  (70%)
02:50:08:WU01:FS02:0xa3:Completed 355000 out of 500000 steps  (71%)
02:58:51:WU01:FS02:0xa3:Completed 360000 out of 500000 steps  (72%)
03:07:34:WU01:FS02:0xa3:Completed 365000 out of 500000 steps  (73%)
03:16:16:WU01:FS02:0xa3:Completed 370000 out of 500000 steps  (74%)
03:16:31:FS00:Finishing
03:16:41:FS00:Paused
03:16:45:FS00:Unpaused
03:16:45:FS00:Finishing
03:25:04:WU01:FS02:0xa3:Completed 375000 out of 500000 steps  (75%)
03:33:47:WU01:FS02:0xa3:Completed 380000 out of 500000 steps  (76%)
03:37:17:Removing old file 'configs/config-20140209-190711.xml'
03:37:17:Saving configuration to config.xml
03:37:17:<config>
03:37:17:  <!-- Folding Core -->
03:37:17:  <checkpoint v='3'/>
03:37:17:
03:37:17:  <!-- Folding Slot Configuration -->
03:37:17:  <power v='full'/>
03:37:17:
03:37:17:  <!-- HTTP Server -->
03:37:17:  <allow v='127.0.0.1 192.168.1.100/25'/>
03:37:17:
03:37:17:  <!-- Logging -->
03:37:17:  <verbosity v='4'/>
03:37:17:
03:37:17:  <!-- Network -->
03:37:17:  <proxy v=':8080'/>
03:37:17:
03:37:17:  <!-- Remote Command Server -->
03:37:17:  <command-allow-no-pass v='127.0.0.1 192.168.1.100/25'/>
03:37:17:  <password v=''/>
03:37:17:
03:37:17:  <!-- Slot Control -->
03:37:17:  <pause-on-battery v='false'/>
03:37:17:
03:37:17:  <!-- User Information -->
03:37:17:  <passkey v='********************************'/>
03:37:17:  <team v='111065'/>
03:37:17:  <user v='Turbo_T'/>
03:37:17:
03:37:17:  <!-- Folding Slots -->
03:37:17:  <slot id='2' type='CPU'>
03:37:17:    <cpus v='10'/>
03:37:17:  </slot>
03:37:17:</config>
03:40:38:Adding folding slot 00: READY gpu:0:GF100 [GeForce GTX 480]
03:40:38:Adding folding slot 01: READY gpu:1:GF100 [GeForce GTX 480]
03:40:38:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
03:40:38:Removing old file 'configs/config-20140212-113339.xml'
03:40:38:Saving configuration to config.xml
03:40:38:<config>
03:40:38:  <!-- Folding Core -->
03:40:38:  <checkpoint v='3'/>
03:40:38:
03:40:38:  <!-- Folding Slot Configuration -->
03:40:38:  <power v='full'/>
03:40:38:
03:40:38:  <!-- HTTP Server -->
03:40:38:  <allow v='127.0.0.1 192.168.1.100/25'/>
03:40:38:
03:40:38:  <!-- Logging -->
03:40:38:  <verbosity v='4'/>
03:40:38:
03:40:38:  <!-- Network -->
03:40:38:  <proxy v=':8080'/>
03:40:38:
03:40:38:  <!-- Remote Command Server -->
03:40:38:  <command-allow-no-pass v='127.0.0.1 192.168.1.100/25'/>
03:40:38:  <password v=''/>
03:40:38:
03:40:38:  <!-- Slot Control -->
03:40:38:  <pause-on-battery v='false'/>
03:40:38:
03:40:38:  <!-- User Information -->
03:40:38:  <passkey v='********************************'/>
03:40:38:  <team v='111065'/>
03:40:38:  <user v='Turbo_T'/>
03:40:38:
03:40:38:  <!-- Folding Slots -->
03:40:38:  <slot id='2' type='CPU'>
03:40:38:    <cpus v='10'/>
03:40:38:  </slot>
03:40:38:  <slot id='0' type='GPU'/>
03:40:38:  <slot id='1' type='GPU'/>
03:40:38:</config>
03:40:38:WU00:FS00:News: Welcome to Folding@Home
03:40:38:WU00:FS00:Assigned to work server 171.64.65.69
03:40:38:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
03:40:38:WU00:FS00:Connecting to 171.64.65.69:8080
03:40:38:WU02:FS01:Connecting to assign-GPU.stanford.edu:80
03:40:39:WU02:FS01:News: Welcome to Folding@Home
03:40:39:WU02:FS01:Assigned to work server 171.64.65.69
03:40:39:WU02:FS01:Requesting new work unit for slot 01: READY gpu:1:GF100 [GeForce GTX 480] from 171.64.65.69
03:40:39:WU02:FS01:Connecting to 171.64.65.69:8080
03:40:39:WU00:FS00:Downloading 4.17MiB
03:40:39:WU02:FS01:Downloading 4.18MiB
03:40:42:WU00:FS00:Download complete
03:40:42:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:613 clone:7 gen:23 core:0x17 unit:0x0000002c028c126651a6af20345d4c45
03:40:42:WU00:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah
03:40:42:WU00:FS00:Connecting to http://www.stanford.edu:80
03:40:43:WU00:FS00:FahCore 17: Downloading 2.55MiB
03:40:43:WU02:FS01:Download complete
03:40:43:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:623 clone:6 gen:23 core:0x17 unit:0x00000027028c126651a6b1514484e678
03:40:49:WU00:FS00:FahCore 17: 75.97%
03:40:50:WU00:FS00:FahCore 17: Download complete
03:40:50:WU00:FS00:Valid core signature
03:40:50:WU00:FS00:Unpacked 8.60MiB to cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe
03:40:51:WU00:FS00:Starting
03:40:51:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
03:40:51:WU00:FS00:Started FahCore on PID 5180
03:40:51:WU00:FS00:Core PID:4716
03:40:51:WU00:FS00:FahCore 0x17 started
03:40:51:WU02:FS01:Starting
03:40:51:WU02:FS01:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 1 -gpu-vendor nvidia
03:40:51:WU02:FS01:Started FahCore on PID 2228
03:40:51:WU02:FS01:Core PID:5360
03:40:51:WU02:FS01:FahCore 0x17 started
03:40:52:WU02:FS01:0x17:*********************** Log Started 2014-03-13T03:40:51Z ***********************
03:40:52:WU02:FS01:0x17:Project: 8900 (Run 623, Clone 6, Gen 23)
03:40:52:WU02:FS01:0x17:Unit: 0x00000027028c126651a6b1514484e678
03:40:52:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
03:40:52:WU02:FS01:0x17:Machine: 1
03:40:52:WU02:FS01:0x17:Reading tar file state.xml
03:40:52:WU00:FS00:0x17:*********************** Log Started 2014-03-13T03:40:51Z ***********************
03:40:52:WU00:FS00:0x17:Project: 8900 (Run 613, Clone 7, Gen 23)
03:40:52:WU00:FS00:0x17:Unit: 0x0000002c028c126651a6af20345d4c45
03:40:52:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
03:40:52:WU00:FS00:0x17:Machine: 0
03:40:52:WU00:FS00:0x17:Reading tar file state.xml
03:40:52:WU00:FS00:0x17:Reading tar file system.xml
03:40:53:WU02:FS01:0x17:Reading tar file system.xml
03:40:53:WU02:FS01:0x17:Reading tar file integrator.xml
03:40:53:WU02:FS01:0x17:Reading tar file core.xml
03:40:53:WU02:FS01:0x17:Digital signatures verified
03:40:53:WU02:FS01:0x17:Folding@home GPU core17
03:40:53:WU02:FS01:0x17:Version 0.0.52
03:40:53:WU00:FS00:0x17:Reading tar file integrator.xml
03:40:53:WU00:FS00:0x17:Reading tar file core.xml
03:40:53:WU00:FS00:0x17:Digital signatures verified
03:40:53:WU00:FS00:0x17:Folding@home GPU core17
03:40:53:WU00:FS00:0x17:Version 0.0.52
03:42:55:WU01:FS02:0xa3:Completed 385000 out of 500000 steps  (77%)
03:44:31:WU02:FS01:0x17:Completed 0 out of 2500000 steps (0%)
03:44:31:WU02:FS01:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
03:44:33:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
03:44:33:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
03:52:04:WU01:FS02:0xa3:Completed 390000 out of 500000 steps  (78%)
03:53:25:WU02:FS01:0x17:Completed 25000 out of 2500000 steps (1%)
04:01:11:WU01:FS02:0xa3:Completed 395000 out of 500000 steps  (79%)
04:02:01:WU02:FS01:0x17:Completed 50000 out of 2500000 steps (2%)
*********************** Log Started 2014-03-12T23:29:27Z ***********************
23:29:27:************************* Folding@home Client *************************
23:29:27:      Website: http://folding.stanford.edu/
23:29:27:    Copyright: (c) 2009-2013 Stanford University
23:29:27:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:29:27:         Args: --open-web-control
23:29:27:       Config: E:/Stanford FAH/config.xml
23:29:27:******************************** Build ********************************
23:29:27:      Version: 7.3.6
23:29:27:         Date: Feb 18 2013
23:29:27:         Time: 15:25:17
23:29:27:      SVN Rev: 3923
23:29:27:       Branch: fah/trunk/client
23:29:27:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
23:29:27:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
23:29:27:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
23:29:27:     Platform: win32 XP
23:29:27:         Bits: 32
23:29:27:         Mode: Release
23:29:27:******************************* System ********************************
23:29:27:          CPU: Intel(R) Core(TM) i7 CPU X 980 @ 3.33GHz
23:29:27:       CPU ID: GenuineIntel Family 6 Model 44 Stepping 2
23:29:27:         CPUs: 12
23:29:27:       Memory: 11.99GiB
23:29:27:  Free Memory: 9.81GiB
23:29:27:      Threads: WINDOWS_THREADS
23:29:27:  Has Battery: false
23:29:27:   On Battery: false
23:29:27:   UTC offset: -4
23:29:27:          PID: 4444
23:29:27:          CWD: E:/Stanford FAH
23:29:27:           OS: Windows 7 Professional
23:29:27:      OS Arch: AMD64
23:29:27:         GPUs: 2
23:29:27:        GPU 0: NVIDIA:2 GF100 [GeForce GTX 480]
23:29:27:        GPU 1: NVIDIA:2 GF100 [GeForce GTX 480]
23:29:27:         CUDA: 2.0
23:29:27:  CUDA Driver: 5050
23:29:27:Win32 Service: false
23:29:27:***********************************************************************
23:29:27:<config>
23:29:27:  <service-description v='Folding@home Client'/>
23:29:27:  <service-restart v='true'/>
23:29:27:  <service-restart-delay v='5000'/>
23:29:27:
23:29:27:  <!-- Client Control -->
23:29:27:  <client-threads v='4'/>
23:29:27:  <cycle-rate v='4'/>
23:29:27:  <cycles v='-1'/>
23:29:27:  <data-directory v='.'/>
23:29:27:  <disable-sleep-when-active v='true'/>
23:29:27:  <exec-directory v='E:\Stanford FAH\FAHClient'/>
23:29:27:  <exit-when-done v='false'/>
23:29:27:  <fold-anon v='false'/>
23:29:27:  <open-web-control v='true'/>
23:29:27:
23:29:27:  <!-- Configuration -->
23:29:27:  <config-rotate v='true'/>
23:29:27:  <config-rotate-dir v='configs'/>
23:29:27:  <config-rotate-max v='16'/>
23:29:27:
23:29:27:  <!-- Debugging -->
23:29:27:  <assignment-servers>
23:29:27:    assign3.stanford.edu:8080 assign4.stanford.edu:80
23:29:27:  </assignment-servers>
23:29:27:  <capture-directory v='capture'/>
23:29:27:  <capture-on-error v='false'/>
23:29:27:  <capture-packets v='false'/>
23:29:27:  <capture-requests v='false'/>
23:29:27:  <capture-responses v='false'/>
23:29:27:  <capture-sockets v='false'/>
23:29:27:  <debug-sockets v='false'/>
23:29:27:  <exception-locations v='true'/>
23:29:27:  <gpu-assignment-servers>
23:29:27:    assign-GPU.stanford.edu:80 assign-GPU.stanford.edu:8080
23:29:27:  </gpu-assignment-servers>
23:29:27:  <stack-traces v='false'/>
23:29:27:
23:29:27:  <!-- Error Handling -->
23:29:27:  <max-slot-errors v='5'/>
23:29:27:  <max-unit-errors v='5'/>
23:29:27:
23:29:27:  <!-- Folding Core -->
23:29:27:  <checkpoint v='3'/>
23:29:27:  <core-dir v='cores'/>
23:29:27:  <core-priority v='idle'/>
23:29:27:  <cpu-affinity v='false'/>
23:29:27:  <cpu-usage v='100'/>
23:29:27:  <gpu-usage v='100'/>
23:29:27:  <no-assembly v='false'/>
23:29:27:
23:29:27:  <!-- Folding Slot Configuration -->
23:29:27:  <cause v='ANY'/>
23:29:27:  <client-subtype v='STDCLI'/>
23:29:27:  <client-type v='normal'/>
23:29:27:  <cpu-species v='X86_PENTIUM_II'/>
23:29:27:  <cpu-type v='AMD64'/>
23:29:27:  <cpus v='-1'/>
23:29:27:  <cuda-index v='0'/>
23:29:27:  <gpu v='true'/>
23:29:27:  <max-packet-size v='normal'/>
23:29:27:  <opencl-index v='0'/>
23:29:27:  <os-species v='UNKNOWN'/>
23:29:27:  <os-type v='WIN32'/>
23:29:27:  <power v='full'/>
23:29:27:  <project-key v='0'/>
23:29:27:  <smp v='true'/>
23:29:27:
23:29:27:  <!-- HTTP Server -->
23:29:27:  <allow v='127.0.0.1 192.168.1.100/25'/>
23:29:27:  <connection-timeout v='60'/>
23:29:27:  <deny v='0/0'/>
23:29:27:  <http-addresses v='0:7396'/>
23:29:27:  <https-addresses v=''/>
23:29:27:  <max-connect-time v='900'/>
23:29:27:  <max-connections v='800'/>
23:29:27:  <max-request-length v='52428800'/>
23:29:27:  <min-connect-time v='300'/>
23:29:27:  <threads v='12'/>
23:29:27:
23:29:27:  <!-- Logging -->
23:29:27:  <log v='log.txt'/>
23:29:27:  <log-color v='false'/>
23:29:27:  <log-crlf v='true'/>
23:29:27:  <log-date v='false'/>
23:29:27:  <log-date-periodically v='21600'/>
23:29:27:  <log-debug v='true'/>
23:29:27:  <log-domain v='false'/>
23:29:27:  <log-header v='true'/>
23:29:27:  <log-level v='true'/>
23:29:27:  <log-no-info-header v='true'/>
23:29:27:  <log-redirect v='false'/>
23:29:27:  <log-rotate v='true'/>
23:29:27:  <log-rotate-dir v='logs'/>
23:29:27:  <log-rotate-max v='16'/>
23:29:27:  <log-short-level v='false'/>
23:29:27:  <log-simple-domains v='true'/>
23:29:27:  <log-thread-id v='false'/>
23:29:27:  <log-thread-prefix v='true'/>
23:29:27:  <log-time v='true'/>
23:29:27:  <log-to-screen v='true'/>
23:29:27:  <log-truncate v='false'/>
23:29:27:  <verbosity v='4'/>
23:29:27:
23:29:27:  <!-- Network -->
23:29:27:  <proxy v=':8080'/>
23:29:27:  <proxy-enable v='false'/>
23:29:27:  <proxy-pass v=''/>
23:29:27:  <proxy-user v=''/>
23:29:27:
23:29:27:  <!-- Process Control -->
23:29:27:  <child v='false'/>
23:29:27:  <daemon v='false'/>
23:29:27:  <pid v='false'/>
23:29:27:  <pid-file v='Folding@home Client.pid'/>
23:29:27:  <respawn v='false'/>
23:29:27:  <service v='false'/>
23:29:27:
23:29:27:  <!-- Remote Command Server -->
23:29:27:  <command-address v='0.0.0.0'/>
23:29:27:  <command-allow-no-pass v='127.0.0.1 192.168.1.100/25'/>
23:29:27:  <command-deny-no-pass v='0/0'/>
23:29:27:  <command-port v='36330'/>
23:29:27:  <password v=''/>
23:29:27:
23:29:27:  <!-- Slot Control -->
23:29:27:  <idle v='false'/>
23:29:27:  <max-shutdown-wait v='60'/>
23:29:27:  <pause-on-battery v='false'/>
23:29:27:  <pause-on-start v='false'/>
23:29:27:
23:29:27:  <!-- User Information -->
23:29:27:  <machine-id v='0'/>
23:29:27:  <passkey v='********************************'/>
23:29:27:  <team v='111065'/>
23:29:27:  <user v='Turbo_T'/>
23:29:27:
23:29:27:  <!-- Web Server -->
23:29:27:  <session-timeout v='3600'/>
23:29:27:  <web-allow v='127.0.0.1'/>
23:29:27:  <web-deny v='0/0'/>
23:29:27:
23:29:27:  <!-- Work Unit Control -->
23:29:27:  <dump-after-deadline v='true'/>
23:29:27:  <max-queue v='16'/>
23:29:27:  <max-units v='0'/>
23:29:27:  <next-unit-percentage v='99'/>
23:29:27:
23:29:27:  <!-- Folding Slots -->
23:29:27:  <slot id='2' type='CPU'>
23:29:27:    <cpus v='10'/>
23:29:27:  </slot>
23:29:27:  <slot id='0' type='GPU'/>
23:29:27:</config>
23:29:27:Trying to access database...
23:29:27:Successfully acquired database lock
23:29:27:Enabled folding slot 02: READY cpu:10
23:29:27:Enabled folding slot 00: READY gpu:0:GF100 [GeForce GTX 480]
23:29:27:WU01:FS02:Starting
23:29:27:WU01:FS02:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe" -dir 01 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -np 10
23:29:27:WU01:FS02:Started FahCore on PID 7080
23:29:27:WU01:FS02:Core PID:2592
23:29:27:WU01:FS02:FahCore 0xa3 started
23:29:28:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
23:29:28:1:127.0.0.1 GET /ping?_=1394666968358&callback=jQuery19009469368797726929_1394666968357
23:29:28:WU01:FS02:0xa3:
23:29:28:WU01:FS02:0xa3:*------------------------------*
23:29:28:WU01:FS02:0xa3:Folding@Home Gromacs SMP Core
23:29:28:WU01:FS02:0xa3:Version 2.27 (Dec. 15, 2010)
23:29:28:WU01:FS02:0xa3:
23:29:28:WU01:FS02:0xa3:Preparing to commence simulation
23:29:28:WU01:FS02:0xa3:- Looking at optimizations...
23:29:28:WU01:FS02:0xa3:- Files status OK
23:29:28:WU00:FS00:News: Welcome to Folding@Home
23:29:28:WU00:FS00:Assigned to work server 171.64.65.69
23:29:28:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:29:28:WU00:FS00:Connecting to 171.64.65.69:8080
23:29:28:2:127.0.0.1 GET /?nocache=0.802401150809601
23:29:29:WU01:FS02:0xa3:- Expanded 3848665 -> 4392432 (decompressed 114.1 percent)
23:29:29:WU01:FS02:0xa3:Called DecompressByteArray: compressed_data_size=3848665 data_size=4392432, decompressed_data_size=4392432 diff=0
23:29:29:WU01:FS02:0xa3:- Digital signature verified
23:29:29:WU01:FS02:0xa3:
23:29:29:WU01:FS02:0xa3:Project: 8581 (Run 0, Clone 2, Gen 473)
23:29:29:WU01:FS02:0xa3:
23:29:29:WU01:FS02:0xa3:Assembly optimizations on if available.
23:29:29:WU01:FS02:0xa3:Entering M.D.
23:29:29:WU00:FS00:Downloading 4.17MiB
23:29:29:3:127.0.0.1 GET /js/main.js?nocache=0.11671217205002904
23:29:29:3:127.0.0.1:New Web connection
23:29:29:4:127.0.0.1 GET /css/style.css?nocache=0.6547354967333376
23:29:30:5:127.0.0.1 GET /api/updates/set?sid=0xc41c3813eea1ba24b5e64715a8a294ae&update_id=0&update_path=/api/basic&update_rate=1
23:29:30:6:127.0.0.1 GET /api/updates/set?sid=0xc41c3813eea1ba24b5e64715a8a294ae&update_id=1&update_path=/api/slots&update_rate=1
23:29:30:7:127.0.0.1 GET /api/configured?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:30:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:30:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:31:WU00:FS00:Download complete
23:29:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:29:31:WU00:FS00:Starting
23:29:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:29:31:WU00:FS00:Started FahCore on PID 4056
23:29:32:WU00:FS00:Core PID:5296
23:29:32:WU00:FS00:FahCore 0x17 started
23:29:32:WU00:FS00:0x17:*********************** Log Started 2014-03-12T23:29:32Z ***********************
23:29:32:WU00:FS00:0x17:Project: 8900 (Run 198, Clone 5, Gen 41)
23:29:32:WU00:FS00:0x17:Unit: 0x0000004b028c126651a652ad5cdceb60
23:29:32:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:29:32:WU00:FS00:0x17:Machine: 0
23:29:32:WU00:FS00:0x17:Reading tar file state.xml
23:29:33:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:33:WU00:FS00:0x17:Reading tar file system.xml
23:29:33:WU00:FS00:0x17:Reading tar file integrator.xml
23:29:33:WU00:FS00:0x17:Reading tar file core.xml
23:29:33:WU00:FS00:0x17:Digital signatures verified
23:29:33:WU00:FS00:0x17:Folding@home GPU core17
23:29:33:WU00:FS00:0x17:Version 0.0.52
23:29:34:WU01:FS02:0xa3:Using Gromacs checkpoints
23:29:35:WU01:FS02:0xa3:Mapping NT from 10 to 10 
23:29:35:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:37:WU01:FS02:0xa3:Resuming from checkpoint
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.log
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.trr
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.edr
23:29:38:WU01:FS02:0xa3:Completed 240595 out of 500000 steps  (48%)
23:29:40:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:44:WARNING:Exception: 8:127.0.0.1: Send error: 10053: An established connection was aborted by the software in your host machine.
23:33:00:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:33:00:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:37:27:WU01:FS02:0xa3:Completed 245000 out of 500000 steps  (49%)
23:46:13:WU01:FS02:0xa3:Completed 250000 out of 500000 steps  (50%)
23:53:40:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
23:53:40:WU00:FS00:0x17:Saving result file logfile_01.txt
23:53:40:WU00:FS00:0x17:Saving result file log.txt
23:53:40:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:53:40:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:53:41:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:53:41:WU00:FS00:Uploading 2.47KiB to 171.64.65.69
23:53:41:WU00:FS00:Connecting to 171.64.65.69:8080
23:53:41:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
23:53:41:WU00:FS00:Upload complete
23:53:41:WU00:FS00:Server responded WORK_ACK (400)
23:53:41:WU00:FS00:Cleaning up
23:53:42:WU02:FS00:News: Welcome to Folding@Home
23:53:42:WU02:FS00:Assigned to work server 171.64.65.69
23:53:42:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:53:42:WU02:FS00:Connecting to 171.64.65.69:8080
23:53:42:WU02:FS00:Downloading 4.17MiB
23:53:45:WU02:FS00:Download complete
23:53:45:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:Starting
23:53:45:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:53:45:WU02:FS00:Started FahCore on PID 4192
23:53:45:WU02:FS00:Core PID:6880
23:53:45:WU02:FS00:FahCore 0x17 started
23:53:45:WU02:FS00:0x17:*********************** Log Started 2014-03-12T23:53:45Z ***********************
23:53:45:WU02:FS00:0x17:Project: 8900 (Run 449, Clone 10, Gen 25)
23:53:45:WU02:FS00:0x17:Unit: 0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:53:45:WU02:FS00:0x17:Machine: 0
23:53:45:WU02:FS00:0x17:Reading tar file state.xml
23:53:46:WU02:FS00:0x17:Reading tar file system.xml
23:53:47:WU02:FS00:0x17:Reading tar file integrator.xml
23:53:47:WU02:FS00:0x17:Reading tar file core.xml
23:53:47:WU02:FS00:0x17:Digital signatures verified
23:53:47:WU02:FS00:0x17:Folding@home GPU core17
23:53:47:WU02:FS00:0x17:Version 0.0.52
23:55:02:WU01:FS02:0xa3:Completed 255000 out of 500000 steps  (51%)
23:57:16:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:57:16:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:03:50:WU01:FS02:0xa3:Completed 260000 out of 500000 steps  (52%)
00:12:36:WU01:FS02:0xa3:Completed 265000 out of 500000 steps  (53%)
00:17:59:WU02:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
00:20:10:WU02:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
00:20:10:WU02:FS00:0x17:Saving result file logfile_01.txt
00:20:10:WU02:FS00:0x17:Saving result file log.txt
00:20:10:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:20:10:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:20:10:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
00:20:10:WU02:FS00:Uploading 2.50KiB to 171.64.65.69
00:20:10:WU02:FS00:Connecting to 171.64.65.69:8080
00:20:10:WU02:FS00:Upload complete
00:20:10:WU02:FS00:Server responded WORK_ACK (400)
00:20:10:WU02:FS00:Cleaning up
00:20:10:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
00:20:11:WU00:FS00:News: Welcome to Folding@Home
00:20:11:WU00:FS00:Assigned to work server 171.64.65.69
00:20:11:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:20:11:WU00:FS00:Connecting to 171.64.65.69:8080
00:20:11:WU00:FS00:Downloading 4.17MiB
00:20:14:WU00:FS00:Download complete
00:20:14:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:20:14:WU00:FS00:Starting
00:20:14:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:20:14:WU00:FS00:Started FahCore on PID 5148
00:20:14:WU00:FS00:Core PID:7016
00:20:14:WU00:FS00:FahCore 0x17 started
00:20:15:WU00:FS00:0x17:*********************** Log Started 2014-03-13T00:20:14Z ***********************
00:20:15:WU00:FS00:0x17:Project: 8900 (Run 861, Clone 8, Gen 25)
00:20:15:WU00:FS00:0x17:Unit: 0x00000030028c126651a6e657e0fa077a
00:20:15:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:20:15:WU00:FS00:0x17:Machine: 0
00:20:15:WU00:FS00:0x17:Reading tar file state.xml
00:20:15:WU00:FS00:0x17:Reading tar file system.xml
00:20:16:WU00:FS00:0x17:Reading tar file integrator.xml
00:20:16:WU00:FS00:0x17:Reading tar file core.xml
00:20:16:WU00:FS00:0x17:Digital signatures verified
00:20:16:WU00:FS00:0x17:Folding@home GPU core17
00:20:16:WU00:FS00:0x17:Version 0.0.52
00:21:24:WU01:FS02:0xa3:Completed 270000 out of 500000 steps  (54%)
00:23:44:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:23:44:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:30:12:WU01:FS02:0xa3:Completed 275000 out of 500000 steps  (55%)
00:38:59:WU01:FS02:0xa3:Completed 280000 out of 500000 steps  (56%)
00:43:21:WU00:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
00:43:21:WU00:FS00:0x17:Saving result file logfile_01.txt
00:43:21:WU00:FS00:0x17:Saving result file log.txt
00:43:21:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:43:21:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:43:21:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:43:21:WU00:FS00:Uploading 2.45KiB to 171.64.65.69
00:43:21:WU00:FS00:Connecting to 171.64.65.69:8080
00:43:21:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
00:43:22:WU00:FS00:Upload complete
00:43:22:WU00:FS00:Server responded WORK_ACK (400)
00:43:22:WU00:FS00:Cleaning up
00:43:22:WU02:FS00:News: Welcome to Folding@Home
00:43:22:WU02:FS00:Assigned to work server 171.64.65.69
00:43:22:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:43:22:WU02:FS00:Connecting to 171.64.65.69:8080
00:43:23:WU02:FS00:Downloading 4.18MiB
00:43:25:WU02:FS00:Download complete
00:43:26:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:Starting
00:43:26:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:43:26:WU02:FS00:Started FahCore on PID 3876
00:43:26:WU02:FS00:Core PID:1108
00:43:26:WU02:FS00:FahCore 0x17 started
00:43:26:WU02:FS00:0x17:*********************** Log Started 2014-03-13T00:43:26Z ***********************
00:43:26:WU02:FS00:0x17:Project: 8900 (Run 302, Clone 7, Gen 38)
00:43:26:WU02:FS00:0x17:Unit: 0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:43:26:WU02:FS00:0x17:Machine: 0
00:43:26:WU02:FS00:0x17:Reading tar file state.xml
00:43:27:WU02:FS00:0x17:Reading tar file system.xml
00:43:28:WU02:FS00:0x17:Reading tar file integrator.xml
00:43:28:WU02:FS00:0x17:Reading tar file core.xml
00:43:28:WU02:FS00:0x17:Digital signatures verified
00:43:28:WU02:FS00:0x17:Folding@home GPU core17
00:43:28:WU02:FS00:0x17:Version 0.0.52
00:46:55:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:46:55:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:47:50:WU01:FS02:0xa3:Completed 285000 out of 500000 steps  (57%)
00:56:36:WU01:FS02:0xa3:Completed 290000 out of 500000 steps  (58%)
01:02:26:WU02:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
01:02:26:WU02:FS00:0x17:Saving result file logfile_01.txt
01:02:26:WU02:FS00:0x17:Saving result file log.txt
01:02:26:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:02:26:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:02:26:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
01:02:26:WU02:FS00:Uploading 2.45KiB to 171.64.65.69
01:02:26:WU02:FS00:Connecting to 171.64.65.69:8080
01:02:27:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
01:02:27:WU02:FS00:Upload complete
01:02:27:WU02:FS00:Server responded WORK_ACK (400)
01:02:27:WU02:FS00:Cleaning up
01:02:27:WU00:FS00:News: Welcome to Folding@Home
01:02:27:WU00:FS00:Assigned to work server 171.64.65.69
01:02:27:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
01:02:27:WU00:FS00:Connecting to 171.64.65.69:8080
01:02:28:WU00:FS00:Downloading 4.18MiB
01:02:30:WU00:FS00:Download complete
01:02:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:Starting
01:02:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
01:02:31:WU00:FS00:Started FahCore on PID 4068
01:02:31:WU00:FS00:Core PID:6876
01:02:31:WU00:FS00:FahCore 0x17 started
01:02:31:WU00:FS00:0x17:*********************** Log Started 2014-03-13T01:02:31Z ***********************
01:02:31:WU00:FS00:0x17:Project: 8900 (Run 220, Clone 7, Gen 24)
01:02:31:WU00:FS00:0x17:Unit: 0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
01:02:31:WU00:FS00:0x17:Machine: 0
01:02:31:WU00:FS00:0x17:Reading tar file state.xml
01:02:32:WU00:FS00:0x17:Reading tar file system.xml
01:02:33:WU00:FS00:0x17:Reading tar file integrator.xml
01:02:33:WU00:FS00:0x17:Reading tar file core.xml
01:02:33:WU00:FS00:0x17:Digital signatures verified
01:02:33:WU00:FS00:0x17:Folding@home GPU core17
01:02:33:WU00:FS00:0x17:Version 0.0.52
01:05:27:WU01:FS02:0xa3:Completed 295000 out of 500000 steps  (59%)
01:06:01:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
01:06:01:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:14:14:WU01:FS02:0xa3:Completed 300000 out of 500000 steps  (60%)
01:23:01:WU01:FS02:0xa3:Completed 305000 out of 500000 steps  (61%)
01:26:40:WU00:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
01:29:00:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
01:29:00:WU00:FS00:0x17:Saving result file logfile_01.txt
01:29:01:WU00:FS00:0x17:Saving result file log.txt
01:29:01:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:29:01:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:29:01:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:29:01:WU00:FS00:Uploading 2.48KiB to 171.64.65.69
01:29:01:WU00:FS00:Connecting to 171.64.65.69:8080
01:29:01:WU00:FS00:Upload complete
01:29:01:WU00:FS00:Server responded WORK_ACK (400)
01:29:01:WU00:FS00:Cleaning up
Mod edit: Added Code tags to log, please follow directions on how to post a log - viewtopic.php?f=61&t=16206&p=225958#p225958

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Thu Mar 13, 2014 11:20 pm
by bruce
If you want further help, please remove the Verbosity 5 setting. The default of 3 is the best setting.
Turbo_T wrote:I am using the recommended drivers 327.23. The latest log is below. I have disabled the secondary GPU and been able to fold all day on the CPU and Primary GPU it appears.
Possibility 1: One GPU can tolerate your overclock settings and the other cannot.
Possibility 2: The total heat generated by 2 GPUs plus CPU exceeds the capacity of your system cooling subsystem.
Possibility 3: Your PS is having trouble supplying enough 12V current to run everything at once.

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Thu Mar 13, 2014 11:29 pm
by Turbo_T
as for the GPU it is an EVGA GTX 480 Hydro Copper FTW, liquid cooled unit with GPU at 752 Mhz and ram at 1900 Mhz from the factory. I have attempted using the EVGA precision X software to tune it down but it will only affect the GPU clock and only reduce it by 2Mhz .

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Thu Mar 13, 2014 11:31 pm
by bruce
To eliminate possibility 1, Finish the WU on one GPU and start the slot for the other GPU.

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Fri Mar 14, 2014 12:05 am
by Joe_H
Also, please return the logging level back to the default of verbosity=3. Higher levels rarely provide any useful information and do get in the way of analyzing the log for problems.

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Fri Mar 14, 2014 2:32 am
by P5-133XL
Off-hand, I do not see anything particularly wrong with the config except the verbosity level and that is more an annoyance than a problem. Your driver version is fine. Hopefully you got those drivers from Nvidia so as to include OpenCl.

After that we get into HW or OC'ing. Can you run just one GPU slot and identify one particular video card having a problem? What's you power supply like? Have you paid attention to the rail system so you know that you are not either overloading the entire power supply or any rail?

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Fri Mar 14, 2014 3:52 am
by Turbo_T
Verbosity corrected,

I have adequate cooling as demonstrated by the temps my systems shows with all three folding, I just break into the mid 60C range at the CPU and max temps on GPU's are mid 70's. All major components are liquid cooled and run through a 3X120 Swiftech double pass radiator. When I designed and built the system I over specified the power and cooling capacity in case I was able to get the SLI ready second GPU. I have a PC Power and cooling 1200 Turbo PSU rated for far more than I am drawing so far. It runs a single rail for the 12V so there are no balancing issues. The "new to me" and seemingly unstable GPU does run 5-7 degrees hotter than my original/primary GPU, but is tests fine in memory and processing benchmarks. When I enable SLI for gaming and benchmark the GPU's together there are no signs of any instability or failure. My original GPU folds fine, but the newer 480 does not tolerate folding as a single GPU at all. It doesn't matter if you run one or both simultaneously the newer card fails and the original one is fine, Very unfortunate for sure.

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Fri Mar 14, 2014 5:10 am
by Turbo_T
As a test case I have loaded the latest drivers, 335.23, and tested the benchmarks. my open CL marks went from :
327.23
Explicit-12.206 1ns/day
Implicit-48.0077 ns/day

to

335.23
Expicit-20.228 ns/day
Implicit-88.2339 ns/day

I am running both GPU's to see if they are any more stable as well.

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Fri Mar 14, 2014 6:30 pm
by bruce
@Turbo_T

At some point, this topic changed from "rampant failures" to "performance is too low" I can't figure out what changed. Did you stop talking about one driver version and permanently move to another or did you lower your overclock expectations (or was it something else)?

There are other reports that changing drivers now does improve the performance, but that doesn't answer which change got rid of the rampant failures.

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Fri Mar 14, 2014 8:14 pm
by Turbo_T
I am still having failure problems on the one GPU but I reported the attempt to correct the stability issue by loading the new drivers. I included a before and after benchmark to validate the driver impact on performance as a byproduct of the failure discussion. The same card continues to fail even now. I guess the GPU is just not going to be a folding asset.

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Fri Mar 14, 2014 8:20 pm
by bruce
The GPU might become a folding asset if you under-clock it enough.

Re: I am having rampant failures with the newest NVIDIA driv

Posted: Fri Mar 14, 2014 9:38 pm
by PantherX
Another possible explanation is that the GPU is failing. I have read about at least one donor who was having issues only while folding and it turns out that the GPU was damaged and after the GPU was replaced, everything was back o normal. Usually, games will not mind an incorrect colour of a pixel or one of those tiny glitches. However, for F@H, it does cause a serious issue.

If you really want to see if it is a hardware issue or not, remove your GPU1 and replace it with GPU2 (it is now in PCI-E Slot one and the second slot is empty). Now, see if it folds on GPU2 or not with stock settings. If it still fails, a hardware issue could be possible. If it fold, then place GPU1 in the second PCI-E Slot and see if it folds or not. If it doesn't fold, then you know that it is a PCI-E issue and not your GPUs.