F@H not running on GPUs

Striker 250 · Post by **Striker 250** » Sun Feb 10, 2013 9:08 pm

I've decided to try F@H after hearing about it from my roommate. Started it up and my GPU's never actually seemed to "do" anything. I couldn't find any errors for my secondary GPU (slot 2), but my main GPU (slot 1) kept showing "GPU_MEMTEST_ERROR (124 = 0x7c)" followed a little while later by "Too many errors, failing... Server did not like results, dumping" Eventually, the 560 Ti shows "Failed" for the status, but the 9800 keeps saying "Running". Also, not sure if this is related or not, but none of the "About Project"s are correct. They all show a bunch of HTML tags with a "500 internal server error" listed as well as a "Apached/2.0.52 (CentOS) Server at fah-web.stanford.edu Port 80".

I did notice this in the logs:

Code: Select all

19:08:11:WU01:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1

I've tried installing it with all the defaults other than the file location (changed from C:/ to D:/ due to limited disc space on my boot SSD) and I've reinstalled several times, both with and without clearing the data.

Computer Specs: i7-920 / EVGA X58 SLI FTW3 mobo / 18 GB RAM (3 x G.Skill PCE-12800 + 3 x G.Skill PC3-10700H) / boot ssd-64 GB Crucial m4, data/program hdd (D:/)-500 GB WD Caviar Black / main GPU (runs single primary monitor): EVGA nvidia 560 Ti FPB (Fermi) 1 GB GDDR5, secondary GPU (runs 2 "secondary" monitors): EVGA nvidia 9800 GTX+ 512 MB GDDR3
Network Connection: hosts are connected to an unmanaged switch over ethernet which is connected to a router that connects to a central fiber core router, basically fiber with a firewall on the router (although roommate connected to the same router has no problems)
Operating System: Windows 7 Professional 64-bit, running nVidia drivers 310.90
Overclocked?: CPU is oc'd from 2.66 to 3.36 GHz, GPU's are at stock speeds
Stable?: Tried both of the memtest programs linked on the folding.stanford.edu page using various numbers on both cards with no errors.
Software: Running F@H client 7.2.9. I'm not sure how to check what version of core(s) I'm running.
WU details: My smp (slot 2) is running fine and has completed a WU with no problem. Currently, my main GPU is running 7625 (540, 0, 25) and my secondary GPU is "running" WU 5769 (3, 37, 2204). Strangely (under the WU details) ETA, Estimated PPD, and Estimated TPF are unknown for both my main and secondary GPUs, but additionally my secondary GPU also lists Base Credit, Estimated Credit, and Timeout as Unknown.

Due to character limits, I'm posting the full log on pastebin: http://pastebin.com/hgSNC0N3

Code: Select all

*********************** Log Started 2013-02-10T19:08:02Z ***********************
19:08:02:************************* Folding@home Client *************************
19:08:02:      Website: http://folding.stanford.edu/
19:08:02:    Copyright: (c) 2009-2012 Stanford University
19:08:02:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:08:02:         Args: --lifeline 11148 --command-port=36330
19:08:02:       Config: d:/Users/<my name>/AppData/Roaming/FAHClient/config.xml
19:08:02:******************************** Build ********************************
19:08:02:      Version: 7.2.9
19:08:02:         Date: Oct 3 2012
19:08:02:         Time: 18:05:48
19:08:02:      SVN Rev: 3578
19:08:02:       Branch: fah/trunk/client
19:08:02:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
19:08:02:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
19:08:02:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
19:08:02:     Platform: win32 XP
19:08:02:         Bits: 32
19:08:02:         Mode: Release
19:08:02:******************************* System ********************************
19:08:02:          CPU: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz
19:08:02:       CPU ID: GenuineIntel Family 6 Model 26 Stepping 4
19:08:02:         CPUs: 8
19:08:02:       Memory: 17.99GiB
19:08:02:  Free Memory: 11.52GiB
19:08:02:      Threads: WINDOWS_THREADS
19:08:02:   On Battery: false
19:08:02:   UTC offset: -5
19:08:02:          PID: 14548
19:08:02:          CWD: d:/Users/<my name>/AppData/Roaming/FAHClient
19:08:02:           OS: Windows 7 Professional
19:08:02:      OS Arch: AMD64
19:08:02:         GPUs: 2
19:08:02:        GPU 0: NVIDIA:1 G92 [GeForce 9800 GTX+]
19:08:02:        GPU 1: NVIDIA:2 GF114 [GeForce GTX 560 Ti]
19:08:02:         CUDA: 2.1
19:08:02:  CUDA Driver: 5000
19:08:02:Win32 Service: false
19:08:02:***********************************************************************
19:08:02:<config>
19:08:02:  <!-- Folding Slot Configuration -->
19:08:02:  <gpu v='true'/>
19:08:02:
19:08:02:  <!-- User Information -->
19:08:02:  <team v='157058'/>
19:08:02:  <user v='Striker_250'/>
19:08:02:
19:08:02:  <!-- Folding Slots -->
19:08:02:</config>
19:08:02:Connecting to assign-GPU.stanford.edu:80
19:08:02:Connecting to assign-GPU.stanford.edu:8080
19:08:02:Read GPUs.txt
19:08:02:Trying to access database...
19:08:03:Successfully acquired database lock
19:08:03:Enabled folding slot 00: READY gpu:0:"G92 [GeForce 9800 GTX+]"
19:08:03:Enabled folding slot 01: READY gpu:1:"GF114 [GeForce GTX 560 Ti]"
19:08:03:Enabled folding slot 02: READY smp:8
19:08:03:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
19:08:03:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
19:08:03:WU02:FS02:Connecting to assign-GPU.stanford.edu:80
19:08:03:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
19:08:03:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
19:08:03:WU02:FS02:Connecting to assign3.stanford.edu:8080
19:08:03:WU00:FS00:News: Welcome to Folding@Home
19:08:03:WU00:FS00:Assigned to work server 171.67.108.11
19:08:03:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:"G92 [GeForce 9800 GTX+]" from 171.67.108.11
19:08:03:WU00:FS00:Connecting to 171.67.108.11:8080
19:08:03:WU01:FS01:News: Welcome to Folding@Home
19:08:03:WU01:FS01:Assigned to work server 171.64.65.105
19:08:03:WU01:FS01:Requesting new work unit for slot 01: READY gpu:1:"GF114 [GeForce GTX 560 Ti]" from 171.64.65.105
19:08:03:WU01:FS01:Connecting to 171.64.65.105:8080
19:08:04:WU02:FS02:News: Welcome to Folding@Home
19:08:04:WU02:FS02:Assigned to work server 171.64.65.75
19:08:04:WU02:FS02:Requesting new work unit for slot 02: READY smp:8 from 171.64.65.75
19:08:04:WU02:FS02:Connecting to 171.64.65.75:8080
19:08:04:WU00:FS00:Downloading 44.81KiB
19:08:04:WU01:FS01:Downloading 122.07KiB
19:08:04:WU00:FS00:Download complete
19:08:04:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:5769 run:3 clone:37 gen:2204 core:0x11 unit:0x3d48de145117f013089c002500031689
19:08:04:WU01:FS01:Download complete
19:08:04:WU00:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/NVIDIA/G80/Core_11.fah
19:08:04:WU00:FS00:Connecting to www.stanford.edu:80
19:08:04:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:7625 run:86 clone:1 gen:33 core:0x15 unit:0x0000002b664f2dd14fe615a062834c3a
19:08:05:WU01:FS01:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah
19:08:05:WU01:FS01:Connecting to www.stanford.edu:80
19:08:05:WU00:FS00:FahCore 11: Downloading 648.82KiB
19:08:05:WU02:FS02:Downloading 1.94MiB
19:08:05:WU01:FS01:FahCore 15: Downloading 1.88MiB
19:08:05:Server connection id=1 on 0.0.0.0:36330 from 127.0.0.1
19:08:06:WU02:FS02:Download complete
19:08:06:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:10127 run:90 clone:1 gen:84 core:0xa3 unit:0x000000d40a3b1e6f4e6900525020ce51
19:08:06:WU00:FS00:FahCore 11: Download complete
19:08:06:WU02:FS02:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah
19:08:06:WU02:FS02:Connecting to www.stanford.edu:80
19:08:06:WU00:FS00:Valid core signature
19:08:06:WU00:FS00:Unpacked 1.82MiB to cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/G80/Core_11.fah/FahCore_11.exe
19:08:07:WU00:FS00:Starting
19:08:07:WU00:FS00:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/G80/Core_11.fah/FahCore_11.exe -dir 00 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 0
19:08:07:WU00:FS00:Started FahCore on PID 21296
19:08:07:WU00:FS00:Core PID:14580
19:08:07:WU00:FS00:FahCore 0x11 started
19:08:07:WU00:FS00:Downloading project 5769 description
19:08:07:WU00:FS00:Connecting to fah-web.stanford.edu:80
19:08:07:WU02:FS02:FahCore a3: Downloading 2.89MiB
19:08:07:WU00:FS00:0x11:
19:08:07:WU00:FS00:0x11:*------------------------------*
19:08:07:WU00:FS00:0x11:Folding@Home GPU Core
19:08:07:WU00:FS00:0x11:Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
19:08:07:WU00:FS00:0x11:
19:08:07:WU00:FS00:0x11:Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86 
19:08:07:WU00:FS00:0x11:Build host: amoeba
19:08:07:WU00:FS00:0x11:Board Type: Nvidia
19:08:07:WU00:FS00:0x11:Core      : 
19:08:07:WU00:FS00:0x11:Preparing to commence simulation
19:08:07:WU00:FS00:0x11:- Looking at optimizations...
19:08:07:WU00:FS00:0x11:DeleteFrameFiles: successfully deleted file=00/wudata_01.ckp
19:08:07:WU00:FS00:0x11:- Created dyn
19:08:07:WU00:FS00:0x11:- Files status OK
19:08:07:WU00:FS00:0x11:- Expanded 45377 -> 251112 (decompressed 553.3 percent)
19:08:07:WU00:FS00:0x11:Called DecompressByteArray: compressed_data_size=45377 data_size=251112, decompressed_data_size=251112 diff=0
19:08:07:WU00:FS00:0x11:- Digital signature verified
19:08:07:WU00:FS00:0x11:
19:08:07:WU00:FS00:0x11:Project: 5769 (Run 3, Clone 37, Gen 2204)
19:08:07:WU00:FS00:0x11:
19:08:07:WU00:FS00:0x11:Assembly optimizations on if available.
19:08:07:WU00:FS00:0x11:Entering M.D.
19:08:07:WU00:FS00:Project 5769 description downloaded successfully
19:08:09:WU01:FS01:FahCore 15: Download complete
19:08:09:WU01:FS01:Valid core signature
19:08:09:WU01:FS01:Unpacked 7.71MiB to cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe
19:08:09:WU01:FS01:Starting
19:08:09:WU01:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:08:09:WU01:FS01:Started FahCore on PID 9916
19:08:09:WU01:FS01:Core PID:13776
19:08:09:WU01:FS01:FahCore 0x15 started
19:08:10:WU01:FS01:Downloading project 7625 description
19:08:10:WU01:FS01:Connecting to fah-web.stanford.edu:80
19:08:10:WU01:FS01:Project 7625 description downloaded successfully
19:08:10:WU01:FS01:0x15:
19:08:10:WU01:FS01:0x15:*------------------------------*
19:08:10:WU01:FS01:0x15:Folding@Home GPU Core
19:08:10:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:08:10:WU01:FS01:0x15:Build host             AmoebaRemote
19:08:10:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
19:08:11:WU01:FS01:0x15:Core                   15
19:08:11:WU01:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:08:11:WU01:FS01:0x15:
19:08:11:WU01:FS01:0x15:Window's signal control handler registered.
19:08:11:WU01:FS01:0x15:Preparing to commence simulation
19:08:11:WU01:FS01:0x15:- Looking at optimizations...
19:08:11:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
19:08:11:WU01:FS01:0x15:- Created dyn
19:08:11:WU01:FS01:0x15:- Files status OK
19:08:11:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:08:11:WU01:FS01:0x15:- Expanded 124483 -> 502918 (decompressed 404.0 percent)
19:08:11:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=124483 data_size=502918, decompressed_data_size=502918 diff=0
19:08:11:WU01:FS01:0x15:- Digital signature verified
19:08:11:WU01:FS01:0x15:
19:08:11:WU01:FS01:0x15:Project: 7625 (Run 86, Clone 1, Gen 33)
19:08:11:WU01:FS01:0x15:
19:08:11:WU01:FS01:0x15:Assembly optimizations on if available.
19:08:11:WU01:FS01:0x15:Entering M.D.
19:08:12:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  3382337022 2773801560 1667039180 1865115488 2638020857
19:08:12:WU01:FS01:0x15:GPU device id=1
19:08:12:WU01:FS01:0x15:Working on Protein
19:08:12:WU01:FS01:0x15:Client config unavailable.
19:08:12:WU01:FS01:0x15:Starting GUI Server
19:08:13:WU02:FS02:FahCore a3: 90.90%
19:08:13:WU02:FS02:FahCore a3: Download complete
19:08:13:WU02:FS02:Valid core signature
19:08:13:WU02:FS02:Unpacked 9.59MiB to cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe
19:08:13:WU02:FS02:Starting
19:08:13:WU02:FS02:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 02 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -np 8
19:08:13:WU02:FS02:Started FahCore on PID 11800
19:08:13:WU02:FS02:Core PID:14544
19:08:13:WU02:FS02:FahCore 0xa3 started
19:08:13:WU00:FS00:0x11:Tpr hash 00/wudata_01.tpr:  3091097838 3795556824 3591362681 855449385 4144820625
19:08:13:WU00:FS00:0x11:
19:08:13:WU00:FS00:0x11:Calling fah_main args: 14 usage=100
19:08:13:WU00:FS00:0x11:
19:08:14:WU02:FS02:Downloading project 10127 description
19:08:14:WU02:FS02:Connecting to fah-web.stanford.edu:80
19:08:14:WU02:FS02:0xa3:
19:08:14:WU02:FS02:0xa3:*------------------------------*
19:08:14:WU02:FS02:0xa3:Folding@Home Gromacs SMP Core
19:08:14:WU02:FS02:0xa3:Version 2.27 (Dec. 15, 2010)
19:08:14:WU02:FS02:0xa3:
19:08:14:WU02:FS02:0xa3:Preparing to commence simulation
19:08:14:WU02:FS02:0xa3:- Looking at optimizations...
19:08:14:WU02:FS02:0xa3:- Created dyn
19:08:14:WU02:FS02:0xa3:- Files status OK
19:08:14:WU02:FS02:0xa3:- Expanded 2034982 -> 3061060 (decompressed 150.4 percent)
19:08:14:WU02:FS02:0xa3:Called DecompressByteArray: compressed_data_size=2034982 data_size=3061060, decompressed_data_size=3061060 diff=0
19:08:14:WU02:FS02:0xa3:- Digital signature verified
19:08:14:WU02:FS02:0xa3:
19:08:14:WU02:FS02:0xa3:Project: 10127 (Run 90, Clone 1, Gen 84)
19:08:14:WU02:FS02:0xa3:
19:08:14:WU02:FS02:0xa3:Assembly optimizations on if available.
19:08:14:WU02:FS02:0xa3:Entering M.D.
19:08:14:WU02:FS02:Project 10127 description downloaded successfully
19:08:20:WU02:FS02:0xa3:Mapping NT from 8 to 8 
19:08:20:WU02:FS02:0xa3:Completed 0 out of 2000000 steps  (0%)
19:09:15:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:09:15:WU01:FS01:Starting
19:09:15:WU01:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:09:15:WU01:FS01:Started FahCore on PID 10556
19:09:15:WU01:FS01:Core PID:21292
19:09:15:WU01:FS01:FahCore 0x15 started
19:09:16:WU01:FS01:0x15:
19:09:16:WU01:FS01:0x15:*------------------------------*
19:09:16:WU01:FS01:0x15:Folding@Home GPU Core
19:09:16:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:09:16:WU01:FS01:0x15:Build host             AmoebaRemote
19:09:16:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
19:09:16:WU01:FS01:0x15:Core                   15
19:09:16:WU01:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:09:16:WU01:FS01:0x15:
19:09:16:WU01:FS01:0x15:Window's signal control handler registered.
19:09:16:WU01:FS01:0x15:Preparing to commence simulation
19:09:16:WU01:FS01:0x15:- Looking at optimizations...
19:09:16:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
19:09:16:WU01:FS01:0x15:- Created dyn
19:09:16:WU01:FS01:0x15:- Files status OK
19:09:16:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:09:16:WU01:FS01:0x15:- Expanded 124483 -> 502918 (decompressed 404.0 percent)
19:09:16:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=124483 data_size=502918, decompressed_data_size=502918 diff=0
19:09:16:WU01:FS01:0x15:- Digital signature verified
19:09:16:WU01:FS01:0x15:
19:09:16:WU01:FS01:0x15:Project: 7625 (Run 86, Clone 1, Gen 33)
19:09:16:WU01:FS01:0x15:
19:09:16:WU01:FS01:0x15:Assembly optimizations on if available.
19:09:16:WU01:FS01:0x15:Entering M.D.
19:09:18:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  3382337022 2773801560 1667039180 1865115488 2638020857
19:09:18:WU01:FS01:0x15:GPU device id=1
19:09:18:WU01:FS01:0x15:Working on Protein
19:09:18:WU01:FS01:0x15:Client config unavailable.
19:09:18:WU01:FS01:0x15:Starting GUI Server
19:10:21:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:10:21:WU01:FS01:Starting
19:10:21:WU01:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:10:22:WU01:FS01:Started FahCore on PID 18544
19:10:22:WU01:FS01:Core PID:19504
19:10:22:WU01:FS01:FahCore 0x15 started
19:10:22:WU01:FS01:0x15:
19:10:22:WU01:FS01:0x15:*------------------------------*
19:10:22:WU01:FS01:0x15:Folding@Home GPU Core
19:10:22:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:10:22:WU01:FS01:0x15:Build host             AmoebaRemote
19:10:22:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
19:10:22:WU01:FS01:0x15:Core                   15
19:10:22:WU01:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:10:22:WU01:FS01:0x15:
19:10:22:WU01:FS01:0x15:Window's signal control handler registered.
19:10:22:WU01:FS01:0x15:Preparing to commence simulation
19:10:22:WU01:FS01:0x15:- Looking at optimizations...
19:10:22:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
19:10:22:WU01:FS01:0x15:- Created dyn
19:10:22:WU01:FS01:0x15:- Files status OK
19:10:22:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:10:22:WU01:FS01:0x15:- Expanded 124483 -> 502918 (decompressed 404.0 percent)
19:10:22:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=124483 data_size=502918, decompressed_data_size=502918 diff=0
19:10:22:WU01:FS01:0x15:- Digital signature verified
19:10:22:WU01:FS01:0x15:
19:10:22:WU01:FS01:0x15:Project: 7625 (Run 86, Clone 1, Gen 33)
19:10:22:WU01:FS01:0x15:
19:10:22:WU01:FS01:0x15:Assembly optimizations on if available.
19:10:22:WU01:FS01:0x15:Entering M.D.
19:10:24:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  3382337022 2773801560 1667039180 1865115488 2638020857
19:10:24:WU01:FS01:0x15:GPU device id=1
19:10:24:WU01:FS01:0x15:Working on Protein
19:10:24:WU01:FS01:0x15:Client config unavailable.
19:10:24:WU01:FS01:0x15:Starting GUI Server
19:11:27:WU01:FS01:0x15:Finished fah_main status=59
19:11:27:WU01:FS01:0x15:mdrun_gpu returned 59
19:11:27:WU01:FS01:0x15:GPU memtest failure
19:11:27:WU01:FS01:0x15:
19:11:27:WU01:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:11:28:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:11:59:WU01:FS01:Starting
19:11:59:WU01:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:11:59:WU01:FS01:Started FahCore on PID 13124
19:11:59:WU01:FS01:Core PID:14752
19:11:59:WU01:FS01:FahCore 0x15 started
19:11:59:WU01:FS01:0x15:
19:11:59:WU01:FS01:0x15:*------------------------------*
19:11:59:WU01:FS01:0x15:Folding@Home GPU Core
19:11:59:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:11:59:WU01:FS01:0x15:Build host             AmoebaRemote
19:11:59:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
19:11:59:WU01:FS01:0x15:Core                   15
19:11:59:WU01:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:11:59:WU01:FS01:0x15:
19:11:59:WU01:FS01:0x15:Window's signal control handler registered.
19:11:59:WU01:FS01:0x15:Preparing to commence simulation
19:11:59:WU01:FS01:0x15:- Looking at optimizations...
19:11:59:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
19:11:59:WU01:FS01:0x15:- Created dyn
19:11:59:WU01:FS01:0x15:- Files status OK
19:11:59:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:11:59:WU01:FS01:0x15:- Expanded 124483 -> 502918 (decompressed 404.0 percent)
19:11:59:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=124483 data_size=502918, decompressed_data_size=502918 diff=0
19:11:59:WU01:FS01:0x15:- Digital signature verified
19:11:59:WU01:FS01:0x15:
19:11:59:WU01:FS01:0x15:Project: 7625 (Run 86, Clone 1, Gen 33)
19:11:59:WU01:FS01:0x15:
19:11:59:WU01:FS01:0x15:Assembly optimizations on if available.
19:11:59:WU01:FS01:0x15:Entering M.D.
19:12:01:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  3382337022 2773801560 1667039180 1865115488 2638020857
19:12:01:WU01:FS01:0x15:GPU device id=1
19:12:01:WU01:FS01:0x15:Working on Protein
19:12:01:WU01:FS01:0x15:Client config unavailable.
19:12:01:WU01:FS01:0x15:Starting GUI Server
19:13:05:WU01:FS01:0x15:Finished fah_main status=59
19:13:05:WU01:FS01:0x15:mdrun_gpu returned 59
19:13:05:WU01:FS01:0x15:GPU memtest failure
19:13:05:WU01:FS01:0x15:
19:13:05:WU01:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:13:06:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:14:36:WU01:FS01:Starting
19:14:36:WU01:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:14:36:WU01:FS01:Started FahCore on PID 7716
19:14:36:WU01:FS01:Core PID:14540
19:14:36:WU01:FS01:FahCore 0x15 started
19:14:36:WU01:FS01:0x15:
19:14:36:WU01:FS01:0x15:*------------------------------*
19:14:36:WU01:FS01:0x15:Folding@Home GPU Core
19:14:36:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:14:36:WU01:FS01:0x15:Build host             AmoebaRemote
19:14:36:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
19:14:36:WU01:FS01:0x15:Core                   15
19:14:36:WU01:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:14:36:WU01:FS01:0x15:
19:14:36:WU01:FS01:0x15:Window's signal control handler registered.
19:14:36:WU01:FS01:0x15:Preparing to commence simulation
19:14:36:WU01:FS01:0x15:- Looking at optimizations...
19:14:36:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
19:14:36:WU01:FS01:0x15:- Created dyn
19:14:36:WU01:FS01:0x15:- Files status OK
19:14:36:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:14:36:WU01:FS01:0x15:- Expanded 124483 -> 502918 (decompressed 404.0 percent)
19:14:36:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=124483 data_size=502918, decompressed_data_size=502918 diff=0
19:14:36:WU01:FS01:0x15:- Digital signature verified
19:14:36:WU01:FS01:0x15:
19:14:36:WU01:FS01:0x15:Project: 7625 (Run 86, Clone 1, Gen 33)
19:14:36:WU01:FS01:0x15:
19:14:36:WU01:FS01:0x15:Assembly optimizations on if available.
19:14:36:WU01:FS01:0x15:Entering M.D.
19:14:38:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  3382337022 2773801560 1667039180 1865115488 2638020857
19:14:38:WU01:FS01:0x15:GPU device id=1
19:14:38:WU01:FS01:0x15:Working on Protein
19:14:38:WU01:FS01:0x15:Client config unavailable.
19:14:38:WU01:FS01:0x15:Starting GUI Server
19:15:39:WU01:FS01:0x15:Finished fah_main status=59
19:15:39:WU01:FS01:0x15:mdrun_gpu returned 59
19:15:39:WU01:FS01:0x15:GPU memtest failure
19:15:39:WU01:FS01:0x15:
19:15:39:WU01:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:15:40:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:15:40:WARNING:WU01:FS01:Too many errors, failing
19:15:40:WU01:FS01:Sending unit results: id:01 state:SEND error:FAILED project:7625 run:86 clone:1 gen:33 core:0x15 unit:0x0000002b664f2dd14fe615a062834c3a
19:15:40:WU01:FS01:Connecting to 171.64.65.105:8080
19:15:40:WU01:FS01:Server responded WORK_QUIT (404)
19:15:40:WARNING:WU01:FS01:Server did not like results, dumping
19:15:40:WU01:FS01:Cleaning up
19:15:40:WU03:FS01:Connecting to assign-GPU.stanford.edu:80
19:15:41:WU03:FS01:News: Welcome to Folding@Home
19:15:41:WU03:FS01:Assigned to work server 171.64.65.105
19:15:41:WU03:FS01:Requesting new work unit for slot 01: READY gpu:1:"GF114 [GeForce GTX 560 Ti]" from 171.64.65.105
19:15:41:WU03:FS01:Connecting to 171.64.65.105:8080
19:15:41:WU03:FS01:Downloading 122.17KiB
19:15:41:WU03:FS01:Download complete
19:15:41:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:7623 run:483 clone:0 gen:107 core:0x15 unit:0x00000088664f2dd14fe4fb29b1f43884
19:15:42:WU03:FS01:Starting
19:15:42:WU03:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 03 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:15:42:WU03:FS01:Started FahCore on PID 7972
19:15:42:WU03:FS01:Core PID:18744
19:15:42:WU03:FS01:FahCore 0x15 started
19:15:42:WU03:FS01:Downloading project 7623 description
19:15:42:WU03:FS01:Connecting to fah-web.stanford.edu:80
19:15:42:WU03:FS01:Project 7623 description downloaded successfully
19:15:42:WU03:FS01:0x15:
19:15:42:WU03:FS01:0x15:*------------------------------*
19:15:42:WU03:FS01:0x15:Folding@Home GPU Core
19:15:42:WU03:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:15:42:WU03:FS01:0x15:Build host             AmoebaRemote
19:15:42:WU03:FS01:0x15:Board Type             NVIDIA/CUDA
19:15:42:WU03:FS01:0x15:Core                   15
19:15:42:WU03:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:15:42:WU03:FS01:0x15:
19:15:42:WU03:FS01:0x15:Window's signal control handler registered.
19:15:42:WU03:FS01:0x15:Preparing to commence simulation
19:15:42:WU03:FS01:0x15:- Looking at optimizations...
19:15:42:WU03:FS01:0x15:DeleteFrameFiles: successfully deleted file=03/wudata_01.ckp
19:15:42:WU03:FS01:0x15:- Created dyn
19:15:42:WU03:FS01:0x15:- Files status OK
19:15:42:WU03:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:15:42:WU03:FS01:0x15:- Expanded 124585 -> 501826 (decompressed 402.7 percent)
19:15:42:WU03:FS01:0x15:Called DecompressByteArray: compressed_data_size=124585 data_size=501826, decompressed_data_size=501826 diff=0
19:15:42:WU03:FS01:0x15:- Digital signature verified
19:15:42:WU03:FS01:0x15:
19:15:42:WU03:FS01:0x15:Project: 7623 (Run 483, Clone 0, Gen 107)
19:15:42:WU03:FS01:0x15:
19:15:42:WU03:FS01:0x15:Assembly optimizations on if available.
19:15:42:WU03:FS01:0x15:Entering M.D.
19:15:44:WU03:FS01:0x15:Tpr hash 03/wudata_01.tpr:  1401061932 3453555306 1088199837 2508198347 613022471
19:15:44:WU03:FS01:0x15:GPU device id=1
19:15:44:WU03:FS01:0x15:Working on Protein
19:15:44:WU03:FS01:0x15:Client config unavailable.
19:15:44:WU03:FS01:0x15:Starting GUI Server
19:16:48:WU03:FS01:0x15:Finished fah_main status=59
19:16:48:WU03:FS01:0x15:mdrun_gpu returned 59
19:16:48:WU03:FS01:0x15:GPU memtest failure
19:16:48:WU03:FS01:0x15:
19:16:48:WU03:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:16:49:WARNING:WU03:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:16:49:WU03:FS01:Starting
19:16:49:WU03:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 03 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:16:49:WU03:FS01:Started FahCore on PID 3404
19:16:49:WU03:FS01:Core PID:11804
19:16:49:WU03:FS01:FahCore 0x15 started
19:16:49:WU03:FS01:0x15:
19:16:49:WU03:FS01:0x15:*------------------------------*
19:16:49:WU03:FS01:0x15:Folding@Home GPU Core
19:16:49:WU03:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:16:49:WU03:FS01:0x15:Build host             AmoebaRemote
19:16:49:WU03:FS01:0x15:Board Type             NVIDIA/CUDA
19:16:49:WU03:FS01:0x15:Core                   15
19:16:49:WU03:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:16:49:WU03:FS01:0x15:
19:16:49:WU03:FS01:0x15:Window's signal control handler registered.
19:16:49:WU03:FS01:0x15:Preparing to commence simulation
19:16:49:WU03:FS01:0x15:- Looking at optimizations...
19:16:49:WU03:FS01:0x15:DeleteFrameFiles: successfully deleted file=03/wudata_01.ckp
19:16:49:WU03:FS01:0x15:- Created dyn
19:16:49:WU03:FS01:0x15:- Files status OK
19:16:49:WU03:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:16:49:WU03:FS01:0x15:- Expanded 124585 -> 501826 (decompressed 402.7 percent)
19:16:49:WU03:FS01:0x15:Called DecompressByteArray: compressed_data_size=124585 data_size=501826, decompressed_data_size=501826 diff=0
19:16:49:WU03:FS01:0x15:- Digital signature verified
19:16:49:WU03:FS01:0x15:
19:16:49:WU03:FS01:0x15:Project: 7623 (Run 483, Clone 0, Gen 107)
19:16:49:WU03:FS01:0x15:
19:16:49:WU03:FS01:0x15:Assembly optimizations on if available.
19:16:49:WU03:FS01:0x15:Entering M.D.
19:16:51:WU03:FS01:0x15:Tpr hash 03/wudata_01.tpr:  1401061932 3453555306 1088199837 2508198347 613022471
19:16:51:WU03:FS01:0x15:GPU device id=1
19:16:51:WU03:FS01:0x15:Working on Protein
19:16:51:WU03:FS01:0x15:Client config unavailable.
19:16:51:WU03:FS01:0x15:Starting GUI Server
19:17:55:WU03:FS01:0x15:Finished fah_main status=59
19:17:55:WU03:FS01:0x15:mdrun_gpu returned 59
19:17:55:WU03:FS01:0x15:GPU memtest failure
19:17:55:WU03:FS01:0x15:
19:17:55:WU03:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:17:55:WARNING:WU03:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:17:55:WU03:FS01:Starting
19:17:55:WU03:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 03 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:17:55:WU03:FS01:Started FahCore on PID 18888
19:17:55:WU03:FS01:Core PID:14744
19:17:55:WU03:FS01:FahCore 0x15 started
19:17:56:WU03:FS01:0x15:
19:17:56:WU03:FS01:0x15:*------------------------------*
19:17:56:WU03:FS01:0x15:Folding@Home GPU Core
19:17:56:WU03:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:17:56:WU03:FS01:0x15:Build host             AmoebaRemote
19:17:56:WU03:FS01:0x15:Board Type             NVIDIA/CUDA
19:17:56:WU03:FS01:0x15:Core                   15
19:17:56:WU03:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:17:56:WU03:FS01:0x15:
19:17:56:WU03:FS01:0x15:Window's signal control handler registered.
19:17:56:WU03:FS01:0x15:Preparing to commence simulation
19:17:56:WU03:FS01:0x15:- Looking at optimizations...
19:17:56:WU03:FS01:0x15:DeleteFrameFiles: successfully deleted file=03/wudata_01.ckp
19:17:56:WU03:FS01:0x15:- Created dyn
19:17:56:WU03:FS01:0x15:- Files status OK
19:17:56:WU03:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:17:56:WU03:FS01:0x15:- Expanded 124585 -> 501826 (decompressed 402.7 percent)
19:17:56:WU03:FS01:0x15:Called DecompressByteArray: compressed_data_size=124585 data_size=501826, decompressed_data_size=501826 diff=0
19:17:56:WU03:FS01:0x15:- Digital signature verified
19:17:56:WU03:FS01:0x15:
19:17:56:WU03:FS01:0x15:Project: 7623 (Run 483, Clone 0, Gen 107)
19:17:56:WU03:FS01:0x15:
19:17:56:WU03:FS01:0x15:Assembly optimizations on if available.
19:17:56:WU03:FS01:0x15:Entering M.D.
19:17:58:WU03:FS01:0x15:Tpr hash 03/wudata_01.tpr:  1401061932 3453555306 1088199837 2508198347 613022471
19:17:58:WU03:FS01:0x15:GPU device id=1
19:17:58:WU03:FS01:0x15:Working on Protein
19:17:58:WU03:FS01:0x15:Client config unavailable.
19:17:58:WU03:FS01:0x15:Starting GUI Server
19:19:02:WU03:FS01:0x15:Finished fah_main status=59
19:19:02:WU03:FS01:0x15:mdrun_gpu returned 59
19:19:02:WU03:FS01:0x15:GPU memtest failure
19:19:02:WU03:FS01:0x15:
19:19:02:WU03:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:19:03:WARNING:WU03:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:19:33:WU03:FS01:Starting
19:19:33:WU03:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 03 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:19:33:WU03:FS01:Started FahCore on PID 6500
19:19:33:WU03:FS01:Core PID:20264
19:19:33:WU03:FS01:FahCore 0x15 started
19:19:33:WU03:FS01:0x15:
19:19:33:WU03:FS01:0x15:*------------------------------*
19:19:33:WU03:FS01:0x15:Folding@Home GPU Core
19:19:33:WU03:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:19:33:WU03:FS01:0x15:Build host             AmoebaRemote
19:19:33:WU03:FS01:0x15:Board Type             NVIDIA/CUDA
19:19:33:WU03:FS01:0x15:Core                   15
19:19:33:WU03:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:19:33:WU03:FS01:0x15:
19:19:33:WU03:FS01:0x15:Window's signal control handler registered.
19:19:33:WU03:FS01:0x15:Preparing to commence simulation
19:19:33:WU03:FS01:0x15:- Looking at optimizations...
19:19:33:WU03:FS01:0x15:DeleteFrameFiles: successfully deleted file=03/wudata_01.ckp
19:19:33:WU03:FS01:0x15:- Created dyn
19:19:33:WU03:FS01:0x15:- Files status OK
19:19:33:WU03:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:19:33:WU03:FS01:0x15:- Expanded 124585 -> 501826 (decompressed 402.7 percent)
19:19:33:WU03:FS01:0x15:Called DecompressByteArray: compressed_data_size=124585 data_size=501826, decompressed_data_size=501826 diff=0
19:19:33:WU03:FS01:0x15:- Digital signature verified
19:19:33:WU03:FS01:0x15:
19:19:33:WU03:FS01:0x15:Project: 7623 (Run 483, Clone 0, Gen 107)
19:19:33:WU03:FS01:0x15:
19:19:33:WU03:FS01:0x15:Assembly optimizations on if available.
19:19:33:WU03:FS01:0x15:Entering M.D.
19:19:35:WU03:FS01:0x15:Tpr hash 03/wudata_01.tpr:  1401061932 3453555306 1088199837 2508198347 613022471
19:19:35:WU03:FS01:0x15:GPU device id=1
19:19:35:WU03:FS01:0x15:Working on Protein
19:19:35:WU03:FS01:0x15:Client config unavailable.
19:19:35:WU03:FS01:0x15:Starting GUI Server
19:20:36:WU03:FS01:0x15:Finished fah_main status=59
19:20:36:WU03:FS01:0x15:mdrun_gpu returned 59
19:20:36:WU03:FS01:0x15:GPU memtest failure
19:20:36:WU03:FS01:0x15:
19:20:36:WU03:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:20:36:WARNING:WU03:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:22:10:WU03:FS01:Starting
19:22:10:WU03:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 03 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:22:10:WU03:FS01:Started FahCore on PID 6168
19:22:10:WU03:FS01:Core PID:9244
19:22:10:WU03:FS01:FahCore 0x15 started
19:22:10:WU03:FS01:0x15:
19:22:10:WU03:FS01:0x15:*------------------------------*
19:22:10:WU03:FS01:0x15:Folding@Home GPU Core
19:22:10:WU03:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:22:10:WU03:FS01:0x15:Build host             AmoebaRemote
19:22:10:WU03:FS01:0x15:Board Type             NVIDIA/CUDA
19:22:10:WU03:FS01:0x15:Core                   15
19:22:10:WU03:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:22:10:WU03:FS01:0x15:
19:22:10:WU03:FS01:0x15:Window's signal control handler registered.
19:22:10:WU03:FS01:0x15:Preparing to commence simulation
19:22:10:WU03:FS01:0x15:- Looking at optimizations...
19:22:10:WU03:FS01:0x15:DeleteFrameFiles: successfully deleted file=03/wudata_01.ckp
19:22:10:WU03:FS01:0x15:- Created dyn
19:22:10:WU03:FS01:0x15:- Files status OK
19:22:10:WU03:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:22:10:WU03:FS01:0x15:- Expanded 124585 -> 501826 (decompressed 402.7 percent)
19:22:10:WU03:FS01:0x15:Called DecompressByteArray: compressed_data_size=124585 data_size=501826, decompressed_data_size=501826 diff=0
19:22:10:WU03:FS01:0x15:- Digital signature verified
19:22:10:WU03:FS01:0x15:
19:22:10:WU03:FS01:0x15:Project: 7623 (Run 483, Clone 0, Gen 107)
19:22:10:WU03:FS01:0x15:
19:22:10:WU03:FS01:0x15:Assembly optimizations on if available.
19:22:10:WU03:FS01:0x15:Entering M.D.
19:22:12:WU03:FS01:0x15:Tpr hash 03/wudata_01.tpr:  1401061932 3453555306 1088199837 2508198347 613022471
19:22:12:WU03:FS01:0x15:GPU device id=1
19:22:12:WU03:FS01:0x15:Working on Protein
19:22:12:WU03:FS01:0x15:Client config unavailable.
19:22:12:WU03:FS01:0x15:Starting GUI Server
19:23:18:WU03:FS01:0x15:Finished fah_main status=59
19:23:18:WU03:FS01:0x15:mdrun_gpu returned 59
19:23:18:WU03:FS01:0x15:GPU memtest failure
19:23:18:WU03:FS01:0x15:
19:23:18:WU03:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:23:18:WARNING:WU03:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:23:18:WARNING:WU03:FS01:Too many errors, failing
19:23:18:WU03:FS01:Sending unit results: id:03 state:SEND error:FAILED project:7623 run:483 clone:0 gen:107 core:0x15 unit:0x00000088664f2dd14fe4fb29b1f43884
19:23:18:WU03:FS01:Connecting to 171.64.65.105:8080
19:23:18:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
19:23:18:WU03:FS01:Server responded WORK_QUIT (404)
19:23:18:WARNING:WU03:FS01:Server did not like results, dumping
19:23:19:WU03:FS01:Cleaning up
19:23:19:WU01:FS01:News: Welcome to Folding@Home
19:23:19:WU01:FS01:Assigned to work server 171.64.65.105
19:23:19:WU01:FS01:Requesting new work unit for slot 01: READY gpu:1:"GF114 [GeForce GTX 560 Ti]" from 171.64.65.105
19:23:19:WU01:FS01:Connecting to 171.64.65.105:8080
19:23:19:WU01:FS01:Downloading 123.59KiB
19:23:20:WU01:FS01:Download complete
19:23:20:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:7626 run:59 clone:0 gen:126 core:0x15 unit:0x000000ab664f2dd14fe61a1466c93241
19:23:20:WU01:FS01:Starting
19:23:20:WU01:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:23:20:WU01:FS01:Started FahCore on PID 20680
19:23:20:WU01:FS01:Core PID:5056
19:23:20:WU01:FS01:FahCore 0x15 started
19:23:20:WU01:FS01:Downloading project 7626 description
19:23:20:WU01:FS01:Connecting to fah-web.stanford.edu:80
19:23:20:WU01:FS01:Project 7626 description downloaded successfully
19:23:20:WU01:FS01:0x15:
19:23:20:WU01:FS01:0x15:*------------------------------*
19:23:20:WU01:FS01:0x15:Folding@Home GPU Core
19:23:20:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:23:20:WU01:FS01:0x15:Build host             AmoebaRemote
19:23:20:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
19:23:20:WU01:FS01:0x15:Core                   15
19:23:20:WU01:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:23:20:WU01:FS01:0x15:
19:23:20:WU01:FS01:0x15:Window's signal control handler registered.
19:23:20:WU01:FS01:0x15:Preparing to commence simulation
19:23:20:WU01:FS01:0x15:- Looking at optimizations...
19:23:20:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
19:23:20:WU01:FS01:0x15:- Created dyn
19:23:20:WU01:FS01:0x15:- Files status OK
19:23:20:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:23:20:WU01:FS01:0x15:- Expanded 126046 -> 507182 (decompressed 402.3 percent)
19:23:20:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=126046 data_size=507182, decompressed_data_size=507182 diff=0
19:23:20:WU01:FS01:0x15:- Digital signature verified
19:23:20:WU01:FS01:0x15:
19:23:20:WU01:FS01:0x15:Project: 7626 (Run 59, Clone 0, Gen 126)
19:23:20:WU01:FS01:0x15:
19:23:20:WU01:FS01:0x15:Assembly optimizations on if available.
19:23:20:WU01:FS01:0x15:Entering M.D.
19:23:22:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  630603223 3946307566 2507423878 2687987218 211647358
19:23:22:WU01:FS01:0x15:GPU device id=1
19:23:22:WU01:FS01:0x15:Working on Protein
19:23:22:WU01:FS01:0x15:Client config unavailable.
19:23:22:WU01:FS01:0x15:Starting GUI Server
19:24:27:WU01:FS01:0x15:Finished fah_main status=59
19:24:27:WU01:FS01:0x15:mdrun_gpu returned 59
19:24:27:WU01:FS01:0x15:GPU memtest failure
19:24:27:WU01:FS01:0x15:
19:24:27:WU01:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:24:27:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:24:27:WU01:FS01:Starting
19:24:27:WU01:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:24:27:WU01:FS01:Started FahCore on PID 5828
19:24:27:WU01:FS01:Core PID:20992
19:24:27:WU01:FS01:FahCore 0x15 started
19:24:28:WU01:FS01:0x15:
19:24:28:WU01:FS01:0x15:*------------------------------*
19:24:28:WU01:FS01:0x15:Folding@Home GPU Core
19:24:28:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:24:28:WU01:FS01:0x15:Build host             AmoebaRemote
19:24:28:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
19:24:28:WU01:FS01:0x15:Core                   15
19:24:28:WU01:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:24:28:WU01:FS01:0x15:
19:24:28:WU01:FS01:0x15:Window's signal control handler registered.
19:24:28:WU01:FS01:0x15:Preparing to commence simulation
19:24:28:WU01:FS01:0x15:- Looking at optimizations...
19:24:28:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
19:24:28:WU01:FS01:0x15:- Created dyn
19:24:28:WU01:FS01:0x15:- Files status OK
19:24:28:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:24:28:WU01:FS01:0x15:- Expanded 126046 -> 507182 (decompressed 402.3 percent)
19:24:28:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=126046 data_size=507182, decompressed_data_size=507182 diff=0
19:24:28:WU01:FS01:0x15:- Digital signature verified
19:24:28:WU01:FS01:0x15:
19:24:28:WU01:FS01:0x15:Project: 7626 (Run 59, Clone 0, Gen 126)
19:24:28:WU01:FS01:0x15:
19:24:28:WU01:FS01:0x15:Assembly optimizations on if available.
19:24:28:WU01:FS01:0x15:Entering M.D.
19:24:30:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  630603223 3946307566 2507423878 2687987218 211647358
19:24:30:WU01:FS01:0x15:GPU device id=1
19:24:30:WU01:FS01:0x15:Working on Protein
19:24:30:WU01:FS01:0x15:Client config unavailable.
19:24:30:WU01:FS01:0x15:Starting GUI Server
19:25:33:WU01:FS01:0x15:Finished fah_main status=59
19:25:33:WU01:FS01:0x15:mdrun_gpu returned 59
19:25:33:WU01:FS01:0x15:GPU memtest failure
19:25:33:WU01:FS01:0x15:
19:25:33:WU01:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:25:33:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:25:34:WU01:FS01:Starting
19:25:34:WU01:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:25:34:WU01:FS01:Started FahCore on PID 7740
19:25:34:WU01:FS01:Core PID:14360
19:25:34:WU01:FS01:FahCore 0x15 started
19:25:34:WU01:FS01:0x15:
19:25:34:WU01:FS01:0x15:*------------------------------*
19:25:34:WU01:FS01:0x15:Folding@Home GPU Core
19:25:34:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:25:34:WU01:FS01:0x15:Build host             AmoebaRemote
19:25:34:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
19:25:34:WU01:FS01:0x15:Core                   15
19:25:34:WU01:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:25:34:WU01:FS01:0x15:
19:25:34:WU01:FS01:0x15:Window's signal control handler registered.
19:25:34:WU01:FS01:0x15:Preparing to commence simulation
19:25:34:WU01:FS01:0x15:- Looking at optimizations...
19:25:34:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
19:25:34:WU01:FS01:0x15:- Created dyn
19:25:34:WU01:FS01:0x15:- Files status OK
19:25:34:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:25:34:WU01:FS01:0x15:- Expanded 126046 -> 507182 (decompressed 402.3 percent)
19:25:34:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=126046 data_size=507182, decompressed_data_size=507182 diff=0
19:25:34:WU01:FS01:0x15:- Digital signature verified
19:25:34:WU01:FS01:0x15:
19:25:34:WU01:FS01:0x15:Project: 7626 (Run 59, Clone 0, Gen 126)
19:25:34:WU01:FS01:0x15:
19:25:34:WU01:FS01:0x15:Assembly optimizations on if available.
19:25:34:WU01:FS01:0x15:Entering M.D.
19:25:36:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  630603223 3946307566 2507423878 2687987218 211647358
19:25:36:WU01:FS01:0x15:GPU device id=1
19:25:36:WU01:FS01:0x15:Working on Protein
19:25:36:WU01:FS01:0x15:Client config unavailable.
19:25:36:WU01:FS01:0x15:Starting GUI Server
19:26:38:WU01:FS01:0x15:Finished fah_main status=59
19:26:38:WU01:FS01:0x15:mdrun_gpu returned 59
19:26:38:WU01:FS01:0x15:GPU memtest failure
19:26:38:WU01:FS01:0x15:
19:26:38:WU01:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:26:38:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:27:11:WU01:FS01:Starting
19:27:11:WU01:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:27:11:WU01:FS01:Started FahCore on PID 7732
19:27:11:WU01:FS01:Core PID:10988
19:27:11:WU01:FS01:FahCore 0x15 started
19:27:11:WU01:FS01:0x15:
19:27:11:WU01:FS01:0x15:*------------------------------*
19:27:11:WU01:FS01:0x15:Folding@Home GPU Core
19:27:11:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:27:11:WU01:FS01:0x15:Build host             AmoebaRemote
19:27:11:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
19:27:11:WU01:FS01:0x15:Core                   15
19:27:11:WU01:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:27:11:WU01:FS01:0x15:
19:27:11:WU01:FS01:0x15:Window's signal control handler registered.
19:27:11:WU01:FS01:0x15:Preparing to commence simulation
19:27:11:WU01:FS01:0x15:- Looking at optimizations...
19:27:11:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
19:27:11:WU01:FS01:0x15:- Created dyn
19:27:11:WU01:FS01:0x15:- Files status OK
19:27:11:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:27:11:WU01:FS01:0x15:- Expanded 126046 -> 507182 (decompressed 402.3 percent)
19:27:11:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=126046 data_size=507182, decompressed_data_size=507182 diff=0
19:27:11:WU01:FS01:0x15:- Digital signature verified
19:27:11:WU01:FS01:0x15:
19:27:11:WU01:FS01:0x15:Project: 7626 (Run 59, Clone 0, Gen 126)
19:27:11:WU01:FS01:0x15:
19:27:11:WU01:FS01:0x15:Assembly optimizations on if available.
19:27:11:WU01:FS01:0x15:Entering M.D.
19:27:13:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  630603223 3946307566 2507423878 2687987218 211647358
19:27:13:WU01:FS01:0x15:GPU device id=1
19:27:13:WU01:FS01:0x15:Working on Protein
19:27:13:WU01:FS01:0x15:Client config unavailable.
19:27:13:WU01:FS01:0x15:Starting GUI Server
19:28:17:WU01:FS01:0x15:Finished fah_main status=59
19:28:17:WU01:FS01:0x15:mdrun_gpu returned 59
19:28:17:WU01:FS01:0x15:GPU memtest failure
19:28:17:WU01:FS01:0x15:
19:28:17:WU01:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:28:17:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:29:48:WU01:FS01:Starting
19:29:48:WU01:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:29:48:WU01:FS01:Started FahCore on PID 5528
19:29:48:WU01:FS01:Core PID:4896
19:29:48:WU01:FS01:FahCore 0x15 started
19:29:48:WU01:FS01:0x15:
19:29:48:WU01:FS01:0x15:*------------------------------*
19:29:48:WU01:FS01:0x15:Folding@Home GPU Core
19:29:48:WU01:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:29:48:WU01:FS01:0x15:Build host             AmoebaRemote
19:29:48:WU01:FS01:0x15:Board Type             NVIDIA/CUDA
19:29:49:WU01:FS01:0x15:Core                   15
19:29:49:WU01:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:29:49:WU01:FS01:0x15:
19:29:49:WU01:FS01:0x15:Window's signal control handler registered.
19:29:49:WU01:FS01:0x15:Preparing to commence simulation
19:29:49:WU01:FS01:0x15:- Looking at optimizations...
19:29:49:WU01:FS01:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
19:29:49:WU01:FS01:0x15:- Created dyn
19:29:49:WU01:FS01:0x15:- Files status OK
19:29:49:WU01:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:29:49:WU01:FS01:0x15:- Expanded 126046 -> 507182 (decompressed 402.3 percent)
19:29:49:WU01:FS01:0x15:Called DecompressByteArray: compressed_data_size=126046 data_size=507182, decompressed_data_size=507182 diff=0
19:29:49:WU01:FS01:0x15:- Digital signature verified
19:29:49:WU01:FS01:0x15:
19:29:49:WU01:FS01:0x15:Project: 7626 (Run 59, Clone 0, Gen 126)
19:29:49:WU01:FS01:0x15:
19:29:49:WU01:FS01:0x15:Assembly optimizations on if available.
19:29:49:WU01:FS01:0x15:Entering M.D.
19:29:50:WU01:FS01:0x15:Tpr hash 01/wudata_01.tpr:  630603223 3946307566 2507423878 2687987218 211647358
19:29:50:WU01:FS01:0x15:GPU device id=1
19:29:50:WU01:FS01:0x15:Working on Protein
19:29:50:WU01:FS01:0x15:Client config unavailable.
19:29:51:WU01:FS01:0x15:Starting GUI Server
19:30:52:WU01:FS01:0x15:Finished fah_main status=59
19:30:52:WU01:FS01:0x15:mdrun_gpu returned 59
19:30:52:WU01:FS01:0x15:GPU memtest failure
19:30:52:WU01:FS01:0x15:
19:30:52:WU01:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:30:53:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:30:53:WARNING:WU01:FS01:Too many errors, failing
19:30:53:WU01:FS01:Sending unit results: id:01 state:SEND error:FAILED project:7626 run:59 clone:0 gen:126 core:0x15 unit:0x000000ab664f2dd14fe61a1466c93241
19:30:53:WU01:FS01:Connecting to 171.64.65.105:8080
19:30:53:WU01:FS01:Server responded WORK_QUIT (404)
19:30:53:WU03:FS01:Connecting to assign-GPU.stanford.edu:80
19:30:53:WARNING:WU01:FS01:Server did not like results, dumping
19:30:53:WU01:FS01:Cleaning up
19:30:54:WU03:FS01:News: Welcome to Folding@Home
19:30:54:WU03:FS01:Assigned to work server 171.64.65.105
19:30:54:WU03:FS01:Requesting new work unit for slot 01: READY gpu:1:"GF114 [GeForce GTX 560 Ti]" from 171.64.65.105
19:30:54:WU03:FS01:Connecting to 171.64.65.105:8080
19:30:54:WU03:FS01:Downloading 121.86KiB
19:30:55:WU03:FS01:Download complete
19:30:55:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:7623 run:523 clone:0 gen:134 core:0x15 unit:0x000000b2664f2dd14fe4fb624a898698
19:30:55:WU03:FS01:Starting
19:30:55:WU03:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 03 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:30:55:WU03:FS01:Started FahCore on PID 7424
19:30:55:WU03:FS01:Core PID:5704
19:30:55:WU03:FS01:FahCore 0x15 started
19:30:55:WU03:FS01:0x15:
19:30:55:WU03:FS01:0x15:*------------------------------*
19:30:55:WU03:FS01:0x15:Folding@Home GPU Core
19:30:55:WU03:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:30:55:WU03:FS01:0x15:Build host             AmoebaRemote
19:30:55:WU03:FS01:0x15:Board Type             NVIDIA/CUDA
19:30:55:WU03:FS01:0x15:Core                   15
19:30:55:WU03:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:30:55:WU03:FS01:0x15:
19:30:55:WU03:FS01:0x15:Window's signal control handler registered.
19:30:55:WU03:FS01:0x15:Preparing to commence simulation
19:30:55:WU03:FS01:0x15:- Looking at optimizations...
19:30:55:WU03:FS01:0x15:DeleteFrameFiles: successfully deleted file=03/wudata_01.ckp
19:30:55:WU03:FS01:0x15:- Created dyn
19:30:55:WU03:FS01:0x15:- Files status OK
19:30:55:WU03:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:30:55:WU03:FS01:0x15:- Expanded 124270 -> 501826 (decompressed 403.8 percent)
19:30:55:WU03:FS01:0x15:Called DecompressByteArray: compressed_data_size=124270 data_size=501826, decompressed_data_size=501826 diff=0
19:30:55:WU03:FS01:0x15:- Digital signature verified
19:30:55:WU03:FS01:0x15:
19:30:55:WU03:FS01:0x15:Project: 7623 (Run 523, Clone 0, Gen 134)
19:30:55:WU03:FS01:0x15:
19:30:55:WU03:FS01:0x15:Assembly optimizations on if available.
19:30:55:WU03:FS01:0x15:Entering M.D.
19:30:57:WU03:FS01:0x15:Tpr hash 03/wudata_01.tpr:  2946586776 2035988073 3268389169 1420145025 4165769353
19:30:57:WU03:FS01:0x15:GPU device id=1
19:30:57:WU03:FS01:0x15:Working on Protein
19:30:57:WU03:FS01:0x15:Client config unavailable.
19:30:57:WU03:FS01:0x15:Starting GUI Server
19:32:00:WU03:FS01:0x15:Finished fah_main status=59
19:32:00:WU03:FS01:0x15:mdrun_gpu returned 59
19:32:00:WU03:FS01:0x15:GPU memtest failure
19:32:00:WU03:FS01:0x15:
19:32:00:WU03:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:32:01:WARNING:WU03:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:32:01:WU03:FS01:Starting
19:32:01:WU03:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 03 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:32:01:WU03:FS01:Started FahCore on PID 18976
19:32:01:WU03:FS01:Core PID:12796
19:32:01:WU03:FS01:FahCore 0x15 started
19:32:02:WU03:FS01:0x15:
19:32:02:WU03:FS01:0x15:*------------------------------*
19:32:02:WU03:FS01:0x15:Folding@Home GPU Core
19:32:02:WU03:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:32:02:WU03:FS01:0x15:Build host             AmoebaRemote
19:32:02:WU03:FS01:0x15:Board Type             NVIDIA/CUDA
19:32:02:WU03:FS01:0x15:Core                   15
19:32:02:WU03:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:32:02:WU03:FS01:0x15:
19:32:02:WU03:FS01:0x15:Window's signal control handler registered.
19:32:02:WU03:FS01:0x15:Preparing to commence simulation
19:32:02:WU03:FS01:0x15:- Looking at optimizations...
19:32:02:WU03:FS01:0x15:DeleteFrameFiles: successfully deleted file=03/wudata_01.ckp
19:32:02:WU03:FS01:0x15:- Created dyn
19:32:02:WU03:FS01:0x15:- Files status OK
19:32:02:WU03:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:32:02:WU03:FS01:0x15:- Expanded 124270 -> 501826 (decompressed 403.8 percent)
19:32:02:WU03:FS01:0x15:Called DecompressByteArray: compressed_data_size=124270 data_size=501826, decompressed_data_size=501826 diff=0
19:32:02:WU03:FS01:0x15:- Digital signature verified
19:32:02:WU03:FS01:0x15:
19:32:02:WU03:FS01:0x15:Project: 7623 (Run 523, Clone 0, Gen 134)
19:32:02:WU03:FS01:0x15:
19:32:02:WU03:FS01:0x15:Assembly optimizations on if available.
19:32:02:WU03:FS01:0x15:Entering M.D.
19:32:03:WU03:FS01:0x15:Tpr hash 03/wudata_01.tpr:  2946586776 2035988073 3268389169 1420145025 4165769353
19:32:03:WU03:FS01:0x15:GPU device id=1
19:32:04:WU03:FS01:0x15:Working on Protein
19:32:04:WU03:FS01:0x15:Client config unavailable.
19:32:04:WU03:FS01:0x15:Starting GUI Server
19:33:07:WU03:FS01:0x15:Finished fah_main status=59
19:33:07:WU03:FS01:0x15:mdrun_gpu returned 59
19:33:07:WU03:FS01:0x15:GPU memtest failure
19:33:08:WU03:FS01:0x15:
19:33:08:WU03:FS01:0x15:Folding@home Core Shutdown: GPU_MEMTEST_ERROR
19:33:08:WARNING:WU03:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)
19:33:08:WU03:FS01:Starting
19:33:08:WU03:FS01:Running FahCore: "D:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" d:/Users/<my name>/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 03 -suffix 01 -version 702 -lifeline 14548 -checkpoint 15 -gpu 1
19:33:08:WU03:FS01:Started FahCore on PID 8756
19:33:08:WU03:FS01:Core PID:11404
19:33:08:WU03:FS01:FahCore 0x15 started
19:33:09:WU03:FS01:0x15:
19:33:09:WU03:FS01:0x15:*------------------------------*
19:33:09:WU03:FS01:0x15:Folding@Home GPU Core
19:33:09:WU03:FS01:0x15:Version                2.25 (Wed May 9 17:03:01 EDT 2012)
19:33:09:WU03:FS01:0x15:Build host             AmoebaRemote
19:33:09:WU03:FS01:0x15:Board Type             NVIDIA/CUDA
19:33:09:WU03:FS01:0x15:Core                   15
19:33:09:WU03:FS01:0x15:GPU device info vendor=0 device=0 name=NA match=0 deviceId=1
19:33:09:WU03:FS01:0x15:
19:33:09:WU03:FS01:0x15:Window's signal control handler registered.
19:33:09:WU03:FS01:0x15:Preparing to commence simulation
19:33:09:WU03:FS01:0x15:- Looking at optimizations...
19:33:09:WU03:FS01:0x15:DeleteFrameFiles: successfully deleted file=03/wudata_01.ckp
19:33:09:WU03:FS01:0x15:- Created dyn
19:33:09:WU03:FS01:0x15:- Files status OK
19:33:09:WU03:FS01:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:33:09:WU03:FS01:0x15:- Expanded 124270 -> 501826 (decompressed 403.8 percent)
19:33:09:WU03:FS01:0x15:Called DecompressByteArray: compressed_data_size=124270 data_size=501826, decompressed_data_size=501826 diff=0
19:33:09:WU03:FS01:0x15:- Digital signature verified
19:33:09:WU03:FS01:0x15:
19:33:09:WU03:FS01:0x15:Project: 7623 (Run 523, Clone 0, Gen 134)
19:33:09:WU03:FS01:0x15:
19:33:09:WU03:FS01:0x15:Assembly optimizations on if available.
19:33:09:WU03:FS01:0x15:Entering M.D.
19:33:10:WU03:FS01:0x15:Tpr hash 03/wudata_01.tpr:  2946586776 2035988073 3268389169 1420145025 4165769353
19:33:10:WU03:FS01:0x15:GPU device id=1
19:33:10:WU03:FS01:0x15:Working on Protein
19:33:10:WU03:FS01:0x15:Client config unavailable.
19:33:11:WU03:FS01:0x15:Starting GUI Server

Mod Edit: Removed Code Tags Around URL - PantherX

Post by **PantherX** » Mon Feb 11, 2013 4:55 pm

Welcome to the F@H Forum Striker 250,

Your log indicates that the WUs are being assigned to the correct GPU. However, it seems that you are receiving an error during the GPU memory test for your GTX 560Ti:
19:09:15:WARNING:WU01:FS01:FahCore returned: GPU_MEMTEST_ERROR (124 = 0x7c)

Some reports have indicated that Nvidia Driver version 306.97 WHQL works better for them than the 310.90 WHQL. If you want, you can try the previous driver version and see how it goes. Just make sure that you set the GPU Slots to Finish (by right clicking the Slot) before you change the driver version to avoid any possible issues.

The reason that the GPU slot displayed Failed was because there were many failed WUs so was automatically disabled. The information is shown as Unknown when the Server doesn't provided the necessary data. There are plans to ensure that eventually, all servers will send the correct information so the appropriate data will be displayed.

art_l_j_PlanetAMD64 · Post by **art_l_j_PlanetAMD64** » Mon Feb 11, 2013 5:13 pm

I believe there was another user here recently, who had a 9800 GT and a GTX 560 Ti in the same system, the same as you have. The only "solution" he found, to get the system folding, was to remove the 9800 GT from the system. I am not suggesting that as a "permanent" fix, but rather as something to try right now, to see if it works. Then we can work on getting both graphics cards to work together in the same system.

Post by **bruce** » Tue Feb 12, 2013 1:07 am

I have used that same trick when installing an AMD and a NV GPU in the same system as you're sugesting when the two different types happen to be different generations from the same vendor. Install one GPU and get all the drivers set up so it works the way you want it to. Remove the GPU without uninstalling the drivers and set up the other GPU the way you want it. Then, and only then, do I put both GPUs in the system and connect a monitor to one of them (or a 3rd GPU).

Striker 250 · Post by **Striker 250** » Wed Feb 13, 2013 5:14 am

Hmm, I tried rolling back the drivers to 306.90. At least it no longer says "Failed" on the status, but I'm still seeing the "GPU_MEMTEST_ERROR" in the log.

I also came across these posts http://foldingforum.org/viewtopic.php?f ... 01#p236298 with a similar problem, but no idea if it was resolved or not. I tried editing my config.xml in a similar way, but apparently I was doing something wrong as it didn't even start up. It just keeps displaying a box "The local client exited unexpectedly, please check for errors in the log file. Do you want to restart the client?" My config is below. The device ID 1200 is the 560 Ti and the 0613 is the 9800.

Code: Select all

<config>
  <!-- Folding Slot Configuration -->
  <gpu v='true'/>

  <!-- Logging -->
  <verbosity v='5'/>

  <!-- Network -->
  <proxy v=':8080'/>

  <!-- User Information -->
  <team v='*******'/>
  <user v='Striker_250'/>

  <!-- Folding Slots -->
  <slot id=0><gpus v="1"/>
    <gpu-vendor-id v="0x10de"/>
    <gpu-device-id v="0x0613"/>
  </slot>
  <slot id=1><gpus v="1"/>
    <gpu-vendor-id v="0x10de"/>
    <gpu-device-id v="0x1200"/>
  </slot>
  <slot id='2' type='SMP'/>

</config>

Striker 250 · Post by **Striker 250** » Wed Feb 13, 2013 6:21 am

It's working now!!!!! I had to edit my config some and I played with the cuda and open-cl indeces. My config is below.

Code: Select all

<config>
  <!-- Logging -->
  <verbosity v='5'/>

  <!-- Network -->
  <proxy v=':8080'/>

  <!-- User Information -->
  <team v='******'/>
  <user v=*******'/>

  <!-- Folding Slots -->
  <slot id='1' type='GPU'>
    <cuda-index v='1'/>
    <opencl-index v='1'/>
  </slot>
  <slot id='2' type='SMP'/>
  <slot id='0' type='GPU'>
    <cuda-index v='0'/>
    <opencl-index v='0'/>
  </slot>
</config>

art_l_j_PlanetAMD64 · Post by **art_l_j_PlanetAMD64** » Wed Feb 13, 2013 6:23 am

I have been told that the online documentation is out-of-date in this case, as the gpu-vendor-id and the gpu-device-id are no longer a valid way of defining GPU slots in config.xml.

Please, try a quick test by removing just the 9800 GTX+, to see if the GTX 560 Ti will be recognized and fold OK. This only takes a few minutes. The 9800 GTX+ can be replaced as soon as the test is complete.

After this problem has been resolved, you should disable auto-detection of GPUs by doing this: <gpu v='false'/>.

art_l_j_PlanetAMD64 · Post by **art_l_j_PlanetAMD64** » Wed Feb 13, 2013 6:26 am

Striker 250 wrote:It's working now!!!!! I had to edit my config some and I played with the cuda and open-cl indeces. My config is below.

That's great!

You were typing your post at the same time as I was typing mine.

Art

Striker 250 · Post by **Striker 250** » Wed Feb 13, 2013 6:35 am

art_l_j_PlanetAMD64 wrote:
Striker 250 wrote:It's working now!!!!! I had to edit my config some and I played with the cuda and open-cl indeces. My config is below.
That's great!

You were typing your post at the same time as I was typing mine.

Art

Heh. Yeah, 24524 PPD is a tad bit better than 3000...

Folding Forum

F@H not running on GPUs

F@H not running on GPUs

Re: F@H not running on GPUs

Re: F@H not running on GPUs

Re: F@H not running on GPUs

Re: F@H not running on GPUs

Re: F@H not running on GPUs

Re: F@H not running on GPUs

Re: F@H not running on GPUs

Re: F@H not running on GPUs