Multiple problems on a 4*280x rig

TheUniporn · Post by **TheUniporn** » Sat May 17, 2014 7:41 am

I apologize if this is in the wrong section, before I posted I searched for solutions (and the rules for posting) but I didn't find any solutions so here goes:

On a rig that has 4 280x cards (not OCed), I had a very weak CPU (a A4-4000 which was 2*3.2GHz) and everything was fine except the CPU was constantly at ~100% and not all GPUs were under load (at the same time at least, usually only one or two GPUs were actively folding). I now upgraded to a A8-6600K CPU that has 4*4.2GHz and while I still only see one or two GPUs working (have working clocks 1100/1500, not the idle ones 300/150), two GPUs display a very low PPD (1679) and a very long WU time ETA (~10 days) that doesn't seem to change with restarts or just waiting (12h+). I don't use the CPU for folding, I updated to the latest drivers and the WU in question are 13000 (1105, 2, 3) and 13000 (106, 0, 16). And this is the log:

Code: Select all

*********************** Log Started 2014-05-16T19:37:47Z ***********************
19:37:47:************************* Folding@home Client *************************
19:37:47:      Website: http://folding.stanford.edu/
19:37:47:    Copyright: (c) 2009-2014 Stanford University
19:37:47:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:37:47:         Args: 
19:37:47:       Config: C:/Users/W3/AppData/Roaming/FAHClient/config.xml
19:37:47:******************************** Build ********************************
19:37:47:      Version: 7.4.4
19:37:47:         Date: Mar 4 2014
19:37:47:         Time: 20:26:54
19:37:47:      SVN Rev: 4130
19:37:47:       Branch: fah/trunk/client
19:37:47:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
19:37:47:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
19:37:47:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
19:37:47:     Platform: win32 XP
19:37:47:         Bits: 32
19:37:47:         Mode: Release
19:37:47:******************************* System ********************************
19:37:47:          CPU: AMD A8-6600K APU with Radeon(tm) HD Graphics
19:37:47:       CPU ID: AuthenticAMD Family 21 Model 19 Stepping 1
19:37:47:         CPUs: 4
19:37:47:       Memory: 3.95GiB
19:37:47:  Free Memory: 3.34GiB
19:37:47:      Threads: WINDOWS_THREADS
19:37:47:   OS Version: 6.1
19:37:47:  Has Battery: false
19:37:47:   On Battery: false
19:37:47:   UTC Offset: 3
19:37:47:          PID: 2288
19:37:47:          CWD: C:/Users/W3/AppData/Roaming/FAHClient
19:37:47:           OS: Windows 7 Ultimate
19:37:47:      OS Arch: AMD64
19:37:47:         GPUs: 4
19:37:47:        GPU 0: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
19:37:47:        GPU 1: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
19:37:47:        GPU 2: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
19:37:47:        GPU 3: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
19:37:47:         CUDA: Not detected
19:37:47:Win32 Service: false
19:37:47:***********************************************************************
19:37:47:<config>
19:37:47:  <!-- Network -->
19:37:47:  <proxy v=':8080'/>
19:37:47:
19:37:47:  <!-- Slot Control -->
19:37:47:  <power v='full'/>
19:37:47:
19:37:47:  <!-- User Information -->
19:37:47:  <passkey v='********************************'/>
19:37:47:  <team v='224497'/>
19:37:47:  <user v='TheUniporn'/>
19:37:47:
19:37:47:  <!-- Folding Slots -->
19:37:47:  <slot id='1' type='GPU'/>
19:37:47:  <slot id='2' type='GPU'/>
19:37:47:  <slot id='3' type='GPU'/>
19:37:47:  <slot id='4' type='GPU'/>
19:37:47:</config>
19:37:47:Trying to access database...
19:37:47:Successfully acquired database lock
19:37:47:Enabled folding slot 01: READY gpu:0:Tahiti XT [Radeon R9 200/HD 7900/8970]
19:37:47:Enabled folding slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970]
19:37:47:Enabled folding slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970]
19:37:47:Enabled folding slot 04: READY gpu:3:Tahiti XT [Radeon R9 200/HD 7900/8970]
19:37:47:WU04:FS02:Starting
19:37:47:WU04:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 704 -lifeline 2288 -checkpoint 15 -gpu 1 -gpu-vendor ati
19:37:47:WU04:FS02:Started FahCore on PID 3048
19:37:47:WU04:FS02:Core PID:3060
19:37:47:WU04:FS02:FahCore 0x17 started
19:37:47:WU01:FS03:Starting
19:37:47:WU01:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 2288 -checkpoint 15 -gpu 2 -gpu-vendor ati
19:37:47:WU01:FS03:Started FahCore on PID 3068
19:37:47:WU01:FS03:Core PID:2116
19:37:47:WU01:FS03:FahCore 0x17 started
19:37:47:WU00:FS01:Starting
19:37:47:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2288 -checkpoint 15 -gpu 0 -gpu-vendor ati
19:37:47:WU00:FS01:Started FahCore on PID 2244
19:37:47:WU00:FS01:Core PID:2196
19:37:47:WU00:FS01:FahCore 0x17 started
19:37:47:WU03:FS04:Starting
19:37:47:WU03:FS04:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 2288 -checkpoint 15 -gpu 3 -gpu-vendor ati
19:37:47:WU03:FS04:Started FahCore on PID 2264
19:37:47:WU03:FS04:Core PID:2356
19:37:47:WU03:FS04:FahCore 0x17 started
19:37:48:WU04:FS02:0x17:*********************** Log Started 2014-05-16T19:37:48Z ***********************
19:37:48:WU04:FS02:0x17:Project: 13000 (Run 1105, Clone 2, Gen 3)
19:37:48:WU04:FS02:0x17:Unit: 0x00000010538b3db75310d3ccaf8435a3
19:37:48:WU04:FS02:0x17:CPU: 0x00000000000000000000000000000000
19:37:48:WU04:FS02:0x17:Machine: 2
19:37:48:WU04:FS02:0x17:Digital signatures verified
19:37:48:WU04:FS02:0x17:Folding@home GPU core17
19:37:48:WU04:FS02:0x17:Version 0.0.52
19:37:48:WU01:FS03:0x17:*********************** Log Started 2014-05-16T19:37:48Z ***********************
19:37:48:WU01:FS03:0x17:Project: 13001 (Run 389, Clone 1, Gen 20)
19:37:48:WU01:FS03:0x17:Unit: 0x0000002c538b3db75328bdf69ccc8643
19:37:48:WU01:FS03:0x17:CPU: 0x00000000000000000000000000000000
19:37:48:WU01:FS03:0x17:Machine: 3
19:37:48:WU01:FS03:0x17:Digital signatures verified
19:37:48:WU01:FS03:0x17:Folding@home GPU core17
19:37:48:WU01:FS03:0x17:Version 0.0.52
19:37:48:WU00:FS01:0x17:*********************** Log Started 2014-05-16T19:37:48Z ***********************
19:37:48:WU00:FS01:0x17:Project: 13001 (Run 49, Clone 1, Gen 12)
19:37:48:WU00:FS01:0x17:Unit: 0x0000001e538b3db753285d97c165b070
19:37:48:WU00:FS01:0x17:CPU: 0x00000000000000000000000000000000
19:37:48:WU00:FS01:0x17:Machine: 1
19:37:48:WU00:FS01:0x17:Digital signatures verified
19:37:48:WU00:FS01:0x17:Folding@home GPU core17
19:37:48:WU00:FS01:0x17:Version 0.0.52
19:37:48:WU03:FS04:0x17:*********************** Log Started 2014-05-16T19:37:48Z ***********************
19:37:48:WU03:FS04:0x17:Project: 13000 (Run 106, Clone 0, Gen 16)
19:37:48:WU03:FS04:0x17:Unit: 0x00000027538b3db7530fb9ef363c26b6
19:37:48:WU03:FS04:0x17:CPU: 0x00000000000000000000000000000000
19:37:48:WU03:FS04:0x17:Machine: 4
19:37:48:WU03:FS04:0x17:Digital signatures verified
19:37:48:WU03:FS04:0x17:Folding@home GPU core17
19:37:48:WU03:FS04:0x17:Version 0.0.52
19:37:50:WU01:FS03:0x17:  Found a checkpoint file
19:42:13:WU01:FS03:0x17:Completed 750000 out of 5000000 steps (15%)
19:42:13:WU01:FS03:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:42:19:WU00:FS01:0x17:Completed 0 out of 5000000 steps (0%)
19:42:19:WU00:FS01:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:42:25:WU03:FS04:0x17:Completed 0 out of 5000000 steps (0%)
19:42:25:WU03:FS04:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:42:32:WU04:FS02:0x17:Completed 0 out of 5000000 steps (0%)
19:42:32:WU04:FS02:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
19:50:07:WU01:FS03:0x17:Completed 800000 out of 5000000 steps (16%)
19:57:44:WU01:FS03:0x17:Completed 850000 out of 5000000 steps (17%)
19:58:12:13:127.0.0.1:New Web connection
20:05:37:WU01:FS03:0x17:Completed 900000 out of 5000000 steps (18%)
20:13:15:WU01:FS03:0x17:Completed 950000 out of 5000000 steps (19%)
20:20:53:WU01:FS03:0x17:Completed 1000000 out of 5000000 steps (20%)
20:28:47:WU01:FS03:0x17:Completed 1050000 out of 5000000 steps (21%)
20:36:24:WU01:FS03:0x17:Completed 1100000 out of 5000000 steps (22%)
20:44:18:WU01:FS03:0x17:Completed 1150000 out of 5000000 steps (23%)
20:51:55:WU01:FS03:0x17:Completed 1200000 out of 5000000 steps (24%)
20:59:33:WU01:FS03:0x17:Completed 1250000 out of 5000000 steps (25%)
21:07:26:WU01:FS03:0x17:Completed 1300000 out of 5000000 steps (26%)
21:15:04:WU01:FS03:0x17:Completed 1350000 out of 5000000 steps (27%)
21:22:58:WU01:FS03:0x17:Completed 1400000 out of 5000000 steps (28%)
21:30:35:WU01:FS03:0x17:Completed 1450000 out of 5000000 steps (29%)
21:38:14:WU01:FS03:0x17:Completed 1500000 out of 5000000 steps (30%)
21:46:07:WU01:FS03:0x17:Completed 1550000 out of 5000000 steps (31%)
21:53:44:WU01:FS03:0x17:Completed 1600000 out of 5000000 steps (32%)
22:01:37:WU01:FS03:0x17:Completed 1650000 out of 5000000 steps (33%)
22:09:12:WU01:FS03:0x17:Completed 1700000 out of 5000000 steps (34%)
22:16:48:WU01:FS03:0x17:Completed 1750000 out of 5000000 steps (35%)
22:24:41:WU01:FS03:0x17:Completed 1800000 out of 5000000 steps (36%)
22:32:18:WU01:FS03:0x17:Completed 1850000 out of 5000000 steps (37%)
22:40:12:WU01:FS03:0x17:Completed 1900000 out of 5000000 steps (38%)
22:47:50:WU01:FS03:0x17:Completed 1950000 out of 5000000 steps (39%)
22:55:28:WU01:FS03:0x17:Completed 2000000 out of 5000000 steps (40%)
23:03:22:WU01:FS03:0x17:Completed 2050000 out of 5000000 steps (41%)
23:11:00:WU01:FS03:0x17:Completed 2100000 out of 5000000 steps (42%)
23:18:54:WU01:FS03:0x17:Completed 2150000 out of 5000000 steps (43%)
23:26:32:WU01:FS03:0x17:Completed 2200000 out of 5000000 steps (44%)
23:34:11:WU01:FS03:0x17:Completed 2250000 out of 5000000 steps (45%)
23:42:05:WU01:FS03:0x17:Completed 2300000 out of 5000000 steps (46%)
23:49:43:WU01:FS03:0x17:Completed 2350000 out of 5000000 steps (47%)
23:57:37:WU01:FS03:0x17:Completed 2400000 out of 5000000 steps (48%)
00:05:15:WU01:FS03:0x17:Completed 2450000 out of 5000000 steps (49%)
00:12:53:WU01:FS03:0x17:Completed 2500000 out of 5000000 steps (50%)
00:20:48:WU01:FS03:0x17:Completed 2550000 out of 5000000 steps (51%)
00:28:26:WU01:FS03:0x17:Completed 2600000 out of 5000000 steps (52%)
00:36:21:WU01:FS03:0x17:Completed 2650000 out of 5000000 steps (53%)
00:43:59:WU01:FS03:0x17:Completed 2700000 out of 5000000 steps (54%)
00:51:35:WU01:FS03:0x17:Completed 2750000 out of 5000000 steps (55%)
00:59:30:WU01:FS03:0x17:Completed 2800000 out of 5000000 steps (56%)
01:07:07:WU01:FS03:0x17:Completed 2850000 out of 5000000 steps (57%)
01:15:01:WU01:FS03:0x17:Completed 2900000 out of 5000000 steps (58%)
01:22:39:WU01:FS03:0x17:Completed 2950000 out of 5000000 steps (59%)
01:30:17:WU01:FS03:0x17:Completed 3000000 out of 5000000 steps (60%)
******************************* Date: 2014-05-17 *******************************
01:38:11:WU01:FS03:0x17:Completed 3050000 out of 5000000 steps (61%)
01:45:49:WU01:FS03:0x17:Completed 3100000 out of 5000000 steps (62%)
01:53:43:WU01:FS03:0x17:Completed 3150000 out of 5000000 steps (63%)
02:01:20:WU01:FS03:0x17:Completed 3200000 out of 5000000 steps (64%)
02:08:58:WU01:FS03:0x17:Completed 3250000 out of 5000000 steps (65%)
02:16:52:WU01:FS03:0x17:Completed 3300000 out of 5000000 steps (66%)
02:24:30:WU01:FS03:0x17:Completed 3350000 out of 5000000 steps (67%)
02:32:23:WU01:FS03:0x17:Completed 3400000 out of 5000000 steps (68%)
02:40:01:WU01:FS03:0x17:Completed 3450000 out of 5000000 steps (69%)
02:47:40:WU01:FS03:0x17:Completed 3500000 out of 5000000 steps (70%)
02:55:34:WU01:FS03:0x17:Completed 3550000 out of 5000000 steps (71%)
03:03:12:WU01:FS03:0x17:Completed 3600000 out of 5000000 steps (72%)
03:11:06:WU01:FS03:0x17:Completed 3650000 out of 5000000 steps (73%)
03:18:43:WU01:FS03:0x17:Completed 3700000 out of 5000000 steps (74%)
03:26:21:WU01:FS03:0x17:Completed 3750000 out of 5000000 steps (75%)
03:34:15:WU01:FS03:0x17:Completed 3800000 out of 5000000 steps (76%)
03:41:53:WU01:FS03:0x17:Completed 3850000 out of 5000000 steps (77%)
03:49:46:WU01:FS03:0x17:Completed 3900000 out of 5000000 steps (78%)
03:57:24:WU01:FS03:0x17:Completed 3950000 out of 5000000 steps (79%)
04:05:02:WU01:FS03:0x17:Completed 4000000 out of 5000000 steps (80%)
04:12:56:WU01:FS03:0x17:Completed 4050000 out of 5000000 steps (81%)
04:20:35:WU01:FS03:0x17:Completed 4100000 out of 5000000 steps (82%)
04:28:28:WU01:FS03:0x17:Completed 4150000 out of 5000000 steps (83%)
04:36:06:WU01:FS03:0x17:Completed 4200000 out of 5000000 steps (84%)
04:43:43:WU01:FS03:0x17:Completed 4250000 out of 5000000 steps (85%)
04:51:37:WU01:FS03:0x17:Completed 4300000 out of 5000000 steps (86%)
04:59:15:WU01:FS03:0x17:Completed 4350000 out of 5000000 steps (87%)
05:07:08:WU01:FS03:0x17:Completed 4400000 out of 5000000 steps (88%)
05:14:46:WU01:FS03:0x17:Completed 4450000 out of 5000000 steps (89%)
05:22:24:WU01:FS03:0x17:Completed 4500000 out of 5000000 steps (90%)
05:30:18:WU01:FS03:0x17:Completed 4550000 out of 5000000 steps (91%)
05:37:56:WU01:FS03:0x17:Completed 4600000 out of 5000000 steps (92%)
05:45:50:WU01:FS03:0x17:Completed 4650000 out of 5000000 steps (93%)
05:47:05:120:127.0.0.1:New Web connection
05:53:27:WU01:FS03:0x17:Completed 4700000 out of 5000000 steps (94%)
06:01:05:WU01:FS03:0x17:Completed 4750000 out of 5000000 steps (95%)
06:08:58:WU01:FS03:0x17:Completed 4800000 out of 5000000 steps (96%)
06:16:36:WU01:FS03:0x17:Completed 4850000 out of 5000000 steps (97%)
06:24:30:WU01:FS03:0x17:Completed 4900000 out of 5000000 steps (98%)
06:32:08:WU01:FS03:0x17:Completed 4950000 out of 5000000 steps (99%)
06:39:46:WU01:FS03:0x17:Completed 5000000 out of 5000000 steps (100%)
06:39:48:WU02:FS03:Connecting to 171.67.108.201:80
06:39:50:WU02:FS03:Assigned to work server 140.163.4.231
06:39:50:WU02:FS03:Requesting new work unit for slot 03: RUNNING gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
06:39:50:WU02:FS03:Connecting to 140.163.4.231:8080
06:39:51:WU02:FS03:Downloading 4.84MiB
06:39:54:WU02:FS03:Download complete
06:39:54:WU02:FS03:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13001 run:154 clone:0 gen:12 core:0x17 unit:0x0000001b538b3db753287b46cbdbc7bd
06:39:54:WU02:FS03:Downloading core from http://web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah
06:39:54:WU02:FS03:Connecting to web.stanford.edu:80
06:39:55:WU02:FS03:FahCore 17: Downloading 2.55MiB
06:40:01:WU02:FS03:FahCore 17: 34.31%
06:40:02:WU01:FS03:0x17:Saving result file logfile_01.txt
06:40:02:WU01:FS03:0x17:Saving result file checkpointState.xml
06:40:04:WU01:FS03:0x17:Saving result file checkpt.crc
06:40:04:WU01:FS03:0x17:Saving result file log.txt
06:40:04:WU01:FS03:0x17:Saving result file positions.xtc
06:40:06:WU01:FS03:0x17:Folding@home Core Shutdown: FINISHED_UNIT
06:40:06:WU01:FS03:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:40:06:WU01:FS03:Sending unit results: id:01 state:SEND error:NO_ERROR project:13001 run:389 clone:1 gen:20 core:0x17 unit:0x0000002c538b3db75328bdf69ccc8643
06:40:07:WU01:FS03:Uploading 12.83MiB to 140.163.4.231
06:40:07:WU01:FS03:Connecting to 140.163.4.231:8080
06:40:07:WU02:FS03:FahCore 17: 71.07%
06:40:12:WU02:FS03:FahCore 17: Download complete
06:40:12:WU02:FS03:Valid core signature
06:40:12:WU02:FS03:Unpacked 8.60MiB to cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe
06:40:12:WU02:FS03:Starting
06:40:12:WU02:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 2288 -checkpoint 15 -gpu 2 -gpu-vendor ati
06:40:12:WU02:FS03:Started FahCore on PID 4764
06:40:12:WU02:FS03:Core PID:1800
06:40:12:WU02:FS03:FahCore 0x17 started
06:40:12:WU02:FS03:0x17:*********************** Log Started 2014-05-17T06:40:12Z ***********************
06:40:12:WU02:FS03:0x17:Project: 13001 (Run 154, Clone 0, Gen 12)
06:40:12:WU02:FS03:0x17:Unit: 0x0000001b538b3db753287b46cbdbc7bd
06:40:12:WU02:FS03:0x17:CPU: 0x00000000000000000000000000000000
06:40:12:WU02:FS03:0x17:Machine: 3
06:40:12:WU02:FS03:0x17:Reading tar file state.xml
06:40:13:WU01:FS03:Upload 4.38%
06:40:13:WU02:FS03:0x17:Reading tar file system.xml
06:40:13:WU02:FS03:0x17:Reading tar file integrator.xml
06:40:13:WU02:FS03:0x17:Reading tar file core.xml
06:40:13:WU02:FS03:0x17:Digital signatures verified
06:40:13:WU02:FS03:0x17:Folding@home GPU core17
06:40:13:WU02:FS03:0x17:Version 0.0.52
06:40:19:WU01:FS03:Upload 8.77%
06:40:25:WU01:FS03:Upload 13.64%
06:40:31:WU01:FS03:Upload 18.02%
06:40:37:WU01:FS03:Upload 22.40%
06:40:43:WU01:FS03:Upload 27.27%
06:40:49:WU01:FS03:Upload 31.66%
06:40:55:WU01:FS03:Upload 36.04%
06:41:01:WU01:FS03:Upload 40.42%
06:41:07:WU01:FS03:Upload 45.29%
06:41:13:WU01:FS03:Upload 49.68%
06:41:19:WU01:FS03:Upload 54.06%
06:41:25:WU01:FS03:Upload 58.93%
06:41:31:WU01:FS03:Upload 63.32%
06:41:37:WU01:FS03:Upload 67.70%
06:41:43:WU01:FS03:Upload 72.08%
06:41:49:WU01:FS03:Upload 76.95%
06:41:55:WU01:FS03:Upload 81.34%
06:42:01:WU01:FS03:Upload 85.72%
06:42:07:WU01:FS03:Upload 90.59%
06:42:13:WU01:FS03:Upload 94.97%
06:42:19:WU01:FS03:Upload 99.36%
06:42:30:WU01:FS03:Upload complete
06:42:30:WU01:FS03:Server responded WORK_ACK (400)
06:42:30:WU01:FS03:Final credit estimate, 70007.00 points
06:42:30:WU01:FS03:Cleaning up
06:42:58:WU02:FS03:0x17:Completed 0 out of 5000000 steps (0%)
06:42:58:WU02:FS03:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
06:50:50:WU02:FS03:0x17:Completed 50000 out of 5000000 steps (1%)
06:58:27:WU02:FS03:0x17:Completed 100000 out of 5000000 steps (2%)
07:06:22:WU02:FS03:0x17:Completed 150000 out of 5000000 steps (3%)
07:13:59:WU02:FS03:0x17:Completed 200000 out of 5000000 steps (4%)
07:21:37:WU02:FS03:0x17:Completed 250000 out of 5000000 steps (5%)
07:29:30:WU02:FS03:0x17:Completed 300000 out of 5000000 steps (6%)

Thank you!

P5-133XL · Post by **P5-133XL** » Sat May 17, 2014 8:20 am

Does your Windows event logs list any recent video driver failures?

TheUniporn · Post by **TheUniporn** » Sat May 17, 2014 8:30 am

Yes, thank you!!! I thought that a video driver crash creates a notification bubble that you can only dismiss with a click and it doesn't go away on its own after 5s. I will try reinstalling the drivers and take it from there.

P5-133XL · Post by **P5-133XL** » Sat May 17, 2014 9:04 am

There are numerous potential causes of video driver crashes. The least likely is an actual failure of the driver. Most of the time it will because a video card got too hot; excessive OC'ing; not enough power to run everything simultanously or an overloaded rail; Ran folding with some other GPU intensive operation like Youtube, a game, or even a GPU accelerated web browser.

Since, multiple cards were affected at the same time I'd guess power problems.

TheUniporn · Post by **TheUniporn** » Sat May 17, 2014 10:13 am

I had to go out for a bit, now I'm back and I'm trying to fix this (all I had time to do was to restore factory voltages, that I forgot about, but it still crashed). The cards were not getting too hot, have no OC (I will also try to reduce the default clocks) and they have plenty of power (2x850W PSUs, all the cards have powered risers and no overloaded rails). On my desktop (1*280x) when I run F@H with games I get a crash but in rest it's rock solid so I just assume that unless I mix the two I shouldn't have any problems.
After restoring the factory voltages and leaving it run for two hours I see that there are no more problems with the two WU, and the rig now uses 3 cards out of four.
I noticed the occasional drivers cash on two other systems ,that have 3-4 cards with older drivers and dual core 3.2GHz CPUs. I will also modify all their voltages and see if they become more stable.
Thank you for your time and help!

Post by **bruce** » Sat May 17, 2014 7:22 pm

I don't know if you remember the early days of operating systems, but the term "cooperative multiprocessing" is a term describing those days. Also RAM allocation (including reorganizing allocations to utilize holes left during deallocation) and programs that were responsible for their own overlays led to some real challenges. Operating systems now manage all those things quite well.

Welcome to the world of GPUs, which have no real OS, so all of those things need to be managed by you or by the programmer.

Running multiple applications that happen to submit work to the same GPU can do funny things to VRAM allocations and each app can hog the processor.

TheUniporn · Post by **TheUniporn** » Mon May 19, 2014 7:58 am

Sorry bruce, but my hardware history doesn't go that far into the past, thank you for the short lesson.

Back to the rig at hand, I get a driver crash every time windows (7 64bit) boots. Now 3 GPUs work, but the 4th one is idle most of the time. No clue what I should do about it... Web control shows that three cards have great PPD but it's very low for the 4th (GPU 1).

Code: Select all

*********************** Log Started 2014-05-18T15:54:31Z ***********************
15:54:31:************************* Folding@home Client *************************
15:54:31:      Website: http://folding.stanford.edu/
15:54:31:    Copyright: (c) 2009-2014 Stanford University
15:54:31:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:54:31:         Args: 
15:54:31:       Config: C:/Users/W3/AppData/Roaming/FAHClient/config.xml
15:54:31:******************************** Build ********************************
15:54:31:      Version: 7.4.4
15:54:31:         Date: Mar 4 2014
15:54:31:         Time: 20:26:54
15:54:31:      SVN Rev: 4130
15:54:31:       Branch: fah/trunk/client
15:54:31:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
15:54:31:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
15:54:31:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
15:54:31:     Platform: win32 XP
15:54:31:         Bits: 32
15:54:31:         Mode: Release
15:54:31:******************************* System ********************************
15:54:31:          CPU: AMD A8-6600K APU with Radeon(tm) HD Graphics
15:54:31:       CPU ID: AuthenticAMD Family 21 Model 19 Stepping 1
15:54:31:         CPUs: 4
15:54:31:       Memory: 3.95GiB
15:54:31:  Free Memory: 3.32GiB
15:54:31:      Threads: WINDOWS_THREADS
15:54:31:   OS Version: 6.1
15:54:31:  Has Battery: false
15:54:31:   On Battery: false
15:54:31:   UTC Offset: 3
15:54:31:          PID: 2320
15:54:31:          CWD: C:/Users/W3/AppData/Roaming/FAHClient
15:54:31:           OS: Windows 7 Ultimate
15:54:31:      OS Arch: AMD64
15:54:31:         GPUs: 4
15:54:31:        GPU 0: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
15:54:31:        GPU 1: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
15:54:31:        GPU 2: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
15:54:31:        GPU 3: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
15:54:31:         CUDA: Not detected
15:54:31:Win32 Service: false
15:54:31:***********************************************************************
15:54:31:<config>
15:54:31:  <!-- Network -->
15:54:31:  <proxy v=':8080'/>
15:54:31:
15:54:31:  <!-- Slot Control -->
15:54:31:  <power v='full'/>
15:54:31:
15:54:31:  <!-- User Information -->
15:54:31:  <passkey v='********************************'/>
15:54:31:  <team v='224497'/>
15:54:31:  <user v='TheUniporn'/>
15:54:31:
15:54:31:  <!-- Folding Slots -->
15:54:31:  <slot id='1' type='GPU'/>
15:54:31:  <slot id='2' type='GPU'/>
15:54:31:  <slot id='3' type='GPU'/>
15:54:31:  <slot id='4' type='GPU'/>
15:54:31:</config>
15:54:31:Trying to access database...
15:54:31:Successfully acquired database lock
15:54:31:Enabled folding slot 01: READY gpu:0:Tahiti XT [Radeon R9 200/HD 7900/8970]
15:54:31:Enabled folding slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970]
15:54:31:Enabled folding slot 03: READY gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970]
15:54:31:Enabled folding slot 04: READY gpu:3:Tahiti XT [Radeon R9 200/HD 7900/8970]
15:54:31:WU00:FS03:Starting
15:54:31:WU00:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 2 -gpu-vendor ati
15:54:31:WU00:FS03:Started FahCore on PID 2976
15:54:31:WU00:FS03:Core PID:3036
15:54:31:WU00:FS03:FahCore 0x17 started
15:54:31:WU02:FS01:Starting
15:54:31:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 0 -gpu-vendor ati
15:54:31:WU02:FS01:Started FahCore on PID 3048
15:54:31:WU02:FS01:Core PID:3060
15:54:31:WU02:FS01:FahCore 0x17 started
15:54:31:WU03:FS04:Starting
15:54:31:WU03:FS04:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 3 -gpu-vendor ati
15:54:31:WU03:FS04:Started FahCore on PID 3068
15:54:31:WU03:FS04:Core PID:2228
15:54:31:WU03:FS04:FahCore 0x17 started
15:54:31:WU04:FS02:Starting
15:54:31:WU04:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 1 -gpu-vendor ati
15:54:31:WU04:FS02:Started FahCore on PID 2236
15:54:31:WU04:FS02:Core PID:2260
15:54:31:WU04:FS02:FahCore 0x17 started
15:54:32:WU04:FS02:0x17:*********************** Log Started 2014-05-18T15:54:31Z ***********************
15:54:32:WU04:FS02:0x17:Project: 13001 (Run 50, Clone 1, Gen 8)
15:54:32:WU04:FS02:0x17:Unit: 0x00000018538b3db753285ddfe4a9cd22
15:54:32:WU04:FS02:0x17:CPU: 0x00000000000000000000000000000000
15:54:32:WU04:FS02:0x17:Machine: 2
15:54:32:WU04:FS02:0x17:Digital signatures verified
15:54:32:WU04:FS02:0x17:Folding@home GPU core17
15:54:32:WU04:FS02:0x17:Version 0.0.52
15:54:32:WU00:FS03:0x17:*********************** Log Started 2014-05-18T15:54:31Z ***********************
15:54:32:WU00:FS03:0x17:Project: 13001 (Run 16, Clone 5, Gen 21)
15:54:32:WU00:FS03:0x17:Unit: 0x0000003b538b3db753285466d69f3677
15:54:32:WU00:FS03:0x17:CPU: 0x00000000000000000000000000000000
15:54:32:WU00:FS03:0x17:Machine: 3
15:54:32:WU00:FS03:0x17:Digital signatures verified
15:54:32:WU00:FS03:0x17:Folding@home GPU core17
15:54:32:WU00:FS03:0x17:Version 0.0.52
15:54:32:WU02:FS01:0x17:*********************** Log Started 2014-05-18T15:54:31Z ***********************
15:54:32:WU02:FS01:0x17:Project: 13000 (Run 1688, Clone 0, Gen 4)
15:54:32:WU02:FS01:0x17:Unit: 0x0000000f538b3db7531178eba684f4e3
15:54:32:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
15:54:32:WU02:FS01:0x17:Machine: 1
15:54:32:WU02:FS01:0x17:Digital signatures verified
15:54:32:WU02:FS01:0x17:Folding@home GPU core17
15:54:32:WU02:FS01:0x17:Version 0.0.52
15:54:32:WU03:FS04:0x17:*********************** Log Started 2014-05-18T15:54:31Z ***********************
15:54:32:WU03:FS04:0x17:Project: 13000 (Run 977, Clone 0, Gen 25)
15:54:32:WU03:FS04:0x17:Unit: 0x0000003b538b3db75310af89687dea90
15:54:32:WU03:FS04:0x17:CPU: 0x00000000000000000000000000000000
15:54:32:WU03:FS04:0x17:Machine: 4
15:54:32:WU03:FS04:0x17:Digital signatures verified
15:54:32:WU03:FS04:0x17:Folding@home GPU core17
15:54:32:WU03:FS04:0x17:Version 0.0.52
15:54:34:WU00:FS03:0x17:  Found a checkpoint file
15:54:34:WU03:FS04:0x17:  Found a checkpoint file
15:54:34:WU02:FS01:0x17:  Found a checkpoint file
15:54:34:WU04:FS02:0x17:  Found a checkpoint file
15:58:58:WU02:FS01:0x17:Completed 1375000 out of 5000000 steps (27%)
15:58:58:WU02:FS01:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:59:05:WU04:FS02:0x17:Completed 375000 out of 5000000 steps (7%)
15:59:05:WU04:FS02:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:59:06:WU03:FS04:0x17:Completed 1375000 out of 5000000 steps (27%)
15:59:06:WU03:FS04:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:59:16:WU00:FS03:0x17:Completed 1000000 out of 5000000 steps (20%)
15:59:16:WU00:FS03:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
16:03:04:WU02:FS01:0x17:Completed 1400000 out of 5000000 steps (28%)
16:03:12:WU03:FS04:0x17:Completed 1400000 out of 5000000 steps (28%)
16:07:10:WU00:FS03:0x17:Completed 1050000 out of 5000000 steps (21%)
16:10:42:WU02:FS01:0x17:Completed 1450000 out of 5000000 steps (29%)
16:10:50:WU03:FS04:0x17:Completed 1450000 out of 5000000 steps (29%)
16:14:48:WU00:FS03:0x17:Completed 1100000 out of 5000000 steps (22%)
16:18:20:WU02:FS01:0x17:Completed 1500000 out of 5000000 steps (30%)
16:18:27:WU03:FS04:0x17:Completed 1500000 out of 5000000 steps (30%)
16:22:44:WU00:FS03:0x17:Completed 1150000 out of 5000000 steps (23%)
16:26:15:WU02:FS01:0x17:Completed 1550000 out of 5000000 steps (31%)
16:26:22:WU03:FS04:0x17:Completed 1550000 out of 5000000 steps (31%)
16:30:22:WU00:FS03:0x17:Completed 1200000 out of 5000000 steps (24%)
16:33:53:WU02:FS01:0x17:Completed 1600000 out of 5000000 steps (32%)
16:34:00:WU03:FS04:0x17:Completed 1600000 out of 5000000 steps (32%)
16:38:01:WU00:FS03:0x17:Completed 1250000 out of 5000000 steps (25%)
16:41:48:WU02:FS01:0x17:Completed 1650000 out of 5000000 steps (33%)
16:41:56:WU03:FS04:0x17:Completed 1650000 out of 5000000 steps (33%)
16:45:57:WU00:FS03:0x17:Completed 1300000 out of 5000000 steps (26%)
16:49:27:WU02:FS01:0x17:Completed 1700000 out of 5000000 steps (34%)
16:49:33:WU03:FS04:0x17:Completed 1700000 out of 5000000 steps (34%)
16:53:36:WU00:FS03:0x17:Completed 1350000 out of 5000000 steps (27%)
16:57:05:WU02:FS01:0x17:Completed 1750000 out of 5000000 steps (35%)
16:57:12:WU03:FS04:0x17:Completed 1750000 out of 5000000 steps (35%)
17:01:31:WU00:FS03:0x17:Completed 1400000 out of 5000000 steps (28%)
17:05:00:WU02:FS01:0x17:Completed 1800000 out of 5000000 steps (36%)
17:05:06:WU03:FS04:0x17:Completed 1800000 out of 5000000 steps (36%)
17:09:09:WU00:FS03:0x17:Completed 1450000 out of 5000000 steps (29%)
17:12:38:WU02:FS01:0x17:Completed 1850000 out of 5000000 steps (37%)
17:12:44:WU03:FS04:0x17:Completed 1850000 out of 5000000 steps (37%)
17:16:47:WU00:FS03:0x17:Completed 1500000 out of 5000000 steps (30%)
17:20:32:WU02:FS01:0x17:Completed 1900000 out of 5000000 steps (38%)
17:20:38:WU03:FS04:0x17:Completed 1900000 out of 5000000 steps (38%)
17:24:42:WU00:FS03:0x17:Completed 1550000 out of 5000000 steps (31%)
17:28:10:WU02:FS01:0x17:Completed 1950000 out of 5000000 steps (39%)
17:28:15:WU03:FS04:0x17:Completed 1950000 out of 5000000 steps (39%)
17:32:19:14:127.0.0.1:New Web connection
17:32:20:WU00:FS03:0x17:Completed 1600000 out of 5000000 steps (32%)
17:35:48:WU02:FS01:0x17:Completed 2000000 out of 5000000 steps (40%)
17:35:53:WU03:FS04:0x17:Completed 2000000 out of 5000000 steps (40%)
17:40:15:WU00:FS03:0x17:Completed 1650000 out of 5000000 steps (33%)
17:43:44:WU02:FS01:0x17:Completed 2050000 out of 5000000 steps (41%)
17:43:48:WU03:FS04:0x17:Completed 2050000 out of 5000000 steps (41%)
17:47:54:WU00:FS03:0x17:Completed 1700000 out of 5000000 steps (34%)
17:51:23:WU02:FS01:0x17:Completed 2100000 out of 5000000 steps (42%)
17:51:26:WU03:FS04:0x17:Completed 2100000 out of 5000000 steps (42%)
17:55:32:WU00:FS03:0x17:Completed 1750000 out of 5000000 steps (35%)
17:59:19:WU02:FS01:0x17:Completed 2150000 out of 5000000 steps (43%)
17:59:22:WU03:FS04:0x17:Completed 2150000 out of 5000000 steps (43%)
18:03:28:WU00:FS03:0x17:Completed 1800000 out of 5000000 steps (36%)
18:06:57:WU02:FS01:0x17:Completed 2200000 out of 5000000 steps (44%)
18:07:00:WU03:FS04:0x17:Completed 2200000 out of 5000000 steps (44%)
18:11:07:WU00:FS03:0x17:Completed 1850000 out of 5000000 steps (37%)
18:14:35:WU02:FS01:0x17:Completed 2250000 out of 5000000 steps (45%)
18:14:39:WU03:FS04:0x17:Completed 2250000 out of 5000000 steps (45%)
18:19:02:WU00:FS03:0x17:Completed 1900000 out of 5000000 steps (38%)
18:22:31:WU02:FS01:0x17:Completed 2300000 out of 5000000 steps (46%)
18:22:34:WU03:FS04:0x17:Completed 2300000 out of 5000000 steps (46%)
18:26:40:WU00:FS03:0x17:Completed 1950000 out of 5000000 steps (39%)
18:30:09:WU02:FS01:0x17:Completed 2350000 out of 5000000 steps (47%)
18:30:11:WU03:FS04:0x17:Completed 2350000 out of 5000000 steps (47%)
18:34:18:WU00:FS03:0x17:Completed 2000000 out of 5000000 steps (40%)
18:38:05:WU02:FS01:0x17:Completed 2400000 out of 5000000 steps (48%)
18:38:07:WU03:FS04:0x17:Completed 2400000 out of 5000000 steps (48%)
18:42:13:WU00:FS03:0x17:Completed 2050000 out of 5000000 steps (41%)
18:45:43:WU02:FS01:0x17:Completed 2450000 out of 5000000 steps (49%)
18:45:45:WU03:FS04:0x17:Completed 2450000 out of 5000000 steps (49%)
18:49:52:WU00:FS03:0x17:Completed 2100000 out of 5000000 steps (42%)
18:53:21:WU02:FS01:0x17:Completed 2500000 out of 5000000 steps (50%)
18:53:23:WU03:FS04:0x17:Completed 2500000 out of 5000000 steps (50%)
18:57:46:WU00:FS03:0x17:Completed 2150000 out of 5000000 steps (43%)
19:01:18:WU02:FS01:0x17:Completed 2550000 out of 5000000 steps (51%)
19:01:19:WU03:FS04:0x17:Completed 2550000 out of 5000000 steps (51%)
19:05:25:WU00:FS03:0x17:Completed 2200000 out of 5000000 steps (44%)
19:08:55:40:127.0.0.1:New Web connection
19:08:56:WU03:FS04:0x17:Completed 2600000 out of 5000000 steps (52%)
19:08:56:WU02:FS01:0x17:Completed 2600000 out of 5000000 steps (52%)
19:13:04:WU00:FS03:0x17:Completed 2250000 out of 5000000 steps (45%)
19:16:53:WU03:FS04:0x17:Completed 2650000 out of 5000000 steps (53%)
19:16:54:WU02:FS01:0x17:Completed 2650000 out of 5000000 steps (53%)
19:20:59:WU00:FS03:0x17:Completed 2300000 out of 5000000 steps (46%)
19:24:31:WU03:FS04:0x17:Completed 2700000 out of 5000000 steps (54%)
19:24:33:WU02:FS01:0x17:Completed 2700000 out of 5000000 steps (54%)
19:28:38:WU00:FS03:0x17:Completed 2350000 out of 5000000 steps (47%)
19:32:09:WU03:FS04:0x17:Completed 2750000 out of 5000000 steps (55%)
19:32:11:WU02:FS01:0x17:Completed 2750000 out of 5000000 steps (55%)
19:36:33:WU00:FS03:0x17:Completed 2400000 out of 5000000 steps (48%)
19:40:04:WU03:FS04:0x17:Completed 2800000 out of 5000000 steps (56%)
19:40:06:WU02:FS01:0x17:Completed 2800000 out of 5000000 steps (56%)
19:44:11:WU00:FS03:0x17:Completed 2450000 out of 5000000 steps (49%)
19:47:41:WU03:FS04:0x17:Completed 2850000 out of 5000000 steps (57%)
19:47:44:WU02:FS01:0x17:Completed 2850000 out of 5000000 steps (57%)
19:51:49:WU00:FS03:0x17:Completed 2500000 out of 5000000 steps (50%)
19:55:35:WU03:FS04:0x17:Completed 2900000 out of 5000000 steps (58%)
19:55:39:WU02:FS01:0x17:Completed 2900000 out of 5000000 steps (58%)
19:59:44:WU00:FS03:0x17:Completed 2550000 out of 5000000 steps (51%)
20:03:13:WU03:FS04:0x17:Completed 2950000 out of 5000000 steps (59%)
20:03:18:WU02:FS01:0x17:Completed 2950000 out of 5000000 steps (59%)
20:07:23:WU00:FS03:0x17:Completed 2600000 out of 5000000 steps (52%)
20:10:50:WU03:FS04:0x17:Completed 3000000 out of 5000000 steps (60%)
20:10:55:WU02:FS01:0x17:Completed 3000000 out of 5000000 steps (60%)
20:15:18:WU00:FS03:0x17:Completed 2650000 out of 5000000 steps (53%)
20:18:45:WU03:FS04:0x17:Completed 3050000 out of 5000000 steps (61%)
20:18:51:WU02:FS01:0x17:Completed 3050000 out of 5000000 steps (61%)
20:22:57:WU00:FS03:0x17:Completed 2700000 out of 5000000 steps (54%)
20:26:23:WU03:FS04:0x17:Completed 3100000 out of 5000000 steps (62%)
20:26:29:WU02:FS01:0x17:Completed 3100000 out of 5000000 steps (62%)
20:30:36:WU00:FS03:0x17:Completed 2750000 out of 5000000 steps (55%)
20:34:18:WU03:FS04:0x17:Completed 3150000 out of 5000000 steps (63%)
20:34:24:WU02:FS01:0x17:Completed 3150000 out of 5000000 steps (63%)
20:38:31:WU00:FS03:0x17:Completed 2800000 out of 5000000 steps (56%)
20:41:57:WU03:FS04:0x17:Completed 3200000 out of 5000000 steps (64%)
20:42:03:WU02:FS01:0x17:Completed 3200000 out of 5000000 steps (64%)
20:46:10:WU00:FS03:0x17:Completed 2850000 out of 5000000 steps (57%)
20:49:35:WU03:FS04:0x17:Completed 3250000 out of 5000000 steps (65%)
20:49:41:WU02:FS01:0x17:Completed 3250000 out of 5000000 steps (65%)
20:54:05:WU00:FS03:0x17:Completed 2900000 out of 5000000 steps (58%)
20:57:28:WU03:FS04:0x17:Completed 3300000 out of 5000000 steps (66%)
20:57:36:WU02:FS01:0x17:Completed 3300000 out of 5000000 steps (66%)
21:01:43:WU00:FS03:0x17:Completed 2950000 out of 5000000 steps (59%)
21:05:05:WU03:FS04:0x17:Completed 3350000 out of 5000000 steps (67%)
21:05:14:WU02:FS01:0x17:Completed 3350000 out of 5000000 steps (67%)
21:09:21:WU00:FS03:0x17:Completed 3000000 out of 5000000 steps (60%)
21:12:59:WU03:FS04:0x17:Completed 3400000 out of 5000000 steps (68%)
21:13:09:WU02:FS01:0x17:Completed 3400000 out of 5000000 steps (68%)
21:17:16:WU00:FS03:0x17:Completed 3050000 out of 5000000 steps (61%)
21:20:37:WU03:FS04:0x17:Completed 3450000 out of 5000000 steps (69%)
21:20:47:WU02:FS01:0x17:Completed 3450000 out of 5000000 steps (69%)
21:24:54:WU00:FS03:0x17:Completed 3100000 out of 5000000 steps (62%)
21:28:14:WU03:FS04:0x17:Completed 3500000 out of 5000000 steps (70%)
21:28:25:WU02:FS01:0x17:Completed 3500000 out of 5000000 steps (70%)
21:32:49:WU00:FS03:0x17:Completed 3150000 out of 5000000 steps (63%)
21:36:08:WU03:FS04:0x17:Completed 3550000 out of 5000000 steps (71%)
21:36:20:WU02:FS01:0x17:Completed 3550000 out of 5000000 steps (71%)
21:40:28:WU00:FS03:0x17:Completed 3200000 out of 5000000 steps (64%)
21:43:46:WU03:FS04:0x17:Completed 3600000 out of 5000000 steps (72%)
21:43:58:WU02:FS01:0x17:Completed 3600000 out of 5000000 steps (72%)
21:48:06:WU00:FS03:0x17:Completed 3250000 out of 5000000 steps (65%)
21:48:37:79:127.0.0.1:New Web connection
21:51:40:WU03:FS04:0x17:Completed 3650000 out of 5000000 steps (73%)
21:51:54:WU02:FS01:0x17:Completed 3650000 out of 5000000 steps (73%)
******************************* Date: 2014-05-18 *******************************
21:56:02:WU00:FS03:0x17:Completed 3300000 out of 5000000 steps (66%)
21:59:18:WU03:FS04:0x17:Completed 3700000 out of 5000000 steps (74%)
21:59:32:WU02:FS01:0x17:Completed 3700000 out of 5000000 steps (74%)
22:03:41:WU00:FS03:0x17:Completed 3350000 out of 5000000 steps (67%)
22:06:57:WU03:FS04:0x17:Completed 3750000 out of 5000000 steps (75%)
22:07:11:WU02:FS01:0x17:Completed 3750000 out of 5000000 steps (75%)
22:11:36:WU00:FS03:0x17:Completed 3400000 out of 5000000 steps (68%)
22:14:50:WU03:FS04:0x17:Completed 3800000 out of 5000000 steps (76%)
22:15:06:WU02:FS01:0x17:Completed 3800000 out of 5000000 steps (76%)
22:19:14:WU00:FS03:0x17:Completed 3450000 out of 5000000 steps (69%)
22:22:29:WU03:FS04:0x17:Completed 3850000 out of 5000000 steps (77%)
22:22:44:WU02:FS01:0x17:Completed 3850000 out of 5000000 steps (77%)
22:26:53:WU00:FS03:0x17:Completed 3500000 out of 5000000 steps (70%)
22:30:22:WU03:FS04:0x17:Completed 3900000 out of 5000000 steps (78%)
22:30:38:WU02:FS01:0x17:Completed 3900000 out of 5000000 steps (78%)
22:34:48:WU00:FS03:0x17:Completed 3550000 out of 5000000 steps (71%)
22:38:00:WU03:FS04:0x17:Completed 3950000 out of 5000000 steps (79%)
22:38:16:WU02:FS01:0x17:Completed 3950000 out of 5000000 steps (79%)
22:42:26:WU00:FS03:0x17:Completed 3600000 out of 5000000 steps (72%)
22:45:38:WU03:FS04:0x17:Completed 4000000 out of 5000000 steps (80%)
22:45:54:WU02:FS01:0x17:Completed 4000000 out of 5000000 steps (80%)
22:50:21:WU00:FS03:0x17:Completed 3650000 out of 5000000 steps (73%)
22:53:31:WU03:FS04:0x17:Completed 4050000 out of 5000000 steps (81%)
22:53:49:WU02:FS01:0x17:Completed 4050000 out of 5000000 steps (81%)
22:58:00:WU00:FS03:0x17:Completed 3700000 out of 5000000 steps (74%)
23:01:09:WU03:FS04:0x17:Completed 4100000 out of 5000000 steps (82%)
23:01:27:WU02:FS01:0x17:Completed 4100000 out of 5000000 steps (82%)
23:05:39:WU00:FS03:0x17:Completed 3750000 out of 5000000 steps (75%)
23:09:03:WU03:FS04:0x17:Completed 4150000 out of 5000000 steps (83%)
23:09:22:WU02:FS01:0x17:Completed 4150000 out of 5000000 steps (83%)
23:13:34:WU00:FS03:0x17:Completed 3800000 out of 5000000 steps (76%)
23:16:41:WU03:FS04:0x17:Completed 4200000 out of 5000000 steps (84%)
23:17:00:WU02:FS01:0x17:Completed 4200000 out of 5000000 steps (84%)
23:21:13:WU00:FS03:0x17:Completed 3850000 out of 5000000 steps (77%)
23:24:19:WU03:FS04:0x17:Completed 4250000 out of 5000000 steps (85%)
23:24:39:WU02:FS01:0x17:Completed 4250000 out of 5000000 steps (85%)
23:29:07:WU00:FS03:0x17:Completed 3900000 out of 5000000 steps (78%)
23:32:13:WU03:FS04:0x17:Completed 4300000 out of 5000000 steps (86%)
23:32:33:WU02:FS01:0x17:Completed 4300000 out of 5000000 steps (86%)
23:36:46:WU00:FS03:0x17:Completed 3950000 out of 5000000 steps (79%)
23:39:50:WU03:FS04:0x17:Completed 4350000 out of 5000000 steps (87%)
23:40:11:WU02:FS01:0x17:Completed 4350000 out of 5000000 steps (87%)
23:44:24:WU00:FS03:0x17:Completed 4000000 out of 5000000 steps (80%)
23:47:44:WU03:FS04:0x17:Completed 4400000 out of 5000000 steps (88%)
23:48:06:WU02:FS01:0x17:Completed 4400000 out of 5000000 steps (88%)
23:52:19:WU00:FS03:0x17:Completed 4050000 out of 5000000 steps (81%)
23:55:22:WU03:FS04:0x17:Completed 4450000 out of 5000000 steps (89%)
23:55:44:WU02:FS01:0x17:Completed 4450000 out of 5000000 steps (89%)
23:59:57:WU00:FS03:0x17:Completed 4100000 out of 5000000 steps (82%)
00:03:00:WU03:FS04:0x17:Completed 4500000 out of 5000000 steps (90%)
00:03:22:WU02:FS01:0x17:Completed 4500000 out of 5000000 steps (90%)
00:07:52:WU00:FS03:0x17:Completed 4150000 out of 5000000 steps (83%)
00:10:55:WU03:FS04:0x17:Completed 4550000 out of 5000000 steps (91%)
00:11:17:WU02:FS01:0x17:Completed 4550000 out of 5000000 steps (91%)
00:15:31:WU00:FS03:0x17:Completed 4200000 out of 5000000 steps (84%)
00:18:33:WU03:FS04:0x17:Completed 4600000 out of 5000000 steps (92%)
00:18:55:WU02:FS01:0x17:Completed 4600000 out of 5000000 steps (92%)
00:23:09:WU00:FS03:0x17:Completed 4250000 out of 5000000 steps (85%)
00:26:27:WU03:FS04:0x17:Completed 4650000 out of 5000000 steps (93%)
00:26:50:WU02:FS01:0x17:Completed 4650000 out of 5000000 steps (93%)
00:31:05:WU00:FS03:0x17:Completed 4300000 out of 5000000 steps (86%)
00:34:05:WU03:FS04:0x17:Completed 4700000 out of 5000000 steps (94%)
00:34:29:WU02:FS01:0x17:Completed 4700000 out of 5000000 steps (94%)
00:38:44:WU00:FS03:0x17:Completed 4350000 out of 5000000 steps (87%)
00:41:44:WU03:FS04:0x17:Completed 4750000 out of 5000000 steps (95%)
00:42:07:WU02:FS01:0x17:Completed 4750000 out of 5000000 steps (95%)
00:46:39:WU00:FS03:0x17:Completed 4400000 out of 5000000 steps (88%)
00:49:37:WU03:FS04:0x17:Completed 4800000 out of 5000000 steps (96%)
00:50:02:WU02:FS01:0x17:Completed 4800000 out of 5000000 steps (96%)
00:54:17:WU00:FS03:0x17:Completed 4450000 out of 5000000 steps (89%)
00:57:15:WU03:FS04:0x17:Completed 4850000 out of 5000000 steps (97%)
00:57:40:WU02:FS01:0x17:Completed 4850000 out of 5000000 steps (97%)
01:01:55:WU00:FS03:0x17:Completed 4500000 out of 5000000 steps (90%)
01:05:08:WU03:FS04:0x17:Completed 4900000 out of 5000000 steps (98%)
01:05:34:WU02:FS01:0x17:Completed 4900000 out of 5000000 steps (98%)
01:09:50:WU00:FS03:0x17:Completed 4550000 out of 5000000 steps (91%)
01:12:46:WU03:FS04:0x17:Completed 4950000 out of 5000000 steps (99%)
01:13:12:WU02:FS01:0x17:Completed 4950000 out of 5000000 steps (99%)
01:17:29:WU00:FS03:0x17:Completed 4600000 out of 5000000 steps (92%)
01:20:24:WU03:FS04:0x17:Completed 5000000 out of 5000000 steps (100%)
01:20:25:WU01:FS04:Connecting to 171.67.108.201:80
01:20:26:WU01:FS04:Assigned to work server 140.163.4.231
01:20:26:WU01:FS04:Requesting new work unit for slot 04: RUNNING gpu:3:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
01:20:26:WU01:FS04:Connecting to 140.163.4.231:8080
01:20:27:WU01:FS04:Downloading 4.84MiB
01:20:29:WU01:FS04:Download complete
01:20:29:WU01:FS04:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:66 clone:0 gen:19 core:0x17 unit:0x00000028538b3db7530faeaed07ec812
01:20:40:WU03:FS04:0x17:Saving result file logfile_01.txt
01:20:40:WU03:FS04:0x17:Saving result file checkpointState.xml
01:20:42:WU03:FS04:0x17:Saving result file checkpt.crc
01:20:42:WU03:FS04:0x17:Saving result file log.txt
01:20:43:WU03:FS04:0x17:Saving result file positions.xtc
01:20:45:WU03:FS04:0x17:Folding@home Core Shutdown: FINISHED_UNIT
01:20:45:WU03:FS04:FahCore returned: FINISHED_UNIT (100 = 0x64)
01:20:45:WU03:FS04:Sending unit results: id:03 state:SEND error:NO_ERROR project:13000 run:977 clone:0 gen:25 core:0x17 unit:0x0000003b538b3db75310af89687dea90
01:20:45:WU03:FS04:Uploading 12.83MiB to 140.163.4.231
01:20:45:WU03:FS04:Connecting to 140.163.4.231:8080
01:20:45:WU01:FS04:Starting
01:20:45:WU01:FS04:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 3 -gpu-vendor ati
01:20:45:WU01:FS04:Started FahCore on PID 1808
01:20:45:WU01:FS04:Core PID:2900
01:20:45:WU01:FS04:FahCore 0x17 started
01:20:46:WU01:FS04:0x17:*********************** Log Started 2014-05-19T01:20:46Z ***********************
01:20:46:WU01:FS04:0x17:Project: 13000 (Run 66, Clone 0, Gen 19)
01:20:46:WU01:FS04:0x17:Unit: 0x00000028538b3db7530faeaed07ec812
01:20:46:WU01:FS04:0x17:CPU: 0x00000000000000000000000000000000
01:20:46:WU01:FS04:0x17:Machine: 4
01:20:46:WU01:FS04:0x17:Reading tar file state.xml
01:20:46:WU01:FS04:0x17:Reading tar file system.xml
01:20:47:WU01:FS04:0x17:Reading tar file integrator.xml
01:20:47:WU01:FS04:0x17:Reading tar file core.xml
01:20:47:WU01:FS04:0x17:Digital signatures verified
01:20:47:WU01:FS04:0x17:Folding@home GPU core17
01:20:47:WU01:FS04:0x17:Version 0.0.52
01:20:50:WU02:FS01:0x17:Completed 5000000 out of 5000000 steps (100%)
01:20:51:WU03:FS04:Upload 3.41%
01:20:51:WU05:FS01:Connecting to 171.67.108.201:80
01:20:52:WU05:FS01:Assigned to work server 140.163.4.231
01:20:52:WU05:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
01:20:52:WU05:FS01:Connecting to 140.163.4.231:8080
01:20:52:WU05:FS01:Downloading 4.83MiB
01:20:55:WU05:FS01:Download complete
01:20:55:WU05:FS01:Received Unit: id:05 state:DOWNLOAD error:NO_ERROR project:13000 run:261 clone:0 gen:19 core:0x17 unit:0x0000001c538b3db7530fe57fbd7af085
01:20:57:WU03:FS04:Upload 7.79%
01:21:03:WU03:FS04:Upload 12.18%
01:21:07:WU02:FS01:0x17:Saving result file logfile_01.txt
01:21:07:WU02:FS01:0x17:Saving result file checkpointState.xml
01:21:09:WU03:FS04:Upload 16.07%
01:21:09:WU02:FS01:0x17:Saving result file checkpt.crc
01:21:09:WU02:FS01:0x17:Saving result file log.txt
01:21:10:WU02:FS01:0x17:Saving result file positions.xtc
01:21:12:WU02:FS01:0x17:Folding@home Core Shutdown: FINISHED_UNIT
01:21:13:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
01:21:13:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:13000 run:1688 clone:0 gen:4 core:0x17 unit:0x0000000f538b3db7531178eba684f4e3
01:21:13:WU02:FS01:Uploading 12.83MiB to 140.163.4.231
01:21:13:WU02:FS01:Connecting to 140.163.4.231:8080
01:21:13:WU05:FS01:Starting
01:21:13:WU05:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 05 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 0 -gpu-vendor ati
01:21:13:WU05:FS01:Started FahCore on PID 3452
01:21:13:WU05:FS01:Core PID:3484
01:21:13:WU05:FS01:FahCore 0x17 started
01:21:13:WU05:FS01:0x17:*********************** Log Started 2014-05-19T01:21:13Z ***********************
01:21:13:WU05:FS01:0x17:Project: 13000 (Run 261, Clone 0, Gen 19)
01:21:13:WU05:FS01:0x17:Unit: 0x0000001c538b3db7530fe57fbd7af085
01:21:13:WU05:FS01:0x17:CPU: 0x00000000000000000000000000000000
01:21:13:WU05:FS01:0x17:Machine: 1
01:21:13:WU05:FS01:0x17:Reading tar file state.xml
01:21:14:WU05:FS01:0x17:Reading tar file system.xml
01:21:14:WU05:FS01:0x17:Reading tar file integrator.xml
01:21:14:WU05:FS01:0x17:Reading tar file core.xml
01:21:14:WU05:FS01:0x17:Digital signatures verified
01:21:14:WU05:FS01:0x17:Folding@home GPU core17
01:21:14:WU05:FS01:0x17:Version 0.0.52
01:21:15:WU03:FS04:Upload 20.46%
01:21:19:WU02:FS01:Upload 3.90%
01:21:21:WU03:FS04:Upload 24.36%
01:21:25:WU02:FS01:Upload 8.28%
01:21:27:WU03:FS04:Upload 28.74%
01:21:31:WU02:FS01:Upload 12.67%
01:21:33:WU03:FS04:Upload 33.12%
01:21:37:WU02:FS01:Upload 16.57%
01:21:39:WU03:FS04:Upload 37.02%
01:21:43:WU02:FS01:Upload 20.95%
01:21:45:WU03:FS04:Upload 41.41%
01:21:49:WU02:FS01:Upload 24.85%
01:21:51:WU03:FS04:Upload 45.79%
01:21:55:WU02:FS01:Upload 29.24%
01:21:57:WU03:FS04:Upload 49.69%
01:22:01:WU02:FS01:Upload 33.62%
01:22:03:WU03:FS04:Upload 54.07%
01:22:07:WU02:FS01:Upload 37.52%
01:22:09:WU03:FS04:Upload 58.45%
01:22:13:WU02:FS01:Upload 41.91%
01:22:15:WU03:FS04:Upload 62.35%
01:22:19:WU02:FS01:Upload 45.80%
01:22:21:WU03:FS04:Upload 66.74%
01:22:25:WU02:FS01:Upload 50.19%
01:22:27:WU03:FS04:Upload 71.12%
01:22:31:WU02:FS01:Upload 54.57%
01:22:33:WU03:FS04:Upload 75.02%
01:22:37:WU02:FS01:Upload 58.47%
01:22:39:WU03:FS04:Upload 79.40%
01:22:43:WU02:FS01:Upload 62.86%
01:22:45:WU03:FS04:Upload 83.78%
01:22:49:WU02:FS01:Upload 67.24%
01:22:51:WU03:FS04:Upload 87.68%
01:22:55:WU02:FS01:Upload 71.14%
01:22:57:WU03:FS04:Upload 92.07%
01:23:01:WU02:FS01:Upload 75.53%
01:23:03:WU03:FS04:Upload 96.45%
01:23:07:WU02:FS01:Upload 79.42%
01:23:13:WU02:FS01:Upload 83.81%
01:23:18:WU03:FS04:Upload complete
01:23:19:WU03:FS04:Server responded WORK_ACK (400)
01:23:19:WU03:FS04:Final credit estimate, 70140.00 points
01:23:19:WU03:FS04:Cleaning up
01:23:19:WU02:FS01:Upload 87.22%
01:23:25:WU02:FS01:Upload 91.61%
01:23:31:WU02:FS01:Upload 95.50%
01:23:37:WU02:FS01:Upload 99.89%
01:23:47:WU02:FS01:Upload complete
01:23:47:WU02:FS01:Server responded WORK_ACK (400)
01:23:47:WU02:FS01:Final credit estimate, 70065.00 points
01:23:47:WU02:FS01:Cleaning up
01:23:58:WU01:FS04:0x17:Completed 0 out of 5000000 steps (0%)
01:23:58:WU01:FS04:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:24:21:WU05:FS01:0x17:Completed 0 out of 5000000 steps (0%)
01:24:21:WU05:FS01:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:25:24:WU00:FS03:0x17:Completed 4650000 out of 5000000 steps (93%)
01:31:50:WU01:FS04:0x17:Completed 50000 out of 5000000 steps (1%)
01:32:13:WU05:FS01:0x17:Completed 50000 out of 5000000 steps (1%)
01:33:03:WU00:FS03:0x17:Completed 4700000 out of 5000000 steps (94%)
01:39:28:WU01:FS04:0x17:Completed 100000 out of 5000000 steps (2%)
01:39:51:WU05:FS01:0x17:Completed 100000 out of 5000000 steps (2%)
01:40:43:WU00:FS03:0x17:Completed 4750000 out of 5000000 steps (95%)
01:47:22:WU01:FS04:0x17:Completed 150000 out of 5000000 steps (3%)
01:47:44:WU05:FS01:0x17:Completed 150000 out of 5000000 steps (3%)
01:48:39:WU00:FS03:0x17:Completed 4800000 out of 5000000 steps (96%)
01:54:59:WU01:FS04:0x17:Completed 200000 out of 5000000 steps (4%)
01:55:23:WU05:FS01:0x17:Completed 200000 out of 5000000 steps (4%)
01:56:18:WU00:FS03:0x17:Completed 4850000 out of 5000000 steps (97%)
02:02:37:WU01:FS04:0x17:Completed 250000 out of 5000000 steps (5%)
02:03:01:WU05:FS01:0x17:Completed 250000 out of 5000000 steps (5%)
02:04:13:WU00:FS03:0x17:Completed 4900000 out of 5000000 steps (98%)
02:10:31:WU01:FS04:0x17:Completed 300000 out of 5000000 steps (6%)
02:10:55:WU05:FS01:0x17:Completed 300000 out of 5000000 steps (6%)
02:11:51:WU00:FS03:0x17:Completed 4950000 out of 5000000 steps (99%)
02:18:08:WU01:FS04:0x17:Completed 350000 out of 5000000 steps (7%)
02:18:33:WU05:FS01:0x17:Completed 350000 out of 5000000 steps (7%)
02:19:30:WU00:FS03:0x17:Completed 5000000 out of 5000000 steps (100%)
02:19:30:WU02:FS03:Connecting to 171.67.108.201:80
02:19:31:WU02:FS03:Assigned to work server 140.163.4.231
02:19:31:WU02:FS03:Requesting new work unit for slot 03: RUNNING gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
02:19:31:WU02:FS03:Connecting to 140.163.4.231:8080
02:19:31:WU02:FS03:Downloading 4.84MiB
02:19:33:WU02:FS03:Download complete
02:19:34:WU02:FS03:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13000 run:1902 clone:0 gen:20 core:0x17 unit:0x0000002c538b3db75311b5967d989fe1
02:19:46:WU00:FS03:0x17:Saving result file logfile_01.txt
02:19:46:WU00:FS03:0x17:Saving result file checkpointState.xml
02:19:48:WU00:FS03:0x17:Saving result file checkpt.crc
02:19:48:WU00:FS03:0x17:Saving result file log.txt
02:19:48:WU00:FS03:0x17:Saving result file positions.xtc
02:19:51:WU00:FS03:0x17:Folding@home Core Shutdown: FINISHED_UNIT
02:19:51:WU00:FS03:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:19:51:WU00:FS03:Sending unit results: id:00 state:SEND error:NO_ERROR project:13001 run:16 clone:5 gen:21 core:0x17 unit:0x0000003b538b3db753285466d69f3677
02:19:51:WU00:FS03:Uploading 12.83MiB to 140.163.4.231
02:19:51:WU00:FS03:Connecting to 140.163.4.231:8080
02:19:51:WU02:FS03:Starting
02:19:51:WU02:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 2320 -checkpoint 15 -gpu 2 -gpu-vendor ati
02:19:51:WU02:FS03:Started FahCore on PID 2864
02:19:51:WU02:FS03:Core PID:2176
02:19:51:WU02:FS03:FahCore 0x17 started
02:19:52:WU02:FS03:0x17:*********************** Log Started 2014-05-19T02:19:51Z ***********************
02:19:52:WU02:FS03:0x17:Project: 13000 (Run 1902, Clone 0, Gen 20)
02:19:52:WU02:FS03:0x17:Unit: 0x0000002c538b3db75311b5967d989fe1
02:19:52:WU02:FS03:0x17:CPU: 0x00000000000000000000000000000000
02:19:52:WU02:FS03:0x17:Machine: 3
02:19:52:WU02:FS03:0x17:Reading tar file state.xml
02:19:52:WU02:FS03:0x17:Reading tar file system.xml
02:19:53:WU02:FS03:0x17:Reading tar file integrator.xml
02:19:53:WU02:FS03:0x17:Reading tar file core.xml
02:19:53:WU02:FS03:0x17:Digital signatures verified
02:19:53:WU02:FS03:0x17:Folding@home GPU core17
02:19:53:WU02:FS03:0x17:Version 0.0.52
02:19:57:WU00:FS03:Upload 3.90%
02:20:03:WU00:FS03:Upload 7.79%
02:20:09:WU00:FS03:Upload 12.18%
02:20:15:WU00:FS03:Upload 16.56%
02:20:21:WU00:FS03:Upload 20.46%
02:20:27:WU00:FS03:Upload 24.85%
02:20:33:WU00:FS03:Upload 29.23%
02:20:39:WU00:FS03:Upload 33.13%
02:20:45:WU00:FS03:Upload 37.51%
02:20:51:WU00:FS03:Upload 41.90%
02:20:57:WU00:FS03:Upload 45.80%
02:21:03:WU00:FS03:Upload 50.18%
02:21:09:WU00:FS03:Upload 54.56%
02:21:15:WU00:FS03:Upload 58.46%
02:21:21:WU00:FS03:Upload 62.85%
02:21:27:WU00:FS03:Upload 66.74%
02:21:33:WU00:FS03:Upload 71.13%
02:21:39:WU00:FS03:Upload 75.51%
02:21:45:WU00:FS03:Upload 79.41%
02:21:51:WU00:FS03:Upload 83.80%
02:21:57:WU00:FS03:Upload 88.18%
02:22:03:WU00:FS03:Upload 92.08%
02:22:09:WU00:FS03:Upload 96.46%
02:22:24:WU00:FS03:Upload complete
02:22:24:WU00:FS03:Server responded WORK_ACK (400)
02:22:24:WU00:FS03:Final credit estimate, 50034.00 points
02:22:24:WU00:FS03:Cleaning up
02:22:53:WU02:FS03:0x17:Completed 0 out of 5000000 steps (0%)
02:22:53:WU02:FS03:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
02:26:03:WU01:FS04:0x17:Completed 400000 out of 5000000 steps (8%)
02:26:28:WU05:FS01:0x17:Completed 400000 out of 5000000 steps (8%)
02:30:46:WU02:FS03:0x17:Completed 50000 out of 5000000 steps (1%)
02:33:41:WU01:FS04:0x17:Completed 450000 out of 5000000 steps (9%)
02:34:06:WU05:FS01:0x17:Completed 450000 out of 5000000 steps (9%)
02:38:25:WU02:FS03:0x17:Completed 100000 out of 5000000 steps (2%)
02:41:18:WU01:FS04:0x17:Completed 500000 out of 5000000 steps (10%)
02:41:44:WU05:FS01:0x17:Completed 500000 out of 5000000 steps (10%)
02:46:20:WU02:FS03:0x17:Completed 150000 out of 5000000 steps (3%)
02:49:11:WU01:FS04:0x17:Completed 550000 out of 5000000 steps (11%)
02:49:38:WU05:FS01:0x17:Completed 550000 out of 5000000 steps (11%)
02:54:00:WU02:FS03:0x17:Completed 200000 out of 5000000 steps (4%)
02:56:48:WU01:FS04:0x17:Completed 600000 out of 5000000 steps (12%)
02:57:15:WU05:FS01:0x17:Completed 600000 out of 5000000 steps (12%)
03:01:39:WU02:FS03:0x17:Completed 250000 out of 5000000 steps (5%)
03:04:42:WU01:FS04:0x17:Completed 650000 out of 5000000 steps (13%)
03:05:09:WU05:FS01:0x17:Completed 650000 out of 5000000 steps (13%)
03:09:35:WU02:FS03:0x17:Completed 300000 out of 5000000 steps (6%)
03:12:20:WU01:FS04:0x17:Completed 700000 out of 5000000 steps (14%)
03:12:47:WU05:FS01:0x17:Completed 700000 out of 5000000 steps (14%)
03:17:14:WU02:FS03:0x17:Completed 350000 out of 5000000 steps (7%)
03:19:58:WU01:FS04:0x17:Completed 750000 out of 5000000 steps (15%)
03:20:25:WU05:FS01:0x17:Completed 750000 out of 5000000 steps (15%)
03:25:09:WU02:FS03:0x17:Completed 400000 out of 5000000 steps (8%)
03:27:52:WU01:FS04:0x17:Completed 800000 out of 5000000 steps (16%)
03:28:19:WU05:FS01:0x17:Completed 800000 out of 5000000 steps (16%)
03:32:49:WU02:FS03:0x17:Completed 450000 out of 5000000 steps (9%)
03:35:29:WU01:FS04:0x17:Completed 850000 out of 5000000 steps (17%)
03:35:57:WU05:FS01:0x17:Completed 850000 out of 5000000 steps (17%)
03:40:28:WU02:FS03:0x17:Completed 500000 out of 5000000 steps (10%)
03:43:23:WU01:FS04:0x17:Completed 900000 out of 5000000 steps (18%)
03:43:51:WU05:FS01:0x17:Completed 900000 out of 5000000 steps (18%)
03:48:23:WU02:FS03:0x17:Completed 550000 out of 5000000 steps (11%)
03:51:01:WU01:FS04:0x17:Completed 950000 out of 5000000 steps (19%)
03:51:29:WU05:FS01:0x17:Completed 950000 out of 5000000 steps (19%)
******************************* Date: 2014-05-19 *******************************
03:56:02:WU02:FS03:0x17:Completed 600000 out of 5000000 steps (12%)
03:58:38:WU01:FS04:0x17:Completed 1000000 out of 5000000 steps (20%)
03:59:07:WU05:FS01:0x17:Completed 1000000 out of 5000000 steps (20%)
04:03:57:WU02:FS03:0x17:Completed 650000 out of 5000000 steps (13%)
04:06:31:WU01:FS04:0x17:Completed 1050000 out of 5000000 steps (21%)
04:07:01:WU05:FS01:0x17:Completed 1050000 out of 5000000 steps (21%)
04:11:37:WU02:FS03:0x17:Completed 700000 out of 5000000 steps (14%)
04:14:09:WU01:FS04:0x17:Completed 1100000 out of 5000000 steps (22%)
04:14:39:WU05:FS01:0x17:Completed 1100000 out of 5000000 steps (22%)
04:19:16:WU02:FS03:0x17:Completed 750000 out of 5000000 steps (15%)
04:22:03:WU01:FS04:0x17:Completed 1150000 out of 5000000 steps (23%)
04:22:33:WU05:FS01:0x17:Completed 1150000 out of 5000000 steps (23%)
04:27:12:WU02:FS03:0x17:Completed 800000 out of 5000000 steps (16%)
04:29:40:WU01:FS04:0x17:Completed 1200000 out of 5000000 steps (24%)
04:30:11:WU05:FS01:0x17:Completed 1200000 out of 5000000 steps (24%)
04:34:52:WU02:FS03:0x17:Completed 850000 out of 5000000 steps (17%)
04:37:18:WU01:FS04:0x17:Completed 1250000 out of 5000000 steps (25%)
04:37:50:WU05:FS01:0x17:Completed 1250000 out of 5000000 steps (25%)
04:42:47:WU02:FS03:0x17:Completed 900000 out of 5000000 steps (18%)
04:45:12:WU01:FS04:0x17:Completed 1300000 out of 5000000 steps (26%)
04:45:44:WU05:FS01:0x17:Completed 1300000 out of 5000000 steps (26%)
04:50:26:WU02:FS03:0x17:Completed 950000 out of 5000000 steps (19%)
04:52:50:WU01:FS04:0x17:Completed 1350000 out of 5000000 steps (27%)
04:53:22:WU05:FS01:0x17:Completed 1350000 out of 5000000 steps (27%)
04:58:05:WU02:FS03:0x17:Completed 1000000 out of 5000000 steps (20%)
05:00:44:WU01:FS04:0x17:Completed 1400000 out of 5000000 steps (28%)
05:01:16:WU05:FS01:0x17:Completed 1400000 out of 5000000 steps (28%)
05:06:00:WU02:FS03:0x17:Completed 1050000 out of 5000000 steps (21%)
05:08:21:WU01:FS04:0x17:Completed 1450000 out of 5000000 steps (29%)
05:08:53:WU05:FS01:0x17:Completed 1450000 out of 5000000 steps (29%)
05:13:40:WU02:FS03:0x17:Completed 1100000 out of 5000000 steps (22%)
05:15:58:WU01:FS04:0x17:Completed 1500000 out of 5000000 steps (30%)
05:16:31:WU05:FS01:0x17:Completed 1500000 out of 5000000 steps (30%)
05:21:35:WU02:FS03:0x17:Completed 1150000 out of 5000000 steps (23%)
05:23:51:WU01:FS04:0x17:Completed 1550000 out of 5000000 steps (31%)
05:24:25:WU05:FS01:0x17:Completed 1550000 out of 5000000 steps (31%)
05:29:15:WU02:FS03:0x17:Completed 1200000 out of 5000000 steps (24%)
05:31:29:WU01:FS04:0x17:Completed 1600000 out of 5000000 steps (32%)
05:32:03:WU05:FS01:0x17:Completed 1600000 out of 5000000 steps (32%)
05:36:54:WU02:FS03:0x17:Completed 1250000 out of 5000000 steps (25%)
05:39:23:WU01:FS04:0x17:Completed 1650000 out of 5000000 steps (33%)
05:39:57:WU05:FS01:0x17:Completed 1650000 out of 5000000 steps (33%)
05:44:50:WU02:FS03:0x17:Completed 1300000 out of 5000000 steps (26%)
05:47:01:WU01:FS04:0x17:Completed 1700000 out of 5000000 steps (34%)
05:47:34:WU05:FS01:0x17:Completed 1700000 out of 5000000 steps (34%)
05:52:30:WU02:FS03:0x17:Completed 1350000 out of 5000000 steps (27%)
05:54:38:WU01:FS04:0x17:Completed 1750000 out of 5000000 steps (35%)
05:55:12:WU05:FS01:0x17:Completed 1750000 out of 5000000 steps (35%)
06:00:25:WU02:FS03:0x17:Completed 1400000 out of 5000000 steps (28%)
06:02:32:WU01:FS04:0x17:Completed 1800000 out of 5000000 steps (36%)
06:03:06:WU05:FS01:0x17:Completed 1800000 out of 5000000 steps (36%)
06:08:04:WU02:FS03:0x17:Completed 1450000 out of 5000000 steps (29%)
06:10:11:WU01:FS04:0x17:Completed 1850000 out of 5000000 steps (37%)
06:10:45:WU05:FS01:0x17:Completed 1850000 out of 5000000 steps (37%)
06:15:43:WU02:FS03:0x17:Completed 1500000 out of 5000000 steps (30%)
06:18:04:WU01:FS04:0x17:Completed 1900000 out of 5000000 steps (38%)
06:18:38:WU05:FS01:0x17:Completed 1900000 out of 5000000 steps (38%)
06:23:39:WU02:FS03:0x17:Completed 1550000 out of 5000000 steps (31%)
06:25:42:WU01:FS04:0x17:Completed 1950000 out of 5000000 steps (39%)
06:26:16:WU05:FS01:0x17:Completed 1950000 out of 5000000 steps (39%)
06:31:18:WU02:FS03:0x17:Completed 1600000 out of 5000000 steps (32%)
06:33:19:WU01:FS04:0x17:Completed 2000000 out of 5000000 steps (40%)
06:33:54:WU05:FS01:0x17:Completed 2000000 out of 5000000 steps (40%)
06:39:13:WU02:FS03:0x17:Completed 1650000 out of 5000000 steps (33%)
06:41:13:WU01:FS04:0x17:Completed 2050000 out of 5000000 steps (41%)
06:41:48:WU05:FS01:0x17:Completed 2050000 out of 5000000 steps (41%)
06:46:53:WU02:FS03:0x17:Completed 1700000 out of 5000000 steps (34%)
06:48:51:WU01:FS04:0x17:Completed 2100000 out of 5000000 steps (42%)
06:49:26:WU05:FS01:0x17:Completed 2100000 out of 5000000 steps (42%)
06:52:11:111:127.0.0.1:New Web connection
06:54:32:WU02:FS03:0x17:Completed 1750000 out of 5000000 steps (35%)
06:56:45:WU01:FS04:0x17:Completed 2150000 out of 5000000 steps (43%)
06:57:21:WU05:FS01:0x17:Completed 2150000 out of 5000000 steps (43%)
07:02:29:WU02:FS03:0x17:Completed 1800000 out of 5000000 steps (36%)
07:04:23:WU01:FS04:0x17:Completed 2200000 out of 5000000 steps (44%)
07:04:59:WU05:FS01:0x17:Completed 2200000 out of 5000000 steps (44%)
07:10:09:WU02:FS03:0x17:Completed 1850000 out of 5000000 steps (37%)
07:12:01:WU01:FS04:0x17:Completed 2250000 out of 5000000 steps (45%)
07:12:38:WU05:FS01:0x17:Completed 2250000 out of 5000000 steps (45%)
07:18:04:WU02:FS03:0x17:Completed 1900000 out of 5000000 steps (38%)
07:19:55:WU01:FS04:0x17:Completed 2300000 out of 5000000 steps (46%)
07:20:32:WU05:FS01:0x17:Completed 2300000 out of 5000000 steps (46%)
07:25:43:WU02:FS03:0x17:Completed 1950000 out of 5000000 steps (39%)
07:27:33:WU01:FS04:0x17:Completed 2350000 out of 5000000 steps (47%)
07:28:10:WU05:FS01:0x17:Completed 2350000 out of 5000000 steps (47%)
07:33:21:WU02:FS03:0x17:Completed 2000000 out of 5000000 steps (40%)
07:35:27:WU01:FS04:0x17:Completed 2400000 out of 5000000 steps (48%)
07:36:04:WU05:FS01:0x17:Completed 2400000 out of 5000000 steps (48%)
07:41:17:WU02:FS03:0x17:Completed 2050000 out of 5000000 steps (41%)
07:43:04:WU01:FS04:0x17:Completed 2450000 out of 5000000 steps (49%)
07:43:41:WU05:FS01:0x17:Completed 2450000 out of 5000000 steps (49%)

Another problem is that when the system boots all 4 CPU cores go to perfect 100% load where it stays for ~5minutes. It's an open air rig and the CPU has the stock cooler. The problem is that is goes very near the maximum temp and in a month the temperature outside will go up 15C.

Post by **PantherX** » Mon May 19, 2014 5:20 pm

Welcome to the F@H Forum TheUniporn,

Regarding the heat issue, here are some options:
1) Upgrade the cooling system to a third party one
2) Change the thermal paste to a higher quality one
3) Underclock the CPU (this may impact folding performance)
4) Clean any dust from the cooling system
5) Relocate the system to a cooler/ventilated place

TheUniporn · Post by **TheUniporn** » Mon May 19, 2014 7:25 pm

Thank you PantherX and thank you for your reply!
1) I might have to. Hope that I can make room for it.
2) Yep.
3) Really good idea! Except those ~5 minutes when it boots, the CPU is not under too much load so it might not impact folding performance.
4) The cooler is new.
5) Already in a ventilated place.
I wonder if the time the CPU is under load at boot is proportional with the number of GPUs...

TheUniporn · Post by **TheUniporn** » Tue May 20, 2014 10:03 am

Update:
I paused the troubling GPU but when I wanted to enable it again it wouldn't start. After a rig restart the drivers didn't crash and the troubling GPU was still paused and trying to start. After letting the rig run for a while I see that the log has some errors and the troubling GPU is listed as failed. When I try to start Protein Viewer I get the error: "LoadLibrary failed with error 998: Invalid access to memory location." (I get the same error when I try to start Kombustor to see how the GPUs handle some 3D).

Code: Select all

*********************** Log Started 2014-05-20T08:08:33Z ***********************
08:08:33:************************* Folding@home Client *************************
08:08:33:      Website: http://folding.stanford.edu/
08:08:33:    Copyright: (c) 2009-2014 Stanford University
08:08:33:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
08:08:33:         Args: --open-web-control
08:08:33:       Config: C:/Users/W3/AppData/Roaming/FAHClient/config.xml
08:08:33:******************************** Build ********************************
08:08:33:      Version: 7.4.4
08:08:33:         Date: Mar 4 2014
08:08:33:         Time: 20:26:54
08:08:33:      SVN Rev: 4130
08:08:33:       Branch: fah/trunk/client
08:08:33:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
08:08:33:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
08:08:33:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
08:08:33:     Platform: win32 XP
08:08:33:         Bits: 32
08:08:33:         Mode: Release
08:08:33:******************************* System ********************************
08:08:33:          CPU: AMD A8-6600K APU with Radeon(tm) HD Graphics
08:08:33:       CPU ID: AuthenticAMD Family 21 Model 19 Stepping 1
08:08:33:         CPUs: 4
08:08:33:       Memory: 3.95GiB
08:08:33:  Free Memory: 2.90GiB
08:08:33:      Threads: WINDOWS_THREADS
08:08:33:   OS Version: 6.1
08:08:33:  Has Battery: false
08:08:33:   On Battery: false
08:08:33:   UTC Offset: 3
08:08:33:          PID: 4240
08:08:33:          CWD: C:/Users/W3/AppData/Roaming/FAHClient
08:08:33:           OS: Windows 7 Ultimate
08:08:33:      OS Arch: AMD64
08:08:33:         GPUs: 4
08:08:33:        GPU 0: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
08:08:33:        GPU 1: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
08:08:33:        GPU 2: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
08:08:33:        GPU 3: ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
08:08:33:         CUDA: Not detected
08:08:33:Win32 Service: false
08:08:33:***********************************************************************
08:08:33:<config>
08:08:33:  <!-- Folding Core -->
08:08:33:  <core-priority v='low'/>
08:08:33:
08:08:33:  <!-- Network -->
08:08:33:  <proxy v=':8080'/>
08:08:33:
08:08:33:  <!-- Slot Control -->
08:08:33:  <power v='full'/>
08:08:33:
08:08:33:  <!-- User Information -->
08:08:33:  <passkey v='********************************'/>
08:08:33:  <team v='224497'/>
08:08:33:  <user v='TheUniporn'/>
08:08:33:
08:08:33:  <!-- Folding Slots -->
08:08:33:  <slot id='1' type='GPU'>
08:08:33:    <paused v='true'/>
08:08:33:  </slot>
08:08:33:  <slot id='2' type='GPU'>
08:08:33:    <idle v='true'/>
08:08:33:    <paused v='true'/>
08:08:33:  </slot>
08:08:33:  <slot id='3' type='GPU'>
08:08:33:    <paused v='true'/>
08:08:33:  </slot>
08:08:33:  <slot id='4' type='GPU'>
08:08:33:    <paused v='true'/>
08:08:33:  </slot>
08:08:33:</config>
08:08:33:Trying to access database...
08:08:33:Successfully acquired database lock
08:08:33:Enabled folding slot 01: PAUSED gpu:0:Tahiti XT [Radeon R9 200/HD 7900/8970] (by user)
08:08:33:Enabled folding slot 02: PAUSED gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] (by user)
08:08:33:Enabled folding slot 03: PAUSED gpu:2:Tahiti XT [Radeon R9 200/HD 7900/8970] (by user)
08:08:33:Enabled folding slot 04: PAUSED gpu:3:Tahiti XT [Radeon R9 200/HD 7900/8970] (by user)
08:08:39:13:127.0.0.1:New Web connection
08:22:38:FS01:Unpaused
08:22:38:FS02:Unpaused
08:22:38:FS03:Unpaused
08:22:38:FS04:Unpaused
08:22:38:WU02:FS01:Starting
08:22:38:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 0 -gpu-vendor ati
08:22:38:WU02:FS01:Started FahCore on PID 1860
08:22:38:WU02:FS01:Core PID:420
08:22:38:WU02:FS01:FahCore 0x17 started
08:22:38:WU04:FS04:Starting
08:22:38:WU04:FS04:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 3 -gpu-vendor ati
08:22:38:WU04:FS04:Started FahCore on PID 1284
08:22:38:WU04:FS04:Core PID:4044
08:22:38:WU04:FS04:FahCore 0x17 started
08:22:38:WU00:FS03:Starting
08:22:38:WU00:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 2 -gpu-vendor ati
08:22:38:WU00:FS03:Started FahCore on PID 3476
08:22:38:WU00:FS03:Core PID:4864
08:22:38:WU00:FS03:FahCore 0x17 started
08:22:39:WU02:FS01:0x17:*********************** Log Started 2014-05-20T08:22:39Z ***********************
08:22:39:WU02:FS01:0x17:Project: 13000 (Run 713, Clone 2, Gen 0)
08:22:39:WU02:FS01:0x17:Unit: 0x00000001538b3db7531064eb359f51ff
08:22:39:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
08:22:39:WU02:FS01:0x17:Machine: 1
08:22:39:WU02:FS01:0x17:Digital signatures verified
08:22:39:WU02:FS01:0x17:Folding@home GPU core17
08:22:39:WU02:FS01:0x17:Version 0.0.52
08:22:39:WU04:FS04:0x17:*********************** Log Started 2014-05-20T08:22:39Z ***********************
08:22:39:WU04:FS04:0x17:Project: 13000 (Run 721, Clone 2, Gen 0)
08:22:39:WU04:FS04:0x17:Unit: 0x00000001538b3db75310672c199504f4
08:22:39:WU04:FS04:0x17:CPU: 0x00000000000000000000000000000000
08:22:39:WU04:FS04:0x17:Machine: 4
08:22:39:WU04:FS04:0x17:Digital signatures verified
08:22:39:WU04:FS04:0x17:Folding@home GPU core17
08:22:39:WU04:FS04:0x17:Version 0.0.52
08:22:39:WU00:FS03:0x17:*********************** Log Started 2014-05-20T08:22:39Z ***********************
08:22:39:WU00:FS03:0x17:Project: 13000 (Run 2172, Clone 2, Gen 0)
08:22:39:WU00:FS03:0x17:Unit: 0x00000001538b3db753120220e6fb5f63
08:22:39:WU00:FS03:0x17:CPU: 0x00000000000000000000000000000000
08:22:39:WU00:FS03:0x17:Machine: 3
08:22:39:WU00:FS03:0x17:Digital signatures verified
08:22:39:WU00:FS03:0x17:Folding@home GPU core17
08:22:39:WU00:FS03:0x17:Version 0.0.52
08:22:40:WU02:FS01:0x17:  Found a checkpoint file
08:22:40:WU04:FS04:0x17:  Found a checkpoint file
08:22:40:WU00:FS03:0x17:  Found a checkpoint file
08:22:47:Removing old file 'configs/config-20140515-170932.xml'
08:22:47:Saving configuration to config.xml
08:22:47:<config>
08:22:47:  <!-- Folding Core -->
08:22:47:  <core-priority v='low'/>
08:22:47:
08:22:47:  <!-- Network -->
08:22:47:  <proxy v=':8080'/>
08:22:47:
08:22:47:  <!-- Slot Control -->
08:22:47:  <power v='full'/>
08:22:47:
08:22:47:  <!-- User Information -->
08:22:47:  <passkey v='********************************'/>
08:22:47:  <team v='224497'/>
08:22:47:  <user v='TheUniporn'/>
08:22:47:
08:22:47:  <!-- Folding Slots -->
08:22:47:  <slot id='1' type='GPU'/>
08:22:47:  <slot id='2' type='GPU'>
08:22:47:    <idle v='true'/>
08:22:47:  </slot>
08:22:47:  <slot id='3' type='GPU'/>
08:22:47:  <slot id='4' type='GPU'/>
08:22:47:</config>
08:25:44:WU01:FS02:Connecting to 171.67.108.201:80
08:25:45:WU01:FS02:Assigned to work server 140.163.4.231
08:25:45:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
08:25:45:WU01:FS02:Connecting to 140.163.4.231:8080
08:25:46:WU01:FS02:Downloading 5.22MiB
08:25:49:WU01:FS02:Download complete
08:25:49:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:1862 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311aa6ae409789c
08:25:49:WU01:FS02:Starting
08:25:49:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 1 -gpu-vendor ati
08:25:49:WU01:FS02:Started FahCore on PID 3048
08:25:49:WU01:FS02:Core PID:4460
08:25:49:WU01:FS02:FahCore 0x17 started
08:25:49:WU01:FS02:0x17:*********************** Log Started 2014-05-20T08:25:49Z ***********************
08:25:49:WU01:FS02:0x17:Project: 13000 (Run 1862, Clone 4, Gen 0)
08:25:49:WU01:FS02:0x17:Unit: 0x00000001538b3db75311aa6ae409789c
08:25:49:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
08:25:49:WU01:FS02:0x17:Machine: 2
08:25:49:WU01:FS02:0x17:Reading tar file system.xml
08:25:50:WU01:FS02:0x17:Reading tar file integrator.xml
08:25:50:WU01:FS02:0x17:Reading tar file state.xml
08:25:51:WU01:FS02:0x17:Reading tar file core.xml
08:25:51:WU01:FS02:0x17:Digital signatures verified
08:25:51:WU01:FS02:0x17:Folding@home GPU core17
08:25:51:WU01:FS02:0x17:Version 0.0.52
08:26:16:WU02:FS01:0x17:Completed 1625000 out of 5000000 steps (32%)
08:26:16:WU02:FS01:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:26:17:WU04:FS04:0x17:Completed 1625000 out of 5000000 steps (32%)
08:26:17:WU04:FS04:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:26:20:WU00:FS03:0x17:Completed 1250000 out of 5000000 steps (25%)
08:26:20:WU00:FS03:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:28:46:WU01:FS02:0x17:ERROR:exception: Force RMSE error of 350.845 with threshold of 5
08:28:46:WU01:FS02:0x17:Saving result file logfile_01.txt
08:28:46:WU01:FS02:0x17:Saving result file log.txt
08:28:46:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
08:28:46:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
08:28:46:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:13000 run:1862 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311aa6ae409789c
08:28:46:WU01:FS02:Uploading 2.39KiB to 140.163.4.231
08:28:46:WU01:FS02:Connecting to 140.163.4.231:8080
08:28:46:WU03:FS02:Connecting to 171.67.108.201:80
08:28:47:WU01:FS02:Upload complete
08:28:47:WU01:FS02:Server responded WORK_ACK (400)
08:28:47:WU01:FS02:Cleaning up
08:28:47:WU03:FS02:Assigned to work server 140.163.4.231
08:28:47:WU03:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
08:28:47:WU03:FS02:Connecting to 140.163.4.231:8080
08:28:48:WU03:FS02:Downloading 5.22MiB
08:28:50:WU03:FS02:Download complete
08:28:50:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13000 run:1920 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311bac906852588
08:28:50:WU03:FS02:Starting
08:28:50:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 1 -gpu-vendor ati
08:28:50:WU03:FS02:Started FahCore on PID 4628
08:28:50:WU03:FS02:Core PID:2524
08:28:50:WU03:FS02:FahCore 0x17 started
08:28:51:WU03:FS02:0x17:*********************** Log Started 2014-05-20T08:28:50Z ***********************
08:28:51:WU03:FS02:0x17:Project: 13000 (Run 1920, Clone 4, Gen 0)
08:28:51:WU03:FS02:0x17:Unit: 0x00000001538b3db75311bac906852588
08:28:51:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
08:28:51:WU03:FS02:0x17:Machine: 2
08:28:51:WU03:FS02:0x17:Reading tar file system.xml
08:28:51:WU03:FS02:0x17:Reading tar file integrator.xml
08:28:51:WU03:FS02:0x17:Reading tar file state.xml
08:28:52:WU03:FS02:0x17:Reading tar file core.xml
08:28:52:WU03:FS02:0x17:Digital signatures verified
08:28:52:WU03:FS02:0x17:Folding@home GPU core17
08:28:52:WU03:FS02:0x17:Version 0.0.52
08:30:20:WU02:FS01:0x17:Completed 1650000 out of 5000000 steps (33%)
08:30:21:WU04:FS04:0x17:Completed 1650000 out of 5000000 steps (33%)
08:31:30:WU03:FS02:0x17:ERROR:exception: Force RMSE error of 348.63 with threshold of 5
08:31:30:WU03:FS02:0x17:Saving result file logfile_01.txt
08:31:30:WU03:FS02:0x17:Saving result file log.txt
08:31:30:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
08:31:30:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
08:31:30:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:13000 run:1920 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311bac906852588
08:31:30:WU03:FS02:Uploading 2.39KiB to 140.163.4.231
08:31:30:WU03:FS02:Connecting to 140.163.4.231:8080
08:31:31:WU03:FS02:Upload complete
08:31:31:WU03:FS02:Server responded WORK_ACK (400)
08:31:31:WU03:FS02:Cleaning up
08:31:31:WU01:FS02:Connecting to 171.67.108.201:80
08:31:31:WU01:FS02:Assigned to work server 140.163.4.231
08:31:31:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
08:31:31:WU01:FS02:Connecting to 140.163.4.231:8080
08:31:32:WU01:FS02:Downloading 5.22MiB
08:31:34:WU01:FS02:Download complete
08:31:35:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:1959 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311c5d145f12a48
08:31:35:WU01:FS02:Starting
08:31:35:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 1 -gpu-vendor ati
08:31:35:WU01:FS02:Started FahCore on PID 4856
08:31:35:WU01:FS02:Core PID:3068
08:31:35:WU01:FS02:FahCore 0x17 started
08:31:35:WU01:FS02:0x17:*********************** Log Started 2014-05-20T08:31:35Z ***********************
08:31:35:WU01:FS02:0x17:Project: 13000 (Run 1959, Clone 4, Gen 0)
08:31:35:WU01:FS02:0x17:Unit: 0x00000001538b3db75311c5d145f12a48
08:31:35:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
08:31:35:WU01:FS02:0x17:Machine: 2
08:31:35:WU01:FS02:0x17:Reading tar file system.xml
08:31:35:WU01:FS02:0x17:Reading tar file integrator.xml
08:31:35:WU01:FS02:0x17:Reading tar file state.xml
08:31:36:WU01:FS02:0x17:Reading tar file core.xml
08:31:36:WU01:FS02:0x17:Digital signatures verified
08:31:36:WU01:FS02:0x17:Folding@home GPU core17
08:31:36:WU01:FS02:0x17:Version 0.0.52
08:34:14:WU00:FS03:0x17:Completed 1300000 out of 5000000 steps (26%)
08:34:14:WU01:FS02:0x17:ERROR:exception: Force RMSE error of 297.093 with threshold of 5
08:34:14:WU01:FS02:0x17:Saving result file logfile_01.txt
08:34:14:WU01:FS02:0x17:Saving result file log.txt
08:34:14:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
08:34:15:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
08:34:15:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:13000 run:1959 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311c5d145f12a48
08:34:15:WU01:FS02:Uploading 2.39KiB to 140.163.4.231
08:34:15:WU01:FS02:Connecting to 140.163.4.231:8080
08:34:15:WU03:FS02:Connecting to 171.67.108.201:80
08:34:15:WU01:FS02:Upload complete
08:34:15:WU01:FS02:Server responded WORK_ACK (400)
08:34:15:WU01:FS02:Cleaning up
08:34:16:WU03:FS02:Assigned to work server 140.163.4.231
08:34:16:WU03:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
08:34:16:WU03:FS02:Connecting to 140.163.4.231:8080
08:34:16:WU03:FS02:Downloading 5.22MiB
08:34:19:WU03:FS02:Download complete
08:34:19:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13000 run:1999 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311d1243803ac65
08:34:19:WU03:FS02:Starting
08:34:19:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 1 -gpu-vendor ati
08:34:19:WU03:FS02:Started FahCore on PID 1416
08:34:19:WU03:FS02:Core PID:2292
08:34:19:WU03:FS02:FahCore 0x17 started
08:34:19:WU03:FS02:0x17:*********************** Log Started 2014-05-20T08:34:19Z ***********************
08:34:19:WU03:FS02:0x17:Project: 13000 (Run 1999, Clone 4, Gen 0)
08:34:19:WU03:FS02:0x17:Unit: 0x00000001538b3db75311d1243803ac65
08:34:19:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
08:34:19:WU03:FS02:0x17:Machine: 2
08:34:19:WU03:FS02:0x17:Reading tar file system.xml
08:34:20:WU03:FS02:0x17:Reading tar file integrator.xml
08:34:20:WU03:FS02:0x17:Reading tar file state.xml
08:34:20:WU03:FS02:0x17:Reading tar file core.xml
08:34:20:WU03:FS02:0x17:Digital signatures verified
08:34:20:WU03:FS02:0x17:Folding@home GPU core17
08:34:20:WU03:FS02:0x17:Version 0.0.52
08:36:59:WU03:FS02:0x17:ERROR:exception: Force RMSE error of 418.023 with threshold of 5
08:36:59:WU03:FS02:0x17:Saving result file logfile_01.txt
08:36:59:WU03:FS02:0x17:Saving result file log.txt
08:36:59:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
08:37:00:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
08:37:00:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:13000 run:1999 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311d1243803ac65
08:37:00:WU03:FS02:Uploading 2.38KiB to 140.163.4.231
08:37:00:WU03:FS02:Connecting to 140.163.4.231:8080
08:37:00:WU01:FS02:Connecting to 171.67.108.201:80
08:37:00:WU03:FS02:Upload complete
08:37:00:WU03:FS02:Server responded WORK_ACK (400)
08:37:00:WU03:FS02:Cleaning up
08:37:01:WU01:FS02:Assigned to work server 140.163.4.231
08:37:01:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
08:37:01:WU01:FS02:Connecting to 140.163.4.231:8080
08:37:02:WU01:FS02:Downloading 4.83MiB
08:37:04:WU01:FS02:Download complete
08:37:04:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13001 run:283 clone:0 gen:7 core:0x17 unit:0x00000017538b3db753289fe5315eba47
08:37:04:WU01:FS02:Starting
08:37:04:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 1 -gpu-vendor ati
08:37:04:WU01:FS02:Started FahCore on PID 2928
08:37:04:WU01:FS02:Core PID:3376
08:37:04:WU01:FS02:FahCore 0x17 started
08:37:04:WU01:FS02:0x17:*********************** Log Started 2014-05-20T08:37:04Z ***********************
08:37:04:WU01:FS02:0x17:Project: 13001 (Run 283, Clone 0, Gen 7)
08:37:04:WU01:FS02:0x17:Unit: 0x00000017538b3db753289fe5315eba47
08:37:04:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
08:37:04:WU01:FS02:0x17:Machine: 2
08:37:04:WU01:FS02:0x17:Reading tar file state.xml
08:37:05:WU01:FS02:0x17:Reading tar file system.xml
08:37:05:WU01:FS02:0x17:Reading tar file integrator.xml
08:37:05:WU01:FS02:0x17:Reading tar file core.xml
08:37:05:WU01:FS02:0x17:Digital signatures verified
08:37:05:WU01:FS02:0x17:Folding@home GPU core17
08:37:05:WU01:FS02:0x17:Version 0.0.52
08:37:55:WU02:FS01:0x17:Completed 1700000 out of 5000000 steps (34%)
08:37:56:WU04:FS04:0x17:Completed 1700000 out of 5000000 steps (34%)
08:39:45:WU01:FS02:0x17:ERROR:exception: Force RMSE error of 367.684 with threshold of 5
08:39:45:WU01:FS02:0x17:Saving result file logfile_01.txt
08:39:45:WU01:FS02:0x17:Saving result file log.txt
08:39:45:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
08:39:46:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
08:39:46:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:13001 run:283 clone:0 gen:7 core:0x17 unit:0x00000017538b3db753289fe5315eba47
08:39:46:WU01:FS02:Uploading 2.39KiB to 140.163.4.231
08:39:46:WU01:FS02:Connecting to 140.163.4.231:8080
08:39:46:WU03:FS02:Connecting to 171.67.108.201:80
08:39:46:WU01:FS02:Upload complete
08:39:46:WU01:FS02:Server responded WORK_ACK (400)
08:39:46:WU01:FS02:Cleaning up
08:39:47:WU03:FS02:Assigned to work server 140.163.4.231
08:39:47:WU03:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
08:39:47:WU03:FS02:Connecting to 140.163.4.231:8080
08:39:48:WU03:FS02:Downloading 5.22MiB
08:39:50:WU03:FS02:Download complete
08:39:50:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13000 run:2087 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311ea166320635d
08:39:50:WU03:FS02:Starting
08:39:50:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 1 -gpu-vendor ati
08:39:50:WU03:FS02:Started FahCore on PID 2612
08:39:50:WU03:FS02:Core PID:372
08:39:50:WU03:FS02:FahCore 0x17 started
08:39:50:WU03:FS02:0x17:*********************** Log Started 2014-05-20T08:39:50Z ***********************
08:39:50:WU03:FS02:0x17:Project: 13000 (Run 2087, Clone 4, Gen 0)
08:39:50:WU03:FS02:0x17:Unit: 0x00000001538b3db75311ea166320635d
08:39:50:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
08:39:50:WU03:FS02:0x17:Machine: 2
08:39:50:WU03:FS02:0x17:Reading tar file system.xml
08:39:51:WU03:FS02:0x17:Reading tar file integrator.xml
08:39:51:WU03:FS02:0x17:Reading tar file state.xml
08:39:51:WU03:FS02:0x17:Reading tar file core.xml
08:39:51:WU03:FS02:0x17:Digital signatures verified
08:39:51:WU03:FS02:0x17:Folding@home GPU core17
08:39:51:WU03:FS02:0x17:Version 0.0.52
08:41:50:WU00:FS03:0x17:Completed 1350000 out of 5000000 steps (27%)
08:42:30:WU03:FS02:0x17:ERROR:exception: Force RMSE error of 276.328 with threshold of 5
08:42:30:WU03:FS02:0x17:Saving result file logfile_01.txt
08:42:30:WU03:FS02:0x17:Saving result file log.txt
08:42:30:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
08:42:31:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
08:42:31:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:13000 run:2087 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311ea166320635d
08:42:31:WU03:FS02:Uploading 2.38KiB to 140.163.4.231
08:42:31:WU03:FS02:Connecting to 140.163.4.231:8080
08:42:31:WU01:FS02:Connecting to 171.67.108.201:80
08:42:31:WU03:FS02:Upload complete
08:42:31:WU03:FS02:Server responded WORK_ACK (400)
08:42:31:WU03:FS02:Cleaning up
08:42:32:WU01:FS02:Assigned to work server 140.163.4.231
08:42:32:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
08:42:32:WU01:FS02:Connecting to 140.163.4.231:8080
08:42:32:WU01:FS02:Downloading 5.22MiB
08:42:34:WU01:FS02:Download complete
08:42:34:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:2130 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311f6454a8ca55a
08:42:34:WU01:FS02:Starting
08:42:34:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 1 -gpu-vendor ati
08:42:34:WU01:FS02:Started FahCore on PID 1336
08:42:34:WU01:FS02:Core PID:996
08:42:34:WU01:FS02:FahCore 0x17 started
08:42:35:WU01:FS02:0x17:*********************** Log Started 2014-05-20T08:42:35Z ***********************
08:42:35:WU01:FS02:0x17:Project: 13000 (Run 2130, Clone 4, Gen 0)
08:42:35:WU01:FS02:0x17:Unit: 0x00000001538b3db75311f6454a8ca55a
08:42:35:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
08:42:35:WU01:FS02:0x17:Machine: 2
08:42:35:WU01:FS02:0x17:Reading tar file system.xml
08:42:35:WU01:FS02:0x17:Reading tar file integrator.xml
08:42:35:WU01:FS02:0x17:Reading tar file state.xml
08:42:36:WU01:FS02:0x17:Reading tar file core.xml
08:42:36:WU01:FS02:0x17:Digital signatures verified
08:42:36:WU01:FS02:0x17:Folding@home GPU core17
08:42:36:WU01:FS02:0x17:Version 0.0.52
08:45:21:WU01:FS02:0x17:ERROR:exception: Force RMSE error of 276.496 with threshold of 5
08:45:21:WU01:FS02:0x17:Saving result file logfile_01.txt
08:45:21:WU01:FS02:0x17:Saving result file log.txt
08:45:21:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
08:45:21:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
08:45:21:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:13000 run:2130 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75311f6454a8ca55a
08:45:21:WU01:FS02:Uploading 2.39KiB to 140.163.4.231
08:45:21:WU01:FS02:Connecting to 140.163.4.231:8080
08:45:22:WU03:FS02:Connecting to 171.67.108.201:80
08:45:22:WU01:FS02:Upload complete
08:45:22:WU01:FS02:Server responded WORK_ACK (400)
08:45:22:WU01:FS02:Cleaning up
08:45:23:WU03:FS02:Assigned to work server 140.163.4.231
08:45:23:WU03:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
08:45:23:WU03:FS02:Connecting to 140.163.4.231:8080
08:45:23:WU03:FS02:Downloading 5.22MiB
08:45:26:WU03:FS02:Download complete
08:45:26:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13000 run:2170 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75312019d5d116790
08:45:26:WU03:FS02:Starting
08:45:26:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 1 -gpu-vendor ati
08:45:26:WU03:FS02:Started FahCore on PID 1788
08:45:26:WU03:FS02:Core PID:3964
08:45:26:WU03:FS02:FahCore 0x17 started
08:45:27:WU03:FS02:0x17:*********************** Log Started 2014-05-20T08:45:27Z ***********************
08:45:27:WU03:FS02:0x17:Project: 13000 (Run 2170, Clone 4, Gen 0)
08:45:27:WU03:FS02:0x17:Unit: 0x00000001538b3db75312019d5d116790
08:45:27:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
08:45:27:WU03:FS02:0x17:Machine: 2
08:45:27:WU03:FS02:0x17:Reading tar file system.xml
08:45:27:WU03:FS02:0x17:Reading tar file integrator.xml
08:45:27:WU03:FS02:0x17:Reading tar file state.xml
08:45:28:WU03:FS02:0x17:Reading tar file core.xml
08:45:28:WU03:FS02:0x17:Digital signatures verified
08:45:28:WU03:FS02:0x17:Folding@home GPU core17
08:45:28:WU03:FS02:0x17:Version 0.0.52
08:45:31:WU02:FS01:0x17:Completed 1750000 out of 5000000 steps (35%)
08:45:31:WU04:FS04:0x17:Completed 1750000 out of 5000000 steps (35%)
08:48:09:WU03:FS02:0x17:ERROR:exception: Force RMSE error of 372.051 with threshold of 5
08:48:09:WU03:FS02:0x17:Saving result file logfile_01.txt
08:48:09:WU03:FS02:0x17:Saving result file log.txt
08:48:09:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
08:48:10:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
08:48:10:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:13000 run:2170 clone:4 gen:0 core:0x17 unit:0x00000001538b3db75312019d5d116790
08:48:10:WU03:FS02:Uploading 2.38KiB to 140.163.4.231
08:48:10:WU03:FS02:Connecting to 140.163.4.231:8080
08:48:10:WU01:FS02:Connecting to 171.67.108.201:80
08:48:10:WU03:FS02:Upload complete
08:48:10:WU03:FS02:Server responded WORK_ACK (400)
08:48:10:WU03:FS02:Cleaning up
08:48:11:WU01:FS02:Assigned to work server 140.163.4.231
08:48:11:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
08:48:11:WU01:FS02:Connecting to 140.163.4.231:8080
08:48:11:WU01:FS02:Downloading 5.22MiB
08:48:14:WU01:FS02:Download complete
08:48:14:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:2220 clone:4 gen:0 core:0x17 unit:0x00000001538b3db753120fc75e2c52b9
08:48:14:WU01:FS02:Starting
08:48:14:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 1 -gpu-vendor ati
08:48:14:WU01:FS02:Started FahCore on PID 4264
08:48:14:WU01:FS02:Core PID:5028
08:48:14:WU01:FS02:FahCore 0x17 started
08:48:15:WU01:FS02:0x17:*********************** Log Started 2014-05-20T08:48:14Z ***********************
08:48:15:WU01:FS02:0x17:Project: 13000 (Run 2220, Clone 4, Gen 0)
08:48:15:WU01:FS02:0x17:Unit: 0x00000001538b3db753120fc75e2c52b9
08:48:15:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
08:48:15:WU01:FS02:0x17:Machine: 2
08:48:15:WU01:FS02:0x17:Reading tar file system.xml
08:48:15:WU01:FS02:0x17:Reading tar file integrator.xml
08:48:15:WU01:FS02:0x17:Reading tar file state.xml
08:48:16:WU01:FS02:0x17:Reading tar file core.xml
08:48:16:WU01:FS02:0x17:Digital signatures verified
08:48:16:WU01:FS02:0x17:Folding@home GPU core17
08:48:16:WU01:FS02:0x17:Version 0.0.52
08:49:47:WU00:FS03:0x17:Completed 1400000 out of 5000000 steps (28%)
08:50:54:WU01:FS02:0x17:ERROR:exception: Force RMSE error of 369.196 with threshold of 5
08:50:54:WU01:FS02:0x17:Saving result file logfile_01.txt
08:50:54:WU01:FS02:0x17:Saving result file log.txt
08:50:54:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
08:50:55:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
08:50:55:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:13000 run:2220 clone:4 gen:0 core:0x17 unit:0x00000001538b3db753120fc75e2c52b9
08:50:55:WU01:FS02:Uploading 2.39KiB to 140.163.4.231
08:50:55:WU01:FS02:Connecting to 140.163.4.231:8080
08:50:55:WU03:FS02:Connecting to 171.67.108.201:80
08:50:56:WU03:FS02:Assigned to work server 140.163.4.231
08:50:56:WU03:FS02:Requesting new work unit for slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.231
08:50:56:WU03:FS02:Connecting to 140.163.4.231:8080
08:50:56:WU01:FS02:Upload complete
08:50:56:WU01:FS02:Server responded WORK_ACK (400)
08:50:56:WU01:FS02:Cleaning up
08:50:57:WU03:FS02:Downloading 4.84MiB
08:51:00:WU03:FS02:Download complete
08:51:00:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13000 run:974 clone:1 gen:6 core:0x17 unit:0x0000000d538b3db75310aeb6dd84f264
08:51:00:WU03:FS02:Starting
08:51:00:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/W3/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 4240 -checkpoint 15 -gpu 1 -gpu-vendor ati
08:51:00:WU03:FS02:Started FahCore on PID 2988
08:51:00:WU03:FS02:Core PID:3016
08:51:00:WU03:FS02:FahCore 0x17 started
08:51:00:WU03:FS02:0x17:*********************** Log Started 2014-05-20T08:51:00Z ***********************
08:51:00:WU03:FS02:0x17:Project: 13000 (Run 974, Clone 1, Gen 6)
08:51:00:WU03:FS02:0x17:Unit: 0x0000000d538b3db75310aeb6dd84f264
08:51:00:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
08:51:00:WU03:FS02:0x17:Machine: 2
08:51:00:WU03:FS02:0x17:Reading tar file state.xml
08:51:01:WU03:FS02:0x17:Reading tar file system.xml
08:51:01:WU03:FS02:0x17:Reading tar file integrator.xml
08:51:01:WU03:FS02:0x17:Reading tar file core.xml
08:51:01:WU03:FS02:0x17:Digital signatures verified
08:51:01:WU03:FS02:0x17:Folding@home GPU core17
08:51:01:WU03:FS02:0x17:Version 0.0.52
08:53:25:WU02:FS01:0x17:Completed 1800000 out of 5000000 steps (36%)
08:53:26:WU04:FS04:0x17:Completed 1800000 out of 5000000 steps (36%)
08:53:43:WU03:FS02:0x17:ERROR:exception: Force RMSE error of 259.618 with threshold of 5
08:53:43:WU03:FS02:0x17:Saving result file logfile_01.txt
08:53:43:WU03:FS02:0x17:Saving result file log.txt
08:53:43:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
08:53:43:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
08:53:43:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:13000 run:974 clone:1 gen:6 core:0x17 unit:0x0000000d538b3db75310aeb6dd84f264
08:53:43:WU03:FS02:Uploading 2.39KiB to 140.163.4.231
08:53:43:WU03:FS02:Connecting to 140.163.4.231:8080
08:53:44:WU03:FS02:Upload complete
08:53:44:WU03:FS02:Server responded WORK_ACK (400)
08:53:44:WU03:FS02:Cleaning up
08:57:26:WU00:FS03:0x17:Completed 1450000 out of 5000000 steps (29%)
09:01:03:WU02:FS01:0x17:Completed 1850000 out of 5000000 steps (37%)
09:01:03:WU04:FS04:0x17:Completed 1850000 out of 5000000 steps (37%)
09:05:06:WU00:FS03:0x17:Completed 1500000 out of 5000000 steps (30%)
09:09:00:WU04:FS04:0x17:Completed 1900000 out of 5000000 steps (38%)
09:09:00:WU02:FS01:0x17:Completed 1900000 out of 5000000 steps (38%)
09:13:02:WU00:FS03:0x17:Completed 1550000 out of 5000000 steps (31%)
09:16:38:WU04:FS04:0x17:Completed 1950000 out of 5000000 steps (39%)
09:16:38:WU02:FS01:0x17:Completed 1950000 out of 5000000 steps (39%)
09:20:42:WU00:FS03:0x17:Completed 1600000 out of 5000000 steps (32%)
09:24:17:WU04:FS04:0x17:Completed 2000000 out of 5000000 steps (40%)
09:24:17:WU02:FS01:0x17:Completed 2000000 out of 5000000 steps (40%)
09:28:38:WU00:FS03:0x17:Completed 1650000 out of 5000000 steps (33%)
09:32:13:WU02:FS01:0x17:Completed 2050000 out of 5000000 steps (41%)
09:32:13:WU04:FS04:0x17:Completed 2050000 out of 5000000 steps (41%)
09:36:17:WU00:FS03:0x17:Completed 1700000 out of 5000000 steps (34%)
09:39:50:WU02:FS01:0x17:Completed 2100000 out of 5000000 steps (42%)
09:39:50:WU04:FS04:0x17:Completed 2100000 out of 5000000 steps (42%)
09:43:55:WU00:FS03:0x17:Completed 1750000 out of 5000000 steps (35%)
09:47:46:WU02:FS01:0x17:Completed 2150000 out of 5000000 steps (43%)
09:47:46:WU04:FS04:0x17:Completed 2150000 out of 5000000 steps (43%)
09:51:51:WU00:FS03:0x17:Completed 1800000 out of 5000000 steps (36%)
09:53:51:46:127.0.0.1:New Web connection
09:55:24:WU04:FS04:0x17:Completed 2200000 out of 5000000 steps (44%)
09:55:24:WU02:FS01:0x17:Completed 2200000 out of 5000000 steps (44%)
09:59:30:WU00:FS03:0x17:Completed 1850000 out of 5000000 steps (37%)
10:03:01:WU04:FS04:0x17:Completed 2250000 out of 5000000 steps (45%)
10:03:02:WU02:FS01:0x17:Completed 2250000 out of 5000000 steps (45%)

edit: I see with GPU-Z that it uses "PCI-E 3.0x16 @x1 1.1" instead of "PCI-E 3.0x16 @x1 2.0"...
edit 2: nevermind, it jumps to 2.0 when is doing the render test in GPU-Z, sorry.

bollix47 · Post by **bollix47** » Tue May 20, 2014 10:49 am

What version of the catalyst drivers are you using? If not 14.4, you could install the ones from AMD.

Were all 4 GPUs in the computer when you installed the drivers? If not, install 14.4 again.

Were all 4 GPUs in the computer when you installed folding@home? If not, after setting all the current work to finish and waiting until they do, uninstall folding@home including data and reinstall the 14.4 drivers, reboot and reinstall folding@home remembering to input your identity data again.

TheUniporn · Post by **TheUniporn** » Tue May 20, 2014 11:42 am

Yes I have the latest drivers but I can only install with one GPU present or I get BSOD while installing the drivers, still all GPUs say that they use the latest drivers so it might be OK; and yes when I install F@H I have all 4 GPUs present. Thank you for the ideas.

bollix47 · Post by **bollix47** » Tue May 20, 2014 12:08 pm

I suspect you need to solve the BSOD problem and install the drivers with all GPUs present in the computer. Using Google Search I did find a number of posts with similar problems suggesting:

1. PSU not enough power
2. Try right clicking on the driver installer (not the folding@home installer) and select "Run as Administrator"
3. Disabling onboard video in the bios
4. Other suggestions

You can't install new hardware on your computer and expect existing software to "just work" correctly without reinstalling some or all of the software involved. The new hardware may appear to work but it might not be using the drivers completely as you intended. If the drivers are not working correctly when you install folding@home then there's a good chance it's not going to identify the hardware properly and in some cases even though your log shows 4 GPUs the client may only be using 3 physical GPUs or it could cause some other seemingly unexplainable problem.

TheUniporn · Post by **TheUniporn** » Tue May 20, 2014 12:54 pm

1.,2. and 3. are already checked. All the GPUs are identical so I do expect it to work with 4 identical GPUs if I installed the drivers for one and they are all listed as using them; not sure what to do to not have BSOD when installing with all 4 at the same time.

Post by **bruce** » Tue May 20, 2014 3:19 pm

This discussion has focused almost entirely on the GPUs and drivers. I don't think that's wrong, and the things suggested and the things you've done all seem like reasonable things.

In addition to those suggestions, I'm concerned about your CPU and main RAM. First, your error with the viewer about "Invalid access to memory location" might be a driver problem, but it also might be faulty RAM. Second, the BSOD could also be an issue with main RAM. If the basic CPU-RAM-MB are not rock-solid, nothing is going to be rock-solid.

With the heat from everything running together, I'd first check that you don't have hot spots that might raise the temperature of the memory subsection when everything is running. Cooling was mentioned earlier and it still may be a problem. Then I'd run memory diagnostics at least over night. It may show something or it may not, but it's still worth a try.

Folding Forum

Multiple problems on a 4*280x rig

Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig

Re: Multiple problems on a 4*280x rig