Project 10496 impossible to finish

Moderators: Site Moderators, FAHC Science Team

Aurum
Posts: 292
Joined: Sat Oct 03, 2015 3:15 pm
Location: The Great Basin

Project 10496 impossible to finish

Post by Aurum »

This dedicated rig is folding 24x7 and doing nothing else. Both GPU cards have 3GB and running at stock speed. As you can see the ETA is almost 3 days after the Expiration Date. Is it me or is it a problem project :?:
Is there any reason not to dump PRGC 10496 and get a WU I can finish in time :?:

Image

Code: Select all

*********************** Log Started 2016-12-18T20:36:21Z ***********************
20:36:21:************************* Folding@home Client *************************
20:36:21:        Website: http://folding.stanford.edu/
20:36:21:      Copyright: (c) 2009-2016 Stanford University
20:36:21:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:36:21:           Args: --open-web-control
20:36:21:         Config: C:\Users\Miner5\AppData\Roaming\FAHClient\config.xml
20:36:21:******************************** Build ********************************
20:36:21:        Version: 7.4.15
20:36:21:           Date: Aug 17 2016
20:36:21:           Time: 04:33:41
20:36:21:     Repository: Git
20:36:21:       Revision: 4f3e0e25571a9f691719f0c273739294bde517dd
20:36:21:         Branch: master
20:36:21:       Compiler: GNU 5.3.1 20160205
20:36:21:        Options: -std=gnu++98 -I/mingw64/include -O3 -funroll-loops -ffast-math
20:36:21:                 -mfpmath=sse -fno-unsafe-math-optimizations -msse2
20:36:21:       Platform: linux2 4.6.0-1-amd64
20:36:21:           Bits: 64
20:36:21:           Mode: Release
20:36:21:******************************* System ********************************
20:36:21:            CPU: AMD Athlon(tm) II X2 4400e Processor
20:36:21:         CPU ID: AuthenticAMD Family 16 Model 6 Stepping 2
20:36:21:           CPUs: 2
20:36:21:         Memory: 8.00GiB
20:36:21:    Free Memory: 6.68GiB
20:36:21:        Threads: WINDOWS_THREADS
20:36:21:     OS Version: 6.1
20:36:21:    Has Battery: false
20:36:21:     On Battery: false
20:36:21:     UTC Offset: -8
20:36:21:            PID: 2672
20:36:21:            CWD: C:\Users\Miner5\AppData\Roaming\FAHClient
20:36:21:             OS: Windows 7 Home Premium Service Pack 1
20:36:21:        OS Arch: AMD64
20:36:21:           GPUs: 2
20:36:21:          GPU 0: Bus:2 Slot:0 ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
20:36:21:          GPU 1: Bus:2 Slot:0 ATI:5 Tahiti XT [Radeon R9 200/HD 7900/8970]
20:36:21:           CUDA: Not detected
20:36:21:OpenCL Device 0: Platform:0 Device:0 Bus:NA Slot:NA Compute:1.2 Driver:2236.9
20:36:21:OpenCL Device 1: Platform:0 Device:1 Bus:NA Slot:NA Compute:1.2 Driver:2236.9
20:36:21:OpenCL Device 2: Platform:0 Device:2 Bus:NA Slot:NA Compute:1.2 Driver:2236.9
20:36:21:  Win32 Service: false
20:36:21:***********************************************************************
20:36:21:<config>
20:36:21:  <!-- Folding Core -->
20:36:21:  <core-priority v='low'/>
20:36:21:
20:36:21:  <!-- HTTP Server -->
20:36:21:  <allow v='192.168.1.253'/>
20:36:21:
20:36:21:  <!-- Network -->
20:36:21:  <proxy v=':8080'/>
20:36:21:
20:36:21:  <!-- Remote Command Server -->
20:36:21:  <password v='*******'/>
20:36:21:
20:36:21:  <!-- Slot Control -->
20:36:21:  <pause-on-battery v='false'/>
20:36:21:  <power v='full'/>
20:36:21:
20:36:21:  <!-- User Information -->
20:36:21:  <passkey v='********************************'/>
20:36:21:  <team v='224497'/>
20:36:21:  <user v='Aurum_ALL_1KJd683KCGdt9eV9DNUXRDxs4ZgQCEdURJ'/>
20:36:21:
20:36:21:  <!-- Folding Slots -->
20:36:21:  <slot id='0' type='CPU'/>
20:36:21:  <slot id='1' type='GPU'/>
20:36:21:  <slot id='2' type='GPU'>
20:36:21:    <opencl-index v='1'/>
20:36:21:  </slot>
20:36:21:</config>
20:36:21:Trying to access database...
20:36:21:Successfully acquired database lock
20:36:21:Enabled folding slot 00: READY cpu:1
20:36:21:Enabled folding slot 01: READY gpu:0:Tahiti XT [Radeon R9 200/HD 7900/8970]
20:36:21:Enabled folding slot 02: READY gpu:1:Tahiti XT [Radeon R9 200/HD 7900/8970]
20:36:21:WU03:FS00:Starting
20:36:21:WU03:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:\Users\Miner5\AppData\Roaming\FAHClient\cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 03 -suffix 01 -version 704 -lifeline 2672 -checkpoint 15 -np 1
20:36:21:WU03:FS00:Started FahCore on PID 2284
20:36:21:WU03:FS00:Core PID:856
20:36:21:WU03:FS00:FahCore 0xa4 started
20:36:21:WU02:FS01:Starting
20:36:21:WU02:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:\Users\Miner5\AppData\Roaming\FAHClient\cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 2672 -checkpoint 15 -opencl-platform 0 -gpu-vendor ati -gpu 0
20:36:21:WU02:FS01:Started FahCore on PID 2916
20:36:21:WU03:FS00:0xa4:
20:36:21:WU03:FS00:0xa4:*------------------------------*
20:36:21:WU03:FS00:0xa4:Folding@Home Gromacs GB Core
20:36:21:WU03:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
20:36:21:WU03:FS00:0xa4:
20:36:21:WU03:FS00:0xa4:Preparing to commence simulation
20:36:21:WU03:FS00:0xa4:- Looking at optimizations...
20:36:21:WU03:FS00:0xa4:- Files status OK
20:36:21:WU03:FS00:0xa4:- Expanded 825064 -> 1398040 (decompressed 169.4 percent)
20:36:21:WU03:FS00:0xa4:Called DecompressByteArray: compressed_data_size=825064 data_size=1398040, decompressed_data_size=1398040 diff=0
20:36:21:WU03:FS00:0xa4:- Digital signature verified
20:36:21:WU03:FS00:0xa4:
20:36:21:WU03:FS00:0xa4:Project: 9039 (Run 392, Clone 0, Gen 641)
20:36:21:WU03:FS00:0xa4:
20:36:21:WU03:FS00:0xa4:Assembly optimizations on if available.
20:36:21:WU03:FS00:0xa4:Entering M.D.
20:36:21:WU02:FS01:Core PID:2908
20:36:21:WU02:FS01:FahCore 0x21 started
20:36:21:WU01:FS02:Starting
20:36:21:WU01:FS02:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:\Users\Miner5\AppData\Roaming\FAHClient\cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 2672 -checkpoint 15 -opencl-platform 0 -gpu-vendor ati -gpu 1
20:36:21:WU01:FS02:Started FahCore on PID 1844
20:36:21:WU01:FS02:Core PID:2624
20:36:21:WU01:FS02:FahCore 0x21 started
20:36:22:WU02:FS01:0x21:*********************** Log Started 2016-12-18T20:36:21Z ***********************
20:36:22:WU02:FS01:0x21:Project: 11711 (Run 7, Clone 11, Gen 5)
20:36:22:WU02:FS01:0x21:Unit: 0x0000000d8ca304e758332b4cf5e9c196
20:36:22:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:36:22:WU02:FS01:0x21:Machine: 1
20:36:22:WU02:FS01:0x21:Digital signatures verified
20:36:22:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:36:22:WU02:FS01:0x21:Version 0.0.17
20:36:22:WU01:FS02:0x21:*********************** Log Started 2016-12-18T20:36:21Z ***********************
20:36:22:WU01:FS02:0x21:Project: 10496 (Run 55, Clone 8, Gen 61)
20:36:22:WU01:FS02:0x21:Unit: 0x0000006e8ca304f556bbaa0e43bdc8c6
20:36:22:WU01:FS02:0x21:CPU: 0x00000000000000000000000000000000
20:36:22:WU01:FS02:0x21:Machine: 2
20:36:22:WU01:FS02:0x21:Digital signatures verified
20:36:22:WU01:FS02:0x21:Folding@home GPU Core21 Folding@home Core
20:36:22:WU01:FS02:0x21:Version 0.0.17
20:36:24:WARNING:Denied 1:127.0.0.1 access to URI: /ping?_=1482093383994&callback=jQuery19003797118177978023_1482093383993
20:36:24:WU01:FS02:0x21:  Found a checkpoint file
20:36:24:WU02:FS01:0x21:  Found a checkpoint file
20:36:28:WU03:FS00:0xa4:Using Gromacs checkpoints
20:36:28:WU03:FS00:0xa4:Mapping NT from 1 to 1 
20:36:30:WU03:FS00:0xa4:Resuming from checkpoint
20:36:30:WU03:FS00:0xa4:Verified 03/wudata_01.log
20:36:30:WU03:FS00:0xa4:Verified 03/wudata_01.trr
20:36:30:WU03:FS00:0xa4:Verified 03/wudata_01.xtc
20:36:30:WU03:FS00:0xa4:Verified 03/wudata_01.edr
20:36:30:WU03:FS00:0xa4:Completed 149130 out of 250000 steps  (59%)
20:37:15:WU02:FS01:0x21:Completed 3250000 out of 7500000 steps (43%)
20:37:15:WU02:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
20:37:22:Removing old file 'configs/config-20161129-024737.xml'
20:37:22:Saving configuration to config.xml
20:37:22:<config>
20:37:22:  <!-- Folding Core -->
20:37:22:  <core-priority v='low'/>
20:37:22:
20:37:22:  <!-- HTTP Server -->
20:37:22:  <allow v='192.168.1.253'/>
20:37:22:
20:37:22:  <!-- Network -->
20:37:22:  <proxy v=':8080'/>
20:37:22:
20:37:22:  <!-- Remote Command Server -->
20:37:22:  <password v='*******'/>
20:37:22:
20:37:22:  <!-- Slot Control -->
20:37:22:  <pause-on-battery v='false'/>
20:37:22:  <power v='full'/>
20:37:22:
20:37:22:  <!-- User Information -->
20:37:22:  <passkey v='********************************'/>
20:37:22:  <team v='224497'/>
20:37:22:  <user v='Aurum_ALL_1KJd683KCGdt9eV9DNUXRDxs4ZgQCEdURJ'/>
20:37:22:
20:37:22:  <!-- Folding Slots -->
20:37:22:  <slot id='0' type='CPU'/>
20:37:22:  <slot id='1' type='GPU'/>
20:37:22:  <slot id='2' type='GPU'/>
20:37:22:</config>
20:38:25:WU01:FS02:0x21:Completed 125000 out of 2000000 steps (6%)
20:38:25:WU01:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
20:46:33:WU03:FS00:0xa4:Completed 150000 out of 250000 steps  (60%)
20:51:22:WU01:FS02:0x21:Completed 140000 out of 2000000 steps (7%)
21:05:58:WU02:FS01:0x21:Completed 3300000 out of 7500000 steps (44%)
21:08:05:WU01:FS02:0x21:Completed 160000 out of 2000000 steps (8%)
21:24:46:WU01:FS02:0x21:Completed 180000 out of 2000000 steps (9%)
21:30:03:WU03:FS00:0xa4:Completed 152500 out of 250000 steps  (61%)
21:41:27:WU01:FS02:0x21:Completed 200000 out of 2000000 steps (10%)
21:48:17:WU02:FS01:0x21:Completed 3375000 out of 7500000 steps (45%)
21:54:20:WU03:FS00:0xa4:Completed 155000 out of 250000 steps  (62%)
21:58:09:WU01:FS02:0x21:Completed 220000 out of 2000000 steps (11%)
22:14:51:WU01:FS02:0x21:Completed 240000 out of 2000000 steps (12%)
22:18:44:WU03:FS00:0xa4:Completed 157500 out of 250000 steps  (63%)
22:30:46:WU02:FS01:0x21:Completed 3450000 out of 7500000 steps (46%)
22:32:04:WU01:FS02:0x21:Completed 260000 out of 2000000 steps (13%)
22:42:46:WU03:FS00:0xa4:Completed 160000 out of 250000 steps  (64%)
22:48:44:WU01:FS02:0x21:Completed 280000 out of 2000000 steps (14%)
23:05:25:WU01:FS02:0x21:Completed 300000 out of 2000000 steps (15%)
23:13:58:WU02:FS01:0x21:Completed 3525000 out of 7500000 steps (47%)
23:22:07:WU01:FS02:0x21:Completed 320000 out of 2000000 steps (16%)
23:25:59:WU03:FS00:0xa4:Completed 162500 out of 250000 steps  (65%)
23:38:48:WU01:FS02:0x21:Completed 340000 out of 2000000 steps (17%)
23:55:30:WU01:FS02:0x21:Completed 360000 out of 2000000 steps (18%)
23:56:55:WU02:FS01:0x21:Completed 3600000 out of 7500000 steps (48%)
00:10:07:WU03:FS00:0xa4:Completed 165000 out of 250000 steps  (66%)
00:12:44:WU01:FS02:0x21:Completed 380000 out of 2000000 steps (19%)
00:29:25:WU01:FS02:0x21:Completed 400000 out of 2000000 steps (20%)
00:40:07:WU02:FS01:0x21:Completed 3675000 out of 7500000 steps (49%)
00:46:07:WU01:FS02:0x21:Completed 420000 out of 2000000 steps (21%)
00:54:18:WU03:FS00:0xa4:Completed 167500 out of 250000 steps  (67%)
01:02:48:WU01:FS02:0x21:Completed 440000 out of 2000000 steps (22%)
01:19:03:WU01:FS02:0x21:Completed 460000 out of 2000000 steps (23%)
01:23:11:WU02:FS01:0x21:Completed 3750000 out of 7500000 steps (50%)
01:35:52:WU01:FS02:0x21:Completed 480000 out of 2000000 steps (24%)
01:37:13:WU03:FS00:0xa4:Completed 170000 out of 250000 steps  (68%)
01:57:52:WU01:FS02:0x21:Completed 500000 out of 2000000 steps (25%)
02:01:10:WU03:FS00:0xa4:Completed 172500 out of 250000 steps  (69%)
02:14:17:WU02:FS01:0x21:Completed 3825000 out of 7500000 steps (51%)
02:23:10:WU01:FS02:0x21:Completed 520000 out of 2000000 steps (26%)
02:25:05:WU03:FS00:0xa4:Completed 175000 out of 250000 steps  (70%)
******************************* Date: 2016-12-19 *******************************
02:47:52:WU01:FS02:0x21:Completed 540000 out of 2000000 steps (27%)
02:49:02:WU03:FS00:0xa4:Completed 177500 out of 250000 steps  (71%)
03:12:43:WU01:FS02:0x21:Completed 560000 out of 2000000 steps (28%)
03:12:57:WU03:FS00:0xa4:Completed 180000 out of 250000 steps  (72%)
03:15:26:WU02:FS01:0x21:Completed 3900000 out of 7500000 steps (52%)
03:36:52:WU03:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
03:37:37:WU01:FS02:0x21:Completed 580000 out of 2000000 steps (29%)
04:00:44:WU03:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
04:02:24:WU01:FS02:0x21:Completed 600000 out of 2000000 steps (30%)
04:16:34:WU02:FS01:0x21:Completed 3975000 out of 7500000 steps (53%)
04:24:40:WU03:FS00:0xa4:Completed 187500 out of 250000 steps  (75%)
04:27:18:WU01:FS02:0x21:Completed 620000 out of 2000000 steps (31%)
04:48:36:WU03:FS00:0xa4:Completed 190000 out of 250000 steps  (76%)
04:52:43:WU01:FS02:0x21:Completed 640000 out of 2000000 steps (32%)
05:12:34:WU03:FS00:0xa4:Completed 192500 out of 250000 steps  (77%)
05:17:28:WU01:FS02:0x21:Completed 660000 out of 2000000 steps (33%)
05:17:50:WU02:FS01:0x21:Completed 4050000 out of 7500000 steps (54%)
05:49:00:WU03:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
05:53:47:WU01:FS02:0x21:Completed 680000 out of 2000000 steps (34%)
06:30:27:WU03:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
06:31:04:WU01:FS02:0x21:Completed 700000 out of 2000000 steps (35%)
07:00:57:WU02:FS01:0x21:Completed 4125000 out of 7500000 steps (55%)
07:04:57:WU01:FS02:0x21:Completed 720000 out of 2000000 steps (36%)
07:10:15:WU03:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
07:33:47:WU03:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
07:35:56:WU01:FS02:0x21:Completed 740000 out of 2000000 steps (37%)
07:57:37:WU03:FS00:0xa4:Completed 205000 out of 250000 steps  (82%)
08:05:55:WU01:FS02:0x21:Completed 760000 out of 2000000 steps (38%)
08:21:02:WU02:FS01:0x21:Completed 4200000 out of 7500000 steps (56%)
08:21:31:WU03:FS00:0xa4:Completed 207500 out of 250000 steps  (83%)
08:41:35:WU01:FS02:0x21:Completed 780000 out of 2000000 steps (39%)
08:45:21:WU03:FS00:0xa4:Completed 210000 out of 250000 steps  (84%)
******************************* Date: 2016-12-19 *******************************
09:07:46:WU01:FS02:0x21:Completed 800000 out of 2000000 steps (40%)
09:09:19:WU03:FS00:0xa4:Completed 212500 out of 250000 steps  (85%)
09:33:18:WU03:FS00:0xa4:Completed 215000 out of 250000 steps  (86%)
09:39:08:WU01:FS02:0x21:Completed 820000 out of 2000000 steps (41%)
09:42:48:WU02:FS01:0x21:Completed 4275000 out of 7500000 steps (57%)
09:57:42:WU03:FS00:0xa4:Completed 217500 out of 250000 steps  (87%)
10:17:08:WU01:FS02:0x21:Completed 840000 out of 2000000 steps (42%)
10:21:25:WU03:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
10:45:00:WU03:FS00:0xa4:Completed 222500 out of 250000 steps  (89%)
10:54:27:WU01:FS02:0x21:Completed 860000 out of 2000000 steps (43%)
11:09:08:WU03:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
11:26:10:WU02:FS01:0x21:Completed 4350000 out of 7500000 steps (58%)
11:32:25:WU01:FS02:0x21:Completed 880000 out of 2000000 steps (44%)
11:32:41:WU03:FS00:0xa4:Completed 227500 out of 250000 steps  (91%)
11:56:15:WU03:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
12:09:43:WU01:FS02:0x21:Completed 900000 out of 2000000 steps (45%)
12:19:55:WU03:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
12:43:29:WU03:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
12:44:38:WU01:FS02:0x21:Completed 920000 out of 2000000 steps (46%)
13:05:09:WU02:FS01:0x21:Completed 4425000 out of 7500000 steps (59%)
13:07:05:WU03:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
13:21:49:WU01:FS02:0x21:Completed 940000 out of 2000000 steps (47%)
13:30:40:WU03:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
13:54:18:WU03:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
13:59:07:WU01:FS02:0x21:Completed 960000 out of 2000000 steps (48%)
14:17:47:WU03:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
14:36:29:WU01:FS02:0x21:Completed 980000 out of 2000000 steps (49%)
14:41:33:WU03:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
14:41:34:WU00:FS00:Connecting to 171.67.108.45:8080
14:41:34:WU00:FS00:Assigned to work server 171.67.108.158
14:41:34:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:1 from 171.67.108.158
14:41:34:WU00:FS00:Connecting to 171.67.108.158:8080
14:41:35:WU00:FS00:Downloading 807.19KiB
14:41:39:WU00:FS00:Download complete
14:41:39:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9038 run:604 clone:3 gen:73 core:0xa4 unit:0x00000060ab436c9e5698296422dd1862
14:49:03:WU02:FS01:0x21:Completed 4500000 out of 7500000 steps (60%)
15:04:49:WU03:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
15:04:49:WU03:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
15:04:59:WU03:FS00:0xa4:
15:04:59:WU03:FS00:0xa4:Finished Work Unit:
15:04:59:WU03:FS00:0xa4:- Reading up to 811440 from "03/wudata_01.trr": Read 811440
15:04:59:WU03:FS00:0xa4:trr file hash check passed.
15:04:59:WU03:FS00:0xa4:- Reading up to 747648 from "03/wudata_01.xtc": Read 747648
15:04:59:WU03:FS00:0xa4:xtc file hash check passed.
15:04:59:WU03:FS00:0xa4:edr file hash check passed.
15:04:59:WU03:FS00:0xa4:logfile size: 33036
15:04:59:WU03:FS00:0xa4:Leaving Run
15:05:04:WU03:FS00:0xa4:- Writing 1594612 bytes of core data to disk...
15:05:04:WU03:FS00:0xa4:Done: 1594100 -> 1539987 (compressed to 96.6 percent)
15:05:04:WU03:FS00:0xa4:  ... Done.
15:05:04:WU03:FS00:0xa4:- Shutting down core
15:05:04:WU03:FS00:0xa4:
15:05:04:WU03:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
15:05:05:WU03:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
15:05:05:WU03:FS00:Sending unit results: id:03 state:SEND error:NO_ERROR project:9039 run:392 clone:0 gen:641 core:0xa4 unit:0x000002beab436c9e5698283371293fe1
15:05:05:WU03:FS00:Uploading 1.47MiB to 171.67.108.158
15:05:05:WU03:FS00:Connecting to 171.67.108.158:8080
15:05:05:WU00:FS00:Starting
15:05:05:WU00:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:\Users\Miner5\AppData\Roaming\FAHClient\cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 2672 -checkpoint 15 -np 1
15:05:05:WU00:FS00:Started FahCore on PID 1980
15:05:05:WU00:FS00:Core PID:1492
15:05:05:WU00:FS00:FahCore 0xa4 started
15:05:05:WU00:FS00:0xa4:
15:05:05:WU00:FS00:0xa4:*------------------------------*
15:05:05:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
15:05:05:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
15:05:05:WU00:FS00:0xa4:
15:05:05:WU00:FS00:0xa4:Preparing to commence simulation
15:05:05:WU00:FS00:0xa4:- Looking at optimizations...
15:05:05:WU00:FS00:0xa4:- Created dyn
15:05:05:WU00:FS00:0xa4:- Files status OK
15:05:05:WU00:FS00:0xa4:- Expanded 826051 -> 1402860 (decompressed 169.8 percent)
15:05:05:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826051 data_size=1402860, decompressed_data_size=1402860 diff=0
15:05:05:WU00:FS00:0xa4:- Digital signature verified
15:05:05:WU00:FS00:0xa4:
15:05:05:WU00:FS00:0xa4:Project: 9038 (Run 604, Clone 3, Gen 73)
15:05:05:WU00:FS00:0xa4:
15:05:05:WU00:FS00:0xa4:Assembly optimizations on if available.
15:05:05:WU00:FS00:0xa4:Entering M.D.
15:05:11:WU03:FS00:Upload 68.07%
15:05:11:WU00:FS00:0xa4:Mapping NT from 1 to 1 
15:05:12:WU00:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
15:05:15:WU03:FS00:Upload complete
15:05:15:WU03:FS00:Server responded WORK_ACK (400)
15:05:15:WU03:FS00:Final credit estimate, 353.00 points
15:05:15:WU03:FS00:Cleaning up
******************************* Date: 2016-12-19 *******************************
15:07:53:WU01:FS02:0x21:Completed 1000000 out of 2000000 steps (50%)
15:17:15:WU00:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
15:28:40:WU00:FS00:0xa4:Completed 5000 out of 250000 steps  (2%)
15:40:05:WU00:FS00:0xa4:Completed 7500 out of 250000 steps  (3%)
15:51:29:WU00:FS00:0xa4:Completed 10000 out of 250000 steps  (4%)
16:02:53:WU00:FS00:0xa4:Completed 12500 out of 250000 steps  (5%)
16:14:19:WU00:FS00:0xa4:Completed 15000 out of 250000 steps  (6%)
16:25:45:WU00:FS00:0xa4:Completed 17500 out of 250000 steps  (7%)
16:37:10:WU00:FS00:0xa4:Completed 20000 out of 250000 steps  (8%)
16:48:35:WU00:FS00:0xa4:Completed 22500 out of 250000 steps  (9%)
17:00:00:WU00:FS00:0xa4:Completed 25000 out of 250000 steps  (10%)
17:11:24:WU00:FS00:0xa4:Completed 27500 out of 250000 steps  (11%)
17:22:49:WU00:FS00:0xa4:Completed 30000 out of 250000 steps  (12%)
17:34:14:WU00:FS00:0xa4:Completed 32500 out of 250000 steps  (13%)
17:45:39:WU00:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
17:57:04:WU00:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
17:58:14:WU01:FS02:0x21:Completed 1020000 out of 2000000 steps (51%)
18:08:29:WU00:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
18:19:55:WU00:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
18:31:20:WU00:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
18:42:46:WU00:FS00:0xa4:Completed 47500 out of 250000 steps  (19%)
18:54:09:WU00:FS00:0xa4:Completed 50000 out of 250000 steps  (20%)
19:05:35:WU00:FS00:0xa4:Completed 52500 out of 250000 steps  (21%)
19:10:42:WU02:FS01:0x21:Completed 4575000 out of 7500000 steps (61%)
19:17:00:WU00:FS00:0xa4:Completed 55000 out of 250000 steps  (22%)
19:28:27:WU00:FS00:0xa4:Completed 57500 out of 250000 steps  (23%)
19:39:52:WU00:FS00:0xa4:Completed 60000 out of 250000 steps  (24%)
19:51:19:WU00:FS00:0xa4:Completed 62500 out of 250000 steps  (25%)
20:02:46:WU00:FS00:0xa4:Completed 65000 out of 250000 steps  (26%)
20:14:12:WU00:FS00:0xa4:Completed 67500 out of 250000 steps  (27%)
20:25:39:WU00:FS00:0xa4:Completed 70000 out of 250000 steps  (28%)
20:37:05:WU00:FS00:0xa4:Completed 72500 out of 250000 steps  (29%)
20:48:31:WU00:FS00:0xa4:Completed 75000 out of 250000 steps  (30%)
21:00:10:WU00:FS00:0xa4:Completed 77500 out of 250000 steps  (31%)
21:01:44:ERROR:Receive error: 10054: An existing connection was forcibly closed by the remote host.
******************************* Date: 2016-12-19 *******************************
21:11:37:WU00:FS00:0xa4:Completed 80000 out of 250000 steps  (32%)
21:23:03:WU00:FS00:0xa4:Completed 82500 out of 250000 steps  (33%)
21:34:29:WU00:FS00:0xa4:Completed 85000 out of 250000 steps  (34%)
21:45:54:WU00:FS00:0xa4:Completed 87500 out of 250000 steps  (35%)
21:57:19:WU00:FS00:0xa4:Completed 90000 out of 250000 steps  (36%)
22:08:45:WU00:FS00:0xa4:Completed 92500 out of 250000 steps  (37%)
22:20:10:WU00:FS00:0xa4:Completed 95000 out of 250000 steps  (38%)
22:31:36:WU00:FS00:0xa4:Completed 97500 out of 250000 steps  (39%)
22:43:03:WU00:FS00:0xa4:Completed 100000 out of 250000 steps  (40%)
22:54:30:WU00:FS00:0xa4:Completed 102500 out of 250000 steps  (41%)
23:05:57:WU00:FS00:0xa4:Completed 105000 out of 250000 steps  (42%)
23:17:24:WU00:FS00:0xa4:Completed 107500 out of 250000 steps  (43%)
23:28:51:WU00:FS00:0xa4:Completed 110000 out of 250000 steps  (44%)
23:33:32:WU01:FS02:0x21:Completed 1040000 out of 2000000 steps (52%)
23:40:16:WU00:FS00:0xa4:Completed 112500 out of 250000 steps  (45%)
23:51:41:WU00:FS00:0xa4:Completed 115000 out of 250000 steps  (46%)
00:03:07:WU00:FS00:0xa4:Completed 117500 out of 250000 steps  (47%)
00:14:32:WU00:FS00:0xa4:Completed 120000 out of 250000 steps  (48%)
00:25:56:WU00:FS00:0xa4:Completed 122500 out of 250000 steps  (49%)
00:37:20:WU00:FS00:0xa4:Completed 125000 out of 250000 steps  (50%)
00:48:44:WU00:FS00:0xa4:Completed 127500 out of 250000 steps  (51%)
01:00:08:WU00:FS00:0xa4:Completed 130000 out of 250000 steps  (52%)
01:11:31:WU00:FS00:0xa4:Completed 132500 out of 250000 steps  (53%)
01:22:57:WU00:FS00:0xa4:Completed 135000 out of 250000 steps  (54%)
01:34:22:WU00:FS00:0xa4:Completed 137500 out of 250000 steps  (55%)
01:45:46:WU00:FS00:0xa4:Completed 140000 out of 250000 steps  (56%)
01:57:12:WU00:FS00:0xa4:Completed 142500 out of 250000 steps  (57%)
02:08:37:WU00:FS00:0xa4:Completed 145000 out of 250000 steps  (58%)
02:20:03:WU00:FS00:0xa4:Completed 147500 out of 250000 steps  (59%)
02:28:53:ERROR:Receive error: 10054: An existing connection was forcibly closed by the remote host.
02:31:29:WU00:FS00:0xa4:Completed 150000 out of 250000 steps  (60%)
02:42:53:WU00:FS00:0xa4:Completed 152500 out of 250000 steps  (61%)
02:54:18:WU00:FS00:0xa4:Completed 155000 out of 250000 steps  (62%)
03:05:40:WU00:FS00:0xa4:Completed 157500 out of 250000 steps  (63%)
******************************* Date: 2016-12-20 *******************************
03:17:04:WU00:FS00:0xa4:Completed 160000 out of 250000 steps  (64%)
03:28:29:WU00:FS00:0xa4:Completed 162500 out of 250000 steps  (65%)
03:39:52:WU00:FS00:0xa4:Completed 165000 out of 250000 steps  (66%)
03:51:16:WU00:FS00:0xa4:Completed 167500 out of 250000 steps  (67%)
04:02:40:WU00:FS00:0xa4:Completed 170000 out of 250000 steps  (68%)
04:14:04:WU00:FS00:0xa4:Completed 172500 out of 250000 steps  (69%)
04:17:55:ERROR:Receive error: 10054: An existing connection was forcibly closed by the remote host.
04:25:27:WU00:FS00:0xa4:Completed 175000 out of 250000 steps  (70%)
04:36:50:WU00:FS00:0xa4:Completed 177500 out of 250000 steps  (71%)
04:48:14:WU00:FS00:0xa4:Completed 180000 out of 250000 steps  (72%)
04:59:39:WU00:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
05:10:54:WU01:FS02:0x21:Completed 1060000 out of 2000000 steps (53%)
05:11:03:WU00:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
05:22:27:WU00:FS00:0xa4:Completed 187500 out of 250000 steps  (75%)
05:33:52:WU00:FS00:0xa4:Completed 190000 out of 250000 steps  (76%)
05:45:16:WU00:FS00:0xa4:Completed 192500 out of 250000 steps  (77%)
05:56:41:WU00:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
06:03:32:WARNING:WU02:FS01:Past final deadline 2016-12-20T06:03:31Z, dumping
06:03:32:WU02:FS01:Shutting core down
06:03:32:WU02:FS01:0x21:WARNING:Console control signal 1 on PID 2908
06:03:32:WU02:FS01:0x21:Exiting, please wait. . .
06:03:32:WU03:FS01:Connecting to 171.67.108.45:80
06:03:32:WU03:FS01:Assigned to work server 140.163.4.245
06:03:32:WU03:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:Tahiti XT [Radeon R9 200/HD 7900/8970] from 140.163.4.245
06:03:32:WU03:FS01:Connecting to 140.163.4.245:8080
06:03:33:WU03:FS01:Downloading 14.49MiB
06:03:39:WU03:FS01:Download 9.06%
06:03:45:WU03:FS01:Download 18.55%
06:03:51:WU03:FS01:Download 26.74%
06:03:57:WU03:FS01:Download 34.93%
06:04:03:WU03:FS01:Download 40.11%
06:04:09:WU03:FS01:Download 45.72%
06:04:15:WU03:FS01:Download 51.75%
06:04:21:WU03:FS01:Download 58.66%
06:04:27:WU03:FS01:Download 65.12%
06:04:30:WU02:FS01:0x21:Folding@home Core Shutdown: INTERRUPTED
06:04:33:WU03:FS01:Download 72.02%
06:04:39:WU03:FS01:Download 77.20%
06:04:45:WU03:FS01:Download 82.81%
06:04:51:WU03:FS01:Download 87.12%
06:04:57:WU03:FS01:Download 91.43%
06:05:03:WU03:FS01:Download 98.76%
06:05:03:WU03:FS01:Download complete
06:05:04:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:10496 run:43 clone:14 gen:84 core:0x21 unit:0x000000958ca304f556bba93a3c61e3ff
06:05:04:WU03:FS01:Starting
06:05:04:WU03:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:\Users\Miner5\AppData\Roaming\FAHClient\cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 03 -suffix 01 -version 704 -lifeline 2672 -checkpoint 15 -opencl-platform 0 -gpu-vendor ati -gpu 0
06:05:04:WU03:FS01:Started FahCore on PID 3044
06:05:04:WU03:FS01:Core PID:3572
06:05:04:WU03:FS01:FahCore 0x21 started
06:05:13:WU03:FS01:0x21:*********************** Log Started 2016-12-20T06:05:13Z ***********************
06:05:13:WU03:FS01:0x21:Project: 10496 (Run 43, Clone 14, Gen 84)
06:05:13:WU03:FS01:0x21:Unit: 0x000000958ca304f556bba93a3c61e3ff
06:05:13:WU03:FS01:0x21:CPU: 0x00000000000000000000000000000000
06:05:13:WU03:FS01:0x21:Machine: 1
06:05:13:WU03:FS01:0x21:Reading tar file core.xml
06:05:13:WU03:FS01:0x21:Reading tar file system.xml
06:05:14:WU03:FS01:0x21:Reading tar file integrator.xml
06:05:14:WU03:FS01:0x21:Reading tar file state.xml
06:05:16:WU03:FS01:0x21:Digital signatures verified
06:05:16:WU03:FS01:0x21:Folding@home GPU Core21 Folding@home Core
06:05:16:WU03:FS01:0x21:Version 0.0.17
06:06:09:WU02:FS01:Cleaning up
06:08:11:WU00:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
06:19:34:WU00:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
06:31:20:WU00:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
06:42:44:WU00:FS00:0xa4:Completed 205000 out of 250000 steps  (82%)
06:54:08:WU00:FS00:0xa4:Completed 207500 out of 250000 steps  (83%)
07:05:30:WU00:FS00:0xa4:Completed 210000 out of 250000 steps  (84%)
07:16:54:WU00:FS00:0xa4:Completed 212500 out of 250000 steps  (85%)
07:28:18:WU00:FS00:0xa4:Completed 215000 out of 250000 steps  (86%)
07:39:41:WU00:FS00:0xa4:Completed 217500 out of 250000 steps  (87%)
07:51:04:WU00:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
08:02:27:WU00:FS00:0xa4:Completed 222500 out of 250000 steps  (89%)
08:13:49:WU00:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
08:18:34:WU03:FS01:0x21:Completed 0 out of 2000000 steps (0%)
08:19:04:WU03:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
08:25:11:WU00:FS00:0xa4:Completed 227500 out of 250000 steps  (91%)
08:29:17:WARNING:WU03:FS01:FahCore returned an unknown error code which probably indicates that it crashed
08:29:17:WARNING:WU03:FS01:FahCore returned: WU_STALLED (127 = 0x7f)
08:29:17:WU03:FS01:Starting
08:29:17:WU03:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:\Users\Miner5\AppData\Roaming\FAHClient\cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_21.fah/FahCore_21.exe -dir 03 -suffix 01 -version 704 -lifeline 2672 -checkpoint 15 -opencl-platform 0 -gpu-vendor ati -gpu 0
08:29:17:WU03:FS01:Started FahCore on PID 2320
08:29:17:WU03:FS01:Core PID:3052
08:29:17:WU03:FS01:FahCore 0x21 started
08:29:43:WU03:FS01:0x21:*********************** Log Started 2016-12-20T08:29:42Z ***********************
08:29:43:WU03:FS01:0x21:Project: 10496 (Run 43, Clone 14, Gen 84)
08:29:43:WU03:FS01:0x21:Unit: 0x000000958ca304f556bba93a3c61e3ff
08:29:43:WU03:FS01:0x21:CPU: 0x00000000000000000000000000000000
08:29:43:WU03:FS01:0x21:Machine: 1
08:29:43:WU03:FS01:0x21:Reading tar file core.xml
08:29:43:WU03:FS01:0x21:Reading tar file system.xml
08:33:06:WU03:FS01:0x21:Reading tar file integrator.xml
08:33:06:WU03:FS01:0x21:Reading tar file state.xml
08:36:35:WU00:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
08:38:06:WU03:FS01:0x21:Digital signatures verified
08:38:06:WU03:FS01:0x21:Folding@home GPU Core21 Folding@home Core
08:38:06:WU03:FS01:0x21:Version 0.0.17
08:48:00:WU00:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
08:59:24:WU00:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
09:10:47:WU00:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
******************************* Date: 2016-12-20 *******************************
09:22:10:WU00:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
09:33:33:WU00:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
09:44:57:WU00:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
09:56:20:WU00:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
09:56:20:WU02:FS00:Connecting to 171.67.108.45:8080
09:56:21:WU02:FS00:Assigned to work server 171.67.108.158
09:56:21:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:1 from 171.67.108.158
09:56:21:WU02:FS00:Connecting to 171.67.108.158:8080
09:56:21:WU02:FS00:Downloading 807.16KiB
09:56:25:WU02:FS00:Download complete
09:56:25:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9037 run:464 clone:10 gen:80 core:0xa4 unit:0x0000005fab436c9e56982b309279f4f9
10:07:44:WU00:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
10:07:45:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
10:08:01:WU00:FS00:0xa4:
10:08:01:WU00:FS00:0xa4:Finished Work Unit:
10:08:01:WU00:FS00:0xa4:- Reading up to 811536 from "00/wudata_01.trr": Read 811536
10:08:01:WU00:FS00:0xa4:trr file hash check passed.
10:08:01:WU00:FS00:0xa4:- Reading up to 747808 from "00/wudata_01.xtc": Read 747808
10:08:01:WU00:FS00:0xa4:xtc file hash check passed.
10:08:01:WU00:FS00:0xa4:edr file hash check passed.
10:08:01:WU00:FS00:0xa4:logfile size: 24071
10:08:01:WU00:FS00:0xa4:Leaving Run
10:08:03:WU00:FS00:0xa4:- Writing 1585903 bytes of core data to disk...
10:08:30:WU03:FS01:0x21:Completed 0 out of 2000000 steps (0%)
10:08:30:WU03:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
10:08:30:WU00:FS00:0xa4:Done: 1585391 -> 1539221 (compressed to 97.0 percent)
10:08:30:WU00:FS00:0xa4:  ... Done.
10:08:36:WU00:FS00:0xa4:- Shutting down core
10:08:36:WU00:FS00:0xa4:
10:08:36:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
10:08:43:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
10:08:43:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:9038 run:604 clone:3 gen:73 core:0xa4 unit:0x00000060ab436c9e5698296422dd1862
10:08:43:WU00:FS00:Uploading 1.47MiB to 171.67.108.158
10:08:43:WU00:FS00:Connecting to 171.67.108.158:8080
10:08:43:WU02:FS00:Starting
10:08:43:WU02:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:\Users\Miner5\AppData\Roaming\FAHClient\cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 704 -lifeline 2672 -checkpoint 15 -np 1
10:08:43:WU02:FS00:Started FahCore on PID 3408
10:08:48:WU02:FS00:Core PID:3140
10:08:48:WU02:FS00:FahCore 0xa4 started
10:08:49:WU00:FS00:Upload 68.10%
10:08:52:WU02:FS00:0xa4:
10:08:52:WU02:FS00:0xa4:*------------------------------*
10:08:52:WU02:FS00:0xa4:Folding@Home Gromacs GB Core
10:08:52:WU02:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
10:08:52:WU02:FS00:0xa4:
10:08:52:WU02:FS00:0xa4:Preparing to commence simulation
10:08:52:WU02:FS00:0xa4:- Looking at optimizations...
10:08:52:WU02:FS00:0xa4:- Created dyn
10:08:52:WU02:FS00:0xa4:- Files status OK
10:08:52:WU02:FS00:0xa4:- Expanded 826021 -> 1403472 (decompressed 169.9 percent)
10:08:52:WU02:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826021 data_size=1403472, decompressed_data_size=1403472 diff=0
10:08:52:WU02:FS00:0xa4:- Digital signature verified
10:08:52:WU02:FS00:0xa4:
10:08:52:WU02:FS00:0xa4:Project: 9037 (Run 464, Clone 10, Gen 80)
10:08:52:WU02:FS00:0xa4:
10:08:52:WU02:FS00:0xa4:Assembly optimizations on if available.
10:08:52:WU02:FS00:0xa4:Entering M.D.
10:08:52:WU00:FS00:Upload complete
10:08:52:WU00:FS00:Server responded WORK_ACK (400)
10:08:52:WU00:FS00:Final credit estimate, 574.00 points
10:08:53:WU00:FS00:Cleaning up
10:08:58:WU02:FS00:0xa4:Mapping NT from 1 to 1 
10:08:59:WU02:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
10:20:40:WU02:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
10:30:41:WU01:FS02:0x21:Completed 1080000 out of 2000000 steps (54%)
10:32:21:WU02:FS00:0xa4:Completed 5000 out of 250000 steps  (2%)
10:44:00:WU02:FS00:0xa4:Completed 7500 out of 250000 steps  (3%)
10:55:41:WU02:FS00:0xa4:Completed 10000 out of 250000 steps  (4%)
11:07:21:WU02:FS00:0xa4:Completed 12500 out of 250000 steps  (5%)
11:19:03:WU02:FS00:0xa4:Completed 15000 out of 250000 steps  (6%)
11:30:43:WU02:FS00:0xa4:Completed 17500 out of 250000 steps  (7%)
11:42:25:WU02:FS00:0xa4:Completed 20000 out of 250000 steps  (8%)
11:53:57:WU02:FS00:0xa4:Completed 22500 out of 250000 steps  (9%)
12:05:38:WU02:FS00:0xa4:Completed 25000 out of 250000 steps  (10%)
12:17:19:WU02:FS00:0xa4:Completed 27500 out of 250000 steps  (11%)
12:29:00:WU02:FS00:0xa4:Completed 30000 out of 250000 steps  (12%)
12:40:42:WU02:FS00:0xa4:Completed 32500 out of 250000 steps  (13%)
12:52:22:WU02:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
13:04:04:WU02:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
13:15:46:WU02:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
13:27:28:WU02:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
13:39:09:WU02:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
13:50:52:WU02:FS00:0xa4:Completed 47500 out of 250000 steps  (19%)
14:02:35:WU02:FS00:0xa4:Completed 50000 out of 250000 steps  (20%)
14:14:16:WU02:FS00:0xa4:Completed 52500 out of 250000 steps  (21%)
14:25:58:WU02:FS00:0xa4:Completed 55000 out of 250000 steps  (22%)
14:28:19:ERROR:Receive error: 10054: An existing connection was forcibly closed by the remote host.
14:37:40:WU02:FS00:0xa4:Completed 57500 out of 250000 steps  (23%)
14:49:22:WU02:FS00:0xa4:Completed 60000 out of 250000 steps  (24%)
14:54:45:WU03:FS01:0x21:Completed 20000 out of 2000000 steps (1%)
15:01:05:WU02:FS00:0xa4:Completed 62500 out of 250000 steps  (25%)
15:12:46:WU02:FS00:0xa4:Completed 65000 out of 250000 steps  (26%)
15:18:33:WU01:FS02:0x21:Completed 1100000 out of 2000000 steps (55%)
******************************* Date: 2016-12-20 *******************************
15:24:28:WU02:FS00:0xa4:Completed 67500 out of 250000 steps  (27%)
15:36:09:WU02:FS00:0xa4:Completed 70000 out of 250000 steps  (28%)
15:47:52:WU02:FS00:0xa4:Completed 72500 out of 250000 steps  (29%)
15:59:33:WU02:FS00:0xa4:Completed 75000 out of 250000 steps  (30%)
16:11:14:WU02:FS00:0xa4:Completed 77500 out of 250000 steps  (31%)
16:22:54:WU02:FS00:0xa4:Completed 80000 out of 250000 steps  (32%)
16:34:35:WU02:FS00:0xa4:Completed 82500 out of 250000 steps  (33%)
16:46:17:WU02:FS00:0xa4:Completed 85000 out of 250000 steps  (34%)
16:57:59:WU02:FS00:0xa4:Completed 87500 out of 250000 steps  (35%)
17:09:43:WU02:FS00:0xa4:Completed 90000 out of 250000 steps  (36%)
17:21:27:WU02:FS00:0xa4:Completed 92500 out of 250000 steps  (37%)
17:33:12:WU02:FS00:0xa4:Completed 95000 out of 250000 steps  (38%)
17:44:54:WU02:FS00:0xa4:Completed 97500 out of 250000 steps  (39%)
17:56:37:WU02:FS00:0xa4:Completed 100000 out of 250000 steps  (40%)
18:08:19:WU02:FS00:0xa4:Completed 102500 out of 250000 steps  (41%)
18:20:01:WU02:FS00:0xa4:Completed 105000 out of 250000 steps  (42%)
18:31:44:WU02:FS00:0xa4:Completed 107500 out of 250000 steps  (43%)
18:43:27:WU02:FS00:0xa4:Completed 110000 out of 250000 steps  (44%)
18:55:10:WU02:FS00:0xa4:Completed 112500 out of 250000 steps  (45%)
19:06:52:WU02:FS00:0xa4:Completed 115000 out of 250000 steps  (46%)
19:18:35:WU02:FS00:0xa4:Completed 117500 out of 250000 steps  (47%)
19:30:16:WU02:FS00:0xa4:Completed 120000 out of 250000 steps  (48%)
19:41:29:WU03:FS01:0x21:Completed 40000 out of 2000000 steps (2%)
19:41:57:WU02:FS00:0xa4:Completed 122500 out of 250000 steps  (49%)
19:53:36:WU02:FS00:0xa4:Completed 125000 out of 250000 steps  (50%)
20:05:11:WU01:FS02:0x21:Completed 1120000 out of 2000000 steps (56%)
20:05:18:WU02:FS00:0xa4:Completed 127500 out of 250000 steps  (51%)
20:17:00:WU02:FS00:0xa4:Completed 130000 out of 250000 steps  (52%)
20:28:42:WU02:FS00:0xa4:Completed 132500 out of 250000 steps  (53%)
20:40:24:WU02:FS00:0xa4:Completed 135000 out of 250000 steps  (54%)
20:52:05:WU02:FS00:0xa4:Completed 137500 out of 250000 steps  (55%)
21:03:48:WU02:FS00:0xa4:Completed 140000 out of 250000 steps  (56%)
21:15:31:WU02:FS00:0xa4:Completed 142500 out of 250000 steps  (57%)
******************************* Date: 2016-12-20 *******************************
21:27:44:WU02:FS00:0xa4:Completed 145000 out of 250000 steps  (58%)
21:39:26:WU02:FS00:0xa4:Completed 147500 out of 250000 steps  (59%)
21:51:09:WU02:FS00:0xa4:Completed 150000 out of 250000 steps  (60%)
22:02:51:WU02:FS00:0xa4:Completed 152500 out of 250000 steps  (61%)
22:14:33:WU02:FS00:0xa4:Completed 155000 out of 250000 steps  (62%)
22:26:16:WU02:FS00:0xa4:Completed 157500 out of 250000 steps  (63%)
22:37:56:WU02:FS00:0xa4:Completed 160000 out of 250000 steps  (64%)
22:49:38:WU02:FS00:0xa4:Completed 162500 out of 250000 steps  (65%)
23:01:19:WU02:FS00:0xa4:Completed 165000 out of 250000 steps  (66%)
23:13:01:WU02:FS00:0xa4:Completed 167500 out of 250000 steps  (67%)
23:24:41:WU02:FS00:0xa4:Completed 170000 out of 250000 steps  (68%)
23:36:22:WU02:FS00:0xa4:Completed 172500 out of 250000 steps  (69%)
23:48:04:WU02:FS00:0xa4:Completed 175000 out of 250000 steps  (70%)
23:59:44:WU02:FS00:0xa4:Completed 177500 out of 250000 steps  (71%)
00:11:25:WU02:FS00:0xa4:Completed 180000 out of 250000 steps  (72%)
00:23:07:WU02:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
00:28:19:WU03:FS01:0x21:Completed 60000 out of 2000000 steps (3%)
00:34:50:WU02:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
00:46:34:WU02:FS00:0xa4:Completed 187500 out of 250000 steps  (75%)
00:53:03:WU01:FS02:0x21:Completed 1140000 out of 2000000 steps (57%)
00:58:15:WU02:FS00:0xa4:Completed 190000 out of 250000 steps  (76%)
01:09:58:WU02:FS00:0xa4:Completed 192500 out of 250000 steps  (77%)
01:21:39:WU02:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
01:33:22:WU02:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
01:45:04:WU02:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
01:56:46:WU02:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
02:08:28:WU02:FS00:0xa4:Completed 205000 out of 250000 steps  (82%)
02:20:10:WU02:FS00:0xa4:Completed 207500 out of 250000 steps  (83%)
02:31:52:WU02:FS00:0xa4:Completed 210000 out of 250000 steps  (84%)
02:43:35:WU02:FS00:0xa4:Completed 212500 out of 250000 steps  (85%)
02:55:18:WU02:FS00:0xa4:Completed 215000 out of 250000 steps  (86%)
03:07:01:WU02:FS00:0xa4:Completed 217500 out of 250000 steps  (87%)
03:18:43:WU02:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
******************************* Date: 2016-12-21 *******************************
03:30:03:ERROR:Receive error: 10054: An existing connection was forcibly closed by the remote host.
03:30:24:WU02:FS00:0xa4:Completed 222500 out of 250000 steps  (89%)
03:42:06:WU02:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
03:53:49:WU02:FS00:0xa4:Completed 227500 out of 250000 steps  (91%)
04:05:30:WU02:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
04:17:10:WU02:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
04:28:52:WU02:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
04:40:33:WU02:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
04:52:16:WU02:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
05:03:57:WU02:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
05:15:19:WU03:FS01:0x21:Completed 80000 out of 2000000 steps (4%)
05:15:40:WU02:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
05:27:21:WU02:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
05:27:23:WU00:FS00:Connecting to 171.67.108.45:8080
05:27:23:WU00:FS00:Assigned to work server 171.67.108.158
05:27:23:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:1 from 171.67.108.158
05:27:23:WU00:FS00:Connecting to 171.67.108.158:8080
05:27:25:WU00:FS00:Downloading 807.73KiB
05:27:31:WU00:FS00:Download 47.54%
05:27:38:WU00:FS00:Download 87.16%
05:27:42:WU00:FS00:Download complete
05:27:42:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9040 run:827 clone:2 gen:205 core:0xa4 unit:0x000000eeab436c9e56e9da1e6c099ace
05:39:04:WU02:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
05:39:05:WU02:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
05:39:07:WU01:FS02:0x21:Completed 1160000 out of 2000000 steps (58%)
05:39:15:WU02:FS00:0xa4:
05:39:15:WU02:FS00:0xa4:Finished Work Unit:
05:39:15:WU02:FS00:0xa4:- Reading up to 811560 from "02/wudata_01.trr": Read 811560
05:39:15:WU02:FS00:0xa4:trr file hash check passed.
05:39:15:WU02:FS00:0xa4:- Reading up to 747744 from "02/wudata_01.xtc": Read 747744
05:39:15:WU02:FS00:0xa4:xtc file hash check passed.
05:39:15:WU02:FS00:0xa4:edr file hash check passed.
05:39:15:WU02:FS00:0xa4:logfile size: 24206
05:39:15:WU02:FS00:0xa4:Leaving Run
05:39:17:WU02:FS00:0xa4:- Writing 1585998 bytes of core data to disk...
05:39:18:WU02:FS00:0xa4:Done: 1585486 -> 1539130 (compressed to 97.0 percent)
05:39:18:WU02:FS00:0xa4:  ... Done.
05:39:18:WU02:FS00:0xa4:- Shutting down core
05:39:18:WU02:FS00:0xa4:
05:39:18:WU02:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
05:39:18:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:39:19:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:9037 run:464 clone:10 gen:80 core:0xa4 unit:0x0000005fab436c9e56982b309279f4f9
05:39:19:WU02:FS00:Uploading 1.47MiB to 171.67.108.158
05:39:19:WU02:FS00:Connecting to 171.67.108.158:8080
05:39:19:WU00:FS00:Starting
05:39:19:WU00:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:\Users\Miner5\AppData\Roaming\FAHClient\cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 2672 -checkpoint 15 -np 1
05:39:19:WU00:FS00:Started FahCore on PID 2000
05:39:19:WU00:FS00:Core PID:1236
05:39:19:WU00:FS00:FahCore 0xa4 started
05:39:19:WU00:FS00:0xa4:
05:39:19:WU00:FS00:0xa4:*------------------------------*
05:39:19:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
05:39:19:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
05:39:19:WU00:FS00:0xa4:
05:39:19:WU00:FS00:0xa4:Preparing to commence simulation
05:39:19:WU00:FS00:0xa4:- Looking at optimizations...
05:39:19:WU00:FS00:0xa4:- Created dyn
05:39:19:WU00:FS00:0xa4:- Files status OK
05:39:19:WU00:FS00:0xa4:- Expanded 826606 -> 1402440 (decompressed 169.6 percent)
05:39:19:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=826606 data_size=1402440, decompressed_data_size=1402440 diff=0
05:39:19:WU00:FS00:0xa4:- Digital signature verified
05:39:19:WU00:FS00:0xa4:
05:39:19:WU00:FS00:0xa4:Project: 9040 (Run 827, Clone 2, Gen 205)
05:39:19:WU00:FS00:0xa4:
05:39:19:WU00:FS00:0xa4:Assembly optimizations on if available.
05:39:19:WU00:FS00:0xa4:Entering M.D.
05:39:25:WU02:FS00:Upload 25.54%
05:39:25:WU00:FS00:0xa4:Mapping NT from 1 to 1 
05:39:26:WU00:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
05:39:31:WU02:FS00:Upload 55.34%
05:39:37:WU02:FS00:Upload 85.13%
05:39:40:WU02:FS00:Upload complete
05:39:40:WU02:FS00:Server responded WORK_ACK (400)
05:39:40:WU02:FS00:Final credit estimate, 570.00 points
05:39:40:WU02:FS00:Cleaning up
05:51:03:WU00:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
06:02:42:WU00:FS00:0xa4:Completed 5000 out of 250000 steps  (2%)
06:14:21:WU00:FS00:0xa4:Completed 7500 out of 250000 steps  (3%)
06:26:00:WU00:FS00:0xa4:Completed 10000 out of 250000 steps  (4%)
06:37:40:WU00:FS00:0xa4:Completed 12500 out of 250000 steps  (5%)
06:49:19:WU00:FS00:0xa4:Completed 15000 out of 250000 steps  (6%)
07:00:57:WU00:FS00:0xa4:Completed 17500 out of 250000 steps  (7%)
07:12:38:WU00:FS00:0xa4:Completed 20000 out of 250000 steps  (8%)
07:24:18:WU00:FS00:0xa4:Completed 22500 out of 250000 steps  (9%)
07:35:57:WU00:FS00:0xa4:Completed 25000 out of 250000 steps  (10%)
07:47:35:WU00:FS00:0xa4:Completed 27500 out of 250000 steps  (11%)
07:59:13:WU00:FS00:0xa4:Completed 30000 out of 250000 steps  (12%)
08:10:53:WU00:FS00:0xa4:Completed 32500 out of 250000 steps  (13%)
08:22:31:WU00:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
08:34:10:WU00:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
08:45:49:WU00:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
08:57:27:WU00:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
09:09:04:WU00:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
09:20:42:WU00:FS00:0xa4:Completed 47500 out of 250000 steps  (19%)
******************************* Date: 2016-12-21 *******************************
09:32:19:WU00:FS00:0xa4:Completed 50000 out of 250000 steps  (20%)
09:43:59:WU00:FS00:0xa4:Completed 52500 out of 250000 steps  (21%)
09:54:29:WU03:FS01:0x21:Completed 100000 out of 2000000 steps (5%)
09:55:37:WU00:FS00:0xa4:Completed 55000 out of 250000 steps  (22%)
10:07:15:WU00:FS00:0xa4:Completed 57500 out of 250000 steps  (23%)
10:18:39:WU01:FS02:0x21:Completed 1180000 out of 2000000 steps (59%)
10:18:54:WU00:FS00:0xa4:Completed 60000 out of 250000 steps  (24%)
10:30:32:WU00:FS00:0xa4:Completed 62500 out of 250000 steps  (25%)
10:42:09:WU00:FS00:0xa4:Completed 65000 out of 250000 steps  (26%)
10:53:48:WU00:FS00:0xa4:Completed 67500 out of 250000 steps  (27%)
11:05:27:WU00:FS00:0xa4:Completed 70000 out of 250000 steps  (28%)
11:17:06:WU00:FS00:0xa4:Completed 72500 out of 250000 steps  (29%)
11:28:44:WU00:FS00:0xa4:Completed 75000 out of 250000 steps  (30%)
11:40:23:WU00:FS00:0xa4:Completed 77500 out of 250000 steps  (31%)
11:52:00:WU00:FS00:0xa4:Completed 80000 out of 250000 steps  (32%)
12:03:39:WU00:FS00:0xa4:Completed 82500 out of 250000 steps  (33%)
12:15:16:WU00:FS00:0xa4:Completed 85000 out of 250000 steps  (34%)
12:26:55:WU00:FS00:0xa4:Completed 87500 out of 250000 steps  (35%)
12:38:33:WU00:FS00:0xa4:Completed 90000 out of 250000 steps  (36%)
12:50:13:WU00:FS00:0xa4:Completed 92500 out of 250000 steps  (37%)
13:01:52:WU00:FS00:0xa4:Completed 95000 out of 250000 steps  (38%)
13:13:32:WU00:FS00:0xa4:Completed 97500 out of 250000 steps  (39%)
13:25:11:WU00:FS00:0xa4:Completed 100000 out of 250000 steps  (40%)
13:36:51:WU00:FS00:0xa4:Completed 102500 out of 250000 steps  (41%)
13:48:27:WU00:FS00:0xa4:Completed 105000 out of 250000 steps  (42%)
14:00:03:WU00:FS00:0xa4:Completed 107500 out of 250000 steps  (43%)
14:11:42:WU00:FS00:0xa4:Completed 110000 out of 250000 steps  (44%)
14:23:20:WU00:FS00:0xa4:Completed 112500 out of 250000 steps  (45%)
In Science We Trust Image
Joe_H
Site Admin
Posts: 7927
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Project 10496 impossible to finish

Post by Joe_H »

Looking at the log, it looks like the problem is folding slot 01, it dumped the previous WU because it passed the final deadline. Before that it was processing slowly compared the your other GPU slot. It looks like the client may have got the indexes mixed up, and possibly is trying to process on the integrated GPU.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Aurum
Posts: 292
Joined: Sat Oct 03, 2015 3:15 pm
Location: The Great Basin

Re: PRGC 10496 impossible to finish

Post by Aurum »

Joe_H wrote:Looking at the log, it looks like the problem is folding slot 01, it dumped the previous WU because it passed the final deadline. Before that it was processing slowly compared the your other GPU slot. It looks like the client may have got the indexes mixed up, and possibly is trying to process on the integrated GPU.
The GPU-indexes are chronically being messed up, even as in this case where the cards are the same model. I keep hoping a rev will come out solving this problem. I'm going to have to study the log to see what you see. I saw a 4.5 hour TFT. Why would the TFT be impacted by the previous WU?
In Science We Trust Image
Joe_H
Site Admin
Posts: 7927
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Project 10496 impossible to finish

Post by Joe_H »

The previous WU had a TPF of about 42 minutes, on a similar sized WU to that being processed in the other GPU slot. The other slot was getting a TPF pf about 16 minutes. Eventually it reached the final deadline and was dumped.

I am not saying that previous WU impacted the speed, just that it demonstrated the GPU slot was processing slowly compared to what is supposedly an identical one. Whether that is from being mis-assigned to GPU hardware or the card running downclocked for some reason, it looks like there is some problem there.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Aurum
Posts: 292
Joined: Sat Oct 03, 2015 3:15 pm
Location: The Great Basin

Re: PRGC 10496 impossible to finish

Post by Aurum »

A different rig had the misfortune to DL two 10496 WUs and they had 4 to 5 hour TPFs. I dumped them both and guess what, it DLed two more 10496s and they both have 4 to 5 hour TPFs. We need a command to prevent repeatedly DLing flawed WUs, a blacklist.
What's the syntax for dumping more than one WU at a time :?:
--dump 3,5 does not dump either WU.
--dump 03 --dump 05 doesn't work.
In Science We Trust Image
Aurum
Posts: 292
Joined: Sat Oct 03, 2015 3:15 pm
Location: The Great Basin

Re: PRGC 10496 impossible to finish

Post by Aurum »

10496 is a real nightmare, it's all over the place and when I dump it another 10496 comes back with 4 plus hours TPF.
Steven Albanese please take down 10496 :evil:
In Science We Trust Image
foldy
Posts: 2040
Joined: Sat Dec 01, 2012 3:43 pm
Hardware configuration: Folding@Home Client 7.6.13 (1 GPU slots)
Windows 7 64bit
Intel Core i5 2500k@4Ghz
Nvidia gtx 1080ti driver 441

Re: PRGC 10496 impossible to finish

Post by foldy »

Maybe it is similar to the other project a month ago where atoms count was 10 times as large by mistake and so TPF was 4 hours instead of 4 min?
Aurum
Posts: 292
Joined: Sat Oct 03, 2015 3:15 pm
Location: The Great Basin

Re: PRGC 10496 impossible to finish

Post by Aurum »

foldy wrote:Maybe it is similar to the other project a month ago where atoms count was 10 times as large by mistake and so TPF was 4 hours instead of 4 min?
Is that something a folder (aka donor) check or only the foldee (aka recipient) check :?:
The project web page says:
"In projects 10491-10499...
Both the mTOR kinase domain and the larger construct including the FAT domain are very large systems, exploiting the latest OpenMM GPU core (0x21 v0.0.11) and push the capabilities of latest-generation GPUs to their full extent."
  • 10491: MTOR kinase domain (80983 atoms, 40 snapshots/WU)
    10492: MTOR kinase + FAT domains (277543 atoms, 40 snapshots/WU)
    10495: MTOR kinase domain mutants (67842 atoms, 20 snapshots/WU)
    10496: MTOR kinase + FAT domain mutants (189218 atoms, 20 snapshots/WU)
Today I have an R9-200 running 10495 with an estimated TPF of 4 mins 37 secs. I have several 19494s running and even on old HD 7700 & 7800 GPUs they run with TPF of 16 to 19 min. I have an HD 7800 running a 10496 with an estimated TPF of 1 hour and an ETA of 3.8 days that may actually finish before expiration on Dec 31st, but it only has an estimated PPD of 3448, a fraction of that card normally does. Oddly none of these monsters have been assigned to any of my RX 470s or 480s as I'd like to see how they handle them.

Jobs that push GPUs to the limit should have rational ETAs that can complete before their expiration date and pay a premium in PPD.

For now I'm setting my older GPUs to max-packet-size=small.
In Science We Trust Image
ComputerGenie
Posts: 230
Joined: Mon Dec 12, 2016 4:06 am

Re: PRGC 10496 impossible to finish

Post by ComputerGenie »

Aurum wrote:...
Jobs that push GPUs to the limit should have rational ETAs that can complete before their expiration date and pay a premium in PPD.
...
I would agree with that if the issue weren't your card. You're using a card that had it's own next generation more than double it's processing power. While I do think that there should be a better way to select jobs based on the capabilities of a given card, I can't see any situation where one should get an extra bonus for taxing a weaker card more heavily.

Just my 2¢
foldy
Posts: 2040
Joined: Sat Dec 01, 2012 3:43 pm
Hardware configuration: Folding@Home Client 7.6.13 (1 GPU slots)
Windows 7 64bit
Intel Core i5 2500k@4Ghz
Nvidia gtx 1080ti driver 441

Re: PRGC 10496 impossible to finish

Post by foldy »

Sometimes when an older GPU cannot finish all work units in time anymore it is time for retire it.
The difference between GPUs performance is in the order of 10th times.
e.g. HD 7800 30k PPD, gtx 1060 400k PPD

But for project 10496 with 189218 atoms that seems a lot atoms and maybe the project tpf/deadline/PPD is not adjusted right by project owner?
Aurum
Posts: 292
Joined: Sat Oct 03, 2015 3:15 pm
Location: The Great Basin

Re: Project 10496 impossible to finish

Post by Aurum »

ComputerGenie wrote:
Aurum wrote:...
Jobs that push GPUs to the limit should have rational ETAs that can complete before their expiration date and pay a premium in PPD.
...
I would agree with that if the issue weren't your card. You're using a card that had it's own next generation more than double it's processing power. While I do think that there should be a better way to select jobs based on the capabilities of a given card, I can't see any situation where one should get an extra bonus for taxing a weaker card more heavily.

Just my 2¢
I totally agree with your request to improve the logic of matching the scale of a WU with the capabilities of the card. Let me rephrase and say the logic for awarding credit needs improving as well.
In Science We Trust Image
Aurum
Posts: 292
Joined: Sat Oct 03, 2015 3:15 pm
Location: The Great Basin

Re: Project 10496 impossible to finish

Post by Aurum »

foldy wrote:Sometimes when an older GPU cannot finish all work units in time anymore it is time for retire it.
The difference between GPUs performance is in the order of 10th times.
e.g. HD 7800 30k PPD, gtx 1060 400k PPD

But for project 10496 with 189218 atoms that seems a lot atoms and maybe the project tpf/deadline/PPD is not adjusted right by project owner?
I'm taking the opposite tack and trying to use a lot of idle equipment I have lying around.
See: viewtopic.php?f=38&t=29431
In Science We Trust Image
JohnChodera
Pande Group Member
Posts: 467
Joined: Fri Feb 22, 2013 9:59 pm

Re: Project 10496 impossible to finish

Post by JohnChodera »

Thanks for all the feedback, everyone. This is a HUGE system---much bigger than we normally simulate---and we seem to have underestimated the deadline and timeout as a result.

I've temporarily set the assignment weight for this project to 0 until we can figure out (1) what an appropriate deadline/timeout should be, and (2) whether we should restrict this to a specific class of fast GPUs.

John
Nathan_P
Posts: 1164
Joined: Wed Apr 01, 2009 9:22 pm
Hardware configuration: Asus Z8NA D6C, 2 x5670@3.2 Ghz, , 12gb Ram, GTX 980ti, AX650 PSU, win 10 (daily use)

Asus Z87 WS, Xeon E3-1230L v3, 8gb ram, KFA GTX 1080, EVGA 750ti , AX760 PSU, Mint 18.2 OS

Not currently folding
Asus Z9PE- D8 WS, 2 E5-2665@2.3 Ghz, 16Gb 1.35v Ram, Ubuntu (Fold only)
Asus Z9PA, 2 Ivy 12 core, 16gb Ram, H folding appliance (fold only)
Location: Jersey, Channel islands

Re: Project 10496 impossible to finish

Post by Nathan_P »

10496 must just be too big for less powerful gpu's. A 980ti, 1070 and 1080 are all showing a tpf of around 2 minutes in my hfm logs. PPD is average for those cards at 580 to 700k PPD but lengthening the deadline will just bump ppd on faster cards, unless you rebench the project.

My humble suggestion would be to restrict to fast gpu's.
Image
Aurum
Posts: 292
Joined: Sat Oct 03, 2015 3:15 pm
Location: The Great Basin

Re: Project 10496 impossible to finish

Post by Aurum »

JohnChodera wrote:Thanks for all the feedback, everyone. This is a HUGE system---much bigger than we normally simulate---and we seem to have underestimated the deadline and timeout as a result.

I've temporarily set the assignment weight for this project to 0 until we can figure out (1) what an appropriate deadline/timeout should be, and (2) whether we should restrict this to a specific class of fast GPUs.

John
I was talking about matching GPUs to WUs on another thread: https://www.dropbox.com/s/nm0o0xkh5wm92 ... 6.jpg?dl=0
But I got the impression it didn't work in the current version. I suggest there that using the max-packet-size option might not be the best way to do it. I'd be curious to know how GPU can be specified.

I never did catch 10496 on one of my RX 480s as I would've liked to see how it ran. Hoping to build a multi-GTX 980ti folding rig soon.
In Science We Trust Image
Post Reply