48 days to finish project 6096

[Michtifertz]

Client is 7.4.4. CPU is an i7 4930k.

1.10% at 6:14 am
1.11% at 6:21 am

That doesn't seem right. No errors, it's just not going to be able to finish. There are less than two weeks before deadline. If an i7 4930k can't even come close to finishing this project on time, what on Earth will it take? Something must not be working right.

Removed the slot and put it back. It is now working on project 9012 and ETA is 6 and a half hours.

[Joe_H]

If the client has not processed a WU from a particular project before, its estimates will not be accurate until the client has processed at least a few percent of the WU. We would need information from the log file to see if there was any actual problem with the WU, see this topic for information on troubleshooting and posting log files - viewtopic.php?f=61&t=26036.

Project 6096 has particularly large WU's, it would have needed at least a few hours to see what the actual ETA was. Since you prematurely deleted the WU it is not possible to determine whether your assumption that it was not working right was correct or not.

[Michtifertz]

Well, a hundredth of a percent in 7 minutes seems to confirm the ETA. Also, it had been going over night, so it had plenty of time.

[bruce]

We still need to see the log...
and if possible, the previous log showing the (non-)processing of that 0.01%. It should be found in the logs subdirectory of FAH's Data directory.

How many CPU-cores are on that machine (presumably 6) and how many were allocated?

[Joe_H]

Yes, we would still need more information. For example, you mention getting a 9012 to process after dumping the 6096 WU and it was estimated to take 6+ hours. Well, I have less powerful machines with i7 860 and Xeon W3530 processors. Those can complete a 9012 in about 3-4 hours. So the log posting would show your actual settings - when the WU was downloaded and started, and the actual elapsed time to complete a percent of progress.

[Michtifertz]

Code: Select all

*********************** Log Started 2015-01-12T10:23:59Z ***********************
10:23:59:************************* Folding@home Client *************************
10:23:59:      Website: http://folding.stanford.edu/
10:23:59:    Copyright: (c) 2009-2014 Stanford University
10:23:59:       Author: Joseph Coffland <joseph@cauldrondevelopment.com>
10:23:59:         Args: 
10:23:59:       Config: C:/Users/John Bond/AppData/Roaming/FAHClient/config.xml
10:23:59:******************************** Build ********************************
10:23:59:      Version: 7.4.4
10:23:59:         Date: Mar 4 2014
10:23:59:         Time: 20:26:54
10:23:59:      SVN Rev: 4130
10:23:59:       Branch: fah/trunk/client
10:23:59:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
10:23:59:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
10:23:59:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
10:23:59:     Platform: win32 XP
10:23:59:         Bits: 32
10:23:59:         Mode: Release
10:23:59:******************************* System ********************************
10:23:59:          CPU: Intel(R) Core(TM) i7-4930K CPU @ 3.40GHz
10:23:59:       CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
10:23:59:         CPUs: 12
10:23:59:       Memory: 15.94GiB
10:23:59:  Free Memory: 13.99GiB
10:23:59:      Threads: WINDOWS_THREADS
10:23:59:   OS Version: 6.1
10:23:59:  Has Battery: false
10:23:59:   On Battery: false
10:23:59:   UTC Offset: -5
10:23:59:          PID: 4056
10:23:59:          CWD: C:/Users/John Bond/AppData/Roaming/FAHClient
10:23:59:           OS: Windows 7 Home Premium
10:23:59:      OS Arch: AMD64
10:23:59:         GPUs: 1
10:23:59:        GPU 0: NVIDIA:3 GK110 [GeForce GTX 780]
10:23:59:         CUDA: 3.5
10:23:59:  CUDA Driver: 7000
10:23:59:Win32 Service: false
10:23:59:***********************************************************************
10:23:59:<config>
10:23:59:  <!-- Network -->
10:23:59:  <proxy v=':8080'/>
10:23:59:
10:23:59:  <!-- Slot Control -->
10:23:59:  <pause-on-start v='true'/>
10:23:59:  <power v='full'/>
10:23:59:
10:23:59:  <!-- User Information -->
10:23:59:  <passkey v='********************************'/>
10:23:59:  <user v='Michtifertz'/>
10:23:59:
10:23:59:  <!-- Folding Slots -->
10:23:59:  <slot id='0' type='CPU'>
10:23:59:    <cpus v='12'/>
10:23:59:  </slot>
10:23:59:  <slot id='1' type='GPU'/>
10:23:59:</config>
10:23:59:Trying to access database...
10:23:59:Successfully acquired database lock
10:23:59:Enabled folding slot 00: PAUSED cpu:12 (by user)
10:23:59:Enabled folding slot 01: PAUSED gpu:0:GK110 [GeForce GTX 780] (by user)
10:23:59:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:9105 run:25 clone:9 gen:19 core:0x18 unit:0x000000160a3b1e81546bd238b26a345b
10:23:59:WU00:FS01:Uploading 6.30MiB to 171.64.65.93
10:23:59:WU00:FS01:Connecting to 171.64.65.93:8080
10:23:59:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
10:23:59:WU00:FS01:Connecting to 171.64.65.93:80
10:23:59:WARNING:WU00:FS01:Exception: Failed to send results to work server: Failed to connect to 171.64.65.93:80: A socket operation was attempted to an unreachable network.
10:23:59:WU00:FS01:Trying to send results to collection server
10:23:59:WU00:FS01:Uploading 6.30MiB to 171.65.103.160
10:23:59:WU00:FS01:Connecting to 171.65.103.160:8080
10:23:59:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
10:23:59:WU00:FS01:Connecting to 171.65.103.160:80
10:24:00:ERROR:WU00:FS01:Exception: Failed to connect to 171.65.103.160:80: A socket operation was attempted to an unreachable network.
10:24:00:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:9105 run:25 clone:9 gen:19 core:0x18 unit:0x000000160a3b1e81546bd238b26a345b
10:24:00:WU00:FS01:Uploading 6.30MiB to 171.64.65.93
10:24:00:WU00:FS01:Connecting to 171.64.65.93:8080
10:24:06:WU00:FS01:Upload 9.92%
10:24:12:WU00:FS01:Upload 20.84%
10:24:17:FS00:Unpaused
10:24:17:FS01:Unpaused
10:24:17:WU01:FS00:Connecting to 171.67.108.200:8080
10:24:18:WU02:FS01:Connecting to 171.67.108.200:80
10:24:18:WU00:FS01:Upload 31.76%
10:24:18:WARNING:WU01:FS00:Failed to get assignment from '171.67.108.200:8080': Empty work server assignment
10:24:18:WU01:FS00:Connecting to 171.67.108.204:80
10:24:18:WU02:FS01:Assigned to work server 140.163.4.234
10:24:18:WU02:FS01:Requesting new work unit for slot 01: READY gpu:0:GK110 [GeForce GTX 780] from 140.163.4.234
10:24:18:WU02:FS01:Connecting to 140.163.4.234:8080
10:24:18:WU02:FS01:Downloading 3.27MiB
10:24:19:WU01:FS00:Assigned to work server 128.143.231.202
10:24:19:WU01:FS00:Requesting new work unit for slot 00: READY cpu:12 from 128.143.231.202
10:24:19:WU01:FS00:Connecting to 128.143.231.202:8080
10:24:20:WU02:FS01:Download complete
10:24:20:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:10478 run:1 clone:267 gen:1 core:0x18 unit:0x00000001538b3dba548f72744d9ef4a6
10:24:20:WU02:FS01:Starting
10:24:20:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/John Bond/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe" -dir 02 -suffix 01 -version 704 -lifeline 4056 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
10:24:20:WU02:FS01:Started FahCore on PID 7892
10:24:20:WU02:FS01:Core PID:7936
10:24:20:WU02:FS01:FahCore 0x18 started
10:24:21:WU01:FS00:Downloading 3.64MiB
10:24:21:WU02:FS01:0x18:*********************** Log Started 2015-01-12T10:24:20Z ***********************
10:24:21:WU02:FS01:0x18:Project: 10478 (Run 1, Clone 267, Gen 1)
10:24:21:WU02:FS01:0x18:Unit: 0x00000001538b3dba548f72744d9ef4a6
10:24:21:WU02:FS01:0x18:CPU: 0x00000000000000000000000000000000
10:24:21:WU02:FS01:0x18:Machine: 1
10:24:21:WU02:FS01:0x18:Reading tar file state.xml
10:24:21:WU02:FS01:0x18:Reading tar file system.xml
10:24:21:WU02:FS01:0x18:Reading tar file integrator.xml
10:24:21:WU02:FS01:0x18:Reading tar file core.xml
10:24:21:WU02:FS01:0x18:Digital signatures verified
10:24:21:WU02:FS01:0x18:Folding@home GPU core18
10:24:21:WU02:FS01:0x18:Version 0.0.3
10:24:23:WU01:FS00:Download complete
10:24:23:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:6096 run:6 clone:87 gen:88 core:0xa3 unit:0x000000a80a3b1e594f1afa4ce5539655
10:24:23:WU01:FS00:Starting
10:24:23:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/John Bond/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe" -dir 01 -suffix 01 -version 704 -lifeline 4056 -checkpoint 15 -np 12
10:24:23:WU01:FS00:Started FahCore on PID 7664
10:24:23:WU01:FS00:Core PID:7676
10:24:23:WU01:FS00:FahCore 0xa3 started
10:24:23:WU01:FS00:0xa3:
10:24:23:WU01:FS00:0xa3:*------------------------------*
10:24:23:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
10:24:23:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
10:24:23:WU01:FS00:0xa3:
10:24:23:WU01:FS00:0xa3:Preparing to commence simulation
10:24:23:WU01:FS00:0xa3:- Looking at optimizations...
10:24:23:WU01:FS00:0xa3:- Created dyn
10:24:23:WU01:FS00:0xa3:- Files status OK
10:24:23:WU01:FS00:0xa3:- Expanded 3815472 -> 4169088 (decompressed 109.2 percent)
10:24:23:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=3815472 data_size=4169088, decompressed_data_size=4169088 diff=0
10:24:23:WU01:FS00:0xa3:- Digital signature verified
10:24:23:WU01:FS00:0xa3:
10:24:23:WU01:FS00:0xa3:Project: 6096 (Run 6, Clone 87, Gen 88)
10:24:23:WU01:FS00:0xa3:
10:24:23:WU01:FS00:0xa3:Assembly optimizations on if available.
10:24:23:WU01:FS00:0xa3:Entering M.D.
10:24:24:WU00:FS01:Upload 42.67%
10:24:29:WU01:FS00:0xa3:Mapping NT from 12 to 12 
10:24:30:WU00:FS01:Upload 54.58%
10:24:36:WU00:FS01:Upload 65.50%
10:24:40:WU02:FS01:0x18:Completed 0 out of 5000000 steps (0%)
10:24:40:WU02:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
10:24:42:WU00:FS01:Upload 76.41%
10:24:48:WU00:FS01:Upload 87.33%
10:24:54:WU00:FS01:Upload 98.24%
10:25:01:WU00:FS01:Upload complete
10:25:01:WU00:FS01:Server responded WORK_ACK (400)
10:25:01:WU00:FS01:Final credit estimate, 21055.00 points
10:25:01:WU00:FS01:Cleaning up
10:25:35:FS00:Paused
10:25:35:FS01:Paused
10:25:35:FS00:Shutting core down
10:25:35:FS01:Shutting core down
10:25:35:WU02:FS01:0x18:WARNING:Console control signal 1 on PID 7936
10:25:35:WU02:FS01:0x18:Exiting, please wait. . .
10:25:35:WU01:FS00:0xa3:Completed 0 out of 500000 steps  (0%)
10:25:35:WU02:FS01:0x18:Lost lifeline PID 7892, exiting
10:25:35:WU02:FS01:0x18:ERROR:103: Lost client lifeline
10:25:35:WU02:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
10:25:35:WU02:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
10:25:40:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
10:26:01:Removing old file 'configs/config-20141229-053228.xml'
10:26:01:Saving configuration to config.xml
10:26:01:<config>
10:26:01:  <!-- Network -->
10:26:01:  <proxy v=':8080'/>
10:26:01:
10:26:01:  <!-- Slot Control -->
10:26:01:  <pause-on-start v='true'/>
10:26:01:  <power v='full'/>
10:26:01:
10:26:01:  <!-- User Information -->
10:26:01:  <passkey v='********************************'/>
10:26:01:  <user v='Michtifertz'/>
10:26:01:
10:26:01:  <!-- Folding Slots -->
10:26:01:  <slot id='0' type='CPU'>
10:26:01:    <cpus v='12'/>
10:26:01:    <paused v='true'/>
10:26:01:  </slot>
10:26:01:  <slot id='1' type='GPU'>
10:26:01:    <paused v='true'/>
10:26:01:  </slot>
10:26:01:</config>
******************************* Date: 2015-01-12 *******************************
22:26:51:FS00:Unpaused
22:26:51:FS01:Unpaused
22:26:51:WU01:FS00:Starting
22:26:51:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/John Bond/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe" -dir 01 -suffix 01 -version 704 -lifeline 4056 -checkpoint 15 -np 12
22:26:51:WU01:FS00:Started FahCore on PID 13208
22:26:51:WU01:FS00:Core PID:13196
22:26:51:WU01:FS00:FahCore 0xa3 started
22:26:51:WU02:FS01:Starting
22:26:51:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/John Bond/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe" -dir 02 -suffix 01 -version 704 -lifeline 4056 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:26:51:WU02:FS01:Started FahCore on PID 14892
22:26:51:WU02:FS01:Core PID:15252
22:26:51:WU02:FS01:FahCore 0x18 started
22:26:52:WU01:FS00:0xa3:
22:26:52:WU01:FS00:0xa3:*------------------------------*
22:26:52:WU01:FS00:0xa3:Folding@Home Gromacs SMP Core
22:26:52:WU01:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
22:26:52:WU01:FS00:0xa3:
22:26:52:WU01:FS00:0xa3:Preparing to commence simulation
22:26:52:WU01:FS00:0xa3:- Looking at optimizations...
22:26:52:WU01:FS00:0xa3:- Files status OK
22:26:52:WU01:FS00:0xa3:- Expanded 3815472 -> 4169088 (decompressed 109.2 percent)
22:26:52:WU01:FS00:0xa3:Called DecompressByteArray: compressed_data_size=3815472 data_size=4169088, decompressed_data_size=4169088 diff=0
22:26:52:WU01:FS00:0xa3:- Digital signature verified
22:26:52:WU01:FS00:0xa3:
22:26:52:WU01:FS00:0xa3:Project: 6096 (Run 6, Clone 87, Gen 88)
22:26:52:WU01:FS00:0xa3:
22:26:52:WU01:FS00:0xa3:Assembly optimizations on if available.
22:26:52:WU01:FS00:0xa3:Entering M.D.
22:26:52:WU02:FS01:0x18:*********************** Log Started 2015-01-12T22:26:51Z ***********************
22:26:52:WU02:FS01:0x18:Project: 10478 (Run 1, Clone 267, Gen 1)
22:26:52:WU02:FS01:0x18:Unit: 0x00000001538b3dba548f72744d9ef4a6
22:26:52:WU02:FS01:0x18:CPU: 0x00000000000000000000000000000000
22:26:52:WU02:FS01:0x18:Machine: 1
22:26:52:WU02:FS01:0x18:Digital signatures verified
22:26:52:WU02:FS01:0x18:Folding@home GPU core18
22:26:52:WU02:FS01:0x18:Version 0.0.3
22:26:58:WU01:FS00:0xa3:Mapping NT from 12 to 12 
22:26:58:WU01:FS00:0xa3:Completed 0 out of 500000 steps  (0%)
22:27:09:WU02:FS01:0x18:Completed 0 out of 5000000 steps (0%)
22:27:09:WU02:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
22:27:51:Removing old file 'configs/config-20141229-053329.xml'
22:27:51:Saving configuration to config.xml
22:27:51:<config>
22:27:51:  <!-- Network -->
22:27:51:  <proxy v=':8080'/>
22:27:51:
22:27:51:  <!-- Slot Control -->
22:27:51:  <pause-on-start v='true'/>
22:27:51:  <power v='full'/>
22:27:51:
22:27:51:  <!-- User Information -->
22:27:51:  <passkey v='********************************'/>
22:27:51:  <user v='Michtifertz'/>
22:27:51:
22:27:51:  <!-- Folding Slots -->
22:27:51:  <slot id='0' type='CPU'>
22:27:51:    <cpus v='12'/>
22:27:51:  </slot>
22:27:51:  <slot id='1' type='GPU'/>
22:27:51:</config>
22:32:23:WU02:FS01:0x18:Completed 50000 out of 5000000 steps (1%)
22:37:40:WU02:FS01:0x18:Completed 100000 out of 5000000 steps (2%)
22:43:03:WU02:FS01:0x18:Completed 150000 out of 5000000 steps (3%)
22:48:20:WU02:FS01:0x18:Completed 200000 out of 5000000 steps (4%)
22:53:38:WU02:FS01:0x18:Completed 250000 out of 5000000 steps (5%)
22:59:04:WU02:FS01:0x18:Completed 300000 out of 5000000 steps (6%)
23:04:24:WU02:FS01:0x18:Completed 350000 out of 5000000 steps (7%)
23:09:52:WU02:FS01:0x18:Completed 400000 out of 5000000 steps (8%)
23:15:12:WU02:FS01:0x18:Completed 450000 out of 5000000 steps (9%)
23:20:31:WU02:FS01:0x18:Completed 500000 out of 5000000 steps (10%)
23:25:59:WU02:FS01:0x18:Completed 550000 out of 5000000 steps (11%)
23:31:19:WU02:FS01:0x18:Completed 600000 out of 5000000 steps (12%)
23:36:46:WU02:FS01:0x18:Completed 650000 out of 5000000 steps (13%)
23:42:06:WU02:FS01:0x18:Completed 700000 out of 5000000 steps (14%)
23:47:26:WU02:FS01:0x18:Completed 750000 out of 5000000 steps (15%)
23:52:53:WU02:FS01:0x18:Completed 800000 out of 5000000 steps (16%)
23:58:13:WU02:FS01:0x18:Completed 850000 out of 5000000 steps (17%)
00:03:42:WU02:FS01:0x18:Completed 900000 out of 5000000 steps (18%)
00:09:05:WU02:FS01:0x18:Completed 950000 out of 5000000 steps (19%)
00:14:26:WU02:FS01:0x18:Completed 1000000 out of 5000000 steps (20%)
00:19:55:WU02:FS01:0x18:Completed 1050000 out of 5000000 steps (21%)
00:25:17:WU02:FS01:0x18:Completed 1100000 out of 5000000 steps (22%)
00:30:47:WU02:FS01:0x18:Completed 1150000 out of 5000000 steps (23%)
00:36:11:WU02:FS01:0x18:Completed 1200000 out of 5000000 steps (24%)
00:41:34:WU02:FS01:0x18:Completed 1250000 out of 5000000 steps (25%)
00:47:05:WU02:FS01:0x18:Completed 1300000 out of 5000000 steps (26%)
00:52:27:WU02:FS01:0x18:Completed 1350000 out of 5000000 steps (27%)
00:57:57:WU02:FS01:0x18:Completed 1400000 out of 5000000 steps (28%)
01:03:19:WU02:FS01:0x18:Completed 1450000 out of 5000000 steps (29%)
01:08:41:WU02:FS01:0x18:Completed 1500000 out of 5000000 steps (30%)
01:14:10:WU02:FS01:0x18:Completed 1550000 out of 5000000 steps (31%)
01:19:33:WU02:FS01:0x18:Completed 1600000 out of 5000000 steps (32%)
01:25:01:WU02:FS01:0x18:Completed 1650000 out of 5000000 steps (33%)
01:30:23:WU02:FS01:0x18:Completed 1700000 out of 5000000 steps (34%)
01:35:45:WU02:FS01:0x18:Completed 1750000 out of 5000000 steps (35%)
01:41:14:WU02:FS01:0x18:Completed 1800000 out of 5000000 steps (36%)
01:46:37:WU02:FS01:0x18:Completed 1850000 out of 5000000 steps (37%)
01:52:10:WU02:FS01:0x18:Completed 1900000 out of 5000000 steps (38%)
01:57:32:WU02:FS01:0x18:Completed 1950000 out of 5000000 steps (39%)
02:02:54:WU02:FS01:0x18:Completed 2000000 out of 5000000 steps (40%)
02:08:24:WU02:FS01:0x18:Completed 2050000 out of 5000000 steps (41%)
02:13:47:WU02:FS01:0x18:Completed 2100000 out of 5000000 steps (42%)
02:19:17:WU02:FS01:0x18:Completed 2150000 out of 5000000 steps (43%)
02:24:41:WU02:FS01:0x18:Completed 2200000 out of 5000000 steps (44%)
02:30:05:WU02:FS01:0x18:Completed 2250000 out of 5000000 steps (45%)
02:35:36:WU02:FS01:0x18:Completed 2300000 out of 5000000 steps (46%)
02:41:00:WU02:FS01:0x18:Completed 2350000 out of 5000000 steps (47%)
02:46:32:WU02:FS01:0x18:Completed 2400000 out of 5000000 steps (48%)
02:51:56:WU02:FS01:0x18:Completed 2450000 out of 5000000 steps (49%)
02:57:20:WU02:FS01:0x18:Completed 2500000 out of 5000000 steps (50%)
03:02:52:WU02:FS01:0x18:Completed 2550000 out of 5000000 steps (51%)
03:08:15:WU02:FS01:0x18:Completed 2600000 out of 5000000 steps (52%)
03:13:45:WU02:FS01:0x18:Completed 2650000 out of 5000000 steps (53%)
03:19:08:WU02:FS01:0x18:Completed 2700000 out of 5000000 steps (54%)
03:24:30:WU02:FS01:0x18:Completed 2750000 out of 5000000 steps (55%)
03:30:01:WU02:FS01:0x18:Completed 2800000 out of 5000000 steps (56%)
03:35:24:WU02:FS01:0x18:Completed 2850000 out of 5000000 steps (57%)
03:40:55:WU02:FS01:0x18:Completed 2900000 out of 5000000 steps (58%)
03:46:20:WU02:FS01:0x18:Completed 2950000 out of 5000000 steps (59%)
03:51:44:WU02:FS01:0x18:Completed 3000000 out of 5000000 steps (60%)
03:57:16:WU02:FS01:0x18:Completed 3050000 out of 5000000 steps (61%)
04:02:41:WU02:FS01:0x18:Completed 3100000 out of 5000000 steps (62%)
04:08:12:WU02:FS01:0x18:Completed 3150000 out of 5000000 steps (63%)
04:13:37:WU02:FS01:0x18:Completed 3200000 out of 5000000 steps (64%)
04:19:01:WU02:FS01:0x18:Completed 3250000 out of 5000000 steps (65%)
04:24:32:WU02:FS01:0x18:Completed 3300000 out of 5000000 steps (66%)
******************************* Date: 2015-01-13 *******************************
04:29:57:WU02:FS01:0x18:Completed 3350000 out of 5000000 steps (67%)
04:35:28:WU02:FS01:0x18:Completed 3400000 out of 5000000 steps (68%)
04:40:51:WU02:FS01:0x18:Completed 3450000 out of 5000000 steps (69%)
04:46:14:WU02:FS01:0x18:Completed 3500000 out of 5000000 steps (70%)
04:51:45:WU02:FS01:0x18:Completed 3550000 out of 5000000 steps (71%)
04:57:08:WU02:FS01:0x18:Completed 3600000 out of 5000000 steps (72%)
05:02:39:WU02:FS01:0x18:Completed 3650000 out of 5000000 steps (73%)
05:08:01:WU02:FS01:0x18:Completed 3700000 out of 5000000 steps (74%)
05:13:25:WU02:FS01:0x18:Completed 3750000 out of 5000000 steps (75%)
05:18:55:WU02:FS01:0x18:Completed 3800000 out of 5000000 steps (76%)
05:24:18:WU02:FS01:0x18:Completed 3850000 out of 5000000 steps (77%)
05:29:48:WU02:FS01:0x18:Completed 3900000 out of 5000000 steps (78%)
05:35:11:WU02:FS01:0x18:Completed 3950000 out of 5000000 steps (79%)
05:40:33:WU02:FS01:0x18:Completed 4000000 out of 5000000 steps (80%)
05:46:05:WU02:FS01:0x18:Completed 4050000 out of 5000000 steps (81%)
05:51:29:WU02:FS01:0x18:Completed 4100000 out of 5000000 steps (82%)
05:57:00:WU02:FS01:0x18:Completed 4150000 out of 5000000 steps (83%)
06:02:26:WU02:FS01:0x18:Completed 4200000 out of 5000000 steps (84%)
06:07:51:WU02:FS01:0x18:Completed 4250000 out of 5000000 steps (85%)
06:13:23:WU02:FS01:0x18:Completed 4300000 out of 5000000 steps (86%)
06:18:47:WU02:FS01:0x18:Completed 4350000 out of 5000000 steps (87%)
06:24:18:WU02:FS01:0x18:Completed 4400000 out of 5000000 steps (88%)
06:29:43:WU02:FS01:0x18:Completed 4450000 out of 5000000 steps (89%)
06:35:09:WU02:FS01:0x18:Completed 4500000 out of 5000000 steps (90%)
06:40:39:WU02:FS01:0x18:Completed 4550000 out of 5000000 steps (91%)
06:46:02:WU02:FS01:0x18:Completed 4600000 out of 5000000 steps (92%)
06:51:33:WU02:FS01:0x18:Completed 4650000 out of 5000000 steps (93%)
06:57:01:WU02:FS01:0x18:Completed 4700000 out of 5000000 steps (94%)
07:02:27:WU02:FS01:0x18:Completed 4750000 out of 5000000 steps (95%)
07:07:58:WU02:FS01:0x18:Completed 4800000 out of 5000000 steps (96%)
07:13:22:WU02:FS01:0x18:Completed 4850000 out of 5000000 steps (97%)
07:18:54:WU02:FS01:0x18:Completed 4900000 out of 5000000 steps (98%)
07:24:18:WU02:FS01:0x18:Completed 4950000 out of 5000000 steps (99%)
07:29:42:WU02:FS01:0x18:Completed 5000000 out of 5000000 steps (100%)
07:29:42:WU00:FS01:Connecting to 171.67.108.200:80
07:29:42:WU00:FS01:Assigned to work server 140.163.4.234
07:29:42:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GK110 [GeForce GTX 780] from 140.163.4.234
07:29:42:WU00:FS01:Connecting to 140.163.4.234:8080
07:29:43:WU00:FS01:Downloading 3.27MiB
07:29:44:WU00:FS01:Download complete
07:29:44:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:10478 run:1 clone:118 gen:4 core:0x18 unit:0x0000000b538b3dba548f6fbda2ab36c1
07:29:51:WU02:FS01:0x18:Saving result file logfile_01.txt
07:29:51:WU02:FS01:0x18:Saving result file checkpointState.xml
07:29:52:WU02:FS01:0x18:Saving result file checkpt.crc
07:29:52:WU02:FS01:0x18:Saving result file log.txt
07:29:53:WU02:FS01:0x18:Saving result file positions.xtc
07:29:54:WU02:FS01:0x18:Folding@home Core Shutdown: FINISHED_UNIT
07:29:54:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
07:29:54:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:10478 run:1 clone:267 gen:1 core:0x18 unit:0x00000001538b3dba548f72744d9ef4a6
07:29:54:WU02:FS01:Uploading 8.77MiB to 140.163.4.234
07:29:54:WU02:FS01:Connecting to 140.163.4.234:8080
07:29:54:WU00:FS01:Starting
07:29:54:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/John Bond/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe" -dir 00 -suffix 01 -version 704 -lifeline 4056 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
07:29:54:WU00:FS01:Started FahCore on PID 13276
07:29:54:WU00:FS01:Core PID:14280
07:29:54:WU00:FS01:FahCore 0x18 started
07:29:55:WU00:FS01:0x18:*********************** Log Started 2015-01-13T07:29:54Z ***********************
07:29:55:WU00:FS01:0x18:Project: 10478 (Run 1, Clone 118, Gen 4)
07:29:55:WU00:FS01:0x18:Unit: 0x0000000b538b3dba548f6fbda2ab36c1
07:29:55:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
07:29:55:WU00:FS01:0x18:Machine: 1
07:29:55:WU00:FS01:0x18:Reading tar file state.xml
07:29:55:WU00:FS01:0x18:Reading tar file system.xml
07:29:56:WU00:FS01:0x18:Reading tar file integrator.xml
07:29:56:WU00:FS01:0x18:Reading tar file core.xml
07:29:56:WU00:FS01:0x18:Digital signatures verified
07:29:56:WU00:FS01:0x18:Folding@home GPU core18
07:29:56:WU00:FS01:0x18:Version 0.0.3
07:30:00:WU02:FS01:Upload 17.82%
07:30:06:WU02:FS01:Upload 36.36%
07:30:12:WU02:FS01:Upload 55.61%
07:30:16:WU00:FS01:0x18:Completed 0 out of 5000000 steps (0%)
07:30:16:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
07:30:18:WU02:FS01:Upload 74.86%
07:30:24:WU02:FS01:Upload 93.39%
07:30:33:WU02:FS01:Upload complete
07:30:33:WU02:FS01:Server responded WORK_ACK (400)
07:30:33:WU02:FS01:Final credit estimate, 32339.00 points
07:30:33:WU02:FS01:Cleaning up
07:35:45:WU00:FS01:0x18:Completed 50000 out of 5000000 steps (1%)
07:41:10:WU00:FS01:0x18:Completed 100000 out of 5000000 steps (2%)
07:46:41:WU00:FS01:0x18:Completed 150000 out of 5000000 steps (3%)
07:52:06:WU00:FS01:0x18:Completed 200000 out of 5000000 steps (4%)
07:57:29:WU00:FS01:0x18:Completed 250000 out of 5000000 steps (5%)
08:03:00:WU00:FS01:0x18:Completed 300000 out of 5000000 steps (6%)
08:08:22:WU00:FS01:0x18:Completed 350000 out of 5000000 steps (7%)
08:13:56:WU00:FS01:0x18:Completed 400000 out of 5000000 steps (8%)
08:19:20:WU00:FS01:0x18:Completed 450000 out of 5000000 steps (9%)
08:24:46:WU00:FS01:0x18:Completed 500000 out of 5000000 steps (10%)
08:30:18:WU00:FS01:0x18:Completed 550000 out of 5000000 steps (11%)
08:35:43:WU00:FS01:0x18:Completed 600000 out of 5000000 steps (12%)
08:41:15:WU00:FS01:0x18:Completed 650000 out of 5000000 steps (13%)
08:46:39:WU00:FS01:0x18:Completed 700000 out of 5000000 steps (14%)
08:52:04:WU00:FS01:0x18:Completed 750000 out of 5000000 steps (15%)
08:57:35:WU00:FS01:0x18:Completed 800000 out of 5000000 steps (16%)
09:03:01:WU00:FS01:0x18:Completed 850000 out of 5000000 steps (17%)
09:08:32:WU00:FS01:0x18:Completed 900000 out of 5000000 steps (18%)
09:13:57:WU00:FS01:0x18:Completed 950000 out of 5000000 steps (19%)
09:19:22:WU00:FS01:0x18:Completed 1000000 out of 5000000 steps (20%)
09:24:54:WU00:FS01:0x18:Completed 1050000 out of 5000000 steps (21%)
09:30:18:WU00:FS01:0x18:Completed 1100000 out of 5000000 steps (22%)
09:35:50:WU00:FS01:0x18:Completed 1150000 out of 5000000 steps (23%)
09:41:14:WU00:FS01:0x18:Completed 1200000 out of 5000000 steps (24%)
09:46:39:WU00:FS01:0x18:Completed 1250000 out of 5000000 steps (25%)
09:52:11:WU00:FS01:0x18:Completed 1300000 out of 5000000 steps (26%)
09:57:36:WU00:FS01:0x18:Completed 1350000 out of 5000000 steps (27%)
10:03:09:WU00:FS01:0x18:Completed 1400000 out of 5000000 steps (28%)
10:07:21:WU01:FS00:0xa3:Completed 5000 out of 500000 steps  (1%)
10:08:34:WU00:FS01:0x18:Completed 1450000 out of 5000000 steps (29%)
10:13:58:WU00:FS01:0x18:Completed 1500000 out of 5000000 steps (30%)
10:19:30:WU00:FS01:0x18:Completed 1550000 out of 5000000 steps (31%)
10:24:55:WU00:FS01:0x18:Completed 1600000 out of 5000000 steps (32%)
******************************* Date: 2015-01-13 *******************************
10:30:27:WU00:FS01:0x18:Completed 1650000 out of 5000000 steps (33%)
10:35:54:WU00:FS01:0x18:Completed 1700000 out of 5000000 steps (34%)
10:41:19:WU00:FS01:0x18:Completed 1750000 out of 5000000 steps (35%)
10:46:52:WU00:FS01:0x18:Completed 1800000 out of 5000000 steps (36%)
10:52:22:WU00:FS01:0x18:Completed 1850000 out of 5000000 steps (37%)
10:58:00:WU00:FS01:0x18:Completed 1900000 out of 5000000 steps (38%)
11:03:26:WU00:FS01:0x18:Completed 1950000 out of 5000000 steps (39%)
11:08:55:WU00:FS01:0x18:Completed 2000000 out of 5000000 steps (40%)
11:14:29:WU00:FS01:0x18:Completed 2050000 out of 5000000 steps (41%)
11:19:59:WU00:FS01:0x18:Completed 2100000 out of 5000000 steps (42%)
11:25:34:WU00:FS01:0x18:Completed 2150000 out of 5000000 steps (43%)
11:31:03:WU00:FS01:0x18:Completed 2200000 out of 5000000 steps (44%)
11:36:38:WU00:FS01:0x18:Completed 2250000 out of 5000000 steps (45%)
11:42:12:WU00:FS01:0x18:Completed 2300000 out of 5000000 steps (46%)
11:47:39:WU00:FS01:0x18:Completed 2350000 out of 5000000 steps (47%)
11:48:50:Removing old file 'configs/config-20141229-183150.xml'
11:48:50:Saving configuration to config.xml
11:48:50:<config>
11:48:50:  <!-- Network -->
11:48:50:  <proxy v=':8080'/>
11:48:50:
11:48:50:  <!-- Slot Control -->
11:48:50:  <pause-on-start v='true'/>
11:48:50:  <power v='full'/>
11:48:50:
11:48:50:  <!-- User Information -->
11:48:50:  <passkey v='********************************'/>
11:48:50:  <user v='Michtifertz'/>
11:48:50:
11:48:50:  <!-- Folding Slots -->
11:48:50:  <slot id='1' type='GPU'/>
11:48:50:</config>
11:48:51:FS00:Shutting core down
11:48:54:WU01:FS00:0xa3:Client no longer detected. Shutting down core 
11:48:54:WU01:FS00:0xa3:
11:48:54:WU01:FS00:0xa3:Folding@home Core Shutdown: CLIENT_DIED
11:48:54:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
11:48:54:WARNING:WU01:Slot ID 0 no longer exists and there are no other matching slots, dumping
11:48:54:WU01:Sending unit results: id:01 state:SEND error:DUMPED project:6096 run:6 clone:87 gen:88 core:0xa3 unit:0x000000a80a3b1e594f1afa4ce5539655
11:48:54:WU01:Connecting to 128.143.231.202:8080
11:48:55:WU01:Server responded WORK_ACK (400)
11:48:55:WU01:Cleaning up
11:48:59:Removing old file 'configs/config-20150102-113311.xml'
11:48:59:Saving configuration to config.xml
11:48:59:<config>
11:48:59:  <!-- Network -->
11:48:59:  <proxy v=':8080'/>
11:48:59:
11:48:59:  <!-- Slot Control -->
11:48:59:  <pause-on-start v='true'/>
11:48:59:  <power v='full'/>
11:48:59:
11:48:59:  <!-- User Information -->
11:48:59:  <passkey v='********************************'/>
11:48:59:  <user v='Michtifertz'/>
11:48:59:
11:48:59:  <!-- Folding Slots -->
11:48:59:  <slot id='1' type='GPU'/>
11:48:59:</config>
11:49:45:Adding folding slot 00: PAUSED cpu:12 (by user)
11:49:45:Removing old file 'configs/config-20150103-025619.xml'
11:49:45:Saving configuration to config.xml
11:49:45:<config>
11:49:45:  <!-- Network -->
11:49:45:  <proxy v=':8080'/>
11:49:45:
11:49:45:  <!-- Slot Control -->
11:49:45:  <pause-on-start v='true'/>
11:49:45:  <power v='full'/>
11:49:45:
11:49:45:  <!-- User Information -->
11:49:45:  <passkey v='********************************'/>
11:49:45:  <user v='Michtifertz'/>
11:49:45:
11:49:45:  <!-- Folding Slots -->
11:49:45:  <slot id='1' type='GPU'/>
11:49:45:  <slot id='0' type='CPU'>
11:49:45:    <cpus v='12'/>
11:49:45:  </slot>
11:49:45:</config>
11:49:48:FS00:Unpaused
11:49:49:WU01:FS00:Connecting to 171.67.108.200:8080
11:49:49:WU01:FS00:Assigned to work server 171.64.65.124
11:49:49:WU01:FS00:Requesting new work unit for slot 00: READY cpu:12 from 171.64.65.124
11:49:49:WU01:FS00:Connecting to 171.64.65.124:8080
11:49:50:WU01:FS00:Downloading 891.87KiB
11:49:53:WU01:FS00:Download complete
11:49:53:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9012 run:621 clone:5 gen:13 core:0xa4 unit:0x00000013664f2de4548af9abb5bdf9f6
11:49:53:WU01:FS00:Starting
11:49:53:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/John Bond/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe" -dir 01 -suffix 01 -version 704 -lifeline 4056 -checkpoint 15 -np 12
11:49:53:WU01:FS00:Started FahCore on PID 16032
11:49:54:WU01:FS00:Core PID:7428
11:49:54:WU01:FS00:FahCore 0xa4 started
11:49:54:WU01:FS00:0xa4:
11:49:54:WU01:FS00:0xa4:*------------------------------*
11:49:54:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
11:49:54:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
11:49:54:WU01:FS00:0xa4:
11:49:54:WU01:FS00:0xa4:Preparing to commence simulation
11:49:54:WU01:FS00:0xa4:- Looking at optimizations...
11:49:54:WU01:FS00:0xa4:- Created dyn
11:49:54:WU01:FS00:0xa4:- Files status OK
11:49:54:WU01:FS00:0xa4:- Expanded 912767 -> 1513440 (decompressed 165.8 percent)
11:49:54:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=912767 data_size=1513440, decompressed_data_size=1513440 diff=0
11:49:54:WU01:FS00:0xa4:- Digital signature verified
11:49:54:WU01:FS00:0xa4:
11:49:54:WU01:FS00:0xa4:Project: 9012 (Run 621, Clone 5, Gen 13)
11:49:54:WU01:FS00:0xa4:
11:49:54:WU01:FS00:0xa4:Assembly optimizations on if available.
11:49:54:WU01:FS00:0xa4:Entering M.D.
11:50:00:Removing old file 'configs/config-20150103-152842.xml'
11:50:00:Saving configuration to config.xml
11:50:00:<config>
11:50:00:  <!-- Network -->
11:50:00:  <proxy v=':8080'/>
11:50:00:
11:50:00:  <!-- Slot Control -->
11:50:00:  <pause-on-start v='true'/>
11:50:00:  <power v='full'/>
11:50:00:
11:50:00:  <!-- User Information -->
11:50:00:  <passkey v='********************************'/>
11:50:00:  <user v='Michtifertz'/>
11:50:00:
11:50:00:  <!-- Folding Slots -->
11:50:00:  <slot id='1' type='GPU'/>
11:50:00:  <slot id='0' type='CPU'>
11:50:00:    <cpus v='12'/>
11:50:00:  </slot>
11:50:00:</config>
11:50:00:WU01:FS00:0xa4:Mapping NT from 12 to 12 
11:50:26:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
11:53:12:WU00:FS01:0x18:Completed 2400000 out of 5000000 steps (48%)
11:58:39:WU00:FS01:0x18:Completed 2450000 out of 5000000 steps (49%)
12:04:05:WU00:FS01:0x18:Completed 2500000 out of 5000000 steps (50%)
12:09:39:WU00:FS01:0x18:Completed 2550000 out of 5000000 steps (51%)
12:15:04:WU00:FS01:0x18:Completed 2600000 out of 5000000 steps (52%)
12:20:37:WU00:FS01:0x18:Completed 2650000 out of 5000000 steps (53%)
12:21:22:FS01:Paused
12:21:22:FS00:Paused
12:21:22:FS01:Shutting core down
12:21:22:FS00:Shutting core down
12:21:22:WU00:FS01:0x18:WARNING:Console control signal 1 on PID 14280
12:21:22:WU00:FS01:0x18:Exiting, please wait. . .
12:21:22:WU00:FS01:0x18:Lost lifeline PID 13276, exiting
12:21:22:WU00:FS01:0x18:ERROR:103: Lost client lifeline
12:21:22:WU00:FS01:0x18:Folding@home Core Shutdown: CLIENT_DIED
12:21:23:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
12:21:24:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
12:21:31:Removing old file 'configs/config-20150103-210109.xml'
12:21:31:Saving configuration to config.xml
12:21:31:<config>
12:21:31:  <!-- Network -->
12:21:31:  <proxy v=':8080'/>
12:21:31:
12:21:31:  <!-- Slot Control -->
12:21:31:  <pause-on-start v='true'/>
12:21:31:  <power v='full'/>
12:21:31:
12:21:31:  <!-- User Information -->
12:21:31:  <passkey v='********************************'/>
12:21:31:  <user v='Michtifertz'/>
12:21:31:
12:21:31:  <!-- Folding Slots -->
12:21:31:  <slot id='1' type='GPU'>
12:21:31:    <paused v='true'/>
12:21:31:  </slot>
12:21:31:  <slot id='0' type='CPU'>
12:21:31:    <cpus v='12'/>
12:21:31:    <paused v='true'/>
12:21:31:  </slot>
12:21:31:</config>

It's using 12 threads. 6 cores, yes.

[Joe_H]

You need to reserve a core to be used by the GPU folding slot. Otherwise the interruption in processing caused by the CPU usage needed to keep the GPU slot active will greatly slow down folding on your CPU slot. Since 11 is a "large prime" as far as folding is concerned, the maximum number of threads you can usefully assign to CPU folding is 10.

[Michtifertz]

OK, trying that out. Thanks.

[heikosch]

Or you use a program like SetPriority.exe to set the FahCore processes a higher base priority.

Heiko

[bruce]

Or you use a program like SetPriority.exe to set the FahCore processes a higher base priority.

Heiko

That doesn't solve the problem of the interruptions of the CPU FahCore by the GPU FahCore desynchronizing the threads. The CPU FahCore runs better when all of the threads are on CPUs which are otherwise idle. See Joe_H's post, above.

[Michtifertz]

I set it to 10 threads and it got a lot faster. This is still using hyper threading, though. Does that matter?

[Joe_H]

Hyper threading still contributes to speeding up the calculations done by the CPU folding core. However each additional thread done through HT does not improve the processing time as much as an additional CPU core by itself. So the 10 threads, 6 on a core plus 4 from HT, instead of being 2/3 faster than 6 threads alone will be about a 1/3 faster depending on the exact WU and folding core involved.