GPU points are not noticed

If you think it might be a driver problem, see viewforum.php?f=79

Moderators: Site Moderators, FAHC Science Team

Folder_0815
Posts: 25
Joined: Wed May 20, 2020 11:00 pm

GPU points are not noticed

Post by Folder_0815 »

Hello everybody,
on my laptop, two tasks are running nicely since 5 weeks,
one on the CPU and one on the GPU.
The points received from WUs completed on the CPU are visible in the online stats (more than 500.000)
However the points for the WUs completed on the GPU appear nowhere.

Recently I had a WU which was announced to run for 5+ days . It finished already afer 4+ days, much below the maximum timelimit.
It provided 61000 points, but these points were never added to my score.

It studied already thoroughly the FAQs how to do the setup,
and as I mentioned before, with the CPU everything works fine.

I read as well a similar post about such a problem here: "GPU work units are not counting to my score" ( viewtopic.php?f=74&t=33867 )
This doesn't apply for me.

Please check my log file:

Code: Select all

14:20:05:WU02:FS00:0xa7:Completed 385000 out of 500000 steps (77%)
14:22:55:WU02:FS00:0xa7:Completed 390000 out of 500000 steps (78%)
14:25:45:WU02:FS00:0xa7:Completed 395000 out of 500000 steps (79%)
14:28:35:WU02:FS00:0xa7:Completed 400000 out of 500000 steps (80%)
14:30:52:301:127.0.0.1:New Web connection
14:31:01:FS00:Shutting core down
14:31:01:WU01:FS01:Starting
14:31:01:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\<user>\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 705 -lifeline 12256 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device 0 -gpu 0
14:31:01:WU01:FS01:Started FahCore on PID 10824
14:31:01:WU01:FS01:Core PID:5612
14:31:01:WU01:FS01:FahCore 0x22 started
14:31:01:WU02:FS00:0xa7:WARNING:Console control signal 1 on PID 7456
14:31:01:WU02:FS00:0xa7:Exiting, please wait. . .
14:31:01:WU01:FS01:0x22:*********************** Log Started 2020-05-21T14:31:01Z ***********************
14:31:01:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
14:31:01:WU01:FS01:0x22:       Type: 0x22
14:31:01:WU01:FS01:0x22:       Core: Core22
14:31:01:WU01:FS01:0x22:    Website: https://foldingathome.org/
14:31:01:WU01:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
14:31:01:WU01:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
14:31:01:WU01:FS01:0x22:             <rafal.wiewiora@choderalab.org>
14:31:01:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 705 -lifeline 10824 -checkpoint 15
14:31:01:WU01:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device
14:31:01:WU01:FS01:0x22:             0 -gpu 0
14:31:01:WU01:FS01:0x22:     Config: <none>
14:31:01:WU01:FS01:0x22:************************************ Build *************************************
14:31:01:WU01:FS01:0x22:    Version: 0.0.5
14:31:01:WU01:FS01:0x22:       Date: Apr 22 2020
14:31:01:WU01:FS01:0x22:       Time: 04:42:59
14:31:01:WU01:FS01:0x22: Repository: Git
14:31:01:WU01:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
14:31:01:WU01:FS01:0x22:     Branch: HEAD
14:31:01:WU01:FS01:0x22:   Compiler: Visual C++ 2008
14:31:01:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
14:31:01:WU01:FS01:0x22:   Platform: win32 10
14:31:01:WU01:FS01:0x22:       Bits: 64
14:31:01:WU01:FS01:0x22:       Mode: Release
14:31:01:WU01:FS01:0x22:************************************ System ************************************
14:31:01:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i7-3820QM CPU @ 2.70GHz
14:31:01:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
14:31:01:WU01:FS01:0x22:       CPUs: 8
14:31:01:WU01:FS01:0x22:     Memory: 15.58GiB
14:31:01:WU01:FS01:0x22:Free Memory: 12.05GiB
14:31:01:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
14:31:01:WU01:FS01:0x22: OS Version: 6.2
14:31:01:WU01:FS01:0x22:Has Battery: true
14:31:01:WU01:FS01:0x22: On Battery: false
14:31:01:WU01:FS01:0x22: UTC Offset: 2
14:31:01:WU01:FS01:0x22:        PID: 5612
14:31:01:WU01:FS01:0x22:        CWD: C:\Users\<user>\AppData\Roaming\FAHClient\work
14:31:01:WU01:FS01:0x22:         OS: Windows 10 Pro
14:31:01:WU01:FS01:0x22:    OS Arch: AMD64
14:31:01:WU01:FS01:0x22:********************************************************************************
14:31:01:WU01:FS01:0x22:Project: 14251 (Run 71, Clone 3, Gen 25)
14:31:01:WU01:FS01:0x22:Unit: 0x0000002acedfaa925eab032302785d08
14:31:01:WU01:FS01:0x22:Digital signatures verified
14:31:01:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
14:31:01:WU01:FS01:0x22:Version 0.0.5
14:31:01:WU01:FS01:0x22:  Found a checkpoint file
14:31:02:WU02:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
14:31:02:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
14:31:02:WU02:FS00:Starting
14:31:02:WARNING:WU02:FS00:Changed SMP threads from 3 to 7 this can cause some work units to fail
14:31:02:WARNING:WU02:FS00:AS lowered CPUs from 7 to 3
14:31:02:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\<user>\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 705 -lifeline 12256 -checkpoint 15 -np 3
14:31:02:WU02:FS00:Started FahCore on PID 9500
14:31:02:WU02:FS00:Core PID:12056
14:31:02:WU02:FS00:FahCore 0xa7 started
14:31:03:WU02:FS00:0xa7:*********************** Log Started 2020-05-21T14:31:02Z ***********************
14:31:03:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
14:31:03:WU02:FS00:0xa7:       Type: 0xa7
14:31:03:WU02:FS00:0xa7:       Core: Gromacs
14:31:03:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 9500 -checkpoint 15 -np 3
14:31:03:WU02:FS00:0xa7:************************************ CBang *************************************
14:31:03:WU02:FS00:0xa7:       Date: Oct 26 2019
14:31:03:WU02:FS00:0xa7:       Time: 01:38:25
14:31:03:WU02:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
14:31:03:WU02:FS00:0xa7:     Branch: master
14:31:03:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
14:31:03:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
14:31:03:WU02:FS00:0xa7:   Platform: win32 10
14:31:03:WU02:FS00:0xa7:       Bits: 64
14:31:03:WU02:FS00:0xa7:       Mode: Release
14:31:03:WU02:FS00:0xa7:************************************ System ************************************
14:31:03:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-3820QM CPU @ 2.70GHz
14:31:03:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
14:31:03:WU02:FS00:0xa7:       CPUs: 8
14:31:03:WU02:FS00:0xa7:     Memory: 15.58GiB
14:31:03:WU02:FS00:0xa7:Free Memory: 11.86GiB
14:31:03:WU02:FS00:0xa7:    Threads: WINDOWS_THREADS
14:31:03:WU02:FS00:0xa7: OS Version: 6.2
14:31:03:WU02:FS00:0xa7:Has Battery: true
14:31:03:WU02:FS00:0xa7: On Battery: false
14:31:03:WU02:FS00:0xa7: UTC Offset: 2
14:31:03:WU02:FS00:0xa7:        PID: 12056
14:31:03:WU02:FS00:0xa7:        CWD: C:\Users\<user>\AppData\Roaming\FAHClient\work
14:31:03:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
14:31:03:WU02:FS00:0xa7:    Version: 0.0.18
14:31:03:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:31:03:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
14:31:03:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
14:31:03:WU02:FS00:0xa7:       Date: Oct 26 2019
14:31:03:WU02:FS00:0xa7:       Time: 01:52:30
14:31:03:WU02:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
14:31:03:WU02:FS00:0xa7:     Branch: master
14:31:03:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
14:31:03:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
14:31:03:WU02:FS00:0xa7:   Platform: win32 10
14:31:03:WU02:FS00:0xa7:       Bits: 64
14:31:03:WU02:FS00:0xa7:       Mode: Release
14:31:03:WU02:FS00:0xa7:************************************ Build *************************************
14:31:03:WU02:FS00:0xa7:       SIMD: avx_256
14:31:03:WU02:FS00:0xa7:********************************************************************************
14:31:03:WU02:FS00:0xa7:Project: 16438 (Run 0, Clone 1526, Gen 44)
14:31:03:WU02:FS00:0xa7:Unit: 0x0000003580fccb015ea74d7605ad5e54
14:31:03:WU02:FS00:0xa7:Digital signatures verified
14:31:03:WU02:FS00:0xa7:Calling: mdrun -s frame44.tpr -o frame44.trr -x frame44.xtc -cpi state.cpt -cpt 15 -nt 3
14:31:03:WU02:FS00:0xa7:Steps: first=22000000 total=500000
14:31:04:WU02:FS00:0xa7:Completed 404322 out of 500000 steps (80%)
14:31:23:Removing old file 'configs/config-20200520-060854.xml'
14:31:23:Saving configuration to config.xml
14:31:23:<config>
14:31:23:  <!-- Network -->
14:31:23:  <proxy v=':8080'/>
14:31:23:
14:31:23:  <!-- Slot Control -->
14:31:23:  <power v='FULL'/>
14:31:23:
14:31:23:  <!-- User Information -->
14:31:23:  <passkey v='********************************'/>
14:31:23:  <team v='261734'/>
14:31:23:  <user v='Folder_0817'/>
14:31:23:
14:31:23:  <!-- Folding Slots -->
14:31:23:  <slot id='0' type='CPU'/>
14:31:23:  <slot id='1' type='GPU'/>
14:31:23:</config>
14:31:24:WU02:FS00:0xa7:Completed 405000 out of 500000 steps (81%)
14:31:44:WU01:FS01:0x22:Completed 40000 out of 500000 steps (8%)
14:31:45:WU01:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
14:33:54:WU02:FS00:0xa7:Completed 410000 out of 500000 steps (82%)

14:55:26:WU02:FS00:0xa7:Completed 455000 out of 500000 steps (91%)
******************************* Date: 2020-05-21 *******************************
14:57:47:WU02:FS00:0xa7:Completed 460000 out of 500000 steps (92%)

15:14:16:WU02:FS00:0xa7:Completed 495000 out of 500000 steps (99%)
15:14:16:WU00:FS00:Connecting to 65.254.110.245:8080
15:14:16:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
15:14:16:WU00:FS00:Connecting to 18.218.241.186:80
15:14:17:WU00:FS00:Assigned to work server 143.89.243.111
15:14:17:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:7 from 143.89.243.111
15:14:17:WU00:FS00:Connecting to 143.89.243.111:8080
15:14:18:ERROR:WU00:FS00:Exception: Server did not assign work unit
15:14:18:WU00:FS00:Connecting to 65.254.110.245:8080
15:14:18:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
15:14:18:WU00:FS00:Connecting to 18.218.241.186:80
15:14:19:WU00:FS00:Assigned to work server 143.89.243.111
15:14:19:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:7 from 143.89.243.111
15:14:19:WU00:FS00:Connecting to 143.89.243.111:8080
15:14:20:ERROR:WU00:FS00:Exception: Server did not assign work unit
15:15:18:WU00:FS00:Connecting to 65.254.110.245:8080
15:15:18:WU00:FS00:Assigned to work server 128.252.203.1
15:15:19:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:7 from 128.252.203.1
15:15:19:WU00:FS00:Connecting to 128.252.203.1:8080
15:15:20:WU00:FS00:Downloading 1.33MiB
15:15:26:WU00:FS00:Download 37.54%
15:15:32:WU00:FS00:Download 84.46%
15:15:36:WU00:FS00:Download complete
15:15:36:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:16438 run:0 clone:2642 gen:77 core:0xa7 unit:0x0000005580fccb015ea74d5e83959484
15:16:37:WU02:FS00:0xa7:Completed 500000 out of 500000 steps (100%)
15:16:38:WU02:FS00:0xa7:Saving result file ..\logfile_01.txt
15:16:38:WU02:FS00:0xa7:Saving result file frame44.trr
15:16:38:WU02:FS00:0xa7:Saving result file frame44.xtc
15:16:38:WU02:FS00:0xa7:Saving result file md.log
15:16:38:WU02:FS00:0xa7:Saving result file science.log
15:16:38:WU02:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
15:16:39:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
15:16:39:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:16438 run:0 clone:1526 gen:44 core:0xa7 unit:0x0000003580fccb015ea74d7605ad5e54
15:16:39:WU02:FS00:Uploading 1.46MiB to 128.252.203.1
15:16:39:WU02:FS00:Connecting to 128.252.203.1:8080
15:16:39:WU00:FS00:Starting
15:16:39:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\<user>\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 705 -lifeline 12256 -checkpoint 15 -np 7
15:16:39:WU00:FS00:Started FahCore on PID 4044
15:16:39:WU00:FS00:Core PID:5608
15:16:39:WU00:FS00:FahCore 0xa7 started
15:16:39:WU00:FS00:0xa7:*********************** Log Started 2020-05-21T15:16:39Z ***********************
15:16:39:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
15:16:39:WU00:FS00:0xa7:       Type: 0xa7
15:16:39:WU00:FS00:0xa7:       Core: Gromacs
15:16:39:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 4044 -checkpoint 15 -np 7
15:16:39:WU00:FS00:0xa7:************************************ CBang *************************************
15:16:39:WU00:FS00:0xa7:       Date: Oct 26 2019
15:16:39:WU00:FS00:0xa7:       Time: 01:38:25
15:16:39:WU00:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
15:16:39:WU00:FS00:0xa7:     Branch: master
15:16:39:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
15:16:39:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
15:16:39:WU00:FS00:0xa7:   Platform: win32 10
15:16:39:WU00:FS00:0xa7:       Bits: 64
15:16:39:WU00:FS00:0xa7:       Mode: Release
15:16:39:WU00:FS00:0xa7:************************************ System ************************************
15:16:39:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-3820QM CPU @ 2.70GHz
15:16:39:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
15:16:39:WU00:FS00:0xa7:       CPUs: 8
15:16:39:WU00:FS00:0xa7:     Memory: 15.58GiB
15:16:39:WU00:FS00:0xa7:Free Memory: 11.22GiB
15:16:39:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
15:16:39:WU00:FS00:0xa7: OS Version: 6.2
15:16:39:WU00:FS00:0xa7:Has Battery: true
15:16:39:WU00:FS00:0xa7: On Battery: false
15:16:39:WU00:FS00:0xa7: UTC Offset: 2
15:16:39:WU00:FS00:0xa7:        PID: 5608
15:16:39:WU00:FS00:0xa7:        CWD: C:\Users\<user>\AppData\Roaming\FAHClient\work
15:16:39:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
15:16:39:WU00:FS00:0xa7:    Version: 0.0.18
15:16:39:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:16:39:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
15:16:39:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
15:16:39:WU00:FS00:0xa7:       Date: Oct 26 2019
15:16:39:WU00:FS00:0xa7:       Time: 01:52:30
15:16:39:WU00:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
15:16:39:WU00:FS00:0xa7:     Branch: master
15:16:39:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
15:16:39:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
15:16:39:WU00:FS00:0xa7:   Platform: win32 10
15:16:39:WU00:FS00:0xa7:       Bits: 64
15:16:39:WU00:FS00:0xa7:       Mode: Release
15:16:39:WU00:FS00:0xa7:************************************ Build *************************************
15:16:39:WU00:FS00:0xa7:       SIMD: avx_256
15:16:39:WU00:FS00:0xa7:********************************************************************************
15:16:39:WU00:FS00:0xa7:Project: 16438 (Run 0, Clone 2642, Gen 77)
15:16:39:WU00:FS00:0xa7:Unit: 0x0000005580fccb015ea74d5e83959484
15:16:39:WU00:FS00:0xa7:Reading tar file core.xml
15:16:39:WU00:FS00:0xa7:Reading tar file frame77.tpr
15:16:39:WU00:FS00:0xa7:Digital signatures verified
15:16:39:WU00:FS00:0xa7:Reducing thread count from 7 to 6 to avoid domain decomposition by a prime number > 3
15:16:39:WU00:FS00:0xa7:Calling: mdrun -s frame77.tpr -o frame77.trr -x frame77.xtc -cpt 15 -nt 6
15:16:39:WU00:FS00:0xa7:Steps: first=38500000 total=500000
15:16:40:WU00:FS00:0xa7:Completed 1 out of 500000 steps (0%)
15:16:43:WU02:FS00:Upload complete
15:16:43:WU02:FS00:Server responded WORK_ACK (400)
15:16:43:WU02:FS00:Final credit estimate, 2836.00 points
15:16:43:WU02:FS00:Cleaning up
15:19:02:WU00:FS00:0xa7:Completed 5000 out of 500000 steps (1%)

16:57:37:WU00:FS00:0xa7:Completed 210000 out of 500000 steps (42%)
16:57:45:FS00:Shutting core down
16:57:45:FS01:Shutting core down
16:57:45:WU01:FS01:0x22:WARNING:Console control signal 1 on PID 5612
16:57:45:WU01:FS01:0x22:Exiting, please wait. . .
16:57:45:WU00:FS00:0xa7:WARNING:Console control signal 1 on PID 5608
16:57:45:WU00:FS00:0xa7:Exiting, please wait. . .
16:57:46:WU01:FS01:0x22:Folding@home Core Shutdown: INTERRUPTED
16:57:47:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
16:57:47:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
16:57:47:Removing old file 'configs/config-20200520-064126.xml'
16:57:47:Saving configuration to config.xml
16:57:47:<config>
16:57:47:  <!-- Network -->
16:57:47:  <proxy v=':8080'/>
16:57:47:
16:57:47:  <!-- Slot Control -->
16:57:47:  <power v='LIGHT'/>
16:57:47:
16:57:47:  <!-- User Information -->
16:57:47:  <passkey v='********************************'/>
16:57:47:  <team v='261734'/>
16:57:47:  <user v='Folder_0817'/>
16:57:47:
16:57:47:  <!-- Folding Slots -->
16:57:47:  <slot id='0' type='CPU'/>
16:57:47:  <slot id='1' type='GPU'/>
16:57:47:</config>
16:57:47:WU00:FS00:Starting
16:57:47:WARNING:WU00:FS00:Changed SMP threads from 7 to 3 this can cause some work units to fail
16:57:47:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\<user>\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 705 -lifeline 12256 -checkpoint 15 -np 3
16:57:47:WU00:FS00:Started FahCore on PID 7184
16:57:47:WU00:FS00:Core PID:5776
16:57:47:WU00:FS00:FahCore 0xa7 started
16:57:48:WU00:FS00:0xa7:*********************** Log Started 2020-05-21T16:57:47Z ***********************
16:57:48:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
16:57:48:WU00:FS00:0xa7:       Type: 0xa7
16:57:48:WU00:FS00:0xa7:       Core: Gromacs
16:57:48:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 7184 -checkpoint 15 -np 3
16:57:48:WU00:FS00:0xa7:************************************ CBang *************************************
16:57:48:WU00:FS00:0xa7:       Date: Oct 26 2019
16:57:48:WU00:FS00:0xa7:       Time: 01:38:25
16:57:48:WU00:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
16:57:48:WU00:FS00:0xa7:     Branch: master
16:57:48:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
16:57:48:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:57:48:WU00:FS00:0xa7:   Platform: win32 10
16:57:48:WU00:FS00:0xa7:       Bits: 64
16:57:48:WU00:FS00:0xa7:       Mode: Release
16:57:48:WU00:FS00:0xa7:************************************ System ************************************
16:57:48:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-3820QM CPU @ 2.70GHz
16:57:48:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
16:57:48:WU00:FS00:0xa7:       CPUs: 8
16:57:48:WU00:FS00:0xa7:     Memory: 15.58GiB
16:57:48:WU00:FS00:0xa7:Free Memory: 11.67GiB
16:57:48:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
16:57:48:WU00:FS00:0xa7: OS Version: 6.2
16:57:48:WU00:FS00:0xa7:Has Battery: true
16:57:48:WU00:FS00:0xa7: On Battery: false
16:57:48:WU00:FS00:0xa7: UTC Offset: 2
16:57:48:WU00:FS00:0xa7:        PID: 5776
16:57:48:WU00:FS00:0xa7:        CWD: C:\Users\<user>\AppData\Roaming\FAHClient\work
16:57:48:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
16:57:48:WU00:FS00:0xa7:    Version: 0.0.18
16:57:48:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
16:57:48:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
16:57:48:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
16:57:48:WU00:FS00:0xa7:       Date: Oct 26 2019
16:57:48:WU00:FS00:0xa7:       Time: 01:52:30
16:57:48:WU00:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
16:57:48:WU00:FS00:0xa7:     Branch: master
16:57:48:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
16:57:48:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
16:57:48:WU00:FS00:0xa7:   Platform: win32 10
16:57:48:WU00:FS00:0xa7:       Bits: 64
16:57:48:WU00:FS00:0xa7:       Mode: Release
16:57:48:WU00:FS00:0xa7:************************************ Build *************************************
16:57:48:WU00:FS00:0xa7:       SIMD: avx_256
16:57:48:WU00:FS00:0xa7:********************************************************************************
16:57:48:WU00:FS00:0xa7:Project: 16438 (Run 0, Clone 2642, Gen 77)
16:57:48:WU00:FS00:0xa7:Unit: 0x0000005580fccb015ea74d5e83959484
16:57:48:WU00:FS00:0xa7:Digital signatures verified
16:57:48:WU00:FS00:0xa7:Calling: mdrun -s frame77.tpr -o frame77.trr -x frame77.xtc -cpi state.cpt -cpt 15 -nt 3
16:57:48:WU00:FS00:0xa7:Steps: first=38500000 total=500000
16:57:49:WU00:FS00:0xa7:Completed 210272 out of 500000 steps (42%)

19:29:52:WU00:FS00:0xa7:Completed 495000 out of 500000 steps (99%)
19:29:53:WU02:FS00:Connecting to 65.254.110.245:8080
19:29:54:WU02:FS00:Assigned to work server 128.252.203.9
19:29:54:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 128.252.203.9
19:29:54:WU02:FS00:Connecting to 128.252.203.9:8080
19:31:10:ERROR:WU02:FS00:Exception: 10002: Received short response, expected 512 bytes, got 0
19:31:10:WU02:FS00:Connecting to 65.254.110.245:8080
19:31:11:WU02:FS00:Assigned to work server 128.252.203.9
19:31:11:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 128.252.203.9
19:31:11:WU02:FS00:Connecting to 128.252.203.9:8080
19:31:38:ERROR:WU02:FS00:Exception: 10002: Received short response, expected 512 bytes, got 0
19:32:10:WU02:FS00:Connecting to 65.254.110.245:8080
19:32:11:WU02:FS00:Assigned to work server 40.114.52.201
19:32:11:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 40.114.52.201
19:32:11:WU02:FS00:Connecting to 40.114.52.201:8080
19:32:11:WU02:FS00:Downloading 14.00MiB
19:32:16:WU02:FS00:Download complete
19:32:16:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:14578 run:0 clone:1597 gen:85 core:0xa7 unit:0x00000063287234c95e7ee9015254ddde
19:32:37:WU00:FS00:0xa7:Completed 500000 out of 500000 steps (100%)
19:32:38:WU00:FS00:0xa7:Saving result file ..\logfile_01.txt
19:32:38:WU00:FS00:0xa7:Saving result file frame77.trr
19:32:38:WU00:FS00:0xa7:Saving result file frame77.xtc
19:32:38:WU00:FS00:0xa7:Saving result file md.log
19:32:38:WU00:FS00:0xa7:Saving result file science.log
19:32:38:WU00:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
19:32:38:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:32:38:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:16438 run:0 clone:2642 gen:77 core:0xa7 unit:0x0000005580fccb015ea74d5e83959484
19:32:38:WU00:FS00:Uploading 1.45MiB to 128.252.203.1
19:32:38:WU00:FS00:Connecting to 128.252.203.1:8080
19:32:39:WU02:FS00:Starting
19:32:39:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\<user>\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 705 -lifeline 12256 -checkpoint 15 -np 3
19:32:39:WU02:FS00:Started FahCore on PID 5472
19:32:39:WU02:FS00:Core PID:4368
19:32:39:WU02:FS00:FahCore 0xa7 started
19:32:39:WU02:FS00:0xa7:*********************** Log Started 2020-05-21T19:32:39Z ***********************
19:32:39:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
19:32:39:WU02:FS00:0xa7:       Type: 0xa7
19:32:39:WU02:FS00:0xa7:       Core: Gromacs
19:32:39:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 5472 -checkpoint 15 -np 3
19:32:39:WU02:FS00:0xa7:************************************ CBang *************************************
19:32:39:WU02:FS00:0xa7:       Date: Oct 26 2019
19:32:39:WU02:FS00:0xa7:       Time: 01:38:25
19:32:39:WU02:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
19:32:39:WU02:FS00:0xa7:     Branch: master
19:32:39:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
19:32:39:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:32:39:WU02:FS00:0xa7:   Platform: win32 10
19:32:39:WU02:FS00:0xa7:       Bits: 64
19:32:39:WU02:FS00:0xa7:       Mode: Release
19:32:39:WU02:FS00:0xa7:************************************ System ************************************
19:32:39:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-3820QM CPU @ 2.70GHz
19:32:39:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
19:32:39:WU02:FS00:0xa7:       CPUs: 8
19:32:39:WU02:FS00:0xa7:     Memory: 15.58GiB
19:32:39:WU02:FS00:0xa7:Free Memory: 10.10GiB
19:32:39:WU02:FS00:0xa7:    Threads: WINDOWS_THREADS
19:32:39:WU02:FS00:0xa7: OS Version: 6.2
19:32:39:WU02:FS00:0xa7:Has Battery: true
19:32:39:WU02:FS00:0xa7: On Battery: false
19:32:39:WU02:FS00:0xa7: UTC Offset: 2
19:32:39:WU02:FS00:0xa7:        PID: 4368
19:32:39:WU02:FS00:0xa7:        CWD: C:\Users\<user>\AppData\Roaming\FAHClient\work
19:32:39:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
19:32:39:WU02:FS00:0xa7:    Version: 0.0.18
19:32:39:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
19:32:39:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
19:32:39:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
19:32:39:WU02:FS00:0xa7:       Date: Oct 26 2019
19:32:39:WU02:FS00:0xa7:       Time: 01:52:30
19:32:39:WU02:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
19:32:39:WU02:FS00:0xa7:     Branch: master
19:32:39:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
19:32:39:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
19:32:39:WU02:FS00:0xa7:   Platform: win32 10
19:32:39:WU02:FS00:0xa7:       Bits: 64
19:32:39:WU02:FS00:0xa7:       Mode: Release
19:32:39:WU02:FS00:0xa7:************************************ Build *************************************
19:32:39:WU02:FS00:0xa7:       SIMD: avx_256
19:32:39:WU02:FS00:0xa7:********************************************************************************
19:32:39:WU02:FS00:0xa7:Project: 14578 (Run 0, Clone 1597, Gen 85)
19:32:39:WU02:FS00:0xa7:Unit: 0x00000063287234c95e7ee9015254ddde
19:32:39:WU02:FS00:0xa7:Reading tar file core.xml
19:32:39:WU02:FS00:0xa7:Reading tar file frame85.tpr
19:32:39:WU02:FS00:0xa7:Digital signatures verified
19:32:39:WU02:FS00:0xa7:Calling: mdrun -s frame85.tpr -o frame85.trr -x frame85.xtc -cpt 15 -nt 3
19:32:39:WU02:FS00:0xa7:Steps: first=10625000 total=125000
19:32:43:WU00:FS00:Upload complete
19:32:43:WU00:FS00:Server responded WORK_ACK (400)
19:32:43:WU00:FS00:Final credit estimate, 2964.00 points
19:32:43:WU00:FS00:Cleaning up
19:32:44:WU02:FS00:0xa7:Completed 1 out of 125000 steps (0%)
19:38:29:WU02:FS00:0xa7:Completed 1250 out of 125000 steps (1%)

20:57:10:WU02:FS00:0xa7:Completed 21250 out of 125000 steps (17%)
******************************* Date: 2020-05-21 *******************************
21:02:40:WU02:FS00:0xa7:Completed 22500 out of 125000 steps (18%)

22:03:26:WU02:FS00:0xa7:Completed 37500 out of 125000 steps (30%)
22:04:28:404:127.0.0.1:New Web connection
22:05:32:FS00:Shutting core down
22:05:32:WU01:FS01:Starting
22:05:32:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\<user>\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 705 -lifeline 12256 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device 0 -gpu 0
22:05:32:WU02:FS00:0xa7:WARNING:Console control signal 1 on PID 4368
22:05:32:WU02:FS00:0xa7:Exiting, please wait. . .
22:05:32:WU01:FS01:Started FahCore on PID 5628
22:05:32:WU01:FS01:Core PID:2488
22:05:32:WU01:FS01:FahCore 0x22 started
22:05:33:WU01:FS01:0x22:*********************** Log Started 2020-05-21T22:05:32Z ***********************
22:05:33:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
22:05:33:WU01:FS01:0x22:       Type: 0x22
22:05:33:WU01:FS01:0x22:       Core: Core22
22:05:33:WU01:FS01:0x22:    Website: https://foldingathome.org/
22:05:33:WU01:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
22:05:33:WU01:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
22:05:33:WU01:FS01:0x22:             <rafal.wiewiora@choderalab.org>
22:05:33:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 705 -lifeline 5628 -checkpoint 15
22:05:33:WU01:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device
22:05:33:WU01:FS01:0x22:             0 -gpu 0
22:05:33:WU01:FS01:0x22:     Config: <none>
22:05:33:WU01:FS01:0x22:************************************ Build *************************************
22:05:33:WU01:FS01:0x22:    Version: 0.0.5
22:05:33:WU01:FS01:0x22:       Date: Apr 22 2020
22:05:33:WU01:FS01:0x22:       Time: 04:42:59
22:05:33:WU01:FS01:0x22: Repository: Git
22:05:33:WU01:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
22:05:33:WU01:FS01:0x22:     Branch: HEAD
22:05:33:WU01:FS01:0x22:   Compiler: Visual C++ 2008
22:05:33:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:05:33:WU01:FS01:0x22:   Platform: win32 10
22:05:33:WU01:FS01:0x22:       Bits: 64
22:05:33:WU01:FS01:0x22:       Mode: Release
22:05:33:WU01:FS01:0x22:************************************ System ************************************
22:05:33:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i7-3820QM CPU @ 2.70GHz
22:05:33:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
22:05:33:WU01:FS01:0x22:       CPUs: 8
22:05:33:WU01:FS01:0x22:     Memory: 15.58GiB
22:05:33:WU01:FS01:0x22:Free Memory: 11.86GiB
22:05:33:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
22:05:33:WU01:FS01:0x22: OS Version: 6.2
22:05:33:WU01:FS01:0x22:Has Battery: true
22:05:33:WU01:FS01:0x22: On Battery: false
22:05:33:WU01:FS01:0x22: UTC Offset: 2
22:05:33:WU01:FS01:0x22:        PID: 2488
22:05:33:WU01:FS01:0x22:        CWD: C:\Users\<user>\AppData\Roaming\FAHClient\work
22:05:33:WU01:FS01:0x22:         OS: Windows 10 Pro
22:05:33:WU01:FS01:0x22:    OS Arch: AMD64
22:05:33:WU01:FS01:0x22:********************************************************************************
22:05:33:WU01:FS01:0x22:Project: 14251 (Run 71, Clone 3, Gen 25)
22:05:33:WU01:FS01:0x22:Unit: 0x0000002acedfaa925eab032302785d08
22:05:33:WU01:FS01:0x22:Digital signatures verified
22:05:33:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
22:05:33:WU01:FS01:0x22:Version 0.0.5
22:05:33:WU01:FS01:0x22:  Found a checkpoint file
22:05:39:WU02:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
22:05:40:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
22:05:40:WU02:FS00:Starting
22:05:40:WARNING:WU02:FS00:Changed SMP threads from 3 to 7 this can cause some work units to fail
22:05:40:WARNING:WU02:FS00:AS lowered CPUs from 7 to 3
22:05:40:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\<user>\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 705 -lifeline 12256 -checkpoint 15 -np 3
22:05:40:WU02:FS00:Started FahCore on PID 8004
22:05:40:WU02:FS00:Core PID:6180
22:05:40:WU02:FS00:FahCore 0xa7 started
22:05:40:WU02:FS00:0xa7:*********************** Log Started 2020-05-21T22:05:40Z ***********************
22:05:40:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
22:05:40:WU02:FS00:0xa7:       Type: 0xa7
22:05:40:WU02:FS00:0xa7:       Core: Gromacs
22:05:40:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 8004 -checkpoint 15 -np 3
22:05:40:WU02:FS00:0xa7:************************************ CBang *************************************
22:05:40:WU02:FS00:0xa7:       Date: Oct 26 2019
22:05:40:WU02:FS00:0xa7:       Time: 01:38:25
22:05:40:WU02:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
22:05:40:WU02:FS00:0xa7:     Branch: master
22:05:40:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
22:05:40:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:05:40:WU02:FS00:0xa7:   Platform: win32 10
22:05:40:WU02:FS00:0xa7:       Bits: 64
22:05:40:WU02:FS00:0xa7:       Mode: Release
22:05:40:WU02:FS00:0xa7:************************************ System ************************************
22:05:40:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-3820QM CPU @ 2.70GHz
22:05:40:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
22:05:40:WU02:FS00:0xa7:       CPUs: 8
22:05:40:WU02:FS00:0xa7:     Memory: 15.58GiB
22:05:40:WU02:FS00:0xa7:Free Memory: 11.81GiB
22:05:40:WU02:FS00:0xa7:    Threads: WINDOWS_THREADS
22:05:40:WU02:FS00:0xa7: OS Version: 6.2
22:05:40:WU02:FS00:0xa7:Has Battery: true
22:05:40:WU02:FS00:0xa7: On Battery: false
22:05:40:WU02:FS00:0xa7: UTC Offset: 2
22:05:40:WU02:FS00:0xa7:        PID: 6180
22:05:40:WU02:FS00:0xa7:        CWD: C:\Users\<user>\AppData\Roaming\FAHClient\work
22:05:40:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
22:05:40:WU02:FS00:0xa7:    Version: 0.0.18
22:05:40:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:05:40:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
22:05:40:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
22:05:40:WU02:FS00:0xa7:       Date: Oct 26 2019
22:05:40:WU02:FS00:0xa7:       Time: 01:52:30
22:05:40:WU02:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
22:05:40:WU02:FS00:0xa7:     Branch: master
22:05:40:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
22:05:40:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:05:40:WU02:FS00:0xa7:   Platform: win32 10
22:05:40:WU02:FS00:0xa7:       Bits: 64
22:05:40:WU02:FS00:0xa7:       Mode: Release
22:05:40:WU02:FS00:0xa7:************************************ Build *************************************
22:05:40:WU02:FS00:0xa7:       SIMD: avx_256
22:05:40:WU02:FS00:0xa7:********************************************************************************
22:05:40:WU02:FS00:0xa7:Project: 14578 (Run 0, Clone 1597, Gen 85)
22:05:40:WU02:FS00:0xa7:Unit: 0x00000063287234c95e7ee9015254ddde
22:05:40:WU02:FS00:0xa7:Digital signatures verified
22:05:40:WU02:FS00:0xa7:Calling: mdrun -s frame85.tpr -o frame85.trr -x frame85.xtc -cpi state.cpt -cpt 15 -nt 3
22:05:41:WU02:FS00:0xa7:Steps: first=10625000 total=125000
22:05:45:WU02:FS00:0xa7:Completed 37992 out of 125000 steps (30%)
22:05:50:Removing old file 'configs/config-20200520-161450.xml'
22:05:50:Saving configuration to config.xml
22:05:50:<config>
22:05:50:  <!-- Network -->
22:05:50:  <proxy v=':8080'/>
22:05:50:
22:05:50:  <!-- Slot Control -->
22:05:50:  <power v='FULL'/>
22:05:50:
22:05:50:  <!-- User Information -->
22:05:50:  <passkey v='********************************'/>
22:05:50:  <team v='261734'/>
22:05:50:  <user v='Folder_0817'/>
22:05:50:
22:05:50:  <!-- Folding Slots -->
22:05:50:  <slot id='0' type='CPU'/>
22:05:50:  <slot id='1' type='GPU'/>
22:05:50:</config>
22:06:27:WU01:FS01:0x22:Completed 40000 out of 500000 steps (8%)
22:06:27:WU01:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
22:09:44:WU02:FS00:0xa7:Completed 38750 out of 125000 steps (31%)

22:45:49:WU01:FS01:0x22:Completed 45000 out of 500000 steps (9%)
22:48:45:WU02:FS00:0xa7:Completed 47500 out of 125000 steps (38%)

02:39:49:WU01:FS01:0x22:Completed 75000 out of 500000 steps (15%)
02:56:23:WU02:FS00:0xa7:Completed 95000 out of 125000 steps (76%)
******************************* Date: 2020-05-22 *******************************
03:02:55:WU02:FS00:0xa7:Completed 96250 out of 125000 steps (77%)
03:18:48:WU01:FS01:0x22:Completed 80000 out of 500000 steps (16%)

05:15:57:WU01:FS01:0x22:Completed 95000 out of 500000 steps (19%)
05:27:15:WU02:FS00:0xa7:Completed 123750 out of 125000 steps (99%)
05:27:16:WU00:FS00:Connecting to 65.254.110.245:8080
05:27:16:WU00:FS00:Assigned to work server 155.247.164.213
05:27:16:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:7 from 155.247.164.213
05:27:16:WU00:FS00:Connecting to 155.247.164.213:8080
05:27:17:WU00:FS00:Downloading 2.83MiB
05:27:18:WU00:FS00:Download complete
05:27:18:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14823 run:1084 clone:0 gen:94 core:0xa7 unit:0x000000679bf7a4d55ea30c4ccd5a2f6f
05:33:47:WU02:FS00:0xa7:Completed 125000 out of 125000 steps (100%)
05:33:56:WU02:FS00:0xa7:Saving result file ..\logfile_01.txt
05:33:56:WU02:FS00:0xa7:Saving result file frame85.trr
05:33:56:WU02:FS00:0xa7:Saving result file frame85.xtc
05:33:56:WU02:FS00:0xa7:Saving result file md.log
05:33:56:WU02:FS00:0xa7:Saving result file science.log
05:33:56:WU02:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
05:33:56:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:33:56:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:14578 run:0 clone:1597 gen:85 core:0xa7 unit:0x00000063287234c95e7ee9015254ddde
05:33:56:WU02:FS00:Uploading 7.25MiB to 40.114.52.201
05:33:56:WU02:FS00:Connecting to 40.114.52.201:8080
05:33:57:WU00:FS00:Starting
05:33:57:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\<user>\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 705 -lifeline 12256 -checkpoint 15 -np 7
05:33:57:WU00:FS00:Started FahCore on PID 12164
05:33:57:WU00:FS00:Core PID:8652
05:33:57:WU00:FS00:FahCore 0xa7 started
05:33:57:WU00:FS00:0xa7:*********************** Log Started 2020-05-22T05:33:57Z ***********************
05:33:57:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
05:33:57:WU00:FS00:0xa7:       Type: 0xa7
05:33:57:WU00:FS00:0xa7:       Core: Gromacs
05:33:57:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 12164 -checkpoint 15 -np
05:33:57:WU00:FS00:0xa7:             7
05:33:57:WU00:FS00:0xa7:************************************ CBang *************************************
05:33:57:WU00:FS00:0xa7:       Date: Oct 26 2019
05:33:57:WU00:FS00:0xa7:       Time: 01:38:25
05:33:57:WU00:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
05:33:57:WU00:FS00:0xa7:     Branch: master
05:33:57:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
05:33:57:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
05:33:57:WU00:FS00:0xa7:   Platform: win32 10
05:33:57:WU00:FS00:0xa7:       Bits: 64
05:33:57:WU00:FS00:0xa7:       Mode: Release
05:33:57:WU00:FS00:0xa7:************************************ System ************************************
05:33:57:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-3820QM CPU @ 2.70GHz
05:33:57:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
05:33:57:WU00:FS00:0xa7:       CPUs: 8
05:33:57:WU00:FS00:0xa7:     Memory: 15.58GiB
05:33:57:WU00:FS00:0xa7:Free Memory: 10.66GiB
05:33:57:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
05:33:57:WU00:FS00:0xa7: OS Version: 6.2
05:33:57:WU00:FS00:0xa7:Has Battery: true
05:33:57:WU00:FS00:0xa7: On Battery: false
05:33:57:WU00:FS00:0xa7: UTC Offset: 2
05:33:57:WU00:FS00:0xa7:        PID: 8652
05:33:57:WU00:FS00:0xa7:        CWD: C:\Users\<user>\AppData\Roaming\FAHClient\work
05:33:57:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
05:33:57:WU00:FS00:0xa7:    Version: 0.0.18
05:33:57:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
05:33:57:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
05:33:57:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
05:33:57:WU00:FS00:0xa7:       Date: Oct 26 2019
05:33:57:WU00:FS00:0xa7:       Time: 01:52:30
05:33:57:WU00:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
05:33:57:WU00:FS00:0xa7:     Branch: master
05:33:57:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
05:33:57:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
05:33:57:WU00:FS00:0xa7:   Platform: win32 10
05:33:57:WU00:FS00:0xa7:       Bits: 64
05:33:57:WU00:FS00:0xa7:       Mode: Release
05:33:57:WU00:FS00:0xa7:************************************ Build *************************************
05:33:57:WU00:FS00:0xa7:       SIMD: avx_256
05:33:57:WU00:FS00:0xa7:********************************************************************************
05:33:57:WU00:FS00:0xa7:Project: 14823 (Run 1084, Clone 0, Gen 94)
05:33:57:WU00:FS00:0xa7:Unit: 0x000000679bf7a4d55ea30c4ccd5a2f6f
05:33:57:WU00:FS00:0xa7:Reading tar file core.xml
05:33:57:WU00:FS00:0xa7:Reading tar file frame94.tpr
05:33:57:WU00:FS00:0xa7:Digital signatures verified
05:33:57:WU00:FS00:0xa7:Reducing thread count from 7 to 6 to avoid domain decomposition by a prime number > 3
05:33:57:WU00:FS00:0xa7:Calling: mdrun -s frame94.tpr -o frame94.trr -cpt 15 -nt 6
05:33:57:WU00:FS00:0xa7:Steps: first=0 total=250000
05:33:59:WU00:FS00:0xa7:Completed 1 out of 250000 steps (0%)
05:34:02:WU02:FS00:Upload 39.65%
05:34:08:WU02:FS00:Upload 86.19%
05:34:09:WU02:FS00:Upload complete
05:34:09:WU02:FS00:Server responded WORK_ACK (400)
05:34:10:WU02:FS00:Final credit estimate, 5393.00 points
05:34:10:WU02:FS00:Cleaning up
05:36:42:WU00:FS00:0xa7:Completed 2500 out of 250000 steps (1%)

07:57:35:WU00:FS00:0xa7:Completed 132500 out of 250000 steps (53%)
07:59:50:445:127.0.0.1:New Web connection
08:00:17:WU00:FS00:0xa7:Completed 135000 out of 250000 steps (54%)
08:02:33:FS00:Shutting core down
08:02:33:FS01:Shutting core down
08:02:33:WU00:FS00:0xa7:WARNING:Console control signal 1 on PID 8652
08:02:33:WU00:FS00:0xa7:Exiting, please wait. . .
08:02:33:WU01:FS01:0x22:WARNING:Console control signal 1 on PID 2488
08:02:33:WU01:FS01:0x22:Exiting, please wait. . .
08:02:34:WU01:FS01:0x22:Folding@home Core Shutdown: INTERRUPTED
08:02:35:WU00:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
08:02:35:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
08:02:35:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
08:02:36:WU00:FS00:Starting
08:02:36:WARNING:WU00:FS00:Changed SMP threads from 7 to 3 this can cause some work units to fail
08:02:36:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\<user>\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 705 -lifeline 12256 -checkpoint 15 -np 3
08:02:36:WU00:FS00:Started FahCore on PID 8968
08:02:36:WU00:FS00:Core PID:5528
08:02:36:WU00:FS00:FahCore 0xa7 started
08:02:36:WU00:FS00:0xa7:*********************** Log Started 2020-05-22T08:02:36Z ***********************
08:02:36:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
08:02:36:WU00:FS00:0xa7:       Type: 0xa7
08:02:36:WU00:FS00:0xa7:       Core: Gromacs
08:02:36:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 8968 -checkpoint 15 -np 3
08:02:36:WU00:FS00:0xa7:************************************ CBang *************************************
08:02:36:WU00:FS00:0xa7:       Date: Oct 26 2019
08:02:36:WU00:FS00:0xa7:       Time: 01:38:25
08:02:36:WU00:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
08:02:36:WU00:FS00:0xa7:     Branch: master
08:02:36:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
08:02:36:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
08:02:36:WU00:FS00:0xa7:   Platform: win32 10
08:02:36:WU00:FS00:0xa7:       Bits: 64
08:02:36:WU00:FS00:0xa7:       Mode: Release
08:02:36:WU00:FS00:0xa7:************************************ System ************************************
08:02:36:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-3820QM CPU @ 2.70GHz
08:02:36:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
08:02:36:WU00:FS00:0xa7:       CPUs: 8
08:02:36:WU00:FS00:0xa7:     Memory: 15.58GiB
08:02:36:WU00:FS00:0xa7:Free Memory: 11.28GiB
08:02:36:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
08:02:36:WU00:FS00:0xa7: OS Version: 6.2
08:02:36:WU00:FS00:0xa7:Has Battery: true
08:02:36:WU00:FS00:0xa7: On Battery: false
08:02:36:WU00:FS00:0xa7: UTC Offset: 2
08:02:36:WU00:FS00:0xa7:        PID: 5528
08:02:36:WU00:FS00:0xa7:        CWD: C:\Users\<user>\AppData\Roaming\FAHClient\work
08:02:36:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
08:02:36:WU00:FS00:0xa7:    Version: 0.0.18
08:02:36:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
08:02:36:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
08:02:36:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
08:02:36:WU00:FS00:0xa7:       Date: Oct 26 2019
08:02:36:WU00:FS00:0xa7:       Time: 01:52:30
08:02:36:WU00:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
08:02:36:WU00:FS00:0xa7:     Branch: master
08:02:36:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
08:02:36:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
08:02:36:WU00:FS00:0xa7:   Platform: win32 10
08:02:36:WU00:FS00:0xa7:       Bits: 64
08:02:36:WU00:FS00:0xa7:       Mode: Release
08:02:36:WU00:FS00:0xa7:************************************ Build *************************************
08:02:36:WU00:FS00:0xa7:       SIMD: avx_256
08:02:36:WU00:FS00:0xa7:********************************************************************************
08:02:36:WU00:FS00:0xa7:Project: 14823 (Run 1084, Clone 0, Gen 94)
08:02:36:WU00:FS00:0xa7:Unit: 0x000000679bf7a4d55ea30c4ccd5a2f6f
08:02:36:WU00:FS00:0xa7:Digital signatures verified
08:02:36:WU00:FS00:0xa7:Calling: mdrun -s frame94.tpr -o frame94.trr -cpi state.cpt -cpt 15 -nt 3
08:02:36:WU00:FS00:0xa7:Steps: first=0 total=250000
08:02:37:WU00:FS00:0xa7:Completed 137079 out of 250000 steps (54%)
08:02:39:Removing old file 'configs/config-20200520-165025.xml'
08:02:39:Saving configuration to config.xml
08:02:39:<config>
08:02:39:  <!-- Network -->
08:02:39:  <proxy v=':8080'/>
08:02:39:
08:02:39:  <!-- Slot Control -->
08:02:39:  <power v='LIGHT'/>
08:02:39:
08:02:39:  <!-- User Information -->
08:02:39:  <passkey v='********************************'/>
08:02:39:  <team v='261734'/>
08:02:39:  <user v='Folder_0817'/>
08:02:39:
08:02:39:  <!-- Folding Slots -->
08:02:39:  <slot id='0' type='CPU'/>
08:02:39:  <slot id='1' type='GPU'/>
08:02:39:</config>
08:03:07:WU00:FS00:0xa7:Completed 137500 out of 250000 steps (55%)

09:01:13:WU00:FS00:0xa7:Completed 185000 out of 250000 steps (74%)
******************************* Date: 2020-05-22 *******************************
09:04:36:WU00:FS00:0xa7:Completed 187500 out of 250000 steps (75%)
09:07:59:WU00:FS00:0xa7:Completed 190000 out of 250000 steps (76%)
If the information provided here is not sufficent, please let me know, and I'll add everything you need.

Thanks in advance for you help. :)
Last edited by Folder_0815 on Fri May 22, 2020 5:23 pm, edited 1 time in total.
NRT_AntiKytherA
Posts: 107
Joined: Sun May 10, 2020 11:50 pm

Re: GPU points are not noticed

Post by NRT_AntiKytherA »

can you filter the log for the gpu slot output (FS01) in the advanced interface and post that please?
JimboPalmer
Posts: 2522
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: GPU points are not noticed

Post by JimboPalmer »

Also a log of the first 200 lines where it shows your configuration would help.
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
Crawdaddy79
Posts: 73
Joined: Sat Mar 21, 2020 3:56 pm

Re: GPU points are not noticed

Post by Crawdaddy79 »

I pored over the log you posted, and there seems to be a lot of missing information. I see you sent and received points for 3 CPU work units, but your GPU work unit starts at 8% and the log stops after it hits 19%, with many gaps in time.

An online utility I found extremely helpful is https://apps.foldingathome.org/wu Input your WU parameters and you can see exactly what is going on. There's a learning curve for the PRCG block, but if you simply leave it blank and type what you know into the bottom four boxes, hit Search and you'll see your credit. There's usually a 30 - 60 minute delay between the time you send your results and the time they are posted. If something fishy happened, it may show up there.

I looked at the one GPU project you have in your log ( Project: 14251 (Run 71, Clone 3, Gen 25) ) and it appears you haven't sent the results to it yet. https://apps.foldingathome.org/wu#proje ... e=3&gen=25
Image
Joe_H
Site Admin
Posts: 7946
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: GPU points are not noticed

Post by Joe_H »

Crawdaddy79 wrote:There's a learning curve for the PRCG block...
I just copy a line from the log that contains the project, run, clone and gen information into the PRCG block and hit Tab. That does a good job of filtering and entering the appropriate values. Don't even have to trim off leading and trailing material in the line from the log.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Folder_0815
Posts: 25
Joined: Wed May 20, 2020 11:00 pm

Re: GPU points are not noticed

Post by Folder_0815 »

After focusing on FS01, I found out that this logfile doesn't cover the full time of about 5 days to see. Also it shows the current WU on the GPU, after the error, it was at 19% when I drew the log.
I am doing some research on it and will try to step up the "learning curve" of the mentioned tool.
Hopefully I ll be able to post the complete history of "lost" WU.

Just let me have some time, even studying the log deeply, helps already.
Thanks so long for helping.
Crawdaddy79
Posts: 73
Joined: Sat Mar 21, 2020 3:56 pm

Re: GPU points are not noticed

Post by Crawdaddy79 »

I only mention the learning curve because I had issues with copying/pasting the correct thing - I often got error:error as a return, but playing with it now I think I was just forgetting to include the word "Project" in the beginning of my string copy. I didn't try copying the whole line, so that's a good tip Mr. Joe_H.

As for the relevant part of the log, what I look for in my own troubleshooting is the error field on the SEND line
14:57:51:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:16435 run:2809 clone:0 gen:32 core:0x22

The WORK_ACK line:
15:02:45:WU01:FS01:Server responded WORK_ACK (400)

If you don't see it, you might see this (which as far as I can tell, you get no points for and does not post at all on the WU tool):
16:14:20:WU00:FS00:Server responded WORK_QUIT (404)
16:14:20:WARNING:WU00:FS00:Server did not like results, dumping

Then the credit estimate line, which doesn't appear unless everything is gravy:
15:02:45:WU01:FS01:Final credit estimate, 97646.00 points
15:02:45:WU01:FS01:Cleaning up

The program keeps 16 rotating log files in its history under C:\Users\**you**\AppData\Roaming\FAHClient\logs by default, so if you're looking for older information, it would be there. A new log file is created every time the client is started and the last one is moved into the log directory.
Image
Folder_0815
Posts: 25
Joined: Wed May 20, 2020 11:00 pm

Re: GPU points are not noticed

Post by Folder_0815 »

I found the traces of the problem.
Here is one older example, which shows also, that the problem seems to be permanent.
############################################################################################
# Last life sign:
############################################################################################
02:31:07:WU01:FS01:0x22:Completed 1780000 out of 2000000 steps (89%)
############################################################################################
# Shortly after that the WU was cancelled
############################################################################################
03:13:11:WARNING:WU01:FS01:Past final deadline 2020-05-11T03:13:10Z, dumping
03:13:11:WU01:FS01:Shutting core down

You see in this case, it was at night.

This happend several times during the last 5 weeks since im joining this project.
Later I will post the WU numbers, but it will atke some time.

My point is that I believe, that I was not behind the deadline
because I was watching always, if my equipment is good enough to fullfil the requirements.
Unfortunately, I don't have screenshots of the past.

Now I made a screenshot of the currently running WU:
Image: https://i.imgur.com/J3eU9Z5.jpg

The max time is always around the double of the calculated time to finish the job,
and I am sure when the last WU was stopped (with the 61000 points) this timelimit was not at all reached.

I don't know what to do now.
My plan is to observe the currently running WU on the GPU and see if it happend again.
Make screenshots and documentation.

Should I identifiy the WU Project numbers which failed in the past due to this behaviour?

Mod Edit: Fixed Image URL - PantherX
Folder_0815
Posts: 25
Joined: Wed May 20, 2020 11:00 pm

Re: GPU points are not noticed

Post by Folder_0815 »

Here I finally found the relevant lines:
20:08:06:WU00:FS01:0x22:*********************** Log Started 2020-05-15T20:08:06Z ***********************
20:08:06:WU00:FS01:0x22:Project: 14437 (Run 906, Clone 3, Gen 30)
20:08:06:WU00:FS01:0x22:Unit: 0x0000002b03854c135e9d22623431ce90
19:32:17:WARNING:WU00:FS01:Past final deadline 2020-05-20T19:32:16Z, dumping

==> WU was dumped after 5 days, but the interface said I have about 10 days to finish.
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: GPU points are not noticed

Post by PantherX »

I have checked and it seems that Project 14437 has a timeout of 2 days and expiration of 5 days. If your ETA is 10 days, then the WU wouldn't be able to meet it :(
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Joe_H
Site Admin
Posts: 7946
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: GPU points are not noticed

Post by Joe_H »

Additional relevant line required, when the WU was downloaded to your system first. The Timeout and Deadline values start then, not when the WU starts.

That would look something like this:

Code: Select all

06:28:45:WU00:FS00:Connecting to 65.254.110.245:80
06:28:45:WU00:FS00:Assigned to work server 40.121.152.108
06:28:45:WU00:FS00:Requesting new work unit for slot 00: READY cpu:4 from 40.121.152.108
06:28:45:WU00:FS00:Connecting to 40.121.152.108:8080
06:28:45:WU00:FS00:Downloading 137.00KiB
06:28:45:WU00:FS00:Download complete
06:28:45:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14376 run:497 clone:2 gen:19 core:0xa7 unit:0x000000132879986c5e886e404a9ba630
06:28:45:WU00:FS00:Starting
06:28:45:WU00:FS00:Running FahCore: /usr/local/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/cores.foldingathome.org/v7/osx/64bit/avx/Core_a7.fah/FahCore_a7" -dir 00 -suffix 01 -version 706 -lifeline 1060 -checkpoint 15 -np 4
06:28:45:WU00:FS00:Started FahCore on PID 1153
06:28:45:WU00:FS00:Core PID:1154
06:28:45:WU00:FS00:FahCore 0xa7 started
06:28:46:WU00:FS00:0xa7:*********************** Log Started 2020-04-18T06:28:45Z ***********************
Also, which interface were you using and seeing 10 days on? If for instance you were using Web Control and have both a GPU and CPU slot, if you have not selected the GPU tab the figures are for the CPU WU. In FAHControl it lists the actual date and time for the deadlines when you have each WU/slot selected.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Folder_0815
Posts: 25
Joined: Wed May 20, 2020 11:00 pm

Re: GPU points are not noticed

Post by Folder_0815 »

@PantherX:
Sry that I didn't explain clear enough.
As far as I remember ETA was ~5,2 days, and the GPU interface said "My computer has 10.x days to complete this work unit".
But I'm not 100% sure about the exact values.
Folder_0815
Posts: 25
Joined: Wed May 20, 2020 11:00 pm

Re: GPU points are not noticed

Post by Folder_0815 »

@Joe_H
All information I talk about came from the GPU tab (interface) in FAHControl.
I'm clear about the two interfaces, but thank you anyway for the hint.

Following should be the startup log for WU 14437. Hopefully complete.

Code: Select all

19:32:16:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GK107 [Quadro 2100M] from 3.133.76.19
19:32:16:WU00:FS01:Connecting to 3.133.76.19:8080
19:32:38:WARNING:WU00:FS01:WorkServer connection failed on port 8080 trying 80
19:32:38:WU00:FS01:Connecting to 3.133.76.19:80
19:34:09:WU00:FS01:Downloading 20.25MiB
19:34:15:WU00:FS01:Download 16.36%
19:34:21:WU00:FS01:Download 28.40%
19:34:27:WU00:FS01:Download 33.65%
19:34:33:WU00:FS01:Download 40.75%
19:34:39:WU00:FS01:Download 48.47%
19:34:45:WU00:FS01:Download 56.49%
19:34:51:WU00:FS01:Download 65.14%
19:34:57:WU00:FS01:Download 70.39%
19:35:03:WU00:FS01:Download 76.56%
19:35:09:WU00:FS01:Download 82.42%
19:35:15:WU00:FS01:Download 88.29%
19:35:21:WU00:FS01:Download 94.77%
19:35:26:WU00:FS01:Download complete
19:35:26:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14437 run:906 clone:3 gen:30 core:0x22 unit:0x0000002b03854c135e9d22623431ce90
20:08:05:WU00:FS01:Starting
20:08:05:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\eriwa\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 705 -lifeline 11424 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device 0 -gpu 0
20:08:06:WU00:FS01:Started FahCore on PID 11292
20:08:06:WU00:FS01:Core PID:11700
20:08:06:WU00:FS01:FahCore 0x22 started
20:08:06:WU00:FS01:0x22:*********************** Log Started 2020-05-15T20:08:06Z ***********************
20:08:06:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
20:08:06:WU00:FS01:0x22:       Type: 0x22
20:08:06:WU00:FS01:0x22:       Core: Core22
20:08:06:WU00:FS01:0x22:    Website: https://foldingathome.org/
20:08:06:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
20:08:06:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
20:08:06:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
20:08:06:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 705 -lifeline 11292 -checkpoint 15
20:08:06:WU00:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device
20:08:06:WU00:FS01:0x22:             0 -gpu 0
20:08:06:WU00:FS01:0x22:     Config: <none>
20:08:06:WU00:FS01:0x22:************************************ Build *************************************
20:08:06:WU00:FS01:0x22:    Version: 0.0.2
20:08:06:WU00:FS01:0x22:       Date: Dec 6 2019
20:08:06:WU00:FS01:0x22:       Time: 21:30:31
20:08:06:WU00:FS01:0x22: Repository: Git
20:08:06:WU00:FS01:0x22:   Revision: abeb39247cc72df5af0f63723edafadb23d5dfbe
20:08:06:WU00:FS01:0x22:     Branch: HEAD
20:08:06:WU00:FS01:0x22:   Compiler: Visual C++ 2008
20:08:06:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
20:08:06:WU00:FS01:0x22:   Platform: win32 10
20:08:06:WU00:FS01:0x22:       Bits: 64
20:08:06:WU00:FS01:0x22:       Mode: Release
20:08:06:WU00:FS01:0x22:************************************ System ************************************
20:08:06:WU00:FS01:0x22:        CPU: Intel(R) Core(TM) i7-3820QM CPU @ 2.70GHz
20:08:06:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
20:08:06:WU00:FS01:0x22:       CPUs: 8
20:08:06:WU00:FS01:0x22:     Memory: 15.58GiB
20:08:06:WU00:FS01:0x22:Free Memory: 10.94GiB
20:08:06:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
20:08:06:WU00:FS01:0x22: OS Version: 6.2
20:08:06:WU00:FS01:0x22:Has Battery: true
20:08:06:WU00:FS01:0x22: On Battery: false
20:08:06:WU00:FS01:0x22: UTC Offset: 2
20:08:06:WU00:FS01:0x22:        PID: 11700
20:08:06:WU00:FS01:0x22:        CWD: C:\Users\eriwa\AppData\Roaming\FAHClient\work
20:08:06:WU00:FS01:0x22:         OS: Windows 10 Pro
20:08:06:WU00:FS01:0x22:    OS Arch: AMD64
20:08:06:WU00:FS01:0x22:********************************************************************************
20:08:06:WU00:FS01:0x22:Project: 14437 (Run 906, Clone 3, Gen 30)
20:08:06:WU00:FS01:0x22:Unit: 0x0000002b03854c135e9d22623431ce90
20:08:06:WU00:FS01:0x22:Reading tar file core.xml
20:08:06:WU00:FS01:0x22:Reading tar file integrator.xml
20:08:06:WU00:FS01:0x22:Reading tar file state.xml
20:08:08:WU00:FS01:0x22:Reading tar file system.xml
20:08:11:WU00:FS01:0x22:Digital signatures verified
20:08:11:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
20:08:11:WU00:FS01:0x22:Version 0.0.2
20:08:55:WU00:FS01:0x22:Completed 0 out of 2000000 steps (0%)
20:08:55:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
~~~
19:32:17:WARNING:WU00:FS01:Past final deadline 2020-05-20T19:32:16Z, dumping
After understanding more deep what is logged I found one other WU on the GPU which failed as well because of timeout: WU 14436

Code: Select all

03:13:09:WU01:FS01:Connecting to 65.254.110.245:8080
03:13:09:WU01:FS01:Assigned to work server 3.133.76.19
03:13:09:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GK107 [Quadro 2100M] from 3.133.76.19
03:13:09:WU01:FS01:Connecting to 3.133.76.19:8080
03:13:31:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
03:13:31:WU01:FS01:Connecting to 3.133.76.19:80
03:14:59:WU01:FS01:Downloading 17.39MiB
03:15:05:WU01:FS01:Download 62.53%
03:15:07:WU01:FS01:Download complete
03:15:07:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14436 run:1203 clone:4 gen:26 core:0x22 unit:0x0000002103854c135e9a790faecfd1f8
03:33:17:WU01:FS01:Starting
03:33:17:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\eriwa\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 705 -lifeline 10280 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device 0 -gpu 0
03:33:17:WU01:FS01:Started FahCore on PID 8744
03:33:17:WU01:FS01:Core PID:8324
03:33:17:WU01:FS01:FahCore 0x22 started

03:33:17:WU01:FS01:0x22:*********************** Log Started 2020-05-06T03:33:17Z ***********************
03:33:17:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
03:33:17:WU01:FS01:0x22:       Type: 0x22
03:33:17:WU01:FS01:0x22:       Core: Core22
03:33:17:WU01:FS01:0x22:    Website: https://foldingathome.org/
03:33:17:WU01:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
03:33:17:WU01:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
03:33:17:WU01:FS01:0x22:             <rafal.wiewiora@choderalab.org>
03:33:17:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 705 -lifeline 8744 -checkpoint 15
03:33:17:WU01:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device
03:33:17:WU01:FS01:0x22:             0 -gpu 0
03:33:17:WU01:FS01:0x22:     Config: <none>
03:33:17:WU01:FS01:0x22:************************************ Build *************************************
03:33:17:WU01:FS01:0x22:    Version: 0.0.2
03:33:17:WU01:FS01:0x22:       Date: Dec 6 2019
03:33:17:WU01:FS01:0x22:       Time: 21:30:31
03:33:17:WU01:FS01:0x22: Repository: Git
03:33:17:WU01:FS01:0x22:   Revision: abeb39247cc72df5af0f63723edafadb23d5dfbe
03:33:17:WU01:FS01:0x22:     Branch: HEAD
03:33:17:WU01:FS01:0x22:   Compiler: Visual C++ 2008
03:33:17:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
03:33:17:WU01:FS01:0x22:   Platform: win32 10
03:33:17:WU01:FS01:0x22:       Bits: 64
03:33:17:WU01:FS01:0x22:       Mode: Release
03:33:17:WU01:FS01:0x22:************************************ System ************************************
03:33:17:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i7-3820QM CPU @ 2.70GHz
03:33:17:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
03:33:17:WU01:FS01:0x22:       CPUs: 8
03:33:17:WU01:FS01:0x22:     Memory: 15.58GiB
03:33:17:WU01:FS01:0x22:Free Memory: 11.28GiB
03:33:17:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
03:33:17:WU01:FS01:0x22: OS Version: 6.2
03:33:17:WU01:FS01:0x22:Has Battery: true
03:33:17:WU01:FS01:0x22: On Battery: false
03:33:17:WU01:FS01:0x22: UTC Offset: 2
03:33:17:WU01:FS01:0x22:        PID: 8324
03:33:17:WU01:FS01:0x22:        CWD: C:\Users\eriwa\AppData\Roaming\FAHClient\work
03:33:17:WU01:FS01:0x22:         OS: Windows 10 Pro
03:33:17:WU01:FS01:0x22:    OS Arch: AMD64
03:33:17:WU01:FS01:0x22:********************************************************************************
03:33:17:WU01:FS01:0x22:Project: 14436 (Run 1203, Clone 4, Gen 26)
03:33:17:WU01:FS01:0x22:Unit: 0x0000002103854c135e9a790faecfd1f8
03:33:17:WU01:FS01:0x22:Reading tar file core.xml
03:33:17:WU01:FS01:0x22:Reading tar file integrator.xml
03:33:17:WU01:FS01:0x22:Reading tar file state.xml
03:33:19:WU01:FS01:0x22:Reading tar file system.xml
03:33:21:WU01:FS01:0x22:Digital signatures verified
03:33:21:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
03:33:21:WU01:FS01:0x22:Version 0.0.2
03:33:53:WU01:FS01:0x22:Completed 0 out of 2000000 steps (0%)
03:33:53:WU01:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900

~~~
03:13:11:WARNING:WU01:FS01:Past final deadline 2020-05-11T03:13:10Z, dumping
Maybe it was my fault, and I don't remember anymore the exact timing.
Over the weeks I had 11 GPU Projects, except of the two mentioned above, all others were fine.
Thats why I wonder how it came to the timeout. Usually the machine runs 24/7 only with a few interruptions.

/br
Folder_0815
Posts: 25
Joined: Wed May 20, 2020 11:00 pm

Re: GPU points are not noticed

Post by Folder_0815 »

Hi all,
to continue with the above discussed problem...

This morning ~8am,
my GPU received a new WU.
ETA was 2.00 days and it said "My computer has 4.74 days to complete this work unit."

When I checked the FAHcontrol at 2pm,
ETA was increased to 5.41 days, but time to complete is the same as before.
===> Clearly that will not work. So why is it then running?

Please see the 2 screenshots from 8am and 2pm
https://imgur.com/a/FUdhQzQ

What can I do to prevent such mismatch?
/br
Crawdaddy79
Posts: 73
Joined: Sat Mar 21, 2020 3:56 pm

Re: GPU points are not noticed

Post by Crawdaddy79 »

Ah... That sucks. I'm surprised that the possibility exists that it ships WUs that a system cannot reasonably fold before the expiration. Maybe something bad is slowing your system down? Do you have latest drivers, not using any intense screensavers, etc?

What's happening there is the client doesn't know how long it will take to finish until it finishes the first percent or so. It defaults to two days (though most WUs I get default to one day).

I do think it keeps a historical database somewhere on our systems and pulls up information from previous WUs that match new ones (same project #, core type, etc.), and will use that to give you a relatively accurate ETA at 0.0% (this could be in my imagination though).
Image
Post Reply