GPU work progress resenting backward

[MajorCaliber]

I opened my computer this morning (I fold 24/7) and noticed the GPU slot 41,500 points was 99.99% complete and was due to finish in 15 seconds. I know that sometimes, like in football, those last few seconds sometimes take longer than advertised. I was expecting to watch it finish, send the finished work unit and download the next. Instead, after a minute or so the progress reset to 90% with hours left to go. I paused FAH at just over 90% completion, restarted the computer, resumed FAH and it picked up at where it left off. Later it went from somewhere in the 90’s back to exactly 90% again and now no longer had sufficient time to complete before expiration. It was just a few hours until expiration so I just let it run to see what would happen. It appears to have completed well within the time and uploaded the completed work unit. What is going on here?

[PantherX]

Can you please post the log file? Ensure you include the first 100 lines which will inform us of what the system configuration is and what the client settings are. If you require guidance, please view this topic: viewtopic.php?f=24&t=26036

[gunnarre]

I have seen this before with a GPU which was in GPUS.txt, but couldn't really fold - a GF119 [GeForce GT 610]. It only has OpenCL 1.1, so it never actually folded successfully - the advanced control program just estimated that it had run until 99.9% and got stuck there.

[Neil-B]

In absence of a log my guess would be that the kit was shut down with folding on the GPU somewhere between 90% and 100% ... When the kit was restarted initially the viewer displayed the estimated completion based on the information collected prior to shutdown (so by this time nearly complete - actualy past pre shutdown estmated completion - so showing 99.99%) ... The core on restart grabbed the last checkpoint data (so guessing 90% checkpoint was the last usable one) and started folding ... the viewer then got an update from the core and reset to show the now correct completion percentage with a new estimate of completion time (which used a rate that included a long shutdown ... this then in turn made it look like completion would take longer than it did ... the repeated pause, shutdown, restart follows the same pattern ... once left to its own devices it actually completed within expiration - my guess would be that by say 93% the estimated completion probably corrected to something close to what actually happened.

But all this is sheer speculation on my part ... however if this is anything like correct then ways to minimise this effect in future would be:

• Shutdown kit shortly after a checkpoint has been written - logs should show checkpoint intervals for GPU WUs - the CPU WUs checkpoints should be as set in control
  Don't look at (or at least don't trust estimates shown by) the viewer for say 3% after a system restart

Sometimes it can just be a case of being patient and letting the client viewers catch up with reality

[bruce]

In absence of a log my guess would be that the kit was shut down with folding on the GPU somewhere between 90% and 100% ...

Or earlier.

There are a few cases where an error occurs in the FAHCore but the client thinks it is still processing. It can happen at any point (before or after 90%) and the estimates will continue to progress to 99.99% even though it actually stopped at some earier point. Please search through the log and find the actual error.

[Neil-B]

It was a guess - but given the slot was reverting to 90% on restart I'd be surprised if it had failed earlier than that? - but as you say the logs should reveal all

[MajorCaliber]

Here is all I have of the log file. It starts from the point where i first re-started the machine after the first progress reset, continues through what I think is the second reset and continues past this line about half way down:

02:31:04:WU01:FS02:0x22:Checkpoint completed at step 0

where the result has been uploaded and it is starting the next GPU unit.

Code: Select all

*********************** Log Started 2020-10-04T22:13:36Z ***********************
22:13:36:Trying to access database...
22:13:36:Successfully acquired database lock
22:13:36:Downloading GPUs.txt from assign1.foldingathome.org:80
22:13:36:Connecting to assign1.foldingathome.org:80
22:13:37:Read GPUs.txt
22:13:37:Enabled folding slot 01: READY cpu:7
22:13:38:Enabled folding slot 02: READY gpu:0:Mars [Radeon R7 M260/M265/M270]
22:13:38:****************************** FAHClient ******************************
22:13:38:        Version: 7.6.13
22:13:38:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:13:38:      Copyright: 2020 foldingathome.org
22:13:38:       Homepage: https://foldingathome.org/
22:13:38:           Date: Apr 27 2020
22:13:38:           Time: 21:21:01
22:13:38:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
22:13:38:         Branch: master
22:13:38:       Compiler: Visual C++ 2008
22:13:38:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:13:38:       Platform: win32 10
22:13:38:           Bits: 32
22:13:38:           Mode: Release
22:13:38:         Config: C:\Users\MyUser93\AppData\Roaming\FAHClient\config.xml
22:13:38:******************************** CBang ********************************
22:13:38:           Date: Apr 24 2020
22:13:38:           Time: 17:07:55
22:13:38:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
22:13:38:         Branch: master
22:13:38:       Compiler: Visual C++ 2008
22:13:38:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:13:38:       Platform: win32 10
22:13:38:           Bits: 32
22:13:38:           Mode: Release
22:13:38:******************************* System ********************************
22:13:38:            CPU: Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz
22:13:38:         CPU ID: GenuineIntel Family 6 Model 142 Stepping 10
22:13:38:           CPUs: 8
22:13:38:         Memory: 15.87GiB
22:13:38:    Free Memory: 13.01GiB
22:13:38:        Threads: WINDOWS_THREADS
22:13:38:     OS Version: 6.2
22:13:38:    Has Battery: true
22:13:38:     On Battery: false
22:13:38:     UTC Offset: -7
22:13:38:            PID: 9312
22:13:38:            CWD: C:\Users\MyUser93\AppData\Roaming\FAHClient
22:13:38:  Win32 Service: false
22:13:38:             OS: Windows 10 Home
22:13:38:        OS Arch: AMD64
22:13:38:           GPUs: 1
22:13:38:          GPU 0: Bus:1 Slot:0 Func:0 AMD:5 Mars [Radeon R7 M260/M265/M270]
22:13:38:           CUDA: Not detected: Failed to open dynamic library 'nvcuda.dll': The
22:13:38:                 specified module could not be found.
22:13:38:
22:13:38:OpenCL Device 0: Platform:0 Device:0 Bus:NA Slot:NA Compute:2.1 Driver:26.20
22:13:38:OpenCL Device 1: Platform:1 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:3110.7
22:13:38:******************************* libFAH ********************************
22:13:38:           Date: Apr 15 2020
22:13:38:           Time: 14:53:14
22:13:38:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
22:13:38:         Branch: master
22:13:38:       Compiler: Visual C++ 2008
22:13:38:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:13:38:       Platform: win32 10
22:13:38:           Bits: 32
22:13:38:           Mode: Release
22:13:38:***********************************************************************
22:13:38:<config>
22:13:38:  <!-- Folding Core -->
22:13:38:  <core-priority v='low'/>
22:13:38:
22:13:38:  <!-- Folding Slot Configuration -->
22:13:38:  <cause v='COVID_19'/>
22:13:38:
22:13:38:  <!-- Network -->
22:13:38:  <proxy v=':8080'/>
22:13:38:
22:13:38:  <!-- Slot Control -->
22:13:38:  <power v='full'/>
22:13:38:
22:13:38:  <!-- User Information -->
22:13:38:  <passkey v='*****'/>
22:13:38:  <team v='198'/>
22:13:38:  <user v='Ken_Johnson'/>
22:13:38:
22:13:38:  <!-- Folding Slots -->
22:13:38:  <slot id='1' type='CPU'/>
22:13:38:  <slot id='2' type='GPU'/>
22:13:38:</config>
22:13:38:WU02:FS02:Starting
22:13:38:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\MyUser93\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 02 -suffix 01 -version 706 -lifeline 9312 -checkpoint 15 -gpu-vendor amd -opencl-platform 1 -opencl-device 0 -gpu 0
22:13:38:WU02:FS02:Started FahCore on PID 13792
22:13:39:WU02:FS02:Core PID:14132
22:13:39:WU02:FS02:FahCore 0x22 started
22:13:39:WU01:FS01:Starting
22:13:39:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\MyUser93\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 9312 -checkpoint 15 -np 7
22:13:39:WU01:FS01:Started FahCore on PID 14156
22:13:39:WU01:FS01:Core PID:14200
22:13:39:WU01:FS01:FahCore 0xa7 started
22:13:39:WU02:FS02:0x22:*********************** Log Started 2020-10-04T22:13:39Z ***********************
22:13:39:WU02:FS02:0x22:*************************** Core22 Folding@home Core ***************************
22:13:39:WU02:FS02:0x22:       Core: Core22
22:13:39:WU02:FS02:0x22:       Type: 0x22
22:13:39:WU02:FS02:0x22:    Version: 0.0.13
22:13:39:WU02:FS02:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:13:39:WU02:FS02:0x22:  Copyright: 2020 foldingathome.org
22:13:39:WU02:FS02:0x22:   Homepage: https://foldingathome.org/
22:13:39:WU02:FS02:0x22:       Date: Sep 19 2020
22:13:39:WU02:FS02:0x22:       Time: 02:35:58
22:13:39:WU02:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
22:13:39:WU02:FS02:0x22:     Branch: core22-0.0.13
22:13:39:WU02:FS02:0x22:   Compiler: Visual C++ 2015
22:13:39:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
22:13:39:WU02:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
22:13:39:WU02:FS02:0x22:   Platform: win32 10
22:13:39:WU01:FS01:0xa7:*********************** Log Started 2020-10-04T22:13:39Z ***********************
22:13:39:WU02:FS02:0x22:       Bits: 64
22:13:39:WU01:FS01:0xa7:************************** Gromacs Folding@home Core ***************************
22:13:39:WU02:FS02:0x22:       Mode: Release
22:13:39:WU01:FS01:0xa7:       Type: 0xa7
22:13:39:WU02:FS02:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
22:13:39:WU01:FS01:0xa7:       Core: Gromacs
22:13:40:WU02:FS02:0x22:             <peastman@stanford.edu>
22:13:40:WU01:FS01:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 14156 -checkpoint 15 -np
22:13:40:WU02:FS02:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 13792 -checkpoint 15
22:13:40:WU01:FS01:0xa7:             7
22:13:40:WU02:FS02:0x22:             -gpu-vendor amd -opencl-platform 1 -opencl-device 0 -gpu 0
22:13:40:WU01:FS01:0xa7:************************************ CBang *************************************
22:13:40:WU02:FS02:0x22:************************************ libFAH ************************************
22:13:40:WU01:FS01:0xa7:       Date: Nov 27 2019
22:13:40:WU02:FS02:0x22:       Date: Sep 7 2020
22:13:40:WU01:FS01:0xa7:       Time: 03:40:09
22:13:40:WU02:FS02:0x22:       Time: 19:09:56
22:13:40:WU01:FS01:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
22:13:40:WU02:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
22:13:40:WU01:FS01:0xa7:     Branch: master
22:13:40:WU02:FS02:0x22:     Branch: HEAD
22:13:40:WU01:FS01:0xa7:   Compiler: Visual C++ 2008
22:13:40:WU02:FS02:0x22:   Compiler: Visual C++ 2015
22:13:40:WU01:FS01:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:13:40:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
22:13:40:WU01:FS01:0xa7:   Platform: win32 10
22:13:40:WU02:FS02:0x22:   Platform: win32 10
22:13:40:WU01:FS01:0xa7:       Bits: 64
22:13:40:WU02:FS02:0x22:       Bits: 64
22:13:40:WU01:FS01:0xa7:       Mode: Release
22:13:40:WU02:FS02:0x22:       Mode: Release
22:13:40:WU01:FS01:0xa7:************************************ System ************************************
22:13:40:WU02:FS02:0x22:************************************ CBang *************************************
22:13:40:WU01:FS01:0xa7:        CPU: Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz
22:13:40:WU02:FS02:0x22:       Date: Sep 7 2020
22:13:40:WU01:FS01:0xa7:     CPU ID: GenuineIntel Family 6 Model 142 Stepping 10
22:13:40:WU02:FS02:0x22:       Time: 19:08:30
22:13:40:WU01:FS01:0xa7:       CPUs: 8
22:13:40:WU02:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
22:13:40:WU01:FS01:0xa7:     Memory: 15.87GiB
22:13:40:WU02:FS02:0x22:     Branch: HEAD
22:13:40:WU01:FS01:0xa7:Free Memory: 12.60GiB
22:13:40:WU02:FS02:0x22:   Compiler: Visual C++ 2015
22:13:40:WU01:FS01:0xa7:    Threads: WINDOWS_THREADS
22:13:40:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
22:13:40:WU01:FS01:0xa7: OS Version: 6.2
22:13:40:WU02:FS02:0x22:   Platform: win32 10
22:13:40:WU01:FS01:0xa7:Has Battery: true
22:13:40:WU02:FS02:0x22:       Bits: 64
22:13:40:WU01:FS01:0xa7: On Battery: false
22:13:40:WU02:FS02:0x22:       Mode: Release
22:13:40:WU01:FS01:0xa7: UTC Offset: -7
22:13:40:WU02:FS02:0x22:************************************ System ************************************
22:13:40:WU01:FS01:0xa7:        PID: 14200
22:13:40:WU02:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz
22:13:40:WU01:FS01:0xa7:        CWD: C:\Users\MyUser93\AppData\Roaming\FAHClient\work
22:13:40:WU02:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 142 Stepping 10
22:13:40:WU01:FS01:0xa7:******************************** Build - libFAH ********************************
22:13:40:WU02:FS02:0x22:       CPUs: 8
22:13:40:WU01:FS01:0xa7:    Version: 0.0.19
22:13:40:WU02:FS02:0x22:     Memory: 15.87GiB
22:13:40:WU01:FS01:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:13:40:WU02:FS02:0x22:Free Memory: 11.69GiB
22:13:40:WU01:FS01:0xa7:  Copyright: 2019 foldingathome.org
22:13:40:WU02:FS02:0x22:    Threads: WINDOWS_THREADS
22:13:40:WU01:FS01:0xa7:   Homepage: https://foldingathome.org/
22:13:40:WU02:FS02:0x22: OS Version: 6.2
22:13:40:WU01:FS01:0xa7:       Date: Nov 25 2019
22:13:40:WU02:FS02:0x22:Has Battery: true
22:13:40:WU01:FS01:0xa7:       Time: 17:12:41
22:13:40:WU02:FS02:0x22: On Battery: false
22:13:40:WU01:FS01:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
22:13:40:WU02:FS02:0x22: UTC Offset: -7
22:13:40:WU01:FS01:0xa7:     Branch: master
22:13:40:WU02:FS02:0x22:        PID: 14132
22:13:40:WU01:FS01:0xa7:   Compiler: Visual C++ 2008
22:13:40:WU02:FS02:0x22:        CWD: C:\Users\MyUser93\AppData\Roaming\FAHClient\work
22:13:40:WU01:FS01:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:13:40:WU02:FS02:0x22:************************************ OpenMM ************************************
22:13:40:WU01:FS01:0xa7:   Platform: win32 10
22:13:40:WU02:FS02:0x22:   Revision: 189320d0
22:13:40:WU01:FS01:0xa7:       Bits: 64
22:13:40:WU02:FS02:0x22:********************************************************************************
22:13:40:WU01:FS01:0xa7:       Mode: Release
22:13:40:WU02:FS02:0x22:Project: 13426 (Run 7989, Clone 9, Gen 0)
22:13:40:WU01:FS01:0xa7:************************************ Build *************************************
22:13:40:WU02:FS02:0x22:Unit: 0x0000000112bc7d9a5f66501ae5baecd1
22:13:40:WU01:FS01:0xa7:       SIMD: avx_256
22:13:40:WU02:FS02:0x22:Digital signatures verified
22:13:40:WU01:FS01:0xa7:********************************************************************************
22:13:40:WU02:FS02:0x22:Folding@home GPU Core22 Folding@home Core
22:13:40:WU01:FS01:0xa7:Project: 16804 (Run 34, Clone 80, Gen 24)
22:13:40:WU02:FS02:0x22:Version 0.0.13
22:13:40:WU01:FS01:0xa7:Unit: 0x0000001e82ed0b915e9df218a1ed05d7
22:13:40:WU02:FS02:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
22:13:40:WU01:FS01:0xa7:Digital signatures verified
22:13:40:WU02:FS02:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
22:13:40:WU01:FS01:0xa7:Reducing thread count from 7 to 6 to avoid domain decomposition by a prime number > 3
22:13:40:WU02:FS02:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
22:13:40:WU01:FS01:0xa7:Calling: mdrun -s frame24.tpr -o frame24.trr -cpi state.cpt -cpt 15 -nt 6
22:13:40:WU02:FS02:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
22:13:40:WU01:FS01:0xa7:Steps: first=12000000 total=500000
22:13:41:WU02:FS02:0x22:There are 3 platforms available.
22:13:41:WU02:FS02:0x22:Platform 0: Reference
22:13:41:WU02:FS02:0x22:Platform 1: CPU
22:13:41:WU02:FS02:0x22:Platform 2: OpenCL
22:13:41:WU02:FS02:0x22:  opencl-device 0 specified
22:13:43:WU01:FS01:0xa7:Completed 361787 out of 500000 steps (72%)
22:14:09:WU02:FS02:0x22:Attempting to create OpenCL context:
22:14:09:WU02:FS02:0x22:  Configuring platform OpenCL
22:14:31:WU02:FS02:0x22:  Using OpenCL on platformId 1 and gpu 0
22:14:31:WU02:FS02:0x22:Completed 900000 out of 1000000 steps (90%)
22:19:31:FS01:Shutting core down
22:19:31:FS02:Shutting core down
22:19:31:WU02:FS02:0x22:WARNING:Console control signal 1 on PID 14132
22:19:31:WU02:FS02:0x22:Exiting, please wait. . .
22:19:31:WU01:FS01:0xa7:WARNING:Console control signal 1 on PID 14200
22:19:31:WU01:FS01:0xa7:Exiting, please wait. . .
22:19:31:WU02:FS02:0x22:Folding@home Core Shutdown: INTERRUPTED
22:19:33:WU02:FS02:FahCore returned: INTERRUPTED (102 = 0x66)
22:19:38:WU01:FS01:0xa7:Folding@home Core Shutdown: INTERRUPTED
22:19:39:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
22:20:08:WU02:FS02:Starting
22:20:08:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\MyUser93\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 02 -suffix 01 -version 706 -lifeline 9312 -checkpoint 15 -gpu-vendor amd -opencl-platform 1 -opencl-device 0 -gpu 0
22:20:08:WU02:FS02:Started FahCore on PID 10708
22:20:08:WU02:FS02:Core PID:12904
22:20:08:WU02:FS02:FahCore 0x22 started
22:20:08:WU01:FS01:Starting
22:20:08:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\MyUser93\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 9312 -checkpoint 15 -np 7
22:20:08:WU01:FS01:Started FahCore on PID 15328
22:20:08:WU01:FS01:Core PID:9988
22:20:08:WU01:FS01:FahCore 0xa7 started
22:20:08:WU02:FS02:0x22:*********************** Log Started 2020-10-04T22:20:08Z ***********************
22:20:08:WU02:FS02:0x22:*************************** Core22 Folding@home Core ***************************
22:20:08:WU02:FS02:0x22:       Core: Core22
22:20:08:WU02:FS02:0x22:       Type: 0x22
22:20:08:WU02:FS02:0x22:    Version: 0.0.13
22:20:08:WU02:FS02:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:20:08:WU02:FS02:0x22:  Copyright: 2020 foldingathome.org
22:20:08:WU02:FS02:0x22:   Homepage: https://foldingathome.org/
22:20:08:WU02:FS02:0x22:       Date: Sep 19 2020
22:20:08:WU02:FS02:0x22:       Time: 02:35:58
22:20:08:WU02:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
22:20:08:WU02:FS02:0x22:     Branch: core22-0.0.13
22:20:08:WU02:FS02:0x22:   Compiler: Visual C++ 2015
22:20:08:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
22:20:08:WU02:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
22:20:08:WU02:FS02:0x22:   Platform: win32 10
22:20:08:WU02:FS02:0x22:       Bits: 64
22:20:08:WU02:FS02:0x22:       Mode: Release
22:20:08:WU02:FS02:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
22:20:08:WU02:FS02:0x22:             <peastman@stanford.edu>
22:20:08:WU02:FS02:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 10708 -checkpoint 15
22:20:08:WU02:FS02:0x22:             -gpu-vendor amd -opencl-platform 1 -opencl-device 0 -gpu 0
22:20:08:WU02:FS02:0x22:************************************ libFAH ************************************
22:20:08:WU02:FS02:0x22:       Date: Sep 7 2020
22:20:08:WU02:FS02:0x22:       Time: 19:09:56
22:20:08:WU02:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
22:20:08:WU02:FS02:0x22:     Branch: HEAD
22:20:08:WU02:FS02:0x22:   Compiler: Visual C++ 2015
22:20:08:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
22:20:08:WU02:FS02:0x22:   Platform: win32 10
22:20:08:WU02:FS02:0x22:       Bits: 64
22:20:08:WU02:FS02:0x22:       Mode: Release
22:20:08:WU02:FS02:0x22:************************************ CBang *************************************
22:20:08:WU02:FS02:0x22:       Date: Sep 7 2020
22:20:08:WU02:FS02:0x22:       Time: 19:08:30
22:20:08:WU02:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
22:20:08:WU02:FS02:0x22:     Branch: HEAD
22:20:08:WU02:FS02:0x22:   Compiler: Visual C++ 2015
22:20:08:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
22:20:08:WU02:FS02:0x22:   Platform: win32 10
22:20:08:WU02:FS02:0x22:       Bits: 64
22:20:08:WU02:FS02:0x22:       Mode: Release
22:20:08:WU02:FS02:0x22:************************************ System ************************************
22:20:08:WU02:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz
22:20:08:WU02:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 142 Stepping 10
22:20:08:WU02:FS02:0x22:       CPUs: 8
22:20:08:WU02:FS02:0x22:     Memory: 15.87GiB
22:20:08:WU01:FS01:0xa7:*********************** Log Started 2020-10-04T22:20:08Z ***********************
22:20:08:WU02:FS02:0x22:Free Memory: 10.98GiB
22:20:08:WU01:FS01:0xa7:************************** Gromacs Folding@home Core ***************************
22:20:08:WU02:FS02:0x22:    Threads: WINDOWS_THREADS
22:20:08:WU01:FS01:0xa7:       Type: 0xa7
22:20:08:WU02:FS02:0x22: OS Version: 6.2
22:20:08:WU01:FS01:0xa7:       Core: Gromacs
22:20:08:WU02:FS02:0x22:Has Battery: true
22:20:08:WU01:FS01:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 15328 -checkpoint 15 -np
22:20:08:WU02:FS02:0x22: On Battery: false
22:20:08:WU01:FS01:0xa7:             7
22:20:08:WU02:FS02:0x22: UTC Offset: -7
22:20:08:WU01:FS01:0xa7:************************************ CBang *************************************
22:20:08:WU02:FS02:0x22:        PID: 12904
22:20:08:WU01:FS01:0xa7:       Date: Nov 27 2019
22:20:08:WU02:FS02:0x22:        CWD: C:\Users\MyUser93\AppData\Roaming\FAHClient\work
22:20:08:WU01:FS01:0xa7:       Time: 03:40:09
22:20:08:WU02:FS02:0x22:************************************ OpenMM ************************************
22:20:08:WU01:FS01:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
22:20:08:WU02:FS02:0x22:   Revision: 189320d0
22:20:08:WU01:FS01:0xa7:     Branch: master
22:20:08:WU02:FS02:0x22:********************************************************************************
22:20:08:WU01:FS01:0xa7:   Compiler: Visual C++ 2008
22:20:08:WU02:FS02:0x22:Project: 13426 (Run 7989, Clone 9, Gen 0)
22:20:08:WU01:FS01:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:20:08:WU02:FS02:0x22:Unit: 0x0000000112bc7d9a5f66501ae5baecd1
22:20:08:WU01:FS01:0xa7:   Platform: win32 10
22:20:08:WU02:FS02:0x22:Digital signatures verified
22:20:08:WU01:FS01:0xa7:       Bits: 64
22:20:08:WU02:FS02:0x22:Folding@home GPU Core22 Folding@home Core
22:20:08:WU01:FS01:0xa7:       Mode: Release
22:20:08:WU02:FS02:0x22:Version 0.0.13
22:20:08:WU01:FS01:0xa7:************************************ System ************************************
22:20:08:WU02:FS02:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
22:20:08:WU01:FS01:0xa7:        CPU: Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz
22:20:08:WU02:FS02:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
22:20:08:WU01:FS01:0xa7:     CPU ID: GenuineIntel Family 6 Model 142 Stepping 10
22:20:08:WU02:FS02:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
22:20:08:WU01:FS01:0xa7:       CPUs: 8
22:20:08:WU02:FS02:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
22:20:08:WU01:FS01:0xa7:     Memory: 15.87GiB
22:20:08:WU02:FS02:0x22:There are 3 platforms available.
22:20:08:WU01:FS01:0xa7:Free Memory: 10.97GiB
22:20:08:WU02:FS02:0x22:Platform 0: Reference
22:20:08:WU01:FS01:0xa7:    Threads: WINDOWS_THREADS
22:20:08:WU02:FS02:0x22:Platform 1: CPU
22:20:08:WU01:FS01:0xa7: OS Version: 6.2
22:20:08:WU02:FS02:0x22:Platform 2: OpenCL
22:20:08:WU01:FS01:0xa7:Has Battery: true
22:20:08:WU02:FS02:0x22:  opencl-device 0 specified
22:20:08:WU01:FS01:0xa7: On Battery: false
22:20:08:WU01:FS01:0xa7: UTC Offset: -7
22:20:08:WU01:FS01:0xa7:        PID: 9988
22:20:08:WU01:FS01:0xa7:        CWD: C:\Users\MyUser93\AppData\Roaming\FAHClient\work
22:20:08:WU01:FS01:0xa7:******************************** Build - libFAH ********************************
22:20:08:WU01:FS01:0xa7:    Version: 0.0.19
22:20:08:WU01:FS01:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:20:08:WU01:FS01:0xa7:  Copyright: 2019 foldingathome.org
22:20:08:WU01:FS01:0xa7:   Homepage: https://foldingathome.org/
22:20:08:WU01:FS01:0xa7:       Date: Nov 25 2019
22:20:08:WU01:FS01:0xa7:       Time: 17:12:41
22:20:08:WU01:FS01:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
22:20:08:WU01:FS01:0xa7:     Branch: master
22:20:08:WU01:FS01:0xa7:   Compiler: Visual C++ 2008
22:20:08:WU01:FS01:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:20:08:WU01:FS01:0xa7:   Platform: win32 10
22:20:08:WU01:FS01:0xa7:       Bits: 64
22:20:08:WU01:FS01:0xa7:       Mode: Release
22:20:08:WU01:FS01:0xa7:************************************ Build *************************************
22:20:08:WU01:FS01:0xa7:       SIMD: avx_256
22:20:08:WU01:FS01:0xa7:********************************************************************************
22:20:08:WU01:FS01:0xa7:Project: 16804 (Run 34, Clone 80, Gen 24)
22:20:08:WU01:FS01:0xa7:Unit: 0x0000001e82ed0b915e9df218a1ed05d7
22:20:08:WU01:FS01:0xa7:Digital signatures verified
22:20:08:WU01:FS01:0xa7:Reducing thread count from 7 to 6 to avoid domain decomposition by a prime number > 3
22:20:08:WU01:FS01:0xa7:Calling: mdrun -s frame24.tpr -o frame24.trr -cpi state.cpt -cpt 15 -nt 6
22:20:08:WU01:FS01:0xa7:Steps: first=12000000 total=500000
22:20:09:WU01:FS01:0xa7:Completed 363542 out of 500000 steps (72%)
22:20:24:ERROR:Receive error: 10053: An established connection was aborted by the software in your host machine.
22:20:36:WU02:FS02:0x22:Attempting to create OpenCL context:
22:20:36:WU02:FS02:0x22:  Configuring platform OpenCL
22:20:57:WU02:FS02:0x22:  Using OpenCL on platformId 1 and gpu 0
22:20:57:WU02:FS02:0x22:Completed 900000 out of 1000000 steps (90%)
22:22:51:WU01:FS01:0xa7:Completed 365000 out of 500000 steps (73%)
22:31:54:WU01:FS01:0xa7:Completed 370000 out of 500000 steps (74%)
22:39:56:WU01:FS01:0xa7:Completed 375000 out of 500000 steps (75%)
22:46:00:WU02:FS02:0x22:Completed 910000 out of 1000000 steps (91%)
22:47:35:WU01:FS01:0xa7:Completed 380000 out of 500000 steps (76%)
22:55:05:WU01:FS01:0xa7:Completed 385000 out of 500000 steps (77%)
23:02:28:WU01:FS01:0xa7:Completed 390000 out of 500000 steps (78%)
23:09:44:WU01:FS01:0xa7:Completed 395000 out of 500000 steps (79%)
23:10:50:WU02:FS02:0x22:Completed 920000 out of 1000000 steps (92%)
23:17:01:WU01:FS01:0xa7:Completed 400000 out of 500000 steps (80%)
23:24:28:WU01:FS01:0xa7:Completed 405000 out of 500000 steps (81%)
23:31:41:WU01:FS01:0xa7:Completed 410000 out of 500000 steps (82%)
23:35:40:WU02:FS02:0x22:Completed 930000 out of 1000000 steps (93%)
23:38:53:WU01:FS01:0xa7:Completed 415000 out of 500000 steps (83%)
23:46:04:WU01:FS01:0xa7:Completed 420000 out of 500000 steps (84%)
23:53:16:WU01:FS01:0xa7:Completed 425000 out of 500000 steps (85%)
00:00:27:WU01:FS01:0xa7:Completed 430000 out of 500000 steps (86%)
00:00:28:WU02:FS02:0x22:Completed 940000 out of 1000000 steps (94%)
00:07:37:WU01:FS01:0xa7:Completed 435000 out of 500000 steps (87%)
00:14:50:WU01:FS01:0xa7:Completed 440000 out of 500000 steps (88%)
00:22:02:WU01:FS01:0xa7:Completed 445000 out of 500000 steps (89%)
00:25:17:WU02:FS02:0x22:Completed 950000 out of 1000000 steps (95%)
00:25:18:WU02:FS02:0x22:Checkpoint completed at step 950000
00:29:14:WU01:FS01:0xa7:Completed 450000 out of 500000 steps (90%)
00:36:26:WU01:FS01:0xa7:Completed 455000 out of 500000 steps (91%)
00:43:38:WU01:FS01:0xa7:Completed 460000 out of 500000 steps (92%)
00:50:06:WU02:FS02:0x22:Completed 960000 out of 1000000 steps (96%)
00:50:51:WU01:FS01:0xa7:Completed 465000 out of 500000 steps (93%)
00:58:01:WU01:FS01:0xa7:Completed 470000 out of 500000 steps (94%)
01:05:14:WU01:FS01:0xa7:Completed 475000 out of 500000 steps (95%)
01:12:24:WU01:FS01:0xa7:Completed 480000 out of 500000 steps (96%)
01:14:54:WU02:FS02:0x22:Completed 970000 out of 1000000 steps (97%)
01:19:35:WU01:FS01:0xa7:Completed 485000 out of 500000 steps (97%)
01:26:48:WU01:FS01:0xa7:Completed 490000 out of 500000 steps (98%)
01:34:00:WU01:FS01:0xa7:Completed 495000 out of 500000 steps (99%)
01:34:00:WU00:FS01:Connecting to assign1.foldingathome.org:80
01:34:00:WU00:FS01:Assigned to work server 130.237.11.145
01:34:00:WU00:FS01:Requesting new work unit for slot 01: RUNNING cpu:7 from 130.237.11.145
01:34:00:WU00:FS01:Connecting to 130.237.11.145:8080
01:34:01:WU00:FS01:Downloading 4.49MiB
01:34:05:WU00:FS01:Download complete
01:34:05:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:16803 run:15 clone:600 gen:38 core:0xa7 unit:0x0000003682ed0b915e99f56b8721a639
01:39:42:WU02:FS02:0x22:Completed 980000 out of 1000000 steps (98%)
01:41:14:WU01:FS01:0xa7:Completed 500000 out of 500000 steps (100%)
01:41:18:WU01:FS01:0xa7:Saving result file ..\logfile_01.txt
01:41:18:WU01:FS01:0xa7:Saving result file ener.edr
01:41:18:WU01:FS01:0xa7:Saving result file frame24.trr
01:41:18:WU01:FS01:0xa7:Saving result file md.log
01:41:18:WU01:FS01:0xa7:Saving result file science.log
01:41:18:WU01:FS01:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
01:41:19:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
01:41:19:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:16804 run:34 clone:80 gen:24 core:0xa7 unit:0x0000001e82ed0b915e9df218a1ed05d7
01:41:19:WU01:FS01:Uploading 8.44MiB to 130.237.11.145
01:41:19:WU01:FS01:Connecting to 130.237.11.145:8080
01:41:19:WU00:FS01:Starting
01:41:19:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\MyUser93\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 706 -lifeline 9312 -checkpoint 15 -np 7
01:41:19:WU00:FS01:Started FahCore on PID 5544
01:41:19:WU00:FS01:Core PID:17388
01:41:19:WU00:FS01:FahCore 0xa7 started
01:41:19:WU00:FS01:0xa7:*********************** Log Started 2020-10-05T01:41:19Z ***********************
01:41:19:WU00:FS01:0xa7:************************** Gromacs Folding@home Core ***************************
01:41:19:WU00:FS01:0xa7:       Type: 0xa7
01:41:19:WU00:FS01:0xa7:       Core: Gromacs
01:41:19:WU00:FS01:0xa7:       Args: -dir 00 -suffix 01 -version 706 -lifeline 5544 -checkpoint 15 -np 7
01:41:19:WU00:FS01:0xa7:************************************ CBang *************************************
01:41:19:WU00:FS01:0xa7:       Date: Nov 27 2019
01:41:19:WU00:FS01:0xa7:       Time: 03:40:09
01:41:19:WU00:FS01:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
01:41:19:WU00:FS01:0xa7:     Branch: master
01:41:19:WU00:FS01:0xa7:   Compiler: Visual C++ 2008
01:41:19:WU00:FS01:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
01:41:19:WU00:FS01:0xa7:   Platform: win32 10
01:41:19:WU00:FS01:0xa7:       Bits: 64
01:41:19:WU00:FS01:0xa7:       Mode: Release
01:41:19:WU00:FS01:0xa7:************************************ System ************************************
01:41:19:WU00:FS01:0xa7:        CPU: Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz
01:41:19:WU00:FS01:0xa7:     CPU ID: GenuineIntel Family 6 Model 142 Stepping 10
01:41:19:WU00:FS01:0xa7:       CPUs: 8
01:41:19:WU00:FS01:0xa7:     Memory: 15.87GiB
01:41:19:WU00:FS01:0xa7:Free Memory: 9.98GiB
01:41:19:WU00:FS01:0xa7:    Threads: WINDOWS_THREADS
01:41:19:WU00:FS01:0xa7: OS Version: 6.2
01:41:19:WU00:FS01:0xa7:Has Battery: true
01:41:19:WU00:FS01:0xa7: On Battery: false
01:41:19:WU00:FS01:0xa7: UTC Offset: -7
01:41:19:WU00:FS01:0xa7:        PID: 17388
01:41:19:WU00:FS01:0xa7:        CWD: C:\Users\MyUser93\AppData\Roaming\FAHClient\work
01:41:19:WU00:FS01:0xa7:******************************** Build - libFAH ********************************
01:41:19:WU00:FS01:0xa7:    Version: 0.0.19
01:41:19:WU00:FS01:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
01:41:19:WU00:FS01:0xa7:  Copyright: 2019 foldingathome.org
01:41:19:WU00:FS01:0xa7:   Homepage: https://foldingathome.org/
01:41:19:WU00:FS01:0xa7:       Date: Nov 25 2019
01:41:19:WU00:FS01:0xa7:       Time: 17:12:41
01:41:19:WU00:FS01:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
01:41:19:WU00:FS01:0xa7:     Branch: master
01:41:19:WU00:FS01:0xa7:   Compiler: Visual C++ 2008
01:41:19:WU00:FS01:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
01:41:19:WU00:FS01:0xa7:   Platform: win32 10
01:41:19:WU00:FS01:0xa7:       Bits: 64
01:41:19:WU00:FS01:0xa7:       Mode: Release
01:41:19:WU00:FS01:0xa7:************************************ Build *************************************
01:41:19:WU00:FS01:0xa7:       SIMD: avx_256
01:41:19:WU00:FS01:0xa7:********************************************************************************
01:41:19:WU00:FS01:0xa7:Project: 16803 (Run 15, Clone 600, Gen 38)
01:41:19:WU00:FS01:0xa7:Unit: 0x0000003682ed0b915e99f56b8721a639
01:41:19:WU00:FS01:0xa7:Reading tar file core.xml
01:41:19:WU00:FS01:0xa7:Reading tar file frame38.tpr
01:41:19:WU00:FS01:0xa7:Digital signatures verified
01:41:19:WU00:FS01:0xa7:Reducing thread count from 7 to 6 to avoid domain decomposition by a prime number > 3
01:41:19:WU00:FS01:0xa7:Calling: mdrun -s frame38.tpr -o frame38.trr -cpt 15 -nt 6
01:41:19:WU00:FS01:0xa7:Steps: first=19000000 total=500000
01:41:24:WU00:FS01:0xa7:Completed 1 out of 500000 steps (0%)
01:41:25:WU01:FS01:Upload 17.77%
01:41:31:WU01:FS01:Upload 39.25%
01:41:37:WU01:FS01:Upload 60.72%
01:41:43:WU01:FS01:Upload 82.20%
01:41:48:WU01:FS01:Upload complete
01:41:48:WU01:FS01:Server responded WORK_ACK (400)
01:41:48:WU01:FS01:Final credit estimate, 6569.00 points
01:41:48:WU01:FS01:Cleaning up
01:53:20:WU00:FS01:0xa7:Completed 5000 out of 500000 steps (1%)
02:04:56:WU00:FS01:0xa7:Completed 10000 out of 500000 steps (2%)
02:05:02:WU02:FS02:0x22:Completed 990000 out of 1000000 steps (99%)
02:05:03:WU01:FS02:Connecting to assign1.foldingathome.org:80
02:05:03:WU01:FS02:Assigned to work server 129.213.157.105
02:05:03:WU01:FS02:Requesting new work unit for slot 02: RUNNING gpu:0:Mars [Radeon R7 M260/M265/M270] from 129.213.157.105
02:05:03:WU01:FS02:Connecting to 129.213.157.105:8080
02:05:09:WU01:FS02:Downloading 17.29MiB
02:05:15:WU01:FS02:Download 29.65%
02:05:21:WU01:FS02:Download 49.89%
02:05:27:WU01:FS02:Download 70.50%
02:05:33:WU01:FS02:Download 92.92%
02:05:34:WU01:FS02:Download complete
02:05:34:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14909 run:262 clone:10 gen:11 core:0x22 unit:0x0000000b81d59d695f526022b51b45a3
02:16:35:WU00:FS01:0xa7:Completed 15000 out of 500000 steps (3%)
02:28:13:WU00:FS01:0xa7:Completed 20000 out of 500000 steps (4%)
02:30:03:WU02:FS02:0x22:Completed 1000000 out of 1000000 steps (100%)
02:30:03:WU02:FS02:0x22:Average performance: 5.77154 ns/day
02:30:05:WU02:FS02:0x22:Checkpoint completed at step 1000000
02:30:16:WU02:FS02:0x22:Saving result file ..\logfile_01.txt
02:30:16:WU02:FS02:0x22:Saving result file checkpointIntegrator.xml
02:30:17:WU02:FS02:0x22:Saving result file checkpointState.xml.bz2
02:30:18:WU02:FS02:0x22:Saving result file globals.csv
02:30:18:WU02:FS02:0x22:Saving result file positions.xtc
02:30:18:WU02:FS02:0x22:Saving result file science.log
02:30:18:WU02:FS02:0x22:Folding@home Core Shutdown: FINISHED_UNIT
02:30:19:WU02:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:30:19:WU02:FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:13426 run:7989 clone:9 gen:0 core:0x22 unit:0x0000000112bc7d9a5f66501ae5baecd1
02:30:19:WU02:FS02:Uploading 8.23MiB to 18.188.125.154
02:30:19:WU02:FS02:Connecting to 18.188.125.154:8080
02:30:19:WU01:FS02:Starting
02:30:19:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\MyUser93\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 9312 -checkpoint 15 -gpu-vendor amd -opencl-platform 1 -opencl-device 0 -gpu 0
02:30:19:WU01:FS02:Started FahCore on PID 13348
02:30:19:WU01:FS02:Core PID:12136
02:30:19:WU01:FS02:FahCore 0x22 started
02:30:20:WU01:FS02:0x22:*********************** Log Started 2020-10-05T02:30:19Z ***********************
02:30:20:WU01:FS02:0x22:*************************** Core22 Folding@home Core ***************************
02:30:20:WU01:FS02:0x22:       Core: Core22
02:30:20:WU01:FS02:0x22:       Type: 0x22
02:30:20:WU01:FS02:0x22:    Version: 0.0.13
02:30:20:WU01:FS02:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:30:20:WU01:FS02:0x22:  Copyright: 2020 foldingathome.org
02:30:20:WU01:FS02:0x22:   Homepage: https://foldingathome.org/
02:30:20:WU01:FS02:0x22:       Date: Sep 19 2020
02:30:20:WU01:FS02:0x22:       Time: 02:35:58
02:30:20:WU01:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
02:30:20:WU01:FS02:0x22:     Branch: core22-0.0.13
02:30:20:WU01:FS02:0x22:   Compiler: Visual C++ 2015
02:30:20:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
02:30:20:WU01:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
02:30:20:WU01:FS02:0x22:   Platform: win32 10
02:30:20:WU01:FS02:0x22:       Bits: 64
02:30:20:WU01:FS02:0x22:       Mode: Release
02:30:20:WU01:FS02:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
02:30:20:WU01:FS02:0x22:             <peastman@stanford.edu>
02:30:20:WU01:FS02:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 13348 -checkpoint 15
02:30:20:WU01:FS02:0x22:             -gpu-vendor amd -opencl-platform 1 -opencl-device 0 -gpu 0
02:30:20:WU01:FS02:0x22:************************************ libFAH ************************************
02:30:20:WU01:FS02:0x22:       Date: Sep 7 2020
02:30:20:WU01:FS02:0x22:       Time: 19:09:56
02:30:20:WU01:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
02:30:20:WU01:FS02:0x22:     Branch: HEAD
02:30:20:WU01:FS02:0x22:   Compiler: Visual C++ 2015
02:30:20:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
02:30:20:WU01:FS02:0x22:   Platform: win32 10
02:30:20:WU01:FS02:0x22:       Bits: 64
02:30:20:WU01:FS02:0x22:       Mode: Release
02:30:20:WU01:FS02:0x22:************************************ CBang *************************************
02:30:20:WU01:FS02:0x22:       Date: Sep 7 2020
02:30:20:WU01:FS02:0x22:       Time: 19:08:30
02:30:20:WU01:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
02:30:20:WU01:FS02:0x22:     Branch: HEAD
02:30:20:WU01:FS02:0x22:   Compiler: Visual C++ 2015
02:30:20:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
02:30:20:WU01:FS02:0x22:   Platform: win32 10
02:30:20:WU01:FS02:0x22:       Bits: 64
02:30:20:WU01:FS02:0x22:       Mode: Release
02:30:20:WU01:FS02:0x22:************************************ System ************************************
02:30:20:WU01:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz
02:30:20:WU01:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 142 Stepping 10
02:30:20:WU01:FS02:0x22:       CPUs: 8
02:30:20:WU01:FS02:0x22:     Memory: 15.87GiB
02:30:20:WU01:FS02:0x22:Free Memory: 10.44GiB
02:30:20:WU01:FS02:0x22:    Threads: WINDOWS_THREADS
02:30:20:WU01:FS02:0x22: OS Version: 6.2
02:30:20:WU01:FS02:0x22:Has Battery: true
02:30:20:WU01:FS02:0x22: On Battery: false
02:30:20:WU01:FS02:0x22: UTC Offset: -7
02:30:20:WU01:FS02:0x22:        PID: 12136
02:30:20:WU01:FS02:0x22:        CWD: C:\Users\MyUser93\AppData\Roaming\FAHClient\work
02:30:20:WU01:FS02:0x22:************************************ OpenMM ************************************
02:30:20:WU01:FS02:0x22:   Revision: 189320d0
02:30:20:WU01:FS02:0x22:********************************************************************************
02:30:20:WU01:FS02:0x22:Project: 14909 (Run 262, Clone 10, Gen 11)
02:30:20:WU01:FS02:0x22:Unit: 0x0000000b81d59d695f526022b51b45a3
02:30:20:WU01:FS02:0x22:Reading tar file core.xml
02:30:20:WU01:FS02:0x22:Reading tar file integrator.xml
02:30:20:WU01:FS02:0x22:Reading tar file state.xml
02:30:22:WU01:FS02:0x22:Reading tar file system.xml
02:30:24:WU01:FS02:0x22:Digital signatures verified
02:30:24:WU01:FS02:0x22:Folding@home GPU Core22 Folding@home Core
02:30:24:WU01:FS02:0x22:Version 0.0.13
02:30:25:WU02:FS02:Upload 35.69%
02:30:25:WU01:FS02:0x22:  Checkpoint write interval: 100000 steps (5%) [20 total]
02:30:25:WU01:FS02:0x22:  JSON viewer frame write interval: 20000 steps (1%) [100 total]
02:30:25:WU01:FS02:0x22:  XTC frame write interval: 50000 steps (2.5%) [40 total]
02:30:25:WU01:FS02:0x22:  Global context and integrator variables write interval: disabled
02:30:25:WU01:FS02:0x22:There are 3 platforms available.
02:30:25:WU01:FS02:0x22:Platform 0: Reference
02:30:25:WU01:FS02:0x22:Platform 1: CPU
02:30:25:WU01:FS02:0x22:Platform 2: OpenCL
02:30:25:WU01:FS02:0x22:  opencl-device 0 specified
02:30:31:WU02:FS02:Upload 75.93%
02:30:35:WU02:FS02:Upload complete
02:30:35:WU02:FS02:Server responded WORK_ACK (400)
02:30:35:WU02:FS02:Final credit estimate, 41250.00 points
02:30:35:WU02:FS02:Cleaning up
02:30:47:WU01:FS02:0x22:Attempting to create OpenCL context:
02:30:47:WU01:FS02:0x22:  Configuring platform OpenCL
02:31:02:WU01:FS02:0x22:  Using OpenCL on platformId 1 and gpu 0
02:31:02:WU01:FS02:0x22:Completed 0 out of 2000000 steps (0%)
02:31:04:WU01:FS02:0x22:Checkpoint completed at step 0
02:39:33:WU00:FS01:0xa7:Completed 25000 out of 500000 steps (5%)
02:51:15:WU00:FS01:0xa7:Completed 30000 out of 500000 steps (6%)
03:02:52:WU00:FS01:0xa7:Completed 35000 out of 500000 steps (7%)
03:04:54:WU01:FS02:0x22:Completed 20000 out of 2000000 steps (1%)
03:14:47:WU00:FS01:0xa7:Completed 40000 out of 500000 steps (8%)
03:27:06:WU00:FS01:0xa7:Completed 45000 out of 500000 steps (9%)
03:38:48:WU01:FS02:0x22:Completed 40000 out of 2000000 steps (2%)
03:38:55:WU00:FS01:0xa7:Completed 50000 out of 500000 steps (10%)
03:50:41:WU00:FS01:0xa7:Completed 55000 out of 500000 steps (11%)
04:02:26:WU00:FS01:0xa7:Completed 60000 out of 500000 steps (12%)
04:12:38:WU01:FS02:0x22:Completed 60000 out of 2000000 steps (3%)
******************************* Date: 2020-10-05 *******************************

[Neil-B]

OK .. so looks like the gpu wu has 5% checkpoints and is starting from the 90% after restarts - as I guessed ... and then once left to its own devices completing and sending results to WS ... so I am now more confident that what you were seeing was an artefact in the viewer caused by looking at the reported estimated completion times firstly prior to the core properly starting up (the 99.99% report) and then once it had started but before it had done enough work after restart to be able to accurately estimate completion time.