no download, no error, no message at all

doune · Post by **doune** » Sat Oct 12, 2019 4:20 am

But what's strange is that this is only happening for one slot: my GPU. The CPU continues to download, fold, upload, and repeat with no interruptions. The GPU finishes X number of jobs, uploads successfully, then just never downloads anything.

In advanced control, the status is "download" but it's permanently at 0%. The logs show nothing with that slot. If I manually kill the FAHClient process and restart, usually it will start downloading again but the UI tools never work quite as reliably afterwards so I wind up rebooting.

This has been happening for approximately the past month. I did a fresh format/reinstall of Win 10 Pro just a few days ago and the problem immediately came back. The hardware tests stable with Prime95 and FurMark no matter how long I run them. The old GPU driver was the "standard" install and the new one (the OS was also a fresh download of the latest installer from MS) is the new DCH package. It doesn't appear to be a driver issue since it does work once I get it to actually do something again.

Code: Select all

*********************** Log Started 2019-10-10T02:14:11Z ***********************
02:14:11:************************* Folding@home Client *************************
02:14:11:        Website: https://foldingathome.org/
02:14:11:      Copyright: (c) 2009-2018 foldingathome.org
02:14:11:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:14:11:           Args: 
02:14:11:         Config: C:\Users\doune\AppData\Roaming\FAHClient\config.xml
02:14:11:******************************** Build ********************************
02:14:11:        Version: 7.5.1
02:14:11:           Date: May 11 2018
02:14:11:           Time: 13:06:32
02:14:11:     Repository: Git
02:14:11:       Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
02:14:11:         Branch: master
02:14:11:       Compiler: Visual C++ 2008
02:14:11:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
02:14:11:       Platform: win32 10
02:14:11:           Bits: 32
02:14:11:           Mode: Release
02:14:11:******************************* System ********************************
02:14:11:            CPU: AMD Ryzen 7 2700X Eight-Core Processor
02:14:11:         CPU ID: AuthenticAMD Family 23 Model 8 Stepping 2
02:14:11:           CPUs: 16
02:14:11:         Memory: 15.93GiB
02:14:11:    Free Memory: 13.62GiB
02:14:11:        Threads: WINDOWS_THREADS
02:14:11:     OS Version: 6.2
02:14:11:    Has Battery: false
02:14:11:     On Battery: false
02:14:11:     UTC Offset: -5
02:14:11:            PID: 8652
02:14:11:            CWD: C:\Users\doune\AppData\Roaming\FAHClient
02:14:11:             OS: Windows 10 Enterprise
02:14:11:        OS Arch: AMD64
02:14:11:           GPUs: 1
02:14:11:          GPU 0: Bus:35 Slot:0 Func:0 NVIDIA:7 TU106 [GeForce RTX 2070] M 6497
02:14:11:  CUDA Device 0: Platform:0 Device:0 Bus:35 Slot:0 Compute:7.5 Driver:10.1
02:14:11:OpenCL Device 0: Platform:0 Device:0 Bus:35 Slot:0 Compute:1.2 Driver:431.86
02:14:11:  Win32 Service: false
02:14:11:***********************************************************************
02:14:11:<config>
02:14:11:  <!-- Network -->
02:14:11:  <proxy v=':8080'/>
02:14:11:
02:14:11:  <!-- Slot Control -->
02:14:11:  <power v='full'/>
02:14:11:
02:14:11:  <!-- User Information -->
02:14:11:  <passkey v='********************************'/>
02:14:11:  <team v='233892'/>
02:14:11:  <user v='morphal'/>
02:14:11:
02:14:11:  <!-- Folding Slots -->
02:14:11:  <slot id='0' type='CPU'>
02:14:11:    <cpus v='12'/>
02:14:11:  </slot>
02:14:11:  <slot id='1' type='GPU'/>
02:14:11:</config>
02:14:11:Trying to access database...
02:14:11:Successfully acquired database lock
02:14:11:Enabled folding slot 00: READY cpu:12
02:14:11:Enabled folding slot 01: READY gpu:0:TU106 [GeForce RTX 2070] M 6497
02:14:11:WU00:FS00:Starting
02:14:11:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\doune\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/x86/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 705 -lifeline 8652 -checkpoint 15 -np 12
02:14:11:WU00:FS00:Started FahCore on PID 8832
02:14:12:WU00:FS00:Core PID:9032
02:14:12:WU00:FS00:FahCore 0xa7 started
02:14:13:WU00:FS00:0xa7:*********************** Log Started 2019-10-10T02:14:13Z ***********************
02:14:13:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
02:14:13:WU00:FS00:0xa7:       Type: 0xa7
02:14:13:WU00:FS00:0xa7:       Core: Gromacs
02:14:13:WU00:FS00:0xa7:    Website: https://foldingathome.org/
02:14:13:WU00:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
02:14:13:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:14:13:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 705 -lifeline 8832 -checkpoint 15 -np
02:14:13:WU00:FS00:0xa7:             12
02:14:13:WU00:FS00:0xa7:     Config: <none>
02:14:13:WU00:FS00:0xa7:************************************ Build *************************************
02:14:13:WU00:FS00:0xa7:    Version: 0.0.17
02:14:13:WU00:FS00:0xa7:       Date: Apr 25 2018
02:14:13:WU00:FS00:0xa7:       Time: 11:02:26
02:14:13:WU00:FS00:0xa7: Repository: Git
02:14:13:WU00:FS00:0xa7:   Revision: fd11abfb405c921e66db1226933e9dd2d18d2acc
02:14:13:WU00:FS00:0xa7:     Branch: master
02:14:13:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
02:14:13:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
02:14:13:WU00:FS00:0xa7:   Platform: win32 10
02:14:13:WU00:FS00:0xa7:       Bits: 32
02:14:13:WU00:FS00:0xa7:       Mode: Release
02:14:13:WU00:FS00:0xa7:       SIMD: sse2
02:14:13:WU00:FS00:0xa7:************************************ System ************************************
02:14:13:WU00:FS00:0xa7:        CPU: Unknown
02:14:13:WU00:FS00:0xa7:     CPU ID: 
02:14:13:WU00:FS00:0xa7:       CPUs: 16
02:14:13:WU00:FS00:0xa7:     Memory: 15.93GiB
02:14:13:WU00:FS00:0xa7:Free Memory: 13.55GiB
02:14:13:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
02:14:13:WU00:FS00:0xa7: OS Version: 6.2
02:14:13:WU00:FS00:0xa7:Has Battery: false
02:14:13:WU00:FS00:0xa7: On Battery: false
02:14:13:WU00:FS00:0xa7: UTC Offset: -5
02:14:13:WU00:FS00:0xa7:        PID: 9032
02:14:13:WU00:FS00:0xa7:        CWD: C:\Users\doune\AppData\Roaming\FAHClient\work
02:14:13:WU00:FS00:0xa7:         OS: Windows 10 Enterprise
02:14:13:WU00:FS00:0xa7:    OS Arch: AMD64
02:14:13:WU00:FS00:0xa7:********************************************************************************
02:14:13:WU00:FS00:0xa7:Project: 14190 (Run 1, Clone 83, Gen 1)
02:14:13:WU00:FS00:0xa7:Unit: 0x000000030002894b5d5d2f6168f26e01
02:14:13:WU00:FS00:0xa7:Digital signatures verified
02:14:13:WU00:FS00:0xa7:Calling: mdrun -s frame1.tpr -o frame1.trr -cpi state.cpt -cpt 15 -nt 12
02:14:14:WU00:FS00:0xa7:Steps: first=1250000 total=1250000
02:14:16:WU00:FS00:0xa7:Completed 561042 out of 1250000 steps (44%)
02:14:16:WU01:FS01:Connecting to 65.254.110.245:8080
02:14:17:WU01:FS01:Assigned to work server 128.252.203.10
02:14:17:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:TU106 [GeForce RTX 2070] M 6497 from 128.252.203.10
02:14:17:WU01:FS01:Connecting to 128.252.203.10:8080
02:14:18:WU01:FS01:Downloading 69.91MiB
02:14:20:WU01:FS01:Download complete
02:14:21:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14230 run:533 clone:1 gen:98 core:0x21 unit:0x0000008180fccb0a5d654c4d3878a376
02:14:21:WU01:FS01:Downloading core from http://cores.foldingathome.org/Win32/AMD64/NVIDIA/Fermi/Core_21.fah
02:14:21:WU01:FS01:Connecting to cores.foldingathome.org:80
02:14:21:WU01:FS01:FahCore 21: Downloading 3.47MiB
02:14:22:WU01:FS01:FahCore 21: Download complete
02:14:22:WU01:FS01:Valid core signature
02:14:22:WU01:FS01:Unpacked 11.80MiB to cores/cores.foldingathome.org/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe
02:14:22:WU01:FS01:Starting
02:14:22:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\doune\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 705 -lifeline 8652 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
02:14:22:WU01:FS01:Started FahCore on PID 880
02:14:22:WU01:FS01:Core PID:8284
02:14:22:WU01:FS01:FahCore 0x21 started
02:14:23:WU01:FS01:0x21:*********************** Log Started 2019-10-10T02:14:22Z ***********************
02:14:23:WU01:FS01:0x21:Project: 14230 (Run 533, Clone 1, Gen 98)
02:14:23:WU01:FS01:0x21:Unit: 0x0000008180fccb0a5d654c4d3878a376
02:14:23:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
02:14:23:WU01:FS01:0x21:Machine: 1
02:14:23:WU01:FS01:0x21:Reading tar file core.xml
02:14:23:WU01:FS01:0x21:Reading tar file integrator.xml
02:14:23:WU01:FS01:0x21:Reading tar file state.xml
02:14:23:WU01:FS01:0x21:Reading tar file system.xml
02:14:24:WU01:FS01:0x21:Digital signatures verified
02:14:24:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
02:14:24:WU01:FS01:0x21:Version 0.0.20
02:14:51:WU01:FS01:0x21:Completed 0 out of 500000 steps (0%)
02:14:51:WU01:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
02:15:03:WU00:FS00:0xa7:Completed 562500 out of 1250000 steps (45%)
02:15:07:ERROR:Receive error: 10054: An existing connection was forcibly closed by the remote host.
02:15:21:WU01:FS01:0x21:Completed 5000 out of 500000 steps (1%)
02:15:51:WU01:FS01:0x21:Completed 10000 out of 500000 steps (2%)
02:16:21:WU01:FS01:0x21:Completed 15000 out of 500000 steps (3%)
02:16:51:WU01:FS01:0x21:Completed 20000 out of 500000 steps (4%)
02:17:28:WU01:FS01:0x21:Completed 25000 out of 500000 steps (5%)
.....
08:25:05:WU01:FS01:Cleaning up

That's it. It just stops. It's hard for me to troubleshoot a null.

The CPU slot does keep going so I don't think it's a network issue.
Pausing/unpausing doesn't seem to trigger any sort of action. I've let it sit since that 10/10 8:25 timestamp and there's nothing in the log at all for that slot, good or bad.

Post by **Joe_H** » Sat Oct 12, 2019 6:30 am

You have left out an important section of your log, from about 98-99% complete on the GPU WU and the completion of the upload. That gives us nothing to work with to troubleshoot your problem.

Post by **bruce** » Sat Oct 12, 2019 4:31 pm

See my response to what might be a similar problem here who also left out critical information.

Post by **bruce** » Sat Oct 12, 2019 6:47 pm

Have you tried pausing that slot .... then unpausing that slot. What error messages do you get?

doune · Post by **doune** » Sun Oct 13, 2019 4:00 am

Code: Select all

******************************* Date: 2019-10-10 *******************************
08:14:22:WU01:FS01:0x21:Completed 1900000 out of 2000000 steps (95%)
08:15:42:WU00:FS00:0xa7:Completed 1212500 out of 1250000 steps (97%)
08:16:28:WU01:FS01:0x21:Completed 1920000 out of 2000000 steps (96%)
08:18:34:WU01:FS01:0x21:Completed 1940000 out of 2000000 steps (97%)
08:20:40:WU01:FS01:0x21:Completed 1960000 out of 2000000 steps (98%)
08:22:26:WU00:FS00:0xa7:Completed 1225000 out of 1250000 steps (98%)
08:22:46:WU01:FS01:0x21:Completed 1980000 out of 2000000 steps (99%)
08:22:47:WU02:FS01:Connecting to 65.254.110.245:8080
08:22:47:WU02:FS01:Assigned to work server 155.247.166.220
08:22:47:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:TU106 [GeForce RTX 2070] M 6497 from 155.247.166.220
08:22:47:WU02:FS01:Connecting to 155.247.166.220:8080
08:22:47:WU02:FS01:Downloading 15.59MiB
08:24:52:WU01:FS01:0x21:Completed 2000000 out of 2000000 steps (100%)
08:25:00:WU01:FS01:0x21:Saving result file logfile_01.txt
08:25:00:WU01:FS01:0x21:Saving result file checkpointState.xml
08:25:01:WU01:FS01:0x21:Saving result file checkpt.crc
08:25:01:WU01:FS01:0x21:Saving result file log.txt
08:25:01:WU01:FS01:0x21:Saving result file positions.xtc
08:25:01:WU01:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
08:25:02:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
08:25:02:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:14227 run:197 clone:1 gen:53 core:0x21 unit:0x0000005580fccb0a5d6545e0d1ad98ae
08:25:02:WU01:FS01:Uploading 93.41MiB to 128.252.203.10
08:25:02:WU01:FS01:Connecting to 128.252.203.10:8080
08:25:05:WU01:FS01:Upload complete
08:25:05:WU01:FS01:Server responded WORK_ACK (400)
08:25:05:WU01:FS01:Final credit estimate, 194814.00 points
08:25:05:WU01:FS01:Cleaning up

I think this is what's missing.

I checked the other thread and was able to browse to both of the IP addresses. The pages just showed FAH logos and informed me they are work servers.

doune · Post by **doune** » Sun Oct 13, 2019 6:20 am

With the "failed reading core package header" error stopping my CPU and this behavior stopping my GPU, I figured it was time to kill the FAHClient process and restart it.

I'll include the new log on the off chance that it contains some new nugget of valuable information:

Code: Select all

*********************** Log Started 2019-10-13T05:05:09Z ***********************
05:05:09:************************* Folding@home Client *************************
05:05:09:        Website: https://foldingathome.org/
05:05:09:      Copyright: (c) 2009-2018 foldingathome.org
05:05:09:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
05:05:09:           Args: --open-web-control
05:05:09:         Config: C:\Users\doune\AppData\Roaming\FAHClient\config.xml
05:05:09:******************************** Build ********************************
05:05:09:        Version: 7.5.1
05:05:09:           Date: May 11 2018
05:05:09:           Time: 13:06:32
05:05:09:     Repository: Git
05:05:09:       Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
05:05:09:         Branch: master
05:05:09:       Compiler: Visual C++ 2008
05:05:09:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
05:05:09:       Platform: win32 10
05:05:09:           Bits: 32
05:05:09:           Mode: Release
05:05:09:******************************* System ********************************
05:05:09:            CPU: AMD Ryzen 7 2700X Eight-Core Processor
05:05:09:         CPU ID: AuthenticAMD Family 23 Model 8 Stepping 2
05:05:09:           CPUs: 16
05:05:09:         Memory: 15.93GiB
05:05:09:    Free Memory: 10.41GiB
05:05:09:        Threads: WINDOWS_THREADS
05:05:09:     OS Version: 6.2
05:05:09:    Has Battery: false
05:05:09:     On Battery: false
05:05:09:     UTC Offset: -5
05:05:09:            PID: 8316
05:05:09:            CWD: C:\Users\doune\AppData\Roaming\FAHClient
05:05:09:             OS: Windows 10 Enterprise
05:05:09:        OS Arch: AMD64
05:05:09:           GPUs: 1
05:05:09:          GPU 0: Bus:35 Slot:0 Func:0 NVIDIA:7 TU106 [GeForce RTX 2070] M 6497
05:05:09:  CUDA Device 0: Platform:0 Device:0 Bus:35 Slot:0 Compute:7.5 Driver:10.1
05:05:09:OpenCL Device 0: Platform:0 Device:0 Bus:35 Slot:0 Compute:1.2 Driver:431.86
05:05:09:  Win32 Service: false
05:05:09:***********************************************************************
05:05:09:<config>
05:05:09:  <!-- Network -->
05:05:09:  <proxy v=':8080'/>
05:05:09:
05:05:09:  <!-- Slot Control -->
05:05:09:  <power v='full'/>
05:05:09:
05:05:09:  <!-- User Information -->
05:05:09:  <passkey v='********************************'/>
05:05:09:  <team v='233892'/>
05:05:09:  <user v='morphal'/>
05:05:09:
05:05:09:  <!-- Folding Slots -->
05:05:09:  <slot id='0' type='CPU'>
05:05:09:    <cpus v='12'/>
05:05:09:  </slot>
05:05:09:  <slot id='1' type='GPU'/>
05:05:09:</config>
05:05:09:Trying to access database...
05:05:09:Successfully acquired database lock
05:05:09:Enabled folding slot 00: READY cpu:12
05:05:09:Enabled folding slot 01: READY gpu:0:TU106 [GeForce RTX 2070] M 6497
05:05:09:WU01:FS00:Downloading core from http://cores.foldingathome.org/Win32/x86/AVX/Core_a7.fah
05:05:09:WU01:FS00:Connecting to cores.foldingathome.org:80
05:05:09:WU00:FS01:Connecting to 65.254.110.245:8080
05:05:09:ERROR:WU01:FS00:Exception: Failed reading core package header.
05:05:10:WU00:FS01:Assigned to work server 155.247.166.220
05:05:10:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:TU106 [GeForce RTX 2070] M 6497 from 155.247.166.220
05:05:10:WU00:FS01:Connecting to 155.247.166.220:8080
05:05:10:WU00:FS01:Downloading 15.86MiB
05:05:12:16:127.0.0.1:New Web connection
05:05:13:WU00:FS01:Download complete
05:05:13:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14180 run:4 clone:334 gen:34 core:0x21 unit:0x000000320002894c5d3b54d66dcffa7d
05:05:13:WU00:FS01:Starting
05:05:13:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\doune\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 705 -lifeline 8316 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
05:05:13:WU00:FS01:Started FahCore on PID 3388
05:05:13:WU00:FS01:Core PID:7540
05:05:13:WU00:FS01:FahCore 0x21 started
05:05:14:WU00:FS01:0x21:*********************** Log Started 2019-10-13T05:05:13Z ***********************
05:05:14:WU00:FS01:0x21:Project: 14180 (Run 4, Clone 334, Gen 34)
05:05:14:WU00:FS01:0x21:Unit: 0x000000320002894c5d3b54d66dcffa7d
05:05:14:WU00:FS01:0x21:CPU: 0x00000000000000000000000000000000
05:05:14:WU00:FS01:0x21:Machine: 1
05:05:14:WU00:FS01:0x21:Reading tar file core.xml
05:05:14:WU00:FS01:0x21:Reading tar file integrator.xml
05:05:14:WU00:FS01:0x21:Reading tar file state.xml
05:05:14:WU00:FS01:0x21:Reading tar file system.xml
05:05:14:WU00:FS01:0x21:Digital signatures verified
05:05:14:WU00:FS01:0x21:Folding@home GPU Core21 Folding@home Core
05:05:14:WU00:FS01:0x21:Version 0.0.20
05:05:20:WU00:FS01:0x21:Completed 0 out of 12500000 steps (0%)
05:05:20:WU00:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
05:06:09:WU01:FS00:Downloading core from http://cores.foldingathome.org/Win32/x86/AVX/Core_a7.fah
05:06:09:WU01:FS00:Connecting to cores.foldingathome.org:80
05:06:09:ERROR:WU01:FS00:Exception: Failed reading core package header.
05:07:46:WU01:FS00:Downloading core from http://cores.foldingathome.org/Win32/x86/AVX/Core_a7.fah
05:07:46:WU01:FS00:Connecting to cores.foldingathome.org:80
05:07:46:ERROR:WU01:FS00:Exception: Failed reading core package header.
05:09:19:WU00:FS01:0x21:Completed 125000 out of 12500000 steps (1%)
05:10:23:WU01:FS00:Downloading core from http://cores.foldingathome.org/Win32/x86/AVX/Core_a7.fah
05:10:23:WU01:FS00:Connecting to cores.foldingathome.org:80
05:10:23:ERROR:WU01:FS00:Exception: Failed reading core package header.
05:13:14:WU00:FS01:0x21:Completed 250000 out of 12500000 steps (2%)
05:14:37:WU01:FS00:Downloading core from http://cores.foldingathome.org/Win32/x86/AVX/Core_a7.fah
05:14:37:WU01:FS00:Connecting to cores.foldingathome.org:80
05:14:37:ERROR:WU01:FS00:Exception: Failed reading core package header.
05:17:14:WU00:FS01:0x21:Completed 375000 out of 12500000 steps (3%)
05:21:01:WU00:FS01:0x21:Completed 500000 out of 12500000 steps (4%)
05:21:29:WU01:FS00:Downloading core from http://cores.foldingathome.org/Win32/x86/AVX/Core_a7.fah
05:21:29:WU01:FS00:Connecting to cores.foldingathome.org:80
05:21:29:ERROR:WU01:FS00:Exception: Failed reading core package header.
05:24:52:WU00:FS01:0x21:Completed 625000 out of 12500000 steps (5%)
05:28:40:WU00:FS01:0x21:Completed 750000 out of 12500000 steps (6%)
05:32:34:WU01:FS00:Downloading core from http://cores.foldingathome.org/Win32/x86/AVX/Core_a7.fah
05:32:34:WU01:FS00:Connecting to cores.foldingathome.org:80
05:32:34:ERROR:WU01:FS00:Exception: Failed reading core package header.
05:32:38:WU00:FS01:0x21:Completed 875000 out of 12500000 steps (7%)
05:36:21:WU00:FS01:0x21:Completed 1000000 out of 12500000 steps (8%)
05:39:45:WU00:FS01:0x21:Completed 1125000 out of 12500000 steps (9%)
05:43:19:WU00:FS01:0x21:Completed 1250000 out of 12500000 steps (10%)
05:47:21:WU00:FS01:0x21:Completed 1375000 out of 12500000 steps (11%)
05:50:31:WU01:FS00:Downloading core from http://cores.foldingathome.org/Win32/x86/AVX/Core_a7.fah
05:50:31:WU01:FS00:Connecting to cores.foldingathome.org:80
05:50:31:ERROR:WU01:FS00:Exception: Failed reading core package header.
05:51:15:WU00:FS01:0x21:Completed 1500000 out of 12500000 steps (12%)
05:55:10:WU00:FS01:0x21:Completed 1625000 out of 12500000 steps (13%)
05:59:13:WU00:FS01:0x21:Completed 1750000 out of 12500000 steps (14%)
06:02:54:WU00:FS01:0x21:Completed 1875000 out of 12500000 steps (15%)
06:06:38:WU00:FS01:0x21:Completed 2000000 out of 12500000 steps (16%)
06:10:39:WU00:FS01:0x21:Completed 2125000 out of 12500000 steps (17%)
06:13:24:WU00:FS01:0x21:Completed 2250000 out of 12500000 steps (18%)
06:15:52:WU00:FS01:0x21:Completed 2375000 out of 12500000 steps (19%)

As I said above, it generally works once I kill FAHClient and restart it. (Is there a more elegant way to stop that process?) However, it might start the behavior again as soon as this one finishes or it may take a few days before it happens. Usually, it's within a day.

Post by **bruce** » Sun Oct 13, 2019 6:48 pm

doune wrote:As I said above, it generally works once I kill FAHClient and restart it. (Is there a more elegant way to stop that process?) However, it might start the behavior again as soon as this one finishes or it may take a few days before it happens. Usually, it's within a day.

I'm not sure I'd call it more elegant, but rebooting is simpler.

In Windows, simply logging off (without rebooting) and then logging back on will restart FAHClient.

doune · Post by **doune** » Sat Oct 19, 2019 12:48 pm

It took longer than usual to recur but here we go:

Code: Select all

04:26:03:WU00:FS00:Connecting to 155.247.166.219:8080
04:26:03:WU01:FS00:Starting
04:26:03:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\doune\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 705 -lifeline 8316 -checkpoint 15 -np 12
04:26:03:WU01:FS00:Started FahCore on PID 4468
04:26:03:WU01:FS00:Core PID:10684
04:26:03:WU01:FS00:FahCore 0xa7 started
04:26:04:WU01:FS00:0xa7:*********************** Log Started 2019-10-19T04:26:04Z ***********************
04:26:04:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
04:26:04:WU01:FS00:0xa7:       Type: 0xa7
04:26:04:WU01:FS00:0xa7:       Core: Gromacs
04:26:04:WU01:FS00:0xa7:    Website: https://foldingathome.org/
04:26:04:WU01:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
04:26:04:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
04:26:04:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 705 -lifeline 4468 -checkpoint 15 -np
04:26:04:WU01:FS00:0xa7:             12
04:26:04:WU01:FS00:0xa7:     Config: <none>
04:26:04:WU01:FS00:0xa7:************************************ Build *************************************
04:26:04:WU01:FS00:0xa7:    Version: 0.0.17
04:26:04:WU01:FS00:0xa7:       Date: Apr 27 2018
04:26:04:WU01:FS00:0xa7:       Time: 16:19:36
04:26:04:WU01:FS00:0xa7: Repository: Git
04:26:04:WU01:FS00:0xa7:   Revision: 21359963583d09ec2063ef946399441c4df4ccd7
04:26:04:WU01:FS00:0xa7:     Branch: master
04:26:04:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
04:26:04:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:26:04:WU01:FS00:0xa7:   Platform: win32 10
04:26:04:WU01:FS00:0xa7:       Bits: 64
04:26:04:WU01:FS00:0xa7:       Mode: Release
04:26:04:WU01:FS00:0xa7:       SIMD: avx_256
04:26:04:WU01:FS00:0xa7:************************************ System ************************************
04:26:04:WU01:FS00:0xa7:        CPU: Unknown
04:26:04:WU01:FS00:0xa7:     CPU ID: 
04:26:04:WU01:FS00:0xa7:       CPUs: 16
04:26:04:WU01:FS00:0xa7:     Memory: 15.93GiB
04:26:04:WU01:FS00:0xa7:Free Memory: 11.33GiB
04:26:04:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
04:26:04:WU01:FS00:0xa7: OS Version: 6.2
04:26:04:WU01:FS00:0xa7:Has Battery: false
04:26:04:WU01:FS00:0xa7: On Battery: false
04:26:04:WU01:FS00:0xa7: UTC Offset: -5
04:26:04:WU01:FS00:0xa7:        PID: 10684
04:26:04:WU01:FS00:0xa7:        CWD: C:\Users\doune\AppData\Roaming\FAHClient\work
04:26:04:WU01:FS00:0xa7:         OS: Windows 10 Pro
04:26:04:WU01:FS00:0xa7:    OS Arch: AMD64
04:26:04:WU01:FS00:0xa7:********************************************************************************
04:26:04:WU01:FS00:0xa7:Project: 13827 (Run 559, Clone 2, Gen 46)
04:26:04:WU01:FS00:0xa7:Unit: 0x0000003880fccb095c9f83cd73b5478f
04:26:04:WU01:FS00:0xa7:Reading tar file core.xml
04:26:04:WU01:FS00:0xa7:Reading tar file frame46.tpr
04:26:04:WU01:FS00:0xa7:Digital signatures verified
04:26:04:WU01:FS00:0xa7:Calling: mdrun -s frame46.tpr -o frame46.trr -x frame46.xtc -cpt 15 -nt 12
04:26:04:WU00:FS00:Upload complete
04:26:04:WU01:FS00:0xa7:Steps: first=5750000 total=125000
04:26:04:WU00:FS00:Server responded WORK_ACK (400)
04:26:04:WU00:FS00:Final credit estimate, 17013.00 points
04:26:04:WU00:FS00:Cleaning up
04:26:07:WU01:FS00:0xa7:Completed 1 out of 125000 steps (0%)
04:26:42:WU02:FS01:0x21:Completed 3950000 out of 5000000 steps (79%)
04:27:24:WU01:FS00:0xa7:Completed 1250 out of 125000 steps (1%)
04:28:40:WU01:FS00:0xa7:Completed 2500 out of 125000 steps (2%)
04:28:52:WU02:FS01:0x21:Completed 4000000 out of 5000000 steps (80%)
04:29:56:WU01:FS00:0xa7:Completed 3750 out of 125000 steps (3%)
04:31:06:WU02:FS01:0x21:Completed 4050000 out of 5000000 steps (81%)
04:31:11:WU01:FS00:0xa7:Completed 5000 out of 125000 steps (4%)
04:32:27:WU01:FS00:0xa7:Completed 6250 out of 125000 steps (5%)
04:33:17:WU02:FS01:0x21:Completed 4100000 out of 5000000 steps (82%)
04:33:43:WU01:FS00:0xa7:Completed 7500 out of 125000 steps (6%)
04:34:59:WU01:FS00:0xa7:Completed 8750 out of 125000 steps (7%)
04:35:27:WU02:FS01:0x21:Completed 4150000 out of 5000000 steps (83%)
04:36:15:WU01:FS00:0xa7:Completed 10000 out of 125000 steps (8%)
04:37:30:WU01:FS00:0xa7:Completed 11250 out of 125000 steps (9%)
04:37:37:WU02:FS01:0x21:Completed 4200000 out of 5000000 steps (84%)
04:38:46:WU01:FS00:0xa7:Completed 12500 out of 125000 steps (10%)
04:39:48:WU02:FS01:0x21:Completed 4250000 out of 5000000 steps (85%)
04:40:02:WU01:FS00:0xa7:Completed 13750 out of 125000 steps (11%)
04:41:18:WU01:FS00:0xa7:Completed 15000 out of 125000 steps (12%)
04:42:02:WU02:FS01:0x21:Completed 4300000 out of 5000000 steps (86%)
04:42:34:WU01:FS00:0xa7:Completed 16250 out of 125000 steps (13%)
04:43:50:WU01:FS00:0xa7:Completed 17500 out of 125000 steps (14%)
04:44:12:WU02:FS01:0x21:Completed 4350000 out of 5000000 steps (87%)
04:45:06:WU01:FS00:0xa7:Completed 18750 out of 125000 steps (15%)
04:46:21:WU01:FS00:0xa7:Completed 20000 out of 125000 steps (16%)
04:46:23:WU02:FS01:0x21:Completed 4400000 out of 5000000 steps (88%)
04:47:37:WU01:FS00:0xa7:Completed 21250 out of 125000 steps (17%)
04:48:33:WU02:FS01:0x21:Completed 4450000 out of 5000000 steps (89%)
04:48:53:WU01:FS00:0xa7:Completed 22500 out of 125000 steps (18%)
04:50:09:WU01:FS00:0xa7:Completed 23750 out of 125000 steps (19%)
04:50:44:WU02:FS01:0x21:Completed 4500000 out of 5000000 steps (90%)
04:51:25:WU01:FS00:0xa7:Completed 25000 out of 125000 steps (20%)
04:52:40:WU01:FS00:0xa7:Completed 26250 out of 125000 steps (21%)
04:52:57:WU02:FS01:0x21:Completed 4550000 out of 5000000 steps (91%)
04:53:56:WU01:FS00:0xa7:Completed 27500 out of 125000 steps (22%)
04:55:08:WU02:FS01:0x21:Completed 4600000 out of 5000000 steps (92%)
04:55:11:WU01:FS00:0xa7:Completed 28750 out of 125000 steps (23%)
04:56:28:WU01:FS00:0xa7:Completed 30000 out of 125000 steps (24%)
04:57:18:WU02:FS01:0x21:Completed 4650000 out of 5000000 steps (93%)
04:57:44:WU01:FS00:0xa7:Completed 31250 out of 125000 steps (25%)
04:59:00:WU01:FS00:0xa7:Completed 32500 out of 125000 steps (26%)
04:59:28:WU02:FS01:0x21:Completed 4700000 out of 5000000 steps (94%)
05:00:15:WU01:FS00:0xa7:Completed 33750 out of 125000 steps (27%)
05:01:31:WU01:FS00:0xa7:Completed 35000 out of 125000 steps (28%)
05:01:38:WU02:FS01:0x21:Completed 4750000 out of 5000000 steps (95%)
05:02:46:WU01:FS00:0xa7:Completed 36250 out of 125000 steps (29%)
05:03:52:WU02:FS01:0x21:Completed 4800000 out of 5000000 steps (96%)
05:04:02:WU01:FS00:0xa7:Completed 37500 out of 125000 steps (30%)
05:05:18:WU01:FS00:0xa7:Completed 38750 out of 125000 steps (31%)
05:06:02:WU02:FS01:0x21:Completed 4850000 out of 5000000 steps (97%)
05:06:34:WU01:FS00:0xa7:Completed 40000 out of 125000 steps (32%)
05:07:49:WU01:FS00:0xa7:Completed 41250 out of 125000 steps (33%)
05:08:12:WU02:FS01:0x21:Completed 4900000 out of 5000000 steps (98%)
05:09:05:WU01:FS00:0xa7:Completed 42500 out of 125000 steps (34%)
05:10:20:WU01:FS00:0xa7:Completed 43750 out of 125000 steps (35%)
05:10:23:WU02:FS01:0x21:Completed 4950000 out of 5000000 steps (99%)
05:10:23:WU00:FS01:Connecting to 65.254.110.245:8080
05:10:23:WU00:FS01:Assigned to work server 155.247.166.220
05:10:23:WU00:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:TU106 [GeForce RTX 2070] M 6497 from 155.247.166.220
05:10:23:WU00:FS01:Connecting to 155.247.166.220:8080
05:10:23:WU00:FS01:Downloading 15.58MiB
05:10:30:WU00:FS01:Download 1.60%
05:10:36:WU00:FS01:Download 2.81%
05:10:50:WU00:FS01:Download 4.81%
05:10:57:WU00:FS01:Download 6.02%
05:11:05:WU00:FS01:Download 8.83%
05:11:11:WU00:FS01:Download 11.64%
05:11:18:WU00:FS01:Download 13.24%
05:11:25:WU00:FS01:Download 15.65%
05:11:32:WU00:FS01:Download 17.65%
05:11:37:WU01:FS00:0xa7:Completed 45000 out of 125000 steps (36%)
05:11:39:WU00:FS01:Download 19.26%
05:11:47:WU00:FS01:Download 20.86%
05:12:24:WU00:FS01:Download 22.47%
05:12:32:WU00:FS01:Download 23.27%
05:12:33:WU02:FS01:0x21:Completed 5000000 out of 5000000 steps (100%)
05:12:36:WU02:FS01:0x21:Saving result file logfile_01.txt
05:12:36:WU02:FS01:0x21:Saving result file checkpointState.xml
05:12:36:WU02:FS01:0x21:Saving result file checkpt.crc
05:12:36:WU02:FS01:0x21:Saving result file log.txt
05:12:36:WU02:FS01:0x21:Saving result file positions.xtc
05:12:36:WU02:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
05:12:37:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:12:37:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:14196 run:13 clone:81 gen:9 core:0x21 unit:0x0000000e0002894b5d9246852fe28c4b
05:12:37:WU02:FS01:Uploading 19.37MiB to 155.247.166.219
05:12:37:WU02:FS01:Connecting to 155.247.166.219:8080
05:12:40:WU02:FS01:Upload complete
05:12:40:WU02:FS01:Server responded WORK_ACK (400)
05:12:40:WU02:FS01:Final credit estimate, 152916.00 points
05:12:40:WU02:FS01:Cleaning up
05:12:52:WU01:FS00:0xa7:Completed 46250 out of 125000 steps (37%)
05:13:09:WU00:FS01:Download 24.07%
05:14:06:WU01:FS00:0xa7:Completed 47500 out of 125000 steps (38%)
05:15:19:WU01:FS00:0xa7:Completed 48750 out of 125000 steps (39%)
05:16:33:WU01:FS00:0xa7:Completed 50000 out of 125000 steps (40%)
05:17:46:WU01:FS00:0xa7:Completed 51250 out of 125000 steps (41%)
05:19:00:WU01:FS00:0xa7:Completed 52500 out of 125000 steps (42%)
05:20:13:WU01:FS00:0xa7:Completed 53750 out of 125000 steps (43%)
05:21:26:WU01:FS00:0xa7:Completed 55000 out of 125000 steps (44%)
05:22:39:WU01:FS00:0xa7:Completed 56250 out of 125000 steps (45%)
05:23:53:WU01:FS00:0xa7:Completed 57500 out of 125000 steps (46%)
05:25:06:WU01:FS00:0xa7:Completed 58750 out of 125000 steps (47%)
******************************* Date: 2019-10-19 *******************************
05:26:20:WU01:FS00:0xa7:Completed 60000 out of 125000 steps (48%)
05:27:33:WU01:FS00:0xa7:Completed 61250 out of 125000 steps (49%)
05:28:46:WU01:FS00:0xa7:Completed 62500 out of 125000 steps (50%)
05:29:59:WU01:FS00:0xa7:Completed 63750 out of 125000 steps (51%)
05:31:12:WU01:FS00:0xa7:Completed 65000 out of 125000 steps (52%)
05:32:25:WU01:FS00:0xa7:Completed 66250 out of 125000 steps (53%)
05:33:39:WU01:FS00:0xa7:Completed 67500 out of 125000 steps (54%)
05:34:52:WU01:FS00:0xa7:Completed 68750 out of 125000 steps (55%)
05:36:05:WU01:FS00:0xa7:Completed 70000 out of 125000 steps (56%)
05:37:18:WU01:FS00:0xa7:Completed 71250 out of 125000 steps (57%)
05:38:31:WU01:FS00:0xa7:Completed 72500 out of 125000 steps (58%)
05:39:44:WU01:FS00:0xa7:Completed 73750 out of 125000 steps (59%)
05:40:58:WU01:FS00:0xa7:Completed 75000 out of 125000 steps (60%)
05:42:12:WU01:FS00:0xa7:Completed 76250 out of 125000 steps (61%)
05:43:25:WU01:FS00:0xa7:Completed 77500 out of 125000 steps (62%)
05:44:38:WU01:FS00:0xa7:Completed 78750 out of 125000 steps (63%)
05:45:51:WU01:FS00:0xa7:Completed 80000 out of 125000 steps (64%)
05:47:04:WU01:FS00:0xa7:Completed 81250 out of 125000 steps (65%)
05:48:18:WU01:FS00:0xa7:Completed 82500 out of 125000 steps (66%)
05:49:31:WU01:FS00:0xa7:Completed 83750 out of 125000 steps (67%)
05:50:44:WU01:FS00:0xa7:Completed 85000 out of 125000 steps (68%)
05:51:57:WU01:FS00:0xa7:Completed 86250 out of 125000 steps (69%)
05:53:10:WU01:FS00:0xa7:Completed 87500 out of 125000 steps (70%)
05:54:23:WU01:FS00:0xa7:Completed 88750 out of 125000 steps (71%)
05:55:36:WU01:FS00:0xa7:Completed 90000 out of 125000 steps (72%)
05:56:50:WU01:FS00:0xa7:Completed 91250 out of 125000 steps (73%)
05:58:03:WU01:FS00:0xa7:Completed 92500 out of 125000 steps (74%)
05:59:16:WU01:FS00:0xa7:Completed 93750 out of 125000 steps (75%)
06:00:29:WU01:FS00:0xa7:Completed 95000 out of 125000 steps (76%)
06:01:42:WU01:FS00:0xa7:Completed 96250 out of 125000 steps (77%)
06:02:55:WU01:FS00:0xa7:Completed 97500 out of 125000 steps (78%)
06:04:09:WU01:FS00:0xa7:Completed 98750 out of 125000 steps (79%)
06:05:22:WU01:FS00:0xa7:Completed 100000 out of 125000 steps (80%)
06:06:35:WU01:FS00:0xa7:Completed 101250 out of 125000 steps (81%)
06:07:48:WU01:FS00:0xa7:Completed 102500 out of 125000 steps (82%)
06:09:01:WU01:FS00:0xa7:Completed 103750 out of 125000 steps (83%)
06:10:14:WU01:FS00:0xa7:Completed 105000 out of 125000 steps (84%)
06:11:28:WU01:FS00:0xa7:Completed 106250 out of 125000 steps (85%)
06:12:41:WU01:FS00:0xa7:Completed 107500 out of 125000 steps (86%)
06:13:54:WU01:FS00:0xa7:Completed 108750 out of 125000 steps (87%)
06:15:08:WU01:FS00:0xa7:Completed 110000 out of 125000 steps (88%)
06:16:20:WU01:FS00:0xa7:Completed 111250 out of 125000 steps (89%)
06:17:33:WU01:FS00:0xa7:Completed 112500 out of 125000 steps (90%)
06:18:47:WU01:FS00:0xa7:Completed 113750 out of 125000 steps (91%)
06:20:00:WU01:FS00:0xa7:Completed 115000 out of 125000 steps (92%)
06:21:13:WU01:FS00:0xa7:Completed 116250 out of 125000 steps (93%)
06:22:26:WU01:FS00:0xa7:Completed 117500 out of 125000 steps (94%)
06:23:39:WU01:FS00:0xa7:Completed 118750 out of 125000 steps (95%)
06:24:52:WU01:FS00:0xa7:Completed 120000 out of 125000 steps (96%)
06:26:05:WU01:FS00:0xa7:Completed 121250 out of 125000 steps (97%)
06:27:19:WU01:FS00:0xa7:Completed 122500 out of 125000 steps (98%)
06:28:32:WU01:FS00:0xa7:Completed 123750 out of 125000 steps (99%)
06:28:33:WU02:FS00:Connecting to 65.254.110.245:8080
06:28:33:WU02:FS00:Assigned to work server 128.252.203.9
06:28:33:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:12 from 128.252.203.9
06:28:33:WU02:FS00:Connecting to 128.252.203.9:8080
06:28:33:WU02:FS00:Downloading 8.14MiB
06:28:34:WU02:FS00:Download complete
06:28:34:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13830 run:966 clone:2 gen:13 core:0xa7 unit:0x0000001480fccb095d693c0cf59ea8e9
06:29:45:WU01:FS00:0xa7:Completed 125000 out of 125000 steps (100%)
06:29:50:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
06:29:50:WU01:FS00:0xa7:Saving result file frame46.trr
06:29:50:WU01:FS00:0xa7:Saving result file frame46.xtc
06:29:50:WU01:FS00:0xa7:Saving result file md.log
06:29:50:WU01:FS00:0xa7:Saving result file science.log
06:29:50:WU01:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
06:29:51:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:29:51:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:13827 run:559 clone:2 gen:46 core:0xa7 unit:0x0000003880fccb095c9f83cd73b5478f
06:29:51:WU01:FS00:Uploading 11.23MiB to 128.252.203.9
06:29:51:WU01:FS00:Connecting to 128.252.203.9:8080
06:29:51:WU02:FS00:Starting
06:29:51:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\doune\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 705 -lifeline 8316 -checkpoint 15 -np 12
06:29:51:WU02:FS00:Started FahCore on PID 9788
06:29:51:WU02:FS00:Core PID:2528
06:29:51:WU02:FS00:FahCore 0xa7 started
06:29:51:WU02:FS00:0xa7:*********************** Log Started 2019-10-19T06:29:51Z ***********************
06:29:51:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
06:29:51:WU02:FS00:0xa7:       Type: 0xa7
06:29:51:WU02:FS00:0xa7:       Core: Gromacs
06:29:51:WU02:FS00:0xa7:    Website: https://foldingathome.org/
06:29:51:WU02:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
06:29:51:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
06:29:51:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 9788 -checkpoint 15 -np
06:29:51:WU02:FS00:0xa7:             12
06:29:51:WU02:FS00:0xa7:     Config: <none>
06:29:51:WU02:FS00:0xa7:************************************ Build *************************************
06:29:51:WU02:FS00:0xa7:    Version: 0.0.17
06:29:51:WU02:FS00:0xa7:       Date: Apr 27 2018
06:29:51:WU02:FS00:0xa7:       Time: 16:19:36
06:29:51:WU02:FS00:0xa7: Repository: Git
06:29:51:WU02:FS00:0xa7:   Revision: 21359963583d09ec2063ef946399441c4df4ccd7
06:29:51:WU02:FS00:0xa7:     Branch: master
06:29:51:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
06:29:51:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
06:29:51:WU02:FS00:0xa7:   Platform: win32 10
06:29:51:WU02:FS00:0xa7:       Bits: 64
06:29:51:WU02:FS00:0xa7:       Mode: Release
06:29:51:WU02:FS00:0xa7:       SIMD: avx_256
06:29:51:WU02:FS00:0xa7:************************************ System ************************************
06:29:51:WU02:FS00:0xa7:        CPU: Unknown
06:29:51:WU02:FS00:0xa7:     CPU ID: 
06:29:51:WU02:FS00:0xa7:       CPUs: 16
06:29:51:WU02:FS00:0xa7:     Memory: 15.93GiB
06:29:51:WU02:FS00:0xa7:Free Memory: 11.67GiB
06:29:51:WU02:FS00:0xa7:    Threads: WINDOWS_THREADS
06:29:51:WU02:FS00:0xa7: OS Version: 6.2
06:29:51:WU02:FS00:0xa7:Has Battery: false
06:29:51:WU02:FS00:0xa7: On Battery: false
06:29:51:WU02:FS00:0xa7: UTC Offset: -5
06:29:51:WU02:FS00:0xa7:        PID: 2528
06:29:51:WU02:FS00:0xa7:        CWD: C:\Users\doune\AppData\Roaming\FAHClient\work
06:29:51:WU02:FS00:0xa7:         OS: Windows 10 Pro
06:29:51:WU02:FS00:0xa7:    OS Arch: AMD64
06:29:51:WU02:FS00:0xa7:********************************************************************************
06:29:51:WU02:FS00:0xa7:Project: 13830 (Run 966, Clone 2, Gen 13)
06:29:51:WU02:FS00:0xa7:Unit: 0x0000001480fccb095d693c0cf59ea8e9
06:29:51:WU02:FS00:0xa7:Reading tar file core.xml
06:29:51:WU02:FS00:0xa7:Reading tar file frame13.tpr
06:29:51:WU02:FS00:0xa7:Digital signatures verified
06:29:51:WU02:FS00:0xa7:Calling: mdrun -s frame13.tpr -o frame13.trr -x frame13.xtc -cpt 15 -nt 12
06:29:51:WU02:FS00:0xa7:Steps: first=1625000 total=125000
06:29:51:WU01:FS00:Upload complete
06:29:51:WU01:FS00:Server responded WORK_ACK (400)
06:29:51:WU01:FS00:Final credit estimate, 6950.00 points
06:29:51:WU01:FS00:Cleaning up
06:29:54:WU02:FS00:0xa7:Completed 1 out of 125000 steps (0%)
06:31:07:WU02:FS00:0xa7:Completed 1250 out of 125000 steps (1%)
06:32:20:WU02:FS00:0xa7:Completed 2500 out of 125000 steps (2%)
06:33:34:WU02:FS00:0xa7:Completed 3750 out of 125000 steps (3%)
06:34:46:WU02:FS00:0xa7:Completed 5000 out of 125000 steps (4%)
06:35:59:WU02:FS00:0xa7:Completed 6250 out of 125000 steps (5%)
06:37:12:WU02:FS00:0xa7:Completed 7500 out of 125000 steps (6%)
06:38:25:WU02:FS00:0xa7:Completed 8750 out of 125000 steps (7%)
06:39:38:WU02:FS00:0xa7:Completed 10000 out of 125000 steps (8%)
06:40:51:WU02:FS00:0xa7:Completed 11250 out of 125000 steps (9%)
06:42:04:WU02:FS00:0xa7:Completed 12500 out of 125000 steps (10%)
06:43:17:WU02:FS00:0xa7:Completed 13750 out of 125000 steps (11%)
06:44:29:WU02:FS00:0xa7:Completed 15000 out of 125000 steps (12%)
06:45:44:WU02:FS00:0xa7:Completed 16250 out of 125000 steps (13%)
06:46:56:WU02:FS00:0xa7:Completed 17500 out of 125000 steps (14%)
06:48:09:WU02:FS00:0xa7:Completed 18750 out of 125000 steps (15%)
06:49:23:WU02:FS00:0xa7:Completed 20000 out of 125000 steps (16%)
06:50:35:WU02:FS00:0xa7:Completed 21250 out of 125000 steps (17%)
06:51:48:WU02:FS00:0xa7:Completed 22500 out of 125000 steps (18%)
06:53:01:WU02:FS00:0xa7:Completed 23750 out of 125000 steps (19%)
06:54:14:WU02:FS00:0xa7:Completed 25000 out of 125000 steps (20%)
06:55:27:WU02:FS00:0xa7:Completed 26250 out of 125000 steps (21%)
06:56:39:WU02:FS00:0xa7:Completed 27500 out of 125000 steps (22%)
06:57:52:WU02:FS00:0xa7:Completed 28750 out of 125000 steps (23%)
06:59:05:WU02:FS00:0xa7:Completed 30000 out of 125000 steps (24%)
07:00:19:WU02:FS00:0xa7:Completed 31250 out of 125000 steps (25%)
07:01:32:WU02:FS00:0xa7:Completed 32500 out of 125000 steps (26%)
07:02:45:WU02:FS00:0xa7:Completed 33750 out of 125000 steps (27%)
07:03:58:WU02:FS00:0xa7:Completed 35000 out of 125000 steps (28%)
07:05:11:WU02:FS00:0xa7:Completed 36250 out of 125000 steps (29%)
07:06:24:WU02:FS00:0xa7:Completed 37500 out of 125000 steps (30%)
07:07:37:WU02:FS00:0xa7:Completed 38750 out of 125000 steps (31%)
07:08:50:WU02:FS00:0xa7:Completed 40000 out of 125000 steps (32%)
07:10:02:WU02:FS00:0xa7:Completed 41250 out of 125000 steps (33%)
07:11:16:WU02:FS00:0xa7:Completed 42500 out of 125000 steps (34%)
07:12:28:WU02:FS00:0xa7:Completed 43750 out of 125000 steps (35%)
07:13:41:WU02:FS00:0xa7:Completed 45000 out of 125000 steps (36%)
07:14:55:WU02:FS00:0xa7:Completed 46250 out of 125000 steps (37%)
07:16:08:WU02:FS00:0xa7:Completed 47500 out of 125000 steps (38%)
07:17:21:WU02:FS00:0xa7:Completed 48750 out of 125000 steps (39%)
07:18:34:WU02:FS00:0xa7:Completed 50000 out of 125000 steps (40%)
07:19:47:WU02:FS00:0xa7:Completed 51250 out of 125000 steps (41%)
07:21:00:WU02:FS00:0xa7:Completed 52500 out of 125000 steps (42%)
07:22:13:WU02:FS00:0xa7:Completed 53750 out of 125000 steps (43%)
07:23:25:WU02:FS00:0xa7:Completed 55000 out of 125000 steps (44%)
07:24:38:WU02:FS00:0xa7:Completed 56250 out of 125000 steps (45%)
07:25:51:WU02:FS00:0xa7:Completed 57500 out of 125000 steps (46%)
07:27:04:WU02:FS00:0xa7:Completed 58750 out of 125000 steps (47%)
07:28:17:WU02:FS00:0xa7:Completed 60000 out of 125000 steps (48%)
07:29:30:WU02:FS00:0xa7:Completed 61250 out of 125000 steps (49%)
07:30:44:WU02:FS00:0xa7:Completed 62500 out of 125000 steps (50%)
07:31:57:WU02:FS00:0xa7:Completed 63750 out of 125000 steps (51%)
07:33:09:WU02:FS00:0xa7:Completed 65000 out of 125000 steps (52%)
07:34:23:WU02:FS00:0xa7:Completed 66250 out of 125000 steps (53%)
07:35:36:WU02:FS00:0xa7:Completed 67500 out of 125000 steps (54%)
07:36:49:WU02:FS00:0xa7:Completed 68750 out of 125000 steps (55%)
07:38:02:WU02:FS00:0xa7:Completed 70000 out of 125000 steps (56%)
07:39:14:WU02:FS00:0xa7:Completed 71250 out of 125000 steps (57%)
07:40:27:WU02:FS00:0xa7:Completed 72500 out of 125000 steps (58%)
07:41:40:WU02:FS00:0xa7:Completed 73750 out of 125000 steps (59%)
07:42:53:WU02:FS00:0xa7:Completed 75000 out of 125000 steps (60%)
07:44:06:WU02:FS00:0xa7:Completed 76250 out of 125000 steps (61%)
07:45:20:WU02:FS00:0xa7:Completed 77500 out of 125000 steps (62%)
07:46:33:WU02:FS00:0xa7:Completed 78750 out of 125000 steps (63%)
07:47:46:WU02:FS00:0xa7:Completed 80000 out of 125000 steps (64%)
07:48:59:WU02:FS00:0xa7:Completed 81250 out of 125000 steps (65%)
07:50:12:WU02:FS00:0xa7:Completed 82500 out of 125000 steps (66%)
07:51:25:WU02:FS00:0xa7:Completed 83750 out of 125000 steps (67%)
07:52:38:WU02:FS00:0xa7:Completed 85000 out of 125000 steps (68%)
07:53:50:WU02:FS00:0xa7:Completed 86250 out of 125000 steps (69%)
07:55:03:WU02:FS00:0xa7:Completed 87500 out of 125000 steps (70%)
07:56:16:WU02:FS00:0xa7:Completed 88750 out of 125000 steps (71%)
07:57:29:WU02:FS00:0xa7:Completed 90000 out of 125000 steps (72%)
07:58:42:WU02:FS00:0xa7:Completed 91250 out of 125000 steps (73%)
07:59:56:WU02:FS00:0xa7:Completed 92500 out of 125000 steps (74%)
08:01:09:WU02:FS00:0xa7:Completed 93750 out of 125000 steps (75%)
08:02:21:WU02:FS00:0xa7:Completed 95000 out of 125000 steps (76%)
08:03:35:WU02:FS00:0xa7:Completed 96250 out of 125000 steps (77%)
08:04:48:WU02:FS00:0xa7:Completed 97500 out of 125000 steps (78%)
08:06:01:WU02:FS00:0xa7:Completed 98750 out of 125000 steps (79%)
08:07:13:WU02:FS00:0xa7:Completed 100000 out of 125000 steps (80%)
08:08:26:WU02:FS00:0xa7:Completed 101250 out of 125000 steps (81%)
08:09:39:WU02:FS00:0xa7:Completed 102500 out of 125000 steps (82%)
08:10:52:WU02:FS00:0xa7:Completed 103750 out of 125000 steps (83%)
08:12:05:WU02:FS00:0xa7:Completed 105000 out of 125000 steps (84%)
08:13:18:WU02:FS00:0xa7:Completed 106250 out of 125000 steps (85%)
08:14:31:WU02:FS00:0xa7:Completed 107500 out of 125000 steps (86%)
08:15:45:WU02:FS00:0xa7:Completed 108750 out of 125000 steps (87%)
08:17:01:WU02:FS00:0xa7:Completed 110000 out of 125000 steps (88%)
08:18:14:WU02:FS00:0xa7:Completed 111250 out of 125000 steps (89%)
08:19:27:WU02:FS00:0xa7:Completed 112500 out of 125000 steps (90%)
08:20:40:WU02:FS00:0xa7:Completed 113750 out of 125000 steps (91%)
08:21:53:WU02:FS00:0xa7:Completed 115000 out of 125000 steps (92%)
08:23:06:WU02:FS00:0xa7:Completed 116250 out of 125000 steps (93%)
08:24:18:WU02:FS00:0xa7:Completed 117500 out of 125000 steps (94%)
08:25:31:WU02:FS00:0xa7:Completed 118750 out of 125000 steps (95%)
08:26:44:WU02:FS00:0xa7:Completed 120000 out of 125000 steps (96%)
08:27:57:WU02:FS00:0xa7:Completed 121250 out of 125000 steps (97%)
08:29:10:WU02:FS00:0xa7:Completed 122500 out of 125000 steps (98%)
08:30:24:WU02:FS00:0xa7:Completed 123750 out of 125000 steps (99%)
08:30:25:WU01:FS00:Connecting to 65.254.110.245:8080
08:30:25:WU01:FS00:Assigned to work server 128.252.203.9
08:30:25:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:12 from 128.252.203.9
08:30:25:WU01:FS00:Connecting to 128.252.203.9:8080
08:30:25:WU01:FS00:Downloading 8.14MiB
08:30:26:WU01:FS00:Download complete
08:30:26:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13831 run:906 clone:2 gen:15 core:0xa7 unit:0x0000001080fccb095d693a3c775d4e2d
08:31:37:WU02:FS00:0xa7:Completed 125000 out of 125000 steps (100%)
08:31:42:WU02:FS00:0xa7:Saving result file ..\logfile_01.txt
08:31:42:WU02:FS00:0xa7:Saving result file frame13.trr
08:31:42:WU02:FS00:0xa7:Saving result file frame13.xtc
08:31:42:WU02:FS00:0xa7:Saving result file md.log
08:31:42:WU02:FS00:0xa7:Saving result file science.log
08:31:42:WU02:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
08:31:42:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
08:31:42:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:13830 run:966 clone:2 gen:13 core:0xa7 unit:0x0000001480fccb095d693c0cf59ea8e9
08:31:42:WU02:FS00:Uploading 11.26MiB to 128.252.203.9
08:31:42:WU02:FS00:Connecting to 128.252.203.9:8080
08:31:42:WU01:FS00:Starting
08:31:42:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\doune\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 705 -lifeline 8316 -checkpoint 15 -np 12
08:31:42:WU01:FS00:Started FahCore on PID 10576
08:31:42:WU01:FS00:Core PID:3628
08:31:42:WU01:FS00:FahCore 0xa7 started
08:31:43:WU01:FS00:0xa7:*********************** Log Started 2019-10-19T08:31:42Z ***********************
08:31:43:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
08:31:43:WU01:FS00:0xa7:       Type: 0xa7
08:31:43:WU01:FS00:0xa7:       Core: Gromacs
08:31:43:WU01:FS00:0xa7:    Website: https://foldingathome.org/
08:31:43:WU01:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
08:31:43:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
08:31:43:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 705 -lifeline 10576 -checkpoint 15 -np
08:31:43:WU01:FS00:0xa7:             12
08:31:43:WU01:FS00:0xa7:     Config: <none>
08:31:43:WU01:FS00:0xa7:************************************ Build *************************************
08:31:43:WU01:FS00:0xa7:    Version: 0.0.17
08:31:43:WU01:FS00:0xa7:       Date: Apr 27 2018
08:31:43:WU01:FS00:0xa7:       Time: 16:19:36
08:31:43:WU01:FS00:0xa7: Repository: Git
08:31:43:WU01:FS00:0xa7:   Revision: 21359963583d09ec2063ef946399441c4df4ccd7
08:31:43:WU01:FS00:0xa7:     Branch: master
08:31:43:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
08:31:43:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
08:31:43:WU01:FS00:0xa7:   Platform: win32 10
08:31:43:WU01:FS00:0xa7:       Bits: 64
08:31:43:WU01:FS00:0xa7:       Mode: Release
08:31:43:WU01:FS00:0xa7:       SIMD: avx_256
08:31:43:WU01:FS00:0xa7:************************************ System ************************************
08:31:43:WU01:FS00:0xa7:        CPU: Unknown
08:31:43:WU01:FS00:0xa7:     CPU ID: 
08:31:43:WU01:FS00:0xa7:       CPUs: 16
08:31:43:WU01:FS00:0xa7:     Memory: 15.93GiB
08:31:43:WU01:FS00:0xa7:Free Memory: 11.64GiB
08:31:43:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
08:31:43:WU01:FS00:0xa7: OS Version: 6.2
08:31:43:WU01:FS00:0xa7:Has Battery: false
08:31:43:WU01:FS00:0xa7: On Battery: false
08:31:43:WU01:FS00:0xa7: UTC Offset: -5
08:31:43:WU01:FS00:0xa7:        PID: 3628
08:31:43:WU01:FS00:0xa7:        CWD: C:\Users\doune\AppData\Roaming\FAHClient\work
08:31:43:WU01:FS00:0xa7:         OS: Windows 10 Pro
08:31:43:WU01:FS00:0xa7:    OS Arch: AMD64
08:31:43:WU01:FS00:0xa7:********************************************************************************
08:31:43:WU01:FS00:0xa7:Project: 13831 (Run 906, Clone 2, Gen 15)
08:31:43:WU01:FS00:0xa7:Unit: 0x0000001080fccb095d693a3c775d4e2d
08:31:43:WU01:FS00:0xa7:Reading tar file core.xml
08:31:43:WU01:FS00:0xa7:Reading tar file frame15.tpr
08:31:43:WU01:FS00:0xa7:Digital signatures verified
08:31:43:WU01:FS00:0xa7:Calling: mdrun -s frame15.tpr -o frame15.trr -x frame15.xtc -cpt 15 -nt 12
08:31:43:WU01:FS00:0xa7:Steps: first=1875000 total=125000
08:31:43:WU02:FS00:Upload complete
08:31:43:WU02:FS00:Server responded WORK_ACK (400)
08:31:43:WU02:FS00:Final credit estimate, 7052.00 points
08:31:43:WU02:FS00:Cleaning up
08:31:46:WU01:FS00:0xa7:Completed 1 out of 125000 steps (0%)
08:32:59:WU01:FS00:0xa7:Completed 1250 out of 125000 steps (1%)
08:34:13:WU01:FS00:0xa7:Completed 2500 out of 125000 steps (2%)
08:35:26:WU01:FS00:0xa7:Completed 3750 out of 125000 steps (3%)
08:36:39:WU01:FS00:0xa7:Completed 5000 out of 125000 steps (4%)
08:37:52:WU01:FS00:0xa7:Completed 6250 out of 125000 steps (5%)
08:39:05:WU01:FS00:0xa7:Completed 7500 out of 125000 steps (6%)
08:40:18:WU01:FS00:0xa7:Completed 8750 out of 125000 steps (7%)
08:41:31:WU01:FS00:0xa7:Completed 10000 out of 125000 steps (8%)
08:42:44:WU01:FS00:0xa7:Completed 11250 out of 125000 steps (9%)
08:43:57:WU01:FS00:0xa7:Completed 12500 out of 125000 steps (10%)
08:45:10:WU01:FS00:0xa7:Completed 13750 out of 125000 steps (11%)
08:46:22:WU01:FS00:0xa7:Completed 15000 out of 125000 steps (12%)
08:47:36:WU01:FS00:0xa7:Completed 16250 out of 125000 steps (13%)
08:48:50:WU01:FS00:0xa7:Completed 17500 out of 125000 steps (14%)
08:50:02:WU01:FS00:0xa7:Completed 18750 out of 125000 steps (15%)
08:51:15:WU01:FS00:0xa7:Completed 20000 out of 125000 steps (16%)
08:52:28:WU01:FS00:0xa7:Completed 21250 out of 125000 steps (17%)
08:53:41:WU01:FS00:0xa7:Completed 22500 out of 125000 steps (18%)
08:54:54:WU01:FS00:0xa7:Completed 23750 out of 125000 steps (19%)
08:56:07:WU01:FS00:0xa7:Completed 25000 out of 125000 steps (20%)
08:57:20:WU01:FS00:0xa7:Completed 26250 out of 125000 steps (21%)
08:58:33:WU01:FS00:0xa7:Completed 27500 out of 125000 steps (22%)
08:59:46:WU01:FS00:0xa7:Completed 28750 out of 125000 steps (23%)
09:00:59:WU01:FS00:0xa7:Completed 30000 out of 125000 steps (24%)
09:02:13:WU01:FS00:0xa7:Completed 31250 out of 125000 steps (25%)
09:03:25:WU01:FS00:0xa7:Completed 32500 out of 125000 steps (26%)
09:04:39:WU01:FS00:0xa7:Completed 33750 out of 125000 steps (27%)
09:05:52:WU01:FS00:0xa7:Completed 35000 out of 125000 steps (28%)
09:07:05:WU01:FS00:0xa7:Completed 36250 out of 125000 steps (29%)
09:08:17:WU01:FS00:0xa7:Completed 37500 out of 125000 steps (30%)
09:09:30:WU01:FS00:0xa7:Completed 38750 out of 125000 steps (31%)
09:10:43:WU01:FS00:0xa7:Completed 40000 out of 125000 steps (32%)
09:11:56:WU01:FS00:0xa7:Completed 41250 out of 125000 steps (33%)
09:13:09:WU01:FS00:0xa7:Completed 42500 out of 125000 steps (34%)
09:14:22:WU01:FS00:0xa7:Completed 43750 out of 125000 steps (35%)
09:15:35:WU01:FS00:0xa7:Completed 45000 out of 125000 steps (36%)
09:16:49:WU01:FS00:0xa7:Completed 46250 out of 125000 steps (37%)
09:18:02:WU01:FS00:0xa7:Completed 47500 out of 125000 steps (38%)
09:19:15:WU01:FS00:0xa7:Completed 48750 out of 125000 steps (39%)
09:20:28:WU01:FS00:0xa7:Completed 50000 out of 125000 steps (40%)
09:21:41:WU01:FS00:0xa7:Completed 51250 out of 125000 steps (41%)
09:22:54:WU01:FS00:0xa7:Completed 52500 out of 125000 steps (42%)
09:24:06:WU01:FS00:0xa7:Completed 53750 out of 125000 steps (43%)
09:25:19:WU01:FS00:0xa7:Completed 55000 out of 125000 steps (44%)
09:26:32:WU01:FS00:0xa7:Completed 56250 out of 125000 steps (45%)
09:27:45:WU01:FS00:0xa7:Completed 57500 out of 125000 steps (46%)
09:28:58:WU01:FS00:0xa7:Completed 58750 out of 125000 steps (47%)
09:30:11:WU01:FS00:0xa7:Completed 60000 out of 125000 steps (48%)
09:31:24:WU01:FS00:0xa7:Completed 61250 out of 125000 steps (49%)
09:32:38:WU01:FS00:0xa7:Completed 62500 out of 125000 steps (50%)
09:33:51:WU01:FS00:0xa7:Completed 63750 out of 125000 steps (51%)
09:35:04:WU01:FS00:0xa7:Completed 65000 out of 125000 steps (52%)
09:36:17:WU01:FS00:0xa7:Completed 66250 out of 125000 steps (53%)
09:37:30:WU01:FS00:0xa7:Completed 67500 out of 125000 steps (54%)
09:38:43:WU01:FS00:0xa7:Completed 68750 out of 125000 steps (55%)
09:39:55:WU01:FS00:0xa7:Completed 70000 out of 125000 steps (56%)
09:41:08:WU01:FS00:0xa7:Completed 71250 out of 125000 steps (57%)
09:42:21:WU01:FS00:0xa7:Completed 72500 out of 125000 steps (58%)
09:43:34:WU01:FS00:0xa7:Completed 73750 out of 125000 steps (59%)
09:44:47:WU01:FS00:0xa7:Completed 75000 out of 125000 steps (60%)
09:46:00:WU01:FS00:0xa7:Completed 76250 out of 125000 steps (61%)
09:47:14:WU01:FS00:0xa7:Completed 77500 out of 125000 steps (62%)
09:48:27:WU01:FS00:0xa7:Completed 78750 out of 125000 steps (63%)
09:49:40:WU01:FS00:0xa7:Completed 80000 out of 125000 steps (64%)
09:50:53:WU01:FS00:0xa7:Completed 81250 out of 125000 steps (65%)
09:52:05:WU01:FS00:0xa7:Completed 82500 out of 125000 steps (66%)
09:53:19:WU01:FS00:0xa7:Completed 83750 out of 125000 steps (67%)
09:54:31:WU01:FS00:0xa7:Completed 85000 out of 125000 steps (68%)
09:55:44:WU01:FS00:0xa7:Completed 86250 out of 125000 steps (69%)
09:56:57:WU01:FS00:0xa7:Completed 87500 out of 125000 steps (70%)
09:58:10:WU01:FS00:0xa7:Completed 88750 out of 125000 steps (71%)
09:59:23:WU01:FS00:0xa7:Completed 90000 out of 125000 steps (72%)
10:00:36:WU01:FS00:0xa7:Completed 91250 out of 125000 steps (73%)
10:01:50:WU01:FS00:0xa7:Completed 92500 out of 125000 steps (74%)
10:03:03:WU01:FS00:0xa7:Completed 93750 out of 125000 steps (75%)
10:04:16:WU01:FS00:0xa7:Completed 95000 out of 125000 steps (76%)
10:05:29:WU01:FS00:0xa7:Completed 96250 out of 125000 steps (77%)
10:06:42:WU01:FS00:0xa7:Completed 97500 out of 125000 steps (78%)
10:07:55:WU01:FS00:0xa7:Completed 98750 out of 125000 steps (79%)
10:09:08:WU01:FS00:0xa7:Completed 100000 out of 125000 steps (80%)
10:10:20:WU01:FS00:0xa7:Completed 101250 out of 125000 steps (81%)
10:11:33:WU01:FS00:0xa7:Completed 102500 out of 125000 steps (82%)
10:12:46:WU01:FS00:0xa7:Completed 103750 out of 125000 steps (83%)
10:13:59:WU01:FS00:0xa7:Completed 105000 out of 125000 steps (84%)
10:15:12:WU01:FS00:0xa7:Completed 106250 out of 125000 steps (85%)
10:16:25:WU01:FS00:0xa7:Completed 107500 out of 125000 steps (86%)
10:17:38:WU01:FS00:0xa7:Completed 108750 out of 125000 steps (87%)
10:18:51:WU01:FS00:0xa7:Completed 110000 out of 125000 steps (88%)
10:20:05:WU01:FS00:0xa7:Completed 111250 out of 125000 steps (89%)
10:21:18:WU01:FS00:0xa7:Completed 112500 out of 125000 steps (90%)
10:22:31:WU01:FS00:0xa7:Completed 113750 out of 125000 steps (91%)
10:23:43:WU01:FS00:0xa7:Completed 115000 out of 125000 steps (92%)
10:24:56:WU01:FS00:0xa7:Completed 116250 out of 125000 steps (93%)
10:26:09:WU01:FS00:0xa7:Completed 117500 out of 125000 steps (94%)
10:27:22:WU01:FS00:0xa7:Completed 118750 out of 125000 steps (95%)
10:28:35:WU01:FS00:0xa7:Completed 120000 out of 125000 steps (96%)
10:29:48:WU01:FS00:0xa7:Completed 121250 out of 125000 steps (97%)
10:31:01:WU01:FS00:0xa7:Completed 122500 out of 125000 steps (98%)
10:32:14:WU01:FS00:0xa7:Completed 123750 out of 125000 steps (99%)
10:32:15:WU02:FS00:Connecting to 65.254.110.245:8080
10:32:15:WU02:FS00:Assigned to work server 128.252.203.9
10:32:15:WU02:FS00:Requesting new work unit for slot 00: RUNNING cpu:12 from 128.252.203.9
10:32:15:WU02:FS00:Connecting to 128.252.203.9:8080
10:32:15:WU02:FS00:Downloading 8.14MiB
10:32:16:WU02:FS00:Download complete
10:32:16:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13829 run:610 clone:0 gen:16 core:0xa7 unit:0x0000001280fccb095d66d379350fcde3
10:33:27:WU01:FS00:0xa7:Completed 125000 out of 125000 steps (100%)
10:33:32:WU01:FS00:0xa7:Saving result file ..\logfile_01.txt
10:33:32:WU01:FS00:0xa7:Saving result file frame15.trr
10:33:32:WU01:FS00:0xa7:Saving result file frame15.xtc
10:33:32:WU01:FS00:0xa7:Saving result file md.log
10:33:32:WU01:FS00:0xa7:Saving result file science.log
10:33:32:WU01:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
10:33:33:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
10:33:33:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:13831 run:906 clone:2 gen:15 core:0xa7 unit:0x0000001080fccb095d693a3c775d4e2d
10:33:33:WU01:FS00:Uploading 11.26MiB to 128.252.203.9
10:33:33:WU01:FS00:Connecting to 128.252.203.9:8080
10:33:33:WU02:FS00:Starting
10:33:33:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\doune\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 705 -lifeline 8316 -checkpoint 15 -np 12
10:33:33:WU02:FS00:Started FahCore on PID 6068
10:33:33:WU02:FS00:Core PID:5440
10:33:33:WU02:FS00:FahCore 0xa7 started
10:33:33:WU02:FS00:0xa7:*********************** Log Started 2019-10-19T10:33:33Z ***********************
10:33:33:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
10:33:33:WU02:FS00:0xa7:       Type: 0xa7
10:33:33:WU02:FS00:0xa7:       Core: Gromacs
10:33:33:WU02:FS00:0xa7:    Website: https://foldingathome.org/
10:33:33:WU02:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
10:33:33:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
10:33:33:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 705 -lifeline 6068 -checkpoint 15 -np
10:33:33:WU02:FS00:0xa7:             12
10:33:33:WU02:FS00:0xa7:     Config: <none>
10:33:33:WU02:FS00:0xa7:************************************ Build *************************************
10:33:33:WU02:FS00:0xa7:    Version: 0.0.17
10:33:33:WU02:FS00:0xa7:       Date: Apr 27 2018
10:33:33:WU02:FS00:0xa7:       Time: 16:19:36
10:33:33:WU02:FS00:0xa7: Repository: Git
10:33:33:WU02:FS00:0xa7:   Revision: 21359963583d09ec2063ef946399441c4df4ccd7
10:33:33:WU02:FS00:0xa7:     Branch: master
10:33:33:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
10:33:33:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
10:33:33:WU02:FS00:0xa7:   Platform: win32 10
10:33:33:WU02:FS00:0xa7:       Bits: 64
10:33:33:WU02:FS00:0xa7:       Mode: Release
10:33:33:WU02:FS00:0xa7:       SIMD: avx_256
10:33:33:WU02:FS00:0xa7:************************************ System ************************************
10:33:33:WU02:FS00:0xa7:        CPU: Unknown
10:33:33:WU02:FS00:0xa7:     CPU ID: 
10:33:33:WU02:FS00:0xa7:       CPUs: 16
10:33:33:WU02:FS00:0xa7:     Memory: 15.93GiB
10:33:33:WU02:FS00:0xa7:Free Memory: 11.70GiB
10:33:33:WU02:FS00:0xa7:    Threads: WINDOWS_THREADS
10:33:33:WU02:FS00:0xa7: OS Version: 6.2
10:33:33:WU02:FS00:0xa7:Has Battery: false
10:33:33:WU02:FS00:0xa7: On Battery: false
10:33:33:WU02:FS00:0xa7: UTC Offset: -5
10:33:33:WU02:FS00:0xa7:        PID: 5440
10:33:33:WU02:FS00:0xa7:        CWD: C:\Users\doune\AppData\Roaming\FAHClient\work
10:33:33:WU02:FS00:0xa7:         OS: Windows 10 Pro
10:33:33:WU02:FS00:0xa7:    OS Arch: AMD64
10:33:33:WU02:FS00:0xa7:********************************************************************************
10:33:33:WU02:FS00:0xa7:Project: 13829 (Run 610, Clone 0, Gen 16)
10:33:33:WU02:FS00:0xa7:Unit: 0x0000001280fccb095d66d379350fcde3
10:33:33:WU02:FS00:0xa7:Reading tar file core.xml
10:33:33:WU02:FS00:0xa7:Reading tar file frame16.tpr
10:33:33:WU02:FS00:0xa7:Digital signatures verified
10:33:33:WU02:FS00:0xa7:Calling: mdrun -s frame16.tpr -o frame16.trr -x frame16.xtc -cpt 15 -nt 12
10:33:33:WU02:FS00:0xa7:Steps: first=2000000 total=125000
10:33:33:WU01:FS00:Upload complete
10:33:33:WU01:FS00:Server responded WORK_ACK (400)
10:33:33:WU01:FS00:Final credit estimate, 7051.00 points
10:33:33:WU01:FS00:Cleaning up
10:33:36:WU02:FS00:0xa7:Completed 1 out of 125000 steps (0%)
10:34:50:WU02:FS00:0xa7:Completed 1250 out of 125000 steps (1%)
10:36:03:WU02:FS00:0xa7:Completed 2500 out of 125000 steps (2%)
10:37:16:WU02:FS00:0xa7:Completed 3750 out of 125000 steps (3%)
10:38:29:WU02:FS00:0xa7:Completed 5000 out of 125000 steps (4%)
10:39:42:WU02:FS00:0xa7:Completed 6250 out of 125000 steps (5%)
10:40:55:WU02:FS00:0xa7:Completed 7500 out of 125000 steps (6%)
10:42:07:WU02:FS00:0xa7:Completed 8750 out of 125000 steps (7%)
10:43:20:WU02:FS00:0xa7:Completed 10000 out of 125000 steps (8%)
10:44:33:WU02:FS00:0xa7:Completed 11250 out of 125000 steps (9%)
10:45:46:WU02:FS00:0xa7:Completed 12500 out of 125000 steps (10%)
10:46:58:WU02:FS00:0xa7:Completed 13750 out of 125000 steps (11%)
10:48:11:WU02:FS00:0xa7:Completed 15000 out of 125000 steps (12%)
10:49:26:WU02:FS00:0xa7:Completed 16250 out of 125000 steps (13%)
10:50:38:WU02:FS00:0xa7:Completed 17500 out of 125000 steps (14%)
10:51:51:WU02:FS00:0xa7:Completed 18750 out of 125000 steps (15%)
10:53:04:WU02:FS00:0xa7:Completed 20000 out of 125000 steps (16%)
10:54:17:WU02:FS00:0xa7:Completed 21250 out of 125000 steps (17%)
10:55:29:WU02:FS00:0xa7:Completed 22500 out of 125000 steps (18%)
10:56:42:WU02:FS00:0xa7:Completed 23750 out of 125000 steps (19%)
10:57:55:WU02:FS00:0xa7:Completed 25000 out of 125000 steps (20%)
10:59:08:WU02:FS00:0xa7:Completed 26250 out of 125000 steps (21%)
11:00:21:WU02:FS00:0xa7:Completed 27500 out of 125000 steps (22%)
11:01:34:WU02:FS00:0xa7:Completed 28750 out of 125000 steps (23%)
11:02:46:WU02:FS00:0xa7:Completed 30000 out of 125000 steps (24%)
11:04:00:WU02:FS00:0xa7:Completed 31250 out of 125000 steps (25%)
11:05:13:WU02:FS00:0xa7:Completed 32500 out of 125000 steps (26%)
11:06:26:WU02:FS00:0xa7:Completed 33750 out of 125000 steps (27%)
11:07:39:WU02:FS00:0xa7:Completed 35000 out of 125000 steps (28%)
11:08:52:WU02:FS00:0xa7:Completed 36250 out of 125000 steps (29%)
11:10:05:WU02:FS00:0xa7:Completed 37500 out of 125000 steps (30%)
11:11:18:WU02:FS00:0xa7:Completed 38750 out of 125000 steps (31%)
11:12:31:WU02:FS00:0xa7:Completed 40000 out of 125000 steps (32%)
11:13:43:WU02:FS00:0xa7:Completed 41250 out of 125000 steps (33%)
11:14:56:WU02:FS00:0xa7:Completed 42500 out of 125000 steps (34%)
11:16:09:WU02:FS00:0xa7:Completed 43750 out of 125000 steps (35%)
11:17:22:WU02:FS00:0xa7:Completed 45000 out of 125000 steps (36%)
11:18:35:WU02:FS00:0xa7:Completed 46250 out of 125000 steps (37%)
11:19:49:WU02:FS00:0xa7:Completed 47500 out of 125000 steps (38%)
11:21:02:WU02:FS00:0xa7:Completed 48750 out of 125000 steps (39%)
11:22:15:WU02:FS00:0xa7:Completed 50000 out of 125000 steps (40%)
11:23:27:WU02:FS00:0xa7:Completed 51250 out of 125000 steps (41%)
11:24:40:WU02:FS00:0xa7:Completed 52500 out of 125000 steps (42%)
11:25:53:WU02:FS00:0xa7:Completed 53750 out of 125000 steps (43%)
******************************* Date: 2019-10-19 *******************************
11:27:06:WU02:FS00:0xa7:Completed 55000 out of 125000 steps (44%)
11:28:19:WU02:FS00:0xa7:Completed 56250 out of 125000 steps (45%)
11:29:32:WU02:FS00:0xa7:Completed 57500 out of 125000 steps (46%)
11:30:45:WU02:FS00:0xa7:Completed 58750 out of 125000 steps (47%)
11:31:58:WU02:FS00:0xa7:Completed 60000 out of 125000 steps (48%)
11:33:10:WU02:FS00:0xa7:Completed 61250 out of 125000 steps (49%)
11:34:25:WU02:FS00:0xa7:Completed 62500 out of 125000 steps (50%)
11:35:38:WU02:FS00:0xa7:Completed 63750 out of 125000 steps (51%)
11:36:51:WU02:FS00:0xa7:Completed 65000 out of 125000 steps (52%)
11:38:03:WU02:FS00:0xa7:Completed 66250 out of 125000 steps (53%)
11:39:16:WU02:FS00:0xa7:Completed 67500 out of 125000 steps (54%)
11:40:29:WU02:FS00:0xa7:Completed 68750 out of 125000 steps (55%)
11:41:42:WU02:FS00:0xa7:Completed 70000 out of 125000 steps (56%)
11:42:55:WU02:FS00:0xa7:Completed 71250 out of 125000 steps (57%)
11:44:08:WU02:FS00:0xa7:Completed 72500 out of 125000 steps (58%)
11:45:21:WU02:FS00:0xa7:Completed 73750 out of 125000 steps (59%)
11:46:33:WU02:FS00:0xa7:Completed 75000 out of 125000 steps (60%)
11:47:46:WU02:FS00:0xa7:Completed 76250 out of 125000 steps (61%)
11:49:00:WU02:FS00:0xa7:Completed 77500 out of 125000 steps (62%)
11:50:13:WU02:FS00:0xa7:Completed 78750 out of 125000 steps (63%)
11:51:26:WU02:FS00:0xa7:Completed 80000 out of 125000 steps (64%)
11:52:39:WU02:FS00:0xa7:Completed 81250 out of 125000 steps (65%)
11:53:52:WU02:FS00:0xa7:Completed 82500 out of 125000 steps (66%)
11:55:05:WU02:FS00:0xa7:Completed 83750 out of 125000 steps (67%)
11:56:18:WU02:FS00:0xa7:Completed 85000 out of 125000 steps (68%)
11:57:30:WU02:FS00:0xa7:Completed 86250 out of 125000 steps (69%)
11:58:43:WU02:FS00:0xa7:Completed 87500 out of 125000 steps (70%)
11:59:56:WU02:FS00:0xa7:Completed 88750 out of 125000 steps (71%)
12:01:09:WU02:FS00:0xa7:Completed 90000 out of 125000 steps (72%)
12:02:22:WU02:FS00:0xa7:Completed 91250 out of 125000 steps (73%)
12:03:34:WU02:FS00:0xa7:Completed 92500 out of 125000 steps (74%)
12:04:49:WU02:FS00:0xa7:Completed 93750 out of 125000 steps (75%)
12:06:02:WU02:FS00:0xa7:Completed 95000 out of 125000 steps (76%)
12:07:14:WU02:FS00:0xa7:Completed 96250 out of 125000 steps (77%)
12:08:27:WU02:FS00:0xa7:Completed 97500 out of 125000 steps (78%)
12:09:40:WU02:FS00:0xa7:Completed 98750 out of 125000 steps (79%)
12:10:53:WU02:FS00:0xa7:Completed 100000 out of 125000 steps (80%)
12:12:06:WU02:FS00:0xa7:Completed 101250 out of 125000 steps (81%)
12:13:19:WU02:FS00:0xa7:Completed 102500 out of 125000 steps (82%)
12:14:31:WU02:FS00:0xa7:Completed 103750 out of 125000 steps (83%)
12:15:44:WU02:FS00:0xa7:Completed 105000 out of 125000 steps (84%)
12:16:57:WU02:FS00:0xa7:Completed 106250 out of 125000 steps (85%)
12:18:10:WU02:FS00:0xa7:Completed 107500 out of 125000 steps (86%)
12:19:24:WU02:FS00:0xa7:Completed 108750 out of 125000 steps (87%)
12:20:37:WU02:FS00:0xa7:Completed 110000 out of 125000 steps (88%)
12:21:50:WU02:FS00:0xa7:Completed 111250 out of 125000 steps (89%)
12:23:02:WU02:FS00:0xa7:Completed 112500 out of 125000 steps (90%)
12:24:15:WU02:FS00:0xa7:Completed 113750 out of 125000 steps (91%)
12:25:28:WU02:FS00:0xa7:Completed 115000 out of 125000 steps (92%)
12:26:41:WU02:FS00:0xa7:Completed 116250 out of 125000 steps (93%)
12:27:54:WU02:FS00:0xa7:Completed 117500 out of 125000 steps (94%)
12:29:07:WU02:FS00:0xa7:Completed 118750 out of 125000 steps (95%)
12:30:20:WU02:FS00:0xa7:Completed 120000 out of 125000 steps (96%)
12:31:32:WU02:FS00:0xa7:Completed 121250 out of 125000 steps (97%)
12:32:45:WU02:FS00:0xa7:Completed 122500 out of 125000 steps (98%)
12:33:59:WU02:FS00:0xa7:Completed 123750 out of 125000 steps (99%)
12:34:00:WU01:FS00:Connecting to 65.254.110.245:8080
12:34:00:WU01:FS00:Assigned to work server 155.247.166.219
12:34:00:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:12 from 155.247.166.219
12:34:00:WU01:FS00:Connecting to 155.247.166.219:8080
12:34:00:WU01:FS00:Downloading 1.99MiB
12:34:01:WU01:FS00:Download complete
12:34:02:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14102 run:0 clone:35 gen:32 core:0xa7 unit:0x000000290002894b5d5d974a7e9461fd
12:35:12:WU02:FS00:0xa7:Completed 125000 out of 125000 steps (100%)
12:35:17:WU02:FS00:0xa7:Saving result file ..\logfile_01.txt
12:35:17:WU02:FS00:0xa7:Saving result file frame16.trr
12:35:17:WU02:FS00:0xa7:Saving result file frame16.xtc
12:35:17:WU02:FS00:0xa7:Saving result file md.log
12:35:17:WU02:FS00:0xa7:Saving result file science.log
12:35:17:WU02:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
12:35:17:WU02:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
12:35:17:WU02:FS00:Sending unit results: id:02 state:SEND error:NO_ERROR project:13829 run:610 clone:0 gen:16 core:0xa7 unit:0x0000001280fccb095d66d379350fcde3
12:35:17:WU02:FS00:Uploading 11.25MiB to 128.252.203.9
12:35:17:WU02:FS00:Connecting to 128.252.203.9:8080
12:35:18:WU01:FS00:Starting
12:35:18:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\doune\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 705 -lifeline 8316 -checkpoint 15 -np 12
12:35:18:WU01:FS00:Started FahCore on PID 7148
12:35:18:WU01:FS00:Core PID:6644
12:35:18:WU01:FS00:FahCore 0xa7 started
12:35:18:WU01:FS00:0xa7:*********************** Log Started 2019-10-19T12:35:18Z ***********************
12:35:18:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
12:35:18:WU01:FS00:0xa7:       Type: 0xa7
12:35:18:WU01:FS00:0xa7:       Core: Gromacs
12:35:18:WU01:FS00:0xa7:    Website: https://foldingathome.org/
12:35:18:WU01:FS00:0xa7:  Copyright: (c) 2009-2018 foldingathome.org
12:35:18:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
12:35:18:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 705 -lifeline 7148 -checkpoint 15 -np
12:35:18:WU01:FS00:0xa7:             12
12:35:18:WU01:FS00:0xa7:     Config: <none>
12:35:18:WU01:FS00:0xa7:************************************ Build *************************************
12:35:18:WU01:FS00:0xa7:    Version: 0.0.17
12:35:18:WU01:FS00:0xa7:       Date: Apr 27 2018
12:35:18:WU01:FS00:0xa7:       Time: 16:19:36
12:35:18:WU01:FS00:0xa7: Repository: Git
12:35:18:WU01:FS00:0xa7:   Revision: 21359963583d09ec2063ef946399441c4df4ccd7
12:35:18:WU01:FS00:0xa7:     Branch: master
12:35:18:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
12:35:18:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
12:35:18:WU01:FS00:0xa7:   Platform: win32 10
12:35:18:WU01:FS00:0xa7:       Bits: 64
12:35:18:WU01:FS00:0xa7:       Mode: Release
12:35:18:WU01:FS00:0xa7:       SIMD: avx_256
12:35:18:WU01:FS00:0xa7:************************************ System ************************************
12:35:18:WU01:FS00:0xa7:        CPU: Unknown
12:35:18:WU01:FS00:0xa7:     CPU ID: 
12:35:18:WU01:FS00:0xa7:       CPUs: 16
12:35:18:WU01:FS00:0xa7:     Memory: 15.93GiB
12:35:18:WU01:FS00:0xa7:Free Memory: 11.66GiB
12:35:18:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
12:35:18:WU01:FS00:0xa7: OS Version: 6.2
12:35:18:WU01:FS00:0xa7:Has Battery: false
12:35:18:WU01:FS00:0xa7: On Battery: false
12:35:18:WU01:FS00:0xa7: UTC Offset: -5
12:35:18:WU01:FS00:0xa7:        PID: 6644
12:35:18:WU01:FS00:0xa7:        CWD: C:\Users\doune\AppData\Roaming\FAHClient\work
12:35:18:WU01:FS00:0xa7:         OS: Windows 10 Pro
12:35:18:WU01:FS00:0xa7:    OS Arch: AMD64
12:35:18:WU01:FS00:0xa7:********************************************************************************
12:35:18:WU01:FS00:0xa7:Project: 14102 (Run 0, Clone 35, Gen 32)
12:35:18:WU01:FS00:0xa7:Unit: 0x000000290002894b5d5d974a7e9461fd
12:35:18:WU01:FS00:0xa7:Reading tar file core.xml
12:35:18:WU01:FS00:0xa7:Reading tar file frame32.tpr
12:35:18:WU01:FS00:0xa7:Digital signatures verified
12:35:18:WU01:FS00:0xa7:Calling: mdrun -s frame32.tpr -o frame32.trr -cpt 15 -nt 12
12:35:18:WU01:FS00:0xa7:Steps: first=40000000 total=1250000
12:35:19:WU02:FS00:Upload complete
12:35:19:WU01:FS00:0xa7:Completed 1 out of 1250000 steps (0%)
12:35:19:WU02:FS00:Server responded WORK_ACK (400)
12:35:19:WU02:FS00:Final credit estimate, 7053.00 points
12:35:19:WU02:FS00:Cleaning up
12:37:23:WU01:FS00:0xa7:Completed 12500 out of 1250000 steps (1%)
12:39:27:WU01:FS00:0xa7:Completed 25000 out of 1250000 steps (2%)
12:41:31:WU01:FS00:0xa7:Completed 37500 out of 1250000 steps (3%)
12:43:35:WU01:FS00:0xa7:Completed 50000 out of 1250000 steps (4%)
12:45:40:WU01:FS00:0xa7:Completed 62500 out of 1250000 steps (5%)

It just... stops downloading.

EarButton · Post by **EarButton** » Sat Oct 19, 2019 1:13 pm

Same problem here. All my machines got stuck and I wasted lots of folding time. Download never finishes. Must be fixed! Not every F@H user is willing to babysit the software 24/7.

doune · Post by **doune** » Sat Oct 19, 2019 1:44 pm

I restarted it and got the same behavior. I also ran a speed test from a city a few hundred miles away and got about 350Mbps up and down. CPU cores continue to work fine.

I can only assume it's something to do with the server?

Edit:

I restarted yet again and it worked almost instantly.

Code: Select all

13:45:00:WU00:FS01:Connecting to 65.254.110.245:8080
13:45:01:WU00:FS01:Assigned to work server 155.247.166.219
13:45:01:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:TU106 [GeForce RTX 2070] M 6497 from 155.247.166.219
13:45:01:WU00:FS01:Connecting to 155.247.166.219:8080
13:45:02:WU00:FS01:Downloading 27.54MiB
13:45:04:WU00:FS01:Download complete

There are two general problems. One is the download failing, obviously. The second is how the client is (or isn't, in this case) handling failed downloads or downloads that should be timed out.

MeeLee · Post by **MeeLee** » Sat Oct 19, 2019 2:32 pm

Server 155.247.166.219:8080 is having problems again.

snapshot · Post by **snapshot** » Sat Oct 19, 2019 4:59 pm

I'm seeing exactly the same behaviour on two clients. Below is the full log from starting the client this morning to it completing one WU and failing to complete the download of the next. I've got round it by stopping the client and deleting the work folder. Rebooting isn't an option on this client but is on the other. I haven't tried pausing/resuming the client yet but will after the next failure and will report the results here.

Code: Select all

*********************** Log Started 2019-10-19T05:15:48Z ***********************
05:15:48:************************* Folding@home Client *************************
05:15:48:        Website: https://foldingathome.org/
05:15:48:      Copyright: (c) 2009-2018 foldingathome.org
05:15:48:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
05:15:48:           Args: --open-web-control
05:15:48:         Config: C:\FAHClient\config.xml
05:15:48:******************************** Build ********************************
05:15:48:        Version: 7.5.1
05:15:48:           Date: May 11 2018
05:15:48:           Time: 13:06:32
05:15:48:     Repository: Git
05:15:48:       Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
05:15:48:         Branch: master
05:15:48:       Compiler: Visual C++ 2008
05:15:48:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
05:15:48:       Platform: win32 10
05:15:48:           Bits: 32
05:15:48:           Mode: Release
05:15:48:******************************* System ********************************
05:15:48:            CPU: Intel(R) Core(TM) i5-8600T CPU @ 2.30GHz
05:15:48:         CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
05:15:48:           CPUs: 6
05:15:48:         Memory: 15.92GiB
05:15:48:    Free Memory: 11.42GiB
05:15:48:        Threads: WINDOWS_THREADS
05:15:48:     OS Version: 6.2
05:15:48:    Has Battery: true
05:15:48:     On Battery: false
05:15:48:     UTC Offset: 1
05:15:48:            PID: 4692
05:15:48:            CWD: C:\FAHClient
05:15:48:             OS: Windows 10 Enterprise
05:15:48:        OS Arch: AMD64
05:15:48:           GPUs: 1
05:15:48:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:7 TU116 [GeForce GTX 1660 Ti]
05:15:48:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:7.5 Driver:10.1
05:15:48:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:431.36
05:15:48:  Win32 Service: false
05:15:48:***********************************************************************
05:15:48:<config>
05:15:48:  <!-- HTTP Server -->
05:15:48:  <deny v=''/>
05:15:48:
05:15:48:  <!-- Network -->
05:15:48:  <proxy v=':8080'/>
05:15:48:
05:15:48:  <!-- Remote Command Server -->
05:15:48:  <command-deny-no-pass v=''/>
05:15:48:
05:15:48:  <!-- Slot Control -->
05:15:48:  <power v='FULL'/>
05:15:48:
05:15:48:  <!-- User Information -->
05:15:48:  <passkey v='********************************'/>
05:15:48:  <team v='157620'/>
05:15:48:  <user v='hurwitt_free'/>
05:15:48:
05:15:48:  <!-- Folding Slots -->
05:15:48:  <slot id='1' type='GPU'/>
05:15:48:</config>
05:15:48:Trying to access database...
05:15:48:Successfully acquired database lock
05:15:48:Enabled folding slot 01: READY gpu:0:TU116 [GeForce GTX 1660 Ti]
05:15:48:WU00:FS01:Connecting to 65.254.110.245:8080
05:15:49:WU00:FS01:Assigned to work server 155.247.166.219
05:15:49:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:TU116 [GeForce GTX 1660 Ti] from 155.247.166.219
05:15:49:WU00:FS01:Connecting to 155.247.166.219:8080
05:15:49:WU00:FS01:Downloading 27.49MiB
05:15:51:19:127.0.0.1:New Web connection
05:15:55:WU00:FS01:Download 57.75%
05:15:57:WU00:FS01:Download complete
05:15:57:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14196 run:14 clone:251 gen:2 core:0x21 unit:0x000000020002894b5d92468db1eba777
05:15:57:WU00:FS01:Starting
05:15:57:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\FAHClient\cores/cores.foldingathome.org/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 00 -suffix 01 -version 705 -lifeline 4692 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
05:15:57:WU00:FS01:Started FahCore on PID 13816
05:15:58:WU00:FS01:Core PID:45308
05:15:58:WU00:FS01:FahCore 0x21 started
05:15:58:WU00:FS01:0x21:*********************** Log Started 2019-10-19T05:15:58Z ***********************
05:15:58:WU00:FS01:0x21:Project: 14196 (Run 14, Clone 251, Gen 2)
05:15:58:WU00:FS01:0x21:Unit: 0x000000020002894b5d92468db1eba777
05:15:58:WU00:FS01:0x21:CPU: 0x00000000000000000000000000000000
05:15:58:WU00:FS01:0x21:Machine: 1
05:15:58:WU00:FS01:0x21:Reading tar file core.xml
05:15:58:WU00:FS01:0x21:Reading tar file integrator.xml
05:15:58:WU00:FS01:0x21:Reading tar file state.xml
05:15:58:WU00:FS01:0x21:Reading tar file system.xml
05:15:58:WU00:FS01:0x21:Digital signatures verified
05:15:58:WU00:FS01:0x21:Folding@home GPU Core21 Folding@home Core
05:15:58:WU00:FS01:0x21:Version 0.0.20
05:16:06:WU00:FS01:0x21:Completed 0 out of 5000000 steps (0%)
05:16:06:WU00:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
05:19:26:WU00:FS01:0x21:Completed 50000 out of 5000000 steps (1%)
05:22:50:WU00:FS01:0x21:Completed 100000 out of 5000000 steps (2%)
05:26:13:WU00:FS01:0x21:Completed 150000 out of 5000000 steps (3%)
05:29:37:WU00:FS01:0x21:Completed 200000 out of 5000000 steps (4%)
05:32:59:WU00:FS01:0x21:Completed 250000 out of 5000000 steps (5%)
05:36:23:WU00:FS01:0x21:Completed 300000 out of 5000000 steps (6%)
05:39:45:WU00:FS01:0x21:Completed 350000 out of 5000000 steps (7%)
05:43:11:WU00:FS01:0x21:Completed 400000 out of 5000000 steps (8%)
05:46:38:WU00:FS01:0x21:Completed 450000 out of 5000000 steps (9%)
05:50:00:WU00:FS01:0x21:Completed 500000 out of 5000000 steps (10%)
05:53:25:WU00:FS01:0x21:Completed 550000 out of 5000000 steps (11%)
05:56:49:WU00:FS01:0x21:Completed 600000 out of 5000000 steps (12%)
06:00:11:WU00:FS01:0x21:Completed 650000 out of 5000000 steps (13%)
06:03:34:WU00:FS01:0x21:Completed 700000 out of 5000000 steps (14%)
06:06:58:WU00:FS01:0x21:Completed 750000 out of 5000000 steps (15%)
06:10:23:WU00:FS01:0x21:Completed 800000 out of 5000000 steps (16%)
06:13:50:WU00:FS01:0x21:Completed 850000 out of 5000000 steps (17%)
06:17:13:WU00:FS01:0x21:Completed 900000 out of 5000000 steps (18%)
06:20:35:WU00:FS01:0x21:Completed 950000 out of 5000000 steps (19%)
06:23:55:WU00:FS01:0x21:Completed 1000000 out of 5000000 steps (20%)
06:27:17:WU00:FS01:0x21:Completed 1050000 out of 5000000 steps (21%)
06:30:37:WU00:FS01:0x21:Completed 1100000 out of 5000000 steps (22%)
06:33:56:WU00:FS01:0x21:Completed 1150000 out of 5000000 steps (23%)
06:37:15:WU00:FS01:0x21:Completed 1200000 out of 5000000 steps (24%)
06:40:33:WU00:FS01:0x21:Completed 1250000 out of 5000000 steps (25%)
06:43:54:WU00:FS01:0x21:Completed 1300000 out of 5000000 steps (26%)
06:47:13:WU00:FS01:0x21:Completed 1350000 out of 5000000 steps (27%)
06:50:32:WU00:FS01:0x21:Completed 1400000 out of 5000000 steps (28%)
06:53:51:WU00:FS01:0x21:Completed 1450000 out of 5000000 steps (29%)
06:57:10:WU00:FS01:0x21:Completed 1500000 out of 5000000 steps (30%)
07:00:31:WU00:FS01:0x21:Completed 1550000 out of 5000000 steps (31%)
07:03:50:WU00:FS01:0x21:Completed 1600000 out of 5000000 steps (32%)
07:07:09:WU00:FS01:0x21:Completed 1650000 out of 5000000 steps (33%)
07:10:28:WU00:FS01:0x21:Completed 1700000 out of 5000000 steps (34%)
07:13:47:WU00:FS01:0x21:Completed 1750000 out of 5000000 steps (35%)
07:17:08:WU00:FS01:0x21:Completed 1800000 out of 5000000 steps (36%)
07:20:27:WU00:FS01:0x21:Completed 1850000 out of 5000000 steps (37%)
07:23:46:WU00:FS01:0x21:Completed 1900000 out of 5000000 steps (38%)
07:27:07:WU00:FS01:0x21:Completed 1950000 out of 5000000 steps (39%)
07:30:26:WU00:FS01:0x21:Completed 2000000 out of 5000000 steps (40%)
07:33:47:WU00:FS01:0x21:Completed 2050000 out of 5000000 steps (41%)
07:37:06:WU00:FS01:0x21:Completed 2100000 out of 5000000 steps (42%)
07:40:25:WU00:FS01:0x21:Completed 2150000 out of 5000000 steps (43%)
07:43:43:WU00:FS01:0x21:Completed 2200000 out of 5000000 steps (44%)
07:47:11:WU00:FS01:0x21:Completed 2250000 out of 5000000 steps (45%)
07:50:42:WU00:FS01:0x21:Completed 2300000 out of 5000000 steps (46%)
07:54:06:WU00:FS01:0x21:Completed 2350000 out of 5000000 steps (47%)
07:57:27:WU00:FS01:0x21:Completed 2400000 out of 5000000 steps (48%)
08:00:47:WU00:FS01:0x21:Completed 2450000 out of 5000000 steps (49%)
08:04:07:WU00:FS01:0x21:Completed 2500000 out of 5000000 steps (50%)
08:07:28:WU00:FS01:0x21:Completed 2550000 out of 5000000 steps (51%)
08:10:47:WU00:FS01:0x21:Completed 2600000 out of 5000000 steps (52%)
08:14:06:WU00:FS01:0x21:Completed 2650000 out of 5000000 steps (53%)
08:17:31:WU00:FS01:0x21:Completed 2700000 out of 5000000 steps (54%)
08:20:52:WU00:FS01:0x21:Completed 2750000 out of 5000000 steps (55%)
08:24:15:WU00:FS01:0x21:Completed 2800000 out of 5000000 steps (56%)
08:27:40:WU00:FS01:0x21:Completed 2850000 out of 5000000 steps (57%)
08:31:10:WU00:FS01:0x21:Completed 2900000 out of 5000000 steps (58%)
08:34:30:WU00:FS01:0x21:Completed 2950000 out of 5000000 steps (59%)
08:37:52:WU00:FS01:0x21:Completed 3000000 out of 5000000 steps (60%)
08:41:14:WU00:FS01:0x21:Completed 3050000 out of 5000000 steps (61%)
08:44:34:WU00:FS01:0x21:Completed 3100000 out of 5000000 steps (62%)
08:47:54:WU00:FS01:0x21:Completed 3150000 out of 5000000 steps (63%)
08:51:13:WU00:FS01:0x21:Completed 3200000 out of 5000000 steps (64%)
08:54:32:WU00:FS01:0x21:Completed 3250000 out of 5000000 steps (65%)
08:57:52:WU00:FS01:0x21:Completed 3300000 out of 5000000 steps (66%)
09:01:11:WU00:FS01:0x21:Completed 3350000 out of 5000000 steps (67%)
09:04:30:WU00:FS01:0x21:Completed 3400000 out of 5000000 steps (68%)
09:07:49:WU00:FS01:0x21:Completed 3450000 out of 5000000 steps (69%)
09:11:08:WU00:FS01:0x21:Completed 3500000 out of 5000000 steps (70%)
09:14:29:WU00:FS01:0x21:Completed 3550000 out of 5000000 steps (71%)
09:17:48:WU00:FS01:0x21:Completed 3600000 out of 5000000 steps (72%)
09:21:06:WU00:FS01:0x21:Completed 3650000 out of 5000000 steps (73%)
09:24:25:WU00:FS01:0x21:Completed 3700000 out of 5000000 steps (74%)
09:27:44:WU00:FS01:0x21:Completed 3750000 out of 5000000 steps (75%)
09:31:05:WU00:FS01:0x21:Completed 3800000 out of 5000000 steps (76%)
09:34:24:WU00:FS01:0x21:Completed 3850000 out of 5000000 steps (77%)
09:37:43:WU00:FS01:0x21:Completed 3900000 out of 5000000 steps (78%)
09:41:03:WU00:FS01:0x21:Completed 3950000 out of 5000000 steps (79%)
09:44:23:WU00:FS01:0x21:Completed 4000000 out of 5000000 steps (80%)
09:47:45:WU00:FS01:0x21:Completed 4050000 out of 5000000 steps (81%)
09:51:05:WU00:FS01:0x21:Completed 4100000 out of 5000000 steps (82%)
09:54:25:WU00:FS01:0x21:Completed 4150000 out of 5000000 steps (83%)
09:57:45:WU00:FS01:0x21:Completed 4200000 out of 5000000 steps (84%)
10:01:05:WU00:FS01:0x21:Completed 4250000 out of 5000000 steps (85%)
10:04:25:WU00:FS01:0x21:Completed 4300000 out of 5000000 steps (86%)
10:07:44:WU00:FS01:0x21:Completed 4350000 out of 5000000 steps (87%)
10:11:03:WU00:FS01:0x21:Completed 4400000 out of 5000000 steps (88%)
10:14:22:WU00:FS01:0x21:Completed 4450000 out of 5000000 steps (89%)
10:17:41:WU00:FS01:0x21:Completed 4500000 out of 5000000 steps (90%)
10:21:01:WU00:FS01:0x21:Completed 4550000 out of 5000000 steps (91%)
10:24:20:WU00:FS01:0x21:Completed 4600000 out of 5000000 steps (92%)
10:27:39:WU00:FS01:0x21:Completed 4650000 out of 5000000 steps (93%)
10:30:58:WU00:FS01:0x21:Completed 4700000 out of 5000000 steps (94%)
10:34:17:WU00:FS01:0x21:Completed 4750000 out of 5000000 steps (95%)
10:37:37:WU00:FS01:0x21:Completed 4800000 out of 5000000 steps (96%)
10:40:56:WU00:FS01:0x21:Completed 4850000 out of 5000000 steps (97%)
10:44:15:WU00:FS01:0x21:Completed 4900000 out of 5000000 steps (98%)
10:47:33:WU00:FS01:0x21:Completed 4950000 out of 5000000 steps (99%)
10:47:34:WU01:FS01:Connecting to 65.254.110.245:8080
10:47:34:WU01:FS01:Assigned to work server 155.247.166.220
10:47:34:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:TU116 [GeForce GTX 1660 Ti] from 155.247.166.220
10:47:34:WU01:FS01:Connecting to 155.247.166.220:8080
10:47:35:WU01:FS01:Downloading 15.59MiB
10:47:48:WU01:FS01:Download 0.80%
10:47:55:WU01:FS01:Download 1.20%
10:48:01:WU01:FS01:Download 2.00%
10:48:07:WU01:FS01:Download 3.21%
10:48:17:WU01:FS01:Download 4.01%
10:48:30:WU01:FS01:Download 4.81%
10:48:42:WU01:FS01:Download 5.61%
10:48:48:WU01:FS01:Download 6.42%
10:49:10:WU01:FS01:Download 6.82%
10:49:19:WU01:FS01:Download 7.62%
10:49:28:WU01:FS01:Download 8.42%
10:50:52:WU00:FS01:0x21:Completed 5000000 out of 5000000 steps (100%)
10:50:54:WU00:FS01:0x21:Saving result file logfile_01.txt
10:50:54:WU00:FS01:0x21:Saving result file checkpointState.xml
10:50:54:WU00:FS01:0x21:Saving result file checkpt.crc
10:50:54:WU00:FS01:0x21:Saving result file log.txt
10:50:54:WU00:FS01:0x21:Saving result file positions.xtc
10:50:54:WU00:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
10:50:55:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
10:50:55:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:14196 run:14 clone:251 gen:2 core:0x21 unit:0x000000020002894b5d92468db1eba777
10:50:55:WU00:FS01:Uploading 19.39MiB to 155.247.166.219
10:50:55:WU00:FS01:Connecting to 155.247.166.219:8080
10:51:02:WU00:FS01:Upload 4.83%
10:51:08:WU00:FS01:Upload 33.84%
10:51:14:WU00:FS01:Upload 45.76%
10:51:20:WU00:FS01:Upload 75.41%
10:51:26:WU00:FS01:Upload 93.14%
10:51:28:WU00:FS01:Upload complete
10:51:28:WU00:FS01:Server responded WORK_ACK (400)
10:51:28:WU00:FS01:Final credit estimate, 130511.00 points
10:51:28:WU00:FS01:Cleaning up

snapshot · Post by **snapshot** » Sat Oct 19, 2019 6:59 pm

Perhaps not surprisingly, pausing had zero effect so I again killed the task and work folder before restarting F@H. I'll give the other one a reboot in a couple of hours when the current WU finishes.

There's going to be lot of lost production this weekend from those who don't keep an eye on their clients......

Looking at the logs, it seems to be 155.247.166.220 that's having problems both uploading and downloading. The last WU failed to upload to 155.247.166.220 at the same time that the download was stalling but then uploaded successfully to 155.247.166.219.

sf8kkn · Post by **sf8kkn** » Sat Oct 19, 2019 7:08 pm

Same here, server 155.247.166.219 doesn't send wus

And 155.247.166.220 seems to be slow, but it works.

Mod note: combined 2 posts

EarButton · Post by **EarButton** » Sat Oct 19, 2019 7:25 pm

Yeah constant problems here also. Sometimes pausing and resuming helps, sometimes I need to delete the stuck slot, shutdown all FAH processes and reconfigure the slot.

Folding Forum

no download, no error, no message at all

no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all

Re: no download, no error, no message at all