Page 1 of 2

intermittent black screen

Posted: Thu Oct 01, 2020 10:29 am
by bmxjumperc
When the F@H client is active I get an intermittent black screen. The monitor appears to briefly almost enter suspended mode but then recovers. Occurs off and on while folding client is active 7.6.13. nVidia driver 456.55. Has anyone else noticed that? I have briefly stress tested the CPU and GPUs all passed. RTX 2070 + GTX 650. Cooling should be adequate in an NZXT H700i case.

Re: intermittent black screen

Posted: Thu Oct 01, 2020 10:52 am
by Neil-B
possibly a graphics driver crash?

Re: intermittent black screen

Posted: Sat Oct 03, 2020 8:05 am
by PantherX
I assume that you're using a quality PSU in your build?

Re: intermittent black screen

Posted: Sat Oct 03, 2020 12:28 pm
by bruce
Check the Windows "Event Viewer."

Re: intermittent black screen

Posted: Sun Oct 11, 2020 3:28 pm
by bmxjumperc
Hey, thanks for the support folks!

What must be happening here is the ubiquitous Windows TDR from the nvlddmkm.sys module. I learned that CUDA programs will often do this for example. I found a few things that can be done to improve the experience.
  • Disable TDR via regedit. "HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control\GraphicsDrivers" -> "TdrLevel"=dword:00000000
  • Only run CUDA (fold) on secondary graphics adapters.
  • The TDR Windows event log can be filtered in "eventvwr.msc" under System -> Display -> event ID 4101.
Example TDR Windows event log:

Code: Select all

Log Name:      System
Source:        Display
Date:          10/3/2020 11:35:46 AM
Event ID:      4101
Task Category: None
Level:         Warning
Keywords:      Classic
User:          N/A
Computer:      *************
Description:
Display driver nvlddmkm stopped responding and has successfully recovered.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
  <System>
    <Provider Name="Display" />
    <EventID Qualifiers="0">4101</EventID>
    <Version>0</Version>
    <Level>3</Level>
    <Task>0</Task>
    <Opcode>0</Opcode>
    <Keywords>0x80000000000000</Keywords>
    <TimeCreated SystemTime="2020-10-03T16:35:46.9748873Z" />
    <EventRecordID>87694</EventRecordID>
    <Correlation />
    <Execution ProcessID="0" ThreadID="0" />
    <Channel>System</Channel>
    <Computer>***********</Computer>
    <Security />
  </System>
  <EventData>
    <Data>nvlddmkm</Data>
    <Data>
    </Data>
  </EventData>
</Event>
nvidia statement:
https://www.nvidia.com/en-us/geforce/fo ... iver-nvld/
educational article:
https://www.pugetsystems.com/labs/hpc/W ... ience-777/

Re: intermittent black screen

Posted: Sun Oct 11, 2020 3:48 pm
by foldy
Does this happen both on RTX 2070 and GTX 650? I guess only the GTX 650 maybe is too slow to hold the TDR timeout. If true and other users get the same issue then maybe CUDA must be disabled on such old GPUs by assignment servers?

Re: intermittent black screen

Posted: Mon Oct 12, 2020 10:31 pm
by bmxjumperc
The screen flickers when folding on the 2070 which is the primary adapter connected to the monitor. It flickers if that is the only client that it is folding on too. I also have another CUDA program that causes the flicker of the screen intermittently. I haven't tested the 650 or CPU alone yet.
I did run Kombusteor https://geeks3d.com/furmark/kombustor/downloads/ for an extended period of time without any artifact errors.
Usually I have it folding on all 3 clients at once. The 650, the 2070 and the CPU.
In fact I'm not getting a TDR event every time the screen flickers so I should keep an eye on it still :|.

Re: intermittent black screen

Posted: Tue Oct 13, 2020 6:58 am
by PantherX
FYI, Kombusteor doesn't provide a realistic simulation of folding... it would simply stress out the rendering elements of the GPU, not the compute section which folding does.

Re: intermittent black screen

Posted: Sat Oct 17, 2020 6:59 pm
by JohnChodera
We're looking into this! Last time we encountered this, there was a specific kernel call that was taking a bit too long to make the windows timeout. We might be able to easily fix this without requiring settings to be changed.

~ John Chodera // MSKCC

Re: intermittent black screen

Posted: Sat Oct 17, 2020 10:01 pm
by JohnChodera
If you're able to provide more information about which PROJ, RUN, CLONE, GENs this occurs with and which GPU(s), as well as whether the core was running in OpenCL or CUDA mode, that would be super helpful in tracking down the offending kernel(s)!

~ John Chodera // MSKCC

Re: intermittent black screen

Posted: Sun Oct 18, 2020 1:14 pm
by bmxjumperc
Oh, great. I started folding with the command prompt open to see what is going on. I'll watch for the monitor black-out and see if I can make a correlation with the line that is in the command prompt at the time. I'll let you know if I see it again.

Re: intermittent black screen

Posted: Mon Oct 19, 2020 11:16 pm
by bmxjumperc
On, 10/12/2020 and 10/14/2020 I have about 5 "perfmon /rel" logs pointing to FahCore_a7.exe "stopped working".

Code: Select all

Source
FahCore_a7.exe

Summary
Stopped working

Date
‎10/‎14/‎2020 11:47 PM

Status
Report sent

Description
Faulting Application Path:	C:\Users\****\AppData\Roaming\FAHClient\cores\cores.foldingathome.org\win\64bit-avx-256\a7-0.0.19\Core_a7.fah\FahCore_a7.exe

Problem signature
Problem Event Name:	BEX64
Application Name:	FahCore_a7.exe
Application Version:	0.0.0.0
Application Timestamp:	5dde687c
Fault Module Name:	FahCore_a7.exe
Fault Module Version:	0.0.0.0
Fault Module Timestamp:	5dde687c
Exception Offset:	0000000000f161e7
Exception Code:	c0000409
Exception Data:	0000000000000005
OS Version:	10.0.19041.2.0.0.256.121
Locale ID:	1033
Additional Information 1:	fbe5
Additional Information 2:	fbe5b49bcfff23ab70738d2aa862c91b
Additional Information 3:	9fec
Additional Information 4:	9fecf9e766d25dd328656f6da1eaf20d

Extra information about the problem
Bucket ID:	5984bd69cc6fcfa1e36cfea2b21ece61 (1399773558931902049)
10/17/2020 I have FahCore_22.exe stopped working.
10/18/2020 each FahCore_22.exe crash was followed by a "Windows Hardware Error" log: "LKD_0x141_Tdr:6_IMAGE_nvlddmkm.sys_Unknown_Cuda"

Code: Select all

Source
FahCore_22.exe

Summary
Stopped working

Date
‎10/‎18/‎2020 9:49 PM

Status
Report sent

Description
Faulting Application Path:	C:\Users\****\AppData\Roaming\FAHClient\cores\cores.foldingathome.org\win\64bit\22-0.0.13\Core_22.fah\FahCore_22.exe

Problem signature
Problem Event Name:	BEX64
Application Name:	FahCore_22.exe
Application Version:	0.0.0.0
Application Timestamp:	5f656e96
Fault Module Name:	OpenMMCUDA.dll
Fault Module Version:	0.0.0.0
Fault Module Timestamp:	5f6518bf
Exception Offset:	00000000000e7fa0
Exception Code:	c0000409
Exception Data:	0000000000000007
OS Version:	10.0.19041.2.0.0.256.121
Locale ID:	1033
Additional Information 1:	8964
Additional Information 2:	89646b7c1bbb7f82d27a8559241e5791
Additional Information 3:	af1d
Additional Information 4:	af1df422850b0e45c9783cedcf5ad0c4

Extra information about the problem
Bucket ID:	4adaf426c939f2a1e92baa4ad70a09f3 (1813730513358817779)

Code: Select all

Source
Windows

Summary
Hardware error

Date
‎10/‎18/‎2020 11:16 PM

Status
Report sent

Description
A problem with your hardware caused Windows to stop working correctly.

Problem signature
Problem Event Name:	LiveKernelEvent
Code:	141
Parameter 1:	ffffe785c2020010
Parameter 2:	fffff8059fdac188
Parameter 3:	0
Parameter 4:	e7c
OS version:	10_0_19041
Service Pack:	0_0
Product:	256_1
OS Version:	10.0.19041.2.0.0.256.121
Locale ID:	1033

Extra information about the problem
Bucket ID:	LKD_0x141_Tdr:6_IMAGE_nvlddmkm.sys_Unknown_Cuda
Server information:	9145cdc1-b82a-427f-a773-6a99b682cf40
It looks like was also getting the TDR event on each hardware error event.

Code: Select all

Log Name:      System
Source:        Display
Date:          10/18/2020 11:16:16 PM
Event ID:      4101
Task Category: None
Level:         Warning
Keywords:      Classic
User:          N/A
Computer:      ****
Description:
Display driver nvlddmkm stopped responding and has successfully recovered.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
  <System>
    <Provider Name="Display" />
    <EventID Qualifiers="0">4101</EventID>
    <Version>0</Version>
    <Level>3</Level>
    <Task>0</Task>
    <Opcode>0</Opcode>
    <Keywords>0x80000000000000</Keywords>
    <TimeCreated SystemTime="2020-10-19T04:16:16.6815006Z" />
    <EventRecordID>127642</EventRecordID>
    <Correlation />
    <Execution ProcessID="0" ThreadID="0" />
    <Channel>System</Channel>
    <Computer>****</Computer>
    <Security />
  </System>
  <EventData>
    <Data>nvlddmkm</Data>
    <Data>
    </Data>
  </EventData>
</Event>
Thanks a bunch. :egeek:

Re: intermittent black screen

Posted: Thu Oct 22, 2020 4:47 am
by bmxjumperc
I see, the cmd window is essentially the log window in advanced view. I haven't seen the crashes since the last one above.
Well here is my log. I saw a few of the screen black-outs in this session. One around 04:22:03, and 04:30:01 for example.
Yes, it looks like it is using CUDA.

Code: Select all

*********************** Log Started 2020-10-22T02:43:58Z ***********************
02:43:58:Trying to access database...
02:43:58:Successfully acquired database lock
02:43:58:Read GPUs.txt
02:43:58:Enabled folding slot 00: READY cpu:10
02:43:58:Enabled folding slot 01: READY gpu:0:GK107 [GeForce GTX 650] 812
02:43:58:Enabled folding slot 02: READY gpu:1:TU106 [GeForce RTX 2070] M 6497
02:43:59:****************************** FAHClient ******************************
02:43:59:        Version: 7.6.13
02:43:59:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:43:59:      Copyright: 2020 foldingathome.org
02:43:59:       Homepage: https://foldingathome.org/
02:43:59:           Date: Apr 27 2020
02:43:59:           Time: 21:21:01
02:43:59:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
02:43:59:         Branch: master
02:43:59:       Compiler: Visual C++ 2008
02:43:59:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
02:43:59:       Platform: win32 10
02:43:59:           Bits: 32
02:43:59:           Mode: Release
02:43:59:         Config: C:\Users\****\AppData\Roaming\FAHClient\config.xml
02:43:59:******************************** CBang ********************************
02:43:59:           Date: Apr 24 2020
02:43:59:           Time: 17:07:55
02:43:59:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
02:43:59:         Branch: master
02:43:59:       Compiler: Visual C++ 2008
02:43:59:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
02:43:59:       Platform: win32 10
02:43:59:           Bits: 32
02:43:59:           Mode: Release
02:43:59:******************************* System ********************************
02:43:59:            CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
02:43:59:         CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
02:43:59:           CPUs: 12
02:43:59:         Memory: 15.90GiB
02:43:59:    Free Memory: 9.77GiB
02:43:59:        Threads: WINDOWS_THREADS
02:43:59:     OS Version: 6.2
02:43:59:    Has Battery: false
02:43:59:     On Battery: false
02:43:59:     UTC Offset: -5
02:43:59:            PID: 35696
02:43:59:            CWD: C:\Users\****\AppData\Roaming\FAHClient
02:43:59:  Win32 Service: false
02:43:59:             OS: Windows 10 Enterprise
02:43:59:        OS Arch: AMD64
02:43:59:           GPUs: 3
02:43:59:          GPU 0: Bus:2 Slot:0 Func:0 NVIDIA:3 GK107 [GeForce GTX 650] 812
02:43:59:          GPU 1: Bus:1 Slot:0 Func:0 NVIDIA:7 TU106 [GeForce RTX 2070] M 6497
02:43:59:          GPU 2: Bus:0 Slot:2 Func:0 INTEL:1 Gen9p5/GT2 [UHD Graphics 630]
02:43:59:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:7.5 Driver:11.1
02:43:59:  CUDA Device 1: Platform:0 Device:1 Bus:2 Slot:0 Compute:3.0 Driver:11.1
02:43:59:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:456.71
02:43:59:OpenCL Device 1: Platform:0 Device:1 Bus:2 Slot:0 Compute:1.2 Driver:456.71
02:43:59:OpenCL Device 2: Platform:1 Device:0 Bus:NA Slot:NA Compute:2.1 Driver:27.20
02:43:59:OpenCL Device 3: Platform:2 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:456.71
02:43:59:OpenCL Device 4: Platform:2 Device:1 Bus:2 Slot:0 Compute:1.2 Driver:456.71
02:43:59:******************************* libFAH ********************************
02:43:59:           Date: Apr 15 2020
02:43:59:           Time: 14:53:14
02:43:59:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
02:43:59:         Branch: master
02:43:59:       Compiler: Visual C++ 2008
02:43:59:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
02:43:59:       Platform: win32 10
02:43:59:           Bits: 32
02:43:59:           Mode: Release
02:43:59:***********************************************************************
02:43:59:<config>
02:43:59:  <!-- Folding Slot Configuration -->
02:43:59:  <cause v='COVID_19'/>
02:43:59:
02:43:59:  <!-- Network -->
02:43:59:  <proxy v=':8080'/>
02:43:59:
02:43:59:  <!-- Slot Control -->
02:43:59:  <pause-on-battery v='false'/>
02:43:59:  <power v='FULL'/>
02:43:59:
02:43:59:  <!-- User Information -->
02:43:59:  <passkey v='*****'/>
02:43:59:  <user v='ande4905'/>
02:43:59:
02:43:59:  <!-- Folding Slots -->
02:43:59:  <slot id='0' type='CPU'/>
02:43:59:  <slot id='1' type='GPU'/>
02:43:59:  <slot id='2' type='GPU'/>
02:43:59:</config>
02:43:59:WU00:FS01:Starting
02:43:59:WU00:FS01:Running FahCore: C:\PROGRA~2\FAHClient/FAHCoreWrapper.exe C:\Users\****\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 35696 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device 1 -gpu 1
02:43:59:WU00:FS01:Started FahCore on PID 30332
02:43:59:WU00:FS01:Core PID:19792
02:43:59:WU00:FS01:FahCore 0x22 started
02:43:59:WU02:FS00:Starting
02:43:59:WU02:FS00:Running FahCore: C:\PROGRA~2\FAHClient/FAHCoreWrapper.exe C:\Users\****\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 706 -lifeline 35696 -checkpoint 15 -np 10
02:43:59:WU02:FS00:Started FahCore on PID 2852
02:43:59:WU02:FS00:Core PID:11852
02:43:59:WU02:FS00:FahCore 0xa7 started
02:43:59:WU03:FS02:Starting
02:43:59:WU03:FS02:Running FahCore: C:\PROGRA~2\FAHClient/FAHCoreWrapper.exe C:\Users\****\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 03 -suffix 01 -version 706 -lifeline 35696 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
02:43:59:WU03:FS02:Started FahCore on PID 3576
02:43:59:WU03:FS02:Core PID:14568
02:43:59:WU03:FS02:FahCore 0x22 started
02:43:59:WU00:FS01:0x22:*********************** Log Started 2020-10-22T02:43:59Z ***********************
02:43:59:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
02:43:59:WU00:FS01:0x22:       Core: Core22
02:43:59:WU00:FS01:0x22:       Type: 0x22
02:43:59:WU00:FS01:0x22:    Version: 0.0.13
02:43:59:WU00:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:43:59:WU00:FS01:0x22:  Copyright: 2020 foldingathome.org
02:43:59:WU00:FS01:0x22:   Homepage: https://foldingathome.org/
02:43:59:WU00:FS01:0x22:       Date: Sep 19 2020
02:43:59:WU00:FS01:0x22:       Time: 02:35:58
02:43:59:WU00:FS01:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
02:43:59:WU00:FS01:0x22:     Branch: core22-0.0.13
02:43:59:WU00:FS01:0x22:   Compiler: Visual C++ 2015
02:43:59:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
02:43:59:WU00:FS01:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
02:43:59:WU00:FS01:0x22:   Platform: win32 10
02:43:59:WU00:FS01:0x22:       Bits: 64
02:43:59:WU00:FS01:0x22:       Mode: Release
02:43:59:WU00:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
02:43:59:WU00:FS01:0x22:             <peastman@stanford.edu>
02:43:59:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 30332 -checkpoint 15
02:43:59:WU00:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device
02:43:59:WU00:FS01:0x22:             1 -gpu 1
02:43:59:WU00:FS01:0x22:************************************ libFAH ************************************
02:43:59:WU00:FS01:0x22:       Date: Sep 7 2020
02:43:59:WU00:FS01:0x22:       Time: 19:09:56
02:43:59:WU02:FS00:0xa7:*********************** Log Started 2020-10-22T02:43:59Z ***********************
02:43:59:WU00:FS01:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
02:43:59:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
02:43:59:WU00:FS01:0x22:     Branch: HEAD
02:43:59:WU02:FS00:0xa7:       Type: 0xa7
02:43:59:WU00:FS01:0x22:   Compiler: Visual C++ 2015
02:43:59:WU02:FS00:0xa7:       Core: Gromacs
02:43:59:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
02:43:59:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 706 -lifeline 2852 -checkpoint 15 -np
02:43:59:WU00:FS01:0x22:   Platform: win32 10
02:43:59:WU02:FS00:0xa7:             10
02:43:59:WU00:FS01:0x22:       Bits: 64
02:43:59:WU02:FS00:0xa7:************************************ CBang *************************************
02:43:59:WU00:FS01:0x22:       Mode: Release
02:43:59:WU02:FS00:0xa7:       Date: Nov 27 2019
02:43:59:WU00:FS01:0x22:************************************ CBang *************************************
02:43:59:WU02:FS00:0xa7:       Time: 03:40:09
02:43:59:WU00:FS01:0x22:       Date: Sep 7 2020
02:43:59:WU02:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
02:43:59:WU00:FS01:0x22:       Time: 19:08:30
02:43:59:WU02:FS00:0xa7:     Branch: master
02:43:59:WU00:FS01:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
02:43:59:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
02:43:59:WU00:FS01:0x22:     Branch: HEAD
02:43:59:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
02:43:59:WU00:FS01:0x22:   Compiler: Visual C++ 2015
02:43:59:WU02:FS00:0xa7:   Platform: win32 10
02:43:59:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
02:43:59:WU02:FS00:0xa7:       Bits: 64
02:43:59:WU00:FS01:0x22:   Platform: win32 10
02:43:59:WU02:FS00:0xa7:       Mode: Release
02:43:59:WU00:FS01:0x22:       Bits: 64
02:43:59:WU02:FS00:0xa7:************************************ System ************************************
02:43:59:WU00:FS01:0x22:       Mode: Release
02:43:59:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
02:43:59:WU00:FS01:0x22:************************************ System ************************************
02:43:59:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
02:43:59:WU00:FS01:0x22:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
02:43:59:WU02:FS00:0xa7:       CPUs: 12
02:43:59:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
02:43:59:WU02:FS00:0xa7:     Memory: 15.90GiB
02:43:59:WU00:FS01:0x22:       CPUs: 12
02:43:59:WU02:FS00:0xa7:Free Memory: 9.66GiB
02:43:59:WU00:FS01:0x22:     Memory: 15.90GiB
02:43:59:WU02:FS00:0xa7:    Threads: WINDOWS_THREADS
02:43:59:WU00:FS01:0x22:Free Memory: 9.66GiB
02:43:59:WU02:FS00:0xa7: OS Version: 6.2
02:43:59:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
02:43:59:WU02:FS00:0xa7:Has Battery: false
02:43:59:WU00:FS01:0x22: OS Version: 6.2
02:43:59:WU02:FS00:0xa7: On Battery: false
02:43:59:WU00:FS01:0x22:Has Battery: false
02:43:59:WU02:FS00:0xa7: UTC Offset: -5
02:43:59:WU00:FS01:0x22: On Battery: false
02:43:59:WU02:FS00:0xa7:        PID: 11852
02:43:59:WU00:FS01:0x22: UTC Offset: -5
02:43:59:WU02:FS00:0xa7:        CWD: C:\Users\****\AppData\Roaming\FAHClient\work
02:43:59:WU00:FS01:0x22:        PID: 19792
02:43:59:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
02:43:59:WU00:FS01:0x22:        CWD: C:\Users\*****\AppData\Roaming\FAHClient\work
02:43:59:WU02:FS00:0xa7:    Version: 0.0.19
02:43:59:WU00:FS01:0x22:************************************ OpenMM ************************************
02:43:59:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:43:59:WU00:FS01:0x22:   Revision: 189320d0
02:43:59:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
02:43:59:WU00:FS01:0x22:********************************************************************************
02:43:59:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
02:43:59:WU00:FS01:0x22:Project: 16918 (Run 142, Clone 63, Gen 33)
02:43:59:WU02:FS00:0xa7:       Date: Nov 25 2019
02:43:59:WU00:FS01:0x22:Unit: 0x0000002d0002894c5f176179d98f12cf
02:43:59:WU02:FS00:0xa7:       Time: 17:12:41
02:43:59:WU00:FS01:0x22:Digital signatures verified
02:43:59:WU02:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
02:43:59:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
02:43:59:WU02:FS00:0xa7:     Branch: master
02:43:59:WU00:FS01:0x22:Version 0.0.13
02:43:59:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
02:43:59:WU00:FS01:0x22:  Checkpoint write interval: 100000 steps (2%) [50 total]
02:43:59:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
02:43:59:WU00:FS01:0x22:  JSON viewer frame write interval: 50000 steps (1%) [100 total]
02:43:59:WU02:FS00:0xa7:   Platform: win32 10
02:43:59:WU00:FS01:0x22:  XTC frame write interval: 250000 steps (5%) [20 total]
02:43:59:WU02:FS00:0xa7:       Bits: 64
02:43:59:WU00:FS01:0x22:  Global context and integrator variables write interval: disabled
02:43:59:WU02:FS00:0xa7:       Mode: Release
02:43:59:WU02:FS00:0xa7:************************************ Build *************************************
02:43:59:WU02:FS00:0xa7:       SIMD: avx_256
02:43:59:WU02:FS00:0xa7:********************************************************************************
02:43:59:WU02:FS00:0xa7:Project: 17414 (Run 0, Clone 830, Gen 97)
02:43:59:WU02:FS00:0xa7:Unit: 0x0000006b42aa6f325f61830385142315
02:43:59:WU02:FS00:0xa7:Digital signatures verified
02:43:59:WU02:FS00:0xa7:Calling: mdrun -s frame97.tpr -o frame97.trr -x frame97.xtc -cpt 15 -nt 10
02:43:59:WU02:FS00:0xa7:Steps: first=12125000 total=125000
02:44:00:WU03:FS02:0x22:*********************** Log Started 2020-10-22T02:43:59Z ***********************
02:44:00:WU03:FS02:0x22:*************************** Core22 Folding@home Core ***************************
02:44:00:WU03:FS02:0x22:       Core: Core22
02:44:00:WU03:FS02:0x22:       Type: 0x22
02:44:00:WU03:FS02:0x22:    Version: 0.0.13
02:44:00:WU03:FS02:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:44:00:WU03:FS02:0x22:  Copyright: 2020 foldingathome.org
02:44:00:WU03:FS02:0x22:   Homepage: https://foldingathome.org/
02:44:00:WU03:FS02:0x22:       Date: Sep 19 2020
02:44:00:WU03:FS02:0x22:       Time: 02:35:58
02:44:00:WU03:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
02:44:00:WU03:FS02:0x22:     Branch: core22-0.0.13
02:44:00:WU03:FS02:0x22:   Compiler: Visual C++ 2015
02:44:00:WU03:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
02:44:00:WU03:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
02:44:00:WU03:FS02:0x22:   Platform: win32 10
02:44:00:WU03:FS02:0x22:       Bits: 64
02:44:00:WU03:FS02:0x22:       Mode: Release
02:44:00:WU03:FS02:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
02:44:00:WU03:FS02:0x22:             <peastman@stanford.edu>
02:44:00:WU03:FS02:0x22:       Args: -dir 03 -suffix 01 -version 706 -lifeline 3576 -checkpoint 15
02:44:00:WU03:FS02:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
02:44:00:WU03:FS02:0x22:             0 -gpu 0
02:44:00:WU03:FS02:0x22:************************************ libFAH ************************************
02:44:00:WU03:FS02:0x22:       Date: Sep 7 2020
02:44:00:WU03:FS02:0x22:       Time: 19:09:56
02:44:00:WU03:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
02:44:00:WU03:FS02:0x22:     Branch: HEAD
02:44:00:WU03:FS02:0x22:   Compiler: Visual C++ 2015
02:44:00:WU03:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
02:44:00:WU03:FS02:0x22:   Platform: win32 10
02:44:00:WU03:FS02:0x22:       Bits: 64
02:44:00:WU03:FS02:0x22:       Mode: Release
02:44:00:WU03:FS02:0x22:************************************ CBang *************************************
02:44:00:WU03:FS02:0x22:       Date: Sep 7 2020
02:44:00:WU03:FS02:0x22:       Time: 19:08:30
02:44:00:WU03:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
02:44:00:WU03:FS02:0x22:     Branch: HEAD
02:44:00:WU03:FS02:0x22:   Compiler: Visual C++ 2015
02:44:00:WU03:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
02:44:00:WU03:FS02:0x22:   Platform: win32 10
02:44:00:WU03:FS02:0x22:       Bits: 64
02:44:00:WU03:FS02:0x22:       Mode: Release
02:44:00:WU03:FS02:0x22:************************************ System ************************************
02:44:00:WU03:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
02:44:00:WU03:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
02:44:00:WU03:FS02:0x22:       CPUs: 12
02:44:00:WU03:FS02:0x22:     Memory: 15.90GiB
02:44:00:WU03:FS02:0x22:Free Memory: 9.62GiB
02:44:00:WU03:FS02:0x22:    Threads: WINDOWS_THREADS
02:44:00:WU03:FS02:0x22: OS Version: 6.2
02:44:00:WU03:FS02:0x22:Has Battery: false
02:44:00:WU03:FS02:0x22: On Battery: false
02:44:00:WU03:FS02:0x22: UTC Offset: -5
02:44:00:WU03:FS02:0x22:        PID: 14568
02:44:00:WU03:FS02:0x22:        CWD: C:\Users\****\AppData\Roaming\FAHClient\work
02:44:00:WU03:FS02:0x22:************************************ OpenMM ************************************
02:44:00:WU03:FS02:0x22:   Revision: 189320d0
02:44:00:WU03:FS02:0x22:********************************************************************************
02:44:00:WU03:FS02:0x22:Project: 14905 (Run 111, Clone 7, Gen 104)
02:44:00:WU03:FS02:0x22:Unit: 0x0000008f81d59d695f4ec9de8dfd995c
02:44:00:WU03:FS02:0x22:Digital signatures verified
02:44:00:WU03:FS02:0x22:Folding@home GPU Core22 Folding@home Core
02:44:00:WU03:FS02:0x22:Version 0.0.13
02:44:00:WU03:FS02:0x22:  Checkpoint write interval: 100000 steps (5%) [20 total]
02:44:00:WU03:FS02:0x22:  JSON viewer frame write interval: 20000 steps (1%) [100 total]
02:44:00:WU03:FS02:0x22:  XTC frame write interval: 50000 steps (2.5%) [40 total]
02:44:00:WU03:FS02:0x22:  Global context and integrator variables write interval: disabled
02:44:00:WU00:FS01:0x22:There are 4 platforms available.
02:44:00:WU00:FS01:0x22:Platform 0: Reference
02:44:00:WU00:FS01:0x22:Platform 1: CPU
02:44:00:WU00:FS01:0x22:Platform 2: OpenCL
02:44:00:WU00:FS01:0x22:  opencl-device 1 specified
02:44:00:WU00:FS01:0x22:Platform 3: CUDA
02:44:00:WU00:FS01:0x22:  cuda-device 1 specified
02:44:00:WU03:FS02:0x22:There are 4 platforms available.
02:44:00:WU03:FS02:0x22:Platform 0: Reference
02:44:00:WU03:FS02:0x22:Platform 1: CPU
02:44:00:WU03:FS02:0x22:Platform 2: OpenCL
02:44:00:WU03:FS02:0x22:  opencl-device 0 specified
02:44:00:WU03:FS02:0x22:Platform 3: CUDA
02:44:00:WU03:FS02:0x22:  cuda-device 0 specified
02:44:03:WU02:FS00:0xa7:Completed 1 out of 125000 steps (0%)
02:44:06:WU00:FS01:0x22:Attempting to create CUDA context:
02:44:06:WU00:FS01:0x22:  Configuring platform CUDA
02:44:08:WU00:FS01:0x22:  Using CUDA and gpu 1
02:44:08:WU00:FS01:0x22:Completed 3300000 out of 5000000 steps (66%)
02:44:13:WU03:FS02:0x22:Attempting to create CUDA context:
02:44:13:WU03:FS02:0x22:  Configuring platform CUDA
02:44:17:WU03:FS02:0x22:  Using CUDA and gpu 0
02:44:17:WU03:FS02:0x22:Completed 300000 out of 2000000 steps (15%)
02:45:20:WU03:FS02:0x22:Completed 320000 out of 2000000 steps (16%)
02:45:21:WU02:FS00:0xa7:Completed 1250 out of 125000 steps (1%)
02:46:24:WU03:FS02:0x22:Completed 340000 out of 2000000 steps (17%)
02:46:37:WU02:FS00:0xa7:Completed 2500 out of 125000 steps (2%)
02:47:28:WU03:FS02:0x22:Completed 360000 out of 2000000 steps (18%)
02:47:54:WU02:FS00:0xa7:Completed 3750 out of 125000 steps (3%)
02:48:32:WU03:FS02:0x22:Completed 380000 out of 2000000 steps (19%)
02:49:11:WU02:FS00:0xa7:Completed 5000 out of 125000 steps (4%)
02:49:37:WU03:FS02:0x22:Completed 400000 out of 2000000 steps (20%)
02:49:38:WU03:FS02:0x22:Checkpoint completed at step 400000
02:50:27:WU02:FS00:0xa7:Completed 6250 out of 125000 steps (5%)
02:50:42:WU03:FS02:0x22:Completed 420000 out of 2000000 steps (21%)
02:51:48:WU03:FS02:0x22:Completed 440000 out of 2000000 steps (22%)
02:51:54:WU02:FS00:0xa7:Completed 7500 out of 125000 steps (6%)
02:52:53:WU03:FS02:0x22:Completed 460000 out of 2000000 steps (23%)
02:53:10:WU02:FS00:0xa7:Completed 8750 out of 125000 steps (7%)
02:53:58:WU03:FS02:0x22:Completed 480000 out of 2000000 steps (24%)
02:54:27:WU02:FS00:0xa7:Completed 10000 out of 125000 steps (8%)
02:55:03:WU03:FS02:0x22:Completed 500000 out of 2000000 steps (25%)
02:55:04:WU03:FS02:0x22:Checkpoint completed at step 500000
02:55:43:WU02:FS00:0xa7:Completed 11250 out of 125000 steps (9%)
02:56:09:WU03:FS02:0x22:Completed 520000 out of 2000000 steps (26%)
02:56:58:WU02:FS00:0xa7:Completed 12500 out of 125000 steps (10%)
02:57:14:WU03:FS02:0x22:Completed 540000 out of 2000000 steps (27%)
02:58:13:WU02:FS00:0xa7:Completed 13750 out of 125000 steps (11%)
02:58:19:WU03:FS02:0x22:Completed 560000 out of 2000000 steps (28%)
02:59:24:WU03:FS02:0x22:Completed 580000 out of 2000000 steps (29%)
02:59:31:WU02:FS00:0xa7:Completed 15000 out of 125000 steps (12%)
03:00:29:WU03:FS02:0x22:Completed 600000 out of 2000000 steps (30%)
03:00:30:WU03:FS02:0x22:Checkpoint completed at step 600000
03:00:48:WU02:FS00:0xa7:Completed 16250 out of 125000 steps (13%)
03:01:35:WU03:FS02:0x22:Completed 620000 out of 2000000 steps (31%)
03:02:05:WU02:FS00:0xa7:Completed 17500 out of 125000 steps (14%)
03:02:40:WU03:FS02:0x22:Completed 640000 out of 2000000 steps (32%)
03:03:21:WU02:FS00:0xa7:Completed 18750 out of 125000 steps (15%)
03:03:45:WU03:FS02:0x22:Completed 660000 out of 2000000 steps (33%)
03:04:38:WU02:FS00:0xa7:Completed 20000 out of 125000 steps (16%)
03:04:50:WU03:FS02:0x22:Completed 680000 out of 2000000 steps (34%)
03:05:47:WU00:FS01:0x22:Completed 3350000 out of 5000000 steps (67%)
03:05:53:WU02:FS00:0xa7:Completed 21250 out of 125000 steps (17%)
03:05:55:WU03:FS02:0x22:Completed 700000 out of 2000000 steps (35%)
03:05:56:WU03:FS02:0x22:Checkpoint completed at step 700000
03:07:01:WU03:FS02:0x22:Completed 720000 out of 2000000 steps (36%)
03:07:08:WU02:FS00:0xa7:Completed 22500 out of 125000 steps (18%)
03:08:06:WU03:FS02:0x22:Completed 740000 out of 2000000 steps (37%)
03:08:24:WU02:FS00:0xa7:Completed 23750 out of 125000 steps (19%)
03:09:11:WU03:FS02:0x22:Completed 760000 out of 2000000 steps (38%)
03:09:40:WU02:FS00:0xa7:Completed 25000 out of 125000 steps (20%)
03:10:16:WU03:FS02:0x22:Completed 780000 out of 2000000 steps (39%)
03:10:55:WU02:FS00:0xa7:Completed 26250 out of 125000 steps (21%)
03:11:21:WU03:FS02:0x22:Completed 800000 out of 2000000 steps (40%)
03:11:22:WU03:FS02:0x22:Checkpoint completed at step 800000
03:12:10:WU02:FS00:0xa7:Completed 27500 out of 125000 steps (22%)
03:12:27:WU03:FS02:0x22:Completed 820000 out of 2000000 steps (41%)
03:13:25:WU02:FS00:0xa7:Completed 28750 out of 125000 steps (23%)
03:13:32:WU03:FS02:0x22:Completed 840000 out of 2000000 steps (42%)
03:14:37:WU03:FS02:0x22:Completed 860000 out of 2000000 steps (43%)
03:14:43:WU02:FS00:0xa7:Completed 30000 out of 125000 steps (24%)
03:15:41:WU03:FS02:0x22:Completed 880000 out of 2000000 steps (44%)
03:15:59:WU02:FS00:0xa7:Completed 31250 out of 125000 steps (25%)
03:16:46:WU03:FS02:0x22:Completed 900000 out of 2000000 steps (45%)
03:16:47:WU03:FS02:0x22:Checkpoint completed at step 900000
03:17:14:WU02:FS00:0xa7:Completed 32500 out of 125000 steps (26%)
03:17:52:WU03:FS02:0x22:Completed 920000 out of 2000000 steps (46%)
03:18:29:WU02:FS00:0xa7:Completed 33750 out of 125000 steps (27%)
03:18:57:WU03:FS02:0x22:Completed 940000 out of 2000000 steps (47%)
03:19:44:WU02:FS00:0xa7:Completed 35000 out of 125000 steps (28%)
03:20:02:WU03:FS02:0x22:Completed 960000 out of 2000000 steps (48%)
03:20:59:WU02:FS00:0xa7:Completed 36250 out of 125000 steps (29%)
03:21:07:WU03:FS02:0x22:Completed 980000 out of 2000000 steps (49%)
03:22:12:WU03:FS02:0x22:Completed 1000000 out of 2000000 steps (50%)
03:22:13:WU03:FS02:0x22:Checkpoint completed at step 1000000
03:22:14:WU02:FS00:0xa7:Completed 37500 out of 125000 steps (30%)
03:23:19:WU03:FS02:0x22:Completed 1020000 out of 2000000 steps (51%)
03:23:30:WU02:FS00:0xa7:Completed 38750 out of 125000 steps (31%)
03:24:24:WU03:FS02:0x22:Completed 1040000 out of 2000000 steps (52%)
03:24:47:WU02:FS00:0xa7:Completed 40000 out of 125000 steps (32%)
03:25:29:WU03:FS02:0x22:Completed 1060000 out of 2000000 steps (53%)
03:26:02:WU02:FS00:0xa7:Completed 41250 out of 125000 steps (33%)
03:26:34:WU03:FS02:0x22:Completed 1080000 out of 2000000 steps (54%)
03:27:17:WU02:FS00:0xa7:Completed 42500 out of 125000 steps (34%)
03:27:26:WU00:FS01:0x22:Completed 3400000 out of 5000000 steps (68%)
03:27:27:WU00:FS01:0x22:Checkpoint completed at step 3400000
03:27:39:WU03:FS02:0x22:Completed 1100000 out of 2000000 steps (55%)
03:27:40:WU03:FS02:0x22:Checkpoint completed at step 1100000
03:28:32:WU02:FS00:0xa7:Completed 43750 out of 125000 steps (35%)
03:28:45:WU03:FS02:0x22:Completed 1120000 out of 2000000 steps (56%)
03:29:50:WU03:FS02:0x22:Completed 1140000 out of 2000000 steps (57%)
03:29:50:WU02:FS00:0xa7:Completed 45000 out of 125000 steps (36%)
03:30:55:WU03:FS02:0x22:Completed 1160000 out of 2000000 steps (58%)
03:31:06:WU02:FS00:0xa7:Completed 46250 out of 125000 steps (37%)
03:32:00:WU03:FS02:0x22:Completed 1180000 out of 2000000 steps (59%)
03:32:22:WU02:FS00:0xa7:Completed 47500 out of 125000 steps (38%)
03:33:05:WU03:FS02:0x22:Completed 1200000 out of 2000000 steps (60%)
03:33:06:WU03:FS02:0x22:Checkpoint completed at step 1200000
03:33:43:WU02:FS00:0xa7:Completed 48750 out of 125000 steps (39%)
03:34:11:WU03:FS02:0x22:Completed 1220000 out of 2000000 steps (61%)
03:35:00:WU02:FS00:0xa7:Completed 50000 out of 125000 steps (40%)
03:35:17:WU03:FS02:0x22:Completed 1240000 out of 2000000 steps (62%)
03:36:14:WU02:FS00:0xa7:Completed 51250 out of 125000 steps (41%)
03:36:22:WU03:FS02:0x22:Completed 1260000 out of 2000000 steps (63%)
03:37:27:WU03:FS02:0x22:Completed 1280000 out of 2000000 steps (64%)
03:37:29:WU02:FS00:0xa7:Completed 52500 out of 125000 steps (42%)
03:38:32:WU03:FS02:0x22:Completed 1300000 out of 2000000 steps (65%)
03:38:33:WU03:FS02:0x22:Checkpoint completed at step 1300000
03:38:44:WU02:FS00:0xa7:Completed 53750 out of 125000 steps (43%)
03:39:38:WU03:FS02:0x22:Completed 1320000 out of 2000000 steps (66%)
03:39:59:WU02:FS00:0xa7:Completed 55000 out of 125000 steps (44%)
03:40:43:WU03:FS02:0x22:Completed 1340000 out of 2000000 steps (67%)
03:41:14:WU02:FS00:0xa7:Completed 56250 out of 125000 steps (45%)
03:41:48:WU03:FS02:0x22:Completed 1360000 out of 2000000 steps (68%)
03:42:29:WU02:FS00:0xa7:Completed 57500 out of 125000 steps (46%)
03:42:53:WU03:FS02:0x22:Completed 1380000 out of 2000000 steps (69%)
03:43:43:WU02:FS00:0xa7:Completed 58750 out of 125000 steps (47%)
03:43:58:WU03:FS02:0x22:Completed 1400000 out of 2000000 steps (70%)
03:43:59:WU03:FS02:0x22:Checkpoint completed at step 1400000
03:45:04:WU02:FS00:0xa7:Completed 60000 out of 125000 steps (48%)
03:45:05:WU03:FS02:0x22:Completed 1420000 out of 2000000 steps (71%)
03:46:10:WU03:FS02:0x22:Completed 1440000 out of 2000000 steps (72%)
03:46:24:WU02:FS00:0xa7:Completed 61250 out of 125000 steps (49%)
03:47:16:WU03:FS02:0x22:Completed 1460000 out of 2000000 steps (73%)
03:47:46:WU02:FS00:0xa7:Completed 62500 out of 125000 steps (50%)
03:48:20:WU03:FS02:0x22:Completed 1480000 out of 2000000 steps (74%)
03:49:01:WU02:FS00:0xa7:Completed 63750 out of 125000 steps (51%)
03:49:05:WU00:FS01:0x22:Completed 3450000 out of 5000000 steps (69%)
03:49:25:WU03:FS02:0x22:Completed 1500000 out of 2000000 steps (75%)
03:49:27:WU03:FS02:0x22:Checkpoint completed at step 1500000
03:50:16:WU02:FS00:0xa7:Completed 65000 out of 125000 steps (52%)
03:50:32:WU03:FS02:0x22:Completed 1520000 out of 2000000 steps (76%)
03:51:32:WU02:FS00:0xa7:Completed 66250 out of 125000 steps (53%)
03:51:37:WU03:FS02:0x22:Completed 1540000 out of 2000000 steps (77%)
03:52:42:WU03:FS02:0x22:Completed 1560000 out of 2000000 steps (78%)
03:52:46:WU02:FS00:0xa7:Completed 67500 out of 125000 steps (54%)
03:53:47:WU03:FS02:0x22:Completed 1580000 out of 2000000 steps (79%)
03:54:01:WU02:FS00:0xa7:Completed 68750 out of 125000 steps (55%)
03:54:52:WU03:FS02:0x22:Completed 1600000 out of 2000000 steps (80%)
03:54:53:WU03:FS02:0x22:Checkpoint completed at step 1600000
03:55:16:WU02:FS00:0xa7:Completed 70000 out of 125000 steps (56%)
03:55:58:WU03:FS02:0x22:Completed 1620000 out of 2000000 steps (81%)
03:56:31:WU02:FS00:0xa7:Completed 71250 out of 125000 steps (57%)
03:57:03:WU03:FS02:0x22:Completed 1640000 out of 2000000 steps (82%)
03:57:45:WU02:FS00:0xa7:Completed 72500 out of 125000 steps (58%)
03:58:08:WU03:FS02:0x22:Completed 1660000 out of 2000000 steps (83%)
03:59:00:WU02:FS00:0xa7:Completed 73750 out of 125000 steps (59%)
03:59:13:WU03:FS02:0x22:Completed 1680000 out of 2000000 steps (84%)
04:00:21:WU03:FS02:0x22:Completed 1700000 out of 2000000 steps (85%)
04:00:23:WU03:FS02:0x22:Checkpoint completed at step 1700000
04:00:36:WU02:FS00:0xa7:Completed 75000 out of 125000 steps (60%)
04:01:34:WU03:FS02:0x22:Completed 1720000 out of 2000000 steps (86%)
04:02:20:WU02:FS00:0xa7:Completed 76250 out of 125000 steps (61%)
04:02:43:WU03:FS02:0x22:Completed 1740000 out of 2000000 steps (87%)
04:03:51:WU03:FS02:0x22:Completed 1760000 out of 2000000 steps (88%)
04:04:03:WU02:FS00:0xa7:Completed 77500 out of 125000 steps (62%)
04:04:59:WU03:FS02:0x22:Completed 1780000 out of 2000000 steps (89%)
04:05:42:WU02:FS00:0xa7:Completed 78750 out of 125000 steps (63%)
04:06:06:WU03:FS02:0x22:Completed 1800000 out of 2000000 steps (90%)
04:06:07:WU03:FS02:0x22:Checkpoint completed at step 1800000
04:07:13:WU03:FS02:0x22:Completed 1820000 out of 2000000 steps (91%)
04:07:19:WU02:FS00:0xa7:Completed 80000 out of 125000 steps (64%)
04:08:21:WU03:FS02:0x22:Completed 1840000 out of 2000000 steps (92%)
04:08:56:WU02:FS00:0xa7:Completed 81250 out of 125000 steps (65%)
04:09:28:WU03:FS02:0x22:Completed 1860000 out of 2000000 steps (93%)
04:10:17:WU02:FS00:0xa7:Completed 82500 out of 125000 steps (66%)
04:10:34:WU03:FS02:0x22:Completed 1880000 out of 2000000 steps (94%)
04:10:47:WU00:FS01:0x22:Completed 3500000 out of 5000000 steps (70%)
04:10:49:WU00:FS01:0x22:Checkpoint completed at step 3500000
04:11:38:WU02:FS00:0xa7:Completed 83750 out of 125000 steps (67%)
04:11:40:WU03:FS02:0x22:Completed 1900000 out of 2000000 steps (95%)
04:11:41:WU03:FS02:0x22:Checkpoint completed at step 1900000
04:12:49:WU03:FS02:0x22:Completed 1920000 out of 2000000 steps (96%)
04:13:04:WU02:FS00:0xa7:Completed 85000 out of 125000 steps (68%)
04:13:54:WU03:FS02:0x22:Completed 1940000 out of 2000000 steps (97%)
04:14:25:WU02:FS00:0xa7:Completed 86250 out of 125000 steps (69%)
04:15:00:WU03:FS02:0x22:Completed 1960000 out of 2000000 steps (98%)
04:15:44:WU02:FS00:0xa7:Completed 87500 out of 125000 steps (70%)
04:16:06:WU03:FS02:0x22:Completed 1980000 out of 2000000 steps (99%)
04:16:10:WU01:FS02:Connecting to assign1.foldingathome.org:80
04:16:12:WU01:FS02:Assigned to work server 129.213.157.105
04:16:12:WU01:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:TU106 [GeForce RTX 2070] M 6497 from 129.213.157.105
04:16:12:WU01:FS02:Connecting to 129.213.157.105:8080
04:16:15:WU01:FS02:Downloading 11.38MiB
04:16:17:WU01:FS02:Download complete
04:16:17:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14904 run:457 clone:1 gen:78 core:0x22 unit:0x0000007081d59d695f4ec9e35a574dc2
04:17:03:WU02:FS00:0xa7:Completed 88750 out of 125000 steps (71%)
04:17:12:WU03:FS02:0x22:Completed 2000000 out of 2000000 steps (100%)
04:17:12:WU03:FS02:0x22:Average performance: 26.1027 ns/day
04:17:13:WU03:FS02:0x22:Checkpoint completed at step 2000000
04:17:17:WU03:FS02:0x22:Saving result file ..\logfile_01.txt
04:17:17:WU03:FS02:0x22:Saving result file checkpointIntegrator.xml
04:17:17:WU03:FS02:0x22:Saving result file checkpointState.xml
04:17:19:WU03:FS02:0x22:Saving result file positions.xtc
04:17:19:WU03:FS02:0x22:Saving result file science.log
04:17:19:WU03:FS02:0x22:Folding@home Core Shutdown: FINISHED_UNIT
04:17:20:WU03:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
04:17:20:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:14905 run:111 clone:7 gen:104 core:0x22 unit:0x0000008f81d59d695f4ec9de8dfd995c
04:17:20:WU03:FS02:Uploading 11.29MiB to 129.213.157.105
04:17:20:WU03:FS02:Connecting to 129.213.157.105:8080
04:17:21:WU01:FS02:Starting
04:17:21:WU01:FS02:Running FahCore: C:\PROGRA~2\FAHClient/FAHCoreWrapper.exe C:\Users\****\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 35696 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
04:17:21:WU01:FS02:Started FahCore on PID 33372
04:17:21:WU01:FS02:Core PID:36908
04:17:21:WU01:FS02:FahCore 0x22 started
04:17:21:WU01:FS02:0x22:*********************** Log Started 2020-10-22T04:17:21Z ***********************
04:17:21:WU01:FS02:0x22:*************************** Core22 Folding@home Core ***************************
04:17:21:WU01:FS02:0x22:       Core: Core22
04:17:21:WU01:FS02:0x22:       Type: 0x22
04:17:21:WU01:FS02:0x22:    Version: 0.0.13
04:17:21:WU01:FS02:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
04:17:21:WU01:FS02:0x22:  Copyright: 2020 foldingathome.org
04:17:21:WU01:FS02:0x22:   Homepage: https://foldingathome.org/
04:17:21:WU01:FS02:0x22:       Date: Sep 19 2020
04:17:21:WU01:FS02:0x22:       Time: 02:35:58
04:17:21:WU01:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
04:17:21:WU01:FS02:0x22:     Branch: core22-0.0.13
04:17:21:WU01:FS02:0x22:   Compiler: Visual C++ 2015
04:17:21:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
04:17:21:WU01:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
04:17:21:WU01:FS02:0x22:   Platform: win32 10
04:17:21:WU01:FS02:0x22:       Bits: 64
04:17:21:WU01:FS02:0x22:       Mode: Release
04:17:21:WU01:FS02:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
04:17:21:WU01:FS02:0x22:             <peastman@stanford.edu>
04:17:21:WU01:FS02:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 33372 -checkpoint 15
04:17:21:WU01:FS02:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
04:17:21:WU01:FS02:0x22:             0 -gpu 0
04:17:21:WU01:FS02:0x22:************************************ libFAH ************************************
04:17:21:WU01:FS02:0x22:       Date: Sep 7 2020
04:17:21:WU01:FS02:0x22:       Time: 19:09:56
04:17:21:WU01:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
04:17:21:WU01:FS02:0x22:     Branch: HEAD
04:17:21:WU01:FS02:0x22:   Compiler: Visual C++ 2015
04:17:21:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
04:17:21:WU01:FS02:0x22:   Platform: win32 10
04:17:21:WU01:FS02:0x22:       Bits: 64
04:17:21:WU01:FS02:0x22:       Mode: Release
04:17:21:WU01:FS02:0x22:************************************ CBang *************************************
04:17:21:WU01:FS02:0x22:       Date: Sep 7 2020
04:17:21:WU01:FS02:0x22:       Time: 19:08:30
04:17:21:WU01:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
04:17:21:WU01:FS02:0x22:     Branch: HEAD
04:17:21:WU01:FS02:0x22:   Compiler: Visual C++ 2015
04:17:21:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
04:17:21:WU01:FS02:0x22:   Platform: win32 10
04:17:21:WU01:FS02:0x22:       Bits: 64
04:17:21:WU01:FS02:0x22:       Mode: Release
04:17:21:WU01:FS02:0x22:************************************ System ************************************
04:17:21:WU01:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
04:17:21:WU01:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
04:17:21:WU01:FS02:0x22:       CPUs: 12
04:17:21:WU01:FS02:0x22:     Memory: 15.90GiB
04:17:21:WU01:FS02:0x22:Free Memory: 8.33GiB
04:17:21:WU01:FS02:0x22:    Threads: WINDOWS_THREADS
04:17:21:WU01:FS02:0x22: OS Version: 6.2
04:17:21:WU01:FS02:0x22:Has Battery: false
04:17:21:WU01:FS02:0x22: On Battery: false
04:17:21:WU01:FS02:0x22: UTC Offset: -5
04:17:21:WU01:FS02:0x22:        PID: 36908
04:17:21:WU01:FS02:0x22:        CWD: C:\Users\****\AppData\Roaming\FAHClient\work
04:17:21:WU01:FS02:0x22:************************************ OpenMM ************************************
04:17:21:WU01:FS02:0x22:   Revision: 189320d0
04:17:21:WU01:FS02:0x22:********************************************************************************
04:17:21:WU01:FS02:0x22:Project: 14904 (Run 457, Clone 1, Gen 78)
04:17:21:WU01:FS02:0x22:Unit: 0x0000007081d59d695f4ec9e35a574dc2
04:17:21:WU01:FS02:0x22:Reading tar file core.xml
04:17:21:WU01:FS02:0x22:Reading tar file integrator.xml
04:17:21:WU01:FS02:0x22:Reading tar file state.xml
04:17:22:WU01:FS02:0x22:Reading tar file system.xml
04:17:23:WU01:FS02:0x22:Digital signatures verified
04:17:23:WU01:FS02:0x22:Folding@home GPU Core22 Folding@home Core
04:17:23:WU01:FS02:0x22:Version 0.0.13
04:17:24:WU01:FS02:0x22:  Checkpoint write interval: 100000 steps (5%) [20 total]
04:17:24:WU01:FS02:0x22:  JSON viewer frame write interval: 20000 steps (1%) [100 total]
04:17:24:WU01:FS02:0x22:  XTC frame write interval: 50000 steps (2.5%) [40 total]
04:17:24:WU01:FS02:0x22:  Global context and integrator variables write interval: disabled
04:17:24:WU01:FS02:0x22:There are 4 platforms available.
04:17:24:WU01:FS02:0x22:Platform 0: Reference
04:17:24:WU01:FS02:0x22:Platform 1: CPU
04:17:24:WU01:FS02:0x22:Platform 2: OpenCL
04:17:24:WU01:FS02:0x22:  opencl-device 0 specified
04:17:24:WU01:FS02:0x22:Platform 3: CUDA
04:17:24:WU01:FS02:0x22:  cuda-device 0 specified
04:17:26:WU03:FS02:Upload 32.65%
04:17:32:WU03:FS02:Upload 70.29%
04:17:35:WU01:FS02:0x22:Attempting to create CUDA context:
04:17:35:WU01:FS02:0x22:  Configuring platform CUDA
04:17:37:WU03:FS02:Upload complete
04:17:37:WU03:FS02:Server responded WORK_ACK (400)
04:17:37:WU03:FS02:Final credit estimate, 50143.00 points
04:17:37:WU03:FS02:Cleaning up
04:17:41:WU01:FS02:0x22:  Using CUDA and gpu 0
04:17:41:WU01:FS02:0x22:Completed 0 out of 2000000 steps (0%)
04:17:42:WU01:FS02:0x22:Checkpoint completed at step 0
04:18:22:WU02:FS00:0xa7:Completed 90000 out of 125000 steps (72%)
04:18:47:WU01:FS02:0x22:Completed 20000 out of 2000000 steps (1%)
04:19:41:WU02:FS00:0xa7:Completed 91250 out of 125000 steps (73%)
04:19:52:WU01:FS02:0x22:Completed 40000 out of 2000000 steps (2%)
04:20:58:WU01:FS02:0x22:Completed 60000 out of 2000000 steps (3%)
04:20:58:WU02:FS00:0xa7:Completed 92500 out of 125000 steps (74%)
04:22:03:WU01:FS02:0x22:Completed 80000 out of 2000000 steps (4%)
04:22:19:WU02:FS00:0xa7:Completed 93750 out of 125000 steps (75%)
04:23:11:WU01:FS02:0x22:Completed 100000 out of 2000000 steps (5%)
04:23:12:WU01:FS02:0x22:Checkpoint completed at step 100000
04:23:51:WU02:FS00:0xa7:Completed 95000 out of 125000 steps (76%)
04:24:21:WU01:FS02:0x22:Completed 120000 out of 2000000 steps (6%)
04:25:19:WU02:FS00:0xa7:Completed 96250 out of 125000 steps (77%)
04:25:29:WU01:FS02:0x22:Completed 140000 out of 2000000 steps (7%)
04:26:36:WU01:FS02:0x22:Completed 160000 out of 2000000 steps (8%)
04:26:46:WU02:FS00:0xa7:Completed 97500 out of 125000 steps (78%)
04:27:45:WU01:FS02:0x22:Completed 180000 out of 2000000 steps (9%)
04:28:20:WU02:FS00:0xa7:Completed 98750 out of 125000 steps (79%)
04:28:53:WU01:FS02:0x22:Completed 200000 out of 2000000 steps (10%)
04:28:54:WU01:FS02:0x22:Checkpoint completed at step 200000
04:29:48:WU02:FS00:0xa7:Completed 100000 out of 125000 steps (80%)
04:30:01:WU01:FS02:0x22:Completed 220000 out of 2000000 steps (11%)
04:31:06:WU02:FS00:0xa7:Completed 101250 out of 125000 steps (81%)
04:31:06:WU01:FS02:0x22:Completed 240000 out of 2000000 steps (12%)
04:32:12:WU01:FS02:0x22:Completed 260000 out of 2000000 steps (13%)
04:32:27:WU02:FS00:0xa7:Completed 102500 out of 125000 steps (82%)
04:32:29:WU00:FS01:0x22:Completed 3550000 out of 5000000 steps (71%)
04:33:18:WU01:FS02:0x22:Completed 280000 out of 2000000 steps (14%)
04:33:46:WU02:FS00:0xa7:Completed 103750 out of 125000 steps (83%)
04:34:24:WU01:FS02:0x22:Completed 300000 out of 2000000 steps (15%)
04:34:25:WU01:FS02:0x22:Checkpoint completed at step 300000
04:35:06:WU02:FS00:0xa7:Completed 105000 out of 125000 steps (84%)
04:35:31:WU01:FS02:0x22:Completed 320000 out of 2000000 steps (16%)
04:36:24:WU02:FS00:0xa7:Completed 106250 out of 125000 steps (85%)
04:36:37:WU01:FS02:0x22:Completed 340000 out of 2000000 steps (17%)
04:37:42:WU02:FS00:0xa7:Completed 107500 out of 125000 steps (86%)
04:37:43:WU01:FS02:0x22:Completed 360000 out of 2000000 steps (18%)
04:38:49:WU01:FS02:0x22:Completed 380000 out of 2000000 steps (19%)
04:39:01:WU02:FS00:0xa7:Completed 108750 out of 125000 steps (87%)
04:39:54:WU01:FS02:0x22:Completed 400000 out of 2000000 steps (20%)
04:39:55:WU01:FS02:0x22:Checkpoint completed at step 400000
04:40:20:WU02:FS00:0xa7:Completed 110000 out of 125000 steps (88%)
04:41:02:WU01:FS02:0x22:Completed 420000 out of 2000000 steps (21%)
04:41:39:WU02:FS00:0xa7:Completed 111250 out of 125000 steps (89%)
04:42:09:WU01:FS02:0x22:Completed 440000 out of 2000000 steps (22%)

Re: intermittent black screen

Posted: Thu Oct 22, 2020 8:16 am
by bruce

Code: Select all

02:43:58:Enabled folding slot 00: READY cpu:10
02:43:58:Enabled folding slot 01: READY gpu:0:GK107 [GeForce GTX 650] 812
02:43:58:Enabled folding slot 02: READY gpu:1:TU106 [GeForce RTX 2070] M 6497
It's likely that your M/B runs the PCIe slots at different speeds. Check the board specs and be sure the 2070 is in a fast slot if they're different. The 650 doesn't need data as fast as the 2070 does.

If you configure your CPU slot for 9 threads instead of 10 you might gain a little speed but it will be a tiny change, if any.

Re: intermittent black screen

Posted: Thu Oct 22, 2020 2:52 pm
by bmxjumperc
Cool.
3 x PCIe 3.0 x16 slots (support x16/x0/x4, x8/x8/x4 modes)
https://us.msi.com/Motherboard/MPG-Z390 ... cification
I have the 2070 in the top silver slot and the 650 in the next silver slot. It's probably in x8/x8/x4 mode. I have a USB controller in the last slot.
I actually don't have any performance issues when folding on full that I am concerned about.
Image