Folding Forum

Community driven support forum for Folding@home
https://foldingforum.org/

highland servers 1-4 down

https://foldingforum.org/viewtopic.php?t=41584

Page 1 of 1

highland servers 1-4 down

Posted: Tue Jun 18, 2024 7:45 pm
by jjmiller
The UPenn data center has a network outage. Servers highland1-4 (158.130.118.23-26) are impacted. We're working to get the network re-established now and the servers back online.

Re: highland servers 1-4 down

Posted: Wed Jun 19, 2024 12:08 pm
by jjmiller
The data center and these servers are back online - please let me know if you are experiencing persistent issues!

Re: highland servers 1-4 down

Posted: Mon Jun 24, 2024 2:30 pm
by jjmiller
We're back to outage status again this morning - another issue with the fiber to the data center. The networking team is working to re-establish connection. Core downloads will also fail for the time being as they're housed at the UPenn datacenter.

Re: highland servers 1-4 down

Posted: Mon Jul 01, 2024 1:31 pm
by cgistlaker
I still see errors, is network still not fixed?
13:27:38:W :CON9:DNS lookup failed for assign2.foldingathome.org
13:27:38:E :OUT9:Failed response: CONNECT
13:27:42:E :OUT3:Failed response: EOF

Re: highland servers 1-4 down

Posted: Fri Jul 05, 2024 12:30 pm
by jjmiller
Sorry for the delayed response. I think the highland servers are back on line. To me, this looks to me like it's an issue connecting to the assignment server, assign2, not the work servers. Are you still having this error popping up?

Re: highland servers 1-4 down

Posted: Sun Jul 07, 2024 9:26 am
by cgistlaker
Last time problem was on Friday 05.07.2024. As result only one WU for GPU was completed, after that whole day no WU's were assigned due to connection error.

Re: highland servers 1-4 down

Posted: Sun Jul 07, 2024 4:16 pm
by kmoyer
I've Installed the 8.3.17 client yesterday, 2024-07-06, on one of my systems to test it. Have had intermittent connection issues show up in the logs as well, experiencing a delay in retrieving a work unit on more than one occasion but the client always eventually successfully retrieved one. Behavior I'm not accustomed to with the 7.6.X client. Of the 2 systems I have the system I chose to test on processes fewer work units in a 24 hour period than the other system. The other system had no issues retrieving work units in the same time period, or put another way, exhibited no delays in Work Unit retrieval.

Eventually things got to a point where the 8.3.17 client was perpetually showing a "Downloading" status, across multiple hours before I took resolving steps. The logs showed that it had been hours since the last attempt at retrieving a Work Unit and pausing / unpausing did not result in a log entry indicating a new attempt at retrieval.

Unfortunately I didn't make a copy of the error log. I found that stopping the client completely and restarting it fixed things. However I had 2 error log entries repeated:
- dns lookup failed for cores.foldingathome.org
- Failed response: CONNECT

Note after taking resolving steps, i.e. stopping the client completely and restarting it, I do see this log in addition to the 2 above:
- DNS lookup failed for highland4.seas.upenn.edu

I'm not sure if the 7.6.X client is simply better at handling / recovering from connection issues. Restarting the 8.3.17 client reset things client side allowing it to download a Work Unit. My first 24 hours with the 8.3.17 client does not have it functionally comparing favorably to the 7.6.X client having observed multiple Work Unit retrieval issues. However this may have all been circumstantial. I'll continue to observe things.

I realize the value of the above post is limited and really only serves to convey my first 24 hour experience as I don't have any other data of value. Though it does corroborate behavior that cgistlaker is describing having indicated seeing it as of 05.07.2024 in their post.

Re: highland servers 1-4 down

Posted: Tue Jul 09, 2024 5:33 pm
by jjmiller
Do you still have the full logs from initialization to these errors? I've poked around the servers a bit with our IT folks and we're not seeing anything that should be leading to this.

I have seen similar errors to this on some computers with both CPU and discrete GPUs that I've just initialized folding. In particular, it seems like this DNS error was popping up if the GPU wasn't recognized when FAH-client is started. Stopping the service and restarting it has fixed this in my case.

Re: highland servers 1-4 down

Posted: Sun Jul 14, 2024 2:24 pm
by kmoyer
Apologies for the delay. Yes I do see the logs are still there.

Note I haven't experienced any issues beyond the first 24 hours. It's been clean the rest of the week so looks like just initial bad luck.

I'm taking some log snippets here for brevity:

This represents the extended period where nothing was written to log and the client didn't recover from an attempt to download:

Log file: log-20240707-123601.txt

Code: Select all


06:52:00:I1:WU10:Completed 2500000 out of 2500000 steps (100%)
06:52:00:I1:WU10:Average performance: 52.0482 ns/day
06:52:06:I1:WU10:Checkpoint completed at step 2500000
06:52:07:I1:WU10:Saving result file ..\logfile_01.txt
06:52:07:I1:WU10:Saving result file checkpointIntegrator.xml
06:52:07:I1:WU10:Saving result file checkpointState.xml
06:52:09:I1:WU10:Saving result file positions.xtc
06:52:09:I1:WU10:Saving result file science.log
06:52:09:I1:WU10:Saving result file xtcAtoms.csv.bz2
06:52:09:I1:WU10:Folding@home Core Shutdown: FINISHED_UNIT
06:52:11:I1:WU10:Core returned FINISHED_UNIT (100)
06:52:11:I1:Default:Added new work unit: cpus:1 gpus:gpu:01:00:00
06:52:11:I1:WU10:Uploading WU results
06:52:11:I1:WU11:Requesting WU assignment for user kmoyer team 111065
06:52:11:I1:OUT54:> POST https://huangfolding1.chem.wisc.edu/api/results HTTP/1.1
06:52:14:I1:OUT54:< HTTP/1.1 200 HTTP_OK
06:52:14:I1:WU10:Credited
06:52:26:W :CON55:DNS lookup failed for assign1.foldingathome.org
06:52:26:E :OUT55:Failed response: CONNECT
06:52:26:I1:WU11:Retry #1 in 2 secs
06:52:28:I1:WU11:Requesting WU assignment for user kmoyer team 111065
06:52:28:I1:OUT56:> POST https://assign2.foldingathome.org/api/assign HTTP/1.1
06:52:28:I1:OUT56:< HTTP/1.1 200 HTTP_OK
06:52:28:I1:WU11:Received WU assignment hvapQyot4-M8SbypnQDSI9B3zUr8J-I6eYqzHa1id_0
06:52:28:I1:WU11:Downloading WU
06:52:28:I1:OUT57:> POST https://ds03.scs.illinois.edu/api/assign HTTP/1.1
06:52:32:I1:OUT57:< HTTP/1.1 200 HTTP_OK
06:52:32:I1:WU11:Received WU P19020 R5 C66 G31
06:52:32:I1:Downloading https://cores.foldingathome.org/openmm-core-22/fahcore-22-windows-64bit-release-0.0.20.tar.bz2.crt
06:52:47:W :CON58:DNS lookup failed for cores.foldingathome.org
06:52:47:E :Exception: No response
12:35:50:I1:Clean exit
This is the period of the initial client startup that lead into the log above, Note I've included an extended period as for the first bit i was playing CPU / GPU resource allocation setting in client V8 as they where new to me so it appears a bit rocky but that's my fault.

Log File: log-20240707-000000.txt

Code: Select all


*********************** Log Started 2024-07-06T14:41:18Z ***********************
14:41:18:I1:*********************** Folding@home Client ***********************
14:41:18:I1:    Version: 8.3.17
14:41:18:I1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:41:18:I1:        Org: foldingathome.org
14:41:18:I1:  Copyright: 2023-2024, foldingathome.org
14:41:18:I1:   Homepage: https://foldingathome.org/
14:41:18:I1:    License: GPL-3.0-or-later
14:41:18:I1:        URL: https://v8-3.foldingathome.org/
14:41:18:I1:       Date: Jun 24 2024
14:41:18:I1:       Time: 13:37:05
14:41:18:I1:   Revision: 5c16e77f0d64416eb66fd5be0b9bd1de33e7d1af
14:41:18:I1:     Branch: master
14:41:18:I1:   Compiler: Visual C++
14:41:18:I1:    Options: $( /TP $) /std:c++14 /nologo /EHa /wd4297 /wd4103 /O2
14:41:18:I1:             /Zc:throwingNew /MT
14:41:18:I1:   Platform: win32 10
14:41:18:I1:       Bits: 64
14:41:18:I1:       Mode: Release
14:41:18:I1:       Args: --open-web-control
14:41:18:I1:     Config: C:\ProgramData\FAHClient\config.xml
14:41:18:I1:****************************** CBang ******************************
14:41:18:I1:    Version: 1.7.2
14:41:18:I1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:41:18:I1:        Org: Cauldron Development
14:41:18:I1:  Copyright: Cauldron Development, 2003-2024
14:41:18:I1:   Homepage: https://cauldrondevelopment.com/
14:41:18:I1:    License: LGPL-2.1-or-later
14:41:18:I1:       Date: Jun 24 2024
14:41:18:I1:       Time: 13:29:54
14:41:18:I1:   Revision: 1b05ea96f0ed3043c32b78a66dbf50a9b2002289
14:41:18:I1:     Branch: master
14:41:18:I1:   Compiler: Visual C++
14:41:18:I1:    Options: $( /TP $) /std:c++14 /nologo /EHa /wd4297 /wd4103 /O2
14:41:18:I1:             /Zc:throwingNew /MT
14:41:18:I1:   Platform: win32 10
14:41:18:I1:       Bits: 64
14:41:18:I1:       Mode: Release
14:41:18:I1:***************************** System ******************************
14:41:18:I1:        CPU: 12th Gen Intel(R) Core(TM) i5-12600K
14:41:18:I1:     CPU ID: GenuineIntel Family 6 Model 151 Stepping 2
14:41:18:I1:       CPUs: 12
14:41:18:I1:     Memory: 31.82GiB
14:41:18:I1:Free Memory: 27.52GiB
14:41:18:I1: OS Version: 6.2
14:41:18:I1:Has Battery: false
14:41:18:I1: On Battery: false
14:41:18:I1:   Hostname: KyMelZ690PC
14:41:18:I1: UTC Offset: -4
14:41:18:I1:        PID: 12844
14:41:18:I1:        CWD: C:\ProgramData\FAHClient
14:41:18:I1:       Exec: C:\Program Files\FAHClient\FAHClient.exe
14:41:18:I1:*******************************************************************
14:41:18:I2:<config>
14:41:18:I2:  <!-- User Information -->
14:41:18:I2:  <passkey v='*****'/>
14:41:18:I2:  <team v='111065'/>
14:41:18:I2:  <user v='kmoyer'/>
14:41:18:I2:</config>
14:41:18:I1:Opening Database
14:41:18:I1:Generating RSA key....++++-.................................++++-
14:41:18:I1:F@H ID = Q9MdU-_otltGnH77B_C0tJUFvuvc5J8jjzMeN6XhMag
14:41:18:I3:Loading default group
14:41:18:I3:Loading default resource group
14:41:18:I1:Listening for HTTP on 127.0.0.1:7396
14:41:18:I3:Loaded 0 wus.
14:41:18:I1:Started Windows systray control
14:41:18:I1:OUT1:> GET https://api.foldingathome.org/gpus HTTP/1.1
14:41:19:I1:OUT1:< HTTP/1.1 200 HTTP_OK
14:41:19:I3:gpus = {
14:41:19:I3:  "gpu:01:00:00": {
14:41:19:I3:    "vendor": 4318,
14:41:19:I3:    "type": "nvidia",
14:41:19:I3:    "description": "NVIDIA GeForce RTX 2080 Ti",
14:41:19:I3:    "uuid": "25328500-2c68-d169-67b0-7bdcbc7b32af",
14:41:19:I3:    "opencl": {"platform": 0, "device": 0, "compute": "3.0", "driver": "556.12"},
14:41:19:I3:    "cuda": {"platform": 0, "device": 0, "compute": "7.5", "driver": "12.5"},
14:41:19:I3:    "device": 7687,
14:41:19:I3:    "supported": true
14:41:19:I3:  }
14:41:19:I3:}
14:51:31:I1:Default:Added new work unit: cpus:0 gpus:gpu:01:00:00
14:51:31:I1:WU1:Requesting WU assignment for user kmoyer team 111065
14:51:31:I1:OUT5:> POST https://assign1.foldingathome.org/api/assign HTTP/1.1
14:51:31:I1:OUT5:< HTTP/1.1 200 HTTP_OK
14:51:31:I1:WU1:Received WU assignment wKrqDwe4yLUzUQilCP0URwSTif2HwPiK9-KUMhxYBeA
14:51:31:I1:WU1:Downloading WU
14:51:46:W :CON6:DNS lookup failed for pllwskifah2.mskcc.org
14:51:46:E :OUT6:Failed response: CONNECT
14:51:46:I1:WU1:Retry #1 in 2 secs
14:51:48:I1:WU1:Downloading WU
14:51:48:I1:OUT7:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
14:51:49:I1:OUT7:< HTTP/1.1 200 HTTP_OK
14:51:49:I1:WU1:Received WU P17649 R8 C2 G32
14:51:49:I1:Downloading https://cores.foldingathome.org/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3.tar.bz2.crt
14:51:49:I1:OUT8:> GET https://cores.foldingathome.org/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3.tar.bz2.crt HTTP/1.1
14:51:49:I1:OUT8:< HTTP/1.1 200 OK
14:51:49:I1:Downloading https://cores.foldingathome.org/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3.tar.bz2.sig
14:51:49:I1:OUT9:> GET https://cores.foldingathome.org/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3.tar.bz2.sig HTTP/1.1
14:51:50:I1:OUT9:< HTTP/1.1 200 OK
14:51:50:I1:Downloading https://cores.foldingathome.org/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3.tar.bz2
14:51:50:I1:OUT10:> GET https://cores.foldingathome.org/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3.tar.bz2 HTTP/1.1
14:51:53:I1:OUT10:< HTTP/1.1 200 OK
14:51:53:I1:Core signature valid
14:51:53:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/FahCore_23.exe
14:51:53:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMM.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMAmoeba.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMAmoebaCUDA.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMAmoebaOpenCL.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMAmoebaReference.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMCPU.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMCUDA.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMCudaCompiler.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMDrude.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMDrudeCUDA.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMDrudeOpenCL.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMDrudeReference.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMOpenCL.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMPME.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMRPMD.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMRPMDCUDA.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMRPMDOpenCL.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/OpenMMRPMDReference.dll
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/core-meta.json
14:51:54:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/cufft64_10.dll
14:52:01:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/libcrypto-1_1-x64.dll
14:52:01:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/libssl-1_1-x64.dll
14:52:01:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/msvcp140.dll
14:52:01:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/msvcp140_1.dll
14:52:01:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/msvcp140_2.dll
14:52:01:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/msvcp140_atomic_wait.dll
14:52:01:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/msvcp140_codecvt_ids.dll
14:52:01:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/nvrtc-builtins64_112.dll
14:52:01:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/nvrtc64_112_0.dll
14:52:02:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/vcruntime140.dll
14:52:02:I1:Extracting cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/vcruntime140_1.dll
14:52:02:I3:WU1:Running FahCore: C:\ProgramData\FAHClient\cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/FahCore_23.exe -dir wKrqDwe4yLUzUQilCP0URwSTif2HwPiK9-KUMhxYBeA -suffix 01 -version 8.3.17 -lifeline 12844 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
14:52:02:I3:WU1:Started FahCore on PID 3456
14:52:02:I1:WU1:*********************** Log Started 2024-07-06T14:52:02Z ***********************
14:52:02:I1:WU1:*************************** Core23 Folding@home Core ***************************
14:52:02:I1:WU1:       Core: Core23
14:52:02:I1:WU1:       Type: 0x23
14:52:02:I1:WU1:    Version: 8.0.3
14:52:02:I1:WU1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:52:02:I1:WU1:  Copyright: 2022 foldingathome.org
14:52:02:I1:WU1:   Homepage: https://foldingathome.org/
14:52:02:I1:WU1:       Date: Aug 3 2023
14:52:02:I1:WU1:       Time: 08:39:06
14:52:02:I1:WU1:   Compiler: Visual C++
14:52:02:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
14:52:02:I1:WU1:             -DOPENMM_VERSION="\"8.0.0\""
14:52:02:I1:WU1:   Platform: win32 10
14:52:02:I1:WU1:       Bits: 64
14:52:02:I1:WU1:       Mode: Release
14:52:02:I1:WU1:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
14:52:02:I1:WU1:             <peastman@stanford.edu>
14:52:02:I1:WU1:       Args: -dir wKrqDwe4yLUzUQilCP0URwSTif2HwPiK9-KUMhxYBeA -suffix 01
14:52:02:I1:WU1:             -version 8.3.17 -lifeline 12844 -gpu-vendor nvidia -opencl-platform
14:52:02:I1:WU1:             0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
14:52:02:I1:WU1:************************************ libFAH ************************************
14:52:02:I1:WU1:       Date: Aug 3 2023
14:52:02:I1:WU1:       Time: 08:37:55
14:52:02:I1:WU1:   Compiler: Visual C++
14:52:02:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
14:52:02:I1:WU1:   Platform: win32 10
14:52:02:I1:WU1:       Bits: 64
14:52:02:I1:WU1:       Mode: Release
14:52:02:I1:WU1:************************************ CBang *************************************
14:52:02:I1:WU1:    Version: 1.7.2
14:52:02:I1:WU1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:52:02:I1:WU1:        Org: Cauldron Development LLC
14:52:02:I1:WU1:  Copyright: Cauldron Development LLC, 2003-2023
14:52:02:I1:WU1:   Homepage: https://cauldrondevelopment.com/
14:52:02:I1:WU1:    License: GPL 2+
14:52:02:I1:WU1:       Date: Aug 3 2023
14:52:02:I1:WU1:       Time: 08:37:14
14:52:02:I1:WU1:   Compiler: Visual C++
14:52:02:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
14:52:02:I1:WU1:   Platform: win32 10
14:52:02:I1:WU1:       Bits: 64
14:52:02:I1:WU1:       Mode: Release
14:52:02:I1:WU1:************************************ System ************************************
14:52:02:I1:WU1:        CPU: 12th Gen Intel(R) Core(TM) i5-12600K
14:52:02:I1:WU1:     CPU ID: GenuineIntel Family 6 Model 151 Stepping 2
14:52:02:I1:WU1:       CPUs: 12
14:52:02:I1:WU1:     Memory: 31.82GiB
14:52:02:I1:WU1:Free Memory: 24.97GiB
14:52:02:I1:WU1:    Threads: WINDOWS_THREADS
14:52:02:I1:WU1: OS Version: 6.2
14:52:02:I1:WU1:Has Battery: false
14:52:02:I1:WU1: On Battery: false
14:52:02:I1:WU1: UTC Offset: -4
14:52:02:I1:WU1:        PID: 3456
14:52:02:I1:WU1:        CWD: C:\ProgramData\FAHClient\work
14:52:02:I1:WU1:       Exec: C:\ProgramData\FAHClient\cores\openmm-core-23\windows-10-64bit\release\fahcore-23-windows-10-64bit-release-8.0.3\FahCore_23.exe
14:52:02:I1:WU1:************************************ OpenMM ************************************
14:52:02:I1:WU1:    Version: 8.0.0
14:52:02:I1:WU1:********************************************************************************
14:52:02:I1:WU1:Project: 17649 (Run 8, Clone 2, Gen 32)
14:52:02:I1:WU1:Reading tar file core.xml
14:52:02:I1:WU1:Reading tar file integrator.xml.bz2
14:52:02:I1:WU1:Reading tar file state.xml.bz2
14:52:02:I1:WU1:Reading tar file system.xml.bz2
14:52:02:I1:WU1:Digital signatures verified
14:52:02:I1:WU1:Folding@home GPU Core23 Folding@home Core
14:52:02:I1:WU1:Version 8.0.3
14:52:02:I1:WU1:  Checkpoint write interval: 125000 steps (5%) [20 total]
14:52:02:I1:WU1:  JSON viewer frame write interval: 25000 steps (1%) [100 total]
14:52:02:I1:WU1:  XTC frame write interval: 12500 steps (0.5%) [200 total]
14:52:02:I1:WU1:  Global context and integrator variables write interval: disabled
14:52:02:I1:WU1:There are 4 platforms available.
14:52:02:I1:WU1:Platform 0: Reference
14:52:02:I1:WU1:Platform 1: CPU
14:52:02:I1:WU1:Platform 2: OpenCL
14:52:02:I1:WU1:  opencl-device 0 specified
14:52:02:I1:WU1:Platform 3: CUDA
14:52:02:I1:WU1:  cuda-device 0 specified
14:52:05:I1:WU1:Attempting to create CUDA context:
14:52:05:I1:WU1:  Configuring platform CUDA
14:52:07:I1:WU1:  Using CUDA on CUDA Platform and gpu 0
14:52:07:I1:WU1:  GPU info: Platform: CUDA
14:52:07:I1:WU1:  GPU info: PlatformIndex: 0
14:52:07:I1:WU1:  GPU info: Device: NVIDIA GeForce RTX 2080 Ti
14:52:07:I1:WU1:  GPU info: DeviceIndex: 0
14:52:07:I1:WU1:  GPU info: Vendor: 0x10de
14:52:07:I1:WU1:  GPU info: PCI: 01:00:00
14:52:07:I1:WU1:  GPU info: Compute: 7.5
14:52:07:I1:WU1:  GPU info: Driver: 12.5
14:52:07:I1:WU1:  GPU info: GPU: true
14:52:07:I1:WU1:Completed 0 out of 2500000 steps (0%)
14:52:07:I1:WU1:Checkpoint completed at step 0
14:52:30:I1:WU1:Completed 25000 out of 2500000 steps (1%)
14:52:54:I1:WU1:Completed 50000 out of 2500000 steps (2%)
14:53:17:I1:WU1:Completed 75000 out of 2500000 steps (3%)
14:53:41:I1:WU1:Completed 100000 out of 2500000 steps (4%)
14:54:05:I1:WU1:Completed 125000 out of 2500000 steps (5%)
14:54:05:I1:WU1:Checkpoint completed at step 125000
14:54:21:W :CON12:DNS lookup failed for api.foldingathome.org
14:54:21:E :OUT12:Failed response: CONNECT
14:54:29:I1:WU1:Completed 150000 out of 2500000 steps (6%)
14:54:36:I1:OUT13:> PUT https://api.foldingathome.org/machine/Q9MdU-_otltGnH77B_C0tJUFvuvc5J8jjzMeN6XhMag HTTP/1.1
14:54:37:I1:OUT13:< HTTP/1.1 200 HTTP_OK
14:54:37:I1:Account linked
14:54:37:I1:OUT14:> GET https://api.foldingathome.org/machine/Q9MdU-_otltGnH77B_C0tJUFvuvc5J8jjzMeN6XhMag HTTP/1.1
14:54:38:I1:OUT14:< HTTP/1.1 200 HTTP_OK
14:54:38:I1:OUT15:> GET wss://node1.foldingathome.org/ws/client HTTP/1.1
14:54:38:I1:OUT15:< HTTP/1.1 101 HTTP_SWITCHING_PROTOCOLS
14:54:38:I1:Logging into node account
14:54:54:I1:WU1:Completed 175000 out of 2500000 steps (7%)
14:55:18:I1:WU1:Completed 200000 out of 2500000 steps (8%)
14:55:42:I1:WU1:Completed 225000 out of 2500000 steps (9%)
14:56:06:I1:WU1:Completed 250000 out of 2500000 steps (10%)
14:56:06:I1:WU1:Checkpoint completed at step 250000
14:56:30:I1:WU1:Completed 275000 out of 2500000 steps (11%)
14:56:54:I1:WU1:Completed 300000 out of 2500000 steps (12%)
14:57:05:I1:Default:Added new work unit: cpus:1 gpus:
14:57:05:I1:WU2:Requesting WU assignment for user kmoyer team 111065
14:57:05:I1:WU1:WARNING:Console control signal 1 on PID 3456
14:57:05:I1:WU1:Exiting, please wait. . .
14:57:05:I1:WU1:Folding@home Core Shutdown: INTERRUPTED
14:57:06:I1:WU1:Core returned INTERRUPTED (102)
14:57:06:I3:WU1:Running FahCore: C:\ProgramData\FAHClient\cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/FahCore_23.exe -dir wKrqDwe4yLUzUQilCP0URwSTif2HwPiK9-KUMhxYBeA -suffix 01 -version 8.3.17 -lifeline 12844 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
14:57:06:I3:WU1:Started FahCore on PID 15660
14:57:06:I1:WU1:*********************** Log Started 2024-07-06T14:57:06Z ***********************
14:57:06:I1:WU1:*************************** Core23 Folding@home Core ***************************
14:57:06:I1:WU1:       Core: Core23
14:57:06:I1:WU1:       Type: 0x23
14:57:06:I1:WU1:    Version: 8.0.3
14:57:06:I1:WU1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:57:06:I1:WU1:  Copyright: 2022 foldingathome.org
14:57:06:I1:WU1:   Homepage: https://foldingathome.org/
14:57:06:I1:WU1:       Date: Aug 3 2023
14:57:06:I1:WU1:       Time: 08:39:06
14:57:06:I1:WU1:   Compiler: Visual C++
14:57:06:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
14:57:06:I1:WU1:             -DOPENMM_VERSION="\"8.0.0\""
14:57:06:I1:WU1:   Platform: win32 10
14:57:06:I1:WU1:       Bits: 64
14:57:06:I1:WU1:       Mode: Release
14:57:06:I1:WU1:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
14:57:06:I1:WU1:             <peastman@stanford.edu>
14:57:06:I1:WU1:       Args: -dir wKrqDwe4yLUzUQilCP0URwSTif2HwPiK9-KUMhxYBeA -suffix 01
14:57:06:I1:WU1:             -version 8.3.17 -lifeline 12844 -gpu-vendor nvidia -opencl-platform
14:57:06:I1:WU1:             0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
14:57:06:I1:WU1:************************************ libFAH ************************************
14:57:06:I1:WU1:       Date: Aug 3 2023
14:57:06:I1:WU1:       Time: 08:37:55
14:57:06:I1:WU1:   Compiler: Visual C++
14:57:06:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
14:57:06:I1:WU1:   Platform: win32 10
14:57:06:I1:WU1:       Bits: 64
14:57:06:I1:WU1:       Mode: Release
14:57:06:I1:WU1:************************************ CBang *************************************
14:57:06:I1:WU1:    Version: 1.7.2
14:57:06:I1:WU1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:57:06:I1:WU1:        Org: Cauldron Development LLC
14:57:06:I1:WU1:  Copyright: Cauldron Development LLC, 2003-2023
14:57:06:I1:WU1:   Homepage: https://cauldrondevelopment.com/
14:57:06:I1:WU1:    License: GPL 2+
14:57:06:I1:WU1:       Date: Aug 3 2023
14:57:06:I1:WU1:       Time: 08:37:14
14:57:06:I1:WU1:   Compiler: Visual C++
14:57:06:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
14:57:06:I1:WU1:   Platform: win32 10
14:57:06:I1:WU1:       Bits: 64
14:57:06:I1:WU1:       Mode: Release
14:57:06:I1:WU1:************************************ System ************************************
14:57:06:I1:WU1:        CPU: 12th Gen Intel(R) Core(TM) i5-12600K
14:57:06:I1:WU1:     CPU ID: GenuineIntel Family 6 Model 151 Stepping 2
14:57:06:I1:WU1:       CPUs: 12
14:57:06:I1:WU1:     Memory: 31.82GiB
14:57:06:I1:WU1:Free Memory: 24.82GiB
14:57:06:I1:WU1:    Threads: WINDOWS_THREADS
14:57:06:I1:WU1: OS Version: 6.2
14:57:06:I1:WU1:Has Battery: false
14:57:06:I1:WU1: On Battery: false
14:57:06:I1:WU1: UTC Offset: -4
14:57:06:I1:WU1:        PID: 15660
14:57:06:I1:WU1:        CWD: C:\ProgramData\FAHClient\work
14:57:06:I1:WU1:       Exec: C:\ProgramData\FAHClient\cores\openmm-core-23\windows-10-64bit\release\fahcore-23-windows-10-64bit-release-8.0.3\FahCore_23.exe
14:57:06:I1:WU1:************************************ OpenMM ************************************
14:57:06:I1:WU1:    Version: 8.0.0
14:57:06:I1:WU1:********************************************************************************
14:57:06:I1:WU1:Project: 17649 (Run 8, Clone 2, Gen 32)
14:57:06:I1:WU1:Digital signatures verified
14:57:06:I1:WU1:Folding@home GPU Core23 Folding@home Core
14:57:06:I1:WU1:Version 8.0.3
14:57:06:I1:WU1:  Checkpoint write interval: 125000 steps (5%) [20 total]
14:57:06:I1:WU1:  JSON viewer frame write interval: 25000 steps (1%) [100 total]
14:57:06:I1:WU1:  XTC frame write interval: 12500 steps (0.5%) [200 total]
14:57:06:I1:WU1:  Global context and integrator variables write interval: disabled
14:57:06:I1:WU1:There are 4 platforms available.
14:57:06:I1:WU1:Platform 0: Reference
14:57:06:I1:WU1:Platform 1: CPU
14:57:06:I1:WU1:Platform 2: OpenCL
14:57:06:I1:WU1:  opencl-device 0 specified
14:57:06:I1:WU1:Platform 3: CUDA
14:57:06:I1:WU1:  cuda-device 0 specified
14:57:09:I1:WU1:Attempting to create CUDA context:
14:57:09:I1:WU1:  Configuring platform CUDA
14:57:10:I1:WU1:  Using CUDA on CUDA Platform and gpu 0
14:57:10:I1:WU1:  GPU info: Platform: CUDA
14:57:10:I1:WU1:  GPU info: PlatformIndex: 0
14:57:10:I1:WU1:  GPU info: Device: NVIDIA GeForce RTX 2080 Ti
14:57:10:I1:WU1:  GPU info: DeviceIndex: 0
14:57:10:I1:WU1:  GPU info: Vendor: 0x10de
14:57:10:I1:WU1:  GPU info: PCI: 01:00:00
14:57:10:I1:WU1:  GPU info: Compute: 7.5
14:57:10:I1:WU1:  GPU info: Driver: 12.5
14:57:10:I1:WU1:  GPU info: GPU: true
14:57:10:I1:WU1:Completed 250000 out of 2500000 steps (10%)
14:57:20:W :CON16:DNS lookup failed for assign2.foldingathome.org
14:57:20:E :OUT16:Failed response: CONNECT
14:57:20:I1:WU2:Retry #1 in 2 secs
14:57:22:I1:WU2:Requesting WU assignment for user kmoyer team 111065
14:57:22:I1:OUT17:> POST https://assign3.foldingathome.org/api/assign HTTP/1.1
14:57:22:I1:OUT17:< HTTP/1.1 200 HTTP_OK
14:57:22:I1:WU2:Received WU assignment gtPeAHBSrnXzjZ3PJHhGo6EUZpLNQrGeA8SS4wfnKGc
14:57:22:I1:WU2:Downloading WU
14:57:22:I1:OUT18:> POST https://vav19.fah.temple.edu/api/assign HTTP/1.1
14:57:23:I1:OUT18:< HTTP/1.1 200 HTTP_OK
14:57:23:I1:WU2:Received WU P18428 R26 C58 G259
14:57:23:I1:Downloading https://cores.foldingathome.org/fahcore-a8-win-64bit-avx2_256-0.0.12.tar.bz2.crt
14:57:34:I1:WU1:Completed 275000 out of 2500000 steps (11%)
14:57:38:W :CON19:DNS lookup failed for cores.foldingathome.org
14:57:38:E :Exception: No response
14:57:58:I1:WU1:Completed 300000 out of 2500000 steps (12%)
14:58:22:I1:WU1:Completed 325000 out of 2500000 steps (13%)
14:58:46:I1:WU1:Completed 350000 out of 2500000 steps (14%)
14:59:10:I1:WU1:Completed 375000 out of 2500000 steps (15%)
14:59:10:I1:WU1:Checkpoint completed at step 375000
14:59:34:I1:WU1:Completed 400000 out of 2500000 steps (16%)
14:59:58:I1:WU1:Completed 425000 out of 2500000 steps (17%)
15:00:23:I1:WU1:Completed 450000 out of 2500000 steps (18%)
15:00:47:I1:WU1:Completed 475000 out of 2500000 steps (19%)
15:01:11:I1:WU1:Completed 500000 out of 2500000 steps (20%)
15:01:11:I1:WU1:Checkpoint completed at step 500000
15:01:13:I1:WU1:An exception occurred at step 502343: Error invoking kernel: CUDA_ERROR_LAUNCH_FAILED (719)
15:01:13:I1:WU1:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
15:01:13:I1:WU1:Folding@home Core Shutdown: CORE_RESTART
15:01:16:W :WU1:Core returned UNKNOWN_ENUM (3221226505)
15:01:16:W :WU1:Core exited with Windows unhandled exception code 0xc0000409.  See https://bit.ly/2CXgWkZ for more information.
15:01:16:I1:WU1:Retry #1 in 2 secs
15:01:18:I3:WU1:Running FahCore: C:\ProgramData\FAHClient\cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/FahCore_23.exe -dir wKrqDwe4yLUzUQilCP0URwSTif2HwPiK9-KUMhxYBeA -suffix 01 -version 8.3.17 -lifeline 12844 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
15:01:18:I3:WU1:Started FahCore on PID 14004
15:01:18:I1:WU1:*********************** Log Started 2024-07-06T15:01:18Z ***********************
15:01:18:I1:WU1:*************************** Core23 Folding@home Core ***************************
15:01:18:I1:WU1:       Core: Core23
15:01:18:I1:WU1:       Type: 0x23
15:01:18:I1:WU1:    Version: 8.0.3
15:01:18:I1:WU1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:01:18:I1:WU1:  Copyright: 2022 foldingathome.org
15:01:18:I1:WU1:   Homepage: https://foldingathome.org/
15:01:18:I1:WU1:       Date: Aug 3 2023
15:01:18:I1:WU1:       Time: 08:39:06
15:01:18:I1:WU1:   Compiler: Visual C++
15:01:18:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:01:18:I1:WU1:             -DOPENMM_VERSION="\"8.0.0\""
15:01:18:I1:WU1:   Platform: win32 10
15:01:18:I1:WU1:       Bits: 64
15:01:18:I1:WU1:       Mode: Release
15:01:18:I1:WU1:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
15:01:18:I1:WU1:             <peastman@stanford.edu>
15:01:18:I1:WU1:       Args: -dir wKrqDwe4yLUzUQilCP0URwSTif2HwPiK9-KUMhxYBeA -suffix 01
15:01:18:I1:WU1:             -version 8.3.17 -lifeline 12844 -gpu-vendor nvidia -opencl-platform
15:01:18:I1:WU1:             0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
15:01:18:I1:WU1:************************************ libFAH ************************************
15:01:18:I1:WU1:       Date: Aug 3 2023
15:01:18:I1:WU1:       Time: 08:37:55
15:01:18:I1:WU1:   Compiler: Visual C++
15:01:18:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:01:18:I1:WU1:   Platform: win32 10
15:01:18:I1:WU1:       Bits: 64
15:01:18:I1:WU1:       Mode: Release
15:01:18:I1:WU1:************************************ CBang *************************************
15:01:18:I1:WU1:    Version: 1.7.2
15:01:18:I1:WU1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:01:18:I1:WU1:        Org: Cauldron Development LLC
15:01:18:I1:WU1:  Copyright: Cauldron Development LLC, 2003-2023
15:01:18:I1:WU1:   Homepage: https://cauldrondevelopment.com/
15:01:18:I1:WU1:    License: GPL 2+
15:01:18:I1:WU1:       Date: Aug 3 2023
15:01:18:I1:WU1:       Time: 08:37:14
15:01:18:I1:WU1:   Compiler: Visual C++
15:01:18:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:01:18:I1:WU1:   Platform: win32 10
15:01:18:I1:WU1:       Bits: 64
15:01:18:I1:WU1:       Mode: Release
15:01:18:I1:WU1:************************************ System ************************************
15:01:18:I1:WU1:        CPU: 12th Gen Intel(R) Core(TM) i5-12600K
15:01:18:I1:WU1:     CPU ID: GenuineIntel Family 6 Model 151 Stepping 2
15:01:18:I1:WU1:       CPUs: 12
15:01:18:I1:WU1:     Memory: 31.82GiB
15:01:18:I1:WU1:Free Memory: 25.07GiB
15:01:18:I1:WU1:    Threads: WINDOWS_THREADS
15:01:18:I1:WU1: OS Version: 6.2
15:01:18:I1:WU1:Has Battery: false
15:01:18:I1:WU1: On Battery: false
15:01:18:I1:WU1: UTC Offset: -4
15:01:18:I1:WU1:        PID: 14004
15:01:18:I1:WU1:        CWD: C:\ProgramData\FAHClient\work
15:01:18:I1:WU1:       Exec: C:\ProgramData\FAHClient\cores\openmm-core-23\windows-10-64bit\release\fahcore-23-windows-10-64bit-release-8.0.3\FahCore_23.exe
15:01:18:I1:WU1:************************************ OpenMM ************************************
15:01:18:I1:WU1:    Version: 8.0.0
15:01:18:I1:WU1:********************************************************************************
15:01:18:I1:WU1:Project: 17649 (Run 8, Clone 2, Gen 32)
15:01:18:I1:WU1:Digital signatures verified
15:01:18:I1:WU1:Folding@home GPU Core23 Folding@home Core
15:01:18:I1:WU1:Version 8.0.3
15:01:18:I1:WU1:  Checkpoint write interval: 125000 steps (5%) [20 total]
15:01:18:I1:WU1:  JSON viewer frame write interval: 25000 steps (1%) [100 total]
15:01:18:I1:WU1:  XTC frame write interval: 12500 steps (0.5%) [200 total]
15:01:18:I1:WU1:  Global context and integrator variables write interval: disabled
15:01:18:I1:WU1:There are 4 platforms available.
15:01:18:I1:WU1:Platform 0: Reference
15:01:18:I1:WU1:Platform 1: CPU
15:01:18:I1:WU1:Platform 2: OpenCL
15:01:18:I1:WU1:  opencl-device 0 specified
15:01:18:I1:WU1:Platform 3: CUDA
15:01:18:I1:WU1:  cuda-device 0 specified
15:01:21:I1:WU1:Attempting to create CUDA context:
15:01:21:I1:WU1:  Configuring platform CUDA
15:01:22:I1:WU1:  Using CUDA on CUDA Platform and gpu 0
15:01:22:I1:WU1:  GPU info: Platform: CUDA
15:01:22:I1:WU1:  GPU info: PlatformIndex: 0
15:01:22:I1:WU1:  GPU info: Device: NVIDIA GeForce RTX 2080 Ti
15:01:22:I1:WU1:  GPU info: DeviceIndex: 0
15:01:22:I1:WU1:  GPU info: Vendor: 0x10de
15:01:22:I1:WU1:  GPU info: PCI: 01:00:00
15:01:22:I1:WU1:  GPU info: Compute: 7.5
15:01:22:I1:WU1:  GPU info: Driver: 12.5
15:01:22:I1:WU1:  GPU info: GPU: true
15:01:22:I1:WU1:Completed 500000 out of 2500000 steps (20%)
15:01:46:I1:WU1:Completed 525000 out of 2500000 steps (21%)
15:02:10:I1:WU1:Completed 550000 out of 2500000 steps (22%)
15:02:34:I1:WU1:Completed 575000 out of 2500000 steps (23%)
15:02:58:I1:WU1:Completed 600000 out of 2500000 steps (24%)
15:03:22:I1:WU1:Completed 625000 out of 2500000 steps (25%)
15:03:22:I1:WU1:Checkpoint completed at step 625000
15:03:38:I1:WU1:WARNING:Console control signal 1 on PID 14004
15:03:38:I1:WU1:Exiting, please wait. . .
15:03:38:I1:WU1:Folding@home Core Shutdown: INTERRUPTED
15:03:38:I1:WU1:Core returned INTERRUPTED (102)
15:03:38:I3:WU1:Running FahCore: C:\ProgramData\FAHClient\cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/FahCore_23.exe -dir wKrqDwe4yLUzUQilCP0URwSTif2HwPiK9-KUMhxYBeA -suffix 01 -version 8.3.17 -lifeline 12844 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
15:03:38:I3:WU1:Started FahCore on PID 12216
15:03:39:I1:WU1:*********************** Log Started 2024-07-06T15:03:38Z ***********************
15:03:39:I1:WU1:*************************** Core23 Folding@home Core ***************************
15:03:39:I1:WU1:       Core: Core23
15:03:39:I1:WU1:       Type: 0x23
15:03:39:I1:WU1:    Version: 8.0.3
15:03:39:I1:WU1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:03:39:I1:WU1:  Copyright: 2022 foldingathome.org
15:03:39:I1:WU1:   Homepage: https://foldingathome.org/
15:03:39:I1:WU1:       Date: Aug 3 2023
15:03:39:I1:WU1:       Time: 08:39:06
15:03:39:I1:WU1:   Compiler: Visual C++
15:03:39:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:03:39:I1:WU1:             -DOPENMM_VERSION="\"8.0.0\""
15:03:39:I1:WU1:   Platform: win32 10
15:03:39:I1:WU1:       Bits: 64
15:03:39:I1:WU1:       Mode: Release
15:03:39:I1:WU1:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
15:03:39:I1:WU1:             <peastman@stanford.edu>
15:03:39:I1:WU1:       Args: -dir wKrqDwe4yLUzUQilCP0URwSTif2HwPiK9-KUMhxYBeA -suffix 01
15:03:39:I1:WU1:             -version 8.3.17 -lifeline 12844 -gpu-vendor nvidia -opencl-platform
15:03:39:I1:WU1:             0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
15:03:39:I1:WU1:************************************ libFAH ************************************
15:03:39:I1:WU1:       Date: Aug 3 2023
15:03:39:I1:WU1:       Time: 08:37:55
15:03:39:I1:WU1:   Compiler: Visual C++
15:03:39:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:03:39:I1:WU1:   Platform: win32 10
15:03:39:I1:WU1:       Bits: 64
15:03:39:I1:WU1:       Mode: Release
15:03:39:I1:WU1:************************************ CBang *************************************
15:03:39:I1:WU1:    Version: 1.7.2
15:03:39:I1:WU1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:03:39:I1:WU1:        Org: Cauldron Development LLC
15:03:39:I1:WU1:  Copyright: Cauldron Development LLC, 2003-2023
15:03:39:I1:WU1:   Homepage: https://cauldrondevelopment.com/
15:03:39:I1:WU1:    License: GPL 2+
15:03:39:I1:WU1:       Date: Aug 3 2023
15:03:39:I1:WU1:       Time: 08:37:14
15:03:39:I1:WU1:   Compiler: Visual C++
15:03:39:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:03:39:I1:WU1:   Platform: win32 10
15:03:39:I1:WU1:       Bits: 64
15:03:39:I1:WU1:       Mode: Release
15:03:39:I1:WU1:************************************ System ************************************
15:03:39:I1:WU1:        CPU: 12th Gen Intel(R) Core(TM) i5-12600K
15:03:39:I1:WU1:     CPU ID: GenuineIntel Family 6 Model 151 Stepping 2
15:03:39:I1:WU1:       CPUs: 12
15:03:39:I1:WU1:     Memory: 31.82GiB
15:03:39:I1:WU1:Free Memory: 25.05GiB
15:03:39:I1:WU1:    Threads: WINDOWS_THREADS
15:03:39:I1:WU1: OS Version: 6.2
15:03:39:I1:WU1:Has Battery: false
15:03:39:I1:WU1: On Battery: false
15:03:39:I1:WU1: UTC Offset: -4
15:03:39:I1:WU1:        PID: 12216
15:03:39:I1:WU1:        CWD: C:\ProgramData\FAHClient\work
15:03:39:I1:WU1:       Exec: C:\ProgramData\FAHClient\cores\openmm-core-23\windows-10-64bit\release\fahcore-23-windows-10-64bit-release-8.0.3\FahCore_23.exe
15:03:39:I1:WU1:************************************ OpenMM ************************************
15:03:39:I1:WU1:    Version: 8.0.0
15:03:39:I1:WU1:********************************************************************************
15:03:39:I1:WU1:Project: 17649 (Run 8, Clone 2, Gen 32)
15:03:39:I1:WU1:Digital signatures verified
15:03:39:I1:WU1:Folding@home GPU Core23 Folding@home Core
15:03:39:I1:WU1:Version 8.0.3
15:03:39:I1:WU1:  Checkpoint write interval: 125000 steps (5%) [20 total]
15:03:39:I1:WU1:  JSON viewer frame write interval: 25000 steps (1%) [100 total]
15:03:39:I1:WU1:  XTC frame write interval: 12500 steps (0.5%) [200 total]
15:03:39:I1:WU1:  Global context and integrator variables write interval: disabled
15:03:39:I1:WU1:There are 4 platforms available.
15:03:39:I1:WU1:Platform 0: Reference
15:03:39:I1:WU1:Platform 1: CPU
15:03:39:I1:WU1:Platform 2: OpenCL
15:03:39:I1:WU1:  opencl-device 0 specified
15:03:39:I1:WU1:Platform 3: CUDA
15:03:39:I1:WU1:  cuda-device 0 specified
15:03:41:I1:WU1:Attempting to create CUDA context:
15:03:41:I1:WU1:  Configuring platform CUDA
15:03:42:I1:WU1:  Using CUDA on CUDA Platform and gpu 0
15:03:42:I1:WU1:  GPU info: Platform: CUDA
15:03:42:I1:WU1:  GPU info: PlatformIndex: 0
15:03:42:I1:WU1:  GPU info: Device: NVIDIA GeForce RTX 2080 Ti
15:03:42:I1:WU1:  GPU info: DeviceIndex: 0
15:03:42:I1:WU1:  GPU info: Vendor: 0x10de
15:03:42:I1:WU1:  GPU info: PCI: 01:00:00
15:03:42:I1:WU1:  GPU info: Compute: 7.5
15:03:42:I1:WU1:  GPU info: Driver: 12.5
15:03:42:I1:WU1:  GPU info: GPU: true
15:03:42:I1:WU1:Completed 625000 out of 2500000 steps (25%)
15:04:06:I1:WU1:Completed 650000 out of 2500000 steps (26%)
15:04:17:I1:WU1:WARNING:Console control signal 1 on PID 12216
15:04:17:I1:WU1:Exiting, please wait. . .
15:04:17:I1:WU1:Folding@home Core Shutdown: INTERRUPTED
15:04:18:I1:WU1:Core returned INTERRUPTED (102)
15:04:18:I3:WU1:Running FahCore: C:\ProgramData\FAHClient\cores/openmm-core-23/windows-10-64bit/release/fahcore-23-windows-10-64bit-release-8.0.3/FahCore_23.exe -dir wKrqDwe4yLUzUQilCP0URwSTif2HwPiK9-KUMhxYBeA -suffix 01 -version 8.3.17 -lifeline 12844 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
15:04:18:I3:WU1:Started FahCore on PID 772
15:04:18:I1:WU1:*********************** Log Started 2024-07-06T15:04:18Z ***********************
15:04:18:I1:WU1:*************************** Core23 Folding@home Core ***************************
15:04:18:I1:WU1:       Core: Core23
15:04:18:I1:WU1:       Type: 0x23
15:04:18:I1:WU1:    Version: 8.0.3
15:04:18:I1:WU1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:04:18:I1:WU1:  Copyright: 2022 foldingathome.org
15:04:18:I1:WU1:   Homepage: https://foldingathome.org/
15:04:18:I1:WU1:       Date: Aug 3 2023
15:04:18:I1:WU1:       Time: 08:39:06
15:04:18:I1:WU1:   Compiler: Visual C++
15:04:18:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:04:18:I1:WU1:             -DOPENMM_VERSION="\"8.0.0\""
15:04:18:I1:WU1:   Platform: win32 10
15:04:18:I1:WU1:       Bits: 64
15:04:18:I1:WU1:       Mode: Release
15:04:18:I1:WU1:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
15:04:18:I1:WU1:             <peastman@stanford.edu>
15:04:18:I1:WU1:       Args: -dir wKrqDwe4yLUzUQilCP0URwSTif2HwPiK9-KUMhxYBeA -suffix 01
15:04:18:I1:WU1:             -version 8.3.17 -lifeline 12844 -gpu-vendor nvidia -opencl-platform
15:04:18:I1:WU1:             0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
15:04:18:I1:WU1:************************************ libFAH ************************************
15:04:18:I1:WU1:       Date: Aug 3 2023
15:04:18:I1:WU1:       Time: 08:37:55
15:04:18:I1:WU1:   Compiler: Visual C++
15:04:18:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:04:18:I1:WU1:   Platform: win32 10
15:04:18:I1:WU1:       Bits: 64
15:04:18:I1:WU1:       Mode: Release
15:04:18:I1:WU1:************************************ CBang *************************************
15:04:18:I1:WU1:    Version: 1.7.2
15:04:18:I1:WU1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:04:18:I1:WU1:        Org: Cauldron Development LLC
15:04:18:I1:WU1:  Copyright: Cauldron Development LLC, 2003-2023
15:04:18:I1:WU1:   Homepage: https://cauldrondevelopment.com/
15:04:18:I1:WU1:    License: GPL 2+
15:04:18:I1:WU1:       Date: Aug 3 2023
15:04:18:I1:WU1:       Time: 08:37:14
15:04:18:I1:WU1:   Compiler: Visual C++
15:04:18:I1:WU1:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:04:18:I1:WU1:   Platform: win32 10
15:04:18:I1:WU1:       Bits: 64
15:04:18:I1:WU1:       Mode: Release
15:04:18:I1:WU1:************************************ System ************************************
15:04:18:I1:WU1:        CPU: 12th Gen Intel(R) Core(TM) i5-12600K
15:04:18:I1:WU1:     CPU ID: GenuineIntel Family 6 Model 151 Stepping 2
15:04:18:I1:WU1:       CPUs: 12
15:04:18:I1:WU1:     Memory: 31.82GiB
15:04:18:I1:WU1:Free Memory: 25.08GiB
15:04:18:I1:WU1:    Threads: WINDOWS_THREADS
15:04:18:I1:WU1: OS Version: 6.2
15:04:18:I1:WU1:Has Battery: false
15:04:18:I1:WU1: On Battery: false
15:04:18:I1:WU1: UTC Offset: -4
15:04:18:I1:WU1:        PID: 772
15:04:18:I1:WU1:        CWD: C:\ProgramData\FAHClient\work
15:04:18:I1:WU1:       Exec: C:\ProgramData\FAHClient\cores\openmm-core-23\windows-10-64bit\release\fahcore-23-windows-10-64bit-release-8.0.3\FahCore_23.exe
15:04:18:I1:WU1:************************************ OpenMM ************************************
15:04:18:I1:WU1:    Version: 8.0.0
15:04:18:I1:WU1:********************************************************************************
15:04:18:I1:WU1:Project: 17649 (Run 8, Clone 2, Gen 32)
15:04:18:I1:WU1:Digital signatures verified
15:04:18:I1:WU1:Folding@home GPU Core23 Folding@home Core
15:04:18:I1:WU1:Version 8.0.3
15:04:18:I1:WU1:  Checkpoint write interval: 125000 steps (5%) [20 total]
15:04:18:I1:WU1:  JSON viewer frame write interval: 25000 steps (1%) [100 total]
15:04:18:I1:WU1:  XTC frame write interval: 12500 steps (0.5%) [200 total]
15:04:18:I1:WU1:  Global context and integrator variables write interval: disabled
15:04:18:I1:WU1:There are 4 platforms available.
15:04:18:I1:WU1:Platform 0: Reference
15:04:18:I1:WU1:Platform 1: CPU
15:04:18:I1:WU1:Platform 2: OpenCL
15:04:18:I1:WU1:  opencl-device 0 specified
15:04:18:I1:WU1:Platform 3: CUDA
15:04:18:I1:WU1:  cuda-device 0 specified
15:04:21:I1:WU1:Attempting to create CUDA context:
15:04:21:I1:WU1:  Configuring platform CUDA
15:04:22:I1:WU1:  Using CUDA on CUDA Platform and gpu 0
15:04:22:I1:WU1:  GPU info: Platform: CUDA
15:04:22:I1:WU1:  GPU info: PlatformIndex: 0
15:04:22:I1:WU1:  GPU info: Device: NVIDIA GeForce RTX 2080 Ti
15:04:22:I1:WU1:  GPU info: DeviceIndex: 0
15:04:22:I1:WU1:  GPU info: Vendor: 0x10de
15:04:22:I1:WU1:  GPU info: PCI: 01:00:00
15:04:22:I1:WU1:  GPU info: Compute: 7.5
15:04:22:I1:WU1:  GPU info: Driver: 12.5
15:04:22:I1:WU1:  GPU info: GPU: true
15:04:22:I1:WU1:Completed 625000 out of 2500000 steps (25%)
15:04:46:I1:WU1:Completed 650000 out of 2500000 steps (26%)
15:05:10:I1:WU1:Completed 675000 out of 2500000 steps (27%)
15:05:34:I1:WU1:Completed 700000 out of 2500000 steps (28%)
15:05:58:I1:WU1:Completed 725000 out of 2500000 steps (29%)
15:06:23:I1:WU1:Completed 750000 out of 2500000 steps (30%)
The log continues through WU completion and upload.

Thanks.

Re: highland servers 1-4 down

Posted: Thu Jul 18, 2024 12:58 pm
by jjmiller
Thanks! Glad that this was resolved, though a bit unsettling to have a bug potentially lurking around.
All times are UTC
Page 1 of 1

Powered by phpBB® Forum Software © phpBB Limited