Fahcore_23 v8.0.3 project:17116 run:5 clone:470 gen:0 core:0x23 Hangs at 100%

[ElectricVehicle]

Fahcore_23 v8.0.3 Hangs at 100%
project:17116 run:5 clone:470 gen:0 core:0x23

The particularly ugly thing about this core:0x23 hanging is that it disables your folding machine by hanging it. You cannot fold anything until the hung WU is cleared out.

I think there's an issue with Fahcore_23 v8.0.3 core:0x23 . My Nvidia 2070 Super GPU has been folding rock solid for many months, maybe 1+ years, less the occasional PG&E power failure....

project:17116 core:0x23 takes 7 seconds per frame, and completes to 99.9% / 100% and then the FahCore_23.exe process just hangs and never completes, exits or throws an error - just hangs...

The last log line from the core before it hangs forever is:
"06:58:25:WU00:FS01:0x23:Folding@home Core Shutdown: FINISHED_UNIT"

I had this happen to multiple project:17116 core:0x23 WUs. I rebooted and did some investigation on the new Core:0x23. Consequently, on this particular WU, I only waited about 15 minutes before pausing and starting to fold again. This WU failed to restart because prior FahCore_23.exe process never exited (I presume) and still help a lock on the files, preventing it from restarting after clicking "Fold". Even if it did restart, I assume it would again hang forever at the same point. I have a solid 1 Gbps down / 40 Mbps cable internet connection that my two other folding machines were running just fine on. This computer continued to fold perfectly with WUs that did not use FahCore_23 .

Code: Select all

07:14:18:FS01:Paused
07:14:18:FS01:Shutting core down
07:14:19:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
07:14:31:FS01:Unpaused
07:14:31:WU00:FS01:Starting
07:14:31:ERROR:WU00:FS01:Failed to start core: Failed to rename 'work/00/logfile_01.txt' to 'work/00/logfile_01-20230816-071431.txt': The process cannot access the file because it is being used by another process.
07:16:08:WU00:FS01:Starting
07:16:08:ERROR:WU00:FS01:Failed to start core: Failed to rename 'work/00/logfile_01.txt' to 'work/00/logfile_01-20230816-071608.txt': The process cannot access the file because it is being used by another process.

It appears that only 2 projects 17116, and 17114 are using core:0x23:
(Easy way to find them all is to search for "0x23" in the web page)
17116 Benchmark Memorial Sloan Kettering Cancer Center 0x23 50000 1000
17114 Benchmark Memorial Sloan Kettering Cancer Center 0x23 50000 1000
Source: https://folding.lar.systems/projects/

17116 54.157.202.86 50,000 1.00 2.00 1,000 0x23 john.chodera
Source: https://apps.foldingathome.org/psummary

Interesting https://folding.lar.systems/ shows only one of these WUs completed so far by someone with an Nvidia TU104 [GeForce RTX 2060]:
https://folding.lar.systems/projects/fo ... file/17116

I have searched and not been able to find any prior references or issues with the new project:17116 or the new core:0x23 / Fahcore_23 using multiple different search terms beyond their appearance in the project listing pages above.

Looks like the core was compiled on "Date: Aug 3 2023". I don't know exactly when the first WU using core:0x23 was released for folding. It's possible the first WUs were issued today or in the last few days, and certainly within the last two weeks, since the core was compiled less than two weeks ago.

Code: Select all

*********************** Log Started 2023-08-16T06:50:44Z ***********************
06:50:44:******************************* libFAH ********************************
06:50:44:           Date: Oct 20 2020
06:50:44:           Time: 13:36:55
06:50:44:       Revision: 5ca109d295a6245e2a2f590b3d0085ad5e567aeb
06:50:44:         Branch: master
06:50:44:       Compiler: Visual C++ 2015
06:50:44:        Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
06:50:44:       Platform: win32 10
06:50:44:           Bits: 32
06:50:44:           Mode: Release
06:50:44:****************************** FAHClient ******************************
06:50:44:        Version: 7.6.21
06:50:44:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
06:50:44:      Copyright: 2020 foldingathome.org
06:50:44:       Homepage: https://foldingathome.org/
06:50:44:           Date: Oct 20 2020
06:50:44:           Time: 13:41:04
06:50:44:       Revision: 6efbf0e138e22d3963e6a291f78dcb9c6422a278
06:50:44:         Branch: master
06:50:44:       Compiler: Visual C++ 2015
06:50:44:        Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
06:50:44:       Platform: win32 10
06:50:44:           Bits: 32
06:50:44:           Mode: Release
06:50:44:           Args: --open-web-control
06:50:44:         Config: C:\Users\MikHexa\AppData\Roaming\FAHClient\config.xml
06:50:44:******************************** CBang ********************************
06:50:44:           Date: Oct 20 2020
06:50:44:           Time: 11:36:18
06:50:44:       Revision: 7e4ce85225d7eaeb775e87c31740181ca603de60
06:50:44:         Branch: master
06:50:44:       Compiler: Visual C++ 2015
06:50:44:        Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
06:50:44:       Platform: win32 10
06:50:44:           Bits: 32
06:50:44:           Mode: Release
06:50:44:******************************* System ********************************
06:50:44:            CPU: Intel(R) Core(TM) i7 CPU X 980 @ 3.33GHz
06:50:44:         CPU ID: GenuineIntel Family 6 Model 44 Stepping 2
06:50:44:           CPUs: 12
06:50:44:         Memory: 11.99GiB
06:50:44:    Free Memory: 9.80GiB
06:50:44:        Threads: WINDOWS_THREADS
06:50:44:     OS Version: 6.1
06:50:44:    Has Battery: false
06:50:44:     On Battery: false
06:50:44:     UTC Offset: -7
06:50:44:            PID: 6708
06:50:44:            CWD: C:\Users\MikHexa\AppData\Roaming\FAHClient
06:50:44:  Win32 Service: false
06:50:44:             OS: Windows 7 Ultimate
06:50:44:        OS Arch: AMD64
06:50:44:           GPUs: 1
06:50:44:          GPU 0: Bus:3 Slot:0 Func:0 NVIDIA:8 TU104 [GeForce RTX 2070 SUPER]
06:50:44:                 8218
06:50:44:  CUDA Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:7.5 Driver:11.4
06:50:44:OpenCL Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:3.0 Driver:472.12
06:50:44:***********************************************************************
06:50:44:<config>
06:50:44:  <!-- Folding Slot Configuration -->
06:50:44:  <cause v='COVID_19'/>
06:50:44:
06:50:44:  <!-- HTTP Server -->
06:50:44:  <allow v='127.0.0.1 192.168.168.153 192.168.168.174 192.168.168.213'/>
06:50:44:
06:50:44:  <!-- Network -->
06:50:44:  <proxy v=':8080'/>
06:50:44:
06:50:44:  <!-- Remote Command Server -->
06:50:44:  <password v='*****'/>
06:50:44:
06:50:44:  <!-- Slot Control -->
06:50:44:  <power v='full'/>
06:50:44:
06:50:44:  <!-- User Information -->
06:50:44:  <passkey v='*****'/>
06:50:44:  <team v='104636'/>
06:50:44:  <user v='[EV]Tesla'/>
06:50:44:
06:50:44:  <!-- Folding Slots -->
06:50:44:  <slot id='1' type='GPU'>
06:50:44:    <paused v='true'/>
06:50:44:    <pci-bus v='3'/>
06:50:44:    <pci-slot v='0'/>
06:50:44:  </slot>
06:50:44:</config>
06:50:44:Trying to access database...
06:50:44:Successfully acquired database lock
06:50:44:FS01:Initialized folding slot 01: gpu:3:0 TU104 [GeForce RTX 2070 SUPER] 8218
06:50:44:Set client configured
06:50:57:18:127.0.0.1:New Web session
06:51:13:FS01:Unpaused
06:51:13:WU00:FS01:Connecting to assign1.foldingathome.org:80
06:51:14:WU00:FS01:Connecting to assign1.foldingathome.org:80
06:51:14:WU00:FS01:Assigned to work server 54.157.202.86
06:51:14:WU00:FS01:Requesting new work unit for slot 01: gpu:3:0 TU104 [GeForce RTX 2070 SUPER] 8218 from 54.157.202.86
06:51:14:WU00:FS01:Connecting to 54.157.202.86:8080
06:51:15:WU00:FS01:Downloading 7.41MiB
06:51:18:WU00:FS01:Download complete
06:51:18:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:17116 run:5 clone:470 gen:0 core:0x23 unit:0x000001d600000000000042dc00000005
06:51:18:WU00:FS01:Starting
06:51:18:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\MikHexa\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/openmm-core-23/windows-10-64bit/release/0x23-8.0.3/Core_23.fah/FahCore_23.exe -dir 00 -suffix 01 -version 706 -lifeline 6708 -checkpoint 15 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
06:51:18:WU00:FS01:Started FahCore on PID 6040
06:51:18:WU00:FS01:Core PID:5248
06:51:18:WU00:FS01:FahCore 0x23 started
06:51:18:WU00:FS01:0x23:*********************** Log Started 2023-08-16T06:51:18Z ***********************
06:51:18:WU00:FS01:0x23:*************************** Core23 Folding@home Core ***************************
06:51:18:WU00:FS01:0x23:       Core: Core23
06:51:18:WU00:FS01:0x23:       Type: 0x23
06:51:18:WU00:FS01:0x23:    Version: 8.0.3
06:51:18:WU00:FS01:0x23:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
06:51:18:WU00:FS01:0x23:  Copyright: 2022 foldingathome.org
06:51:18:WU00:FS01:0x23:   Homepage: https://foldingathome.org/
06:51:18:WU00:FS01:0x23:       Date: Aug 3 2023
06:51:18:WU00:FS01:0x23:       Time: 08:39:06
06:51:18:WU00:FS01:0x23:   Compiler: Visual C++
06:51:18:WU00:FS01:0x23:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
06:51:18:WU00:FS01:0x23:             -DOPENMM_VERSION="\"8.0.0\""
06:51:18:WU00:FS01:0x23:   Platform: win32 10
06:51:18:WU00:FS01:0x23:       Bits: 64
06:51:18:WU00:FS01:0x23:       Mode: Release
06:51:18:WU00:FS01:0x23:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
06:51:18:WU00:FS01:0x23:             <peastman@stanford.edu>
06:51:18:WU00:FS01:0x23:       Args: -dir 00 -suffix 01 -version 706 -lifeline 6040 -checkpoint 15
06:51:18:WU00:FS01:0x23:             -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
06:51:18:WU00:FS01:0x23:             nvidia -gpu 0 -gpu-usage 100
06:51:18:WU00:FS01:0x23:************************************ libFAH ************************************
06:51:18:WU00:FS01:0x23:       Date: Aug 3 2023
06:51:18:WU00:FS01:0x23:       Time: 08:37:55
06:51:18:WU00:FS01:0x23:   Compiler: Visual C++
06:51:18:WU00:FS01:0x23:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
06:51:18:WU00:FS01:0x23:   Platform: win32 10
06:51:18:WU00:FS01:0x23:       Bits: 64
06:51:18:WU00:FS01:0x23:       Mode: Release
06:51:18:WU00:FS01:0x23:************************************ CBang *************************************
06:51:18:WU00:FS01:0x23:    Version: 1.7.2
06:51:18:WU00:FS01:0x23:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
06:51:18:WU00:FS01:0x23:        Org: Cauldron Development LLC
06:51:18:WU00:FS01:0x23:  Copyright: Cauldron Development LLC, 2003-2023
06:51:18:WU00:FS01:0x23:   Homepage: https://cauldrondevelopment.com/
06:51:18:WU00:FS01:0x23:    License: GPL 2+
06:51:18:WU00:FS01:0x23:       Date: Aug 3 2023
06:51:18:WU00:FS01:0x23:       Time: 08:37:14
06:51:18:WU00:FS01:0x23:   Compiler: Visual C++
06:51:18:WU00:FS01:0x23:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
06:51:18:WU00:FS01:0x23:   Platform: win32 10
06:51:18:WU00:FS01:0x23:       Bits: 64
06:51:18:WU00:FS01:0x23:       Mode: Release
06:51:18:WU00:FS01:0x23:************************************ System ************************************
06:51:18:WU00:FS01:0x23:        CPU: Intel(R) Core(TM) i7 CPU X 980 @ 3.33GHz
06:51:18:WU00:FS01:0x23:     CPU ID: GenuineIntel Family 6 Model 44 Stepping 2
06:51:18:WU00:FS01:0x23:       CPUs: 12
06:51:18:WU00:FS01:0x23:     Memory: 11.99GiB
06:51:18:WU00:FS01:0x23:Free Memory: 9.26GiB
06:51:18:WU00:FS01:0x23:    Threads: WINDOWS_THREADS
06:51:18:WU00:FS01:0x23: OS Version: 6.1
06:51:18:WU00:FS01:0x23:Has Battery: false
06:51:18:WU00:FS01:0x23: On Battery: false
06:51:18:WU00:FS01:0x23: UTC Offset: -7
06:51:18:WU00:FS01:0x23:        PID: 5248
06:51:18:WU00:FS01:0x23:        CWD: C:\Users\MikHexa\AppData\Roaming\FAHClient\work
06:51:18:WU00:FS01:0x23:       Exec: C:\Users\MikHexa\AppData\Roaming\FAHClient\cores\cores.foldingathome.org\openmm-core-23\windows-10-64bit\release\0x23-8.0.3\Core_23.fah\FahCore_23.exe
06:51:18:WU00:FS01:0x23:************************************ OpenMM ************************************
06:51:18:WU00:FS01:0x23:    Version: 8.0.0
06:51:18:WU00:FS01:0x23:********************************************************************************
06:51:18:WU00:FS01:0x23:Project: 17116 (Run 5, Clone 470, Gen 0)
06:51:18:WU00:FS01:0x23:Reading tar file core.xml
06:51:18:WU00:FS01:0x23:Reading tar file integrator.xml.bz2
06:51:18:WU00:FS01:0x23:Reading tar file state.xml.bz2
06:51:18:WU00:FS01:0x23:Reading tar file system.xml.bz2
06:51:18:WU00:FS01:0x23:Digital signatures verified
06:51:18:WU00:FS01:0x23:Folding@home GPU Core23 Folding@home Core
06:51:18:WU00:FS01:0x23:Version 8.0.3
06:51:18:WU00:FS01:0x23:  Checkpoint write interval: 95088 steps (50%) [2 total]
06:51:18:WU00:FS01:0x23:  JSON viewer frame write interval: 1901 steps (1%) [100 total]
06:51:18:WU00:FS01:0x23:  XTC frame write interval: 190176 steps (1e+02%) [1 total]
06:51:18:WU00:FS01:0x23:  Global context and integrator variables write interval: disabled
06:51:18:WU00:FS01:0x23:There are 4 platforms available.
06:51:18:WU00:FS01:0x23:Platform 0: Reference
06:51:18:WU00:FS01:0x23:Platform 1: CPU
06:51:18:WU00:FS01:0x23:Platform 2: OpenCL
06:51:18:WU00:FS01:0x23:  opencl-device 0 specified
06:51:18:WU00:FS01:0x23:Platform 3: CUDA
06:51:18:WU00:FS01:0x23:  cuda-device 0 specified
06:51:28:WU00:FS01:0x23:Attempting to create CUDA context:
06:51:28:WU00:FS01:0x23:  Configuring platform CUDA
06:51:35:WU00:FS01:0x23:  Using CUDA on CUDA Platform and gpu 0
06:51:35:WU00:FS01:0x23:  GPU info: Platform: CUDA
06:51:35:WU00:FS01:0x23:  GPU info: PlatformIndex: 0
06:51:35:WU00:FS01:0x23:  GPU info: Device: NVIDIA GeForce RTX 2070 SUPER
06:51:35:WU00:FS01:0x23:  GPU info: DeviceIndex: 0
06:51:35:WU00:FS01:0x23:  GPU info: Vendor: 0x10de
06:51:35:WU00:FS01:0x23:  GPU info: PCI: 03:00:00
06:51:35:WU00:FS01:0x23:  GPU info: Compute: 7.5
06:51:35:WU00:FS01:0x23:  GPU info: Driver: 11.4
06:51:35:WU00:FS01:0x23:  GPU info: GPU: true
06:51:36:WU00:FS01:0x23:Completed 0 out of 190176 steps (0%)
06:51:36:WU00:FS01:0x23:Checkpoint completed at step 0
06:51:40:WU00:FS01:0x23:Completed 1902 out of 190176 steps (1%)
06:51:44:WU00:FS01:0x23:Completed 3804 out of 190176 steps (2%)
06:51:45:Removing old file 'configs/config-20211120-081755.xml'
06:51:45:Saving configuration to config.xml
06:51:45:<config>
06:51:45:  <!-- Folding Slot Configuration -->
06:51:45:  <cause v='COVID_19'/>
06:51:45:
06:51:45:  <!-- HTTP Server -->
06:51:45:  <allow v='127.0.0.1 192.168.168.153 192.168.168.174 192.168.168.213'/>
06:51:45:
06:51:45:  <!-- Network -->
06:51:45:  <proxy v=':8080'/>
06:51:45:
06:51:45:  <!-- Remote Command Server -->
06:51:45:  <password v='*****'/>
06:51:45:
06:51:45:  <!-- Slot Control -->
06:51:45:  <power v='full'/>
06:51:45:
06:51:45:  <!-- User Information -->
06:51:45:  <passkey v='*****'/>
06:51:45:  <team v='104636'/>
06:51:45:  <user v='[EV]Tesla'/>
06:51:45:
06:51:45:  <!-- Folding Slots -->
06:51:45:  <slot id='1' type='GPU'>
06:51:45:    <pci-bus v='3'/>
06:51:45:    <pci-slot v='0'/>
06:51:45:  </slot>
06:51:45:</config>
06:51:48:WU00:FS01:0x23:Completed 5706 out of 190176 steps (3%)
06:51:52:WU00:FS01:0x23:Completed 7608 out of 190176 steps (4%)
06:51:56:WU00:FS01:0x23:Completed 9509 out of 190176 steps (5%)
06:52:00:WU00:FS01:0x23:Completed 11411 out of 190176 steps (6%)
06:52:05:WU00:FS01:0x23:Completed 13313 out of 190176 steps (7%)
06:52:09:WU00:FS01:0x23:Completed 15215 out of 190176 steps (8%)
06:52:13:WU00:FS01:0x23:Completed 17116 out of 190176 steps (9%)
06:52:17:WU00:FS01:0x23:Completed 19018 out of 190176 steps (10%)
06:52:21:WU00:FS01:0x23:Completed 20920 out of 190176 steps (11%)
06:52:25:WU00:FS01:0x23:Completed 22822 out of 190176 steps (12%)
06:52:29:WU00:FS01:0x23:Completed 24723 out of 190176 steps (13%)
06:52:33:WU00:FS01:0x23:Completed 26625 out of 190176 steps (14%)
06:52:37:WU00:FS01:0x23:Completed 28527 out of 190176 steps (15%)
06:52:41:WU00:FS01:0x23:Completed 30429 out of 190176 steps (16%)
06:52:45:WU00:FS01:0x23:Completed 32330 out of 190176 steps (17%)
06:52:49:WU00:FS01:0x23:Completed 34232 out of 190176 steps (18%)
06:52:53:WU00:FS01:0x23:Completed 36134 out of 190176 steps (19%)
06:52:57:WU00:FS01:0x23:Completed 38036 out of 190176 steps (20%)
06:53:02:WU00:FS01:0x23:Completed 39937 out of 190176 steps (21%)
06:53:06:WU00:FS01:0x23:Completed 41839 out of 190176 steps (22%)
06:53:10:WU00:FS01:0x23:Completed 43741 out of 190176 steps (23%)
06:53:14:WU00:FS01:0x23:Completed 45643 out of 190176 steps (24%)
06:53:18:WU00:FS01:0x23:Completed 47544 out of 190176 steps (25%)
06:53:22:WU00:FS01:0x23:Completed 49446 out of 190176 steps (26%)
06:53:26:WU00:FS01:0x23:Completed 51348 out of 190176 steps (27%)
06:53:30:WU00:FS01:0x23:Completed 53250 out of 190176 steps (28%)
06:53:34:WU00:FS01:0x23:Completed 55152 out of 190176 steps (29%)
06:53:38:WU00:FS01:0x23:Completed 57053 out of 190176 steps (30%)
06:53:42:WU00:FS01:0x23:Completed 58955 out of 190176 steps (31%)
06:53:47:WU00:FS01:0x23:Completed 60857 out of 190176 steps (32%)
06:53:50:WU00:FS01:0x23:Completed 62759 out of 190176 steps (33%)
06:53:55:WU00:FS01:0x23:Completed 64660 out of 190176 steps (34%)
06:53:59:WU00:FS01:0x23:Completed 66562 out of 190176 steps (35%)
06:54:03:WU00:FS01:0x23:Completed 68464 out of 190176 steps (36%)
06:54:07:WU00:FS01:0x23:Completed 70366 out of 190176 steps (37%)
06:54:11:WU00:FS01:0x23:Completed 72267 out of 190176 steps (38%)
06:54:15:WU00:FS01:0x23:Completed 74169 out of 190176 steps (39%)
06:54:19:WU00:FS01:0x23:Completed 76071 out of 190176 steps (40%)
06:54:23:WU00:FS01:0x23:Completed 77973 out of 190176 steps (41%)
06:54:27:WU00:FS01:0x23:Completed 79874 out of 190176 steps (42%)
06:54:31:WU00:FS01:0x23:Completed 81776 out of 190176 steps (43%)
06:54:35:WU00:FS01:0x23:Completed 83678 out of 190176 steps (44%)
06:54:39:WU00:FS01:0x23:Completed 85580 out of 190176 steps (45%)
06:54:43:WU00:FS01:0x23:Completed 87481 out of 190176 steps (46%)
06:54:47:WU00:FS01:0x23:Completed 89383 out of 190176 steps (47%)
06:54:51:WU00:FS01:0x23:Completed 91285 out of 190176 steps (48%)
06:54:55:WU00:FS01:0x23:Completed 93187 out of 190176 steps (49%)
06:54:59:WU00:FS01:0x23:Completed 95088 out of 190176 steps (50%)
06:54:59:WU00:FS01:0x23:Checkpoint completed at step 95088
06:55:04:WU00:FS01:0x23:Completed 96990 out of 190176 steps (51%)
06:55:08:WU00:FS01:0x23:Completed 98892 out of 190176 steps (52%)
06:55:11:WU00:FS01:0x23:Completed 100794 out of 190176 steps (53%)
06:55:15:WU00:FS01:0x23:Completed 102696 out of 190176 steps (54%)
06:55:19:WU00:FS01:0x23:Completed 104597 out of 190176 steps (55%)
06:55:23:WU00:FS01:0x23:Completed 106499 out of 190176 steps (56%)
06:55:27:WU00:FS01:0x23:Completed 108401 out of 190176 steps (57%)
06:55:31:WU00:FS01:0x23:Completed 110303 out of 190176 steps (58%)
06:55:36:WU00:FS01:0x23:Completed 112204 out of 190176 steps (59%)
06:55:40:WU00:FS01:0x23:Completed 114106 out of 190176 steps (60%)
06:55:44:WU00:FS01:0x23:Completed 116008 out of 190176 steps (61%)
06:55:48:WU00:FS01:0x23:Completed 117910 out of 190176 steps (62%)
06:55:52:WU00:FS01:0x23:Completed 119811 out of 190176 steps (63%)
06:55:56:WU00:FS01:0x23:Completed 121713 out of 190176 steps (64%)
06:56:00:WU00:FS01:0x23:Completed 123615 out of 190176 steps (65%)
06:56:04:WU00:FS01:0x23:Completed 125517 out of 190176 steps (66%)
06:56:08:WU00:FS01:0x23:Completed 127418 out of 190176 steps (67%)
06:56:12:WU00:FS01:0x23:Completed 129320 out of 190176 steps (68%)
06:56:16:WU00:FS01:0x23:Completed 131222 out of 190176 steps (69%)
06:56:20:WU00:FS01:0x23:Completed 133124 out of 190176 steps (70%)
06:56:24:WU00:FS01:0x23:Completed 135025 out of 190176 steps (71%)
06:56:28:WU00:FS01:0x23:Completed 136927 out of 190176 steps (72%)
06:56:32:WU00:FS01:0x23:Completed 138829 out of 190176 steps (73%)
06:56:36:WU00:FS01:0x23:Completed 140731 out of 190176 steps (74%)
06:56:40:WU00:FS01:0x23:Completed 142632 out of 190176 steps (75%)
06:56:44:WU00:FS01:0x23:Completed 144534 out of 190176 steps (76%)
06:56:48:WU00:FS01:0x23:Completed 146436 out of 190176 steps (77%)
06:56:52:WU00:FS01:0x23:Completed 148338 out of 190176 steps (78%)
06:56:56:WU00:FS01:0x23:Completed 150240 out of 190176 steps (79%)
06:57:00:WU00:FS01:0x23:Completed 152141 out of 190176 steps (80%)
06:57:04:WU00:FS01:0x23:Completed 154043 out of 190176 steps (81%)
06:57:08:WU00:FS01:0x23:Completed 155945 out of 190176 steps (82%)
06:57:12:WU00:FS01:0x23:Completed 157847 out of 190176 steps (83%)
06:57:16:WU00:FS01:0x23:Completed 159748 out of 190176 steps (84%)
06:57:20:WU00:FS01:0x23:Completed 161650 out of 190176 steps (85%)
06:57:24:WU00:FS01:0x23:Completed 163552 out of 190176 steps (86%)
06:57:29:WU00:FS01:0x23:Completed 165454 out of 190176 steps (87%)
06:57:33:WU00:FS01:0x23:Completed 167355 out of 190176 steps (88%)
06:57:37:WU00:FS01:0x23:Completed 169257 out of 190176 steps (89%)
06:57:41:WU00:FS01:0x23:Completed 171159 out of 190176 steps (90%)
06:57:45:WU00:FS01:0x23:Completed 173061 out of 190176 steps (91%)
06:57:49:WU00:FS01:0x23:Completed 174962 out of 190176 steps (92%)
06:57:53:WU00:FS01:0x23:Completed 176864 out of 190176 steps (93%)
06:57:57:WU00:FS01:0x23:Completed 178766 out of 190176 steps (94%)
06:58:01:WU00:FS01:0x23:Completed 180668 out of 190176 steps (95%)
06:58:05:WU00:FS01:0x23:Completed 182569 out of 190176 steps (96%)
06:58:09:WU00:FS01:0x23:Completed 184471 out of 190176 steps (97%)
06:58:13:WU00:FS01:0x23:Completed 186373 out of 190176 steps (98%)
06:58:17:WU00:FS01:0x23:Completed 188275 out of 190176 steps (99%)
06:58:17:WU01:FS01:Connecting to assign1.foldingathome.org:80
06:58:18:WU01:FS01:Assigned to work server 128.174.73.74
06:58:18:WU01:FS01:Requesting new work unit for slot 01: gpu:3:0 TU104 [GeForce RTX 2070 SUPER] 8218 from 128.174.73.74
06:58:18:WU01:FS01:Connecting to 128.174.73.74:8080
06:58:21:WU00:FS01:0x23:Completed 190176 out of 190176 steps (100%)
06:58:21:WU00:FS01:0x23:Average performance: 163.495 ns/day
06:58:21:WU00:FS01:0x23:Checkpoint completed at step 190176
06:58:25:WU00:FS01:0x23:Saving result file ..\logfile_01.txt
06:58:25:WU00:FS01:0x23:Saving result file checkpointIntegrator.xml.bz2
06:58:25:WU00:FS01:0x23:Saving result file checkpointState.xml.bz2
06:58:25:WU00:FS01:0x23:Saving result file positions.xtc
06:58:25:WU00:FS01:0x23:Saving result file science.log
06:58:25:WU00:FS01:0x23:Saving result file xtcAtoms.csv.bz2
06:58:25:WU00:FS01:0x23:Folding@home Core Shutdown: FINISHED_UNIT
06:58:30:WU01:FS01:Downloading 37.73MiB
06:58:36:WU01:FS01:Download 52.51%
06:58:41:WU01:FS01:Download complete
06:58:41:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14955 run:0 clone:253 gen:246 core:0x22 unit:0xf6000000fd000000000000006b3a0000
07:14:18:FS01:Paused
07:14:18:FS01:Shutting core down
07:14:19:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
07:14:31:FS01:Unpaused
07:14:31:WU00:FS01:Starting
07:14:31:ERROR:WU00:FS01:Failed to start core: Failed to rename 'work/00/logfile_01.txt' to 'work/00/logfile_01-20230816-071431.txt': The process cannot access the file because it is being used by another process.
07:16:08:WU00:FS01:Starting
07:16:08:ERROR:WU00:FS01:Failed to start core: Failed to rename 'work/00/logfile_01.txt' to 'work/00/logfile_01-20230816-071608.txt': The process cannot access the file because it is being used by another process.

[toTOW]

Do you still see FahCore_23.exe running after you get the message "Folding@home Core Shutdown: FINISHED_UNIT" ? By running, I mean showing some CPU activity ?

Also, after you paused the slot and got the "FahCore returned: INTERRUPTED (102 = 0x66)" message, is FahCore_23.exe still present ?

Do you use some kind of security/anti virus tool that could interfere with the core disk accesses ?

[BobWilliams757]

I've had one of them run without any issue. No delays or anything strange in the logs (other than the single checkpoint) that I could see.

PRCG 17116, 14, 321, 0

[Calcii]

+1 Our team has one with no problem
Great results for AMD cards, example for RX480

[Badsinger]

I've seen 17116 and core 23 on all 4 of my machines now. 3 running win 10 and 1 linux mint with a mix of rtx 3070 and 3070ti's. The tests run fine here but all the machines are downloading the next WU at 99% without the -next-unit-percentage flag set. Is this a change?

[ElectricVehicle]

Do you still see FahCore_23.exe running after you get the message "Folding@home Core Shutdown: FINISHED_UNIT" ? By running, I mean showing some CPU activity ?

>>>> The process was present, I didn't check the CPU activity.

Also, after you paused the slot and got the "FahCore returned: INTERRUPTED (102 = 0x66)" message, is FahCore_23.exe still present ?

>>>> Not absolutely sure, I think so, since a FahCore_23.exe process was present, I assume on clicking Fold, that the core process spawned from clicking Fold could not start up, generating these log messages, hence if the core couldn't start on clicking Fold, the FahCore_23.exe presumably must have been one hung from prior to pressing Pause.

07:16:08:WU00:FS01:Starting
07:14:31:ERROR:WU00:FS01:Failed to start core: Failed to rename 'work/00/logfile_01.txt' to 'work/00/logfile_01-20230816-071431.txt': The process cannot access the file because it is being used by another process.

Do you use some kind of security/anti virus tool that could interfere with the core disk accesses ?

>>>> Nothing that interferes. I couldn't manually delete the files from windows until I killed FahCore_23.exe . No changes to the system at all for months and months of 24x7 folding with 0 failed failed WUs.
[/quote]

If I get another one of these, I can check a little more on the behavior.

Good to know that this has run for others - at least it's not taking everyone's folding machines down.... ( BobWilliams757 , Calcii, Badsinger )

I haven't noticed one on my other 2 folding machines yet. I would only notice if I happen to look at them while it's running- or if it hangs / stops folding of all WUs like it did on my 2070 Super machine.

[Gary480six]

I am having the same issue as the OP on P17116 R3 C627 G0.

Work blazes through to 100% the last useful line of the log is: Core Shutdown : Finished work unit.

Then nothing. GTX 1650 super I think - on Windows 7

I also noticed that when I exit the Folding client... the new Core 23 was still running in Task manager.
No CPU activity - but shouldn't it close if the client is off?

It also seems like the progress is not being recorded. If the work is stuck at 100% and I shut down
and restart Folding - the same P17116 work unit starts again from 0%

I disabled Avast and restarted the work unit - Got to 100% and stuck.
Client still running - no CPU usage on Core 23 in task manager.

My only solution was to stop the Folding client and delete that stuck work Folder.

Then I got new work.

I also noticed the new Core 23 is located in a subfolder called Windows 10. Does this new core not work on
Windows 7 or Windows 8?

[ElectricVehicle]

@Gary480six
I'm also on Windows 7, Windows 11 requires a Microsoft account and is even more invasive...

06:50:44: OS: Windows 7 Ultimate
...
06:50:44: GPU 0: Bus:3 Slot:0 Func:0 NVIDIA:8 TU104 [GeForce RTX 2070 SUPER]
06:50:44: 8218
06:50:44: CUDA Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:7.5 Driver:11.4
06:50:44:OpenCL Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:3.0 Driver:472.12

[Joe_H]

...but all the machines are downloading the next WU at 99% without the -next-unit-percentage flag set. Is this a change?

Downloading at 99% completion is the default setting for the v7 client. You have to use the flag to set it to something else, range usable is 90-100%

As for those using Windows 7, MS stopped support in 2020 and it is not a supported OS for F@h any longer. Most things still work, but it would not surprise me if that is contributing to problems. As far as I know Core_23 has not been tested internally on Windows 7, just Windows 10 and 11 as well as several recent Linux distros.

[ElectricVehicle]

I'm going to run Windows 7 or maybe switch to Ubuntu. Windows 11 is not a good solution for everyone. I also understand not supporting an old OS, problem is their is no viable current version of Windows for me.. If Microsoft didn't treat their customers as data mines to be forcibly exploited with no way to opt out. I would have upgraded long ago if it wasn't for the data issues and the forced Microsoft account. I'm tired of Microsoft forcing me to connect all of my computers including crash and burn test rigs to my Microsoft account. The privacy - overconnected virus OS that is Windows 11.... I know IT professionals who refuse to upgrade their companies to Windows 11... end rant..

[Badsinger]

Joe_H wrote

Downloading at 99% completion is the default setting for the v7 client. You have to use the flag to set it to something else, range usable is 90-100%

Thanks for the info. My memory had it backwards thinking 100% was the default.

[Gary480six]

I found a post on urban network about Windows 7. I think it's only 10 months old.

In January 2020 Windows 7 had a 25.56 percent slice of the desktop operating system marketplace, and since then this figure has only dropped slightly.

At the moment Windows 7 still holds a considerable 22.71 percent chunk of the desktop OS market, a drop of less than two percent compared to the start of the year. In fact, when looking at month-on-month figures, Windows 7 recently saw its share of the desktop operating system market increase.

That's a big chunk of the OS market. Maybe Folding should think about still supporting Windows 7 system? (or lose 20% of their volunteers?)

[Joe_H]

That's a big chunk of the OS market. Maybe Folding should think about still supporting Windows 7 system? (or lose 20% of their volunteers?)

That was 10 months ago, the percentage has surely dropped further since then. F@h can not singlehandedly support older OSs, there is also the fact that both Nvidia and AMD have moved driver support for Windows 7 to legacy support. For example the newest drivers for AMD to use with Windows 7 date to last year. The newer series Nvidia cards do not even have Windows 7 drivers at all. The software development tools can only go so far back and still support recent GPUs at the same time.

This is less of an issue with CPU folding. There the executable can be compiled for an older OS and usually still runs properly on a newer OS. It doesn't need to interface with driver code that is continually changing and being updated to support new devices and capabilities.

[muziqaz]

FAH supports all the available OSs. What does not support all available OSs is GPU vendors, as Joe mentioned. There is nothing in Fahclient/Fahcore code what would prevent it from running on older OSs, as long as they are 64bit. We ignore Linux side of things as distros are so fragmented, and our dev hates python 3

[Joe_H]

Here is a link to a post from March of this year based on Statcounter's tracking of OS usage - https://www.ghacks.net/2023/03/01/windo ... ly-halved/. That lists the Windows 7 share as having dropped to just over 5% in February, not anywhere near 20%. Part of the quick drop may be that the last security updates for Windows 7 were released in early January under Microsoft's ESU program.