2025-09-11 -- CUDA_ERROR_ILLEGAL_ADDRESS (700)

[D.Record]

Good afternoon,

2025-09-11 -- CUDA_ERROR_ILLEGAL_ADDRESS (700)

I having trouble with "CUDA_ERROR_ILLEGAL_ADDRESS (700)" causing WU's to fail.

I running a AMD Ryzen 3 3300x 4 Core 8 Thread Processor, with a GPU "EVGA GTX 1080 Ti 11 GB BIOS (FTW3 Hybrid)".

It seems to happen when i leave the machine, and perhaps when the screen attempts to turn off. Naturally im trying to get the best performance out of my system, and can hit a consistent GPU of 2,138,308 PPD.

I had the monitor set to not turn off after 10 minutes and that allowed me to complete
Ok David_Record 1067404 18,000 2025-11-09 12:21:20 2025-11-09 14:04:16
then after i enabled monitor to turn off while away, thinking it was something else that i thought i had resolved, it failed 5 GPU WU's are the projects below.

Ill try disabling monitor turn off when idle, and report back later.

Any one have any ideas?

Many thanks,
David

The projects WU failing are:

18281 - 0x27 - By Justin Miller, University of Pennsylvania
Failed Nadezhda_Petr0vna 47191 0 2025-11-09 12:55:56 2025-11-09 13:54:16
Failed David_Record 067404 0 2025-11-09 13:56:43 2025-11-09 14:54:25

18282 - 0x27 - By Justin Miller, University of Pennsylvania
Failed David_Record 1067404 0 2025-11-09 14:46:57 2025-11-09 14:54:24

18283 - 0x27 - By Justin Miller, University of Pennsylvania
Failed David_Record 1067404 0 2025-11-09 14:46:09 2025-11-09 14:54:25



Update: 14:46 -- 09/11/2025

Its just attempting the same WU's and failing again and again.

18282 - 0x27 - 0.0% - ??? - 140,830 - -25s ago
18282 - 0x27 - 0.0% - ??? - 140,830 - -14s ago
18282 - 0x27 - 0.0% - ??? - 140,817 - 391ms ago
18281 - 0x27 - 0.0% - ??? - 155,367 - 11s ago
18281 - 0x27 - 0.0% - ??? - 155,367 - 23s ago
18282 - 0x27 - 0.0% - ??? - 140,830 - 57m 36s ago
18282 - 0x27 - 0.0% - ??? - 140,812 - 57m 53s ago

Code: Select all

15:43:47:I1:Machine state fold
15:43:47:I1:Default:Added new work unit: cpus:0 gpus:gpu:40:00:00
15:43:47:I3:Removing old file 'work/-y--HD96yyfXFeJKzhaa6DuTCvXocCgaBrNSXUj6_Yc/logfile_01-20251109-083400.txt'
15:43:47:I3:Running FahCore: C:\ProgramData\FAHClient\cores/fahcore-a8-win-64bit-avx2_256-0.0.12/FahCore_a8.exe -dir -y--HD96yyfXFeJKzhaa6DuTCvXocCgaBrNSXUj6_Yc -suffix 01 -version 8.5.3 -lifeline 15228 -np 6
15:43:47:I3:WU58:Started FahCore on PID 19884
15:43:47:I1:WU81:Requesting WU assignment for user David_Record team 1067404
15:43:47:I2:OUT97:> POST /api/assign HTTP/1.1
15:43:47:I1:WU58:*********************** Log Started 2025-11-09T15:43:47Z ***********************
15:43:47:I1:WU58:************************** Gromacs Folding@home Core ***************************
15:43:47:I1:WU58:       Core: Gromacs
15:43:47:I1:WU58:       Type: 0xa8
15:43:47:I1:WU58:    Version: 0.0.12
15:43:47:I1:WU58:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:43:47:I1:WU58:  Copyright: 2020 foldingathome.org
15:43:47:I1:WU58:   Homepage: https://foldingathome.org/
15:43:47:I1:WU58:       Date: Jan 16 2021
15:43:47:I1:WU58:       Time: 12:29:40
15:43:47:I1:WU58:   Revision: c5816759c404e4b65f9f364c3d1ef554a67c4225
15:43:47:I1:WU58:     Branch: master
15:43:47:I1:WU58:   Compiler: Visual C++ 2019 16.7
15:43:47:I1:WU58:    Options: /TP /std:c++14 /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:43:47:I1:WU58:   Platform: win32 10
15:43:47:I1:WU58:       Bits: 64
15:43:47:I1:WU58:       Mode: Release
15:43:47:I1:WU58:       SIMD: avx2_256
15:43:47:I1:WU58:     OpenMP: ON
15:43:47:I1:WU58:       CUDA: OFF
15:43:47:I1:WU58:       Args: -dir -y--HD96yyfXFeJKzhaa6DuTCvXocCgaBrNSXUj6_Yc -suffix 01
15:43:47:I1:WU58:             -version 8.5.3 -lifeline 15228 -np 6
15:43:47:I1:WU58:************************************ libFAH ************************************
15:43:47:I1:WU58:       Date: Jan 16 2021
15:43:47:I1:WU58:       Time: 11:24:13
15:43:47:I1:WU58:   Revision: c5816759c404e4b65f9f364c3d1ef554a67c4225
15:43:47:I1:WU58:     Branch: master
15:43:47:I1:WU58:   Compiler: Visual C++ 2019 16.7
15:43:47:I1:WU58:    Options: /TP /std:c++14 /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:43:47:I1:WU58:   Platform: win32 10
15:43:47:I1:WU58:       Bits: 64
15:43:47:I1:WU58:       Mode: Release
15:43:47:I1:WU58:************************************ CBang *************************************
15:43:47:I1:WU58:       Date: Jan 16 2021
15:43:47:I1:WU58:       Time: 11:23:53
15:43:47:I1:WU58:   Revision: c5816759c404e4b65f9f364c3d1ef554a67c4225
15:43:47:I1:WU58:     Branch: master
15:43:47:I1:WU58:   Compiler: Visual C++ 2019 16.7
15:43:47:I1:WU58:    Options: /TP /std:c++14 /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:43:47:I1:WU58:   Platform: win32 10
15:43:47:I1:WU58:       Bits: 64
15:43:47:I1:WU58:       Mode: Release
15:43:47:I1:WU58:************************************ System ************************************
15:43:47:I1:WU58:        CPU: AMD Ryzen 3 3300X 4-Core Processor
15:43:47:I1:WU58:     CPU ID: AuthenticAMD Family 23 Model 113 Stepping 0
15:43:47:I1:WU58:       CPUs: 8
15:43:47:I1:WU58:     Memory: 15.93GiB
15:43:47:I1:WU58:Free Memory: 5.87GiB
15:43:47:I1:WU58:    Threads: WINDOWS_THREADS
15:43:47:I1:WU58: OS Version: 6.2
15:43:47:I1:WU58:Has Battery: false
15:43:47:I1:WU58: On Battery: false
15:43:47:I1:WU58: UTC Offset: 0
15:43:47:I1:WU58:        PID: 19884
15:43:47:I1:WU58:        CWD: C:\ProgramData\FAHClient\work
15:43:47:I1:WU58:********************************************************************************
15:43:47:I1:WU58:Project: 18490 (Run 31, Clone 14, Gen 37)
15:43:47:I1:WU58:Unit: 0x00000000000000000000000000000000
15:43:47:I1:WU58:Digital signatures verified
15:43:47:I1:WU58:Calling: mdrun -c frame37.gro -s frame37.tpr -x frame37.xtc -cpi state.cpt -cpt 5 -nt 6 -ntmpi 1
15:43:47:I1:WU58:Steps: first=185000000 total=190000000
15:43:47:I2:OUT97:< HTTP/1.1 200 HTTP_OK
15:43:47:I1:WU81:Received WU assignment fD66avxg5T3ij7bC07zdgRWcGHxhKP5sd2q2pfZknnQ
15:43:47:I1:WU81:Downloading WU
15:43:47:I2:OUT98:> POST /api/assign HTTP/1.1
15:43:48:I1:WU81:DOWNLOAD 100% 219B of 219B
15:43:48:I1:WU58:Completed 2493205 out of 5000000 steps (49%)
15:43:49:I2:OUT98:< HTTP/1.1 200 HTTP_OK
15:43:49:I1:WU81:Received WU P18281 R7 C0 G14
15:43:49:I3:Running FahCore: C:\ProgramData\FAHClient\cores/openmm-core-27/windows-10-64bit/release/fahcore-27-windows-10-64bit-release-8.2.1/FahCore_27.exe -dir fD66avxg5T3ij7bC07zdgRWcGHxhKP5sd2q2pfZknnQ -suffix 01 -version 8.5.3 -lifeline 15228 -gpu-uuid b5f93c8e-fc52-2312-ab87-e4bb1ad347c8 -gpu-platform cuda -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
15:43:49:I3:WU81:Started FahCore on PID 14068
15:43:49:I1:WU81:*********************** Log Started 2025-11-09T15:43:49Z ***********************
15:43:49:I1:WU81:*************************** Core27 Folding@home Core ***************************
15:43:49:I1:WU81:       Core: Core27
15:43:49:I1:WU81:       Type: 0x27
15:43:49:I1:WU81:    Version: 8.2.1
15:43:49:I1:WU81:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:43:49:I1:WU81:  Copyright: 2022 foldingathome.org
15:43:49:I1:WU81:   Homepage: https://foldingathome.org/
15:43:49:I1:WU81:       Date: Mar 27 2025
15:43:49:I1:WU81:       Time: 04:46:58
15:43:49:I1:WU81:   Revision: 84019442387121f2bed4ed52e05c53b7b7b52a72
15:43:49:I1:WU81:     Branch: HEAD
15:43:49:I1:WU81:   Compiler: Visual C++
15:43:49:I1:WU81:    Options: $( /TP $) /std:c++14 /nologo /EHa /wd4297 /wd4103 /O2
15:43:49:I1:WU81:             /Zc:throwingNew /MT -DOPENMM_VERSION="\"8.2.0\"" /Ox /std:c++14
15:43:49:I1:WU81:   Platform: win32 10
15:43:49:I1:WU81:       Bits: 64
15:43:49:I1:WU81:       Mode: Release
15:43:49:I1:WU81:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
15:43:49:I1:WU81:             <peastman@stanford.edu>
15:43:49:I1:WU81:       Args: -dir fD66avxg5T3ij7bC07zdgRWcGHxhKP5sd2q2pfZknnQ -suffix 01
15:43:49:I1:WU81:             -version 8.5.3 -lifeline 15228 -gpu-uuid
15:43:49:I1:WU81:             b5f93c8e-fc52-2312-ab87-e4bb1ad347c8 -gpu-platform cuda -gpu-vendor
15:43:49:I1:WU81:             nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0
15:43:49:I1:WU81:             -cuda-device 0 -gpu 0
15:43:49:I1:WU81:************************************ libFAH ************************************
15:43:49:I1:WU81:       Date: Mar 27 2025
15:43:49:I1:WU81:       Time: 04:30:44
15:43:49:I1:WU81:   Revision: c7d2824a47eb025fa8cda8968c7a5e971585d90c
15:43:49:I1:WU81:     Branch: HEAD
15:43:49:I1:WU81:   Compiler: Visual C++
15:43:49:I1:WU81:    Options: $( /TP $) /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:43:49:I1:WU81:   Platform: win32 10
15:43:49:I1:WU81:       Bits: 64
15:43:49:I1:WU81:       Mode: Release
15:43:49:I1:WU81:************************************ CBang *************************************
15:43:49:I1:WU81:    Version: 1.7.2
15:43:49:I1:WU81:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:43:49:I1:WU81:        Org: Cauldron Development LLC
15:43:49:I1:WU81:  Copyright: Cauldron Development LLC, 2003-2024
15:43:49:I1:WU81:   Homepage: https://cauldrondevelopment.com/
15:43:49:I1:WU81:    License: LGPL-2.1-or-later
15:43:49:I1:WU81:       Date: Mar 27 2025
15:43:49:I1:WU81:       Time: 04:29:12
15:43:49:I1:WU81:   Revision: f1cd4c791e8c40a35dcfeab3ab85d910949cc0cb
15:43:49:I1:WU81:     Branch: HEAD
15:43:49:I1:WU81:   Compiler: Visual C++
15:43:49:I1:WU81:    Options: $( /TP $) /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:43:49:I1:WU81:   Platform: win32 10
15:43:49:I1:WU81:       Bits: 64
15:43:49:I1:WU81:       Mode: Release
15:43:49:I1:WU81:************************************ System ************************************
15:43:49:I1:WU81:        CPU: AMD Ryzen 3 3300X 4-Core Processor
15:43:49:I1:WU81:     CPU ID: AuthenticAMD Family 23 Model 113 Stepping 0
15:43:49:I1:WU81:       CPUs: 8
15:43:49:I1:WU81:     Memory: 15.93GiB
15:43:49:I1:WU81:Free Memory: 5.83GiB
15:43:49:I1:WU81: OS Version: 10.0
15:43:49:I1:WU81:Has Battery: false
15:43:49:I1:WU81: On Battery: false
15:43:49:I1:WU81:   Hostname: DESKTOP-01GJ4I6
15:43:49:I1:WU81: UTC Offset: 0
15:43:49:I1:WU81:        PID: 14068
15:43:49:I1:WU81:        CWD: C:\ProgramData\FAHClient\work
15:43:49:I1:WU81:       Exec: C:\ProgramData\FAHClient\cores\openmm-core-27\windows-10-64bit\release\fahcore-27-windows-10-64bit-release-8.2.1\FahCore_27.exe
15:43:49:I1:WU81:************************************ OpenMM ************************************
15:43:49:I1:WU81:    Version: 8.2.0
15:43:49:I1:WU81:********************************************************************************
15:43:49:I1:WU81:Project: 18281 (Run 7, Clone 0, Gen 14)
15:43:49:I1:WU81:Reading tar file core.xml
15:43:49:I1:WU81:Reading tar file integrator.xml
15:43:49:I1:WU81:Reading tar file state.xml.bz2
15:43:49:I1:WU81:Reading tar file system.xml.bz2
15:43:49:I1:WU81:Digital signatures verified
15:43:49:I1:WU81:Folding@home GPU Core27 Folding@home Core
15:43:49:I1:WU81:Version 8.2.1
15:43:49:I1:WU81:  GPU info: Platform: OpenCL: NVIDIA CUDA
15:43:49:I1:WU81:  GPU info: PlatformIndex: 0
15:43:49:I1:WU81:  GPU info: Device: NVIDIA GeForce GTX 1080 Ti
15:43:49:I1:WU81:  GPU info: DeviceIndex: 0
15:43:49:I1:WU81:  GPU info: Vendor: 0x10de
15:43:49:I1:WU81:  GPU info: PCI: 40:00:00
15:43:49:I1:WU81:  GPU info: Compute: 3.0
15:43:49:I1:WU81:  GPU info: Driver: 560.94
15:43:49:I1:WU81:  GPU info: GPU: true
15:43:49:I1:WU81:  GPU info: Platform: CUDA
15:43:49:I1:WU81:  GPU info: PlatformIndex: 0
15:43:49:I1:WU81:  GPU info: Device: NVIDIA GeForce GTX 1080 Ti
15:43:49:I1:WU81:  GPU info: DeviceIndex: 0
15:43:49:I1:WU81:  GPU info: Vendor: 0x10de
15:43:49:I1:WU81:  GPU info: PCI: 40:00:00
15:43:49:I1:WU81:  GPU info: Compute: 6.1
15:43:49:I1:WU81:  GPU info: Driver: 12.6
15:43:49:I1:WU81:  GPU info: GPU: true
15:43:49:I1:WU81:  Checkpoint write interval: 100000 steps (2%) [50 total]
15:43:49:I1:WU81:  JSON viewer frame write interval: 50000 steps (1%) [100 total]
15:43:49:I1:WU81:  XTC frame write interval: 10000 steps (0.2%) [500 total]
15:43:49:I1:WU81:  TRR frame write interval: disabled
15:43:49:I1:WU81:  Global context and integrator variables write interval: disabled
15:43:49:I1:WU81:There are 4 platforms available.
15:43:49:I1:WU81:Platform 0: Reference
15:43:49:I1:WU81:Platform 1: CPU
15:43:49:I1:WU81:Platform 2: OpenCL
15:43:49:I1:WU81:  opencl-device 0 specified
15:43:49:I1:WU81:Platform 3: CUDA
15:43:49:I1:WU81:  cuda-device 0 specified
15:43:52:I1:WU58:WARNING:Console control signal 1 on PID 19884
15:43:52:I1:WU58:Exiting, please wait. . .
15:43:52:I1:WU58:Folding@home Core Shutdown: INTERRUPTED
15:43:53:I1:WU81:Attempting to create CUDA context:
15:43:53:I1:WU81:  Configuring platform CUDA
15:43:53:I1:WU58:Core returned INTERRUPTED (102)
15:43:53:I3:Removing old file 'work/-y--HD96yyfXFeJKzhaa6DuTCvXocCgaBrNSXUj6_Yc/logfile_01-20251109-083406.txt'
15:43:53:I3:Running FahCore: C:\ProgramData\FAHClient\cores/fahcore-a8-win-64bit-avx2_256-0.0.12/FahCore_a8.exe -dir -y--HD96yyfXFeJKzhaa6DuTCvXocCgaBrNSXUj6_Yc -suffix 01 -version 8.5.3 -lifeline 15228 -np 5
15:43:53:I3:WU58:Started FahCore on PID 20000
15:43:53:I1:WU58:*********************** Log Started 2025-11-09T15:43:53Z ***********************
15:43:53:I1:WU58:************************** Gromacs Folding@home Core ***************************
15:43:53:I1:WU58:       Core: Gromacs
15:43:53:I1:WU58:       Type: 0xa8
15:43:53:I1:WU58:    Version: 0.0.12
15:43:53:I1:WU58:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:43:53:I1:WU58:  Copyright: 2020 foldingathome.org
15:43:53:I1:WU58:   Homepage: https://foldingathome.org/
15:43:53:I1:WU58:       Date: Jan 16 2021
15:43:53:I1:WU58:       Time: 12:29:40
15:43:53:I1:WU58:   Revision: c5816759c404e4b65f9f364c3d1ef554a67c4225
15:43:53:I1:WU58:     Branch: master
15:43:53:I1:WU58:   Compiler: Visual C++ 2019 16.7
15:43:53:I1:WU58:    Options: /TP /std:c++14 /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:43:53:I1:WU58:   Platform: win32 10
15:43:53:I1:WU58:       Bits: 64
15:43:53:I1:WU58:       Mode: Release
15:43:53:I1:WU58:       SIMD: avx2_256
15:43:53:I1:WU58:     OpenMP: ON
15:43:53:I1:WU58:       CUDA: OFF
15:43:53:I1:WU58:       Args: -dir -y--HD96yyfXFeJKzhaa6DuTCvXocCgaBrNSXUj6_Yc -suffix 01
15:43:53:I1:WU58:             -version 8.5.3 -lifeline 15228 -np 5
15:43:53:I1:WU58:************************************ libFAH ************************************
15:43:53:I1:WU58:       Date: Jan 16 2021
15:43:53:I1:WU58:       Time: 11:24:13
15:43:53:I1:WU58:   Revision: c5816759c404e4b65f9f364c3d1ef554a67c4225
15:43:53:I1:WU58:     Branch: master
15:43:53:I1:WU58:   Compiler: Visual C++ 2019 16.7
15:43:53:I1:WU58:    Options: /TP /std:c++14 /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:43:53:I1:WU58:   Platform: win32 10
15:43:53:I1:WU58:       Bits: 64
15:43:53:I1:WU58:       Mode: Release
15:43:53:I1:WU58:************************************ CBang *************************************
15:43:53:I1:WU58:       Date: Jan 16 2021
15:43:53:I1:WU58:       Time: 11:23:53
15:43:53:I1:WU58:   Revision: c5816759c404e4b65f9f364c3d1ef554a67c4225
15:43:53:I1:WU58:     Branch: master
15:43:53:I1:WU58:   Compiler: Visual C++ 2019 16.7
15:43:53:I1:WU58:    Options: /TP /std:c++14 /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
15:43:53:I1:WU58:   Platform: win32 10
15:43:53:I1:WU58:       Bits: 64
15:43:53:I1:WU58:       Mode: Release
15:43:53:I1:WU58:************************************ System ************************************
15:43:53:I1:WU58:        CPU: AMD Ryzen 3 3300X 4-Core Processor
15:43:53:I1:WU58:     CPU ID: AuthenticAMD Family 23 Model 113 Stepping 0
15:43:53:I1:WU58:       CPUs: 8
15:43:53:I1:WU58:     Memory: 15.93GiB
15:43:53:I1:WU58:Free Memory: 5.74GiB
15:43:53:I1:WU58:    Threads: WINDOWS_THREADS
15:43:53:I1:WU58: OS Version: 6.2
15:43:53:I1:WU58:Has Battery: false
15:43:53:I1:WU58: On Battery: false
15:43:53:I1:WU58: UTC Offset: 0
15:43:53:I1:WU58:        PID: 20000
15:43:53:I1:WU58:        CWD: C:\ProgramData\FAHClient\work
15:43:53:I1:WU58:********************************************************************************
15:43:53:I1:WU58:Project: 18490 (Run 31, Clone 14, Gen 37)
15:43:53:I1:WU58:Unit: 0x00000000000000000000000000000000
15:43:53:I1:WU58:Digital signatures verified
15:43:53:I1:WU58:Calling: mdrun -c frame37.gro -s frame37.tpr -x frame37.xtc -cpi state.cpt -cpt 5 -nt 5 -ntmpi 1
15:43:53:I1:WU58:Steps: first=185000000 total=190000000
15:43:54:I1:WU58:Completed 2493633 out of 5000000 steps (49%)
15:43:55:I1:WU81:  Using CUDA on CUDA Platform and gpu 0
15:43:55:I1:WU81:  GPU info: Platform: CUDA
15:43:55:I1:WU81:  GPU info: PlatformIndex: 0
15:43:55:I1:WU81:  GPU info: Device: NVIDIA GeForce GTX 1080 Ti
15:43:55:I1:WU81:  GPU info: DeviceIndex: 0
15:43:55:I1:WU81:  GPU info: Vendor: 0x10de
15:43:55:I1:WU81:  GPU info: PCI: 40:00:00
15:43:55:I1:WU81:  GPU info: Compute: 6.1
15:43:55:I1:WU81:  GPU info: Driver: 12.6
15:43:55:I1:WU81:  GPU info: GPU: true
15:43:55:I1:WU81:Completed 0 out of 5000000 steps (0%)
15:43:56:I1:WU81:Checkpoint completed at step 0
15:43:57:I1:WU81:An exception occurred at step 174: Error invoking kernel: CUDA_ERROR_ILLEGAL_ADDRESS (700)
15:43:57:I1:WU81:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
15:43:57:I1:WU81:Folding@home Core Shutdown: CORE_RESTART
15:44:00:E :WU81:Core exited with Windows unhandled exception code 0xc0000409.  See https://bit.ly/2CXgWkZ for more information.
15:44:00:E :WU81:Core returned FAILED_1 (0)
15:44:00:E :WU81:Run did not produce any results. Dumping WU
15:44:00:I1:Default:Added new work unit: cpus:0 gpus:gpu:40:00:00
15:44:00:I1:WU81:Sending dump report
15:44:00:I1:WU82:Requesting WU assignment for user David_Record team 1067404
15:44:00:I2:OUT99:> POST /api/results HTTP/1.1
15:44:00:I2:OUT100:> POST /api/assign HTTP/1.1
15:44:00:I1:WU58:WARNING:Console control signal 1 on PID 20000
15:44:00:I1:WU58:Exiting, please wait. . .
15:44:00:I1:WU58:Core returned INTERRUPTED (102)
15:44:00:I3:Removing old file 'work/-y--HD96yyfXFeJKzhaa6DuTCvXocCgaBrNSXUj6_Yc/logfile_01-20251109-083418.txt'
15:44:00:I3:Running FahCore: C:\ProgramData\FAHClient\cores/fahcore-a8-win-64bit-avx2_256-0.0.12/FahCore_a8.exe -dir -y--HD96yyfXFeJKzhaa6DuTCvXocCgaBrNSXUj6_Yc -suffix 01 -version 8.5.3 -lifeline 15228 -np 6
15:44:00:I3:WU58:Started FahCore on PID 1780
15:44:00:I2:OUT99:< HTTP/1.1 200 HTTP_OK
15:44:00:I1:WU81:Dumped
15:44:00:I2:OUT100:< HTTP/1.1 200 HTTP_OK
15:44:00:I1:WU82:Received WU assignment 2JYpVXadrbUcaKjSTHHG2HGaQZQEi9dzxmBH3_YUEKk
15:44:00:I1:WU82:Downloading WU
15:44:00:I2:OUT101:> POST /api/assign HTTP/1.1

[D.Record]

Hi,

I continued to work the problem, and did some more research in to the CUDA_ERROR_ILLEGAL_ADDRESS (700) issue.

I came across this forum discussion regarding the same error.
https://render.otoy.com/forum/viewtopic.php?t=83404

I downloaded the latest drivers from here as i had the Nvidia Driver 560.94 installed:
https://www.nvidia.com/en-gb/geforce/drivers/

Search all GeForce drivers by providing your system information.
Product Type: GeForce
Product Series: GeForce 10 Series
Product: GeForce GTX 1080 Ti
Operating System: Windows 10 64-bit
Language: English (UK)
Download Type: All

I downloaded this driver:
NVIDIA Studio Driver - WHQL Driver Version: 581.57 - Release Date: 2025 October 14
Located here @ Nvidia: https://www.nvidia.com/en-gb/geforce/dr ... ts/257338/

I downloaded and clicked advanced install option, then selected to do perform a clean install which removes all the drivers.

It turned out i only had the driver installed, and not PhysX System software installed, and then after it restarted from removing the older drivers, i selected for it to install Nvidia Studio Driver option.

****************************
SPECIAL NOTE:
****************************
As a note. I also checked my bios settings for my MSI B450 AM4 Motherboard, and enabled "Above 4G memory/Crypto Currency mining"

This could be reason the error related to memory addresses in the first place with my Geforce 1080 TI being 11GB VRAM capacity. So its worth checking your bios for this feature if you have tried fresh install of the latest drivers.
****************************

Im 50 minutes in to a WU for the 18283 project , so far thankfully so good.
If its fine ill leave this for others to use for help, otherwise ill be back to add more.

Happy Folding, and may the PPD be with you!

David

[BobWilliams757]

All those projects are still in beta testing.

If you are on the beta team, you should have posted in the beta section. If you are not on the beta team, you now know one of the reasons why beta testing can be less stable and result in failed work units. There may be issues that cause instability with no hardware or software issues on your end.

[D.Record]

Hi Bob,

Many thanks for your reply, yes i agree I think there is an issue with project 18282, it would make sense its the one thats failed again and again since i posted earlier.

Ill look for the correct place, and post a message.

UPDATE: Im not a member of the beta team, hopefully they will see it and add this to the list.

Many thanks,
David

[toTOW]

First thing to do on a folding machine is to disable power saving features.

[D.Record]

Hi,

Running in high performance mode, no energy saving features, cpu set to minimum & maximum 99%, gpu just set to power target of now with PrecisionX @ 56%.


Update: 2025-11-09 20:57

Ive been using MSI Afterburner the last couple of days instead of my normal EVGA PrecisionX OC, it could have been that all along, because after i unclicked beta i had some trouble still after i closed and repoened the FAHclient.

I will update again later.

Many thanks,
David

[BobWilliams757]

Just food for thought....

I have used both the EVGA (Precision X1) and MSI Afterburner software without any issues, but keep in mind in some cases you can set it to boot to that setting and might have missed it. But in either case, both seem to work fine.

BUT I did have one project when I first got a GPU that had a number of work units fail, many more had errors but completed, and overall had me scratching my head. Like yourself, I was running the GPU at the lower edge of power limits. Bumping the power limit just slightly brought stability back to all projects. And in my case I was testing voltages, under and over clocks, etc, etc..... the final culprit seemed to be the lower power limit alone. At the time my GPU was new and it had me thinking I might have a hardware problem, until I noticed that only one single project was throwing consistent errors. Keep in mind that 100% stable is great, but you might pick up the next project and find it is not 100% stable. These projects work in strange ways and some will expose a problem that the next project does not.

I can't remember for sure, but I think Afterburner was allowing me to run the GPU at a lower power level than what was stated using the nvidia -smi commands that give info for the GPU. But in any case, I ended up increasing power levels from a low of 53% to 60%. Most projects were fine at 53% and even bumping it to 54-57% solved most of the errors, but not all. I finally just decided to set it at 60% and that was the end of the issues. I have on occasion run other projects at 53% with no issues at all.