R9 390 Exceptions Every WU

[ghuitster]

Hey everyone! I'd love some help.

I have a Sapphire Nitro Radeon R9 390 100382NTOC-2L. I'm on Windows 10 64-bit using Adrenaline 20.4.2. My GPU is at stock clocks and voltages, I haven't enabled any performance tuning. Every GPU work unit assigned to my GPU slot gets an exception.

I do not experience problems gaming or running different GPU benchmarks or stress tests. On all the stress tests and gaming I've done my max temp was 73 C. My PSU is a Corsair AX1200i.

I have log output that looks exactly like below for 14253 (774, 1, 36), 13408 (542, 22, 1), 16435 (2947, 0, 43), 11743 (0, 1926, 130), and 11761 (0, 3749, 77). That's what convinced me that something is up, because I'm getting the same error on various projects. I set my log verbosity level to 5 and captured the log output below for a work unit with the exception. Anybody have tips or advice for me?

Code: Select all

04:20:45:WU02:FS01:Downloading 4.52MiB
04:20:49:WU02:FS01:Download complete
04:20:49:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:11743 run:0 clone:1926 gen:130 core:0x22 unit:0x000000d48ca304f15e67e34715db3298
04:20:49:WU02:FS01:Starting
04:20:49:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Bla\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 02 -suffix 01 -version 705 -lifeline 6184 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:20:49:WU02:FS01:Started FahCore on PID 3644
04:20:49:WU02:FS01:Core PID:12736
04:20:49:WU02:FS01:FahCore 0x22 started
04:20:50:WU02:FS01:0x22:*********************** Log Started 2020-06-02T04:20:49Z ***********************
04:20:50:WU02:FS01:0x22:*************************** Core22 Folding@home Core ***************************
04:20:50:WU02:FS01:0x22:       Type: 0x22
04:20:50:WU02:FS01:0x22:       Core: Core22
04:20:50:WU02:FS01:0x22:    Website: https://foldingathome.org/
04:20:50:WU02:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
04:20:50:WU02:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
04:20:50:WU02:FS01:0x22:             <rafal.wiewiora@choderalab.org>
04:20:50:WU02:FS01:0x22:       Args: -dir 02 -suffix 01 -version 705 -lifeline 3644 -checkpoint 15
04:20:50:WU02:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
04:20:50:WU02:FS01:0x22:     Config: <none>
04:20:50:WU02:FS01:0x22:************************************ Build *************************************
04:20:50:WU02:FS01:0x22:    Version: 0.0.5
04:20:50:WU02:FS01:0x22:       Date: Apr 22 2020
04:20:50:WU02:FS01:0x22:       Time: 04:42:59
04:20:50:WU02:FS01:0x22: Repository: Git
04:20:50:WU02:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
04:20:50:WU02:FS01:0x22:     Branch: HEAD
04:20:50:WU02:FS01:0x22:   Compiler: Visual C++ 2008
04:20:50:WU02:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
04:20:50:WU02:FS01:0x22:   Platform: win32 10
04:20:50:WU02:FS01:0x22:       Bits: 64
04:20:50:WU02:FS01:0x22:       Mode: Release
04:20:50:WU02:FS01:0x22:************************************ System ************************************
04:20:50:WU02:FS01:0x22:        CPU: Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz
04:20:50:WU02:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
04:20:50:WU02:FS01:0x22:       CPUs: 12
04:20:50:WU02:FS01:0x22:     Memory: 15.92GiB
04:20:50:WU02:FS01:0x22:Free Memory: 11.65GiB
04:20:50:WU02:FS01:0x22:    Threads: WINDOWS_THREADS
04:20:50:WU02:FS01:0x22: OS Version: 6.2
04:20:50:WU02:FS01:0x22:Has Battery: false
04:20:50:WU02:FS01:0x22: On Battery: false
04:20:50:WU02:FS01:0x22: UTC Offset: -6
04:20:50:WU02:FS01:0x22:        PID: 12736
04:20:50:WU02:FS01:0x22:        CWD: C:\Users\Bla\AppData\Roaming\FAHClient\work
04:20:50:WU02:FS01:0x22:         OS: Windows 10 Pro
04:20:50:WU02:FS01:0x22:    OS Arch: AMD64
04:20:50:WU02:FS01:0x22:********************************************************************************
04:20:50:WU02:FS01:0x22:Project: 11743 (Run 0, Clone 1926, Gen 130)
04:20:50:WU02:FS01:0x22:Unit: 0x000000d48ca304f15e67e34715db3298
04:20:50:WU02:FS01:0x22:Reading tar file core.xml
04:20:50:WU02:FS01:0x22:Reading tar file integrator.xml
04:20:50:WU02:FS01:0x22:Reading tar file state.xml
04:20:50:WU02:FS01:0x22:Reading tar file system.xml
04:20:51:WU02:FS01:0x22:Digital signatures verified
04:20:51:WU02:FS01:0x22:Folding@home GPU Core22 Folding@home Core
04:20:51:WU02:FS01:0x22:Version 0.0.5
04:21:00:WU02:FS01:0x22:Completed 0 out of 2000000 steps (0%)
04:21:00:WU02:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
04:21:22:WU02:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
04:21:22:WU02:FS01:0x22:Following exception occured: Particle coordinate is nan
04:21:25:WU02:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
04:21:25:WU02:FS01:0x22:Following exception occured: Particle coordinate is nan
04:21:28:WU02:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
04:21:28:WU02:FS01:0x22:Following exception occured: Particle coordinate is nan
04:21:28:WU02:FS01:0x22:ERROR:114: Max Retries Reached
04:21:28:WU02:FS01:0x22:Saving result file ..\logfile_01.txt
04:21:28:WU02:FS01:0x22:Saving result file badstate-0.xml
04:21:29:WU02:FS01:0x22:Saving result file badstate-1.xml
04:21:31:WU02:FS01:0x22:Saving result file badstate-2.xml
04:21:32:WU02:FS01:0x22:Saving result file checkpt.crc
04:21:32:WU02:FS01:0x22:Saving result file science.log
04:21:32:WU02:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
04:21:33:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:21:33:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:11743 run:0 clone:1926 gen:130 core:0x22 unit:0x000000d48ca304f15e67e34715db3298
04:21:33:WU02:FS01:Uploading 11.57MiB to 140.163.4.241
04:21:33:WU02:FS01:Connecting to 140.163.4.241:8080
04:21:33:WU01:FS01:Connecting to 65.254.110.245:8080
04:21:33:WU01:FS01:Assigned to work server 128.252.203.10
04:21:33:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:Hawaii [Radeon R9 200/300 Series] from 128.252.203.10
04:21:33:WU01:FS01:Connecting to 128.252.203.10:8080
04:21:39:WU02:FS01:Upload 30.79%
04:21:45:WU02:FS01:Upload 65.91%
04:21:53:WU02:FS01:Upload complete
04:21:53:WU02:FS01:Server responded WORK_ACK (400)
04:21:53:WU02:FS01:Cleaning up

[PantherX]

Welcome to the F@H Forum ghuitster,

Please note that verbosity level 5 isn't helpful in troubleshooting this issue. Can you please set it back to the default of level 3 and post the log file. Also, we would like to see the first 100 lines of the log file. It would look something like this:

Code: Select all

*********************** Log Started 2020-06-02T03:23:29Z ***********************
03:23:29:Trying to access database...
03:23:29:Successfully acquired database lock
03:23:29:Read GPUs.txt
03:23:29:Enabled folding slot 01: PAUSED gpu:0:GP102 [GeForce GTX 1080 Ti] 11380 (by user)
03:23:29:Enabled folding slot 00: PAUSED cpu:2 (by user)
03:23:29:****************************** FAHClient ******************************
03:23:29:        Version: 7.6.13
03:23:29:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
03:23:29:      Copyright: 2020 foldingathome.org
03:23:29:       Homepage: https://foldingathome.org/
03:23:29:           Date: Apr 27 2020
03:23:29:           Time: 21:21:01
03:23:29:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
03:23:29:         Branch: master
03:23:29:       Compiler: Visual C++ 2008
03:23:29:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
03:23:29:       Platform: win32 10
03:23:29:           Bits: 32
03:23:29:           Mode: Release
03:23:29:         Config: C:\Users\PantherX-H\AppData\Roaming\FAHClient\config.xml
03:23:29:******************************** CBang ********************************
03:23:29:           Date: Apr 24 2020
03:23:29:           Time: 17:07:55
03:23:29:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
03:23:29:         Branch: master
03:23:29:       Compiler: Visual C++ 2008
03:23:29:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
03:23:29:       Platform: win32 10
03:23:29:           Bits: 32
03:23:29:           Mode: Release
03:23:29:******************************* System ********************************
03:23:29:            CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz
03:23:29:         CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
03:23:29:           CPUs: 8
03:23:29:         Memory: 31.94GiB
03:23:29:    Free Memory: 27.38GiB
03:23:29:        Threads: WINDOWS_THREADS
03:23:29:     OS Version: 6.2
03:23:29:    Has Battery: false
03:23:29:     On Battery: false
03:23:29:     UTC Offset: 12
03:23:29:            PID: 11924
03:23:29:            CWD: C:\Users\PantherX-H\AppData\Roaming\FAHClient
03:23:29:  Win32 Service: false
03:23:29:             OS: Windows 10 Enterprise
03:23:29:        OS Arch: AMD64
03:23:29:           GPUs: 1
03:23:29:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:8 GP102 [GeForce GTX 1080 Ti] 11380
03:23:29:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:6.1 Driver:10.2
03:23:29:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:442.19
03:23:29:******************************* libFAH ********************************
03:23:29:           Date: Apr 15 2020
03:23:29:           Time: 14:53:14
03:23:29:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
03:23:29:         Branch: master
03:23:29:       Compiler: Visual C++ 2008
03:23:29:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
03:23:29:       Platform: win32 10
03:23:29:           Bits: 32
03:23:29:           Mode: Release
03:23:29:***********************************************************************
03:23:30:<config>
03:23:30:  <!-- Folding Core -->
03:23:30:  <checkpoint v='30'/>
03:23:30:  <core-priority v='low'/>
03:23:30:
03:23:30:  <!-- Network -->
03:23:30:  <proxy v=':8080'/>
03:23:30:
03:23:30:  <!-- Slot Control -->
03:23:30:  <pause-on-start v='true'/>
03:23:30:  <power v='full'/>
03:23:30:
03:23:30:  <!-- User Information -->
03:23:30:  <passkey v='*****'/>
03:23:30:  <team v='69411'/>
03:23:30:  <user v='PantherX'/>
03:23:30:
03:23:30:  <!-- Work Unit Control -->
03:23:30:  <next-unit-percentage v='100'/>
03:23:30:
03:23:30:  <!-- Folding Slots -->
03:23:30:  <slot id='1' type='GPU'>
03:23:30:    <client-type v='advanced'/>
03:23:30:  </slot>
03:23:30:  <slot id='0' type='CPU'>
03:23:30:    <client-type v='advanced'/>
03:23:30:    <cpus v='2'/>
03:23:30:  </slot>
03:23:30:</config>

Just to double check, you have installed the latest drivers from AMD's site itself, right?

[JimboPalmer]

Welcome to Folding@Home!

https://www.amd.com/en/support/graphics ... eon-r9-390
Should be the latest driver

https://www.techpowerup.com/gpu-specs/r ... -390.c2664
This card should fold fine, OpenCL 2.0 support and Double Precision floating point math (FP64) It does use a LOT of electrical power, I would use AT LEAST a 600 watt power supply.

[foldy]

Adrenaline 20.4.2 has some issues. Get latest version 20.5.1

[ghuitster]

Thanks for the comments and welcome folks!

Here is the log output at verbosity level 3 from the start of F@H.

I have a 1200 watt PSU with 80 Plus Platinum efficiency rating, so I hope that's not the problem...

Currently attempting updating to Adrenaline 20.5.1 and will try folding in a bit.

Code: Select all

*********************** Log Started 2020-06-02T14:47:02Z ***********************
14:47:02:************************* Folding@home Client *************************
14:47:02:        Website: https://foldingathome.org/
14:47:02:      Copyright: (c) 2009-2018 foldingathome.org
14:47:02:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:47:02:           Args: --open-web-control
14:47:02:         Config: C:\Users\David\AppData\Roaming\FAHClient\config.xml
14:47:02:******************************** Build ********************************
14:47:02:        Version: 7.5.1
14:47:02:           Date: May 11 2018
14:47:02:           Time: 13:06:32
14:47:02:     Repository: Git
14:47:02:       Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
14:47:02:         Branch: master
14:47:02:       Compiler: Visual C++ 2008
14:47:02:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
14:47:02:       Platform: win32 10
14:47:02:           Bits: 32
14:47:02:           Mode: Release
14:47:02:******************************* System ********************************
14:47:02:            CPU: Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz
14:47:02:         CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
14:47:02:           CPUs: 12
14:47:02:         Memory: 15.92GiB
14:47:02:    Free Memory: 10.56GiB
14:47:02:        Threads: WINDOWS_THREADS
14:47:02:     OS Version: 6.2
14:47:02:    Has Battery: false
14:47:02:     On Battery: false
14:47:02:     UTC Offset: -6
14:47:02:            PID: 492
14:47:02:            CWD: C:\Users\David\AppData\Roaming\FAHClient
14:47:02:             OS: Windows 10 Enterprise
14:47:02:        OS Arch: AMD64
14:47:02:           GPUs: 1
14:47:02:          GPU 0: Bus:3 Slot:0 Func:0 AMD:5 Hawaii [Radeon R9 200/300 Series]
14:47:02:           CUDA: Not detected: Failed to open dynamic library 'nvcuda.dll': The
14:47:02:                 specified module could not be found.
14:47:02:
14:47:02:OpenCL Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:1.2 Driver:3004.8
14:47:02:  Win32 Service: false
14:47:02:***********************************************************************
14:47:02:<config>
14:47:02:  <!-- Network -->
14:47:02:  <proxy v=':8080'/>
14:47:02:
14:47:02:  <!-- Slot Control -->
14:47:02:  <power v='FULL'/>
14:47:02:
14:47:02:  <!-- User Information -->
14:47:02:  <passkey v='********************************'/>
14:47:02:  <team v='249541'/>
14:47:02:  <user v='ghuitster'/>
14:47:02:
14:47:02:  <!-- Folding Slots -->
14:47:02:  <slot id='0' type='CPU'>
14:47:02:    <paused v='true'/>
14:47:02:  </slot>
14:47:02:  <slot id='1' type='GPU'>
14:47:02:    <paused v='true'/>
14:47:02:  </slot>
14:47:02:</config>
14:47:02:Trying to access database...
14:47:02:Successfully acquired database lock
14:47:02:Enabled folding slot 00: PAUSED cpu:11 (by user)
14:47:02:Enabled folding slot 01: PAUSED gpu:0:Hawaii [Radeon R9 200/300 Series] (by user)

[ghuitster]

After updating to Adrenaline 20.5.1 my first two GPU WUs failed with the same exceptions

11761 (0, 3749, 77) and 14251 (1168, 3, 51) were the projects assigned.

Here's the log output from those two WUs, in case there's anything useful in them

Code: Select all

*********************** Log Started 2020-06-02T15:00:07Z ***********************
15:01:09:FS01:Unpaused
15:01:09:WU01:FS01:Starting
15:01:09:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\David\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 705 -lifeline 11600 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
15:01:09:WU01:FS01:Started FahCore on PID 4396
15:01:10:WU01:FS01:Core PID:10736
15:01:10:WU01:FS01:FahCore 0x22 started
15:01:10:WU01:FS01:0x22:*********************** Log Started 2020-06-02T15:01:10Z ***********************
15:01:10:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
15:01:10:WU01:FS01:0x22:       Type: 0x22
15:01:10:WU01:FS01:0x22:       Core: Core22
15:01:10:WU01:FS01:0x22:    Website: https://foldingathome.org/
15:01:10:WU01:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
15:01:10:WU01:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
15:01:10:WU01:FS01:0x22:             <rafal.wiewiora@choderalab.org>
15:01:10:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 705 -lifeline 4396 -checkpoint 15
15:01:10:WU01:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
15:01:10:WU01:FS01:0x22:     Config: <none>
15:01:10:WU01:FS01:0x22:************************************ Build *************************************
15:01:10:WU01:FS01:0x22:    Version: 0.0.5
15:01:10:WU01:FS01:0x22:       Date: Apr 22 2020
15:01:10:WU01:FS01:0x22:       Time: 04:42:59
15:01:10:WU01:FS01:0x22: Repository: Git
15:01:10:WU01:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
15:01:10:WU01:FS01:0x22:     Branch: HEAD
15:01:10:WU01:FS01:0x22:   Compiler: Visual C++ 2008
15:01:10:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
15:01:10:WU01:FS01:0x22:   Platform: win32 10
15:01:10:WU01:FS01:0x22:       Bits: 64
15:01:10:WU01:FS01:0x22:       Mode: Release
15:01:10:WU01:FS01:0x22:************************************ System ************************************
15:01:10:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz
15:01:10:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
15:01:10:WU01:FS01:0x22:       CPUs: 12
15:01:10:WU01:FS01:0x22:     Memory: 15.92GiB
15:01:10:WU01:FS01:0x22:Free Memory: 11.98GiB
15:01:10:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
15:01:10:WU01:FS01:0x22: OS Version: 6.2
15:01:10:WU01:FS01:0x22:Has Battery: false
15:01:10:WU01:FS01:0x22: On Battery: false
15:01:10:WU01:FS01:0x22: UTC Offset: -6
15:01:10:WU01:FS01:0x22:        PID: 10736
15:01:10:WU01:FS01:0x22:        CWD: C:\Users\David\AppData\Roaming\FAHClient\work
15:01:10:WU01:FS01:0x22:         OS: Windows 10 Pro
15:01:10:WU01:FS01:0x22:    OS Arch: AMD64
15:01:10:WU01:FS01:0x22:********************************************************************************
15:01:10:WU01:FS01:0x22:Project: 11761 (Run 0, Clone 3749, Gen 77)
15:01:10:WU01:FS01:0x22:Unit: 0x0000009680fccb0a5e6d7d5acb8f2a41
15:01:10:WU01:FS01:0x22:Reading tar file core.xml
15:01:10:WU01:FS01:0x22:Reading tar file integrator.xml
15:01:10:WU01:FS01:0x22:Reading tar file state.xml
15:01:10:WU01:FS01:0x22:Reading tar file system.xml
15:01:10:WU01:FS01:0x22:Digital signatures verified
15:01:10:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
15:01:10:WU01:FS01:0x22:Version 0.0.5
15:01:20:WU01:FS01:0x22:Completed 0 out of 2000000 steps (0%)
15:01:20:WU01:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:03:04:WU01:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
15:03:04:WU01:FS01:0x22:Following exception occured: Particle coordinate is nan
15:03:07:WU01:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
15:03:07:WU01:FS01:0x22:Following exception occured: Particle coordinate is nan
15:03:10:WU01:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
15:03:10:WU01:FS01:0x22:Following exception occured: Particle coordinate is nan
15:03:10:WU01:FS01:0x22:ERROR:114: Max Retries Reached
15:03:10:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
15:03:10:WU01:FS01:0x22:Saving result file badstate-0.xml
15:03:10:WU01:FS01:0x22:Saving result file badstate-1.xml
15:03:11:WU01:FS01:0x22:Saving result file badstate-2.xml
15:03:11:WU01:FS01:0x22:Saving result file checkpt.crc
15:03:11:WU01:FS01:0x22:Saving result file science.log
15:03:11:WU01:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
15:03:11:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
15:03:11:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:11761 run:0 clone:3749 gen:77 core:0x22 unit:0x0000009680fccb0a5e6d7d5acb8f2a41
15:03:11:WU01:FS01:Uploading 43.09MiB to 128.252.203.10
15:03:11:WU01:FS01:Connecting to 128.252.203.10:8080
15:03:11:WU00:FS01:Connecting to 65.254.110.245:8080
15:03:12:WU00:FS01:Assigned to work server 206.223.170.146
15:03:12:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:Hawaii [Radeon R9 200/300 Series] from 206.223.170.146
15:03:12:WU00:FS01:Connecting to 206.223.170.146:8080
15:03:21:WU00:FS01:Downloading 35.99MiB
15:03:27:WU00:FS01:Download 61.82%
15:03:32:WU00:FS01:Download complete
15:03:32:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14251 run:1168 clone:3 gen:51 core:0x22 unit:0x00000046cedfaa925eab0320c7ad984b
15:03:32:WU00:FS01:Starting
15:03:32:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\David\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 705 -lifeline 11600 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
15:03:32:WU00:FS01:Started FahCore on PID 4696
15:03:32:WU00:FS01:Core PID:700
15:03:32:WU00:FS01:FahCore 0x22 started
15:03:32:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
15:03:32:WU01:FS01:Connecting to 128.252.203.10:80
15:03:32:WU00:FS01:0x22:*********************** Log Started 2020-06-02T15:03:32Z ***********************
15:03:32:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
15:03:32:WU00:FS01:0x22:       Type: 0x22
15:03:32:WU00:FS01:0x22:       Core: Core22
15:03:32:WU00:FS01:0x22:    Website: https://foldingathome.org/
15:03:32:WU00:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
15:03:32:WU00:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
15:03:32:WU00:FS01:0x22:             <rafal.wiewiora@choderalab.org>
15:03:32:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 705 -lifeline 4696 -checkpoint 15
15:03:32:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
15:03:32:WU00:FS01:0x22:     Config: <none>
15:03:32:WU00:FS01:0x22:************************************ Build *************************************
15:03:32:WU00:FS01:0x22:    Version: 0.0.5
15:03:32:WU00:FS01:0x22:       Date: Apr 22 2020
15:03:32:WU00:FS01:0x22:       Time: 04:42:59
15:03:32:WU00:FS01:0x22: Repository: Git
15:03:32:WU00:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
15:03:32:WU00:FS01:0x22:     Branch: HEAD
15:03:32:WU00:FS01:0x22:   Compiler: Visual C++ 2008
15:03:32:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
15:03:32:WU00:FS01:0x22:   Platform: win32 10
15:03:32:WU00:FS01:0x22:       Bits: 64
15:03:32:WU00:FS01:0x22:       Mode: Release
15:03:32:WU00:FS01:0x22:************************************ System ************************************
15:03:32:WU00:FS01:0x22:        CPU: Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz
15:03:32:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
15:03:32:WU00:FS01:0x22:       CPUs: 12
15:03:32:WU00:FS01:0x22:     Memory: 15.92GiB
15:03:32:WU00:FS01:0x22:Free Memory: 11.59GiB
15:03:32:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
15:03:32:WU00:FS01:0x22: OS Version: 6.2
15:03:32:WU00:FS01:0x22:Has Battery: false
15:03:32:WU00:FS01:0x22: On Battery: false
15:03:32:WU00:FS01:0x22: UTC Offset: -6
15:03:32:WU00:FS01:0x22:        PID: 700
15:03:32:WU00:FS01:0x22:        CWD: C:\Users\David\AppData\Roaming\FAHClient\work
15:03:32:WU00:FS01:0x22:         OS: Windows 10 Pro
15:03:32:WU00:FS01:0x22:    OS Arch: AMD64
15:03:32:WU00:FS01:0x22:********************************************************************************
15:03:32:WU00:FS01:0x22:Project: 14251 (Run 1168, Clone 3, Gen 51)
15:03:32:WU00:FS01:0x22:Unit: 0x00000046cedfaa925eab0320c7ad984b
15:03:32:WU00:FS01:0x22:Reading tar file core.xml
15:03:32:WU00:FS01:0x22:Reading tar file integrator.xml
15:03:32:WU00:FS01:0x22:Reading tar file state.xml
15:03:33:WU01:FS01:Upload 0.15%
15:03:34:WU00:FS01:0x22:Reading tar file system.xml
15:03:36:WU00:FS01:0x22:Digital signatures verified
15:03:36:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
15:03:36:WU00:FS01:0x22:Version 0.0.5
15:04:13:WU00:FS01:0x22:Completed 0 out of 500000 steps (0%)
15:04:14:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:04:24:WU01:FS01:Upload 0.44%
15:04:30:WU01:FS01:Upload 9.57%
15:04:36:WU01:FS01:Upload 19.43%
15:04:42:WU01:FS01:Upload 29.01%
15:04:48:WU01:FS01:Upload 38.87%
15:04:54:WU01:FS01:Upload 48.44%
15:05:00:WU01:FS01:Upload 58.30%
15:05:06:WU01:FS01:Upload 68.02%
15:05:12:WU01:FS01:Upload 78.03%
15:05:18:WU01:FS01:Upload 87.60%
15:05:24:WU01:FS01:Upload 97.46%
15:05:25:WU01:FS01:Upload complete
15:05:25:WU01:FS01:Server responded WORK_ACK (400)
15:05:25:WU01:FS01:Cleaning up
15:06:19:WU00:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
15:06:19:WU00:FS01:0x22:Following exception occured: Particle coordinate is nan
15:09:05:WU00:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
15:09:05:WU00:FS01:0x22:Following exception occured: Particle coordinate is nan
15:11:25:WU00:FS01:0x22:Completed 5000 out of 500000 steps (1%)
15:11:59:WU00:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
15:11:59:WU00:FS01:0x22:Following exception occured: Particle coordinate is nan
15:11:59:WU00:FS01:0x22:ERROR:114: Max Retries Reached
15:11:59:WU00:FS01:0x22:Saving result file ..\logfile_01.txt
15:11:59:WU00:FS01:0x22:Saving result file badstate-0.xml
15:12:01:WU00:FS01:0x22:Saving result file badstate-1.xml
15:12:02:WU00:FS01:0x22:Saving result file badstate-2.xml
15:12:02:WU00:FS01:0x22:Saving result file checkpt.crc
15:12:02:WU00:FS01:0x22:Saving result file science.log
15:12:02:WU00:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
15:12:03:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
15:12:03:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:14251 run:1168 clone:3 gen:51 core:0x22 unit:0x00000046cedfaa925eab0320c7ad984b
15:12:03:WU00:FS01:Uploading 379.63KiB to 206.223.170.146
15:12:03:WU00:FS01:Connecting to 206.223.170.146:8080
15:12:04:WU01:FS01:Connecting to 65.254.110.245:8080
15:12:04:WARNING:WU01:FS01:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
15:12:04:WU01:FS01:Connecting to 18.218.241.186:80
15:12:04:WU01:FS01:Assigned to work server 3.133.76.19
15:12:04:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:Hawaii [Radeon R9 200/300 Series] from 3.133.76.19
15:12:04:WU01:FS01:Connecting to 3.133.76.19:8080
15:12:04:WU00:FS01:Upload complete
15:12:04:WU00:FS01:Server responded WORK_ACK (400)
15:12:05:WU00:FS01:Cleaning up

[ghuitster]

Noticed from that output my F@H client was out of date. Just updated that as well and still getting an exception.

Here's log output using Adrenaline 20.5.1 and the most recent F@H software

Code: Select all

*********************** Log Started 2020-06-02T15:20:14Z ***********************
15:20:14:Trying to access database...
15:20:14:Successfully acquired database lock
15:20:14:Downloading GPUs.txt from assign1.foldingathome.org:80
15:20:14:Connecting to assign1.foldingathome.org:80
15:20:14:Read GPUs.txt
15:20:15:Enabled folding slot 00: PAUSED cpu:11 (by user)
15:20:15:Enabled folding slot 01: PAUSED gpu:0:Hawaii [Radeon R9 200/300 Series] (by user)
15:20:15:****************************** FAHClient ******************************
15:20:15:        Version: 7.6.13
15:20:15:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
15:20:15:      Copyright: 2020 foldingathome.org
15:20:15:       Homepage: https://foldingathome.org/
15:20:15:           Date: Apr 27 2020
15:20:15:           Time: 21:21:01
15:20:15:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
15:20:15:         Branch: master
15:20:15:       Compiler: Visual C++ 2008
15:20:15:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
15:20:15:       Platform: win32 10
15:20:15:           Bits: 32
15:20:15:           Mode: Release
15:20:15:           Args: --open-web-control
15:20:15:         Config: C:\Users\David\AppData\Roaming\FAHClient\config.xml
15:20:15:******************************** CBang ********************************
15:20:15:           Date: Apr 24 2020
15:20:15:           Time: 17:07:55
15:20:15:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
15:20:15:         Branch: master
15:20:15:       Compiler: Visual C++ 2008
15:20:15:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
15:20:15:       Platform: win32 10
15:20:15:           Bits: 32
15:20:15:           Mode: Release
15:20:15:******************************* System ********************************
15:20:15:            CPU: Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz
15:20:15:         CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
15:20:15:           CPUs: 12
15:20:15:         Memory: 15.92GiB
15:20:15:    Free Memory: 11.50GiB
15:20:15:        Threads: WINDOWS_THREADS
15:20:15:     OS Version: 6.2
15:20:15:    Has Battery: false
15:20:15:     On Battery: false
15:20:15:     UTC Offset: -6
15:20:15:            PID: 9092
15:20:15:            CWD: C:\Users\David\AppData\Roaming\FAHClient
15:20:15:  Win32 Service: false
15:20:15:             OS: Windows 10 Enterprise
15:20:15:        OS Arch: AMD64
15:20:15:           GPUs: 1
15:20:15:          GPU 0: Bus:3 Slot:0 Func:0 AMD:5 Hawaii [Radeon R9 200/300 Series]
15:20:15:           CUDA: Not detected: Failed to open dynamic library 'nvcuda.dll': The
15:20:15:                 specified module could not be found.
15:20:15:
15:20:15:OpenCL Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:1.2 Driver:3075.12
15:20:15:******************************* libFAH ********************************
15:20:15:           Date: Apr 15 2020
15:20:15:           Time: 14:53:14
15:20:15:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
15:20:15:         Branch: master
15:20:15:       Compiler: Visual C++ 2008
15:20:15:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
15:20:15:       Platform: win32 10
15:20:15:           Bits: 32
15:20:15:           Mode: Release
15:20:15:***********************************************************************
15:20:15:<config>
15:20:15:  <!-- Network -->
15:20:15:  <proxy v=':8080'/>
15:20:15:
15:20:15:  <!-- Slot Control -->
15:20:15:  <power v='FULL'/>
15:20:15:
15:20:15:  <!-- User Information -->
15:20:15:  <passkey v='*****'/>
15:20:15:  <team v='249541'/>
15:20:15:  <user v='ghuitster'/>
15:20:15:
15:20:15:  <!-- Folding Slots -->
15:20:15:  <slot id='0' type='CPU'>
15:20:15:    <paused v='true'/>
15:20:15:  </slot>
15:20:15:  <slot id='1' type='GPU'>
15:20:15:    <paused v='true'/>
15:20:15:  </slot>
15:20:15:</config>
15:20:17:9:127.0.0.1:New Web session
15:20:53:FS01:Unpaused
15:20:53:WU01:FS01:Starting
15:20:53:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\David\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 9092 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
15:20:53:WU01:FS01:Started FahCore on PID 15116
15:20:53:WU01:FS01:Core PID:13056
15:20:53:WU01:FS01:FahCore 0x22 started
15:20:54:WU01:FS01:0x22:*********************** Log Started 2020-06-02T15:20:53Z ***********************
15:20:54:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
15:20:54:WU01:FS01:0x22:       Type: 0x22
15:20:54:WU01:FS01:0x22:       Core: Core22
15:20:54:WU01:FS01:0x22:    Website: https://foldingathome.org/
15:20:54:WU01:FS01:0x22:  Copyright: (c) 2009-2018 foldingathome.org
15:20:54:WU01:FS01:0x22:     Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
15:20:54:WU01:FS01:0x22:             <rafal.wiewiora@choderalab.org>
15:20:54:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 15116 -checkpoint 15
15:20:54:WU01:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
15:20:54:WU01:FS01:0x22:     Config: <none>
15:20:54:WU01:FS01:0x22:************************************ Build *************************************
15:20:54:WU01:FS01:0x22:    Version: 0.0.5
15:20:54:WU01:FS01:0x22:       Date: Apr 22 2020
15:20:54:WU01:FS01:0x22:       Time: 04:42:59
15:20:54:WU01:FS01:0x22: Repository: Git
15:20:54:WU01:FS01:0x22:   Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
15:20:54:WU01:FS01:0x22:     Branch: HEAD
15:20:54:WU01:FS01:0x22:   Compiler: Visual C++ 2008
15:20:54:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
15:20:54:WU01:FS01:0x22:   Platform: win32 10
15:20:54:WU01:FS01:0x22:       Bits: 64
15:20:54:WU01:FS01:0x22:       Mode: Release
15:20:54:WU01:FS01:0x22:************************************ System ************************************
15:20:54:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz
15:20:54:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
15:20:54:WU01:FS01:0x22:       CPUs: 12
15:20:54:WU01:FS01:0x22:     Memory: 15.92GiB
15:20:54:WU01:FS01:0x22:Free Memory: 11.41GiB
15:20:54:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
15:20:54:WU01:FS01:0x22: OS Version: 6.2
15:20:54:WU01:FS01:0x22:Has Battery: false
15:20:54:WU01:FS01:0x22: On Battery: false
15:20:54:WU01:FS01:0x22: UTC Offset: -6
15:20:54:WU01:FS01:0x22:        PID: 13056
15:20:54:WU01:FS01:0x22:        CWD: C:\Users\David\AppData\Roaming\FAHClient\work
15:20:54:WU01:FS01:0x22:         OS: Windows 10 Pro
15:20:54:WU01:FS01:0x22:    OS Arch: AMD64
15:20:54:WU01:FS01:0x22:********************************************************************************
15:20:54:WU01:FS01:0x22:Project: 16435 (Run 617, Clone 0, Gen 47)
15:20:54:WU01:FS01:0x22:Unit: 0x0000005e03854c135e9a4efaabfa27a8
15:20:54:WU01:FS01:0x22:Digital signatures verified
15:20:54:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
15:20:54:WU01:FS01:0x22:Version 0.0.5
15:21:02:WU01:FS01:0x22:Completed 0 out of 5000000 steps (0%)
15:21:02:WU01:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
15:21:14:WU01:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
15:21:14:WU01:FS01:0x22:Following exception occured: Particle coordinate is nan
15:21:15:Removing old file 'configs/config-20200523-001610.xml'
15:21:15:Saving configuration to config.xml
15:21:15:<config>
15:21:15:  <!-- Network -->
15:21:15:  <proxy v=':8080'/>
15:21:15:
15:21:15:  <!-- Slot Control -->
15:21:15:  <power v='FULL'/>
15:21:15:
15:21:15:  <!-- User Information -->
15:21:15:  <passkey v='*****'/>
15:21:15:  <team v='249541'/>
15:21:15:  <user v='ghuitster'/>
15:21:15:
15:21:15:  <!-- Folding Slots -->
15:21:15:  <slot id='0' type='CPU'>
15:21:15:    <paused v='true'/>
15:21:15:  </slot>
15:21:15:  <slot id='1' type='GPU'/>
15:21:15:</config>
15:21:25:WU01:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
15:21:25:WU01:FS01:0x22:Following exception occured: Particle coordinate is nan
15:21:43:WU01:FS01:0x22:Bad State detected... attempting to resume from last good checkpoint. Is your system overclocked?
15:21:43:WU01:FS01:0x22:Following exception occured: Particle coordinate is nan
15:21:43:WU01:FS01:0x22:ERROR:114: Max Retries Reached
15:21:43:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
15:21:43:WU01:FS01:0x22:Saving result file badstate-0.xml
15:21:43:WU01:FS01:0x22:Saving result file badstate-1.xml
15:21:43:WU01:FS01:0x22:Saving result file badstate-2.xml
15:21:43:WU01:FS01:0x22:Saving result file checkpt.crc
15:21:43:WU01:FS01:0x22:Saving result file science.log
15:21:43:WU01:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
15:21:44:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
15:21:44:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:16435 run:617 clone:0 gen:47 core:0x22 unit:0x0000005e03854c135e9a4efaabfa27a8
15:21:44:WU01:FS01:Uploading 68.82KiB to 3.133.76.19
15:21:44:WU01:FS01:Connecting to 3.133.76.19:8080
15:21:44:WU00:FS01:Connecting to assign1.foldingathome.org:80
15:21:44:WARNING:WU00:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
15:21:44:WU00:FS01:Connecting to assign2.foldingathome.org:80
15:21:45:WU00:FS01:Assigned to work server 155.247.166.220
15:21:45:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:Hawaii [Radeon R9 200/300 Series] from 155.247.166.220
15:21:45:WU00:FS01:Connecting to 155.247.166.220:8080
15:21:45:ERROR:WU00:FS01:Exception: Server did not assign work unit
15:21:45:WU00:FS01:Connecting to assign1.foldingathome.org:80
15:21:45:WU00:FS01:Assigned to work server 128.252.203.10
15:21:45:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:Hawaii [Radeon R9 200/300 Series] from 128.252.203.10
15:21:45:WU00:FS01:Connecting to 128.252.203.10:8080
15:22:30:WU01:FS01:Upload complete
15:22:31:WU01:FS01:Server responded WORK_ACK (400)
15:22:31:WU01:FS01:Cleaning up

[ghuitster]

A few more failed WUs later I got this one 13409 (32, 16, 0) and it's successfully folding. Not sure how that project is different than the others I was failing on previously. Will see what happens on the next WU and report back

[ghuitster]

13409 (32, 16, 0) reverted to checkpoints looks like ~4 times. It did eventually succeed. Had two WUs in a row fail immediately with the Particle coordinate is nan exception. Just picked up 14510 (0, 41, 70) and that's successfully folding so far

[bruce]

Remove any overclocking you have set.

FAHCores are more intense than the traditional benchmarks.

I just checked Project: 11761 (Run 0, Clone 3749, Gen 77) and the project was reassigned and completed by the next assignee. Unfortunately I can't tell if they're running Adrenaline drivers or NVidia drivers.

[JimboPalmer]

First I am in over my head with hardware, ideally someone much more familiar with Under clocking an AMD card would jump in.

If the card is under warranty,consider an RMA.

MSI Afterburner is a 'gamer' pverclocking utility, you may wish to use it to underclock your card. It may also allow you to increase your fan speeds to cool the card.

https://www.msi.com/page/afterburner

I would lower the GPU clock speed by 100 Mhz until WUs quit failing. Memory speed is not important to F@H. Best of luck.

As I say, this is not my field of expertise, but I think we have addressed the software, it is time to look at hardware.

[ghuitster]

Thanks again for responses everyone! Really appreciate all the help on this.

Remove any overclocking you have set.

I don't have any overclocking set at all. Not using factory overclock, as far as I can tell I'm stock.

If the card is under warranty,consider an RMA.

Unfortunately I'm ~2.5 years out of warranty support. Good idea though!

This current WU I have from 14510 (0, 41, 70) is currently at 65% completion without any errors or exceptions. So I'm seeing better results, possibly from the updated Adrenaline version or the updated F@H version. At least not every WU is immediately failing.

[_r2w_ben]

Try running MemtestCL and see if it reports any errors.
https://simtk.org/projects/memtest
or
https://www.majorgeeks.com/files/details/memtestcl.html

[ghuitster]

Okay. Let it run overnight and collected more data. I had six WUs complete successfully. 13 WUs failed with exceptions. 12 WUs failed with "Particle coordinate is nan" and one failed with "Exception access violation."

I ran MemtestCL with 1024 MB and 10 iterations, and got hundreds of thousands of errors, not an exaggeration. Is that tool still reliable? There hasn't been a commit to it in 6 years. If it is still reliable maybe it's time to start thinking about a new GPU.

[JimboPalmer]

It may be time to tell us your budget and any limits to your PC.

Low Profile? Single Slot? Power Supply Size? And, of course, Budget?

I think you can get a GTX 1650 in Low Profile
https://www.newegg.com/gigabyte-geforce ... 6814932298

I think you can get a GTX 1030 in Single Slot
https://www.newegg.com/msi-geforce-gt-1 ... 6814137318

The GTX 1650 only draws 65 Watts.
https://www.newegg.com/zotac-geforce-gt ... 6814500468

The above are new, these are refurbs

https://www.newegg.com/p/pl?N=100007709 ... rder=PRICE