Radeon VII failed

[ShortnBearded]

When I started using F@H mid-March everything worked fine, but for the past couple weeks I haven't gotten any WUs for my GPU. It doesn't seem to matter if I overclock or not. I'm generally good with hardware, but not the greatest with reading software. Any help would be greatly appreciated.

[ajm]

The best would be to start by posting your log, like this: viewtopic.php?p=327412&f=24#p327412

Then we would know your system better and might spot the cause of the problem.

[PantherX]

Welcome to the F@H Forum ShortnBearded,

Can you please post the first section of the log file? It is about 100 lines and will provide us with the system configuration and the client's setup. That will allow us to understand what's happening on your system. If you need guidance, please review this topic which has instructions: viewtopic.php?f=24&t=26036

[ShortnBearded]

Code: Select all

*********************** Log Started 2020-05-10T00:48:26Z ***********************
00:48:26:Trying to access database...
00:48:26:Successfully acquired database lock
00:48:26:Read GPUs.txt
00:48:26:Enabled folding slot 00: PAUSED cpu:7 (waiting for idle)
00:48:26:Enabled folding slot 01: PAUSED gpu:0:Vega 20 [Radeon VII] (waiting for idle)
00:48:26:****************************** FAHClient ******************************
00:48:26:        Version: 7.6.13
00:48:26:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
00:48:26:      Copyright: 2020 foldingathome.org
00:48:26:       Homepage: https://foldingathome.org/
00:48:26:           Date: Apr 27 2020
00:48:26:           Time: 21:21:01
00:48:26:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
00:48:26:         Branch: master
00:48:26:       Compiler: Visual C++ 2008
00:48:26:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
00:48:26:       Platform: win32 10
00:48:26:           Bits: 32
00:48:26:           Mode: Release
00:48:26:         Config: C:\Users\voris\AppData\Roaming\FAHClient\config.xml
00:48:26:******************************** CBang ********************************
00:48:26:           Date: Apr 24 2020
00:48:26:           Time: 17:07:55
00:48:26:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
00:48:26:         Branch: master
00:48:26:       Compiler: Visual C++ 2008
00:48:26:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
00:48:26:       Platform: win32 10
00:48:26:           Bits: 32
00:48:26:           Mode: Release
00:48:26:******************************* System ********************************
00:48:26:            CPU: Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz
00:48:26:         CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
00:48:26:           CPUs: 8
00:48:26:         Memory: 31.92GiB
00:48:26:    Free Memory: 28.32GiB
00:48:26:        Threads: WINDOWS_THREADS
00:48:26:     OS Version: 6.2
00:48:26:    Has Battery: false
00:48:26:     On Battery: false
00:48:26:     UTC Offset: 9
00:48:26:            PID: 6708
00:48:26:            CWD: C:\Users\voris\AppData\Roaming\FAHClient
00:48:26:  Win32 Service: false
00:48:26:             OS: Windows 10 Home
00:48:26:        OS Arch: AMD64
00:48:26:           GPUs: 1
00:48:26:          GPU 0: Bus:3 Slot:0 Func:0 AMD:5 Vega 20 [Radeon VII]
00:48:26:           CUDA: Not detected: Failed to open dynamic library 'nvcuda.dll': The
00:48:26:                 specified module could not be found.
00:48:26:
00:48:26:OpenCL Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:1.2 Driver:3004.8
00:48:26:******************************* libFAH ********************************
00:48:26:           Date: Apr 15 2020
00:48:26:           Time: 14:53:14
00:48:26:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
00:48:26:         Branch: master
00:48:26:       Compiler: Visual C++ 2008
00:48:26:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
00:48:26:       Platform: win32 10
00:48:26:           Bits: 32
00:48:26:           Mode: Release
00:48:26:***********************************************************************
00:48:26:<config>
00:48:26:  <!-- Network -->
00:48:26:  <proxy v=':8080'/>
00:48:26:
00:48:26:  <!-- Slot Control -->
00:48:26:  <power v='FULL'/>
00:48:26:
00:48:26:  <!-- User Information -->
00:48:26:  <passkey v='*****'/>
00:48:26:  <team v='234771'/>
00:48:26:  <user v='ShortnBearded'/>
00:48:26:
00:48:26:  <!-- Folding Slots -->
00:48:26:  <slot id='0' type='CPU'>
00:48:26:    <idle v='true'/>
00:48:26:  </slot>
00:48:26:  <slot id='1' type='GPU'>
00:48:26:    <idle v='true'/>
00:48:26:  </slot>
00:48:26:</config>
00:50:12:WU02:FS00:Starting
00:50:12:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\voris\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 706 -lifeline 6708 -checkpoint 15 -np 7
00:50:12:WU02:FS00:Started FahCore on PID 1032
00:50:12:WU02:FS00:Core PID:13812
00:50:12:WU02:FS00:FahCore 0xa7 started
00:50:13:WU02:FS00:0xa7:*********************** Log Started 2020-05-10T00:50:12Z ***********************
00:50:13:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
00:50:13:WU02:FS00:0xa7:       Type: 0xa7
00:50:13:WU02:FS00:0xa7:       Core: Gromacs
00:50:13:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 706 -lifeline 1032 -checkpoint 15 -np 7
00:50:13:WU02:FS00:0xa7:************************************ CBang *************************************
00:50:13:WU02:FS00:0xa7:       Date: Oct 26 2019
00:50:13:WU02:FS00:0xa7:       Time: 01:38:25
00:50:13:WU02:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
00:50:13:WU02:FS00:0xa7:     Branch: master
00:50:13:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
00:50:13:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
00:50:13:WU02:FS00:0xa7:   Platform: win32 10
00:50:13:WU02:FS00:0xa7:       Bits: 64
00:50:13:WU02:FS00:0xa7:       Mode: Release
00:50:13:WU02:FS00:0xa7:************************************ System ************************************
00:50:13:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz
00:50:13:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
00:50:13:WU02:FS00:0xa7:       CPUs: 8
00:50:13:WU02:FS00:0xa7:     Memory: 31.92GiB
00:50:13:WU02:FS00:0xa7:Free Memory: 27.90GiB
00:50:13:WU02:FS00:0xa7:    Threads: WINDOWS_THREADS
00:50:13:WU02:FS00:0xa7: OS Version: 6.2
00:50:13:WU02:FS00:0xa7:Has Battery: false
00:50:13:WU02:FS00:0xa7: On Battery: false
00:50:13:WU02:FS00:0xa7: UTC Offset: 9
00:50:13:WU02:FS00:0xa7:        PID: 13812
00:50:13:WU02:FS00:0xa7:        CWD: C:\Users\voris\AppData\Roaming\FAHClient\work
00:50:13:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
00:50:13:WU02:FS00:0xa7:    Version: 0.0.18
00:50:13:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
00:50:13:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
00:50:13:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
00:50:13:WU02:FS00:0xa7:       Date: Oct 26 2019
00:50:13:WU02:FS00:0xa7:       Time: 01:52:30
00:50:13:WU02:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
00:50:13:WU02:FS00:0xa7:     Branch: master
00:50:13:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
00:50:13:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
00:50:13:WU02:FS00:0xa7:   Platform: win32 10
00:50:13:WU02:FS00:0xa7:       Bits: 64
00:50:13:WU02:FS00:0xa7:       Mode: Release
00:50:13:WU02:FS00:0xa7:************************************ Build *************************************
00:50:13:WU02:FS00:0xa7:       SIMD: avx_256
00:50:13:WU02:FS00:0xa7:********************************************************************************
00:50:13:WU02:FS00:0xa7:Project: 14584 (Run 0, Clone 708, Gen 105)
00:50:13:WU02:FS00:0xa7:Unit: 0x0000007a0d5262775e7a6b601564d77a
00:50:13:WU02:FS00:0xa7:Digital signatures verified
00:50:13:WU02:FS00:0xa7:Reducing thread count from 7 to 6 to avoid domain decomposition by a prime number > 3
00:50:13:WU02:FS00:0xa7:Calling: mdrun -s frame105.tpr -o frame105.trr -x frame105.xtc -cpi state.cpt -cpt 15 -nt 6
00:50:13:WU02:FS00:0xa7:Steps: first=26250000 total=250000
00:50:14:WU02:FS00:0xa7:Completed 47292 out of 250000 steps (18%)
00:50:16:WU00:FS01:Connecting to assign1.foldingathome.org:80
00:50:17:WARNING:WU00:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
00:50:17:WU00:FS01:Connecting to assign2.foldingathome.org:80
00:50:18:WU02:FS00:0xa7:Completed 47500 out of 250000 steps (19%)
00:50:18:WU00:FS01:Assigned to work server 128.252.203.10
00:50:18:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:Vega 20 [Radeon VII] from 128.252.203.10
00:50:18:WU00:FS01:Connecting to 128.252.203.10:8080
00:50:22:FS00:Shutting core down
00:50:22:WU02:FS00:0xa7:WARNING:Console control signal 1 on PID 13812
00:50:22:WU02:FS00:0xa7:Exiting, please wait. . .
00:50:22:WU02:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
00:50:22:WU02:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
00:50:49:ERROR:WU00:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0
01:41:45:WU02:FS00:Starting
01:41:45:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\voris\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 02 -suffix 01 -version 706 -lifeline 6708 -checkpoint 15 -np 7
01:41:45:WU02:FS00:Started FahCore on PID 11140
01:41:45:WU02:FS00:Core PID:13248
01:41:45:WU02:FS00:FahCore 0xa7 started
01:41:46:WU00:FS01:Connecting to assign1.foldingathome.org:80
01:41:46:WU02:FS00:0xa7:*********************** Log Started 2020-05-10T01:41:45Z ***********************
01:41:46:WU02:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
01:41:46:WU02:FS00:0xa7:       Type: 0xa7
01:41:46:WU02:FS00:0xa7:       Core: Gromacs
01:41:46:WU02:FS00:0xa7:       Args: -dir 02 -suffix 01 -version 706 -lifeline 11140 -checkpoint 15 -np
01:41:46:WU02:FS00:0xa7:             7
01:41:46:WU02:FS00:0xa7:************************************ CBang *************************************
01:41:46:WU02:FS00:0xa7:       Date: Oct 26 2019
01:41:46:WU02:FS00:0xa7:       Time: 01:38:25
01:41:46:WU02:FS00:0xa7:   Revision: c46a1a011a24143739ac7218c5a435f66777f62f
01:41:46:WU02:FS00:0xa7:     Branch: master
01:41:46:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
01:41:46:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
01:41:46:WU02:FS00:0xa7:   Platform: win32 10
01:41:46:WU02:FS00:0xa7:       Bits: 64
01:41:46:WU02:FS00:0xa7:       Mode: Release
01:41:46:WU02:FS00:0xa7:************************************ System ************************************
01:41:46:WU02:FS00:0xa7:        CPU: Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz
01:41:46:WU02:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
01:41:46:WU02:FS00:0xa7:       CPUs: 8
01:41:46:WU02:FS00:0xa7:     Memory: 31.92GiB
01:41:46:WU02:FS00:0xa7:Free Memory: 25.70GiB
01:41:46:WU02:FS00:0xa7:    Threads: WINDOWS_THREADS
01:41:46:WU02:FS00:0xa7: OS Version: 6.2
01:41:46:WU02:FS00:0xa7:Has Battery: false
01:41:46:WU02:FS00:0xa7: On Battery: false
01:41:46:WU02:FS00:0xa7: UTC Offset: 9
01:41:46:WU02:FS00:0xa7:        PID: 13248
01:41:46:WU02:FS00:0xa7:        CWD: C:\Users\voris\AppData\Roaming\FAHClient\work
01:41:46:WU02:FS00:0xa7:******************************** Build - libFAH ********************************
01:41:46:WU02:FS00:0xa7:    Version: 0.0.18
01:41:46:WU02:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
01:41:46:WU02:FS00:0xa7:  Copyright: 2019 foldingathome.org
01:41:46:WU02:FS00:0xa7:   Homepage: https://foldingathome.org/
01:41:46:WU02:FS00:0xa7:       Date: Oct 26 2019
01:41:46:WU02:FS00:0xa7:       Time: 01:52:30
01:41:46:WU02:FS00:0xa7:   Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
01:41:46:WU02:FS00:0xa7:     Branch: master
01:41:46:WU02:FS00:0xa7:   Compiler: Visual C++ 2008
01:41:46:WU02:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
01:41:46:WU02:FS00:0xa7:   Platform: win32 10
01:41:46:WU02:FS00:0xa7:       Bits: 64
01:41:46:WU02:FS00:0xa7:       Mode: Release
01:41:46:WU02:FS00:0xa7:************************************ Build *************************************
01:41:46:WU02:FS00:0xa7:       SIMD: avx_256
01:41:46:WU02:FS00:0xa7:********************************************************************************
01:41:46:WU02:FS00:0xa7:Project: 14584 (Run 0, Clone 708, Gen 105)
01:41:46:WU02:FS00:0xa7:Unit: 0x0000007a0d5262775e7a6b601564d77a
01:41:46:WU02:FS00:0xa7:Digital signatures verified
01:41:46:WU02:FS00:0xa7:Reducing thread count from 7 to 6 to avoid domain decomposition by a prime number > 3
01:41:46:WU02:FS00:0xa7:Calling: mdrun -s frame105.tpr -o frame105.trr -x frame105.xtc -cpi state.cpt -cpt 15 -nt 6
01:41:46:WU02:FS00:0xa7:Steps: first=26250000 total=250000
01:41:47:WU02:FS00:0xa7:Completed 47682 out of 250000 steps (19%)
01:41:47:WARNING:WU00:FS01:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration
01:41:47:WU00:FS01:Connecting to assign2.foldingathome.org:80
01:41:48:WU00:FS01:Assigned to work server 140.163.4.231
01:41:48:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:Vega 20 [Radeon VII] from 140.163.4.231
01:41:48:WU00:FS01:Connecting to 140.163.4.231:8080
01:42:25:WU00:FS01:Downloading 4.53MiB
01:42:30:WU00:FS01:Download complete
01:42:30:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:11748 run:0 clone:1068 gen:17 core:0x22 unit:0x0000002a8ca304e75e6a7fe4a8cf7860
01:42:30:WU00:FS01:Starting
01:42:30:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\voris\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 6708 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
01:42:30:WU00:FS01:Started FahCore on PID 11952
01:42:30:WU00:FS01:Core PID:13748
01:42:30:WU00:FS01:FahCore 0x22 started

[PantherX]

It seems that you have configured your CPU and GPU to fold only when idle. That's okay if that's what you want.

Currently, the demand of GPU WUs have exceeded the supply of GPU WUs but work is being done to fix that. Near the bottom of your log, your GPU did get a WU:
01:42:30:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:11748 run:0 clone:1068 gen:17 core:0x22 unit:0x0000002a8ca304e75e6a7fe4a8cf7860

AFAIK, everything looks file. The only suggestion I have is to manually set the number of CPUs from 7 to 6 to remove this warning message:
00:50:13:WU02:FS00:0xa7:Reducing thread count from 7 to 6 to avoid domain decomposition by a prime number > 3
Which can be done by opening up Advanced Control (AKA FAHControl) -> Configure -> Slots Tab -> CPU -> Edit -> Change value from -1 to 6 -> OK -> Save

[ajm]

The power control is on full, which would mean that CPU and GPU should be working all the time, but there are idle flags for both of them. The overall effect is that CPU and GPU will work only when the machine is idle. If you don't want this, or only for the CPU, you have to remove the idle flag for the GPU in Advanced Control (FAHControl): right clic on the folding slot, untick the check-box "On Idle".

[ShortnBearded]

I do have them set to run only when idle because my system tended to have trouble when it folded when I was using it. I can hear my system kick up when I'm away for a while, but when I come back, my CPU is in the middle of a WU but my GPU has nothing going on. I wasn't sure if this was a problem with my GPU or if there just weren't enough WUs. I have heard that they are having trouble keeping up a workload, but it seems my GPU has been idle for a while. I've only recently gotten the "Failed" message though, so that has me worried.

[bruce]

FAILED generaly means you're overclocking or you have defective hardware. Drop the OC.

Please stop dumping good projects.

[ShortnBearded]

I would have thought overclocking would help. I didn't realize it would cause a problem. I'll see if that helps.

[ajm]

It can help only as long as it doesn't cause any error whatsoever. For games, small errors are of no consequence. For FAH, the slightest one will make the WU fail.

[NormalDiffusion]

I would have thought overclocking would help. I didn't realize it would cause a problem. I'll see if that helps.

The RVII is quite picky... Leave her at stock frequency (1801 MHz), but you can undervolt slightly. Be careful, she won't take as much as an undervolt as for games or rendering... Mine is 1132mV stock; for rendering/gaming 987mV, for F@H 1005mV...

Edit: to test settings, you can use FAHBench.
There is an unofficial build with Core22 for Windows and real work unit.
https://www.file-upload.net/download-13 ... n.zip.html

[MeeLee]

I saw most AMD GPUs are tuned pretty close to their max rated frequencies, and min rated wattage. You could get 10% lower power consumption, and a slight overclock; but it's nowhere near Nvidia performance.
With the newest AMD BIOS updates, to get more performance out of their 5600/5700XT GPUs, for increased VRAM speeds (14Gbps), things get even tighter.

An overclock that works for a game with some minor glitches, might crash a WU on FAH.

[ShortnBearded]

Thanks for all of your help. I turned off my overclock and my GPU is folding now.