Fedora Silverblue using podman/docker fah-gpu-amd: No OpenCl support detected.
Posted: Sun Mar 10, 2024 9:53 pm
I might have a bit of an unusual setup, but all things considered, it should be working. I am running the docker container version of folding at home on podman in a Fedora Silverblue system with ROCm. The container ignores my GPU whenever I try to run it. This is the command I used to start the container:
Here is a snippet from the container logs (including my config):
I have a Fedora Silverblue system that has the ROCm packages layered onto the OS. These are the ROCm packages that are in the Fedora 39 repos. Basically, I ran this command:
Here is the output of rocm-clinfo:
I also ran clinfo to get evidence that OpenCL should indeed be working:
This should have everything it needs to have a functioning GPU be given to the container and use opencl for compute. I had this system working on arch linux with no major problems. I don't know if I'm missing something here or if there is an issue that I would need to resolve to get this to work. If not, I might submit this as an issue on github. If I need to provide more logs, let me know.
Code: Select all
podman run -it \
--device=/dev/kfd \
--device=/dev/dri \
--security-opt seccomp=unconfined \
--group-add video \
--name fah0 \
-d \
--userns keep-id \
--volume $HOME/fah:/fah:Z \
foldingathome/fah-gpu-amd:latest
Code: Select all
21:08:31:Read GPUs.txt
21:08:31:******************************* libFAH ********************************
21:08:31: Date: Oct 20 2020
21:08:31: Time: 20:36:39
21:08:31: Revision: 5ca109d295a6245e2a2f590b3d0085ad5e567aeb
21:08:31: Branch: master
21:08:31: Compiler: GNU 8.3.0
21:08:31: Options: -faligned-new -std=c++11 -fsigned-char -ffunction-sections
21:08:31: -fdata-sections -O3 -funroll-loops -fno-pie
21:08:31: Platform: linux2 5.8.0-1-amd64
21:08:31: Bits: 64
21:08:31: Mode: Release
21:08:31:****************************** FAHClient ******************************
21:08:31: Version: 7.6.21
21:08:31: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:08:31: Copyright: 2020 foldingathome.org
21:08:31: Homepage: https://foldingathome.org/
21:08:31: Date: Oct 20 2020
21:08:31: Time: 20:39:00
21:08:31: Revision: 6efbf0e138e22d3963e6a291f78dcb9c6422a278
21:08:31: Branch: master
21:08:31: Compiler: GNU 8.3.0
21:08:31: Options: -faligned-new -std=c++11 -fsigned-char -ffunction-sections
21:08:31: -fdata-sections -O3 -funroll-loops -fno-pie
21:08:31: Platform: linux2 5.8.0-1-amd64
21:08:31: Bits: 64
21:08:31: Mode: Release
21:08:31: Args: --chdir /fah
21:08:31: Config: /fah/config.xml
21:08:31:******************************** CBang ********************************
21:08:31: Date: Oct 20 2020
21:08:31: Time: 18:37:59
21:08:31: Revision: 7e4ce85225d7eaeb775e87c31740181ca603de60
21:08:31: Branch: master
21:08:31: Compiler: GNU 8.3.0
21:08:31: Options: -faligned-new -std=c++11 -fsigned-char -ffunction-sections
21:08:31: -fdata-sections -O3 -funroll-loops -fno-pie -fPIC
21:08:31: Platform: linux2 5.8.0-1-amd64
21:08:31: Bits: 64
21:08:31: Mode: Release
21:08:31:******************************* System ********************************
21:08:31: CPU: 12th Gen Intel(R) Core(TM) i5-12600K
21:08:31: CPU ID: GenuineIntel Family 6 Model 151 Stepping 2
21:08:31: CPUs: 16
21:08:31: Memory: 31.12GiB
21:08:31:Free Memory: 26.53GiB
21:08:31: Threads: POSIX_THREADS
21:08:31: OS Version: 6.7
21:08:31:Has Battery: false
21:08:31: On Battery: false
21:08:31: UTC Offset: 0
21:08:31: PID: 1
21:08:31: CWD: /fah
21:08:31: OS: Linux 6.7.7-200.fc39.x86_64 x86_64
21:08:31: OS Arch: AMD64
21:08:31: GPUs: 1
21:08:31: GPU 0: Bus:3 Slot:0 Func:0 AMD:8 Navi 22 XT-XL [Radeon RX
21:08:31: 6700/6700XT/6800M]
21:08:31: CUDA: Not detected: Failed to open dynamic library 'libcuda.so':
21:08:31: libcuda.so: cannot open shared object file: No such file or
21:08:31: directory
21:08:31:***********************************************************************
21:08:31:<config>
21:08:31: <!-- Client Control -->
21:08:31: <exit-when-done v='true'/>
21:08:31:
21:08:31: <!-- Folding Slot Configuration -->
21:08:31: <disable-viz v='true'/>
21:08:31:
21:08:31: <!-- GUI -->
21:08:31: <gui-enabled v='false'/>
21:08:31:
21:08:31: <!-- Slot Control -->
21:08:31: <power v='full'/>
21:08:31:
21:08:31: <!-- User Information -->
21:08:31: <passkey v='*****'/>
21:08:31: <user v='alienassasin3'/>
21:08:31:
21:08:31: <!-- Web Server -->
21:08:31: <web-enable v='false'/>
21:08:31:
21:08:31: <!-- Folding Slots -->
21:08:31: <slot id='0' type='GPU'>
21:08:31: <pci-bus v='3'/>
21:08:31: <pci-slot v='0'/>
21:08:31: </slot>
21:08:31: <slot id='1' type='CPU'>
21:08:31: <cpus v='15'/>
21:08:31: </slot>
21:08:31:</config>
21:08:31:Trying to access database...
21:08:31:Successfully acquired database lock
21:08:31:WARNING:FS00:No CUDA or OpenCL 1.2+ support detected for GPU slot 00: gpu:3:0 Navi 22 XT-XL [Radeon RX 6700/6700XT/6800M]. Disabling.
21:08:31:FS01:Initialized folding slot 01: cpu:15
21:08:31:WU00:FS01:Starting
21:08:31:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /fah/cores/cores.foldingathome.org/lin/64bit-avx2-256/a8-0.0.12/Core_a8.fah/FahCore_a8 -dir 00 -suffix 01 -version 706 -lifeline 1 -checkpoint 15 -np 15
21:08:31:WU00:FS01:Started FahCore on PID 10
21:08:31:WU00:FS01:Core PID:14
21:08:31:WU00:FS01:FahCore 0xa8 started
21:08:32:WU00:FS01:0xa8:*********************** Log Started 2024-03-10T21:08:31Z ***********************
21:08:32:WU00:FS01:0xa8:************************** Gromacs Folding@home Core ***************************
21:08:32:WU00:FS01:0xa8: Core: Gromacs
21:08:32:WU00:FS01:0xa8: Type: 0xa8
21:08:32:WU00:FS01:0xa8: Version: 0.0.12
21:08:32:WU00:FS01:0xa8: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:08:32:WU00:FS01:0xa8: Copyright: 2020 foldingathome.org
21:08:32:WU00:FS01:0xa8: Homepage: https://foldingathome.org/
21:08:32:WU00:FS01:0xa8: Date: Jan 16 2021
21:08:32:WU00:FS01:0xa8: Time: 19:24:44
21:08:32:WU00:FS01:0xa8: Compiler: GNU 8.3.0
21:08:32:WU00:FS01:0xa8: Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
21:08:32:WU00:FS01:0xa8: -fdata-sections -O3 -funroll-loops -fno-pie
21:08:32:WU00:FS01:0xa8: Platform: linux2 4.15.0-128-generic
21:08:32:WU00:FS01:0xa8: Bits: 64
21:08:32:WU00:FS01:0xa8: Mode: Release
21:08:32:WU00:FS01:0xa8: SIMD: avx2_256
21:08:32:WU00:FS01:0xa8: OpenMP: ON
21:08:32:WU00:FS01:0xa8: CUDA: OFF
21:08:32:WU00:FS01:0xa8: Args: -dir 00 -suffix 01 -version 706 -lifeline 10 -checkpoint 15 -np 15
21:08:32:WU00:FS01:0xa8:************************************ libFAH ************************************
21:08:32:WU00:FS01:0xa8: Date: Jan 16 2021
21:08:32:WU00:FS01:0xa8: Time: 19:21:38
21:08:32:WU00:FS01:0xa8: Compiler: GNU 8.3.0
21:08:32:WU00:FS01:0xa8: Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
21:08:32:WU00:FS01:0xa8: -fdata-sections -O3 -funroll-loops -fno-pie
21:08:32:WU00:FS01:0xa8: Platform: linux2 4.15.0-128-generic
21:08:32:WU00:FS01:0xa8: Bits: 64
21:08:32:WU00:FS01:0xa8: Mode: Release
21:08:32:WU00:FS01:0xa8:************************************ CBang *************************************
21:08:32:WU00:FS01:0xa8: Date: Jan 16 2021
21:08:32:WU00:FS01:0xa8: Time: 19:21:24
21:08:32:WU00:FS01:0xa8: Compiler: GNU 8.3.0
21:08:32:WU00:FS01:0xa8: Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
21:08:32:WU00:FS01:0xa8: -fdata-sections -O3 -funroll-loops -fno-pie -fPIC
21:08:32:WU00:FS01:0xa8: Platform: linux2 4.15.0-128-generic
21:08:32:WU00:FS01:0xa8: Bits: 64
21:08:32:WU00:FS01:0xa8: Mode: Release
21:08:32:WU00:FS01:0xa8:************************************ System ************************************
21:08:32:WU00:FS01:0xa8: CPU: 12th Gen Intel(R) Core(TM) i5-12600K
21:08:32:WU00:FS01:0xa8: CPU ID: GenuineIntel Family 6 Model 151 Stepping 2
21:08:32:WU00:FS01:0xa8: CPUs: 16
21:08:32:WU00:FS01:0xa8: Memory: 31.12GiB
21:08:32:WU00:FS01:0xa8:Free Memory: 26.52GiB
21:08:32:WU00:FS01:0xa8: Threads: POSIX_THREADS
21:08:32:WU00:FS01:0xa8: OS Version: 6.7
21:08:32:WU00:FS01:0xa8:Has Battery: false
21:08:32:WU00:FS01:0xa8: On Battery: false
21:08:32:WU00:FS01:0xa8: UTC Offset: 0
21:08:32:WU00:FS01:0xa8: PID: 14
21:08:32:WU00:FS01:0xa8: CWD: /fah/work
21:08:32:WU00:FS01:0xa8:********************************************************************************
21:08:32:WU00:FS01:0xa8:Project: 18800 (Run 0, Clone 85, Gen 98)
21:08:32:WU00:FS01:0xa8:Unit: 0x00000000000000000000000000000000
21:08:32:WU00:FS01:0xa8:Digital signatures verified
Code: Select all
rpm-ostree install rocm-hip rocm-opencl rocm-clinfoCode: Select all
Number of platforms: 1
Platform Profile: FULL_PROFILE
Platform Version: OpenCL 2.1 AMD-APP (3590.0)
Platform Name: AMD Accelerated Parallel Processing
Platform Vendor: Advanced Micro Devices, Inc.
Platform Extensions: cl_khr_icd cl_amd_event_callback
Platform Name: AMD Accelerated Parallel Processing
Number of devices: 1
Device Type: CL_DEVICE_TYPE_GPU
Vendor ID: 1002h
Board name: AMD Radeon RX 6750 XT
Device Topology: PCI[ B#3, D#0, F#0 ]
Max compute units: 20
Max work items dimensions: 3
Max work items[0]: 1024
Max work items[1]: 1024
Max work items[2]: 1024
Max work group size: 256
Preferred vector width char: 4
Preferred vector width short: 2
Preferred vector width int: 1
Preferred vector width long: 1
Preferred vector width float: 1
Preferred vector width double: 1
Native vector width char: 4
Native vector width short: 2
Native vector width int: 1
Native vector width long: 1
Native vector width float: 1
Native vector width double: 1
Max clock frequency: 2880Mhz
Address bits: 64
Max memory allocation: 10937905968
Image support: Yes
Max number of images read arguments: 128
Max number of images write arguments: 8
Max image 2D width: 16384
Max image 2D height: 16384
Max image 3D width: 16384
Max image 3D height: 16384
Max image 3D depth: 8192
Max samplers within kernel: 16
Max size of kernel argument: 1024
Alignment (bits) of base address: 1024
Minimum alignment (bytes) for any datatype: 128
Single precision floating point capability
Denorms: Yes
Quiet NaNs: Yes
Round to nearest even: Yes
Round to zero: Yes
Round to +ve and infinity: Yes
IEEE754-2008 fused multiply-add: Yes
Cache type: Read/Write
Cache line size: 64
Cache size: 16384
Global memory size: 12868124672
Constant buffer size: 10937905968
Max number of constant args: 8
Local memory type: Scratchpad
Local memory size: 65536
Max pipe arguments: 16
Max pipe active reservations: 16
Max pipe packet size: 2347971376
Max global variable size: 10937905968
Max global variable preferred total size: 12868124672
Max read/write image args: 64
Max on device events: 1024
Queue on device max size: 8388608
Max on device queues: 1
Queue on device preferred size: 262144
SVM capabilities:
Coarse grain buffer: Yes
Fine grain buffer: Yes
Fine grain system: No
Atomics: No
Preferred platform atomic alignment: 0
Preferred global atomic alignment: 0
Preferred local atomic alignment: 0
Kernel Preferred work group size multiple: 32
Error correction support: 0
Unified memory for Host and Device: 0
Profiling timer resolution: 1
Device endianess: Little
Available: Yes
Compiler available: Yes
Execution capabilities:
Execute OpenCL kernels: Yes
Execute native function: No
Queue on Host properties:
Out-of-Order: No
Profiling : Yes
Queue on Device properties:
Out-of-Order: Yes
Profiling : Yes
Platform ID: 0x7f2c6532d808
Name: gfx1031
Vendor: Advanced Micro Devices, Inc.
Device OpenCL C version: OpenCL C 2.0
Driver version: 3590.0 (HSA1.1,LC)
Profile: FULL_PROFILE
Version: OpenCL 2.0
Extensions: cl_khr_fp64 cl_khr_global_int32_base_atomics cl_khr_global_int32_extended_atomics cl_khr_local_int32_base_atomics cl_khr_local_int32_extended_atomics cl_khr_int64_base_atomics cl_khr_int64_extended_atomics cl_khr_3d_image_writes cl_khr_byte_addressable_store cl_khr_fp16 cl_khr_gl_sharing cl_amd_device_attribute_query cl_amd_media_ops cl_amd_media_ops2 cl_khr_image2d_from_buffer cl_khr_subgroups cl_khr_depth_images cl_amd_copy_buffer_p2p cl_amd_assembly_program
Code: Select all
Number of platforms 1
Platform Name AMD Accelerated Parallel Processing
Platform Vendor Advanced Micro Devices, Inc.
Platform Version OpenCL 2.1 AMD-APP (3590.0)
Platform Profile FULL_PROFILE
Platform Extensions cl_khr_icd cl_amd_event_callback
Platform Extensions function suffix AMD
Platform Host timer resolution 1ns
Platform Name AMD Accelerated Parallel Processing
Number of devices 1
Device Name gfx1031
Device Vendor Advanced Micro Devices, Inc.
Device Vendor ID 0x1002
Device Version OpenCL 2.0
Driver Version 3590.0 (HSA1.1,LC)
Device OpenCL C Version OpenCL C 2.0
Device Type GPU
Device Board Name (AMD) AMD Radeon RX 6750 XT
Device PCI-e ID (AMD) 0x73df
Device Topology (AMD) PCI-E, 0000:03:00.0
Device Profile FULL_PROFILE
Device Available Yes
Compiler Available Yes
Linker Available Yes
Max compute units 20
SIMD per compute unit (AMD) 4
SIMD width (AMD) 32
SIMD instruction width (AMD) 1
Max clock frequency 2880MHz
Graphics IP (AMD) 10.3
Device Partition (core)
Max number of sub-devices 20
Supported partition types None
Supported affinity domains (n/a)
Max work item dimensions 3
Max work item sizes 1024x1024x1024
Max work group size 256
Preferred work group size (AMD) 256
Max work group size (AMD) 1024
Preferred work group size multiple (kernel) 32
Wavefront width (AMD) 32
Preferred / native vector sizes
char 4 / 4
short 2 / 2
int 1 / 1
long 1 / 1
half 1 / 1 (cl_khr_fp16)
float 1 / 1
double 1 / 1 (cl_khr_fp64)
Half-precision Floating-point support (cl_khr_fp16)
Denormals Yes
Infinity and NANs Yes
Round to nearest Yes
Round to zero Yes
Round to infinity Yes
IEEE754-2008 fused multiply-add Yes
Support is emulated in software No
Single-precision Floating-point support (core)
Denormals Yes
Infinity and NANs Yes
Round to nearest Yes
Round to zero Yes
Round to infinity Yes
IEEE754-2008 fused multiply-add Yes
Support is emulated in software No
Correctly-rounded divide and sqrt operations Yes
Double-precision Floating-point support (cl_khr_fp64)
Denormals Yes
Infinity and NANs Yes
Round to nearest Yes
Round to zero Yes
Round to infinity Yes
IEEE754-2008 fused multiply-add Yes
Support is emulated in software No
Address bits 64, Little-Endian
Global memory size 12868124672 (11.98GiB)
Global free memory (AMD) 12386304 (11.81GiB) 12386304 (11.81GiB)
Global memory channels (AMD) 6
Global memory banks per channel (AMD) 4
Global memory bank width (AMD) 256 bytes
Error Correction support No
Max memory allocation 10937905968 (10.19GiB)
Unified memory for Host and Device No
Shared Virtual Memory (SVM) capabilities (core)
Coarse-grained buffer sharing Yes
Fine-grained buffer sharing Yes
Fine-grained system sharing No
Atomics No
Minimum alignment for any data type 128 bytes
Alignment of base address 1024 bits (128 bytes)
Preferred alignment for atomics
SVM 0 bytes
Global 0 bytes
Local 0 bytes
Max size for global variable 10937905968 (10.19GiB)
Preferred total size of global vars 12868124672 (11.98GiB)
Global Memory cache type Read/Write
Global Memory cache size 16384 (16KiB)
Global Memory cache line size 64 bytes
Image support Yes
Max number of samplers per kernel 16
Max size for 1D images from buffer 134217728 pixels
Max 1D or 2D image array size 8192 images
Base address alignment for 2D image buffers 256 bytes
Pitch alignment for 2D image buffers 256 pixels
Max 2D image size 16384x16384 pixels
Max 3D image size 16384x16384x8192 pixels
Max number of read image args 128
Max number of write image args 8
Max number of read/write image args 64
Max number of pipe args 16
Max active pipe reservations 16
Max pipe packet size 2347971376 (2.187GiB)
Local memory type Local
Local memory size 65536 (64KiB)
Local memory size per CU (AMD) 65536 (64KiB)
Local memory banks (AMD) 32
Max number of constant args 8
Max constant buffer size 10937905968 (10.19GiB)
Preferred constant buffer size (AMD) 16384 (16KiB)
Max size of kernel argument 1024
Queue properties (on host)
Out-of-order execution No
Profiling Yes
Queue properties (on device)
Out-of-order execution Yes
Profiling Yes
Preferred size 262144 (256KiB)
Max size 8388608 (8MiB)
Max queues on device 1
Max events on device 1024
Prefer user sync for interop Yes
Number of P2P devices (AMD) 0
Profiling timer resolution 1ns
Profiling timer offset since Epoch (AMD) 0ns (Wed Dec 31 16:00:00 1969)
Execution capabilities
Run OpenCL kernels Yes
Run native kernels No
Thread trace supported (AMD) No
Number of async queues (AMD) 8
Max real-time compute queues (AMD) 8
Max real-time compute units (AMD) 20
printf() buffer size 4194304 (4MiB)
Built-in kernels (n/a)
Device Extensions cl_khr_fp64 cl_khr_global_int32_base_atomics cl_khr_global_int32_extended_atomics cl_khr_local_int32_base_atomics cl_khr_local_int32_extended_atomics cl_khr_int64_base_atomics cl_khr_int64_extended_atomics cl_khr_3d_image_writes cl_khr_byte_addressable_store cl_khr_fp16 cl_khr_gl_sharing cl_amd_device_attribute_query cl_amd_media_ops cl_amd_media_ops2 cl_khr_image2d_from_buffer cl_khr_subgroups cl_khr_depth_images cl_amd_copy_buffer_p2p cl_amd_assembly_program
NULL platform behavior
clGetPlatformInfo(NULL, CL_PLATFORM_NAME, ...) AMD Accelerated Parallel Processing
clGetDeviceIDs(NULL, CL_DEVICE_TYPE_ALL, ...) Success [AMD]
clCreateContext(NULL, ...) [default] Success [AMD]
clCreateContextFromType(NULL, CL_DEVICE_TYPE_DEFAULT) Success (1)
Platform Name AMD Accelerated Parallel Processing
Device Name gfx1031
clCreateContextFromType(NULL, CL_DEVICE_TYPE_CPU) No devices found in platform
clCreateContextFromType(NULL, CL_DEVICE_TYPE_GPU) Success (1)
Platform Name AMD Accelerated Parallel Processing
Device Name gfx1031
clCreateContextFromType(NULL, CL_DEVICE_TYPE_ACCELERATOR) No devices found in platform
clCreateContextFromType(NULL, CL_DEVICE_TYPE_CUSTOM) No devices found in platform
clCreateContextFromType(NULL, CL_DEVICE_TYPE_ALL) Success (1)
Platform Name AMD Accelerated Parallel Processing
Device Name gfx1031
ICD loader properties
ICD loader Name OpenCL ICD Loader
ICD loader Vendor OCL Icd free software
ICD loader Version 2.3.2
ICD loader Profile OpenCL 3.0