I am having issues on my Tesla P4 - I am on the 11.7 cuda drivers and most recent nvidia drivers. Rebooted multiple times, clean install of newest drviers, and checked the card, no faults found. Any ideas?
21:57:34:FS05:Initialized folding slot 05: gpu:8:0 GP104GL [Tesla P4] 5704
21:58:22:WU00:FS05:Starting
21:58:22:WU00:FS05:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 3904 -checkpoint 30 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
21:58:22:WU00:FS05:Started FahCore on PID 18172
21:58:24:WU00:FS05:Core PID:18448
21:58:24:WU00:FS05:FahCore 0x22 started
21:58:26:WU00:FS05:0x22:*********************** Log Started 2022-08-19T21:58:26Z ***********************
21:58:26:WU00:FS05:0x22:*************************** Core22 Folding@home Core ***************************
21:58:26:WU00:FS05:0x22: Core: Core22
21:58:26:WU00:FS05:0x22: Type: 0x22
21:58:26:WU00:FS05:0x22: Version: 0.0.20
21:58:26:WU00:FS05:0x22: Author: Joseph Coffland <
joseph@cauldrondevelopment.com>
21:58:26:WU00:FS05:0x22: Copyright: 2020 foldingathome.org
21:58:26:WU00:FS05:0x22: Homepage:
https://foldingathome.org/
21:58:26:WU00:FS05:0x22: Date: Jan 20 2022
21:58:26:WU00:FS05:0x22: Time: 01:15:36
21:58:26:WU00:FS05:0x22: Revision: 3f211b8a4346514edbff34e3cb1c0e0ec951373c
21:58:26:WU00:FS05:0x22: Branch: HEAD
21:58:26:WU00:FS05:0x22: Compiler: Visual C++
21:58:26:WU00:FS05:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
21:58:26:WU00:FS05:0x22: -DOPENMM_VERSION="\"7.7.0\""
21:58:26:WU00:FS05:0x22: Platform: win32 10
21:58:26:WU00:FS05:0x22: Bits: 64
21:58:26:WU00:FS05:0x22: Mode: Release
21:58:26:WU00:FS05:0x22:Maintainers: John Chodera <
john.chodera@choderalab.org> and Peter Eastman
21:58:26:WU00:FS05:0x22: <
peastman@stanford.edu>
21:58:26:WU00:FS05:0x22: Args: -dir 00 -suffix 01 -version 706 -lifeline 18172 -checkpoint 30
21:58:26:WU00:FS05:0x22: -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
21:58:26:WU00:FS05:0x22: nvidia -gpu 0 -gpu-usage 100
21:58:26:WU00:FS05:0x22:************************************ libFAH ************************************
21:58:26:WU00:FS05:0x22: Date: Jan 20 2022
21:58:26:WU00:FS05:0x22: Time: 01:14:17
21:58:26:WU00:FS05:0x22: Revision: 9f4ad694e75c2350d4bb6b8b5b769ba27e483a2f
21:58:26:WU00:FS05:0x22: Branch: HEAD
21:58:26:WU00:FS05:0x22: Compiler: Visual C++
21:58:26:WU00:FS05:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
21:58:26:WU00:FS05:0x22: Platform: win32 10
21:58:26:WU00:FS05:0x22: Bits: 64
21:58:26:WU00:FS05:0x22: Mode: Release
21:58:26:WU00:FS05:0x22:************************************ CBang *************************************
21:58:26:WU00:FS05:0x22: Date: Jan 20 2022
21:58:26:WU00:FS05:0x22: Time: 01:13:20
21:58:26:WU00:FS05:0x22: Revision: ab023d155b446906d55b0f6c9a1eedeea04f7a1a
21:58:26:WU00:FS05:0x22: Branch: HEAD
21:58:26:WU00:FS05:0x22: Compiler: Visual C++
21:58:26:WU00:FS05:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
21:58:26:WU00:FS05:0x22: Platform: win32 10
21:58:26:WU00:FS05:0x22: Bits: 64
21:58:26:WU00:FS05:0x22: Mode: Release
21:58:26:WU00:FS05:0x22:************************************ System ************************************
21:58:26:WU00:FS05:0x22: CPU: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz
21:58:26:WU00:FS05:0x22: CPU ID: GenuineIntel Family 6 Model 79 Stepping 1
21:58:26:WU00:FS05:0x22: CPUs: 28
21:58:26:WU00:FS05:0x22: Memory: 127.87GiB
21:58:26:WU00:FS05:0x22:Free Memory: 111.01GiB
21:58:26:WU00:FS05:0x22: Threads: WINDOWS_THREADS
21:58:26:WU00:FS05:0x22: OS Version: 6.2
21:58:26:WU00:FS05:0x22:Has Battery: false
21:58:26:WU00:FS05:0x22: On Battery: false
21:58:26:WU00:FS05:0x22: UTC Offset: -4
21:58:26:WU00:FS05:0x22: PID: 18448
21:58:26:WU00:FS05:0x22: CWD: C:\ProgramData\FAHClient\work
21:58:26:WU00:FS05:0x22:************************************ OpenMM ************************************
21:58:27:WU00:FS05:0x22: Version: 7.7.0
21:58:27:WU00:FS05:0x22:********************************************************************************
21:58:27:WU00:FS05:0x22:Project: 17918 (Run 929, Clone 0, Gen 58)
21:58:27:WU00:FS05:0x22:Digital signatures verified
21:58:27:WU00:FS05:0x22:Folding@home GPU Core22 Folding@home Core
21:58:27:WU00:FS05:0x22:Version 0.0.20
21:58:27:WU00:FS05:0x22: Checkpoint write interval: 50000 steps (5%) [20 total]
21:58:27:WU00:FS05:0x22: JSON viewer frame write interval: 10000 steps (1%) [100 total]
21:58:27:WU00:FS05:0x22: XTC frame write interval: 25000 steps (2.5%) [40 total]
21:58:27:WU00:FS05:0x22: Global context and integrator variables write interval: disabled
21:58:30:WU00:FS05:0x22:There are 4 platforms available.
21:58:30:WU00:FS05:0x22:Platform 0: Reference
21:58:30:WU00:FS05:0x22:Platform 1: CPU
21:58:30:WU00:FS05:0x22:Platform 2: OpenCL
21:58:30:WU00:FS05:0x22: opencl-device 0 specified
21:58:30:WU00:FS05:0x22:Platform 3: CUDA
21:58:30:WU00:FS05:0x22: cuda-device 0 specified
21:58:37:WU00:FS05:0x22:ERROR:Guru Meditation #ef03d1478e72f3a1.dc8b1b8de3f84560 (138740557.138740557) '00/01/system.xml'
21:58:37:WARNING:WU00:FS05:FahCore returned: BAD_FRAME_CHECKSUM (112 = 0x70)
21:58:37:WARNING:WU00:FS05:Fatal error, dumping
21:58:37:WU00:FS05:Sending unit results: id:00 state:SEND error:DUMPED project:17918 run:929 clone:0 gen:58 core:0x22 unit:0x000000000000003a000045fe000003a1
21:58:37:WU00:FS05:Uploading 15.50MiB to 128.174.73.78
21:58:37:WU00:FS05:Connecting to 128.174.73.78:8080
21:58:37:WU03:FS05:Connecting to assign1.foldingathome.org:80
21:58:38:WU03:FS05:Assigned to work server 128.174.73.78
21:58:38:WU03:FS05:Requesting new work unit for slot 05: gpu:8:0 GP104GL [Tesla P4] 5704 from 128.174.73.78
21:58:38:WU03:FS05:Connecting to 128.174.73.78:8080
21:58:43:WU00:FS05:Upload 70.14%
21:58:45:WU00:FS05:Upload complete
21:58:45:WU00:FS05:Server responded WORK_ACK (400)
21:58:45:WU00:FS05:Cleaning up
21:58:48:WU03:FS05:Downloading 23.63MiB
21:58:51:WU03:FS05:Download complete
21:58:51:WU03:FS05:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:17916 run:907 clone:0 gen:79 core:0x22 unit:0x000000000000004f000045fc0000038b
21:58:51:WU03:FS05:Starting
21:58:51:WU03:FS05:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/FahCore_22.exe -dir 03 -suffix 01 -version 706 -lifeline 3904 -checkpoint 30 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
21:58:51:WU03:FS05:Started FahCore on PID 19084
21:58:52:WU03:FS05:Core PID:19108
21:58:52:WU03:FS05:FahCore 0x22 started
21:58:52:WU03:FS05:0x22:*********************** Log Started 2022-08-19T21:58:52Z ***********************
21:58:52:WU03:FS05:0x22:*************************** Core22 Folding@home Core ***************************
21:58:52:WU03:FS05:0x22: Core: Core22
21:58:52:WU03:FS05:0x22: Type: 0x22
21:58:52:WU03:FS05:0x22: Version: 0.0.20
21:58:52:WU03:FS05:0x22: Author: Joseph Coffland <
joseph@cauldrondevelopment.com>
21:58:52:WU03:FS05:0x22: Copyright: 2020 foldingathome.org
21:58:52:WU03:FS05:0x22: Homepage:
https://foldingathome.org/
21:58:52:WU03:FS05:0x22: Date: Jan 20 2022
21:58:52:WU03:FS05:0x22: Time: 01:15:36
21:58:52:WU03:FS05:0x22: Revision: 3f211b8a4346514edbff34e3cb1c0e0ec951373c
21:58:52:WU03:FS05:0x22: Branch: HEAD
21:58:52:WU03:FS05:0x22: Compiler: Visual C++
21:58:52:WU03:FS05:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
21:58:52:WU03:FS05:0x22: -DOPENMM_VERSION="\"7.7.0\""
21:58:52:WU03:FS05:0x22: Platform: win32 10
21:58:52:WU03:FS05:0x22: Bits: 64
21:58:52:WU03:FS05:0x22: Mode: Release
21:58:52:WU03:FS05:0x22:Maintainers: John Chodera <
john.chodera@choderalab.org> and Peter Eastman
21:58:52:WU03:FS05:0x22: <
peastman@stanford.edu>
21:58:52:WU03:FS05:0x22: Args: -dir 03 -suffix 01 -version 706 -lifeline 19084 -checkpoint 30
21:58:52:WU03:FS05:0x22: -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
21:58:52:WU03:FS05:0x22: nvidia -gpu 0 -gpu-usage 100
21:58:52:WU03:FS05:0x22:************************************ libFAH ************************************
21:58:52:WU03:FS05:0x22: Date: Jan 20 2022
21:58:52:WU03:FS05:0x22: Time: 01:14:17
21:58:52:WU03:FS05:0x22: Revision: 9f4ad694e75c2350d4bb6b8b5b769ba27e483a2f
21:58:52:WU03:FS05:0x22: Branch: HEAD
21:58:52:WU03:FS05:0x22: Compiler: Visual C++
21:58:52:WU03:FS05:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
21:58:52:WU03:FS05:0x22: Platform: win32 10
21:58:52:WU03:FS05:0x22: Bits: 64
21:58:52:WU03:FS05:0x22: Mode: Release
21:58:52:WU03:FS05:0x22:************************************ CBang *************************************
21:58:52:WU03:FS05:0x22: Date: Jan 20 2022
21:58:52:WU03:FS05:0x22: Time: 01:13:20
21:58:52:WU03:FS05:0x22: Revision: ab023d155b446906d55b0f6c9a1eedeea04f7a1a
21:58:52:WU03:FS05:0x22: Branch: HEAD
21:58:52:WU03:FS05:0x22: Compiler: Visual C++
21:58:52:WU03:FS05:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
21:58:52:WU03:FS05:0x22: Platform: win32 10
21:58:52:WU03:FS05:0x22: Bits: 64
21:58:52:WU03:FS05:0x22: Mode: Release
21:58:52:WU03:FS05:0x22:************************************ System ************************************
21:58:52:WU03:FS05:0x22: CPU: Intel(R) Xeon(R) CPU E5-2650L v4 @ 1.70GHz
21:58:52:WU03:FS05:0x22: CPU ID: GenuineIntel Family 6 Model 79 Stepping 1
21:58:52:WU03:FS05:0x22: CPUs: 28
21:58:52:WU03:FS05:0x22: Memory: 127.87GiB
21:58:52:WU03:FS05:0x22:Free Memory: 111.09GiB
21:58:52:WU03:FS05:0x22: Threads: WINDOWS_THREADS
21:58:52:WU03:FS05:0x22: OS Version: 6.2
21:58:52:WU03:FS05:0x22:Has Battery: false
21:58:52:WU03:FS05:0x22: On Battery: false
21:58:52:WU03:FS05:0x22: UTC Offset: -4
21:58:52:WU03:FS05:0x22: PID: 19108
21:58:52:WU03:FS05:0x22: CWD: C:\ProgramData\FAHClient\work
21:58:52:WU03:FS05:0x22:************************************ OpenMM ************************************
21:58:52:WU03:FS05:0x22: Version: 7.7.0
21:58:52:WU03:FS05:0x22:********************************************************************************
21:58:52:WU03:FS05:0x22:Project: 17916 (Run 907, Clone 0, Gen 79)
21:58:52:WU03:FS05:0x22:Reading tar file core.xml
21:58:52:WU03:FS05:0x22:Reading tar file integrator.xml
21:58:52:WU03:FS05:0x22:Reading tar file state.xml
21:58:54:WU03:FS05:0x22:Reading tar file system.xml
21:58:58:WU03:FS05:0x22:Digital signatures verified
21:58:58:WU03:FS05:0x22:Folding@home GPU Core22 Folding@home Core
21:58:58:WU03:FS05:0x22:Version 0.0.20
21:58:58:WU03:FS05:0x22: Checkpoint write interval: 50000 steps (5%) [20 total]
21:58:58:WU03:FS05:0x22: JSON viewer frame write interval: 10000 steps (1%) [100 total]
21:58:58:WU03:FS05:0x22: XTC frame write interval: 25000 steps (2.5%) [40 total]
21:58:58:WU03:FS05:0x22: Global context and integrator variables write interval: disabled
21:58:58:WU03:FS05:0x22:There are 4 platforms available.
21:58:58:WU03:FS05:0x22:Platform 0: Reference
21:58:58:WU03:FS05:0x22:Platform 1: CPU
21:58:58:WU03:FS05:0x22:Platform 2: OpenCL
21:58:58:WU03:FS05:0x22: opencl-device 0 specified
21:58:58:WU03:FS05:0x22:Platform 3: CUDA
21:58:58:WU03:FS05:0x22: cuda-device 0 specified
22:00:35:WU03:FS05:0x22:Attempting to create CUDA context:
22:00:35:WU03:FS05:0x22: Configuring platform CUDA
22:01:06:WU03:FS05:0x22:ERROR:Discrepancy: Forces are blowing up! 88 0
22:01:06:WU03:FS05:0x22:Saving result file ..\logfile_01.txt
22:01:06:WU03:FS05:0x22:Saving result file science.log
22:01:06:WU03:FS05:0x22:Saving result file state.xml
22:01:13:WU03:FS05:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT