Help with "Core returned WU_STALLED" preventing me from running
Posted: Sun Jul 14, 2024 12:34 am
I am a new folding@home donor and am trying to setup my unraid NAS to use my GTX2060 for folding. I've installed the foldingathome app and the Nvidia-Driver app in unraid. The Nvidia driver is running the "New Feature Branch V555.58.02" although I have also tried v550.100 to see if that changed anything. Based on this tutorial on using nvidia GPUs in dockers https://forums.unraid.net/topic/98978-p ... ia-driver/ I set extra parameters to --runtime=nvidia, NVIDIA_VISIBLE_DEVICES to GPU-eab7e7b0-5142-8b7f-005f-584a0be782ff, and NVIDIA_DRIVER_CAPABILITIES to all. Based on the log it looks like it should be working because it sees the GPU, says that the CUDA and OpenCL are supported, and determines that it is a supported device. When I try and start it however it will complete the download of the task, throw a "Core returned WU_STALLED" warning, stop, and then start the download again in a loop.
Anyone have any suggestions about how to fix this?
Thanks
Anyone have any suggestions about how to fix this?
Thanks
Code: Select all
23:43:44:I1: Version: 8.3.18
23:43:44:I1: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:43:44:I1: Org: foldingathome.org
23:43:44:I1: Copyright: 2023-2024, foldingathome.org
23:43:44:I1: Homepage: https://foldingathome.org/
23:43:44:I1: License: GPL-3.0-or-later
23:43:44:I1: URL: https://v8-3.foldingathome.org/
23:43:44:I1: Date: Jul 12 2024
23:43:44:I1: Time: 13:26:31
23:43:44:I1: Revision: 99ae953ee7b1c0b3070161cfcf9150184f76bd96
23:43:44:I1: Branch: master
23:43:44:I1: Compiler: GNU 8.3.0
23:43:44:I1: Options: -Wsuggest-override -faligned-new -std=c++17 -fsigned-char
23:43:44:I1: -ffunction-sections -fdata-sections -O3 -funroll-loops -fno-pie
23:43:44:I1: Platform: linux 4.19.0-26-cloud-amd64
23:43:44:I1: Bits: 64
23:43:44:I1: Mode: Release
23:43:44:I1: Args: --http-addresses 0.0.0.0:7396 --allow 0/0 --account-token
23:43:44:I1: 065s5065tmNf0tmNFOWY7FOWRVHdqRVHG-iKDG-iu5U --machine-name MEunRaid
23:43:44:I1:****************************** CBang ******************************
23:43:44:I1: Version: 1.7.2
23:43:44:I1: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:43:44:I1: Org: Cauldron Development
23:43:44:I1: Copyright: Cauldron Development, 2003-2024
23:43:44:I1: Homepage: https://cauldrondevelopment.com/
23:43:44:I1: License: LGPL-2.1-or-later
23:43:44:I1: Date: Jun 24 2024
23:43:44:I1: Time: 13:29:44
23:43:44:I1: Revision: 1b05ea96f0ed3043c32b78a66dbf50a9b2002289
23:43:44:I1: Branch: master
23:43:44:I1: Compiler: GNU 8.3.0
23:43:44:I1: Options: -Wsuggest-override -faligned-new -std=c++17 -fsigned-char
23:43:44:I1: -ffunction-sections -fdata-sections -O3 -funroll-loops -fno-pie
23:43:44:I1: -fPIC
23:43:44:I1: Platform: linux 4.19.0-26-cloud-amd64
23:43:44:I1: Bits: 64
23:43:44:I1: Mode: Release
23:43:44:I1:***************************** System ******************************
23:43:44:I1: CPU: Intel(R) Xeon(R) CPU E5-2687W v3 @ 3.10GHz
23:43:44:I1: CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
23:43:44:I1: CPUs: 40
23:43:44:I1: Memory: 251.82GiB
23:43:44:I1:Free Memory: 246.37GiB
23:43:44:I1: OS Version: 6.1
23:43:44:I1:Has Battery: false
23:43:44:I1: On Battery: false
23:43:44:I1: Hostname: MEnas
23:43:44:I1: UTC Offset: -4
23:43:44:I1: PID: 220
23:43:44:I1: CWD: /config
23:43:44:I1: Exec: /app/fah-client
23:43:44:I1:*******************************************************************
23:43:44:I2:<config/>
23:43:44:I1:Opening Database
23:43:44:I1:F@H ID = QY5nm3TshA4M650SVG2GtzmSXVS4aDvLlvd9mfVZ490
23:43:44:I3:Loading default group
23:43:44:I3:Loading default resource group
23:43:44:I1:Listening for HTTP on 0.0.0.0:7396
23:43:44:I3:Loaded 0 wus.
23:43:45:I3:gpus = {
23:43:45:I3: "gpu:02:00:00": {"vendor": 4098, "device": 26667, "type": "amd", "supported": false, "description": "Cape Verde PRO/Venus LE/Tropo LE [HD 8830M/R7 250/M465X]"},
23:43:45:I3: "gpu:06:00:00": {
23:43:45:I3: "vendor": 4318,
23:43:45:I3: "type": "nvidia",
23:43:45:I3: "description": "NVIDIA GeForce RTX 2060",
23:43:45:I3: "uuid": "ff82e70b-4a58-5f00-7f8b-4251b0e7b7ea",
23:43:45:I3: "opencl": {"platform": 0, "device": 0, "compute": "3.0", "driver": "555.58"},
23:43:45:I3: "cuda": {"platform": 0, "device": 0, "compute": "7.5", "driver": "12.5"},
23:43:45:I3: "device": 7939,
23:43:45:I3: "supported": true
23:43:45:I3: }
23:43:45:I3:}
23:43:45:I1:OUT1:> GET https://api.foldingathome.org/machine/QY5nm3TshA4M650SVG2GtzmSXVS4aDvLlvd9mfVZ490 HTTP/1.1
23:43:46:I1:OUT1:< HTTP/1.1 200 HTTP_OK
23:43:46:I1:OUT3:> GET wss://node1.foldingathome.org/ws/client HTTP/1.1
23:43:46:I1:OUT3:< HTTP/1.1 101 HTTP_SWITCHING_PROTOCOLS
23:43:46:I1:Logging into node account
23:44:22:I1:Default:Added new work unit: cpus:1 gpus:gpu:06:00:00
23:44:22:I1:WU28:Requesting WU assignment for user ME62 team 227802
23:44:22:I1:OUT4:> POST https://assign1.foldingathome.org/api/assign HTTP/1.1
23:44:23:I1:OUT4:< HTTP/1.1 200 HTTP_OK
23:44:23:I1:WU28:Received WU assignment bf3ovbEQPSVCgLu3ay2qWR82RodfhQ10_tFAM0SGXtk
23:44:23:I1:WU28:Downloading WU
23:44:23:I1:OUT5:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
23:44:24:I1:WU28:DOWNLOAD 82% 5.67MiB of 6.90MiB
23:44:24:I1:OUT5:< HTTP/1.1 200 HTTP_OK
23:44:24:I1:WU28:Received WU P17650 R91 C1 G60
23:44:25:I1:Loaded cores/openmm-core-23/centos-7.9.2009-64bit/release/fahcore-23-centos-7.9.2009-64bit-release-8.0.3/FahCore_23
23:44:25:I3:WU28:Running FahCore: /config/cores/openmm-core-23/centos-7.9.2009-64bit/release/fahcore-23-centos-7.9.2009-64bit-release-8.0.3/FahCore_23 -dir bf3ovbEQPSVCgLu3ay2qWR82RodfhQ10_tFAM0SGXtk -suffix 01 -version 8.3.18 -lifeline 220 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
23:44:25:I3:WU28:Started FahCore on PID 262
23:44:26:W :WU28:Core returned WU_STALLED (127)
23:44:26:I1:Default:Added new work unit: cpus:1 gpus:gpu:06:00:00
23:44:26:I1:WU28:Sending dump report
23:44:26:I1:WU29:Requesting WU assignment for user ME62 team 227802
23:44:26:I1:OUT6:> POST https://pllwskifah2.mskcc.org/api/results HTTP/1.1
23:44:26:I1:OUT7:> POST https://assign2.foldingathome.org/api/assign HTTP/1.1
23:44:26:I1:OUT7:< HTTP/1.1 200 HTTP_OK
23:44:26:I1:WU29:Received WU assignment bK8IFS3pEKcVGPqfrNYPuJ8lUw1AHMm5fgBzJyeO57c
23:44:26:I1:WU29:Downloading WU
23:44:26:I1:OUT6:< HTTP/1.1 200 HTTP_OK
23:44:26:I1:WU28:Dumped
23:44:26:I1:OUT8:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
23:44:27:I1:WU29:DOWNLOAD 71% 4.87MiB of 6.90MiB
23:44:28:I1:OUT8:< HTTP/1.1 200 HTTP_OK
23:44:28:I1:WU29:Received WU P17649 R13 C0 G195
23:44:28:I3:WU29:Running FahCore: /config/cores/openmm-core-23/centos-7.9.2009-64bit/release/fahcore-23-centos-7.9.2009-64bit-release-8.0.3/FahCore_23 -dir bK8IFS3pEKcVGPqfrNYPuJ8lUw1AHMm5fgBzJyeO57c -suffix 01 -version 8.3.18 -lifeline 220 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
23:44:28:I3:WU29:Started FahCore on PID 263
23:44:29:W :WU29:Core returned WU_STALLED (127)
23:44:29:I1:Default:Added new work unit: cpus:1 gpus:gpu:06:00:00
23:44:29:I1:WU29:Sending dump report
23:44:29:I1:WU30:Requesting WU assignment for user ME62 team 227802
23:44:29:I1:OUT9:> POST https://pllwskifah2.mskcc.org/api/results HTTP/1.1
23:44:29:I1:OUT10:> POST https://assign3.foldingathome.org/api/assign HTTP/1.1
23:44:29:I1:OUT9:< HTTP/1.1 200 HTTP_OK
23:44:29:I1:WU29:Dumped
23:44:29:I1:OUT10:< HTTP/1.1 200 HTTP_OK
23:44:29:I1:WU30:Received WU assignment UobiJ3KSWnziu7cF35CvznSQlBNvdn7QKcJFcmn2oSA
23:44:29:I1:WU30:Downloading WU
23:44:30:I1:OUT11:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
23:44:31:I1:WU30:DOWNLOAD 77% 5.33MiB of 6.90MiB
23:44:31:I1:OUT11:< HTTP/1.1 200 HTTP_OK
23:44:31:I1:WU30:Received WU P17650 R101 C0 G73
23:44:31:I3:WU30:Running FahCore: /config/cores/openmm-core-23/centos-7.9.2009-64bit/release/fahcore-23-centos-7.9.2009-64bit-release-8.0.3/FahCore_23 -dir UobiJ3KSWnziu7cF35CvznSQlBNvdn7QKcJFcmn2oSA -suffix 01 -version 8.3.18 -lifeline 220 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
23:44:31:I3:WU30:Started FahCore on PID 264
23:44:32:W :WU30:Core returned WU_STALLED (127)
23:44:32:I1:Default:Added new work unit: cpus:1 gpus:gpu:06:00:00
23:44:32:I1:WU30:Sending dump report
23:44:32:I1:WU31:Requesting WU assignment for user ME62 team 227802
23:44:32:I1:OUT12:> POST https://pllwskifah2.mskcc.org/api/results HTTP/1.1
23:44:32:I1:OUT13:> POST https://assign4.foldingathome.org/api/assign HTTP/1.1
23:44:33:I1:OUT12:< HTTP/1.1 200 HTTP_OK
23:44:33:I1:WU30:Dumped
23:44:33:I1:OUT13:< HTTP/1.1 200 HTTP_OK
23:44:33:I1:WU31:Received WU assignment nd0GQ2prnWy5EQ7wxUmfm58PDJKdDfPbJGGSGXYgd3E
23:44:33:I1:WU31:Downloading WU
23:44:33:I1:OUT14:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
23:44:34:I1:WU31:DOWNLOAD 85% 5.84MiB of 6.90MiB
23:44:34:I1:OUT14:< HTTP/1.1 200 HTTP_OK
23:44:34:I1:WU31:Received WU P17650 R24 C0 G69
23:44:35:I3:WU31:Running FahCore: /config/cores/openmm-core-23/centos-7.9.2009-64bit/release/fahcore-23-centos-7.9.2009-64bit-release-8.0.3/FahCore_23 -dir nd0GQ2prnWy5EQ7wxUmfm58PDJKdDfPbJGGSGXYgd3E -suffix 01 -version 8.3.18 -lifeline 220 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
23:44:35:I3:WU31:Started FahCore on PID 265
23:44:36:W :WU31:Core returned WU_STALLED (127)
23:44:36:I1:Default:Added new work unit: cpus:1 gpus:gpu:06:00:00
23:44:36:I1:WU31:Sending dump report
23:44:36:I1:WU32:Requesting WU assignment for user ME62 team 227802
23:44:36:I1:OUT15:> POST https://pllwskifah2.mskcc.org/api/results HTTP/1.1
23:44:36:I1:OUT16:> POST https://assign5.foldingathome.org/api/assign HTTP/1.1
23:44:36:I1:OUT15:< HTTP/1.1 200 HTTP_OK
23:44:36:I1:WU31:Dumped
23:44:36:I1:OUT16:< HTTP/1.1 200 HTTP_OK
23:44:36:I1:WU32:Received WU assignment NK4skaPlQyX3QUvKdX_aLdBw4cHeItTE5X5GugwUXnk
23:44:36:I1:WU32:Downloading WU
23:44:36:I1:OUT17:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
23:44:38:I1:WU32:DOWNLOAD 98% 6.05MiB of 6.20MiB
23:44:38:I1:OUT17:< HTTP/1.1 200 HTTP_OK
23:44:38:I1:WU32:Received WU P17650 R44 C1 G41
23:44:38:I3:WU32:Running FahCore: /config/cores/openmm-core-23/centos-7.9.2009-64bit/release/fahcore-23-centos-7.9.2009-64bit-release-8.0.3/FahCore_23 -dir NK4skaPlQyX3QUvKdX_aLdBw4cHeItTE5X5GugwUXnk -suffix 01 -version 8.3.18 -lifeline 220 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
23:44:38:I3:WU32:Started FahCore on PID 266
23:44:39:W :WU32:Core returned WU_STALLED (127)
23:44:39:I1:Default:Added new work unit: cpus:1 gpus:gpu:06:00:00
23:44:39:I1:WU32:Sending dump report
23:44:39:I1:WU33:Requesting WU assignment for user ME62 team 227802
23:44:39:I1:OUT18:> POST https://pllwskifah2.mskcc.org/api/results HTTP/1.1
23:44:39:I1:OUT19:> POST https://assign6.foldingathome.org/api/assign HTTP/1.1
23:44:39:I1:OUT18:< HTTP/1.1 200 HTTP_OK
23:44:39:I1:WU32:Dumped
23:44:39:I1:OUT19:< HTTP/1.1 200 HTTP_OK
23:44:39:I1:WU33:Received WU assignment 4-8jjyl-wPiX1C_oD9IM2azKG40X_-H68AZmnKbNK9Q
23:44:39:I1:WU33:Downloading WU
23:44:40:I1:OUT20:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
23:44:41:I1:WU33:DOWNLOAD 70% 4.84MiB of 6.90MiB
23:44:41:I1:WU33:DOWNLOAD 100% 6.90MiB of 6.90MiB
23:44:41:I1:OUT20:< HTTP/1.1 200 HTTP_OK
23:44:41:I1:WU33:Received WU P17650 R95 C4 G38
23:44:41:I3:WU33:Running FahCore: /config/cores/openmm-core-23/centos-7.9.2009-64bit/release/fahcore-23-centos-7.9.2009-64bit-release-8.0.3/FahCore_23 -dir 4-8jjyl-wPiX1C_oD9IM2azKG40X_-H68AZmnKbNK9Q -suffix 01 -version 8.3.18 -lifeline 220 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
23:44:41:I3:WU33:Started FahCore on PID 267
23:44:42:W :WU33:Core returned WU_STALLED (127)
23:44:42:I1:Default:Added new work unit: cpus:1 gpus:gpu:06:00:00
23:44:42:I1:WU33:Sending dump report
23:44:42:I1:WU34:Requesting WU assignment for user ME62 team 227802
23:44:42:I1:OUT21:> POST https://pllwskifah2.mskcc.org/api/results HTTP/1.1
23:44:42:I1:OUT22:> POST https://assign1.foldingathome.org/api/assign HTTP/1.1
23:44:43:I1:OUT22:< HTTP/1.1 200 HTTP_OK
23:44:43:I1:WU34:Received WU assignment xP3iW-tmv3UArDyckJj7DwlQZAG3ytbhyFhemIQ8eVE
23:44:43:I1:WU34:Downloading WU
23:44:43:I1:OUT23:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
23:44:43:I1:OUT21:< HTTP/1.1 200 HTTP_OK
23:44:43:I1:WU33:Dumped
23:44:44:I1:WU34:DOWNLOAD 66% 4.57MiB of 6.90MiB
23:44:44:I1:WU34:DOWNLOAD 100% 6.90MiB of 6.90MiB
23:44:44:I1:OUT23:< HTTP/1.1 200 HTTP_OK
23:44:44:I1:WU34:Received WU P17650 R28 C6 G38
23:44:44:I3:WU34:Running FahCore: /config/cores/openmm-core-23/centos-7.9.2009-64bit/release/fahcore-23-centos-7.9.2009-64bit-release-8.0.3/FahCore_23 -dir xP3iW-tmv3UArDyckJj7DwlQZAG3ytbhyFhemIQ8eVE -suffix 01 -version 8.3.18 -lifeline 220 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
23:44:44:I3:WU34:Started FahCore on PID 268
23:44:45:W :WU34:Core returned WU_STALLED (127)
23:44:46:I1:Default:Added new work unit: cpus:1 gpus:gpu:06:00:00
23:44:46:I1:WU34:Sending dump report
23:44:46:I1:WU35:Requesting WU assignment for user ME62 team 227802
23:44:46:I1:OUT24:> POST https://pllwskifah2.mskcc.org/api/results HTTP/1.1
23:44:46:I1:OUT25:> POST https://assign2.foldingathome.org/api/assign HTTP/1.1
23:44:46:I1:OUT25:< HTTP/1.1 200 HTTP_OK
23:44:46:I1:WU35:Received WU assignment W8xay7J39R7AXVvSSHbd3TR2dnegTSjcEUVmlkVjOkw
23:44:46:I1:WU35:Downloading WU
23:44:46:I1:OUT26:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
23:44:46:I1:OUT24:< HTTP/1.1 200 HTTP_OK
23:44:46:I1:WU34:Dumped
23:44:47:I1:WU35:DOWNLOAD 50% 3.44MiB of 6.90MiB
23:44:47:I1:OUT26:< HTTP/1.1 200 HTTP_OK
23:44:48:I1:WU35:Received WU P17650 R43 C6 G34
23:44:48:I3:WU35:Running FahCore: /config/cores/openmm-core-23/centos-7.9.2009-64bit/release/fahcore-23-centos-7.9.2009-64bit-release-8.0.3/FahCore_23 -dir W8xay7J39R7AXVvSSHbd3TR2dnegTSjcEUVmlkVjOkw -suffix 01 -version 8.3.18 -lifeline 220 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
23:44:48:I3:WU35:Started FahCore on PID 269
23:44:49:W :WU35:Core returned WU_STALLED (127)
23:44:49:I1:Default:Added new work unit: cpus:1 gpus:gpu:06:00:00
23:44:49:I1:WU35:Sending dump report
23:44:49:I1:WU36:Requesting WU assignment for user ME62 team 227802
23:44:49:I1:OUT27:> POST https://pllwskifah2.mskcc.org/api/results HTTP/1.1
23:44:49:I1:OUT28:> POST https://assign3.foldingathome.org/api/assign HTTP/1.1
23:44:49:I1:OUT28:< HTTP/1.1 200 HTTP_OK
23:44:49:I1:WU36:Received WU assignment K_CkkUKt6pKw_zrv-a4aN2HnSJmvWW4COnT9e39o0h8
23:44:49:I1:WU36:Downloading WU
23:44:49:I1:OUT27:< HTTP/1.1 200 HTTP_OK
23:44:49:I1:WU35:Dumped
23:44:49:I1:OUT29:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
23:44:51:I1:WU36:DOWNLOAD 4% 246.55KiB of 6.90MiB
23:44:52:I1:WU36:DOWNLOAD 18% 1.23MiB of 6.90MiB
23:44:53:I1:WU36:DOWNLOAD 40% 2.79MiB of 6.90MiB
23:44:54:I1:WU36:DOWNLOAD 73% 5.01MiB of 6.90MiB
23:44:54:I1:WU36:DOWNLOAD 100% 6.90MiB of 6.90MiB
23:44:54:I1:OUT29:< HTTP/1.1 200 HTTP_OK
23:44:55:I1:WU36:Received WU P17650 R49 C7 G34
23:44:55:I3:WU36:Running FahCore: /config/cores/openmm-core-23/centos-7.9.2009-64bit/release/fahcore-23-centos-7.9.2009-64bit-release-8.0.3/FahCore_23 -dir K_CkkUKt6pKw_zrv-a4aN2HnSJmvWW4COnT9e39o0h8 -suffix 01 -version 8.3.18 -lifeline 220 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-platform 0 -cuda-device 0 -gpu 0
23:44:55:I3:WU36:Started FahCore on PID 270
23:44:56:W :WU36:Core returned WU_STALLED (127)
23:44:56:I1:WU36:Sending dump report
23:44:56:I1:OUT30:> POST https://pllwskifah2.mskcc.org/api/results HTTP/1.1
23:44:56:I1:OUT30:< HTTP/1.1 200 HTTP_OK
23:44:56:I1:WU36:Dumped