core22 0.0.10 released to full FAH!

[foldy]

First time I now saw the average performance trace for nvidia gtx 1080ti on Windows:
Project: 16600 (Run 0, Clone 441, Gen 388)
12:48:43:WU00:FS01:0x22:Average performance: 16.2254 ns/day

I hope this is average performance while FAH slot running only and not fah slot paused or PC standby included?

I guess the ns/day value should be similar to Fahbench build with opemm 7.4.2 mixed precision and running with this work unit?

[Crunchtimer]

Hi all!

My GPUs started failing last night and now it's just sitting there showing FAILED in the FAHControl. Here are the logs for GPUs:

GPU01:

Code: Select all

04:27:35:WU02:FS01:0x22:Completed 1980000 out of 2000000 steps (99%)
04:27:36:WU03:FS01:Connecting to assign1.foldingathome.org:80
04:27:36:WU03:FS01:Assigned to work server 18.188.125.154
04:27:36:WU03:FS01:Requesting new work unit for slot 01: RUNNING gpu:1:GP104 [GeForce GTX 1070] 6463 from 18.188.125.154
04:27:36:WU03:FS01:Connecting to 18.188.125.154:8080
04:27:39:WU03:FS01:Downloading 9.36MiB
04:27:43:WU03:FS01:Download complete
04:27:43:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13414 run:3438 clone:32 gen:0 core:0x22 unit:0x0000000312bc7d9a5ef50d7005c4dcdf
04:32:10:WU02:FS01:0x22:Completed 2000000 out of 2000000 steps (100%)
04:32:10:WU02:FS01:0x22:Average performance: 2.5098 ns/day
04:32:20:WU02:FS01:0x22:Saving result file ../logfile_01.txt
04:32:20:WU02:FS01:0x22:Saving result file checkpointState.xml
04:32:25:WU02:FS01:0x22:Saving result file positions.xtc
04:32:30:WU02:FS01:0x22:Saving result file science.log
04:32:30:WU02:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
04:32:31:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
04:32:31:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:14445 run:0 clone:957 gen:71 core:0x22 unit:0x0000006d03854c135ea7b891e9592e30
04:32:31:WU02:FS01:Uploading 94.17MiB to 3.133.76.19
04:32:31:WU02:FS01:Connecting to 3.133.76.19:8080
04:32:31:WU03:FS01:Starting
04:32:31:WU03:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/Core_22.fah/FahCore_22 -dir 03 -suffix 01 -version 706 -lifeline 1394 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device 1 -gpu 1
04:32:31:WU03:FS01:Started FahCore on PID 57249
04:32:31:WU03:FS01:Core PID:57253
04:32:31:WU03:FS01:FahCore 0x22 started
04:32:32:WU03:FS01:0x22:*********************** Log Started 2020-06-27T04:32:31Z ***********************
04:32:32:WU03:FS01:0x22:*************************** Core22 Folding@home Core ***************************
04:32:32:WU03:FS01:0x22:       Core: Core22
04:32:32:WU03:FS01:0x22:       Type: 0x22
04:32:32:WU03:FS01:0x22:    Version: 0.0.10
04:32:32:WU03:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
04:32:32:WU03:FS01:0x22:  Copyright: 2020 foldingathome.org
04:32:32:WU03:FS01:0x22:   Homepage: https://foldingathome.org/
04:32:32:WU03:FS01:0x22:       Date: Jun 16 2020
04:32:32:WU03:FS01:0x22:       Time: 15:55:31
04:32:32:WU03:FS01:0x22:   Revision: 147051aad40bcbec7d4b25105bbedfab425f1dc2
04:32:32:WU03:FS01:0x22:     Branch: core22-0.0.10
04:32:32:WU03:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
04:32:32:WU03:FS01:0x22:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
04:32:32:WU03:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
04:32:32:WU03:FS01:0x22:       Bits: 64
04:32:32:WU03:FS01:0x22:       Mode: Release
04:32:32:WU03:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
04:32:32:WU03:FS01:0x22:             <peastman@stanford.edu>
04:32:32:WU03:FS01:0x22:       Args: -dir 03 -suffix 01 -version 706 -lifeline 57249 -checkpoint 15
04:32:32:WU03:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device
04:32:32:WU03:FS01:0x22:             1 -gpu 1
04:32:32:WU03:FS01:0x22:************************************ libFAH ************************************
04:32:32:WU03:FS01:0x22:       Date: Jun 2 2020
04:32:32:WU03:FS01:0x22:       Time: 00:07:31
04:32:32:WU03:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
04:32:32:WU03:FS01:0x22:     Branch: HEAD
04:32:32:WU03:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
04:32:32:WU03:FS01:0x22:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
04:32:32:WU03:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
04:32:32:WU03:FS01:0x22:       Bits: 64
04:32:32:WU03:FS01:0x22:       Mode: Release
04:32:32:WU03:FS01:0x22:************************************ CBang *************************************
04:32:32:WU03:FS01:0x22:       Date: May 31 2020
04:32:32:WU03:FS01:0x22:       Time: 20:16:34
04:32:32:WU03:FS01:0x22:   Revision: 75fcee0b8e713cb47f5191a3689d5f4f07244c7f
04:32:32:WU03:FS01:0x22:     Branch: HEAD
04:32:32:WU03:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
04:32:32:WU03:FS01:0x22:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
04:32:32:WU03:FS01:0x22:             -fPIC
04:32:32:WU03:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
04:32:32:WU03:FS01:0x22:       Bits: 64
04:32:32:WU03:FS01:0x22:       Mode: Release
04:32:32:WU03:FS01:0x22:************************************ System ************************************
04:32:32:WU03:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
04:32:32:WU03:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
04:32:32:WU03:FS01:0x22:       CPUs: 24
04:32:32:WU03:FS01:0x22:     Memory: 15.54GiB
04:32:32:WU03:FS01:0x22:Free Memory: 9.65GiB
04:32:32:WU03:FS01:0x22:    Threads: POSIX_THREADS
04:32:32:WU03:FS01:0x22: OS Version: 5.4
04:32:32:WU03:FS01:0x22:Has Battery: false
04:32:32:WU03:FS01:0x22: On Battery: false
04:32:32:WU03:FS01:0x22: UTC Offset: 2
04:32:32:WU03:FS01:0x22:        PID: 57253
04:32:32:WU03:FS01:0x22:        CWD: /var/lib/fahclient/work
04:32:32:WU03:FS01:0x22:********************************************************************************
04:32:32:WU03:FS01:0x22:Project: 13414 (Run 3438, Clone 32, Gen 0)
04:32:32:WU03:FS01:0x22:Unit: 0x0000000312bc7d9a5ef50d7005c4dcdf
04:32:32:WU03:FS01:0x22:Reading tar file core.xml
04:32:32:WU03:FS01:0x22:Reading tar file integrator.xml
04:32:32:WU03:FS01:0x22:Reading tar file state.xml
04:32:32:WU03:FS01:0x22:Reading tar file system.xml
04:32:33:WU03:FS01:0x22:Digital signatures verified
04:32:33:WU03:FS01:0x22:Folding@home GPU Core22 Folding@home Core
04:32:33:WU03:FS01:0x22:Version 0.0.10
04:32:33:WU03:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
04:32:33:WU03:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
04:32:33:WU03:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
04:32:33:WU03:FS01:0x22:  Global context and integrator variables write interval: 250 steps (0.025%) [4000 total]
04:32:33:WU03:FS01:0x22:OpenCL platform is not available.
04:32:33:WU03:FS01:0x22:There is no registered Platform called "OpenCL"
04:32:33:WU03:FS01:0x22:Platform plugin load failures:
04:32:33:WU03:FS01:0x22:ERROR:126: OpenCL platform is not available.
04:32:33:WU03:FS01:0x22:ERROR:There is no registered Platform called "OpenCL"
04:32:33:WU03:FS01:0x22:ERROR:Platform plugin load failures:
04:32:33:WU03:FS01:0x22:Saving result file ../logfile_01.txt
04:32:33:WU03:FS01:0x22:Saving result file science.log
04:32:33:WU03:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
04:32:33:WARNING:WU03:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:32:33:WU03:FS01:Sending unit results: id:03 state:SEND error:FAULTY project:13414 run:3438 clone:32 gen:0 core:0x22 unit:0x0000000312bc7d9a5ef50d7005c4dcdf
04:32:33:WU03:FS01:Uploading 2.04KiB to 18.188.125.154
04:32:33:WU03:FS01:Connecting to 18.188.125.154:8080
04:32:33:WU05:FS01:Connecting to assign1.foldingathome.org:80
04:32:33:WU03:FS01:Upload complete
04:32:33:WU03:FS01:Server responded WORK_ACK (400)
04:32:33:WU03:FS01:Cleaning up
04:32:34:WU05:FS01:Assigned to work server 18.188.125.154
04:32:34:WU05:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] 6463 from 18.188.125.154
04:32:34:WU05:FS01:Connecting to 18.188.125.154:8080
04:32:36:WU05:FS01:Downloading 9.41MiB
04:32:37:WU02:FS01:Upload 2.79%
04:32:41:WU05:FS01:Download complete
04:32:41:WU05:FS01:Received Unit: id:05 state:DOWNLOAD error:NO_ERROR project:13414 run:4212 clone:30 gen:1 core:0x22 unit:0x0000000112bc7d9a5ef50d4a1d19ed33
04:32:41:WU05:FS01:Starting
04:32:41:WU05:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/Core_22.fah/FahCore_22 -dir 05 -suffix 01 -version 706 -lifeline 1394 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device 1 -gpu 1
04:32:41:WU05:FS01:Started FahCore on PID 57257
04:32:41:WU05:FS01:Core PID:57261
04:32:41:WU05:FS01:FahCore 0x22 started
04:32:42:WU05:FS01:0x22:*********************** Log Started 2020-06-27T04:32:41Z ***********************
04:32:42:WU05:FS01:0x22:*************************** Core22 Folding@home Core ***************************
04:32:42:WU05:FS01:0x22:       Core: Core22
04:32:42:WU05:FS01:0x22:       Type: 0x22
04:32:42:WU05:FS01:0x22:    Version: 0.0.10
04:32:42:WU05:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
04:32:42:WU05:FS01:0x22:  Copyright: 2020 foldingathome.org
04:32:42:WU05:FS01:0x22:   Homepage: https://foldingathome.org/
04:32:42:WU05:FS01:0x22:       Date: Jun 16 2020
04:32:42:WU05:FS01:0x22:       Time: 15:55:31
04:32:42:WU05:FS01:0x22:   Revision: 147051aad40bcbec7d4b25105bbedfab425f1dc2
04:32:42:WU05:FS01:0x22:     Branch: core22-0.0.10
04:32:42:WU05:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
04:32:42:WU05:FS01:0x22:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
04:32:42:WU05:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
04:32:42:WU05:FS01:0x22:       Bits: 64
04:32:42:WU05:FS01:0x22:       Mode: Release
04:32:42:WU05:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
04:32:42:WU05:FS01:0x22:             <peastman@stanford.edu>
04:32:42:WU05:FS01:0x22:       Args: -dir 05 -suffix 01 -version 706 -lifeline 57257 -checkpoint 15
04:32:42:WU05:FS01:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device
04:32:42:WU05:FS01:0x22:             1 -gpu 1
04:32:42:WU05:FS01:0x22:************************************ libFAH ************************************
04:32:42:WU05:FS01:0x22:       Date: Jun 2 2020
04:32:42:WU05:FS01:0x22:       Time: 00:07:31
04:32:42:WU05:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
04:32:42:WU05:FS01:0x22:     Branch: HEAD
04:32:42:WU05:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
04:32:42:WU05:FS01:0x22:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
04:32:42:WU05:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
04:32:42:WU05:FS01:0x22:       Bits: 64
04:32:42:WU05:FS01:0x22:       Mode: Release
04:32:42:WU05:FS01:0x22:************************************ CBang *************************************
04:32:42:WU05:FS01:0x22:       Date: May 31 2020
04:32:42:WU05:FS01:0x22:       Time: 20:16:34
04:32:42:WU05:FS01:0x22:   Revision: 75fcee0b8e713cb47f5191a3689d5f4f07244c7f
04:32:42:WU05:FS01:0x22:     Branch: HEAD
04:32:42:WU05:FS01:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
04:32:42:WU05:FS01:0x22:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
04:32:42:WU05:FS01:0x22:             -fPIC
04:32:42:WU05:FS01:0x22:   Platform: linux2 4.19.76-linuxkit
04:32:42:WU05:FS01:0x22:       Bits: 64
04:32:42:WU05:FS01:0x22:       Mode: Release
04:32:42:WU05:FS01:0x22:************************************ System ************************************
04:32:42:WU05:FS01:0x22:        CPU: Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
04:32:42:WU05:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
04:32:42:WU05:FS01:0x22:       CPUs: 24
04:32:42:WU05:FS01:0x22:     Memory: 15.54GiB
04:32:42:WU05:FS01:0x22:Free Memory: 9.65GiB
04:32:42:WU05:FS01:0x22:    Threads: POSIX_THREADS
04:32:42:WU05:FS01:0x22: OS Version: 5.4
04:32:42:WU05:FS01:0x22:Has Battery: false
04:32:42:WU05:FS01:0x22: On Battery: false
04:32:42:WU05:FS01:0x22: UTC Offset: 2
04:32:42:WU05:FS01:0x22:        PID: 57261
04:32:42:WU05:FS01:0x22:        CWD: /var/lib/fahclient/work
04:32:42:WU05:FS01:0x22:********************************************************************************
04:32:42:WU05:FS01:0x22:Project: 13414 (Run 4212, Clone 30, Gen 1)
04:32:42:WU05:FS01:0x22:Unit: 0x0000000112bc7d9a5ef50d4a1d19ed33
04:32:42:WU05:FS01:0x22:Reading tar file core.xml
04:32:42:WU05:FS01:0x22:Reading tar file integrator.xml
04:32:42:WU05:FS01:0x22:Reading tar file state.xml
04:32:42:WU05:FS01:0x22:Reading tar file system.xml
04:32:42:WU05:FS01:0x22:Digital signatures verified
04:32:42:WU05:FS01:0x22:Folding@home GPU Core22 Folding@home Core
04:32:42:WU05:FS01:0x22:Version 0.0.10
04:32:42:WU05:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
04:32:42:WU05:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
04:32:42:WU05:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
04:32:42:WU05:FS01:0x22:  Global context and integrator variables write interval: 250 steps (0.025%) [4000 total]
04:32:42:WU05:FS01:0x22:OpenCL platform is not available.
04:32:42:WU05:FS01:0x22:There is no registered Platform called "OpenCL"
04:32:42:WU05:FS01:0x22:Platform plugin load failures:
04:32:42:WU05:FS01:0x22:ERROR:126: OpenCL platform is not available.
04:32:42:WU05:FS01:0x22:ERROR:There is no registered Platform called "OpenCL"
04:32:42:WU05:FS01:0x22:ERROR:Platform plugin load failures:
04:32:42:WU05:FS01:0x22:Saving result file ../logfile_01.txt
04:32:42:WU05:FS01:0x22:Saving result file science.log
04:32:42:WU05:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
04:32:43:WU02:FS01:Upload 5.51%
04:32:43:WARNING:WU05:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
04:32:43:WU05:FS01:Sending unit results: id:05 state:SEND error:FAULTY project:13414 run:4212 clone:30 gen:1 core:0x22 unit:0x0000000112bc7d9a5ef50d4a1d19ed33
04:32:43:WU05:FS01:Uploading 2.04KiB to 18.188.125.154
04:32:43:WU05:FS01:Connecting to 18.188.125.154:8080
04:32:43:WU03:FS01:Connecting to assign1.foldingathome.org:80
04:32:43:WU05:FS01:Upload complete
04:32:43:WU05:FS01:Server responded WORK_ACK (400)
04:32:43:WU05:FS01:Cleaning up

[Crunchtimer]

Here are the FAULTY projects if that helps:

Code: Select all

fah@fah-MS-7885:~$ less /var/lib/fahclient/log.txt | grep 'error:FAULTY'
17:24:34:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:13414 run:1408 clone:31 gen:0 core:0x22 unit:0x0000000212bc7d9a5ef19f7f97f5fba5
04:32:33:WU03:FS01:Sending unit results: id:03 state:SEND error:FAULTY project:13414 run:3438 clone:32 gen:0 core:0x22 unit:0x0000000312bc7d9a5ef50d7005c4dcdf
04:32:43:WU05:FS01:Sending unit results: id:05 state:SEND error:FAULTY project:13414 run:4212 clone:30 gen:1 core:0x22 unit:0x0000000112bc7d9a5ef50d4a1d19ed33
04:33:25:WU03:FS01:Sending unit results: id:03 state:SEND error:FAULTY project:14561 run:0 clone:623 gen:104 core:0x22 unit:0x000000b180fccb025e9615c1888b65c2
04:33:42:WU05:FS01:Sending unit results: id:05 state:SEND error:FAULTY project:14457 run:0 clone:516 gen:56 core:0x22 unit:0x0000005703854c135eb39a2e6630dd4d
04:35:23:WU03:FS01:Sending unit results: id:03 state:SEND error:FAULTY project:14462 run:0 clone:935 gen:72 core:0x22 unit:0x0000006f03854c135eb39e429d7fa0af
04:35:31:WU05:FS01:Sending unit results: id:05 state:SEND error:FAULTY project:16443 run:0 clone:521 gen:90 core:0x22 unit:0x0000007f80fccb015eaa00190697517b
04:35:49:WU03:FS01:Sending unit results: id:03 state:SEND error:FAULTY project:14462 run:0 clone:22 gen:71 core:0x22 unit:0x0000006503854c135eb39e4366f0ba67
04:36:31:WU05:FS01:Sending unit results: id:05 state:SEND error:FAULTY project:14561 run:0 clone:79 gen:121 core:0x22 unit:0x000000c380fccb025e9615c108cf8a23
04:38:09:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:11759 run:0 clone:6639 gen:130 core:0x22 unit:0x000000f880fccb0a5e6e93904f01c634
04:40:07:WU03:FS01:Sending unit results: id:03 state:SEND error:FAULTY project:14295 run:0 clone:18 gen:246 core:0x21 unit:0x0000016f80fccb0a5e0e6ce067aace67
05:25:35:WU00:FS02:Sending unit results: id:00 state:SEND error:FAULTY project:11759 run:0 clone:8255 gen:107 core:0x22 unit:0x000000c780fccb0a5e6eaa7e497fa4e5
05:26:28:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:14253 run:1352 clone:1 gen:100 core:0x22 unit:0x000000a6cedfaa925eaba95dcafc42c5
05:26:36:WU00:FS02:Sending unit results: id:00 state:SEND error:FAULTY project:14543 run:0 clone:1830 gen:68 core:0x22 unit:0x0000006480fccb045e7fc1bd02957efc
05:26:52:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:14438 run:0 clone:905 gen:7 core:0x22 unit:0x0000001403854c135e9fc39d9d66ce5c
05:27:59:WU00:FS02:Sending unit results: id:00 state:SEND error:FAULTY project:14253 run:1877 clone:4 gen:103 core:0x22 unit:0x000000aacedfaa925eaba95b9eb30720
05:28:15:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:14439 run:0 clone:1467 gen:65 core:0x22 unit:0x0000005e03854c135ea0a301937dda89
05:28:25:WU00:FS02:Sending unit results: id:00 state:SEND error:FAULTY project:13414 run:3467 clone:33 gen:0 core:0x22 unit:0x0000000212bc7d9a5ef50d6a4ad5ab80
05:28:29:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:16433 run:416 clone:3 gen:36 core:0x22 unit:0x0000003703854c135e9a4efd708bee28
05:28:47:WU00:FS02:Sending unit results: id:00 state:SEND error:FAULTY project:14448 run:0 clone:323 gen:77 core:0x22 unit:0x0000007303854c135ea7b88f72959a7c
05:28:57:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:13414 run:3968 clone:33 gen:0 core:0x22 unit:0x0000000012bc7d9a5ef50d5668752f32

[ajm]

It looks like a drivers' problem:

Code: Select all

04:32:42:WU05:FS01:0x22:OpenCL platform is not available.
04:32:42:WU05:FS01:0x22:There is no registered Platform called "OpenCL"
04:32:42:WU05:FS01:0x22:Platform plugin load failures:
04:32:42:WU05:FS01:0x22:ERROR:126: OpenCL platform is not available.
04:32:42:WU05:FS01:0x22:ERROR:There is no registered Platform called "OpenCL"
04:32:42:WU05:FS01:0x22:ERROR:Platform plugin load failures:

Typically, you need the Nvidia drivers AND

Code: Select all

sudo apt install ocl-icd-opencl-dev

[tomc001]

We're excited to roll out core22 0.0.10 to full FAH after extensive testing of updates since 0.0.5.

~ John Chodera and the core22 team

Is there something users need to do to get this or is it a behind the scenes automatic update?

[ajm]

It should be automatic. You can check in your log whether it's been done, a bit after that line

Code: Select all

*************************** Core22 Folding@home Core ***************************

13:45:01:WU00:FS00:0x22:*************************** Core22 Folding@home Core ***************************
13:45:01:WU00:FS00:0x22: Core: Core22
13:45:01:WU00:FS00:0x22: Type: 0x22
13:45:01:WU00:FS00:0x22: Version: 0.0.10
13:45:01:WU00:FS00:0x22: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
13:45:01:WU00:FS00:0x22: Copyright: 2020 foldingathome.org
13:45:01:WU00:FS00:0x22: Homepage: https://foldingathome.org/

[Crunchtimer]

It looks like a drivers' problem:

I agree but update says I already have the latest (ocl-icd-opencl-dev is already the newest version (2.2.11-1ubuntu1)) and my rig has been running flawlessly for weeks and it's running again after I cleared the GPU-slots from WUs.
Should be something else I guess.

Thanks!

[Joe_H]

Could there be a permissions problem? The user that FAHClient runs under needs to be part of the 'video' group, and possibly the 'render' group depending on which version of Ubuntu. Someone also posted here that they need to make the 'render' group the primary one for the user.

[Crunchtimer]

[quote="foldy"]First time I now saw the average performance trace for nvidia gtx 1080ti on Windows:
Project: 16600 (Run 0, Clone 441, Gen 388)
12:48:43:WU00:FS01:0x22:Average performance: 16.2254 ns/day

I hope this is average performance while FAH slot running only and not fah slot paused or PC standby included?
/quote]

I don't have project 16600, but here are a few from my 2 Nvidia gtx 1070 (the numbers i ns/day are consistent for the same projects, but vary a great deal between projects):

Code: Select all

FS02:0x22:Average performance: 112.794 ns/day
FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:13412 run:237 clone:0 gen:3 core:0x22 unit:0x0000000312bc7d9a5ee9acd7eb2bffbb
FS01:0x22:Average performance: 9.70787 ns/day
FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:14417 run:0 clone:460 gen:131 core:0x22 unit:0x000000c00d5262775e84c8a684084bc3
FS02:0x22:Average performance: 8.40876 ns/day
FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:16448 run:0 clone:358 gen:74 core:0x22 unit:0x0000006f42aa6f325ed18ce3c739dccb
FS02:0x22:Average performance: 43.9695 ns/day
FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:11760 run:0 clone:73 gen:58 core:0x22 unit:0x0000007480fccb0a5e6d7cc7522c0f6a
FS01:0x22:Average performance: 9.72973 ns/day
FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:14417 run:0 clone:376 gen:118 core:0x22 unit:0x000000b60d5262775e84c8a6e058c7f1
FS02:0x22:Average performance: 30.6383 ns/day
FS02:Sending unit results: id:04 state:SEND error:NO_ERROR project:11759 run:0 clone:9723 gen:131 core:0x22 unit:0x000000e980fccb0a5e6eafe2503c1c37
FS01:0x22:Average performance: 103.473 ns/day
FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:13412 run:1682 clone:3 gen:3 core:0x22 unit:0x0000000512bc7d9a5eec4c8b89df8d72
FS02:0x22:Average performance: 4.27723 ns/day
FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:16443 run:0 clone:2909 gen:81 core:0x22 unit:0x0000007b80fccb015eaa0016c8eb343d
FS01:0x22:Average performance: 102.857 ns/day
FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:13412 run:2593 clone:7 gen:0 core:0x22 unit:0x0000000012bc7d9a5eec4c6568db807f
FS02:0x22:Average performance: 5.56522 ns/day
FS02:Sending unit results: id:04 state:SEND error:NO_ERROR project:16441 run:37 clone:3 gen:101 core:0x22 unit:0x0000008680fccb015ea9980095415591
FS02:0x22:Average performance: 7.30655 ns/day
FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:14564 run:1636 clone:1 gen:122 core:0x22 unit:0x000000bbcedfaa925eb08d3a9fbc9e3a
FS01:0x22:Average performance: 28.0519 ns/day
FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:11759 run:0 clone:11381 gen:78 core:0x22 unit:0x0000007c80fccb0a5e6ebd207019adaa
FS02:0x22:Average performance: 4.29851 ns/day
FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:16444 run:0 clone:423 gen:104 core:0x22 unit:0x000000a180fccb015eaa0015562941ec
FS01:0x22:Average performance: 2.51345 ns/day
FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:14445 run:0 clone:969 gen:50 core:0x22 unit:0x0000004d03854c135ea7b8916bcc1d4b
FS01:0x22:Average performance: 39.9076 ns/day
FS01:Sending unit results: id:04 state:SEND error:NO_ERROR project:11761 run:0 clone:2437 gen:90 core:0x22 unit:0x000000b580fccb0a5e6d7d41159bfdbd
FS02:0x22:Average performance: 3.13043 ns/day
FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:14449 run:0 clone:444 gen:65 core:0x22 unit:0x0000006503854c135eac4ad16195934f
FS02:0x22:Average performance: 114.135 ns/day
FS02:Sending unit results: id:04 state:SEND error:NO_ERROR project:13414 run:305 clone:22 gen:0 core:0x22 unit:0x0000000012bc7d9a5eed8c69c4b9c049
FS02:0x22:Average performance: 44.1944 ns/day
FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:11760 run:0 clone:1703 gen:74 core:0x22 unit:0x0000008b80fccb0a5e6d7cdfd75308c3
FS01:0x22:Average performance: 105.109 ns/day
FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:13414 run:77 clone:29 gen:0 core:0x22 unit:0x0000000012bc7d9a5eed8c743ed79ea5
FS02:0x22:Average performance: 114.894 ns/day
FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:13414 run:76 clone:32 gen:0 core:0x22 unit:0x0000000112bc7d9a5eed8c711be83798
FS01:0x22:Average performance: 5.12 ns/day
FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:14251 run:643 clone:2 gen:97 core:0x22 unit:0x00000093cedfaa925eab032132f2265e
FS02:0x22:Average performance: 4.41944 ns/day
FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:14561 run:0 clone:879 gen:100 core:0x22 unit:0x0000009580fccb025e9615c0f3bb0a3b
FS01:0x22:Average performance: 4.03738 ns/day
FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:14563 run:0 clone:499 gen:122 core:0x22 unit:0x000000b680fccb025e9615b8c28299ad
FS01:0x22:Average performance: 103.349 ns/day
FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:13412 run:563 clone:5 gen:1 core:0x22 unit:0x0000000212bc7d9a5eec4cb8bf55eeb9
FS01:0x22:Average performance: 6.49624 ns/day
FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:14564 run:667 clone:2 gen:107 core:0x22 unit:0x000000a2cedfaa925eb08d3cabe274ca
FS02:0x22:Average performance: 114.589 ns/day
FS02:Sending unit results: id:05 state:SEND error:NO_ERROR project:13414 run:216 clone:54 gen:0 core:0x22 unit:0x0000000012bc7d9a5eed8c6cbd185d94
FS01:0x22:Average performance: 25.1528 ns/day
FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11746 run:0 clone:4658 gen:142 core:0x22 unit:0x000000de8ca304f15e6aaaa7d8a7c38c
FS02:0x22:Average performance: 113.237 ns/day
FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:13414 run:987 clone:60 gen:0 core:0x22 unit:0x0000000012bc7d9a5eed8c53c28f8d81
FS01:0x22:Average performance: 107.196 ns/day
FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:13412 run:1911 clone:5 gen:1 core:0x22 unit:0x0000000212bc7d9a5eec4c80a4633c4f
FS02:0x22:Average performance: 83.3173 ns/day
FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:13414 run:878 clone:57 gen:1 core:0x22 unit:0x0000000112bc7d9a5eed8c571d465eff
FS01:0x22:Average performance: 79.1209 ns/day
FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13414 run:866 clone:63 gen:1 core:0x22 unit:0x0000000112bc7d9a5eed8c57f4ffd214
FS02:0x22:Average performance: 30.6383 ns/day
FS02:Sending unit results: id:04 state:SEND error:NO_ERROR project:11759 run:0 clone:13973 gen:93 core:0x22 unit:0x000000b080fccb0a5e6ed05a2df61b9e
FS02:0x22:Average performance: 43.9695 ns/day
FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:11760 run:0 clone:2077 gen:60 core:0x22 unit:0x0000007c80fccb0a5e6d7ce41657fc64
FS01:0x22:Average performance: 7.80135 ns/day
FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:16448 run:0 clone:682 gen:123 core:0x22 unit:0x000000c142aa6f325ed18ce3bc7b0ca3
FS01:0x22:Average performance: 103.103 ns/day
FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:13414 run:649 clone:77 gen:0 core:0x22 unit:0x0000000012bc7d9a5eed8c5e53407a40
FS02:0x22:Average performance: 3.09677 ns/day
FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:14463 run:0 clone:634 gen:51 core:0x22 unit:0x0000004b03854c135eb39e424e5a98c6
FS01:0x22:Average performance: 103.597 ns/day
FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:13414 run:267 clone:78 gen:1 core:0x22 unit:0x0000000112bc7d9a5eed8c71981004e9
FS02:0x22:Average performance: 112.647 ns/day
FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:13414 run:254 clone:82 gen:1 core:0x22 unit:0x0000000112bc7d9a5eed8c6a51ccb3ba
FS02:0x22:Average performance: 4.46512 ns/day
FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:16433 run:1599 clone:0 gen:42 core:0x22 unit:0x0000004203854c135e9a4f00b988ffeb
FS01:0x22:Average performance: 3.05031 ns/day
FS01:Sending unit results: id:04 state:SEND error:NO_ERROR project:16434 run:144 clone:0 gen:59 core:0x22 unit:0x0000006c03854c135e9cbaccbeff2dc2
FS01:0x22:Average performance: 39.7241 ns/day
FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:11742 run:0 clone:9156 gen:170 core:0x22 unit:0x0000010c8ca304f15e6bc4dbd3a5037a
FS02:0x22:Average performance: 5.48571 ns/day
FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14562 run:0 clone:861 gen:115 core:0x22 unit:0x000000ad80fccb025e9615bd9fbf35f9
FS02:0x22:Average performance: 44.0816 ns/day
FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:11760 run:0 clone:1761 gen:81 core:0x22 unit:0x0000009880fccb0a5e6d7ce007e3df53
FS01:0x22:Average performance: 103.349 ns/day
FS01:Sending unit results: id:04 state:SEND error:NO_ERROR project:13414 run:514 clone:97 gen:1 core:0x22 unit:0x0000000112bc7d9a5eed8c618c7b24f1
FS02:0x22:Average performance: 112.794 ns/day
FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:13414 run:800 clone:99 gen:1 core:0x22 unit:0x0000000312bc7d9a5eed8c593bd9b9f8
FS02:0x22:Average performance: 44.0816 ns/day
FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:11760 run:0 clone:252 gen:78 core:0x22 unit:0x0000008b80fccb0a5e6d7cc9158f52a7
FS01:0x22:Average performance: 3.97699 ns/day
FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:16443 run:0 clone:1526 gen:86 core:0x22 unit:0x0000007f80fccb015eaa00171f28eed9
FS02:0x22:Average performance: 113.386 ns/day
FS02:Sending unit results: id:04 state:SEND error:NO_ERROR project:13414 run:1763 clone:8 gen:0 core:0x22 unit:0x0000000012bc7d9a5ef1aef4a140a5b7
FS01:0x22:Average performance: 7.1346 ns/day
FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:14416 run:0 clone:1639 gen:135 core:0x22 unit:0x000000c50d5262775e84c8a7d5eb3a90
FS02:0x22:Average performance: 2.69579 ns/day
FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:14445 run:0 clone:1141 gen:72 core:0x22 unit:0x0000006103854c135ea7b891605958d2
FS01:0x22:Average performance: 104.348 ns/day
FS01:Sending unit results: id:04 state:SEND error:NO_ERROR project:13414 run:1146 clone:12 gen:1 core:0x22 unit:0x0000000112bc7d9a5ef19fab781a4836
FS02:0x22:Average performance: 30.6927 ns/day
FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:11741 run:0 clone:2273 gen:116 core:0x22 unit:0x000000bc8ca304f15e67d8b84cca169a
FS01:0x22:Average performance: 27.9612 ns/day
FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:11759 run:0 clone:3484 gen:120 core:0x22 unit:0x000000e280fccb0a5e6d7cae7a14569f
FS02:0x22:Average performance: 30.5841 ns/day
FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:11759 run:0 clone:1078 gen:136 core:0x22 unit:0x000000fa80fccb0a5e6d7c88aea904d7
FS01:0x22:Average performance: 2.87521 ns/day
FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:14449 run:0 clone:1362 gen:60 core:0x22 unit:0x0000006903854c135eac4ad149b72a5d
FS02:0x22:Average performance: 2.63214 ns/day
FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:14447 run:0 clone:1126 gen:71 core:0x22 unit:0x0000006f03854c135ea7b88f7435e713
FS01:0x22:Average performance: 3.94521 ns/day
FS01:Sending unit results: id:04 state:SEND error:NO_ERROR project:16444 run:0 clone:1329 gen:115 core:0x22 unit:0x000000b980fccb015eaa00153375f160
FS02:0x22:Average performance: 114.286 ns/day
FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:13414 run:1708 clone:29 gen:0 core:0x22 unit:0x0000000112bc7d9a5ef1af09452231e6
FS01:0x22:Average performance: 37.8118 ns/day
FS01:Sending unit results: id:05 state:SEND error:NO_ERROR project:11742 run:0 clone:4116 gen:159 core:0x22 unit:0x000001088ca304f15e69cb837227683f
FS01:0x22:Average performance: 7.85455 ns/day
FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:16448 run:0 clone:2266 gen:106 core:0x22 unit:0x000000a942aa6f325ed18ce2d3e1964c
FS02:0x22:Average performance: 112.794 ns/day
FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:13414 run:2837 clone:29 gen:1 core:0x22 unit:0x0000000212bc7d9a5ef1aeb58423e3f5
FS01:0x22:Average performance: 6.36464 ns/day
FS01:Sending unit results: id:04 state:SEND error:NO_ERROR project:14564 run:571 clone:2 gen:124 core:0x22 unit:0x000000c4cedfaa925eb08d3c5dea60aa
FS02:0x22:Average performance: 6.6334 ns/day
FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:16442 run:0 clone:1402 gen:121 core:0x22 unit:0x000000bd80fccb015eaa1bf33622759a
FS02:0x22:Average performance: 30.53 ns/day
FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:11741 run:0 clone:9888 gen:149 core:0x22 unit:0x000000e68ca304f15e6bc53b62a7d9f6
FS02:0x22:Average performance: 43.8579 ns/day
FS02:Sending unit results: id:04 state:SEND error:NO_ERROR project:11743 run:0 clone:5382 gen:113 core:0x22 unit:0x000000b68ca304f15e6bc4be658cf441
FS01:0x22:Average performance: 2.84913 ns/day
FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:14462 run:0 clone:1072 gen:49 core:0x22 unit:0x0000004703854c135eb39e42d6cf2042
FS02:0x22:Average performance: 114.437 ns/day
FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:13414 run:2986 clone:40 gen:0 core:0x22 unit:0x0000000112bc7d9a5ef1aea66f4fcaf6
FS01:0x22:Average performance: 102.735 ns/day
FS01:Sending unit results: id:04 state:SEND error:NO_ERROR project:13414 run:1249 clone:41 gen:0 core:0x22 unit:0x0000000012bc7d9a5ef19f9d9935df36
FS02:0x22:Average performance: 114.135 ns/day
FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:13414 run:2836 clone:44 gen:0 core:0x22 unit:0x0000000012bc7d9a5ef1aeb5ab1ed36e
FS01:0x22:Average performance: 2.83511 ns/day
FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:14460 run:0 clone:996 gen:50 core:0x22 unit:0x0000005203854c135eb39e448899fbf8
FS02:0x22:Average performance: 10.4982 ns/day
FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:14417 run:0 clone:1580 gen:117 core:0x22 unit:0x000000bd0d5262775e84c8a4da5e4dc7
FS01:0x22:Average performance: 6.14947 ns/day
FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:16442 run:0 clone:756 gen:96 core:0x22 unit:0x0000009180fccb015eaa1bf2711217a7
FS01:0x22:Average performance: 39.8157 ns/day
FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:11743 run:0 clone:9814 gen:170 core:0x22 unit:0x000000f88ca304f15e6bc456aadd5da2
FS02:0x22:Average performance: 4.32541 ns/day
FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:16444 run:0 clone:898 gen:134 core:0x22 unit:0x000000da80fccb015eaa001580ebc497

[Crunchtimer]

Could there be a permissions problem? The user that FAHClient runs under needs to be part of the 'video' group, and possibly the 'render' group depending on which version of Ubuntu. Someone also posted here that they need to make the 'render' group the primary one for the user.

Yes could be, but the rig only runs FAH and it just came to this stop all by itself. Could that just happen without any other changes made?
Now it's done anyways.

[Joe_H]

Could there be a permissions problem? The user that FAHClient runs under needs to be part of the 'video' group, and possibly the 'render' group depending on which version of Ubuntu. Someone also posted here that they need to make the 'render' group the primary one for the user.

Yes could be, but the rig only runs FAH and it just came to this stop all by itself. Could that just happen without any other changes made?
Now it's done anyways.

Any updates to the system or other software happen around that time? I have see that kind of thing "fix" other items that didn't need fixing.

[Crunchtimer]

Any updates to the system or other software happen around that time? I have see that kind of thing "fix" other items that didn't need fixing.

Hmmm, I wasn't aware Ubuntu does auto-upgrades..... Mine doesn't anymore though
This one looks suspicous and happened some 30 min before it collapsed.

Code: Select all

Commandline: /usr/bin/unattended-upgrade
Install: linux-modules-nvidia-440-5.4.0-39-generic:amd64 (5.4.0-39.43, automatic)
Upgrade: linux-modules-nvidia-440-generic-hwe-20.04:amd64 (5.4.0-37.41, 5.4.0-39.43)

Thanks, now I shouldn't have to babysit my rig anymore!

[tomc001]

Postby ajm » Sun Jun 28, 2020 10:28 am

It should be automatic. You can check in your log whether it's been done, a bit after that line

Thanks. My log shows Core22 so it did indeed update with no intervention from me.

Interesting that the Version: is a mix of 0.0.10 and 0.0.11.

[JohnChodera]

@Crunchtimer: This message means that the core can't talk to your OpenCL drivers for some reason:

Code: Select all

04:32:33:WU03:FS01:0x22:OpenCL platform is not available.
04:32:33:WU03:FS01:0x22:There is no registered Platform called "OpenCL"
04:32:33:WU03:FS01:0x22:Platform plugin load failures:
04:32:33:WU03:FS01:0x22:ERROR:126: OpenCL platform is not available.
04:32:33:WU03:FS01:0x22:ERROR:There is no registered Platform called "OpenCL"

Does a reboot help fix this, or are you still stuck in this state?

Anyone else having this issue?

~ John Chodera // MSKCC

[Crunchtimer]

@Crunchtimer: This message means that the core can't talk to your OpenCL drivers for some reason:

Does a reboot help fix this, or are you still stuck in this state?

Anyone else having this issue?

~ John Chodera // MSKCC

Thanks John! It got sorted with a reboot, or rather I cleared the GPU-slots and rebooted.
We came to the conclusion that auto update in Ubuntu had "fixed" drivers which caused the problem.

I now manually control updates, at least I'd like to think so

All the best and keep up the fantastic work!