Page 1 of 1
GTX1060 Ubuntu16.04 drv430 BAD_WORK_UNIT Error compiling ker
Posted: Sun Mar 29, 2020 9:05 pm
by florinandrei
Ubuntu 16.04 and GTX1060 - I used to mine cryptocurrency here on the GPU, and the crypto miners still technically work (though at a financial loss, so I'm not using them anymore).
I've installed the Nvidia drivers from the PPA:
Code: Select all
# dpkg -l | grep nvidia
ii nvidia-430 430.64-0ubuntu0~gpu16.04.2 amd64 NVIDIA binary driver - version 430.64
ii nvidia-430-dev 430.64-0ubuntu0~gpu16.04.2 amd64 NVIDIA binary Xorg driver development files
ii nvidia-opencl-dev:amd64 7.5.18-0ubuntu1 amd64 NVIDIA OpenCL development files
ii nvidia-opencl-icd-430 430.64-0ubuntu0~gpu16.04.2 amd64 NVIDIA OpenCL ICD
ii nvidia-prime 0.8.2 amd64 Tools to enable NVIDIA's Prime
ii nvidia-settings 440.64.00-0ubuntu1 amd64 Tool for configuring the NVIDIA graphics driver
I cannot run FAH on the GPU. I always get this error:
Code: Select all
20:39:38:WU00:FS01:Download complete
20:39:38:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:11760 run:0 clone:2781 gen:15 core:0x22 unit:0x0000001c80fccb0a5e6d7cf62c7f8d63
20:39:38:WU00:FS01:Starting
20:39:38:WU00:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/Core_22.fah/FahCore_22 -dir 00 -suffix 01 -version 705 -lifeline 13632 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:39:38:WU00:FS01:Started FahCore on PID 13835
20:39:38:WU00:FS01:Core PID:13839
20:39:38:WU00:FS01:FahCore 0x22 started
20:39:38:WU00:FS01:0x22:*********************** Log Started 2020-03-29T20:39:38Z ***********************
20:39:38:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
20:39:38:WU00:FS01:0x22: Type: 0x22
20:39:38:WU00:FS01:0x22: Core: Core22
20:39:38:WU00:FS01:0x22: Website: https://foldingathome.org/
20:39:38:WU00:FS01:0x22: Copyright: (c) 2009-2018 foldingathome.org
20:39:38:WU00:FS01:0x22: Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
20:39:38:WU00:FS01:0x22: <rafal.wiewiora@choderalab.org>
20:39:38:WU00:FS01:0x22: Args: -dir 00 -suffix 01 -version 705 -lifeline 13835 -checkpoint 15
20:39:38:WU00:FS01:0x22: -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
20:39:38:WU00:FS01:0x22: 0 -gpu 0
20:39:38:WU00:FS01:0x22: Config: <none>
20:39:38:WU00:FS01:0x22:************************************ Build *************************************
20:39:38:WU00:FS01:0x22: Version: 0.0.2
20:39:38:WU00:FS01:0x22: Date: Dec 6 2019
20:39:38:WU00:FS01:0x22: Time: 21:20:17
20:39:38:WU00:FS01:0x22: Repository: Git
20:39:38:WU00:FS01:0x22: Revision: f87d92b58abdf7e6bf2e173cfbc4dc3e837c7042
20:39:38:WU00:FS01:0x22: Branch: core22
20:39:38:WU00:FS01:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:39:38:WU00:FS01:0x22: Options: -std=gnu++98 -O3 -funroll-loops
20:39:38:WU00:FS01:0x22: Platform: linux2 4.9.87-linuxkit-aufs
20:39:38:WU00:FS01:0x22: Bits: 64
20:39:38:WU00:FS01:0x22: Mode: Release
20:39:38:WU00:FS01:0x22:************************************ System ************************************
20:39:38:WU00:FS01:0x22: CPU: AMD FX(tm)-4300 Quad-Core Processor
20:39:38:WU00:FS01:0x22: CPU ID: AuthenticAMD Family 21 Model 2 Stepping 0
20:39:38:WU00:FS01:0x22: CPUs: 4
20:39:38:WU00:FS01:0x22: Memory: 15.65GiB
20:39:38:WU00:FS01:0x22:Free Memory: 9.90GiB
20:39:38:WU00:FS01:0x22: Threads: POSIX_THREADS
20:39:38:WU00:FS01:0x22: OS Version: 4.4
20:39:38:WU00:FS01:0x22:Has Battery: false
20:39:38:WU00:FS01:0x22: On Battery: false
20:39:38:WU00:FS01:0x22: UTC Offset: -7
20:39:38:WU00:FS01:0x22: PID: 13839
20:39:38:WU00:FS01:0x22: CWD: /var/lib/fahclient/work
20:39:38:WU00:FS01:0x22: OS: Linux 4.4.0-176-generic x86_64
20:39:38:WU00:FS01:0x22: OS Arch: AMD64
20:39:38:WU00:FS01:0x22:********************************************************************************
20:39:38:WU00:FS01:0x22:Project: 11760 (Run 0, Clone 2781, Gen 15)
20:39:38:WU00:FS01:0x22:Unit: 0x0000001c80fccb0a5e6d7cf62c7f8d63
20:39:38:WU00:FS01:0x22:Reading tar file core.xml
20:39:38:WU00:FS01:0x22:Reading tar file integrator.xml
20:39:38:WU00:FS01:0x22:Reading tar file state.xml
20:39:38:WU00:FS01:0x22:Reading tar file system.xml
20:39:38:WU00:FS01:0x22:Digital signatures verified
20:39:38:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
20:39:38:WU00:FS01:0x22:Version 0.0.2
20:39:43:WU00:FS01:0x22:ERROR:exception: Error compiling kernel:
20:39:43:WU00:FS01:0x22:Saving result file ../logfile_01.txt
20:39:43:WU00:FS01:0x22:Saving result file science.log
20:39:43:WU00:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
20:39:43:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:39:43:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:11760 run:0 clone:2781 gen:15 core:0x22 unit:0x0000001c80fccb0a5e6d7cf62c7f8d63
20:39:43:WU00:FS01:Uploading 8.00KiB to 128.252.203.10
It's hard to capture what happens in /var/lib/fahclient/work because things are deleted so quickly, but I managed to get this science.log - not sure how useful it is:
Code: Select all
*************************** Core22 Folding@home Core ***************************
Type: 0x22
Core: Core22
Website: https://foldingathome.org/
Copyright: (c) 2009-2018 foldingathome.org
Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
<rafal.wiewiora@choderalab.org>
Args: -dir 00 -suffix 01 -version 705 -lifeline 13835 -checkpoint 15
-gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
0 -gpu 0
Config: <none>
************************************ Build *************************************
Version: 0.0.2
Date: Dec 6 2019
Time: 21:20:17
Repository: Git
Revision: f87d92b58abdf7e6bf2e173cfbc4dc3e837c7042
Branch: core22
Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
Options: -std=gnu++98 -O3 -funroll-loops
Platform: linux2 4.9.87-linuxkit-aufs
Bits: 64
Mode: Release
************************************ System ************************************
CPU: AMD FX(tm)-4300 Quad-Core Processor
CPU ID: AuthenticAMD Family 21 Model 2 Stepping 0
CPUs: 4
Memory: 15.65GiB
Free Memory: 9.90GiB
Threads: POSIX_THREADS
OS Version: 4.4
Has Battery: false
On Battery: false
UTC Offset: -7
PID: 13839
CWD: /var/lib/fahclient/work
OS: Linux 4.4.0-176-generic x86_64
OS Arch: AMD64
********************************************************************************
Folding@home GPU Core22 Folding@home Core
Version 0.0.2
[1] compatible platform(s):
-- 0 --
PROFILE = FULL_PROFILE
VERSION = OpenCL 1.2 CUDA 10.1.120
NAME = NVIDIA CUDA
VENDOR = NVIDIA Corporation
(1) device(s) found on platform 0:
-- 0 --
DEVICE_NAME = GeForce GTX 1060 6GB
DEVICE_VENDOR = NVIDIA Corporation
DEVICE_VERSION = OpenCL 1.2 CUDA
[ Entering Init ]
Launch time: 2020-03-29T20:39:38Z
Arguments passed: -dir 00 -suffix 01 -version 705 -lifeline 13835 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
For testState comparison of CPU and GPU, will use:
forceTolerance: 5 kJ/mol/nm
energyTolerance: 10 kJ/mol
[ Leaving Init ]
[ Entering Main ]
Reading core settings...
Total number of steps: 2000000
XTC write frequency: 50000
Checkpoint write frequency: 50000 (2.5%)
Number of frames per WU: 40
[ Initializing Core Contexts ]
Using platform OpenCL
Looking for vendor: nvidia...found on platformId 0
Setting platform precision to mixed
Setting DisablePmeStream to 1
Deserializing System...
Found MonteCarloBarostat @ 1.01325 (default) Bar, 310 Kelvin, 25 pressure change frequency.
Found: 62227 atoms, 5 forces.
Deserializing State...
Config file:
Code: Select all
<config>
<!-- Configuration file created by FAHClient on 2020-03-27T00:29:03Z -->
<user value='florinandrei'/>
<team value='0'/>
<passkey value=''/>
<smp value='false'/>
<gpu value='true'/>
<slot id='1' type='GPU'/>
</config>
What can I do to troubleshoot it? The logs don't offer much of a clue beyond "something has crashed".
Re: GTX1060 Ubuntu16.04 drv430 BAD_WORK_UNIT Error compiling
Posted: Sun Mar 29, 2020 10:06 pm
by florinandrei
I've downgraded the drivers to 390.116 (apt-get install nvidia-390, with the PPA) and now the GPU core seems to be crunching WUs.
Code: Select all
# dpkg -l | grep nvidia
ii nvidia-390 390.116-0ubuntu1 amd64 NVIDIA binary driver - version 390.116
ii nvidia-opencl-dev:amd64 7.5.18-0ubuntu1 amd64 NVIDIA OpenCL development files
ii nvidia-opencl-icd-390 390.116-0ubuntu1 amd64 NVIDIA OpenCL ICD
ii nvidia-prime 0.8.2 amd64 Tools to enable NVIDIA's Prime
ii nvidia-settings 440.64.00-0ubuntu1 amd64 Tool for configuring the NVIDIA graphics driver
Code: Select all
21:56:38:WU00:FS01:0x22:Project: 11753 (Run 0, Clone 2636, Gen 10)
21:56:38:WU00:FS01:0x22:Unit: 0x000000119bf7a4d55e6d76c7d507bf1f
21:56:38:WU00:FS01:0x22:Reading tar file core.xml
21:56:38:WU00:FS01:0x22:Reading tar file integrator.xml
21:56:38:WU00:FS01:0x22:Reading tar file state.xml
21:56:39:WU00:FS01:0x22:Reading tar file system.xml
21:56:40:WU00:FS01:0x22:Digital signatures verified
21:56:40:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
21:56:40:WU00:FS01:0x22:Version 0.0.2
21:57:06:WU00:FS01:0x22:Completed 0 out of 1000000 steps (0%)
21:57:06:WU00:FS01:0x22:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
21:59:49:WU00:FS01:0x22:Completed 10000 out of 1000000 steps (1%)
22:02:31:WU00:FS01:0x22:Completed 20000 out of 1000000 steps (2%)
But, folks, this is not right. That's a very old driver. The current driver series is 44x. A lot of people will install the latest. A lot of Ubuntu users, like me, will follow the recommendation from the PPA, which is the 43x series - and FAH will fail.
Can we get the Linux GPU core to work with more recent drivers?
Thanks!
Re: GTX1060 Ubuntu16.04 drv430 BAD_WORK_UNIT Error compiling
Posted: Mon Mar 30, 2020 6:41 pm
by katakaio
florinandrei wrote:
Can we get the Linux GPU core to work with more recent drivers?
Thanks!
I'm currently folding on 19.10 with the 440.xx drivers successfully. I used the following PPA to get those drivers:
https://launchpad.net/~graphics-drivers ... ubuntu/ppa
Have you tried 440 yet?
Re: GTX1060 Ubuntu16.04 drv430 BAD_WORK_UNIT Error compiling
Posted: Tue Mar 31, 2020 12:46 am
by ipkh
My system folds just fine on the newer drivers. The ppa shouldn't be needed anymore. Try making sure the nvidia-xxx-compute packages are also installed along with the drivers. Usually they get pulled in automatically but I'm not sure that happens with the ppa.
Re: GTX1060 Ubuntu16.04 drv430 BAD_WORK_UNIT Error compiling
Posted: Tue Mar 31, 2020 8:54 pm
by Abuyin
I'm running in the same issue after i stuck a second GPU in today.
Code: Select all
*********************** Log Started 2020-03-31T20:30:22Z ***********************
20:30:22:************************* Folding@home Client *************************
20:30:22: Website: https://foldingathome.org/
20:30:22: Copyright: (c) 2009-2018 foldingathome.org
20:30:22: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:30:22: Args: --child --lifeline 2570 /etc/fahclient/config.xml --run-as
20:30:22: fahclient --pid-file=/var/run/fahclient.pid --daemon
20:30:22: Config: /etc/fahclient/config.xml
20:30:22:******************************** Build ********************************
20:30:22: Version: 7.5.1
20:30:22: Date: May 11 2018
20:30:22: Time: 19:59:04
20:30:22: Repository: Git
20:30:22: Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
20:30:22: Branch: master
20:30:22: Compiler: GNU 6.3.0 20170516
20:30:22: Options: -std=gnu++98 -O3 -funroll-loops
20:30:22: Platform: linux2 4.14.0-3-amd64
20:30:22: Bits: 64
20:30:22: Mode: Release
20:30:22:******************************* System ********************************
20:30:22: CPU: Intel(R) Core(TM) i7-4960X CPU @ 3.60GHz
20:30:22: CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
20:30:22: CPUs: 12
20:30:22: Memory: 15.57GiB
20:30:22: Free Memory: 13.54GiB
20:30:22: Threads: POSIX_THREADS
20:30:22: OS Version: 5.3
20:30:22: Has Battery: false
20:30:22: On Battery: false
20:30:22: UTC Offset: 2
20:30:22: PID: 2572
20:30:22: CWD: /var/lib/fahclient
20:30:22: OS: Linux 5.3.0-45-generic x86_64
20:30:22: OS Arch: AMD64
20:30:22: GPUs: 0
20:30:22: CUDA Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:6.1 Driver:10.2
20:30:22: CUDA Device 1: Platform:0 Device:1 Bus:1 Slot:0 Compute:5.2 Driver:10.2
20:30:22:OpenCL Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:1.2 Driver:440.64
20:30:22:OpenCL Device 1: Platform:0 Device:1 Bus:1 Slot:0 Compute:1.2 Driver:440.64
20:30:22:***********************************************************************
20:30:22:<config>
20:30:22: <!-- Client Control -->
20:30:22: <fold-anon v='true'/>
20:30:22:
20:30:22: <!-- Folding Slot Configuration -->
20:30:22: <gpu v='false'/>
20:30:22:
20:30:22: <!-- Network -->
20:30:22: <proxy v=':8080'/>
20:30:22:
20:30:22: <!-- User Information -->
20:30:22: <passkey v='********************************'/>
20:30:22: <team v='235850'/>
20:30:22: <user v='Abuyin'/>
20:30:22:
20:30:22: <!-- Folding Slots -->
20:30:22:</config>
20:30:22:Switching to user fahclient
20:30:22:Trying to access database...
20:30:24:Successfully acquired database lock
20:30:24:Enabled folding slot 00: READY cpu:11
20:30:24:WU00:FS00:Connecting to 65.254.110.245:8080
20:30:25:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:30:25:WU00:FS00:Connecting to 18.218.241.186:80
20:30:26:WARNING:WU00:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:30:26:ERROR:WU00:FS00:Exception: Could not get an assignment
20:30:26:WU00:FS00:Connecting to 65.254.110.245:8080
20:30:27:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:30:27:WU00:FS00:Connecting to 18.218.241.186:80
20:30:27:WARNING:WU00:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:30:27:ERROR:WU00:FS00:Exception: Could not get an assignment
20:30:51:FS00:Paused
20:31:01:Saving configuration to /etc/fahclient/config.xml
20:31:01:<config>
20:31:01: <!-- Client Control -->
20:31:01: <fold-anon v='true'/>
20:31:01:
20:31:01: <!-- Folding Slot Configuration -->
20:31:01: <gpu v='false'/>
20:31:01:
20:31:01: <!-- Network -->
20:31:01: <proxy v=':8080'/>
20:31:01:
20:31:01: <!-- User Information -->
20:31:01: <passkey v='********************************'/>
20:31:01: <team v='235850'/>
20:31:01: <user v='Abuyin'/>
20:31:01:
20:31:01: <!-- Folding Slots -->
20:31:01:</config>
20:31:01:WU00:Slot ID 0 no longer exists and not yet downloaded, dumping
20:31:01:WU00:Cleaning up
20:31:14:Saving configuration to /etc/fahclient/config.xml
20:31:14:<config>
20:31:14: <!-- Client Control -->
20:31:14: <fold-anon v='true'/>
20:31:14:
20:31:14: <!-- Folding Slot Configuration -->
20:31:14: <gpu v='false'/>
20:31:14:
20:31:14: <!-- Network -->
20:31:14: <proxy v=':8080'/>
20:31:14:
20:31:14: <!-- User Information -->
20:31:14: <passkey v='********************************'/>
20:31:14: <team v='235850'/>
20:31:14: <user v='Abuyin'/>
20:31:14:
20:31:14: <!-- Folding Slots -->
20:31:14:</config>
20:33:11:Saving configuration to /etc/fahclient/config.xml
20:33:11:<config>
20:33:11: <!-- Client Control -->
20:33:11: <fold-anon v='true'/>
20:33:11:
20:33:11: <!-- Network -->
20:33:11: <proxy v=':8080'/>
20:33:11:
20:33:11: <!-- User Information -->
20:33:11: <passkey v='********************************'/>
20:33:11: <team v='235850'/>
20:33:11: <user v='Abuyin'/>
20:33:11:
20:33:11: <!-- Folding Slots -->
20:33:11:</config>
20:33:11:Connecting to assign1.foldingathome.org:8080
20:33:12:Updated GPUs.txt
20:33:27:Saving configuration to /etc/fahclient/config.xml
20:33:27:<config>
20:33:27: <!-- Client Control -->
20:33:27: <fold-anon v='true'/>
20:33:27:
20:33:27: <!-- Network -->
20:33:27: <proxy v=':8080'/>
20:33:27:
20:33:27: <!-- User Information -->
20:33:27: <passkey v='********************************'/>
20:33:27: <team v='235850'/>
20:33:27: <user v='Abuyin'/>
20:33:27:
20:33:27: <!-- Folding Slots -->
20:33:27:</config>
20:33:29:Saving configuration to /etc/fahclient/config.xml
20:33:29:<config>
20:33:29: <!-- Client Control -->
20:33:29: <fold-anon v='true'/>
20:33:29:
20:33:29: <!-- Network -->
20:33:29: <proxy v=':8080'/>
20:33:29:
20:33:29: <!-- User Information -->
20:33:29: <passkey v='********************************'/>
20:33:29: <team v='235850'/>
20:33:29: <user v='Abuyin'/>
20:33:29:
20:33:29: <!-- Folding Slots -->
20:33:29:</config>
20:33:51:Saving configuration to /etc/fahclient/config.xml
20:33:51:<config>
20:33:51: <!-- Client Control -->
20:33:51: <fold-anon v='true'/>
20:33:51:
20:33:51: <!-- Network -->
20:33:51: <proxy v=':8080'/>
20:33:51:
20:33:51: <!-- User Information -->
20:33:51: <passkey v='********************************'/>
20:33:51: <team v='235850'/>
20:33:51: <user v='Abuyin'/>
20:33:51:
20:33:51: <!-- Folding Slots -->
20:33:51:</config>
20:34:27:Lost lifeline PID 2570, exiting
20:34:28:Clean exit
*********************** Log Started 2020-03-31T20:34:27Z ***********************
20:34:27:************************* Folding@home Client *************************
20:34:27: Website: https://foldingathome.org/
20:34:27: Copyright: (c) 2009-2018 foldingathome.org
20:34:27: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:34:27: Args: --child --lifeline 2669 /etc/fahclient/config.xml --run-as
20:34:27: fahclient --pid-file=/var/run/fahclient.pid --daemon
20:34:27: Config: /etc/fahclient/config.xml
20:34:27:******************************** Build ********************************
20:34:27: Version: 7.5.1
20:34:27: Date: May 11 2018
20:34:27: Time: 19:59:04
20:34:27: Repository: Git
20:34:27: Revision: 4705bf53c635f88b8fe85af7675557e15d491ff0
20:34:27: Branch: master
20:34:27: Compiler: GNU 6.3.0 20170516
20:34:27: Options: -std=gnu++98 -O3 -funroll-loops
20:34:27: Platform: linux2 4.14.0-3-amd64
20:34:27: Bits: 64
20:34:27: Mode: Release
20:34:27:******************************* System ********************************
20:34:27: CPU: Intel(R) Core(TM) i7-4960X CPU @ 3.60GHz
20:34:27: CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
20:34:27: CPUs: 12
20:34:27: Memory: 15.57GiB
20:34:27: Free Memory: 13.54GiB
20:34:27: Threads: POSIX_THREADS
20:34:27: OS Version: 5.3
20:34:27: Has Battery: false
20:34:27: On Battery: false
20:34:27: UTC Offset: 2
20:34:27: PID: 2671
20:34:27: CWD: /var/lib/fahclient
20:34:27: OS: Linux 5.3.0-45-generic x86_64
20:34:27: OS Arch: AMD64
20:34:27: GPUs: 2
20:34:27: GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:5 GM204 [GeForce GTX 970] 3494
20:34:27: GPU 1: Bus:3 Slot:0 Func:0 NVIDIA:7 GP106 [GeForce GTX 1060 6GB] 4372
20:34:27: CUDA Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:6.1 Driver:10.2
20:34:27: CUDA Device 1: Platform:0 Device:1 Bus:1 Slot:0 Compute:5.2 Driver:10.2
20:34:27:OpenCL Device 0: Platform:0 Device:0 Bus:3 Slot:0 Compute:1.2 Driver:440.64
20:34:27:OpenCL Device 1: Platform:0 Device:1 Bus:1 Slot:0 Compute:1.2 Driver:440.64
20:34:27:***********************************************************************
20:34:27:<config>
20:34:27: <!-- Client Control -->
20:34:27: <fold-anon v='true'/>
20:34:27:
20:34:27: <!-- Network -->
20:34:27: <proxy v=':8080'/>
20:34:27:
20:34:27: <!-- User Information -->
20:34:27: <passkey v='********************************'/>
20:34:27: <team v='235850'/>
20:34:27: <user v='Abuyin'/>
20:34:27:
20:34:27: <!-- Folding Slots -->
20:34:27:</config>
20:34:27:Switching to user fahclient
20:34:27:Trying to access database...
20:34:29:Successfully acquired database lock
20:34:29:Enabled folding slot 00: READY cpu:9
20:34:29:Enabled folding slot 01: READY gpu:0:GM204 [GeForce GTX 970] 3494
20:34:29:Enabled folding slot 02: READY gpu:1:GP106 [GeForce GTX 1060 6GB] 4372
20:34:29:WU00:FS00:Connecting to 65.254.110.245:8080
20:34:29:WU01:FS01:Connecting to 65.254.110.245:8080
20:34:29:WU02:FS02:Connecting to 65.254.110.245:8080
20:34:29:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:34:29:WU00:FS00:Connecting to 18.218.241.186:80
20:34:29:WARNING:WU01:FS01:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:34:29:WU01:FS01:Connecting to 18.218.241.186:80
20:34:29:WARNING:WU02:FS02:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:34:29:WU02:FS02:Connecting to 18.218.241.186:80
20:34:30:WARNING:WU00:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:34:30:ERROR:WU00:FS00:Exception: Could not get an assignment
20:34:30:WARNING:WU01:FS01:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:34:30:ERROR:WU01:FS01:Exception: Could not get an assignment
20:34:30:WARNING:WU02:FS02:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:34:30:ERROR:WU02:FS02:Exception: Could not get an assignment
20:34:30:WU00:FS00:Connecting to 65.254.110.245:8080
20:34:30:WU01:FS01:Connecting to 65.254.110.245:8080
20:34:30:WU02:FS02:Connecting to 65.254.110.245:8080
20:34:31:WARNING:WU00:FS00:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:34:31:WU00:FS00:Connecting to 18.218.241.186:80
20:34:31:WARNING:WU01:FS01:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:34:31:WU01:FS01:Connecting to 18.218.241.186:80
20:34:31:WARNING:WU02:FS02:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:34:31:WU02:FS02:Connecting to 18.218.241.186:80
20:34:32:WARNING:WU00:FS00:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:34:32:ERROR:WU00:FS00:Exception: Could not get an assignment
20:34:32:WARNING:WU01:FS01:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:34:32:ERROR:WU01:FS01:Exception: Could not get an assignment
20:34:32:WARNING:WU02:FS02:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:34:32:ERROR:WU02:FS02:Exception: Could not get an assignment
20:34:39:FS00:Paused
20:35:04:Saving configuration to /etc/fahclient/config.xml
20:35:04:<config>
20:35:04: <!-- Client Control -->
20:35:04: <fold-anon v='true'/>
20:35:04:
20:35:04: <!-- Network -->
20:35:04: <proxy v=':8080'/>
20:35:04:
20:35:04: <!-- User Information -->
20:35:04: <passkey v='********************************'/>
20:35:04: <team v='235850'/>
20:35:04: <user v='Abuyin'/>
20:35:04:
20:35:04: <!-- Folding Slots -->
20:35:04: <slot id='1' type='GPU'/>
20:35:04: <slot id='2' type='GPU'/>
20:35:04:</config>
20:35:04:WU00:Slot ID 0 no longer exists and not yet downloaded, dumping
20:35:04:WU00:Cleaning up
20:35:30:Saving configuration to /etc/fahclient/config.xml
20:35:30:<config>
20:35:30: <!-- Client Control -->
20:35:30: <fold-anon v='true'/>
20:35:30:
20:35:30: <!-- Network -->
20:35:30: <proxy v=':8080'/>
20:35:30:
20:35:30: <!-- User Information -->
20:35:30: <passkey v='********************************'/>
20:35:30: <team v='235850'/>
20:35:30: <user v='Abuyin'/>
20:35:30:
20:35:30: <!-- Folding Slots -->
20:35:30: <slot id='1' type='GPU'/>
20:35:30: <slot id='2' type='GPU'/>
20:35:30:</config>
20:35:31:WU01:FS01:Connecting to 65.254.110.245:8080
20:35:31:WU02:FS02:Connecting to 65.254.110.245:8080
20:35:31:WARNING:WU01:FS01:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:35:31:WU01:FS01:Connecting to 18.218.241.186:80
20:35:31:WARNING:WU02:FS02:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:35:31:WU02:FS02:Connecting to 18.218.241.186:80
20:35:32:WARNING:WU01:FS01:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:35:32:ERROR:WU01:FS01:Exception: Could not get an assignment
20:35:32:WU02:FS02:Assigned to work server 40.114.52.201
20:35:32:WU02:FS02:Requesting new work unit for slot 02: READY gpu:1:GP106 [GeForce GTX 1060 6GB] 4372 from 40.114.52.201
20:35:32:WU02:FS02:Connecting to 40.114.52.201:8080
20:36:58:WU02:FS02:Downloading 29.59MiB
20:37:04:WU02:FS02:Download 6.97%
20:37:08:WU01:FS01:Connecting to 65.254.110.245:8080
20:37:08:WU01:FS01:Assigned to work server 128.252.203.10
20:37:08:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GM204 [GeForce GTX 970] 3494 from 128.252.203.10
20:37:08:WU01:FS01:Connecting to 128.252.203.10:8080
20:37:10:WU02:FS02:Download 18.38%
20:37:16:WU02:FS02:Download 30.63%
20:37:22:WU02:FS02:Download 43.72%
20:37:28:WU02:FS02:Download 53.02%
20:37:34:WU02:FS02:Download 65.69%
20:37:40:WU02:FS02:Download 78.36%
20:37:46:WU02:FS02:Download 91.03%
20:37:52:WU02:FS02:Download 98.43%
20:37:52:WU02:FS02:Download complete
20:37:52:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:11778 run:0 clone:16528 gen:2 core:0x22 unit:0x00000007287234c95e774956638ead01
20:37:52:WU02:FS02:Downloading core from http://cores.foldingathome.org/v7/lin/64bit/Core_22.fah
20:37:52:WU02:FS02:Connecting to cores.foldingathome.org:80
20:37:53:WU02:FS02:FahCore 22: Downloading 3.58MiB
20:37:58:WU02:FS02:FahCore 22: Download complete
20:37:58:WU02:FS02:Valid core signature
20:37:58:WU02:FS02:Unpacked 9.30MiB to cores/cores.foldingathome.org/v7/lin/64bit/Core_22.fah/FahCore_22
20:37:58:WU02:FS02:Starting
20:37:58:WU02:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/Core_22.fah/FahCore_22 -dir 02 -suffix 01 -version 705 -lifeline 2671 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:37:58:WU02:FS02:Started FahCore on PID 2693
20:37:58:WU02:FS02:Core PID:2697
20:37:58:WU02:FS02:FahCore 0x22 started
20:37:58:WU02:FS02:0x22:*********************** Log Started 2020-03-31T20:37:58Z ***********************
20:37:58:WU02:FS02:0x22:*************************** Core22 Folding@home Core ***************************
20:37:58:WU02:FS02:0x22: Type: 0x22
20:37:58:WU02:FS02:0x22: Core: Core22
20:37:58:WU02:FS02:0x22: Website: https://foldingathome.org/
20:37:58:WU02:FS02:0x22: Copyright: (c) 2009-2018 foldingathome.org
20:37:58:WU02:FS02:0x22: Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
20:37:58:WU02:FS02:0x22: <rafal.wiewiora@choderalab.org>
20:37:58:WU02:FS02:0x22: Args: -dir 02 -suffix 01 -version 705 -lifeline 2693 -checkpoint 15
20:37:58:WU02:FS02:0x22: -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
20:37:58:WU02:FS02:0x22: 0 -gpu 0
20:37:58:WU02:FS02:0x22: Config: <none>
20:37:58:WU02:FS02:0x22:************************************ Build *************************************
20:37:58:WU02:FS02:0x22: Version: 0.0.2
20:37:58:WU02:FS02:0x22: Date: Dec 6 2019
20:37:58:WU02:FS02:0x22: Time: 21:20:17
20:37:58:WU02:FS02:0x22: Repository: Git
20:37:58:WU02:FS02:0x22: Revision: f87d92b58abdf7e6bf2e173cfbc4dc3e837c7042
20:37:58:WU02:FS02:0x22: Branch: core22
20:37:58:WU02:FS02:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:37:58:WU02:FS02:0x22: Options: -std=gnu++98 -O3 -funroll-loops
20:37:58:WU02:FS02:0x22: Platform: linux2 4.9.87-linuxkit-aufs
20:37:58:WU02:FS02:0x22: Bits: 64
20:37:58:WU02:FS02:0x22: Mode: Release
20:37:58:WU02:FS02:0x22:************************************ System ************************************
20:37:58:WU02:FS02:0x22: CPU: Intel(R) Core(TM) i7-4960X CPU @ 3.60GHz
20:37:58:WU02:FS02:0x22: CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
20:37:58:WU02:FS02:0x22: CPUs: 12
20:37:58:WU02:FS02:0x22: Memory: 15.57GiB
20:37:58:WU02:FS02:0x22:Free Memory: 13.50GiB
20:37:58:WU02:FS02:0x22: Threads: POSIX_THREADS
20:37:58:WU02:FS02:0x22: OS Version: 5.3
20:37:58:WU02:FS02:0x22:Has Battery: false
20:37:58:WU02:FS02:0x22: On Battery: false
20:37:58:WU02:FS02:0x22: UTC Offset: 2
20:37:58:WU02:FS02:0x22: PID: 2697
20:37:58:WU02:FS02:0x22: CWD: /var/lib/fahclient/work
20:37:58:WU02:FS02:0x22: OS: Linux 5.3.0-45-generic x86_64
20:37:58:WU02:FS02:0x22: OS Arch: AMD64
20:37:58:WU02:FS02:0x22:********************************************************************************
20:37:58:WU02:FS02:0x22:Project: 11778 (Run 0, Clone 16528, Gen 2)
20:37:58:WU02:FS02:0x22:Unit: 0x00000007287234c95e774956638ead01
20:37:58:WU02:FS02:0x22:Reading tar file core.xml
20:37:58:WU02:FS02:0x22:Reading tar file integrator.xml
20:37:58:WU02:FS02:0x22:Reading tar file state.xml
20:37:58:WU02:FS02:0x22:Reading tar file system.xml
20:37:58:WU02:FS02:0x22:Digital signatures verified
20:37:58:WU02:FS02:0x22:Folding@home GPU Core22 Folding@home Core
20:37:58:WU02:FS02:0x22:Version 0.0.2
20:38:00:WU02:FS02:0x22:ERROR:exception: Error initializing context: clCreateContext (-30)
20:38:00:WU02:FS02:0x22:Saving result file ../logfile_01.txt
20:38:00:WU02:FS02:0x22:Saving result file science.log
20:38:00:WU02:FS02:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
20:38:00:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:38:00:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:11778 run:0 clone:16528 gen:2 core:0x22 unit:0x00000007287234c95e774956638ead01
20:38:00:WU02:FS02:Uploading 8.00KiB to 40.114.52.201
20:38:00:WU02:FS02:Connecting to 40.114.52.201:8080
20:38:01:WU00:FS02:Connecting to 65.254.110.245:8080
20:38:01:WARNING:WU00:FS02:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:38:01:WU00:FS02:Connecting to 18.218.241.186:80
20:38:02:WARNING:WU00:FS02:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:38:02:ERROR:WU00:FS02:Exception: Could not get an assignment
20:38:02:WU00:FS02:Connecting to 65.254.110.245:8080
20:38:02:WARNING:WU00:FS02:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:38:02:WU00:FS02:Connecting to 18.218.241.186:80
20:38:03:WARNING:WU00:FS02:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:38:03:ERROR:WU00:FS02:Exception: Could not get an assignment
20:39:02:WU00:FS02:Connecting to 65.254.110.245:8080
20:39:02:WARNING:WU00:FS02:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:39:02:WU00:FS02:Connecting to 18.218.241.186:80
20:39:03:WARNING:WU00:FS02:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:39:03:ERROR:WU00:FS02:Exception: Could not get an assignment
20:39:13:WU01:FS01:Downloading 86.23MiB
20:39:19:WU01:FS01:Download 4.28%
20:39:25:WU01:FS01:Download 9.13%
20:39:31:WU01:FS01:Download 13.99%
20:39:37:WU01:FS01:Download 19.06%
20:39:43:WU01:FS01:Download 24.28%
20:39:49:WU01:FS01:Download 29.50%
20:39:55:WU01:FS01:Download 34.28%
20:40:01:WU01:FS01:Download 39.06%
20:40:07:WU01:FS01:Download 44.07%
20:40:11:WARNING:WU02:FS02:WorkServer connection failed on port 8080 trying 80
20:40:11:WU02:FS02:Connecting to 40.114.52.201:80
20:40:11:WU02:FS02:Upload 100.00%
20:40:13:WU01:FS01:Download 48.92%
20:40:19:WU01:FS01:Download 53.27%
20:40:25:WU01:FS01:Download 56.68%
20:40:25:WU02:FS02:Upload complete
20:40:25:WU02:FS02:Server responded WORK_ACK (400)
20:40:25:WU02:FS02:Cleaning up
20:40:31:WU01:FS01:Download 60.95%
20:40:37:WU01:FS01:Download 65.88%
20:40:39:WU00:FS02:Connecting to 65.254.110.245:8080
20:40:40:WARNING:WU00:FS02:Failed to get assignment from '65.254.110.245:8080': No WUs available for this configuration
20:40:40:WU00:FS02:Connecting to 18.218.241.186:80
20:40:40:WARNING:WU00:FS02:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
20:40:40:ERROR:WU00:FS02:Exception: Could not get an assignment
20:40:43:WU01:FS01:Download 71.10%
20:40:49:WU01:FS01:Download 76.03%
20:40:55:WU01:FS01:Download 81.03%
20:41:01:WU01:FS01:Download 85.74%
20:41:07:WU01:FS01:Download 89.00%
20:41:13:WU01:FS01:Download 91.83%
20:41:19:WU01:FS01:Download 96.90%
20:41:23:WU01:FS01:Download complete
20:41:23:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:11764 run:0 clone:6639 gen:18 core:0x22 unit:0x0000001f80fccb0a5e7112fe1600de19
20:41:23:WU01:FS01:Starting
20:41:23:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/v7/lin/64bit/Core_22.fah/FahCore_22 -dir 01 -suffix 01 -version 705 -lifeline 2671 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device 1 -gpu 1
20:41:23:WU01:FS01:Started FahCore on PID 2957
20:41:23:WU01:FS01:Core PID:2961
20:41:23:WU01:FS01:FahCore 0x22 started
20:41:23:WU01:FS01:0x22:*********************** Log Started 2020-03-31T20:41:23Z ***********************
20:41:23:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
20:41:23:WU01:FS01:0x22: Type: 0x22
20:41:23:WU01:FS01:0x22: Core: Core22
20:41:23:WU01:FS01:0x22: Website: https://foldingathome.org/
20:41:23:WU01:FS01:0x22: Copyright: (c) 2009-2018 foldingathome.org
20:41:23:WU01:FS01:0x22: Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
20:41:23:WU01:FS01:0x22: <rafal.wiewiora@choderalab.org>
20:41:23:WU01:FS01:0x22: Args: -dir 01 -suffix 01 -version 705 -lifeline 2957 -checkpoint 15
20:41:23:WU01:FS01:0x22: -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device
20:41:23:WU01:FS01:0x22: 1 -gpu 1
20:41:23:WU01:FS01:0x22: Config: <none>
20:41:23:WU01:FS01:0x22:************************************ Build *************************************
20:41:23:WU01:FS01:0x22: Version: 0.0.2
20:41:23:WU01:FS01:0x22: Date: Dec 6 2019
20:41:23:WU01:FS01:0x22: Time: 21:20:17
20:41:23:WU01:FS01:0x22: Repository: Git
20:41:23:WU01:FS01:0x22: Revision: f87d92b58abdf7e6bf2e173cfbc4dc3e837c7042
20:41:23:WU01:FS01:0x22: Branch: core22
20:41:23:WU01:FS01:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:41:23:WU01:FS01:0x22: Options: -std=gnu++98 -O3 -funroll-loops
20:41:23:WU01:FS01:0x22: Platform: linux2 4.9.87-linuxkit-aufs
20:41:23:WU01:FS01:0x22: Bits: 64
20:41:23:WU01:FS01:0x22: Mode: Release
20:41:23:WU01:FS01:0x22:************************************ System ************************************
20:41:23:WU01:FS01:0x22: CPU: Intel(R) Core(TM) i7-4960X CPU @ 3.60GHz
20:41:23:WU01:FS01:0x22: CPU ID: GenuineIntel Family 6 Model 62 Stepping 4
20:41:23:WU01:FS01:0x22: CPUs: 12
20:41:23:WU01:FS01:0x22: Memory: 15.57GiB
20:41:23:WU01:FS01:0x22:Free Memory: 12.82GiB
20:41:23:WU01:FS01:0x22: Threads: POSIX_THREADS
20:41:23:WU01:FS01:0x22: OS Version: 5.3
20:41:23:WU01:FS01:0x22:Has Battery: false
20:41:23:WU01:FS01:0x22: On Battery: false
20:41:23:WU01:FS01:0x22: UTC Offset: 2
20:41:23:WU01:FS01:0x22: PID: 2961
20:41:23:WU01:FS01:0x22: CWD: /var/lib/fahclient/work
20:41:23:WU01:FS01:0x22: OS: Linux 5.3.0-45-generic x86_64
20:41:23:WU01:FS01:0x22: OS Arch: AMD64
20:41:23:WU01:FS01:0x22:********************************************************************************
20:41:23:WU01:FS01:0x22:Project: 11764 (Run 0, Clone 6639, Gen 18)
20:41:23:WU01:FS01:0x22:Unit: 0x0000001f80fccb0a5e7112fe1600de19
20:41:23:WU01:FS01:0x22:Reading tar file core.xml
20:41:23:WU01:FS01:0x22:Reading tar file integrator.xml
20:41:23:WU01:FS01:0x22:Reading tar file state.xml
20:41:23:WU01:FS01:0x22:Reading tar file system.xml
20:41:23:WU01:FS01:0x22:Digital signatures verified
20:41:23:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
20:41:23:WU01:FS01:0x22:Version 0.0.2
20:41:29:WU01:FS01:0x22:ERROR:exception: Error initializing context: clCreateContext (-30)
20:41:29:WU01:FS01:0x22:Saving result file ../logfile_01.txt
20:41:29:WU01:FS01:0x22:Saving result file science.log
20:41:29:WU01:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
20:41:30:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:41:30:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:11764 run:0 clone:6639 gen:18 core:0x22 unit:0x0000001f80fccb0a5e7112fe1600de19
Running the 440.64 Driver
Code: Select all
nvidia-smi
Tue Mar 31 22:50:17 2020
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.64 Driver Version: 440.64 CUDA Version: 10.2 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 GeForce GTX 970 Off | 00000000:01:00.0 On | N/A |
| 33% 37C P0 45W / 120W | 528MiB / 4040MiB | 1% Default |
+-------------------------------+----------------------+----------------------+
| 1 GeForce GTX 106... Off | 00000000:03:00.0 Off | N/A |
| 0% 35C P8 6W / 150W | 12MiB / 6078MiB | 0% Default |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| 0 1520 G /usr/lib/xorg/Xorg 34MiB |
| 0 1558 G /usr/bin/gnome-shell 50MiB |
| 0 1914 G /usr/lib/xorg/Xorg 273MiB |
| 0 2049 G /usr/bin/gnome-shell 161MiB |
+-----------------------------------------------------------------------------+
openCL is installed too
i purged FAHClient and Control and reinstalled it still the same. I'm out of ideas for now.
Re: GTX1060 Ubuntu16.04 drv430 BAD_WORK_UNIT Error compiling
Posted: Wed Apr 01, 2020 4:17 pm
by Abuyin
FIXED
reinstalling GPU Drivers 440.64 in my case fixed it for me. Now the dual GPU setup is folding and the servers don't respont with BAD_WORK_UNIT anymore.