Page 1 of 1
Error compiling kernel GTX 550 Ti
Posted: Sat May 02, 2020 8:41 pm
by Zekovski
Hello, I'm new here and trying to get my GPU to work. (CPU is fine)
It once started a project and failed to recover it after computer reboot.
And currently it fails every projects it gets.
Anybody can help please ?
Here is the log :
Edit : I already reinstalled the client, but kept the data during reinstallation.
Code: Select all
*********************** Log Started 2020-05-02T18:55:21Z ***********************
18:55:29:WU00:FS01:Connecting to 65.254.110.245:80
18:55:31:WU00:FS01:Assigned to work server 3.133.76.19
18:55:31:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GF116 [GeForce GTX 550 Ti] 691 from 3.133.76.19
18:55:31:WU00:FS01:Connecting to 3.133.76.19:8080
18:56:58:WU00:FS01:Downloading 20.24MiB
18:57:04:WU00:FS01:Download 14.82%
18:57:10:WU00:FS01:Download 34.27%
18:57:16:WU00:FS01:Download 46.93%
18:57:22:WU00:FS01:Download 54.34%
18:57:28:WU00:FS01:Download 62.99%
18:57:34:WU00:FS01:Download 70.09%
18:57:40:WU00:FS01:Download 77.50%
18:57:46:WU00:FS01:Download 84.60%
18:57:52:WU00:FS01:Download 95.71%
18:57:55:WU00:FS01:Download complete
18:57:55:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14437 run:834 clone:2 gen:19 core:0x22 unit:0x0000001503854c135e9d226254935b1c
18:57:55:WU00:FS01:Starting
18:57:55:WU00:FS01:Running FahCore: D:\Programmes\FoldingAtHome\FAHClient/FAHCoreWrapper.exe D:\Programmes\FoldingAtHome\Config&Data\cores/cores.foldingathome.org/v7/win/64bit/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 8232 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device 0 -gpu 0
18:57:55:WU00:FS01:Started FahCore on PID 10116
18:57:55:WU00:FS01:Core PID:10076
18:57:55:WU00:FS01:FahCore 0x22 started
18:57:56:WU00:FS01:0x22:*********************** Log Started 2020-05-02T18:57:56Z ***********************
18:57:56:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
18:57:56:WU00:FS01:0x22: Type: 0x22
18:57:56:WU00:FS01:0x22: Core: Core22
18:57:56:WU00:FS01:0x22: Website: https://foldingathome.org/
18:57:56:WU00:FS01:0x22: Copyright: (c) 2009-2018 foldingathome.org
18:57:56:WU00:FS01:0x22: Author: John Chodera <john.chodera@choderalab.org> and Rafal Wiewiora
18:57:56:WU00:FS01:0x22: <rafal.wiewiora@choderalab.org>
18:57:56:WU00:FS01:0x22: Args: -dir 00 -suffix 01 -version 706 -lifeline 10116 -checkpoint 15
18:57:56:WU00:FS01:0x22: -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device
18:57:56:WU00:FS01:0x22: 0 -gpu 0
18:57:56:WU00:FS01:0x22: Config: <none>
18:57:56:WU00:FS01:0x22:************************************ Build *************************************
18:57:56:WU00:FS01:0x22: Version: 0.0.5
18:57:56:WU00:FS01:0x22: Date: Apr 22 2020
18:57:56:WU00:FS01:0x22: Time: 04:42:59
18:57:56:WU00:FS01:0x22: Repository: Git
18:57:56:WU00:FS01:0x22: Revision: 2d69202c898bd9bb3e093f51cd32bf411c2a0388
18:57:56:WU00:FS01:0x22: Branch: HEAD
18:57:56:WU00:FS01:0x22: Compiler: Visual C++ 2008
18:57:56:WU00:FS01:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:57:56:WU00:FS01:0x22: Platform: win32 10
18:57:56:WU00:FS01:0x22: Bits: 64
18:57:56:WU00:FS01:0x22: Mode: Release
18:57:56:WU00:FS01:0x22:************************************ System ************************************
18:57:56:WU00:FS01:0x22: CPU: Intel(R) Core(TM) i5-4590 CPU @ 3.30GHz
18:57:56:WU00:FS01:0x22: CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
18:57:56:WU00:FS01:0x22: CPUs: 4
18:57:56:WU00:FS01:0x22: Memory: 7.95GiB
18:57:56:WU00:FS01:0x22:Free Memory: 5.72GiB
18:57:56:WU00:FS01:0x22: Threads: WINDOWS_THREADS
18:57:56:WU00:FS01:0x22: OS Version: 6.2
18:57:56:WU00:FS01:0x22:Has Battery: false
18:57:56:WU00:FS01:0x22: On Battery: false
18:57:56:WU00:FS01:0x22: UTC Offset: 2
18:57:56:WU00:FS01:0x22: PID: 10076
18:57:56:WU00:FS01:0x22: CWD: D:\Programmes\FoldingAtHome\Config&Data\work
18:57:56:WU00:FS01:0x22: OS: Windows 10 Pro
18:57:56:WU00:FS01:0x22: OS Arch: AMD64
18:57:56:WU00:FS01:0x22:********************************************************************************
18:57:56:WU00:FS01:0x22:Project: 14437 (Run 834, Clone 2, Gen 19)
18:57:56:WU00:FS01:0x22:Unit: 0x0000001503854c135e9d226254935b1c
18:57:56:WU00:FS01:0x22:Reading tar file core.xml
18:57:56:WU00:FS01:0x22:Reading tar file integrator.xml
18:57:56:WU00:FS01:0x22:Reading tar file state.xml
18:57:57:WU00:FS01:0x22:Reading tar file system.xml
18:57:57:WU00:FS01:0x22:Digital signatures verified
18:57:57:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
18:57:57:WU00:FS01:0x22:Version 0.0.5
18:58:15:WU00:FS01:0x22:ERROR:exception: Error compiling kernel:
18:58:15:WU00:FS01:0x22:Saving result file ..\logfile_01.txt
18:58:15:WU00:FS01:0x22:Saving result file science.log
18:58:15:WU00:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
18:58:16:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
18:58:16:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:14437 run:834 clone:2 gen:19 core:0x22 unit:0x0000001503854c135e9d226254935b1c
18:58:16:WU00:FS01:Uploading 2.28KiB to 3.133.76.19
18:58:16:WU00:FS01:Connecting to 3.133.76.19:8080
18:58:16:WU02:FS01:Connecting to 65.254.110.245:80
18:58:17:WARNING:WU02:FS01:Failed to get assignment from '65.254.110.245:80': No WUs available for this configuration
18:58:17:WU02:FS01:Connecting to 18.218.241.186:80
18:58:18:WARNING:WU02:FS01:Failed to get assignment from '18.218.241.186:80': No WUs available for this configuration
18:58:18:WU02:FS01:Connecting to 65.254.110.245:80
Re: Error compiling kernel GTX 550 Ti
Posted: Sat May 02, 2020 9:00 pm
by PantherX
Welcome to the F@H Forum Zekovski,
Can you please post the first 100 line of the log file so we can see what the client has detected and how it has been configured?
Re: Error compiling kernel GTX 550 Ti
Posted: Sat May 02, 2020 9:02 pm
by Zekovski
Here it is.
Code: Select all
*********************** Log Started 2020-05-02T18:55:21Z ***********************
18:55:21:****************************** FAHClient ******************************
18:55:21: Version: 7.6.9
18:55:21: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
18:55:21: Copyright: 2020 foldingathome.org
18:55:21: Homepage: https://foldingathome.org/
18:55:21: Date: Apr 17 2020
18:55:21: Time: 11:13:06
18:55:21: Revision: 398c2b17fa535e0cc6c9d10856b2154c32771646
18:55:21: Branch: master
18:55:21: Compiler: Visual C++ 2008
18:55:21: Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:55:21: Platform: win32 10
18:55:21: Bits: 32
18:55:21: Mode: Release
18:55:21: Config: D:\Programmes\FoldingAtHome\Config&Data\config.xml
18:55:21:******************************** CBang ********************************
18:55:21: Date: Apr 17 2020
18:55:21: Time: 11:10:09
18:55:21: Revision: 2fb0be7809c5e45287a122ca5fbc15b5ae859a3b
18:55:21: Branch: master
18:55:21: Compiler: Visual C++ 2008
18:55:21: Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:55:21: Platform: win32 10
18:55:21: Bits: 32
18:55:21: Mode: Release
18:55:21:******************************* System ********************************
18:55:21: CPU: Intel(R) Core(TM) i5-4590 CPU @ 3.30GHz
18:55:21: CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
18:55:21: CPUs: 4
18:55:21: Memory: 7.95GiB
18:55:21: Free Memory: 6.34GiB
18:55:21: Threads: WINDOWS_THREADS
18:55:21: OS Version: 6.2
18:55:21: Has Battery: false
18:55:21: On Battery: false
18:55:21: UTC Offset: 2
18:55:21: PID: 8232
18:55:21: CWD: D:\Programmes\FoldingAtHome\Config&Data
18:55:21: OS: Windows 10 Enterprise
18:55:21: OS Arch: AMD64
18:55:21: GPUs: 1
18:55:21: GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:2 GF116 [GeForce GTX 550 Ti] 691
18:55:21: CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:2.1 Driver:9.1
18:55:21:OpenCL Device 1: Platform:1 Device:0 Bus:1 Slot:0 Compute:1.1 Driver:391.35
18:55:21: Win32 Service: false
18:55:21:******************************* libFAH ********************************
18:55:21: Date: Apr 15 2020
18:55:21: Time: 14:53:14
18:55:21: Revision: 216968bc7025029c841ed6e36e81a03a316890d3
18:55:21: Branch: master
18:55:21: Compiler: Visual C++ 2008
18:55:21: Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:55:21: Platform: win32 10
18:55:21: Bits: 32
18:55:21: Mode: Release
18:55:21:***********************************************************************
18:55:22:<config>
18:55:22: <!-- Network -->
18:55:22: <proxy v=':8080'/>
18:55:22:
18:55:22: <!-- Slot Control -->
18:55:22: <power v='full'/>
18:55:22:
18:55:22: <!-- User Information -->
18:55:22: <user v='Zekovski'/>
18:55:22:
18:55:22: <!-- Folding Slots -->
18:55:22: <slot id='0' type='CPU'>
18:55:22: <cpus v='4'/>
18:55:22: </slot>
18:55:22: <slot id='1' type='GPU'/>
18:55:22:</config>
18:55:22:Trying to access database...
18:55:22:Successfully acquired database lock
18:55:22:Enabled folding slot 00: READY cpu:4
18:55:22:Enabled folding slot 01: READY gpu:0:GF116 [GeForce GTX 550 Ti] 691
18:55:22:WU01:FS00:Starting
18:55:22:WU01:FS00:Running FahCore: D:\Programmes\FoldingAtHome\FAHClient/FAHCoreWrapper.exe D:\Programmes\FoldingAtHome\Config&Data\cores/cores.foldingathome.org/v7/win/64bit/avx/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 8232 -checkpoint 15 -np 4
18:55:23:WU01:FS00:Started FahCore on PID 8528
18:55:26:WU01:FS00:Core PID:9852
18:55:26:WU01:FS00:FahCore 0xa7 started
18:55:27:WU01:FS00:0xa7:*********************** Log Started 2020-05-02T18:55:27Z ***********************
18:55:27:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
18:55:27:WU01:FS00:0xa7: Type: 0xa7
18:55:27:WU01:FS00:0xa7: Core: Gromacs
18:55:27:WU01:FS00:0xa7: Args: -dir 01 -suffix 01 -version 706 -lifeline 8528 -checkpoint 15 -np 4
18:55:27:WU01:FS00:0xa7:************************************ CBang *************************************
18:55:27:WU01:FS00:0xa7: Date: Oct 26 2019
18:55:27:WU01:FS00:0xa7: Time: 01:38:25
18:55:27:WU01:FS00:0xa7: Revision: c46a1a011a24143739ac7218c5a435f66777f62f
18:55:27:WU01:FS00:0xa7: Branch: master
18:55:27:WU01:FS00:0xa7: Compiler: Visual C++ 2008
18:55:27:WU01:FS00:0xa7: Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:55:27:WU01:FS00:0xa7: Platform: win32 10
18:55:27:WU01:FS00:0xa7: Bits: 64
18:55:27:WU01:FS00:0xa7: Mode: Release
18:55:27:WU01:FS00:0xa7:************************************ System ************************************
18:55:27:WU01:FS00:0xa7: CPU: Intel(R) Core(TM) i5-4590 CPU @ 3.30GHz
18:55:27:WU01:FS00:0xa7: CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
18:55:27:WU01:FS00:0xa7: CPUs: 4
18:55:27:WU01:FS00:0xa7: Memory: 7.95GiB
18:55:27:WU01:FS00:0xa7:Free Memory: 6.08GiB
18:55:27:WU01:FS00:0xa7: Threads: WINDOWS_THREADS
18:55:27:WU01:FS00:0xa7: OS Version: 6.2
18:55:27:WU01:FS00:0xa7:Has Battery: false
18:55:27:WU01:FS00:0xa7: On Battery: false
18:55:27:WU01:FS00:0xa7: UTC Offset: 2
18:55:27:WU01:FS00:0xa7: PID: 9852
18:55:27:WU01:FS00:0xa7: CWD: D:\Programmes\FoldingAtHome\Config&Data\work
18:55:27:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
18:55:27:WU01:FS00:0xa7: Version: 0.0.18
18:55:27:WU01:FS00:0xa7: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
18:55:27:WU01:FS00:0xa7: Copyright: 2019 foldingathome.org
18:55:27:WU01:FS00:0xa7: Homepage: https://foldingathome.org/
18:55:27:WU01:FS00:0xa7: Date: Oct 26 2019
18:55:27:WU01:FS00:0xa7: Time: 01:52:30
18:55:27:WU01:FS00:0xa7: Revision: c1e3513b1bc0c16013668f2173ee969e5995b38e
18:55:27:WU01:FS00:0xa7: Branch: master
18:55:27:WU01:FS00:0xa7: Compiler: Visual C++ 2008
18:55:27:WU01:FS00:0xa7: Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
18:55:27:WU01:FS00:0xa7: Platform: win32 10
18:55:27:WU01:FS00:0xa7: Bits: 64
18:55:27:WU01:FS00:0xa7: Mode: Release
18:55:27:WU01:FS00:0xa7:************************************ Build *************************************
18:55:27:WU01:FS00:0xa7: SIMD: avx_256
18:55:27:WU01:FS00:0xa7:********************************************************************************
18:55:27:WU01:FS00:0xa7:Project: 14311 (Run 8, Clone 19, Gen 75)
18:55:27:WU01:FS00:0xa7:Unit: 0x000000520002894b5df2b699e9a83e59
18:55:27:WU01:FS00:0xa7:Digital signatures verified
18:55:27:WU01:FS00:0xa7:Calling: mdrun -s frame75.tpr -o frame75.trr -cpi state.cpt -cpt 15 -nt 4
18:55:28:WU01:FS00:0xa7:Steps: first=37500000 total=500000
18:55:29:WU00:FS01:Connecting to 65.254.110.245:80
18:55:30:WU01:FS00:0xa7:Completed 163777 out of 500000 steps (32%)
18:55:31:WU00:FS01:Assigned to work server 3.133.76.19
18:55:31:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:GF116 [GeForce GTX 550 Ti] 691 from 3.133.76.19
Re: Error compiling kernel GTX 550 Ti
Posted: Sat May 02, 2020 9:17 pm
by PantherX
I haven't seen that message before:
18:58:15:WU00:FS01:0x22:ERROR:exception: Error compiling kernel:
I have contacted the researcher in case it's an issue since FahCore_22 version 0.0.5 has recently been released.
Re: Error compiling kernel GTX 550 Ti
Posted: Sat May 02, 2020 9:19 pm
by bruce
My GTX 550 Ti is working fine.
The exception Error compiling kernel: is, indeed, strange. Are you running the latest drivers from nvidia.com that support that GPU? Are you running the OpenCL drvier that came with the drivers?
Re: Error compiling kernel GTX 550 Ti
Posted: Sat May 02, 2020 9:24 pm
by JohnChodera
Thanks for the report! I don't believe we've seen this before, but I'll check the logs to see if this has happened elsewhere.
We'll add some more instrumentation to the next core22 release (0.0.6) slated for this coming week to bring back more information to help us debug this.
In the meantime, if you have the time, I'd suggest trying the following:
* Delete the core from the cores directory (it will auto-re-download) to see if you pick up a project with 0.0.4, and see if that runs but 0.0.5 does not
* If so, perhaps reinstall your GPU drivers (which should bring the OpenCL drivers with it)? That error means that, for some reason, we don't have OpenCL 1.2 or later available, which recent drivers should provide. Our updated core will try to bring back more info on the error.
~ John Chodera // MSKCC
Re: Error compiling kernel GTX 550 Ti
Posted: Sat May 02, 2020 9:27 pm
by PantherX
I did a quick check and it seems that for GTX 550 Ti, the latest driver is 391.35 WHQL released on 2018.3.27 which I think your system has:
18:55:21: CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:2.1 Driver:9.1
18:55:21:OpenCL Device 1: Platform:1 Device:0 Bus:1 Slot:0 Compute:1.1 Driver:391.35
However, bruce and JohnChodera do have a point where a Microsoft update may have installed the "latest" version which might cause driver issues so that's something you can check. Also, when was the last time you were able to successfully fold on the GPU?
Re: Error compiling kernel GTX 550 Ti
Posted: Sat May 02, 2020 9:33 pm
by Zekovski
My drivers come with Geforce Experience. So indeed, I have 391.35. Concerning OpenCL, I have run the FAHBench and it did not encounter problems with the GPU. But I don't know how to check anyway else for OpenCL.
Last (and only) time I folded with it was at most 3 days ago.
I'll try your solutions John and keep you updated.
Thanks everyone.
Re: Error compiling kernel GTX 550 Ti
Posted: Sat May 02, 2020 9:39 pm
by PantherX
Download GPU-Z and see what it says
Re: Error compiling kernel GTX 550 Ti
Posted: Sat May 02, 2020 9:56 pm
by Zekovski
So I reinstalled the driver and restarted. Nothing new, I still get the same error.
And this is what GPUZ has to say. So seems OpenCL is fine.
https://zekovski.files.wordpress.com/2020/05/gpuz.png
Re: Error compiling kernel GTX 550 Ti
Posted: Sat May 02, 2020 10:02 pm
by Joe_H
You may be running into an issue that some others have encountered with the GT400 and GT500 series cards. Officially they just support OpenCL 1.1. But some of them have enough hardware/software support to run the GPU cores that usually require OpenCL 1.2. But some specific projects don't work, some error or another crops up. The exact error may depend on which card from these series is being used.
Now whether this is coming from a change in Core_22 between v0.0.2 and the current 0.0.5, John Chodera may have a better idea than me. But some issues were reported before this update for Core_22.
Re: Error compiling kernel GTX 550 Ti
Posted: Sun May 03, 2020 4:48 am
by JohnChodera
@Joe_H may be on the right track here: OpenMM technically requires OpenCL 1.2, but not every project may exercise kernels that require OpenCL 1.2.
Let me confer with the other devs and see what we can come up with in the next few days.
In the meantime, it would be great to know if deleting the work and cores directory gets you any working WUs, and noting whether this is because (1) you picked up 0.0.5 but a different _project_, or (2) you picked up 0.0.2.
~ John Chodera // MSKCC
Re: Error compiling kernel GTX 550 Ti
Posted: Sun May 03, 2020 7:25 pm
by Zekovski
I did a complete reinstallation today and the problem persists.
And sorry but I could not get a core that wasn't 0.0.5.
I'll keep you updated if something happens.
Re: Error compiling kernel GTX 550 Ti
Posted: Sun May 03, 2020 9:11 pm
by JohnChodera
@Zekovski: Thanks so much for trying! We'll see if we can bring back more debug info in the next core release!
~ John Chodera // MSKCC
Re: Error compiling kernel GTX 550 Ti
Posted: Thu Jul 09, 2020 8:19 pm
by Zekovski
Hello.
I had to reinstall F@H today. And I don't know what you guys have been doing up until now but it works ! My GPU is now folding normally. I didn't even have to configure it like before.
So thank you everyone !
Be fine.
