Failed GPU slot daily :(

It seems that a lot of GPU problems revolve around specific versions of drivers. Though AMD has their own support structure, you can often learn from information reported by others who fold.

Moderators: Site Moderators, FAHC Science Team

Post Reply
crimson1077
Posts: 33
Joined: Sat Aug 22, 2020 4:37 pm

Failed GPU slot daily :(

Post by crimson1077 »

I have no idea how to fix this, and mind you I have already uninstalled and clean installed driver for my AMD R9 390. A few were newer and some I tried were even rollback drivers. Even reinstalled FAH as well. Deleted the CPU slot, and restarted computer then re-added the CPU slot. Also have done the same with GPU slot. I was folding fine, then paused my CPU & GPU, shut down computer, fired it up a few days later to this. What seems to be the kicker?

I'm noticing "BAD_WORK_UNIT (114 = 0x72)" and "WARNING:WU00:FS00:Changed SMP threads from 4 to 3 this can cause some work units to fail" in the log. :?:
Last edited by crimson1077 on Sat Aug 22, 2020 8:45 pm, edited 2 times in total.
Top
JimboPalmer
Posts: 2522
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: Failed GPU slot daily :(

Post by JimboPalmer »

Sadly, You did not list the configuration portion of your log. the first 200 lines tell us many things you did not.
viewtopic.php?f=24&t=26036

As a trouble shooting step, delete the CPU slot, and restart your computer than re-add the CPU slot.
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
Top
crimson1077
Posts: 33
Joined: Sat Aug 22, 2020 4:37 pm

Re: Failed GPU slot daily :(

Post by crimson1077 »

Let me have a look
Last edited by crimson1077 on Sat Aug 22, 2020 8:31 pm, edited 1 time in total.
Top
Neil-B
Posts: 1996
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: Failed GPU slot daily :(

Post by Neil-B »

The last 16 logs are in the log sub folder ... and you can set log-rotate-max to 0 in advance control expert configuration iirc
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Top
crimson1077
Posts: 33
Joined: Sat Aug 22, 2020 4:37 pm

Re: Failed GPU slot daily :(

Post by crimson1077 »

Code: Select all

*********************** Log Started 2020-08-22T20:18:27Z ***********************
20:18:27:Trying to access database...
20:18:27:Successfully acquired database lock
20:18:27:Read GPUs.txt
20:18:27:Enabled folding slot 00: READY cpu:3
20:18:28:Enabled folding slot 01: READY gpu:0:Hawaii [Radeon R9 200/300 Series]
20:18:28:****************************** FAHClient ******************************
20:18:28:        Version: 7.6.13
20:18:28:         Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:18:28:      Copyright: 2020 foldingathome.org
20:18:28:       Homepage: https://foldingathome.org/
20:18:28:           Date: Apr 27 2020
20:18:28:           Time: 21:21:01
20:18:28:       Revision: 5a652817f46116b6e135503af97f18e094414e3b
20:18:28:         Branch: master
20:18:28:       Compiler: Visual C++ 2008
20:18:28:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
20:18:28:       Platform: win32 10
20:18:28:           Bits: 32
20:18:28:           Mode: Release
20:18:28:         Config: C:\Users\Crimson\AppData\Roaming\FAHClient\config.xml
20:18:28:******************************** CBang ********************************
20:18:28:           Date: Apr 24 2020
20:18:28:           Time: 17:07:55
20:18:28:       Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
20:18:28:         Branch: master
20:18:28:       Compiler: Visual C++ 2008
20:18:28:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
20:18:28:       Platform: win32 10
20:18:28:           Bits: 32
20:18:28:           Mode: Release
20:18:28:******************************* System ********************************
20:18:28:            CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz
20:18:28:         CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
20:18:28:           CPUs: 4
20:18:28:         Memory: 14.97GiB
20:18:28:    Free Memory: 13.37GiB
20:18:28:        Threads: WINDOWS_THREADS
20:18:28:     OS Version: 6.2
20:18:28:    Has Battery: false
20:18:28:     On Battery: false
20:18:28:     UTC Offset: -5
20:18:28:            PID: 3680
20:18:28:            CWD: C:\Users\Crimson\AppData\Roaming\FAHClient
20:18:28:  Win32 Service: false
20:18:28:             OS: Windows 10 Enterprise LTSC 2019
20:18:28:        OS Arch: AMD64
20:18:28:           GPUs: 1
20:18:28:          GPU 0: Bus:1 Slot:0 Func:0 AMD:5 Hawaii [Radeon R9 200/300 Series]
20:18:28:           CUDA: Not detected: Failed to open dynamic library 'nvcuda.dll': The
20:18:28:                 specified module could not be found.
20:18:28:
20:18:28:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:3004.8
20:18:28:******************************* libFAH ********************************
20:18:28:           Date: Apr 15 2020
20:18:28:           Time: 14:53:14
20:18:28:       Revision: 216968bc7025029c841ed6e36e81a03a316890d3
20:18:28:         Branch: master
20:18:28:       Compiler: Visual C++ 2008
20:18:28:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
20:18:28:       Platform: win32 10
20:18:28:           Bits: 32
20:18:28:           Mode: Release
20:18:28:***********************************************************************
20:18:28:<config>
20:18:28:  <!-- Network -->
20:18:28:  <proxy v=':8080'/>
20:18:28:
20:18:28:  <!-- Slot Control -->
20:18:28:  <power v='full'/>
20:18:28:
20:18:28:  <!-- User Information -->
20:18:28:  <passkey v='*****'/>
20:18:28:  <team v='12072'/>
20:18:28:  <user v='crimson1077'/>
20:18:28:
20:18:28:  <!-- Folding Slots -->
20:18:28:  <slot id='0' type='CPU'/>
20:18:28:  <slot id='1' type='GPU'/>
20:18:28:</config>
20:18:29:WU00:FS00:Connecting to assign1.foldingathome.org:80
20:18:29:WU01:FS01:Connecting to assign1.foldingathome.org:80
20:18:30:WU01:FS01:Assigned to work server 18.188.125.154
20:18:30:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:Hawaii [Radeon R9 200/300 Series] from 18.188.125.154
20:18:30:WU00:FS00:Assigned to work server 155.247.164.213
20:18:30:WU01:FS01:Connecting to 18.188.125.154:8080
20:18:30:WU00:FS00:Requesting new work unit for slot 00: READY cpu:3 from 155.247.164.213
20:18:30:WU00:FS00:Connecting to 155.247.164.213:8080
20:18:30:WU00:FS00:Downloading 2.82MiB
20:18:30:WU01:FS01:Downloading 7.03MiB
20:18:33:WU00:FS00:Download complete
20:18:34:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:14824 run:1225 clone:3 gen:52 core:0xa7 unit:0x000000419bf7a4d55ea34542a6827e9c
20:18:34:WU00:FS00:Starting
20:18:34:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Crimson\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 706 -lifeline 3680 -checkpoint 15 -np 3
20:18:34:WU00:FS00:Started FahCore on PID 7448
20:18:34:WU00:FS00:Core PID:7472
20:18:34:WU00:FS00:FahCore 0xa7 started
20:18:34:WU00:FS00:0xa7:*********************** Log Started 2020-08-22T20:18:34Z ***********************
20:18:34:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
20:18:34:WU00:FS00:0xa7:       Type: 0xa7
20:18:34:WU00:FS00:0xa7:       Core: Gromacs
20:18:34:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 706 -lifeline 7448 -checkpoint 15 -np 3
20:18:34:WU00:FS00:0xa7:************************************ CBang *************************************
20:18:34:WU00:FS00:0xa7:       Date: Nov 27 2019
20:18:34:WU00:FS00:0xa7:       Time: 03:40:09
20:18:34:WU00:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
20:18:34:WU00:FS00:0xa7:     Branch: master
20:18:34:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
20:18:34:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
20:18:34:WU00:FS00:0xa7:   Platform: win32 10
20:18:34:WU00:FS00:0xa7:       Bits: 64
20:18:34:WU00:FS00:0xa7:       Mode: Release
20:18:34:WU00:FS00:0xa7:************************************ System ************************************
20:18:34:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz
20:18:34:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
20:18:34:WU00:FS00:0xa7:       CPUs: 4
20:18:34:WU00:FS00:0xa7:     Memory: 14.97GiB
20:18:34:WU00:FS00:0xa7:Free Memory: 12.63GiB
20:18:34:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
20:18:34:WU00:FS00:0xa7: OS Version: 6.2
20:18:34:WU00:FS00:0xa7:Has Battery: false
20:18:34:WU00:FS00:0xa7: On Battery: false
20:18:34:WU00:FS00:0xa7: UTC Offset: -5
20:18:34:WU00:FS00:0xa7:        PID: 7472
20:18:34:WU00:FS00:0xa7:        CWD: C:\Users\Crimson\AppData\Roaming\FAHClient\work
20:18:34:WU00:FS00:0xa7:******************************** Build - libFAH ********************************
20:18:34:WU00:FS00:0xa7:    Version: 0.0.19
20:18:34:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:18:34:WU00:FS00:0xa7:  Copyright: 2019 foldingathome.org
20:18:34:WU00:FS00:0xa7:   Homepage: https://foldingathome.org/
20:18:34:WU00:FS00:0xa7:       Date: Nov 25 2019
20:18:34:WU00:FS00:0xa7:       Time: 17:12:41
20:18:34:WU00:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
20:18:34:WU00:FS00:0xa7:     Branch: master
20:18:34:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
20:18:34:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
20:18:34:WU00:FS00:0xa7:   Platform: win32 10
20:18:34:WU00:FS00:0xa7:       Bits: 64
20:18:34:WU00:FS00:0xa7:       Mode: Release
20:18:34:WU00:FS00:0xa7:************************************ Build *************************************
20:18:34:WU00:FS00:0xa7:       SIMD: avx_256
20:18:34:WU00:FS00:0xa7:********************************************************************************
20:18:34:WU00:FS00:0xa7:Project: 14824 (Run 1225, Clone 3, Gen 52)
20:18:34:WU00:FS00:0xa7:Unit: 0x000000419bf7a4d55ea34542a6827e9c
20:18:34:WU00:FS00:0xa7:Reading tar file core.xml
20:18:34:WU00:FS00:0xa7:Reading tar file frame52.tpr
20:18:34:WU00:FS00:0xa7:Digital signatures verified
20:18:34:WU00:FS00:0xa7:Calling: mdrun -s frame52.tpr -o frame52.trr -cpt 15 -nt 3
20:18:34:WU00:FS00:0xa7:Steps: first=0 total=250000
20:18:36:WU01:FS01:Download 73.77%
20:18:36:WU00:FS00:0xa7:Completed 1 out of 250000 steps (0%)
20:18:37:WU01:FS01:Download complete
20:18:37:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13422 run:3163 clone:20 gen:0 core:0x22 unit:0x0000000112bc7d9a5f39933e7c8e709c
20:18:37:WU01:FS01:Starting
20:18:37:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Crimson\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.11/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 3680 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
20:18:37:WU01:FS01:Started FahCore on PID 7556
20:18:37:WU01:FS01:Core PID:7576
20:18:37:WU01:FS01:FahCore 0x22 started
20:18:37:WU01:FS01:0x22:*********************** Log Started 2020-08-22T20:18:37Z ***********************
20:18:37:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
20:18:37:WU01:FS01:0x22:       Core: Core22
20:18:37:WU01:FS01:0x22:       Type: 0x22
20:18:37:WU01:FS01:0x22:    Version: 0.0.11
20:18:37:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:18:37:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
20:18:37:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
20:18:37:WU01:FS01:0x22:       Date: Jun 26 2020
20:18:37:WU01:FS01:0x22:       Time: 19:49:16
20:18:37:WU01:FS01:0x22:   Revision: 22010df8a4db48db1b35d33e666b64d8ce48689d
20:18:37:WU01:FS01:0x22:     Branch: core22-0.0.11
20:18:37:WU01:FS01:0x22:   Compiler: Visual C++ 2015
20:18:37:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:18:37:WU01:FS01:0x22:   Platform: win32 10
20:18:37:WU01:FS01:0x22:       Bits: 64
20:18:37:WU01:FS01:0x22:       Mode: Release
20:18:37:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
20:18:37:WU01:FS01:0x22:             <peastman@stanford.edu>
20:18:37:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 7556 -checkpoint 15
20:18:37:WU01:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
20:18:37:WU01:FS01:0x22:************************************ libFAH ************************************
20:18:37:WU01:FS01:0x22:       Date: Jun 26 2020
20:18:37:WU01:FS01:0x22:       Time: 19:47:12
20:18:37:WU01:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
20:18:37:WU01:FS01:0x22:     Branch: HEAD
20:18:37:WU01:FS01:0x22:   Compiler: Visual C++ 2015
20:18:37:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:18:37:WU01:FS01:0x22:   Platform: win32 10
20:18:37:WU01:FS01:0x22:       Bits: 64
20:18:37:WU01:FS01:0x22:       Mode: Release
20:18:37:WU01:FS01:0x22:************************************ CBang *************************************
20:18:37:WU01:FS01:0x22:       Date: Jun 26 2020
20:18:37:WU01:FS01:0x22:       Time: 19:46:11
20:18:37:WU01:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
20:18:37:WU01:FS01:0x22:     Branch: master
20:18:37:WU01:FS01:0x22:   Compiler: Visual C++ 2015
20:18:37:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:18:37:WU01:FS01:0x22:   Platform: win32 10
20:18:37:WU01:FS01:0x22:       Bits: 64
20:18:37:WU01:FS01:0x22:       Mode: Release
20:18:37:WU01:FS01:0x22:************************************ System ************************************
20:18:37:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz
20:18:37:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
20:18:37:WU01:FS01:0x22:       CPUs: 4
20:18:37:WU01:FS01:0x22:     Memory: 14.97GiB
20:18:37:WU01:FS01:0x22:Free Memory: 12.59GiB
20:18:37:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
20:18:37:WU01:FS01:0x22: OS Version: 6.2
20:18:37:WU01:FS01:0x22:Has Battery: false
20:18:37:WU01:FS01:0x22: On Battery: false
20:18:37:WU01:FS01:0x22: UTC Offset: -5
20:18:37:WU01:FS01:0x22:        PID: 7576
20:18:37:WU01:FS01:0x22:        CWD: C:\Users\Crimson\AppData\Roaming\FAHClient\work
20:18:37:WU01:FS01:0x22:********************************************************************************
20:18:37:WU01:FS01:0x22:Project: 13422 (Run 3163, Clone 20, Gen 0)
20:18:37:WU01:FS01:0x22:Unit: 0x0000000112bc7d9a5f39933e7c8e709c
20:18:37:WU01:FS01:0x22:Reading tar file core.xml
20:18:37:WU01:FS01:0x22:Reading tar file integrator.xml
20:18:37:WU01:FS01:0x22:Reading tar file state.xml.bz2
20:18:37:WU01:FS01:0x22:Reading tar file system.xml.bz2
20:18:37:WU01:FS01:0x22:Digital signatures verified
20:18:37:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
20:18:37:WU01:FS01:0x22:Version 0.0.11
20:18:37:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
20:18:37:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
20:18:37:WU01:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
20:18:37:WU01:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
20:18:55:WU01:FS01:0x22:Completed 0 out of 1000000 steps (0%)
20:19:28:Removing old file 'configs/config-20200822-084105.xml'
20:19:28:Saving configuration to config.xml
20:19:28:<config>
20:19:28:  <!-- Network -->
20:19:28:  <proxy v=':8080'/>
20:19:28:
20:19:28:  <!-- Slot Control -->
20:19:28:  <power v='full'/>
20:19:28:
20:19:28:  <!-- User Information -->
20:19:28:  <passkey v='*****'/>
20:19:28:  <team v='12072'/>
20:19:28:  <user v='crimson1077'/>
20:19:28:
20:19:28:  <!-- Folding Slots -->
20:19:28:  <slot id='0' type='CPU'/>
20:19:28:  <slot id='1' type='GPU'/>
20:19:28:</config>
20:19:37:ERROR:Receive error: 10053: An established connection was aborted by the software in your host machine.
20:19:47:Removing old file 'configs/config-20200822-084146.xml'
20:19:47:Saving configuration to config.xml
20:19:47:<config>
20:19:47:  <!-- Network -->
20:19:47:  <proxy v=':8080'/>
20:19:47:
20:19:47:  <!-- Slot Control -->
20:19:47:  <power v='full'/>
20:19:47:
20:19:47:  <!-- User Information -->
20:19:47:  <passkey v='*****'/>
20:19:47:  <team v='12072'/>
20:19:47:  <user v='crimson1077'/>
20:19:47:
20:19:47:  <!-- Folding Slots -->
20:19:47:  <slot id='1' type='GPU'/>
20:19:47:</config>
20:19:47:FS00:Shutting core down
20:19:48:WU00:FS00:0xa7:WARNING:Console control signal 1 on PID 7472
20:19:48:WU00:FS00:0xa7:Exiting, please wait. . .
20:19:49:WU00:FS00:0xa7:Folding@home Core Shutdown: INTERRUPTED
20:19:49:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
20:19:50:WARNING:WU00:Slot ID 0 no longer exists and there are no other matching slots, dumping
20:19:50:WU00:Sending unit results: id:00 state:SEND error:DUMPED project:14824 run:1225 clone:3 gen:52 core:0xa7 unit:0x000000419bf7a4d55ea34542a6827e9c
20:19:50:WU00:Connecting to 155.247.164.213:8080
20:19:50:WU00:Server responded WORK_ACK (400)
20:19:50:WU00:Cleaning up
20:19:51:FS01:Paused
20:19:51:FS01:Shutting core down
20:19:52:WU01:FS01:0x22:WARNING:Console control signal 1 on PID 7576
20:19:52:WU01:FS01:0x22:Exiting, please wait. . .
20:19:52:WU01:FS01:0x22:Folding@home Core Shutdown: INTERRUPTED
20:19:52:WU01:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
20:20:06:FS01:Unpaused
20:20:06:WU01:FS01:Starting
20:20:06:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Crimson\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.11/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 3680 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
20:20:06:WU01:FS01:Started FahCore on PID 5180
20:20:06:WU01:FS01:Core PID:3644
20:20:06:WU01:FS01:FahCore 0x22 started
20:20:06:WU01:FS01:0x22:*********************** Log Started 2020-08-22T20:20:06Z ***********************
20:20:06:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
20:20:06:WU01:FS01:0x22:       Core: Core22
20:20:06:WU01:FS01:0x22:       Type: 0x22
20:20:06:WU01:FS01:0x22:    Version: 0.0.11
20:20:06:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:20:06:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
20:20:06:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
20:20:06:WU01:FS01:0x22:       Date: Jun 26 2020
20:20:06:WU01:FS01:0x22:       Time: 19:49:16
20:20:06:WU01:FS01:0x22:   Revision: 22010df8a4db48db1b35d33e666b64d8ce48689d
20:20:06:WU01:FS01:0x22:     Branch: core22-0.0.11
20:20:06:WU01:FS01:0x22:   Compiler: Visual C++ 2015
20:20:06:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:20:06:WU01:FS01:0x22:   Platform: win32 10
20:20:06:WU01:FS01:0x22:       Bits: 64
20:20:06:WU01:FS01:0x22:       Mode: Release
20:20:06:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
20:20:06:WU01:FS01:0x22:             <peastman@stanford.edu>
20:20:06:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 5180 -checkpoint 15
20:20:06:WU01:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
20:20:06:WU01:FS01:0x22:************************************ libFAH ************************************
20:20:06:WU01:FS01:0x22:       Date: Jun 26 2020
20:20:06:WU01:FS01:0x22:       Time: 19:47:12
20:20:06:WU01:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
20:20:06:WU01:FS01:0x22:     Branch: HEAD
20:20:06:WU01:FS01:0x22:   Compiler: Visual C++ 2015
20:20:06:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:20:06:WU01:FS01:0x22:   Platform: win32 10
20:20:06:WU01:FS01:0x22:       Bits: 64
20:20:06:WU01:FS01:0x22:       Mode: Release
20:20:06:WU01:FS01:0x22:************************************ CBang *************************************
20:20:06:WU01:FS01:0x22:       Date: Jun 26 2020
20:20:06:WU01:FS01:0x22:       Time: 19:46:11
20:20:06:WU01:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
20:20:06:WU01:FS01:0x22:     Branch: master
20:20:06:WU01:FS01:0x22:   Compiler: Visual C++ 2015
20:20:06:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:20:06:WU01:FS01:0x22:   Platform: win32 10
20:20:06:WU01:FS01:0x22:       Bits: 64
20:20:06:WU01:FS01:0x22:       Mode: Release
20:20:06:WU01:FS01:0x22:************************************ System ************************************
20:20:06:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz
20:20:06:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
20:20:06:WU01:FS01:0x22:       CPUs: 4
20:20:06:WU01:FS01:0x22:     Memory: 14.97GiB
20:20:06:WU01:FS01:0x22:Free Memory: 13.03GiB
20:20:06:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
20:20:06:WU01:FS01:0x22: OS Version: 6.2
20:20:06:WU01:FS01:0x22:Has Battery: false
20:20:06:WU01:FS01:0x22: On Battery: false
20:20:06:WU01:FS01:0x22: UTC Offset: -5
20:20:06:WU01:FS01:0x22:        PID: 3644
20:20:06:WU01:FS01:0x22:        CWD: C:\Users\Crimson\AppData\Roaming\FAHClient\work
20:20:06:WU01:FS01:0x22:********************************************************************************
20:20:06:WU01:FS01:0x22:Project: 13422 (Run 3163, Clone 20, Gen 0)
20:20:06:WU01:FS01:0x22:Unit: 0x0000000112bc7d9a5f39933e7c8e709c
20:20:06:WU01:FS01:0x22:Digital signatures verified
20:20:06:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
20:20:06:WU01:FS01:0x22:Version 0.0.11
20:20:06:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
20:20:06:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
20:20:06:WU01:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
20:20:06:WU01:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
20:20:22:WU01:FS01:0x22:Completed 0 out of 1000000 steps (0%)
20:20:29:Removing old file 'configs/config-20200822-084651.xml'
20:20:29:Saving configuration to config.xml
20:20:29:<config>
20:20:29:  <!-- Network -->
20:20:29:  <proxy v=':8080'/>
20:20:29:
20:20:29:  <!-- Slot Control -->
20:20:29:  <power v='full'/>
20:20:29:
20:20:29:  <!-- User Information -->
20:20:29:  <passkey v='*****'/>
20:20:29:  <team v='12072'/>
20:20:29:  <user v='crimson1077'/>
20:20:29:
20:20:29:  <!-- Folding Slots -->
20:20:29:  <slot id='1' type='GPU'/>
20:20:29:</config>
20:20:47:WU01:FS01:0x22:An exception occurred at step 1003: Particle coordinate is nan
20:20:47:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
20:20:47:WU01:FS01:0x22:Folding@home Core Shutdown: CORE_RESTART
20:20:47:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
20:21:06:WU01:FS01:Starting
20:21:06:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Crimson\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.11/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 3680 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
20:21:06:WU01:FS01:Started FahCore on PID 7912
20:21:06:WU01:FS01:Core PID:7580
20:21:06:WU01:FS01:FahCore 0x22 started
20:21:07:WU01:FS01:0x22:*********************** Log Started 2020-08-22T20:21:06Z ***********************
20:21:07:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
20:21:07:WU01:FS01:0x22:       Core: Core22
20:21:07:WU01:FS01:0x22:       Type: 0x22
20:21:07:WU01:FS01:0x22:    Version: 0.0.11
20:21:07:WU01:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:21:07:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
20:21:07:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
20:21:07:WU01:FS01:0x22:       Date: Jun 26 2020
20:21:07:WU01:FS01:0x22:       Time: 19:49:16
20:21:07:WU01:FS01:0x22:   Revision: 22010df8a4db48db1b35d33e666b64d8ce48689d
20:21:07:WU01:FS01:0x22:     Branch: core22-0.0.11
20:21:07:WU01:FS01:0x22:   Compiler: Visual C++ 2015
20:21:07:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:21:07:WU01:FS01:0x22:   Platform: win32 10
20:21:07:WU01:FS01:0x22:       Bits: 64
20:21:07:WU01:FS01:0x22:       Mode: Release
20:21:07:WU01:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
20:21:07:WU01:FS01:0x22:             <peastman@stanford.edu>
20:21:07:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 7912 -checkpoint 15
20:21:07:WU01:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
20:21:07:WU01:FS01:0x22:************************************ libFAH ************************************
20:21:07:WU01:FS01:0x22:       Date: Jun 26 2020
20:21:07:WU01:FS01:0x22:       Time: 19:47:12
20:21:07:WU01:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
20:21:07:WU01:FS01:0x22:     Branch: HEAD
20:21:07:WU01:FS01:0x22:   Compiler: Visual C++ 2015
20:21:07:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:21:07:WU01:FS01:0x22:   Platform: win32 10
20:21:07:WU01:FS01:0x22:       Bits: 64
20:21:07:WU01:FS01:0x22:       Mode: Release
20:21:07:WU01:FS01:0x22:************************************ CBang *************************************
20:21:07:WU01:FS01:0x22:       Date: Jun 26 2020
20:21:07:WU01:FS01:0x22:       Time: 19:46:11
20:21:07:WU01:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
20:21:07:WU01:FS01:0x22:     Branch: master
20:21:07:WU01:FS01:0x22:   Compiler: Visual C++ 2015
20:21:07:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:21:07:WU01:FS01:0x22:   Platform: win32 10
20:21:07:WU01:FS01:0x22:       Bits: 64
20:21:07:WU01:FS01:0x22:       Mode: Release
20:21:07:WU01:FS01:0x22:************************************ System ************************************
20:21:07:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz
20:21:07:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
20:21:07:WU01:FS01:0x22:       CPUs: 4
20:21:07:WU01:FS01:0x22:     Memory: 14.97GiB
20:21:07:WU01:FS01:0x22:Free Memory: 12.52GiB
20:21:07:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
20:21:07:WU01:FS01:0x22: OS Version: 6.2
20:21:07:WU01:FS01:0x22:Has Battery: false
20:21:07:WU01:FS01:0x22: On Battery: false
20:21:07:WU01:FS01:0x22: UTC Offset: -5
20:21:07:WU01:FS01:0x22:        PID: 7580
20:21:07:WU01:FS01:0x22:        CWD: C:\Users\Crimson\AppData\Roaming\FAHClient\work
20:21:07:WU01:FS01:0x22:********************************************************************************
20:21:07:WU01:FS01:0x22:Project: 13422 (Run 3163, Clone 20, Gen 0)
20:21:07:WU01:FS01:0x22:Unit: 0x0000000112bc7d9a5f39933e7c8e709c
20:21:07:WU01:FS01:0x22:Digital signatures verified
20:21:07:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
20:21:07:WU01:FS01:0x22:Version 0.0.11
20:21:07:WU01:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
20:21:07:WU01:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
20:21:07:WU01:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
20:21:07:WU01:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
20:21:22:WU01:FS01:0x22:Completed 0 out of 1000000 steps (0%)
20:22:15:WU01:FS01:0x22:An exception occurred at step 2258: Particle coordinate is nan
20:22:15:WU01:FS01:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
20:22:15:WU01:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
20:22:15:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
20:22:15:WU01:FS01:0x22:Saving result file globals.csv
20:22:15:WU01:FS01:0x22:Saving result file science.log
20:22:15:WU01:FS01:0x22:Saving result file state.xml.bz2
20:22:15:WU01:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
20:22:15:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:22:15:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:13422 run:3163 clone:20 gen:0 core:0x22 unit:0x0000000112bc7d9a5f39933e7c8e709c
20:22:15:WU01:FS01:Uploading 5.61MiB to 18.188.125.154
20:22:15:WU01:FS01:Connecting to 18.188.125.154:8080
20:22:16:WU00:FS01:Connecting to assign1.foldingathome.org:80
20:22:16:WU00:FS01:Assigned to work server 18.188.125.154
20:22:16:WU00:FS01:Requesting new work unit for slot 01: READY gpu:0:Hawaii [Radeon R9 200/300 Series] from 18.188.125.154
20:22:16:WU00:FS01:Connecting to 18.188.125.154:8080
20:22:16:WU00:FS01:Downloading 7.04MiB
20:22:20:WU00:FS01:Download complete
20:22:21:WU01:FS01:Upload 77.98%
20:22:21:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13422 run:3002 clone:49 gen:2 core:0x22 unit:0x0000000212bc7d9a5f399337044af4fe
20:22:21:WU00:FS01:Starting
20:22:21:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Crimson\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.11/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 3680 -checkpoint 15 -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
20:22:21:WU00:FS01:Started FahCore on PID 3828
20:22:21:WU00:FS01:Core PID:7324
20:22:21:WU00:FS01:FahCore 0x22 started
20:22:21:WU00:FS01:0x22:*********************** Log Started 2020-08-22T20:22:21Z ***********************
20:22:21:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
20:22:21:WU00:FS01:0x22:       Core: Core22
20:22:21:WU00:FS01:0x22:       Type: 0x22
20:22:21:WU00:FS01:0x22:    Version: 0.0.11
20:22:21:WU00:FS01:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:22:21:WU00:FS01:0x22:  Copyright: 2020 foldingathome.org
20:22:21:WU00:FS01:0x22:   Homepage: https://foldingathome.org/
20:22:21:WU00:FS01:0x22:       Date: Jun 26 2020
20:22:21:WU00:FS01:0x22:       Time: 19:49:16
20:22:21:WU00:FS01:0x22:   Revision: 22010df8a4db48db1b35d33e666b64d8ce48689d
20:22:21:WU00:FS01:0x22:     Branch: core22-0.0.11
20:22:21:WU00:FS01:0x22:   Compiler: Visual C++ 2015
20:22:21:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:22:21:WU00:FS01:0x22:   Platform: win32 10
20:22:21:WU00:FS01:0x22:       Bits: 64
20:22:21:WU00:FS01:0x22:       Mode: Release
20:22:21:WU00:FS01:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
20:22:21:WU00:FS01:0x22:             <peastman@stanford.edu>
20:22:21:WU00:FS01:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 3828 -checkpoint 15
20:22:21:WU00:FS01:0x22:             -gpu-vendor amd -opencl-platform 0 -opencl-device 0 -gpu 0
20:22:21:WU00:FS01:0x22:************************************ libFAH ************************************
20:22:21:WU00:FS01:0x22:       Date: Jun 26 2020
20:22:21:WU00:FS01:0x22:       Time: 19:47:12
20:22:21:WU00:FS01:0x22:   Revision: 2b383f4f04f38511dff592885d7c0400e72bdf43
20:22:21:WU00:FS01:0x22:     Branch: HEAD
20:22:21:WU00:FS01:0x22:   Compiler: Visual C++ 2015
20:22:21:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:22:21:WU00:FS01:0x22:   Platform: win32 10
20:22:21:WU00:FS01:0x22:       Bits: 64
20:22:21:WU00:FS01:0x22:       Mode: Release
20:22:21:WU00:FS01:0x22:************************************ CBang *************************************
20:22:21:WU00:FS01:0x22:       Date: Jun 26 2020
20:22:21:WU00:FS01:0x22:       Time: 19:46:11
20:22:21:WU00:FS01:0x22:   Revision: f8529962055b0e7bde23e429f5072ff758089dee
20:22:21:WU00:FS01:0x22:     Branch: master
20:22:21:WU00:FS01:0x22:   Compiler: Visual C++ 2015
20:22:21:WU00:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
20:22:21:WU00:FS01:0x22:   Platform: win32 10
20:22:21:WU00:FS01:0x22:       Bits: 64
20:22:21:WU00:FS01:0x22:       Mode: Release
20:22:21:WU00:FS01:0x22:************************************ System ************************************
20:22:21:WU00:FS01:0x22:        CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz
20:22:21:WU00:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
20:22:21:WU00:FS01:0x22:       CPUs: 4
20:22:21:WU00:FS01:0x22:     Memory: 14.97GiB
20:22:21:WU00:FS01:0x22:Free Memory: 12.58GiB
20:22:21:WU00:FS01:0x22:    Threads: WINDOWS_THREADS
20:22:21:WU00:FS01:0x22: OS Version: 6.2
20:22:21:WU00:FS01:0x22:Has Battery: false
20:22:21:WU00:FS01:0x22: On Battery: false
20:22:21:WU00:FS01:0x22: UTC Offset: -5
20:22:21:WU00:FS01:0x22:        PID: 7324
20:22:21:WU00:FS01:0x22:        CWD: C:\Users\Crimson\AppData\Roaming\FAHClient\work
20:22:21:WU00:FS01:0x22:********************************************************************************
20:22:21:WU00:FS01:0x22:Project: 13422 (Run 3002, Clone 49, Gen 2)
20:22:21:WU00:FS01:0x22:Unit: 0x0000000212bc7d9a5f399337044af4fe
20:22:21:WU00:FS01:0x22:Reading tar file core.xml
20:22:21:WU00:FS01:0x22:Reading tar file integrator.xml
20:22:21:WU00:FS01:0x22:Reading tar file state.xml.bz2
20:22:21:WU00:FS01:0x22:Reading tar file system.xml.bz2
20:22:21:WU00:FS01:0x22:Digital signatures verified
20:22:21:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
20:22:21:WU00:FS01:0x22:Version 0.0.11
20:22:21:WU00:FS01:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
20:22:21:WU00:FS01:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
20:22:21:WU00:FS01:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
20:22:21:WU00:FS01:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
20:22:22:WU01:FS01:Upload complete
20:22:22:WU01:FS01:Server responded WORK_ACK (400)
20:22:22:WU01:FS01:Cleaning up
20:22:37:WU00:FS01:0x22:Completed 0 out of 1000000 steps (0%)
20:23:00:Adding folding slot 00: READY cpu:3
20:23:00:Removing old file 'configs/config-20200822-152321.xml'
20:23:00:Saving configuration to config.xml
20:23:00:<config>
20:23:00:  <!-- Network -->
20:23:00:  <proxy v=':8080'/>
20:23:00:
20:23:00:  <!-- Slot Control -->
20:23:00:  <power v='full'/>
20:23:00:
20:23:00:  <!-- User Information -->
20:23:00:  <passkey v='*****'/>
20:23:00:  <team v='12072'/>
20:23:00:  <user v='crimson1077'/>
20:23:00:
20:23:00:  <!-- Folding Slots -->
20:23:00:  <slot id='1' type='GPU'/>
20:23:00:  <slot id='0' type='CPU'/>
20:23:00:</config>
20:23:00:WU01:FS00:Connecting to assign1.foldingathome.org:80
20:23:00:WU01:FS00:Assigned to work server 206.223.170.146
20:23:00:WU01:FS00:Requesting new work unit for slot 00: READY cpu:3 from 206.223.170.146
20:23:00:WU01:FS00:Connecting to 206.223.170.146:8080
20:23:00:WU01:FS00:Downloading 25.12MiB
20:23:06:WU01:FS00:Download 34.84%
20:23:12:WU01:FS00:Download 49.27%
20:23:18:WU01:FS00:Download 75.89%
20:23:21:WU01:FS00:Download complete
20:23:21:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14236 run:266 clone:3 gen:53 core:0xa7 unit:0x0000003bcedfaa925eb8d1493665c495
20:23:21:WU01:FS00:Starting
20:23:21:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Crimson\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 01 -suffix 01 -version 706 -lifeline 3680 -checkpoint 15 -np 3
20:23:21:WU01:FS00:Started FahCore on PID 1156
20:23:21:WU01:FS00:Core PID:3468
20:23:21:WU01:FS00:FahCore 0xa7 started
20:23:21:WU01:FS00:0xa7:*********************** Log Started 2020-08-22T20:23:21Z ***********************
20:23:21:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
20:23:21:WU01:FS00:0xa7:       Type: 0xa7
20:23:21:WU01:FS00:0xa7:       Core: Gromacs
20:23:21:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 1156 -checkpoint 15 -np 3
20:23:21:WU01:FS00:0xa7:************************************ CBang *************************************
20:23:21:WU01:FS00:0xa7:       Date: Nov 27 2019
20:23:21:WU01:FS00:0xa7:       Time: 03:40:09
20:23:21:WU01:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
20:23:21:WU01:FS00:0xa7:     Branch: master
20:23:21:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
20:23:21:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
20:23:21:WU01:FS00:0xa7:   Platform: win32 10
20:23:21:WU01:FS00:0xa7:       Bits: 64
20:23:21:WU01:FS00:0xa7:       Mode: Release
20:23:21:WU01:FS00:0xa7:************************************ System ************************************
20:23:21:WU01:FS00:0xa7:        CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz
20:23:21:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
20:23:21:WU01:FS00:0xa7:       CPUs: 4
20:23:21:WU01:FS00:0xa7:     Memory: 14.97GiB
20:23:21:WU01:FS00:0xa7:Free Memory: 12.15GiB
20:23:21:WU01:FS00:0xa7:    Threads: WINDOWS_THREADS
20:23:21:WU01:FS00:0xa7: OS Version: 6.2
20:23:21:WU01:FS00:0xa7:Has Battery: false
20:23:21:WU01:FS00:0xa7: On Battery: false
20:23:21:WU01:FS00:0xa7: UTC Offset: -5
20:23:21:WU01:FS00:0xa7:        PID: 3468
20:23:21:WU01:FS00:0xa7:        CWD: C:\Users\Crimson\AppData\Roaming\FAHClient\work
20:23:21:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
20:23:21:WU01:FS00:0xa7:    Version: 0.0.19
20:23:21:WU01:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
20:23:21:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
20:23:21:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
20:23:21:WU01:FS00:0xa7:       Date: Nov 25 2019
20:23:21:WU01:FS00:0xa7:       Time: 17:12:41
20:23:21:WU01:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
20:23:21:WU01:FS00:0xa7:     Branch: master
20:23:21:WU01:FS00:0xa7:   Compiler: Visual C++ 2008
20:23:21:WU01:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
20:23:21:WU01:FS00:0xa7:   Platform: win32 10
20:23:21:WU01:FS00:0xa7:       Bits: 64
20:23:21:WU01:FS00:0xa7:       Mode: Release
20:23:21:WU01:FS00:0xa7:************************************ Build *************************************
20:23:21:WU01:FS00:0xa7:       SIMD: avx_256
20:23:21:WU01:FS00:0xa7:********************************************************************************
20:23:21:WU01:FS00:0xa7:Project: 14236 (Run 266, Clone 3, Gen 53)
20:23:21:WU01:FS00:0xa7:Unit: 0x0000003bcedfaa925eb8d1493665c495
20:23:21:WU01:FS00:0xa7:Reading tar file core.xml
20:23:21:WU01:FS00:0xa7:Reading tar file frame53.tpr
20:23:21:WU01:FS00:0xa7:Digital signatures verified
20:23:21:WU01:FS00:0xa7:Calling: mdrun -s frame53.tpr -o frame53.trr -x frame53.xtc -cpt 15 -nt 3
20:23:22:WU01:FS00:0xa7:Steps: first=3312500 total=62500
20:23:27:WU01:FS00:0xa7:Completed 1 out of 62500 steps (0%)
20:23:32:Removing old file 'configs/config-20200822-174956.xml'
20:23:32:Saving configuration to config.xml
20:23:32:<config>
20:23:32:  <!-- Network -->
20:23:32:  <proxy v=':8080'/>
20:23:32:
20:23:32:  <!-- Slot Control -->
20:23:32:  <power v='full'/>
20:23:32:
20:23:32:  <!-- User Information -->
20:23:32:  <passkey v='*****'/>
20:23:32:  <team v='12072'/>
20:23:32:  <user v='crimson1077'/>
20:23:32:
20:23:32:  <!-- Folding Slots -->
20:23:32:  <slot id='1' type='GPU'/>
20:23:32:  <slot id='0' type='CPU'/>
20:23:32:</config>
Mod Edit: Added Code Tags - PantherX
Top
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:
Contact PantherX

Re: Failed GPU slot daily :(

Post by PantherX »

Welcome to the F@H Forum crimson1077,

Please note that this is a warning message which can be safely ignored "Changed SMP threads from 4 to 3 this can cause some work units to fail". This occurs when the WU starts folding with a higher number of CPUs and then during the folding process, you may change the number of CPUs by adjusting the slider or changing the value. It is very rare for a WU to fail nowadays but the warning message is still present for those edge cases.

The log file posted above has a single WU (Project: 13422 (Run 3163, Clone 20, Gen 0)) that has been reported as a bad WU while the other WU (Project: 13422 (Run 3002, Clone 49, Gen 2)) has just started folding and the log file simply stops.

Can you please provide more information about your system; is it overclocked, what are the temperatures while folding, what's the ambient temperature, etc?
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Top
crimson1077
Posts: 33
Joined: Sat Aug 22, 2020 4:37 pm

Re: Failed GPU slot daily :(

Post by crimson1077 »

Thank you for your reply! I have never overclocked. Ambient temperature stays about 70F, Folding temps for CPU about 42C, and GPU roughly 70-75C.
Top
JimboPalmer
Posts: 2522
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: Failed GPU slot daily :(

Post by JimboPalmer »

20:18:34:WU00:FS00:0xa7: CPUs: 4

20:18:28: GPUs: 1
20:18:28: GPU 0: Bus:1 Slot:0 Func:0 AMD:5 Hawaii [Radeon R9 200/300 Series]
20:18:28: CUDA: Not detected: Failed to open dynamic library 'nvcuda.dll': The
20:18:28: specified module could not be found.
20:18:28:OpenCL Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:3004.8

20:18:34:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Crimson\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 706 -lifeline 3680 -checkpoint 15 -np 3

Ok, you have 4 CPU threads, but you have a GPU and F@H reserves 1 CPU thread to feed data to/from that GPU.

So when the CPU Work Unit is started it is told -np 3 (use 3 CPU threads) or sometimes -nt 3.

If the GPU 'disappears', then F@H will try to use all 4 CPU threads but you can't increase the number of CPU threads in the middle of a WU.

(you can usually decrease the number of CPUs mid WU)
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
Top
crimson1077
Posts: 33
Joined: Sat Aug 22, 2020 4:37 pm

Re: Failed GPU slot daily :(

Post by crimson1077 »

Project: 13422 must have to be the culprit. Because I have 2 main folding computers both running a GTX 660 and it's moving along fine.
Some how this 390 GPU had to get the ticking time bomb called "Project: 13422"
Last edited by crimson1077 on Sun Aug 23, 2020 1:25 am, edited 1 time in total.
Top
crimson1077
Posts: 33
Joined: Sat Aug 22, 2020 4:37 pm

Re: Failed GPU slot daily :(

Post by crimson1077 »

Jimbo, Ah, I see. From the GUI what exactly would I be looking for? Could you give me like a really simple instruction template and like from the interface choose this click that etc. But, If you're referring to my slots,
all values are set to -1 by default I have not touched those ever.
Top
JimboPalmer
Posts: 2522
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: Failed GPU slot daily :(

Post by JimboPalmer »

I am happy with -1 but if you want to hard code 3, here is how.

In the taskbar to the lower right of the screen, you should see a F@H molecule icon, click it (you may need to click an Up Arrow to see it ^)
The second item in this menu is Advanced Control, click it
On this screen to the left is a Configure button, click it
Now you get a screen with a Slots tab, click it
On this white field should be a cpu item, click it and then click edit

By default F@H set the number of CPUs to -1 meaning let the software decide.
You can enter any number from 1 to the number of threads your CPU supports.

Type the number you want, (3) and click save.
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
Top
crimson1077
Posts: 33
Joined: Sat Aug 22, 2020 4:37 pm

Re: Failed GPU slot daily :(

Post by crimson1077 »

Okay Jimbo, all done as you said I guess time to set back and see what happens. So far, what's weird is, i'm still noticing that PRCG is changing from 13422 (2975, 69, 2) to PRCG 16918 (4, 50, 39) then right back to PRCG 13422 (2975, 69, 2) again and repeat. Is that a sign of anything? (And the progress bar keeps going back to 0.00%)
Top
crimson1077
Posts: 33
Joined: Sat Aug 22, 2020 4:37 pm

Re: Failed GPU slot daily :(

Post by crimson1077 »

I'm led to believe that PRCG 13422 (2975, 69, 2) was what I was folding when I paused for the cause and shut down the program for a few days.
As a result of firing back up the program recently I feel that particular WU is somehow still tied to me. But, then again how if I've uninstalled it? Server glitch/bug?

Not really sure, I just start folding back in April so i'm just a noob.
So far this has been the only inconvenience I've had with Folding@home.
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Failed GPU slot daily :(

Post by bruce »

... So far, what's weird is, i'm still noticing that PRCG is changing from 13422 (2975, 69, 2) to PRCG 16918 (4, 50, 39) then right back to PRCG 13422 (2975, 69, 2) again and repeat. Is that a sign of anything?
Yes, and it's a good sign. FAH is running two WUs that run independently of each other, one on your CPU and one on your GPU. The output logs are intermixed so you have to learn to read the combined output or use the filtering function that's built into to FAHControl.

Code: Select all

20:18:34:WU00:FS00:0xa7:       SIMD: avx_256
20:18:34:WU00:FS00:0xa7:Project: 14824 (Run 1225, Clone 3, Gen 52)
...
20:18:37:WU01:FS01:0x22:Project: 13422 (Run 3163, Clone 20, Gen 0)
FAHCore 0xa7 is running WU00 on slot FS00 using the avx-256 hardware feature. Independently, FAHCore 0x22 is running (or trying to) WU01 using slot FS01
Top
crimson1077
Posts: 33
Joined: Sat Aug 22, 2020 4:37 pm

Re: Failed GPU slot daily :(

Post by crimson1077 »

*********************** Log Started 2020-08-23T05:16:28Z ***********************
05:18:01:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
05:18:01:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
05:19:06:WU01:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
05:19:07:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
05:24:33:WU02:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
05:24:34:WARNING:WU02:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
05:28:11:WU02:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
05:28:12:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
*********************** Log Started 2020-08-23T05:16:28Z ***********************
05:18:01:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
05:18:01:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
05:19:06:WU01:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
05:19:07:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
05:24:33:WU02:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
05:24:34:WARNING:WU02:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
05:28:11:WU02:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
05:28:12:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
05:30:42:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
05:30:43:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
*********************** Log Started 2020-08-23T05:16:28Z ***********************
05:18:01:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
05:18:01:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
05:19:06:WU01:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
05:19:07:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
05:24:33:WU02:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
05:24:34:WARNING:WU02:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
05:28:11:WU02:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
05:28:12:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
05:30:42:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
05:30:43:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)

I guess if I leave it running for a few days and just leave it alone who knows time tell
Last edited by crimson1077 on Sun Aug 23, 2020 8:27 am, edited 1 time in total.
Top
Post Reply

Return to “Problems with AMD/ATI drivers”