FahCore returned: INTERRUPTED loop on core a8-0.0.7
Posted: Thu Sep 24, 2020 2:39 pm
My client downloaded a new a8 core (0.0.7) last night and it's constantly outputting FahCore returned: INTERRUPTED (102 = 0x66).
My client is saying I'm currently on attempt 467 It's been like this for about 8 hours.
The work unit before that one completed fine, same project, using a8-0.0.6.
Worth noting that it took about 5 minutes to find a new work unit, as you can see from the timestamps.
My startup log:
Other context:
Computer Specs: Quad-Core Intel Core i7 2.8 GHz. 16 GB RAM. Hyper-Threading enabled.
Network Connection: Starry Internet. Basically cable. 200 Mbits up and down.
Operating System: macOS Catalina version 10.15.6.
Overclocked?: None
Stable?: Haven't run any stability testing software, but this is my first time having a problem. This is my main work & personal computer.
Software: Client version 7.6.13. Core version a8-0.0.7, AVX2-256.
WU details: Gromacs avx2_256. PRCG 16810 (6, 548, 26)
Is there some way for me to roll back to a8-0.0.6? I could delete this WU and get a new one, but I'd prefer to complete this one if possible.
Code: Select all
06:14:19:WU00:FS00:Connecting to assign1.foldingathome.org:80
06:14:19:WU00:FS00:Assigned to work server 178.174.196.138
06:14:19:WU00:FS00:Requesting new work unit for slot 00: READY cpu:3 from 178.174.196.138
06:14:19:WU00:FS00:Connecting to 178.174.196.138:8080
06:14:20:WU00:FS00:Downloading 1.88MiB
06:14:21:WU00:FS00:Download complete
06:14:21:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:16810 run:6 clone:548 gen:26 core:0xa8 unit:0x0000001db2aec48a5eff2cc166d781d9
06:14:21:WU00:FS00:Downloading core from http://cores.foldingathome.org/osx/64bit-avx2-256/a8-0.0.7/Core_a8.fah
06:14:21:WU00:FS00:Connecting to cores.foldingathome.org:80
06:14:21:WU00:FS00:FahCore a8: Downloading 6.22MiB
06:14:22:WU00:FS00:FahCore a8: Download complete
06:14:23:WU00:FS00:Valid core signature
06:14:23:WU00:FS00:Unpacked 15.63MiB to cores/cores.foldingathome.org/osx/64bit-avx2-256/a8-0.0.7/Core_a8.fah/FahCore_a8
06:14:23:WU00:FS00:Starting
06:14:23:WU00:FS00:Running FahCore: /usr/local/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/cores.foldingathome.org/osx/64bit-avx2-256/a8-0.0.7/Core_a8.fah/FahCore_a8" -dir 00 -suffix 01 -version 706 -lifeline 150 -checkpoint 15 -np 3
06:14:23:WU00:FS00:Started FahCore on PID 23323
06:14:23:WU00:FS00:Core PID:23324
06:14:23:WU00:FS00:FahCore 0xa8 started
06:14:24:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
06:14:24:WU00:FS00:Starting
06:14:24:WU00:FS00:Running FahCore: /usr/local/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/cores.foldingathome.org/osx/64bit-avx2-256/a8-0.0.7/Core_a8.fah/FahCore_a8" -dir 00 -suffix 01 -version 706 -lifeline 150 -checkpoint 15 -np 3
06:14:24:WU00:FS00:Started FahCore on PID 23325
06:14:24:WU00:FS00:Core PID:23326
06:14:24:WU00:FS00:FahCore 0xa8 started
06:14:25:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
06:15:24:WU00:FS00:Starting
06:15:24:WU00:FS00:Running FahCore: /usr/local/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/cores.foldingathome.org/osx/64bit-avx2-256/a8-0.0.7/Core_a8.fah/FahCore_a8" -dir 00 -suffix 01 -version 706 -lifeline 150 -checkpoint 15 -np 3
06:15:24:WU00:FS00:Started FahCore on PID 23366
06:15:24:WU00:FS00:Core PID:23367
06:15:24:WU00:FS00:FahCore 0xa8 started
06:15:25:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
06:16:25:WU00:FS00:Starting
06:16:25:WU00:FS00:Running FahCore: /usr/local/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/cores.foldingathome.org/osx/64bit-avx2-256/a8-0.0.7/Core_a8.fah/FahCore_a8" -dir 00 -suffix 01 -version 706 -lifeline 150 -checkpoint 15 -np 3
06:16:25:WU00:FS00:Started FahCore on PID 23402
06:16:25:WU00:FS00:Core PID:23403
06:16:25:WU00:FS00:FahCore 0xa8 started
06:16:25:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
The work unit before that one completed fine, same project, using a8-0.0.6.
Code: Select all
00:07:43:WU01:FS00:Connecting to assign1.foldingathome.org:80
00:07:43:WU01:FS00:Assigned to work server 178.174.196.138
00:07:43:WU01:FS00:Requesting new work unit for slot 00: READY cpu:3 from 178.174.196.138
00:07:43:WU01:FS00:Connecting to 178.174.196.138:8080
00:07:43:WU01:FS00:Downloading 1.88MiB
00:07:46:WU01:FS00:Download complete
00:07:46:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:16810 run:89 clone:956 gen:4 core:0xa8 unit:0x00000004b2aec48a5eff208e7cc8d572
00:07:46:WU01:FS00:Starting
00:07:46:WU01:FS00:Running FahCore: /usr/local/bin/FAHCoreWrapper "/Library/Application Support/FAHClient/cores/cores.foldingathome.org/osx/64bit-avx2-256/a8-0.0.6/Core_a8.fah/FahCore_a8" -dir 01 -suffix 01 -version 706 -lifeline 150 -checkpoint 15 -np 3
00:07:46:WU01:FS00:Started FahCore on PID 9606
00:07:46:WU01:FS00:Core PID:9607
00:07:46:WU01:FS00:FahCore 0xa8 started
00:07:47:WU01:FS00:0xa8:*********************** Log Started 2020-09-24T00:07:46Z ***********************
00:07:47:WU01:FS00:0xa8:************************** Gromacs Folding@home Core ***************************
00:07:47:WU01:FS00:0xa8: Core: Gromacs
00:07:47:WU01:FS00:0xa8: Type: 0xa8
00:07:47:WU01:FS00:0xa8: Version: 0.0.6
00:07:47:WU01:FS00:0xa8: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
00:07:47:WU01:FS00:0xa8: Copyright: 2020 foldingathome.org
00:07:47:WU01:FS00:0xa8: Homepage: https://foldingathome.org/
00:07:47:WU01:FS00:0xa8: Date: Jul 25 2020
00:07:47:WU01:FS00:0xa8: Time: 17:01:41
00:07:47:WU01:FS00:0xa8: Revision: bb73a0bb4b90096d0c4f404ba28d26418056a589
00:07:47:WU01:FS00:0xa8: Branch: master
00:07:47:WU01:FS00:0xa8: Compiler: GNU 4.2.1 Compatible Apple LLVM 11.0.3 (clang-1103.0.32.62)
00:07:47:WU01:FS00:0xa8: Options: -std=c++14 -fsigned-char -stdlib=libc++ -O3 -funroll-loops -fno-pie
00:07:47:WU01:FS00:0xa8: -mmacosx-version-min=10.9
00:07:47:WU01:FS00:0xa8: Platform: darwin 19.5.0
00:07:47:WU01:FS00:0xa8: Bits: 64
00:07:47:WU01:FS00:0xa8: Mode: Release
00:07:47:WU01:FS00:0xa8: SIMD: avx2_256
00:07:47:WU01:FS00:0xa8: OpenMP: ON
00:07:47:WU01:FS00:0xa8: CUDA: OFF
00:07:47:WU01:FS00:0xa8: Args: -dir 01 -suffix 01 -version 706 -lifeline 9606 -checkpoint 15 -np 3
00:07:47:WU01:FS00:0xa8:************************************ libFAH ************************************
00:07:47:WU01:FS00:0xa8: Date: Jul 25 2020
00:07:47:WU01:FS00:0xa8: Time: 16:58:36
00:07:47:WU01:FS00:0xa8: Revision: bb73a0bb4b90096d0c4f404ba28d26418056a589
00:07:47:WU01:FS00:0xa8: Branch: master
00:07:47:WU01:FS00:0xa8: Compiler: GNU 4.2.1 Compatible Apple LLVM 11.0.3 (clang-1103.0.32.62)
00:07:47:WU01:FS00:0xa8: Options: -std=c++14 -fsigned-char -stdlib=libc++ -O3 -funroll-loops -fno-pie
00:07:47:WU01:FS00:0xa8: -mmacosx-version-min=10.9
00:07:47:WU01:FS00:0xa8: Platform: darwin 19.5.0
00:07:47:WU01:FS00:0xa8: Bits: 64
00:07:47:WU01:FS00:0xa8: Mode: Release
00:07:47:WU01:FS00:0xa8:************************************ CBang *************************************
00:07:47:WU01:FS00:0xa8: Date: Jul 25 2020
00:07:47:WU01:FS00:0xa8: Time: 16:58:19
00:07:47:WU01:FS00:0xa8: Revision: bb73a0bb4b90096d0c4f404ba28d26418056a589
00:07:47:WU01:FS00:0xa8: Branch: master
00:07:47:WU01:FS00:0xa8: Compiler: GNU 4.2.1 Compatible Apple LLVM 11.0.3 (clang-1103.0.32.62)
00:07:47:WU01:FS00:0xa8: Options: -std=c++14 -fsigned-char -stdlib=libc++ -O3 -funroll-loops -fno-pie
00:07:47:WU01:FS00:0xa8: -mmacosx-version-min=10.9 -fPIC
00:07:47:WU01:FS00:0xa8: Platform: darwin 19.5.0
00:07:47:WU01:FS00:0xa8: Bits: 64
00:07:47:WU01:FS00:0xa8: Mode: Release
00:07:47:WU01:FS00:0xa8:************************************ System ************************************
00:07:47:WU01:FS00:0xa8: CPU: Intel(R) Core(TM) i7-7700HQ CPU @ 2.80GHz
00:07:47:WU01:FS00:0xa8: CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
00:07:47:WU01:FS00:0xa8: CPUs: 8
00:07:47:WU01:FS00:0xa8: Memory: 16.00GiB
00:07:47:WU01:FS00:0xa8:Free Memory: 1.97GiB
00:07:47:WU01:FS00:0xa8: Threads: POSIX_THREADS
00:07:47:WU01:FS00:0xa8: OS Version: 10.15
00:07:47:WU01:FS00:0xa8:Has Battery: true
00:07:47:WU01:FS00:0xa8: On Battery: false
00:07:47:WU01:FS00:0xa8: UTC Offset: -4
00:07:47:WU01:FS00:0xa8: PID: 9607
00:07:47:WU01:FS00:0xa8: CWD: /Library/Application Support/FAHClient/work
00:07:47:WU01:FS00:0xa8:********************************************************************************
00:07:47:WU01:FS00:0xa8:Project: 16810 (Run 89, Clone 956, Gen 4)
00:07:47:WU01:FS00:0xa8:Unit: 0x00000004b2aec48a5eff208e7cc8d572
00:07:47:WU01:FS00:0xa8:Reading tar file core.xml
00:07:47:WU01:FS00:0xa8:Reading tar file frame4.tpr
00:07:47:WU01:FS00:0xa8:Digital signatures verified
00:07:47:WU01:FS00:0xa8:Calling: mdrun -c frame4.gro -s frame4.tpr -x frame4.xtc -cpt 15 -nt 3 -ntmpi 1
00:07:47:WU01:FS00:0xa8:Steps: first=2000000 total=2500000
00:07:49:WU01:FS00:0xa8:Completed 1 out of 500000 steps (0%)
00:11:23:WU01:FS00:0xa8:Completed 5000 out of 500000 steps (1%)
...
06:04:48:WU01:FS00:0xa8:Completed 495000 out of 500000 steps (99%)
06:04:49:WU00:FS00:Connecting to assign1.foldingathome.org:80
[93m06:04:49:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration[0m
06:04:49:WU00:FS00:Connecting to assign2.foldingathome.org:80
[93m06:04:50:WARNING:WU00:FS00:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration[0m
06:04:50:WU00:FS00:Connecting to assign3.foldingathome.org:80
[93m06:04:50:WARNING:WU00:FS00:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration[0m
06:04:50:WU00:FS00:Connecting to assign4.foldingathome.org:80
[93m06:04:50:WARNING:WU00:FS00:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration[0m
[91m06:04:50:ERROR:WU00:FS00:Exception: Could not get an assignment[0m
06:04:50:WU00:FS00:Connecting to assign1.foldingathome.org:80
[93m06:04:51:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration[0m
06:04:51:WU00:FS00:Connecting to assign2.foldingathome.org:80
06:04:51:WU00:FS00:Assigned to work server 143.89.243.111
06:04:51:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 143.89.243.111
06:04:51:WU00:FS00:Connecting to 143.89.243.111:8080
[91m06:04:52:ERROR:WU00:FS00:Exception: Server did not assign work unit[0m
06:05:50:WU00:FS00:Connecting to assign1.foldingathome.org:80
[93m06:05:51:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration[0m
06:05:51:WU00:FS00:Connecting to assign2.foldingathome.org:80
06:05:51:WU00:FS00:Assigned to work server 143.89.243.111
06:05:51:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 143.89.243.111
06:05:51:WU00:FS00:Connecting to 143.89.243.111:8080
[91m06:05:52:ERROR:WU00:FS00:Exception: Server did not assign work unit[0m
06:07:28:WU00:FS00:Connecting to assign1.foldingathome.org:80
[93m06:07:28:WARNING:WU00:FS00:Failed to get assignment from 'assign1.foldingathome.org:80': No WUs available for this configuration[0m
06:07:28:WU00:FS00:Connecting to assign2.foldingathome.org:80
[93m06:07:28:WARNING:WU00:FS00:Failed to get assignment from 'assign2.foldingathome.org:80': No WUs available for this configuration[0m
06:07:28:WU00:FS00:Connecting to assign3.foldingathome.org:80
[93m06:07:29:WARNING:WU00:FS00:Failed to get assignment from 'assign3.foldingathome.org:80': No WUs available for this configuration[0m
06:07:29:WU00:FS00:Connecting to assign4.foldingathome.org:80
[93m06:07:29:WARNING:WU00:FS00:Failed to get assignment from 'assign4.foldingathome.org:80': No WUs available for this configuration[0m
[91m06:07:29:ERROR:WU00:FS00:Exception: Could not get an assignment[0m
06:09:08:WU01:FS00:0xa8:Completed 500000 out of 500000 steps (100%)
06:09:11:WU01:FS00:0xa8:Saving result file ../logfile_01.txt
06:09:11:WU01:FS00:0xa8:Saving result file ener.edr
06:09:11:WU01:FS00:0xa8:Saving result file frame4.gro
06:09:11:WU01:FS00:0xa8:Saving result file frame4.xtc
06:09:11:WU01:FS00:0xa8:Saving result file md.log
06:09:11:WU01:FS00:0xa8:Saving result file science.log
06:09:11:WU01:FS00:0xa8:Saving result file state.cpt
06:09:11:WU01:FS00:0xa8:Folding@home Core Shutdown: FINISHED_UNIT
06:09:11:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:09:11:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:16810 run:89 clone:956 gen:4 core:0xa8 unit:0x00000004b2aec48a5eff208e7cc8d572
06:09:11:WU01:FS00:Uploading 8.01MiB to 178.174.196.138
06:09:11:WU01:FS00:Connecting to 178.174.196.138:8080
06:09:17:WU01:FS00:Upload 32.79%
06:09:23:WU01:FS00:Upload 73.39%
06:09:27:WU01:FS00:Upload complete
06:09:27:WU01:FS00:Server responded WORK_ACK (400)
06:09:27:WU01:FS00:Final credit estimate, 9019.00 points
06:09:27:WU01:FS00:Cleaning up
My startup log:
Code: Select all
21:19:22:Trying to access database...
21:19:24:Successfully acquired database lock
21:19:25:Downloading GPUs.txt from assign1.foldingathome.org:80
21:19:25:Connecting to assign1.foldingathome.org:80
21:19:25:Read GPUs.txt
21:19:26:Enabled folding slot 00: PAUSED cpu:3 (by user)
21:19:26:****************************** FAHClient ******************************
21:19:26: Version: 7.6.13
21:19:26: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
21:19:26: Copyright: 2020 foldingathome.org
21:19:26: Homepage: https://foldingathome.org/
21:19:26: Date: Apr 27 2020
21:19:26: Time: 21:20:45
21:19:26: Revision: 5a652817f46116b6e135503af97f18e094414e3b
21:19:26: Branch: master
21:19:26: Compiler: GNU 4.2.1 Compatible Apple LLVM 11.0.0 (clang-1100.0.33.8)
21:19:26: Options: -std=c++11 -O3 -funroll-loops -mmacosx-version-min=10.7
21:19:26: -Wno-unused-local-typedefs -stdlib=libc++
21:19:26: Platform: darwin 19.2.0
21:19:26: Bits: 64
21:19:26: Mode: Release
21:19:26: Config: /Library/Application Support/FAHClient/config.xml
21:19:26:******************************** CBang ********************************
21:19:26: Date: Apr 24 2020
21:19:26: Time: 17:07:50
21:19:26: Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
21:19:26: Branch: master
21:19:26: Compiler: GNU 4.2.1 Compatible Apple LLVM 11.0.0 (clang-1100.0.33.8)
21:19:26: Options: -std=c++11 -O3 -funroll-loops -mmacosx-version-min=10.7
21:19:26: -Wno-unused-local-typedefs -stdlib=libc++ -fPIC
21:19:26: Platform: darwin 19.2.0
21:19:26: Bits: 64
21:19:26: Mode: Release
21:19:26:******************************* System ********************************
21:19:26: CPU: Intel(R) Core(TM) i7-7700HQ CPU @ 2.80GHz
21:19:26: CPU ID: GenuineIntel Family 6 Model 158 Stepping 9
21:19:26: CPUs: 8
21:19:26: Memory: 16.00GiB
21:19:26:Free Memory: 14.17GiB
21:19:26: Threads: POSIX_THREADS
21:19:26: OS Version: 10.15
21:19:26:Has Battery: true
21:19:26: On Battery: true
21:19:26: UTC Offset: -4
21:19:26: PID: 150
21:19:26: CWD: /Library/Application Support/FAHClient
21:19:26: OS: Darwin 19.6.0 x86_64
21:19:26: OS Arch: AMD64
21:19:26: GPUs: 1
21:19:26: GPU 0: Bus:1 Slot:0 Func:0 AMD:5 Baffin XT [Radeon RX 460]
21:19:26: CUDA: Not detected: Failed to open dynamic library 'libcuda.dylib':
21:19:26: dlopen(libcuda.dylib, 1): image not found
21:19:26: OpenCL: Not detected: Failed to open dynamic library 'libOpenCL.dylib':
21:19:26: dlopen(libOpenCL.dylib, 1): image not found
21:19:26:******************************* libFAH ********************************
21:19:26: Date: Apr 15 2020
21:19:26: Time: 14:43:28
21:19:26: Revision: 216968bc7025029c841ed6e36e81a03a316890d3
21:19:26: Branch: master
21:19:26: Compiler: GNU 4.2.1 Compatible Apple LLVM 11.0.0 (clang-1100.0.33.8)
21:19:26: Options: -std=c++11 -O3 -funroll-loops -mmacosx-version-min=10.7
21:19:26: -Wno-unused-local-typedefs -stdlib=libc++
21:19:26: Platform: darwin 19.2.0
21:19:26: Bits: 64
21:19:26: Mode: Release
21:19:26:***********************************************************************
21:19:26:<config>
21:19:26: <!-- Folding Slot Configuration -->
21:19:26: <cause v='COVID_19'/>
21:19:26:
21:19:26: <!-- Network -->
21:19:26: <proxy v=':8080'/>
21:19:26:
21:19:26: <!-- Slot Control -->
21:19:26: <pause-on-start v='true'/>
21:19:26: <power v='LIGHT'/>
21:19:26:
21:19:26: <!-- User Information -->
21:19:26: <passkey v='*****'/>
21:19:26: <team v='3213'/>
21:19:26: <user v='garaden'/>
21:19:26:
21:19:26: <!-- Folding Slots -->
21:19:26: <slot id='0' type='CPU'/>
21:19:26:</config>
Computer Specs: Quad-Core Intel Core i7 2.8 GHz. 16 GB RAM. Hyper-Threading enabled.
Network Connection: Starry Internet. Basically cable. 200 Mbits up and down.
Operating System: macOS Catalina version 10.15.6.
Overclocked?: None
Stable?: Haven't run any stability testing software, but this is my first time having a problem. This is my main work & personal computer.
Software: Client version 7.6.13. Core version a8-0.0.7, AVX2-256.
WU details: Gromacs avx2_256. PRCG 16810 (6, 548, 26)
Is there some way for me to roll back to a8-0.0.6? I could delete this WU and get a new one, but I'd prefer to complete this one if possible.