Receiving extra CPU WUs after a 503 "please wait" error

[arisu]

For some reason I very often get a "no appropriate assignment" message for GPU WUs. About 1 in 10 times it works, so sometimes I'll just restart my client a few times until it does. Every once in a while, the error message changes to "please wait" (also a 503 error). Once it retries after that, it will download a CPU WU despite one already running (when it was trying to get a GPU one), which means I'll end up with half a dozen pending CPU WUs that I have to dump.

Here is a snippet of the relevant parts, showing it trying to download a GPU WU, getting a 503 error, then trying again and instead receiving a CPU WU:

Code: Select all

arisu@mememe:/var/log/fah-client$ grep -e :WU116: -e :OUT1: -e :OUT2: log-20250224-230803.txt
23:06:43:I1:WU116:Requesting WU assignment for user Loli Alice team 230362
23:06:43:I1:OUT1:> CONNECT assign1.foldingathome.org:443 HTTP/1.1
23:06:43:I1:OUT1:> POST https://assign1.foldingathome.org/api/assign HTTP/1.1
23:06:44:I1:OUT1:< HTTP/1.1 200 HTTP_OK
23:06:44:I1:WU116:Received WU assignment kC_EOqXseAHoS0Xcd5QwbU5rRSqfLenpwra9YRaFWoE
23:06:44:I1:WU116:Downloading WU
23:06:45:I1:OUT2:> CONNECT pllwskifah2.mskcc.org:443 HTTP/1.1
23:06:45:I1:OUT2:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
23:06:46:I1:WU116:DOWNLOAD 100% 46B of 46B
23:06:46:I1:OUT2:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
23:06:46:E :OUT2:HTTP_SERVICE_UNAVAILABLE: {"error":{"message":"Please wait","code":503}}
23:06:46:I1:WU116:Retry #1 in 2 secs
23:06:48:I1:WU116:Requesting WU assignment for user Loli Alice team 230362
23:06:51:I1:WU116:Received WU assignment erBVi7sYl5KQSxgjoSytFh9ObpW7MSt7LDV8amrzh3k
23:06:51:I1:WU116:Downloading WU
23:06:53:I1:WU116:DOWNLOAD 100% 307.25KiB of 307.25KiB
23:06:53:I1:WU116:Received WU P12481 R44 C0 G26
23:07:35:I3:WU116:Dumping erBVi7sYl5KQSxgjoSytFh9ObpW7MSt7LDV8amrzh3k
23:07:35:I1:WU116:Sending dump report
23:07:40:I1:WU116:Dumped

Here are the full logs. This is one where it goes into the "no appropriate assignment" loop. It ends only when I restart the client:

Code: Select all

*********************** Log Started 2025-02-24T23:06:15Z ***********************
23:06:15:I1:*********************** Folding@home Client ***********************
23:06:15:I1:    Version: 8.4.9
23:06:15:I1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:06:15:I1:        Org: foldingathome.org
23:06:15:I1:  Copyright: 2023-2024, foldingathome.org
23:06:15:I1:   Homepage: https://foldingathome.org/
23:06:15:I1:    License: GPL-3.0-or-later
23:06:15:I1:        URL: https://v8-4.foldingathome.org/
23:06:15:I1:       Date: Nov 20 2024
23:06:15:I1:       Time: 14:47:19
23:06:15:I1:   Revision: 360fe71b1bd05bb89814bfb97b73a5bda84802d6
23:06:15:I1:     Branch: master
23:06:15:I1:   Compiler: GNU 8.3.0
23:06:15:I1:    Options: -Wsuggest-override -faligned-new -std=c++17 -fsigned-char
23:06:15:I1:             -ffunction-sections -fdata-sections -O3 -funroll-loops -fno-pie
23:06:15:I1:   Platform: linux 4.19.0-27-cloud-amd64
23:06:15:I1:       Bits: 64
23:06:15:I1:       Mode: Release
23:06:15:I1:       Args: --config=/etc/fah-client/config.xml
23:06:15:I1:             --log=/var/log/fah-client/log.txt
23:06:15:I1:             --log-rotate-dir=/var/log/fah-client/
23:06:15:I1:     Config: /etc/fah-client/config.xml
23:06:15:I1:****************************** CBang ******************************
23:06:15:I1:    Version: 1.7.2
23:06:15:I1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:06:15:I1:        Org: Cauldron Development
23:06:15:I1:  Copyright: Cauldron Development, 2003-2024
23:06:15:I1:   Homepage: https://cauldrondevelopment.com/
23:06:15:I1:    License: LGPL-2.1-or-later
23:06:15:I1:       Date: Nov 19 2024
23:06:15:I1:       Time: 21:54:38
23:06:15:I1:   Revision: 443c54e909eb8d8994405a18fb328b5b05a623a5
23:06:15:I1:     Branch: master
23:06:15:I1:   Compiler: GNU 8.3.0
23:06:15:I1:    Options: -Wsuggest-override -faligned-new -std=c++17 -fsigned-char
23:06:15:I1:             -ffunction-sections -fdata-sections -O3 -funroll-loops -fno-pie
23:06:15:I1:             -fPIC
23:06:15:I1:   Platform: linux 4.19.0-27-cloud-amd64
23:06:15:I1:       Bits: 64
23:06:15:I1:       Mode: Release
23:06:15:I1:***************************** System ******************************
23:06:15:I1:        CPU: AMD Ryzen 7 7840U w/ Radeon 780M Graphics
23:06:15:I1:     CPU ID: AuthenticAMD Family 25 Model 116 Stepping 1
23:06:15:I1:       CPUs: 8
23:06:15:I1:     Memory: 30.58GiB
23:06:15:I1:Free Memory: 22.82GiB
23:06:15:I1: OS Version: 6.1
23:06:15:I1:Has Battery: true
23:06:15:I1: On Battery: false
23:06:15:I1:   Hostname: mememe
23:06:15:I1: UTC Offset: 0
23:06:15:I1:        PID: 134261
23:06:15:I1:        CWD: /var/lib/fah-client
23:06:15:I1:       Exec: /usr/bin/fah-client
23:06:15:I1:*******************************************************************
23:06:15:I2:<config/>
23:06:15:I1:Opening Database
23:06:15:I1:F@H ID = 5ZRuPo7XgKOfnDa7E54YXDtyUJKiBKtSr3dV0rv1ua8
23:06:15:I3:Loading default resource group
23:06:15:I1:Listening for HTTP on 127.0.0.1:7396
23:06:15:I3:WU96:Loading work unit 96 with ID 9U9x1ATEnQV9Cje4lBwQncKKoKq5z301XoL1pXOGXJo
23:06:15:I3:WU98:Loading work unit 98 with ID jSzz05AfTROuOrAp76iNuMAb0Qe90xqqNdR6JOEcIFg
23:06:15:I3:WU107:Loading work unit 107 with ID CB7kX-5X52t2t9r6LvrR5-N4neixQqcc-OdPFRDolmY
23:06:15:I3:Loaded 3 wus.
23:06:15:I3:gpus = {
23:06:15:I3:  "gpu:03:00:00": {
23:06:15:I3:    "vendor": 4098,
23:06:15:I3:    "type": "amd",
23:06:15:I3:    "description": "gfx1103",
23:06:15:I3:    "opencl": {"platform": 0, "device": 0, "compute": "2.0", "driver": "3625.0"},
23:06:15:I3:    "device": 5567,
23:06:15:I3:    "supported": true
23:06:15:I3:  }
23:06:15:I3:}
23:06:15:I1:Loaded cores/fahcore-a8-lin-64bit-avx2_256-0.0.12/FahCore_a8
23:06:15:I1:Default:Added new work unit: cpus:0 gpus:gpu:03:00:00
23:06:15:I1:WU115:Requesting WU assignment for user Loli Alice team 230362
23:06:15:I3:Running FahCore: /var/lib/fah-client/cores/fahcore-a8-lin-64bit-avx2_256-0.0.12/FahCore_a8 -dir 9U9x1ATEnQV9Cje4lBwQncKKoKq5z301XoL1pXOGXJo -suffix 01 -version 8.4.9 -lifeline 134261 -np 8
23:06:15:I3:WU96:Started FahCore on PID 134265
23:06:15:I1:OUT1:> CONNECT assign1.foldingathome.org:443 HTTP/1.1
23:06:15:I1:WU96:*********************** Log Started 2025-02-24T23:06:15Z ***********************
23:06:15:I1:WU96:************************** Gromacs Folding@home Core ***************************
23:06:15:I1:WU96:       Core: Gromacs
23:06:15:I1:WU96:       Type: 0xa8
23:06:15:I1:WU96:    Version: 0.0.12
23:06:15:I1:WU96:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:06:15:I1:WU96:  Copyright: 2020 foldingathome.org
23:06:15:I1:WU96:   Homepage: https://foldingathome.org/
23:06:15:I1:WU96:       Date: Jan 16 2021
23:06:15:I1:WU96:       Time: 19:24:44
23:06:15:I1:WU96:   Compiler: GNU 8.3.0
23:06:15:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:15:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie
23:06:15:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:15:I1:WU96:       Bits: 64
23:06:15:I1:WU96:       Mode: Release
23:06:15:I1:WU96:       SIMD: avx2_256
23:06:15:I1:WU96:     OpenMP: ON
23:06:15:I1:WU96:       CUDA: OFF
23:06:15:I1:WU96:       Args: -dir 9U9x1ATEnQV9Cje4lBwQncKKoKq5z301XoL1pXOGXJo -suffix 01
23:06:15:I1:WU96:             -version 8.4.9 -lifeline 134261 -np 8
23:06:15:I1:WU96:************************************ libFAH ************************************
23:06:15:I1:WU96:       Date: Jan 16 2021
23:06:15:I1:WU96:       Time: 19:21:38
23:06:15:I1:WU96:   Compiler: GNU 8.3.0
23:06:15:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:15:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie
23:06:15:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:15:I1:WU96:       Bits: 64
23:06:15:I1:WU96:       Mode: Release
23:06:15:I1:WU96:************************************ CBang *************************************
23:06:15:I1:WU96:       Date: Jan 16 2021
23:06:15:I1:WU96:       Time: 19:21:24
23:06:15:I1:WU96:   Compiler: GNU 8.3.0
23:06:15:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:15:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie -fPIC
23:06:15:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:15:I1:WU96:       Bits: 64
23:06:15:I1:WU96:       Mode: Release
23:06:15:I1:WU96:************************************ System ************************************
23:06:15:I1:WU96:        CPU: AMD Ryzen 7 7840U w/ Radeon 780M Graphics
23:06:15:I1:WU96:     CPU ID: AuthenticAMD Family 25 Model 116 Stepping 1
23:06:15:I1:WU96:       CPUs: 8
23:06:15:I1:WU96:     Memory: 30.58GiB
23:06:15:I1:WU96:Free Memory: 22.79GiB
23:06:15:I1:WU96:    Threads: POSIX_THREADS
23:06:15:I1:WU96: OS Version: 6.1
23:06:15:I1:WU96:Has Battery: true
23:06:15:I1:WU96: On Battery: false
23:06:15:I1:WU96: UTC Offset: 0
23:06:15:I1:WU96:        PID: 134265
23:06:15:I1:WU96:        CWD: /var/lib/fah-client/work
23:06:15:I1:WU96:********************************************************************************
23:06:15:I1:WU96:Project: 12485 (Run 11, Clone 0, Gen 16)
23:06:15:I1:WU96:Unit: 0x00000000000000000000000000000000
23:06:15:I1:WU96:Digital signatures verified
23:06:15:I1:WU96:Calling: mdrun -c frame16.gro -s frame16.tpr -x frame16.xtc -cpi state.cpt -cpt 5 -nt 8 -ntmpi 1
23:06:15:I1:WU96:Steps: first=8000000 total=8500000
23:06:16:I1:OUT1:> POST https://assign1.foldingathome.org/api/assign HTTP/1.1
23:06:17:I1:WU96:Completed 169006 out of 500000 steps (33%)
23:06:17:I1:OUT1:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
23:06:17:E :OUT1:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
23:06:17:I1:WU115:Retry #1 in 2 secs
23:06:19:I1:WU115:Requesting WU assignment for user Loli Alice team 230362
23:06:19:I1:OUT2:> CONNECT assign2.foldingathome.org:443 HTTP/1.1
23:06:20:I1:OUT2:> POST https://assign2.foldingathome.org/api/assign HTTP/1.1
23:06:21:I1:OUT2:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
23:06:21:E :OUT2:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
23:06:21:I1:WU115:Retry #2 in 4 secs
23:06:25:I1:WU115:Requesting WU assignment for user Loli Alice team 230362
23:06:25:I1:OUT3:> CONNECT assign3.foldingathome.org:443 HTTP/1.1
23:06:25:I1:OUT3:> POST https://assign3.foldingathome.org/api/assign HTTP/1.1
23:06:27:I1:OUT3:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
23:06:27:E :OUT3:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
23:06:27:I1:WU115:Retry #3 in 8 secs
23:06:35:I1:WU115:Requesting WU assignment for user Loli Alice team 230362
23:06:35:I1:OUT4:> CONNECT assign4.foldingathome.org:443 HTTP/1.1
23:06:35:I1:OUT4:> POST https://assign4.foldingathome.org/api/assign HTTP/1.1
23:06:37:I1:OUT4:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
23:06:37:E :OUT4:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
23:06:37:I1:WU115:Retry #4 in 16 secs
23:06:37:I1:WU96:Completed 170000 out of 500000 steps (34%)
23:06:41:I1:WU96:Caught signal SIGINT(2) on PID 134265
23:06:41:I1:WU96:Exiting, please wait. . .
23:06:42:I1:WU96:Folding@home Core Shutdown: INTERRUPTED
23:06:42:I1:WU96:Core returned INTERRUPTED (102)
23:06:42:I1:Clean exit

And here is where the server eventually sends a "please wait" response instead, which causes the next retry to download a CPU WU instead of a GPU WU. This is also where I noticed the build up of pending WUs, which I dumped manually:

Code: Select all

*********************** Log Started 2025-02-24T23:06:43Z ***********************
23:06:43:I1:*********************** Folding@home Client ***********************
23:06:43:I1:    Version: 8.4.9
23:06:43:I1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:06:43:I1:        Org: foldingathome.org
23:06:43:I1:  Copyright: 2023-2024, foldingathome.org
23:06:43:I1:   Homepage: https://foldingathome.org/
23:06:43:I1:    License: GPL-3.0-or-later
23:06:43:I1:        URL: https://v8-4.foldingathome.org/
23:06:43:I1:       Date: Nov 20 2024
23:06:43:I1:       Time: 14:47:19
23:06:43:I1:   Revision: 360fe71b1bd05bb89814bfb97b73a5bda84802d6
23:06:43:I1:     Branch: master
23:06:43:I1:   Compiler: GNU 8.3.0
23:06:43:I1:    Options: -Wsuggest-override -faligned-new -std=c++17 -fsigned-char
23:06:43:I1:             -ffunction-sections -fdata-sections -O3 -funroll-loops -fno-pie
23:06:43:I1:   Platform: linux 4.19.0-27-cloud-amd64
23:06:43:I1:       Bits: 64
23:06:43:I1:       Mode: Release
23:06:43:I1:       Args: --config=/etc/fah-client/config.xml
23:06:43:I1:             --log=/var/log/fah-client/log.txt
23:06:43:I1:             --log-rotate-dir=/var/log/fah-client/
23:06:43:I1:     Config: /etc/fah-client/config.xml
23:06:43:I1:****************************** CBang ******************************
23:06:43:I1:    Version: 1.7.2
23:06:43:I1:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:06:43:I1:        Org: Cauldron Development
23:06:43:I1:  Copyright: Cauldron Development, 2003-2024
23:06:43:I1:   Homepage: https://cauldrondevelopment.com/
23:06:43:I1:    License: LGPL-2.1-or-later
23:06:43:I1:       Date: Nov 19 2024
23:06:43:I1:       Time: 21:54:38
23:06:43:I1:   Revision: 443c54e909eb8d8994405a18fb328b5b05a623a5
23:06:43:I1:     Branch: master
23:06:43:I1:   Compiler: GNU 8.3.0
23:06:43:I1:    Options: -Wsuggest-override -faligned-new -std=c++17 -fsigned-char
23:06:43:I1:             -ffunction-sections -fdata-sections -O3 -funroll-loops -fno-pie
23:06:43:I1:             -fPIC
23:06:43:I1:   Platform: linux 4.19.0-27-cloud-amd64
23:06:43:I1:       Bits: 64
23:06:43:I1:       Mode: Release
23:06:43:I1:***************************** System ******************************
23:06:43:I1:        CPU: AMD Ryzen 7 7840U w/ Radeon 780M Graphics
23:06:43:I1:     CPU ID: AuthenticAMD Family 25 Model 116 Stepping 1
23:06:43:I1:       CPUs: 8
23:06:43:I1:     Memory: 30.58GiB
23:06:43:I1:Free Memory: 22.81GiB
23:06:43:I1: OS Version: 6.1
23:06:43:I1:Has Battery: true
23:06:43:I1: On Battery: false
23:06:43:I1:   Hostname: mememe
23:06:43:I1: UTC Offset: 0
23:06:43:I1:        PID: 134317
23:06:43:I1:        CWD: /var/lib/fah-client
23:06:43:I1:       Exec: /usr/bin/fah-client
23:06:43:I1:*******************************************************************
23:06:43:I2:<config/>
23:06:43:I1:Opening Database
23:06:43:I1:F@H ID = 5ZRuPo7XgKOfnDa7E54YXDtyUJKiBKtSr3dV0rv1ua8
23:06:43:I3:Loading default resource group
23:06:43:I1:Listening for HTTP on 127.0.0.1:7396
23:06:43:I3:WU96:Loading work unit 96 with ID 9U9x1ATEnQV9Cje4lBwQncKKoKq5z301XoL1pXOGXJo
23:06:43:I3:WU98:Loading work unit 98 with ID jSzz05AfTROuOrAp76iNuMAb0Qe90xqqNdR6JOEcIFg
23:06:43:I3:WU107:Loading work unit 107 with ID CB7kX-5X52t2t9r6LvrR5-N4neixQqcc-OdPFRDolmY
23:06:43:I3:Loaded 3 wus.
23:06:43:I3:gpus = {
23:06:43:I3:  "gpu:03:00:00": {
23:06:43:I3:    "vendor": 4098,
23:06:43:I3:    "type": "amd",
23:06:43:I3:    "description": "gfx1103",
23:06:43:I3:    "opencl": {"platform": 0, "device": 0, "compute": "2.0", "driver": "3625.0"},
23:06:43:I3:    "device": 5567,
23:06:43:I3:    "supported": true
23:06:43:I3:  }
23:06:43:I3:}
23:06:43:I1:Loaded cores/fahcore-a8-lin-64bit-avx2_256-0.0.12/FahCore_a8
23:06:43:I1:Default:Added new work unit: cpus:0 gpus:gpu:03:00:00
23:06:43:I1:WU116:Requesting WU assignment for user Loli Alice team 230362
23:06:43:I3:Running FahCore: /var/lib/fah-client/cores/fahcore-a8-lin-64bit-avx2_256-0.0.12/FahCore_a8 -dir 9U9x1ATEnQV9Cje4lBwQncKKoKq5z301XoL1pXOGXJo -suffix 01 -version 8.4.9 -lifeline 134317 -np 8
23:06:43:I3:WU96:Started FahCore on PID 134321
23:06:43:I1:OUT1:> CONNECT assign1.foldingathome.org:443 HTTP/1.1
23:06:43:I1:WU96:*********************** Log Started 2025-02-24T23:06:43Z ***********************
23:06:43:I1:WU96:************************** Gromacs Folding@home Core ***************************
23:06:43:I1:WU96:       Core: Gromacs
23:06:43:I1:WU96:       Type: 0xa8
23:06:43:I1:WU96:    Version: 0.0.12
23:06:43:I1:WU96:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:06:43:I1:WU96:  Copyright: 2020 foldingathome.org
23:06:43:I1:WU96:   Homepage: https://foldingathome.org/
23:06:43:I1:WU96:       Date: Jan 16 2021
23:06:43:I1:WU96:       Time: 19:24:44
23:06:43:I1:WU96:   Compiler: GNU 8.3.0
23:06:43:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:43:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie
23:06:43:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:43:I1:WU96:       Bits: 64
23:06:43:I1:WU96:       Mode: Release
23:06:43:I1:WU96:       SIMD: avx2_256
23:06:43:I1:WU96:     OpenMP: ON
23:06:43:I1:WU96:       CUDA: OFF
23:06:43:I1:WU96:       Args: -dir 9U9x1ATEnQV9Cje4lBwQncKKoKq5z301XoL1pXOGXJo -suffix 01
23:06:43:I1:WU96:             -version 8.4.9 -lifeline 134317 -np 8
23:06:43:I1:WU96:************************************ libFAH ************************************
23:06:43:I1:WU96:       Date: Jan 16 2021
23:06:43:I1:WU96:       Time: 19:21:38
23:06:43:I1:WU96:   Compiler: GNU 8.3.0
23:06:43:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:43:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie
23:06:43:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:43:I1:WU96:       Bits: 64
23:06:43:I1:WU96:       Mode: Release
23:06:43:I1:WU96:************************************ CBang *************************************
23:06:43:I1:WU96:       Date: Jan 16 2021
23:06:43:I1:WU96:       Time: 19:21:24
23:06:43:I1:WU96:   Compiler: GNU 8.3.0
23:06:43:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:43:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie -fPIC
23:06:43:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:43:I1:WU96:       Bits: 64
23:06:43:I1:WU96:       Mode: Release
23:06:43:I1:WU96:************************************ System ************************************
23:06:43:I1:WU96:        CPU: AMD Ryzen 7 7840U w/ Radeon 780M Graphics
23:06:43:I1:WU96:     CPU ID: AuthenticAMD Family 25 Model 116 Stepping 1
23:06:43:I1:WU96:       CPUs: 8
23:06:43:I1:WU96:     Memory: 30.58GiB
23:06:43:I1:WU96:Free Memory: 22.78GiB
23:06:43:I1:WU96:    Threads: POSIX_THREADS
23:06:43:I1:WU96: OS Version: 6.1
23:06:43:I1:WU96:Has Battery: true
23:06:43:I1:WU96: On Battery: false
23:06:43:I1:WU96: UTC Offset: 0
23:06:43:I1:WU96:        PID: 134321
23:06:43:I1:WU96:        CWD: /var/lib/fah-client/work
23:06:43:I1:WU96:********************************************************************************
23:06:43:I1:WU96:Project: 12485 (Run 11, Clone 0, Gen 16)
23:06:43:I1:WU96:Unit: 0x00000000000000000000000000000000
23:06:43:I1:WU96:Digital signatures verified
23:06:43:I1:WU96:Calling: mdrun -c frame16.gro -s frame16.tpr -x frame16.xtc -cpi state.cpt -cpt 5 -nt 8 -ntmpi 1
23:06:43:I1:WU96:Steps: first=8000000 total=8500000
23:06:43:I1:OUT1:> POST https://assign1.foldingathome.org/api/assign HTTP/1.1
23:06:44:I1:WU96:Completed 170208 out of 500000 steps (34%)
23:06:44:I1:OUT1:< HTTP/1.1 200 HTTP_OK
23:06:44:I1:WU116:Received WU assignment kC_EOqXseAHoS0Xcd5QwbU5rRSqfLenpwra9YRaFWoE
23:06:44:I1:WU116:Downloading WU
23:06:44:I1:WU96:Caught signal SIGINT(2) on PID 134321
23:06:44:I1:WU96:Exiting, please wait. . .
23:06:45:I1:OUT2:> CONNECT pllwskifah2.mskcc.org:443 HTTP/1.1
23:06:45:I1:WU96:Folding@home Core Shutdown: INTERRUPTED
23:06:45:I1:OUT2:> POST https://pllwskifah2.mskcc.org/api/assign HTTP/1.1
23:06:45:I1:WU96:Core returned INTERRUPTED (102)
23:06:45:I3:Running FahCore: /var/lib/fah-client/cores/fahcore-a8-lin-64bit-avx2_256-0.0.12/FahCore_a8 -dir 9U9x1ATEnQV9Cje4lBwQncKKoKq5z301XoL1pXOGXJo -suffix 01 -version 8.4.9 -lifeline 134317 -np 7
23:06:45:I3:WU96:Started FahCore on PID 134334
23:06:46:I1:WU96:*********************** Log Started 2025-02-24T23:06:45Z ***********************
23:06:46:I1:WU96:************************** Gromacs Folding@home Core ***************************
23:06:46:I1:WU96:       Core: Gromacs
23:06:46:I1:WU96:       Type: 0xa8
23:06:46:I1:WU96:    Version: 0.0.12
23:06:46:I1:WU96:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:06:46:I1:WU96:  Copyright: 2020 foldingathome.org
23:06:46:I1:WU96:   Homepage: https://foldingathome.org/
23:06:46:I1:WU96:       Date: Jan 16 2021
23:06:46:I1:WU96:       Time: 19:24:44
23:06:46:I1:WU96:   Compiler: GNU 8.3.0
23:06:46:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:46:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie
23:06:46:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:46:I1:WU96:       Bits: 64
23:06:46:I1:WU96:       Mode: Release
23:06:46:I1:WU96:       SIMD: avx2_256
23:06:46:I1:WU96:     OpenMP: ON
23:06:46:I1:WU96:       CUDA: OFF
23:06:46:I1:WU96:       Args: -dir 9U9x1ATEnQV9Cje4lBwQncKKoKq5z301XoL1pXOGXJo -suffix 01
23:06:46:I1:WU96:             -version 8.4.9 -lifeline 134317 -np 7
23:06:46:I1:WU96:************************************ libFAH ************************************
23:06:46:I1:WU96:       Date: Jan 16 2021
23:06:46:I1:WU96:       Time: 19:21:38
23:06:46:I1:WU96:   Compiler: GNU 8.3.0
23:06:46:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:46:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie
23:06:46:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:46:I1:WU96:       Bits: 64
23:06:46:I1:WU96:       Mode: Release
23:06:46:I1:WU96:************************************ CBang *************************************
23:06:46:I1:WU96:       Date: Jan 16 2021
23:06:46:I1:WU96:       Time: 19:21:24
23:06:46:I1:WU96:   Compiler: GNU 8.3.0
23:06:46:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:46:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie -fPIC
23:06:46:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:46:I1:WU96:       Bits: 64
23:06:46:I1:WU96:       Mode: Release
23:06:46:I1:WU96:************************************ System ************************************
23:06:46:I1:WU96:        CPU: AMD Ryzen 7 7840U w/ Radeon 780M Graphics
23:06:46:I1:WU96:     CPU ID: AuthenticAMD Family 25 Model 116 Stepping 1
23:06:46:I1:WU96:       CPUs: 8
23:06:46:I1:WU96:     Memory: 30.58GiB
23:06:46:I1:WU96:Free Memory: 22.77GiB
23:06:46:I1:WU96:    Threads: POSIX_THREADS
23:06:46:I1:WU96: OS Version: 6.1
23:06:46:I1:WU96:Has Battery: true
23:06:46:I1:WU96: On Battery: false
23:06:46:I1:WU96: UTC Offset: 0
23:06:46:I1:WU96:        PID: 134334
23:06:46:I1:WU96:        CWD: /var/lib/fah-client/work
23:06:46:I1:WU96:********************************************************************************
23:06:46:I1:WU96:Project: 12485 (Run 11, Clone 0, Gen 16)
23:06:46:I1:WU96:Unit: 0x00000000000000000000000000000000
23:06:46:I1:WU96:Digital signatures verified
23:06:46:I1:WU96:Calling: mdrun -c frame16.gro -s frame16.tpr -x frame16.xtc -cpi state.cpt -cpt 5 -nt 7 -ntmpi 1
23:06:46:I1:WU96:Steps: first=8000000 total=8500000
23:06:46:I1:WU116:DOWNLOAD 100% 46B of 46B
23:06:46:I1:OUT2:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
23:06:46:E :OUT2:HTTP_SERVICE_UNAVAILABLE: {"error":{"message":"Please wait","code":503}}
23:06:46:I1:WU116:Retry #1 in 2 secs
23:06:47:I1:WU96:Completed 170222 out of 500000 steps (34%)
23:06:48:I1:WU116:Requesting WU assignment for user Loli Alice team 230362
23:06:49:I1:OUT3:> CONNECT assign2.foldingathome.org:443 HTTP/1.1
23:06:49:I1:OUT3:> POST https://assign2.foldingathome.org/api/assign HTTP/1.1
23:06:51:I1:OUT3:< HTTP/1.1 200 HTTP_OK
23:06:51:I1:WU116:Received WU assignment erBVi7sYl5KQSxgjoSytFh9ObpW7MSt7LDV8amrzh3k
23:06:51:I1:WU116:Downloading WU
23:06:51:I1:OUT4:> CONNECT vav21.fah.temple.edu:443 HTTP/1.1
23:06:51:I1:WU96:Caught signal SIGINT(2) on PID 134334
23:06:51:I1:WU96:Exiting, please wait. . .
23:06:51:I1:OUT4:> POST https://vav21.fah.temple.edu/api/assign HTTP/1.1
23:06:51:I1:WU96:Folding@home Core Shutdown: INTERRUPTED
23:06:52:I1:WU96:Core returned INTERRUPTED (102)
23:06:53:I1:WU116:DOWNLOAD 100% 307.25KiB of 307.25KiB
23:06:53:I1:OUT4:< HTTP/1.1 200 HTTP_OK
23:06:53:I1:WU116:Received WU P12481 R44 C0 G26
23:06:53:I3:Running FahCore: /var/lib/fah-client/cores/fahcore-a8-lin-64bit-avx2_256-0.0.12/FahCore_a8 -dir 9U9x1ATEnQV9Cje4lBwQncKKoKq5z301XoL1pXOGXJo -suffix 01 -version 8.4.9 -lifeline 134317 -np 8
23:06:53:I3:WU96:Started FahCore on PID 134345
23:06:53:I1:WU96:*********************** Log Started 2025-02-24T23:06:53Z ***********************
23:06:53:I1:WU96:************************** Gromacs Folding@home Core ***************************
23:06:53:I1:WU96:       Core: Gromacs
23:06:53:I1:WU96:       Type: 0xa8
23:06:53:I1:WU96:    Version: 0.0.12
23:06:53:I1:WU96:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:06:53:I1:WU96:  Copyright: 2020 foldingathome.org
23:06:53:I1:WU96:   Homepage: https://foldingathome.org/
23:06:53:I1:WU96:       Date: Jan 16 2021
23:06:53:I1:WU96:       Time: 19:24:44
23:06:53:I1:WU96:   Compiler: GNU 8.3.0
23:06:53:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:53:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie
23:06:53:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:53:I1:WU96:       Bits: 64
23:06:53:I1:WU96:       Mode: Release
23:06:53:I1:WU96:       SIMD: avx2_256
23:06:53:I1:WU96:     OpenMP: ON
23:06:53:I1:WU96:       CUDA: OFF
23:06:53:I1:WU96:       Args: -dir 9U9x1ATEnQV9Cje4lBwQncKKoKq5z301XoL1pXOGXJo -suffix 01
23:06:53:I1:WU96:             -version 8.4.9 -lifeline 134317 -np 8
23:06:53:I1:WU96:************************************ libFAH ************************************
23:06:53:I1:WU96:       Date: Jan 16 2021
23:06:53:I1:WU96:       Time: 19:21:38
23:06:53:I1:WU96:   Compiler: GNU 8.3.0
23:06:53:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:53:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie
23:06:53:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:53:I1:WU96:       Bits: 64
23:06:53:I1:WU96:       Mode: Release
23:06:53:I1:WU96:************************************ CBang *************************************
23:06:53:I1:WU96:       Date: Jan 16 2021
23:06:53:I1:WU96:       Time: 19:21:24
23:06:53:I1:WU96:   Compiler: GNU 8.3.0
23:06:53:I1:WU96:    Options: -faligned-new -std=c++14 -fsigned-char -ffunction-sections
23:06:53:I1:WU96:             -fdata-sections -O3 -funroll-loops -fno-pie -fPIC
23:06:53:I1:WU96:   Platform: linux2 4.15.0-128-generic
23:06:53:I1:WU96:       Bits: 64
23:06:53:I1:WU96:       Mode: Release
23:06:53:I1:WU96:************************************ System ************************************
23:06:53:I1:WU96:        CPU: AMD Ryzen 7 7840U w/ Radeon 780M Graphics
23:06:53:I1:WU96:     CPU ID: AuthenticAMD Family 25 Model 116 Stepping 1
23:06:53:I1:WU96:       CPUs: 8
23:06:53:I1:WU96:     Memory: 30.58GiB
23:06:53:I1:WU96:Free Memory: 22.69GiB
23:06:53:I1:WU96:    Threads: POSIX_THREADS
23:06:53:I1:WU96: OS Version: 6.1
23:06:53:I1:WU96:Has Battery: true
23:06:53:I1:WU96: On Battery: false
23:06:53:I1:WU96: UTC Offset: 0
23:06:53:I1:WU96:        PID: 134345
23:06:53:I1:WU96:        CWD: /var/lib/fah-client/work
23:06:53:I1:WU96:********************************************************************************
23:06:53:I1:WU96:Project: 12485 (Run 11, Clone 0, Gen 16)
23:06:53:I1:WU96:Unit: 0x00000000000000000000000000000000
23:06:53:I1:WU96:Digital signatures verified
23:06:53:I1:WU96:Calling: mdrun -c frame16.gro -s frame16.tpr -x frame16.xtc -cpi state.cpt -cpt 5 -nt 8 -ntmpi 1
23:06:53:I1:WU96:Steps: first=8000000 total=8500000
23:06:55:I1:WU96:Completed 170365 out of 500000 steps (34%)
23:07:33:I3:WU98:Dumping jSzz05AfTROuOrAp76iNuMAb0Qe90xqqNdR6JOEcIFg
23:07:33:I1:WU98:Sending dump report
23:07:33:I1:OUT6:> CONNECT vav21.fah.temple.edu:443 HTTP/1.1
23:07:33:I1:OUT6:> POST https://vav21.fah.temple.edu/api/results HTTP/1.1
23:07:35:I1:OUT6:< HTTP/1.1 200 HTTP_OK
23:07:35:I1:WU98:Dumped
23:07:35:I3:WU107:Dumping CB7kX-5X52t2t9r6LvrR5-N4neixQqcc-OdPFRDolmY
23:07:35:I1:WU107:Sending dump report
23:07:35:I1:OUT7:> CONNECT vav21.fah.temple.edu:443 HTTP/1.1
23:07:35:I3:WU116:Dumping erBVi7sYl5KQSxgjoSytFh9ObpW7MSt7LDV8amrzh3k
23:07:35:I1:WU116:Sending dump report
23:07:35:I1:OUT8:> CONNECT vav21.fah.temple.edu:443 HTTP/1.1
23:07:36:I1:OUT7:> POST https://vav21.fah.temple.edu/api/results HTTP/1.1
23:07:36:I3:WU107:Dumping CB7kX-5X52t2t9r6LvrR5-N4neixQqcc-OdPFRDolmY
23:07:36:I1:OUT8:> POST https://vav21.fah.temple.edu/api/results HTTP/1.1
23:07:37:I1:Default:Added new work unit: cpus:0 gpus:gpu:03:00:00
23:07:37:I1:WU107:Sending dump report
23:07:37:I1:WU117:Requesting WU assignment for user Loli Alice team 230362
23:07:37:I1:OUT9:> CONNECT vav21.fah.temple.edu:443 HTTP/1.1
23:07:37:I1:OUT10:> CONNECT assign3.foldingathome.org:443 HTTP/1.1
23:07:37:I1:OUT9:> POST https://vav21.fah.temple.edu/api/results HTTP/1.1
23:07:37:I1:OUT10:> POST https://assign3.foldingathome.org/api/assign HTTP/1.1
23:07:39:I1:OUT10:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
23:07:39:E :OUT10:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
23:07:39:I1:WU117:Retry #1 in 2 secs
23:07:40:I1:OUT8:< HTTP/1.1 200 HTTP_OK
23:07:40:I1:WU116:Dumped
23:07:40:I1:OUT9:< HTTP/1.1 200 HTTP_OK
23:07:40:I1:WU107:Dumped
23:07:41:I1:WU117:Requesting WU assignment for user Loli Alice team 230362
23:07:41:I1:OUT11:> CONNECT assign4.foldingathome.org:443 HTTP/1.1
23:07:41:I1:OUT11:> POST https://assign4.foldingathome.org/api/assign HTTP/1.1
23:07:42:I1:OUT11:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
23:07:42:E :OUT11:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
23:07:42:I1:WU117:Retry #2 in 4 secs
23:07:46:I1:WU117:Requesting WU assignment for user Loli Alice team 230362
23:07:46:I1:OUT12:> CONNECT assign5.foldingathome.org:443 HTTP/1.1
23:07:46:I1:OUT12:> POST https://assign5.foldingathome.org/api/assign HTTP/1.1
23:07:47:I1:OUT12:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
23:07:47:E :OUT12:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
23:07:47:I1:WU117:Retry #3 in 8 secs
23:07:55:I1:WU117:Requesting WU assignment for user Loli Alice team 230362
23:07:55:I1:OUT13:> CONNECT assign6.foldingathome.org:443 HTTP/1.1
23:07:55:I1:OUT13:> POST https://assign6.foldingathome.org/api/assign HTTP/1.1
23:07:56:I1:OUT13:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
23:07:56:E :OUT13:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
23:07:56:I1:WU117:Retry #4 in 16 secs
23:08:00:I1:WU96:Caught signal SIGINT(2) on PID 134345
23:08:00:I1:WU96:Exiting, please wait. . .
23:08:01:I1:WU96:Folding@home Core Shutdown: INTERRUPTED
23:08:01:I1:WU96:Core returned INTERRUPTED (102)
23:08:02:I1:Clean exit

[muziqaz]

Please don't do that.
No appropriate work available means that there is no work available for your hardware configuration. It is not meant to be "fixed" by system reboots or software restarts.

[arisu]

Alright, I thought it was an issue with my proxy. The error message wasn't very self-explanatory. I'll let the exponential back-off deal with the retries instead of retrying myself. The problem I'm having happens whether or not I restart the client myself, btw.

Anyway I think I might have an idea for why it's trying to download a CPU WU even when one is already running. When the GPU WU finishes, a single CPU core is freed, so perhaps the client now thinks there are free resources and that it can download a WU for the CPU.

Here is the "units" portion of the "fahctl state" output:

Code: Select all

  "units": [
    {
      "group": "",
      "number": 124,
      "cpus": 8,
      "gpus": [],
      "state": "RUN",
      "paused": false,
      "id": "6Q4x-S0vtewBQDv5w44ssCJ17WlagVj5kocT_bhxFoE",
      "progress": 0,
      "assignment": {
        "time": "2025-02-25T03:28:08Z",
        "ws": "vav17.fah.temple.edu",
        "port": 443,
        "project": 12485,
        "deadline": 302400,
        "timeout": 172800,
        "credit": 9430,
        "cpus": 7,
        "min_cpus": 1,
        "max_cpus": 64,
        "core": {"type": "0xa8", "url": "https://cores2.foldingathome.org/fahcore-a8-lin-64bit-avx2_256-0.0.12.tar.bz2", "sha256": "5d81e2df84fb0857e9804ce4c263e412d632b0e7c65bada542b608f1f8a2f204"}
      },
      "wu": {
        "time": "2025-02-25T03:28:08Z",
        "cs": ["vav24.fah.temple.edu", "129.32.209.204", "highland3.seas.upenn.edu", "highland4.seas.upenn.edu", "ds01.scs.illinois.edu", "ds03.scs.illinois.edu", "129.32.209.201", "129.32.209.203", "129.32.209.205", "129.32.209.206"],
        "server": 2166411720,
        "run": 0,
        "clone": 0,
        "gen": 53,
        "sha256": "j4ERMj0q1pvJB2FR7GinkBpQ77Nx1JSEiHjrV1vKa2A="
      },
      "wu_progress": 0.751,
      "eta": "1h 10m",
      "ppd": 167057,
      "frames": 76,
      "run_time": 12302,
      "start_time": "2025-02-25T07:26:58Z"
    },
    {
      "group": "",
      "number": 125,
      "cpus": 1,
      "gpus": [],
      "state": "RUN",
      "paused": true,
      "id": "Bh9uA5pIAIknb2o-wBU5SgcB7CBXsygXWskYyx_-Kbo",
      "delay": 32,
      "wait": "2025-02-25T07:26:54Z",
      "retries": 5,
      "progress": 0,
      "pause_reason": "Resources not available"
    },
    {
      "group": "",
      "number": 126,
      "cpus": 0,
      "gpus": ["gpu:03:00:00"],
      "state": "ASSIGN",
      "paused": false,
      "id": "bz1nBcNDY5-JNS0IOIyPimyYEltevCAC8sVsQNStVps",
      "error": "No appropriate assignment",
      "delay": 256,
      "wait": "2025-02-25T07:35:43Z",
      "retries": 8
    }
  ]

It's WU 125 that was inappropriately downloaded and is paused because "no resources available". Sure enough, the CPU WU (WU 124) that has been running already for a few hours restarted itself in order to make use of the freshly-available CPU core. WU 126 is the one which is waiting for an assignment.

Is this a bug in the client? It's assuming that there are free resources and then downloading a new CPU WU when the "free" resource was never actually meant to be used for a second CPU WU.

[muziqaz]

Remove any CPU cores assigned for your GPU. There is no need to assign any CPU cores for GPU. Just leave 1 core free when you assign the number of cores to CPU, please

[muziqaz]

To clarify, if you have resource group set up just for GPU, it only has to have GPU ticked, and 0 (zero) CPUs assigned to it.
For CPU resource group assign CPU threads your CPU has minus 1.
If you don't have resource groups, tick the GPU and set CPU number of the total number you have minus 1

[arisu]

I do not have any custom resource groups. It's just 8 cores allowed for the CPU, and GPU selected on.

[muziqaz]

How many cores in total do you have?

[arisu]

8 physical cores. SMT is disabled in the BIOS, so that means 8 threads. I just enable all cores. The GPU WU takes 1 and the CPU WU takes 7. They do this automatically (I didn't configure them to do this). If I turn off the GPU WU, the CPU restarts itself to take 8 cores.

The only thing I'm able to configure is how many cores this resource group will use, and I'm using only one resource group (the default).

[muziqaz]

If you want you can go to your settings (cog icon) and unlock this padlock at the bottom right corner. It will allow you to create 2 separate resource groups. One for you GPU, one for CPU. You can actually use Default group for your CPU, finish the work, set the CPU slider to 7 and untick GPU. Then on the left hand side click on Add, set the CPU slider to zero, tick the GPU, name the resource group whatever you want. Click save.
Now you will have two groups each controlling their own device. One controls CPU only, another GPU only.
So of you want to just fold on GPU, you pause or finish work on CPU and continue folding with GPU, and other way round if you just wan to fold on the CPU.
It is not recommended to keep unticking and ticking the GPU

[muziqaz]

https://flic.kr/p/2qNK8f2

Here is my set up on one of my computers

[arisu]

I don't usually tick and untick the GPU. I just did that to test it.

Is running a CPU and GPU on the same resource group not recommended? Is that why the client tries to download a CPU WU for one single core when it's supposed to be downloading a GPU WU? This seems like a bug, since it causes an accumulation of paused CPU WUs.

I guess if I use two resource groups, then I can also get the CPU WU to use all 8 cores instead of 7. The GPU WU only takes up about 20% of a single core (it's an iGPU so I suppose that is why it's not maxing out its CPU core because it's not very hard for it to keep the iGPU fed). Or would that not be recommended?

[muziqaz]

If CPU has designated 7 cores for work, the spare core will never get a new work unit.
And you cannot use all 8 cores for your CPU resource group, since GPU uses one core for its own calculations, so leave it at 7, even with its own resource group.
Ticking or unticking the GPU while things are being folded is very not recommended, big or no bug
If you wish to fiddle with your devices or resource groups best is to finish your work and then start changing things

If you only fold on iGPU, it is best to just untick it and leave CPU folding with its 8 cores, since iGPUs are not meant for compute tasks and rarely get any work

[arisu]

This iGPU (AMD 780M) actually does pretty well on this device and approximately doubles the PPD. CPU-only, I get around 220k PPD. When I enable both, the CPU PPD goes down to around 200k (I assume it has to do with the fact that they both share the same memory) and the iGPU adds an additional 200k.

Is it true that prime numbers of cores is bad for performance, since I have 7 in use? I've heard that around but I can't imagine how that could possibly be.

[muziqaz]

Ah, 780m is acceptable then.
FAH no longer cares about prime number of cores. It craps out with 96+ cores, but that's about it.
Set it to 7 and it will be fine.

[arisu]

Why did prime numbers ever matter? That's such a strange-sounding constraint.

In creating new resource group, I accidentally started it thinking it would just wait until the default resource group's CPU WU finished, but instead it started downloading and running a second CPU WU. Should I dump the WU so it can go to someone else, or just let it sit there for a few hours until it can run (or let it run at the same time at reduced speed)?