Most of my devices now: No work Failed Warning

[AvsEnFuego]

The majority of my devices are now just repeating this. I tried to check the server stats page, but there seems to be a certificate issue with it.

I tried changing my account's cause from "diabetes" to "any" thinking maybe if there's bad servers they're associated with diabetes, but expanding my causes doesn't fix it.

Of the devices with the status of "No Work Failed Warning", they seem to just be repeating this in the logs.

17:55:17:I1:WU30:Retry #1 in 2 secs
17:55:19:I1:WU30:Requesting WU assignment for user
17:55:19:I1:OUT174:> POST https://assign5.foldingathome.org/api/assign HTTP/1.1
17:55:20:I1:OUT174:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
17:55:20:E :OUT174:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"DB ERROR: IO error: log-v2.leveldb/068411.log: No space left on device"}}

[Joe_H]

There are several recent posts about not getting work, you have not supplied enough information to determine the cause for you. There is a low amount of available WUs for GPUs, especially higher end ones. CPU WUs will generally only assign to CPU thread settings of 3 or higher.

As for the Server Status page, I have not had any difficulty accessing it today.

If you could post the beginning section, first couple hundred lines, of your log from after a restart, that would be helpful. Additional log entries from the beginning of a WU request also would help.

[malkie]

I'm seeing that too, along with OUT117:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}.

In addition (I'll update the thread I started a couple of days ago) I'm finding that since assigning 3 of my 8 Ryzen 3400 cores to FAH, there is a noticeable slowdown on almost everything I do.

[AvsEnFuego]

After a reboot:

Code: Select all

18:41:20:I1: License: GPL-3.0-or-later
18:41:20:I1: URL: https://v8-4.foldingathome.org/
18:41:20:I1: Date: Nov 20 2024
18:41:20:I1: Time: 14:47:46
18:41:20:I1: Revision: 360fe71b1bd05bb89814bfb97b73a5bda84802d6
18:41:20:I1: Branch: master
18:41:20:I1: Compiler: Visual C++
18:41:20:I1: Options: $( /TP $) /std:c++14 /nologo /EHa /wd4297 /wd4103 /O2
18:41:20:I1: /Zc:throwingNew /MT
18:41:20:I1: Platform: win32 10
18:41:20:I1: Bits: 64
18:41:20:I1: Mode: Release
18:41:20:I1: Args: --open-web-control
18:41:20:I1:****************************** CBang ******************************
18:41:20:I1: Version: 1.7.2
18:41:20:I1: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
18:41:20:I1: Org: Cauldron Development
18:41:20:I1: Copyright: Cauldron Development, 2003-2024
18:41:20:I1: Homepage: https://cauldrondevelopment.com/
18:41:20:I1: License: LGPL-2.1-or-later
18:41:20:I1: Date: Nov 20 2024
18:41:20:I1: Time: 09:04:40
18:41:20:I1: Revision: 443c54e909eb8d8994405a18fb328b5b05a623a5
18:41:20:I1: Branch: master
18:41:20:I1: Compiler: Visual C++
18:41:20:I1: Options: $( /TP $) /std:c++14 /nologo /EHa /wd4297 /wd4103 /O2
18:41:20:I1: /Zc:throwingNew /MT
18:41:20:I1: Platform: win32 10
18:41:20:I1: Bits: 64
18:41:20:I1: Mode: Release
18:41:20:I1:***************************** System ******************************
18:41:20:I1: CPU: Intel(R) Core(TM) i7-6700T CPU @ 2.80GHz
18:41:20:I1: CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
18:41:20:I1: CPUs: 8
18:41:20:I1: Memory: 7.90GiB
18:41:20:I1:Free Memory: 5.36GiB
18:41:20:I1: OS Version: 6.2
18:41:20:I1:Has Battery: false
18:41:20:I1: On Battery: false
18:41:20:I1: Hostname: Folding
18:41:20:I1: UTC Offset: -6
18:41:20:I1: PID: 7316
18:41:20:I1: CWD: C:\Users\Tony\Desktop
18:41:20:I1: Exec: C:\Program Files\FAHClient\FAHClient.exe
18:41:20:I1:*******************************************************************
18:41:20:I2:<config/>
18:41:20:I1:Opening Database
18:41:20:I1:F@H ID = g52-UXjtnvC_ZMUXCbpVYtr7zahDqRJ17MQm0K_S8CQ
18:41:20:I3:Loading default resource group
18:41:20:I1:Listening for HTTP on 127.0.0.1:7396
18:41:20:I3:Loaded 0 wus.
18:41:20:I1:Started Windows systray control
18:41:21:I3:gpus = {
18:41:21:I3: "gpu:00:02:00": {
18:41:21:I3: "vendor": 32902,
18:41:21:I3: "type": "intel",
18:41:21:I3: "description": "Intel(R) HD Graphics 530",
18:41:21:I3: "opencl": {"platform": 0, "device": 0, "compute": "3.0", "driver": "31.0"},
18:41:21:I3: "device": 6418,
18:41:21:I3: "supported": true
18:41:21:I3: }
18:41:21:I3:}
18:41:21:I1:OUT1:> GET https://api.foldingathome.org/machine/g52-UXjtnvC_ZMUXCbpVYtr7zahDqRJ17MQm0K_S8CQ HTTP/1.1
18:41:21:I1:OUT2:> GET https://api.foldingathome.org/gpus HTTP/1.1
18:41:21:I1:OUT1:< HTTP/1.1 200 HTTP_OK
18:41:22:I1:OUT3:> GET wss://node1.foldingathome.org/ws/client HTTP/1.1
18:41:22:I1:OUT3:< HTTP/1.1 101 HTTP_SWITCHING_PROTOCOLS
18:41:22:I1:Logging into node account
18:41:22:I1:OUT2:< HTTP/1.1 200 HTTP_OK
18:41:28:I1:Machine state fold
18:41:28:I1:Default:Added new work unit: cpus:3 gpus:
18:41:28:I1:WU821:Requesting WU assignment for user AvsEnFuego team 251626
18:41:28:I1:OUT6:> POST https://assign1.foldingathome.org/api/assign HTTP/1.1
18:41:28:I1:OUT6:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
18:41:28:E :OUT6:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"DB ERROR: IO error: log-v2.leveldb/068411.log: No space left on device"}}
18:41:30:I1:Default:Added new work unit: cpus:3 gpus:
18:41:30:I1:WU822:Requesting WU assignment for user AvsEnFuego team 251626
18:41:30:I1:OUT7:> POST https://assign2.foldingathome.org/api/assign HTTP/1.1
18:41:31:I1:OUT7:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
18:41:31:E :OUT7:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
18:41:31:I1:WU822:Retry #1 in 2 secs
18:41:33:I1:WU822:Requesting WU assignment for user AvsEnFuego team 251626
18:41:33:I1:OUT8:> POST https://assign3.foldingathome.org/api/assign HTTP/1.1
18:41:33:I1:OUT8:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
18:41:33:E :OUT8:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"DB ERROR: IO error: log-v2.leveldb/068411.log: No space left on device"}}
18:41:37:I1:Default:Added new work unit: cpus:3 gpus:
18:41:37:I1:WU823:Requesting WU assignment for user AvsEnFuego team 251626
18:41:37:I1:OUT9:> POST https://assign4.foldingathome.org/api/assign HTTP/1.1
18:41:37:I1:OUT9:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
18:41:37:E :OUT9:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
18:41:37:I1:WU823:Retry #1 in 2 secs
18:41:39:I1:WU823:Requesting WU assignment for user AvsEnFuego team 251626
18:41:39:I1:OUT10:> POST https://assign5.foldingathome.org/api/assign HTTP/1.1
18:41:40:I1:OUT10:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
18:41:40:E :OUT10:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"DB ERROR: IO error: log-v2.leveldb/068411.log: No space left on device"}}
18:41:48:I1:Default:Added new work unit: cpus:3 gpus:
18:41:48:I1:WU824:Requesting WU assignment for user AvsEnFuego team 251626
18:41:48:I1:OUT11:> POST https://assign6.foldingathome.org/api/assign HTTP/1.1
18:41:48:I1:OUT11:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
18:41:48:E :OUT11:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
18:41:48:I1:WU824:Retry #1 in 2 secs
18:41:50:I1:WU824:Requesting WU assignment for user AvsEnFuego team 251626
18:41:50:I1:OUT12:> POST https://assign1.foldingathome.org/api/assign HTTP/1.1
18:41:51:I1:OUT12:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
18:41:51:E :OUT12:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"DB ERROR: IO error: log-v2.leveldb/068411.log: No space left on device"}}
18:42:07:I1:Default:Added new work unit: cpus:3 gpus:
18:42:07:I1:WU825:Requesting WU assignment for user AvsEnFuego team 251626
18:42:07:I1:OUT13:> POST https://assign2.foldingathome.org/api/assign HTTP/1.1
18:42:07:I1:OUT13:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
18:42:07:E :OUT13:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
18:42:07:I1:WU825:Retry #1 in 2 secs
18:42:09:I1:WU825:Requesting WU assignment for user AvsEnFuego team 251626
18:42:09:I1:OUT14:> POST https://assign3.foldingathome.org/api/assign HTTP/1.1
18:42:09:I1:OUT14:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
18:42:09:E :OUT14:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"DB ERROR: IO error: log-v2.leveldb/068411.log: No space left on device"}}
18:59:42:I1:Machine state fold
18:59:42:I1:Default:Added new work unit: cpus:3 gpus:
18:59:42:I1:WU826:Requesting WU assignment for user AvsEnFuego team 251626
18:59:42:I1:OUT15:> POST https://assign4.foldingathome.org/api/assign HTTP/1.1
18:59:43:I1:OUT15:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
18:59:43:E :OUT15:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
18:59:43:I1:WU826:Retry #1 in 2 secs
18:59:45:I1:WU826:Requesting WU assignment for user AvsEnFuego team 251626
18:59:45:I1:OUT16:> POST https://assign5.foldingathome.org/api/assign HTTP/1.1
18:59:45:I1:OUT16:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
18:59:45:E :OUT16:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"DB ERROR: IO error: log-v2.leveldb/068411.log: No space left on device"}}
18:59:47:I1:Default:Added new work unit: cpus:3 gpus:
18:59:47:I1:WU827:Requesting WU assignment for user AvsEnFuego team 251626
18:59:47:I1:OUT17:> POST https://assign6.foldingathome.org/api/assign HTTP/1.1
18:59:47:I1:OUT17:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
18:59:47:E :OUT17:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
18:59:47:I1:WU827:Retry #1 in 2 secs
18:59:49:I1:WU827:Requesting WU assignment for user AvsEnFuego team 251626
18:59:49:I1:OUT18:> POST https://assign1.foldingathome.org/api/assign HTTP/1.1
18:59:50:I1:OUT18:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
18:59:50:E :OUT18:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"DB ERROR: IO error: log-v2.leveldb/068411.log: No space left on device"}}
18:59:54:I1:Default:Added new work unit: cpus:3 gpus:
18:59:54:I1:WU828:Requesting WU assignment for user AvsEnFuego team 251626
18:59:54:I1:OUT19:> POST https://assign2.foldingathome.org/api/assign HTTP/1.1
18:59:54:I1:OUT19:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
18:59:54:E :OUT19:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
18:59:54:I1:WU828:Retry #1 in 2 secs
18:59:56:I1:WU828:Requesting WU assignment for user AvsEnFuego team 251626
18:59:56:I1:OUT20:> POST https://assign3.foldingathome.org/api/assign HTTP/1.1
18:59:56:I1:OUT20:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
18:59:56:E :OUT20:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"DB ERROR: IO error: log-v2.leveldb/068411.log: No space left on device"}}
19:00:04:I1:Default:Added new work unit: cpus:3 gpus:
19:00:04:I1:WU829:Requesting WU assignment for user AvsEnFuego team 251626
19:00:05:I1:OUT21:> POST https://assign4.foldingathome.org/api/assign HTTP/1.1
19:00:05:I1:OUT21:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
19:00:05:E :OUT21:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
19:00:05:I1:WU829:Retry #1 in 2 secs
19:00:07:I1:WU829:Requesting WU assignment for user AvsEnFuego team 251626
19:00:07:I1:OUT22:> POST https://assign5.foldingathome.org/api/assign HTTP/1.1
19:00:07:I1:OUT22:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
19:00:07:E :OUT22:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"DB ERROR: IO error: log-v2.leveldb/068411.log: No space left on device"}}
19:00:23:I1:Default:Added new work unit: cpus:3 gpus:
19:00:23:I1:WU830:Requesting WU assignment for user AvsEnFuego team 251626
19:00:23:I1:OUT23:> POST https://assign6.foldingathome.org/api/assign HTTP/1.1
19:00:24:I1:OUT23:< HTTP/1.1 503 HTTP_SERVICE_UNAVAILABLE
19:00:24:E :OUT23:HTTP_SERVICE_UNAVAILABLE: {"error":"No appropriate assignment"}
19:00:24:I1:WU830:Retry #1 in 2 secs
19:00:26:I1:WU830:Requesting WU assignment for user AvsEnFuego team 251626
19:00:26:I1:OUT24:> POST https://assign1.foldingathome.org/api/assign HTTP/1.1
19:00:26:I1:OUT24:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
19:00:26:E :OUT24:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"DB ERROR: IO error: log-v2.leveldb/068411.log: No space left on device"}}

[AvsEnFuego]

I should mention that all of my failing devices are not using GPU, are at 3 CPUs, and all previously working. One is a Mac, and the rest are Windows.

[Joe_H]

Okay, your messages and some another person posted appear to point to one of the assignment servers running out of space. I have notified the person who manages them.

[arisu]

There appear to be two separate issues. They may or may not be related. The first is an assignment server running out of space. The second is CPU WUs failing to be assigned.