Status: Send Progress: 100% ETA: Unknown

[rok65612]

Hello all, hope I am posting in the right place: I've been getting this issue HEAPS lately but can't seem to find other posts of people with the same issue.

The Work Units are completed, but then when the client application tries to send the completed data, it just gets stuck in the queue at "Status: Send | Progress: 100% | ETA: Unknown". If I leave my PC on all day and night it sometimes/eventually clears some of the completed Work Units from the queue, but not after trying to send the data multiple times (more than 10 send attempts on the 3 current WU's that have been sitting in the queue all day and now the application waits an hour to try sending again after each failure).

Meanwhile, all the "bonus credit" for completing all the Work Units early is just wasting away. I try extra hard to let all Work Units finish without pausing or stopping before they are 100%, so they're always early, but now it seems like that is a huge waste of time and electricity if the servers don't even accept the finished data early.

I've tried rebooting my PC, rebooting my router, nothing clears these queues for many hours.
Please help if you can.

[rok65612]

The specific projects that are not responding to send requests are:

17435 Work Server: 206.223.170.146 Collection Server: 128.252.203.10

16951 WS: 129.32.209.203 CS:129.32.209.202

18202 WS: 128.252.203.11 CS: 128.252.203.10

[debs3759]

In some cases, the wu is uploaded, but the server is not responding. In those cases, you get the points for the first upload, but fahcontrol does not know. I notice it most for project 18202.

[rok65612]

Thanks for the reply! I'll keep watching the status.
Perhaps my forum searching skills aren't up to scratch but I find it weird that there don't seem to be many other people experiencing the same issue. So I thought it might be a problem specific to my rig/connection/client.

[zarluk1]

Code: Select all

06:00:03:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:11044 clone:1 gen:8 core:0x22 unit:0x00000001000000080000471a00002b24
06:00:03:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
06:00:03:WU01:FS01:Connecting to 128.252.203.11:8080
06:00:10:WU01:FS01:Upload 0.23%
06:00:36:WU01:FS01:Upload 0.45%
06:00:58:WU00:FS01:0x22:Completed 4950000 out of 5000000 steps (99%)
06:00:59:WU02:FS01:Connecting to assign1.foldingathome.org:80
06:01:00:WU02:FS01:Assigned to work server 54.157.202.86
06:01:00:WU02:FS01:Requesting new work unit for slot 01: gpu:1:0 GP106 [GeForce GTX 1060 6GB] 4372 from 54.157.202.86
06:01:00:WU02:FS01:Connecting to 54.157.202.86:8080
06:01:00:ERROR:WU02:FS01:Exception: Server did not assign work unit
06:01:01:WU01:FS01:Upload 0.68%
06:01:01:WU02:FS01:Connecting to assign1.foldingathome.org:80
06:01:01:WU02:FS01:Assigned to work server 54.157.202.86
06:01:01:WU02:FS01:Requesting new work unit for slot 01: gpu:1:0 GP106 [GeForce GTX 1060 6GB] 4372 from 54.157.202.86
06:01:01:WU02:FS01:Connecting to 54.157.202.86:8080
06:01:02:ERROR:WU02:FS01:Exception: Server did not assign work unit
06:01:07:WU01:FS01:Upload 10.23%
06:01:13:WU01:FS01:Upload 19.77%
06:01:19:WU01:FS01:Upload 29.09%
06:01:25:WU01:FS01:Upload 38.41%
06:01:31:WU01:FS01:Upload 47.95%
06:01:37:WU01:FS01:Upload 57.27%
06:01:43:WU01:FS01:Upload 66.59%
06:01:49:WU01:FS01:Upload 75.91%
06:01:55:WU01:FS01:Upload 85.45%
06:02:01:WU01:FS01:Upload 94.77%
06:02:01:WU02:FS01:Connecting to assign1.foldingathome.org:80
06:02:01:WU02:FS01:Assigned to work server 128.252.203.11
06:02:01:WU02:FS01:Requesting new work unit for slot 01: gpu:1:0 GP106 [GeForce GTX 1060 6GB] 4372 from 128.252.203.11
06:02:01:WU02:FS01:Connecting to 128.252.203.11:8080
06:02:04:WU01:FS01:Upload complete
06:02:04:WU01:FS01:Server responded PLEASE_WAIT (464)
06:02:04:WARNING:WU01:FS01:Failed to send results, will try again later

[niko_sguva]

Hi there,

FYI, I am also getting a problem with the same server. I hope it is temporary. Here is the log:

Code: Select all

08:43:01:WU00:FS00:Uploading 27.50MiB to 128.252.203.10
08:43:01:WU00:FS00:Connecting to 128.252.203.10:8080
08:43:14:WU01:FS00:0x22:Completed 925000 out of 1250000 steps (74%)
08:43:15:WU01:FS00:0x22:Checkpoint completed at step 925000
08:43:16:WU00:FS00:Upload 1.14%
08:43:22:WU00:FS00:Upload 8.41%
08:43:28:WU00:FS00:Upload 16.59%
08:43:34:WU00:FS00:Upload 23.63%
08:43:40:WU00:FS00:Upload 30.45%
08:43:46:WU00:FS00:Upload 37.04%
08:43:52:WU00:FS00:Upload 45.22%
08:43:58:WU00:FS00:Upload 51.81%
08:44:04:WU00:FS00:Upload 60.45%
08:44:10:WU00:FS00:Upload 67.49%
08:44:16:WU00:FS00:Upload 75.68%
08:44:22:WU00:FS00:Upload 82.95%
08:44:28:WU00:FS00:Upload 89.99%
08:44:34:WU00:FS00:Upload 98.17%
08:44:36:WU00:FS00:Upload complete
08:44:36:WU00:FS00:Server responded PLEASE_WAIT (464)
ESC[93m08:44:36:WARNING:WU00:FS00:Failed to send results, will try again laterESC[0m

[rok65612]

Thanks for sharing.

The same three servers still are not receiving/acknowledging my sends, so it's over 48 hours that these servers have been doing this.

Is there some way to reach out to the administrators of those servers?

[gunnarre]

On this forum: viewforum.php?f=18

And on the discord: http://discord.gg/foldingathome

However, some of the people have been out of office. While work doesn't shut down during summer vacations, it might take longer to get the attention of admins and/or scientists.

[rok65612]

Thanks for the reply. I've posted on there now.