140.163.4.241 & 52.224.109.74 not accepting finished units.

[cbigfoot]

Code: Select all

22:29:07:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
22:29:07:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
22:29:07:WU01:FS00:Connecting to 140.163.4.241:8080
22:29:34:WU01:FS00:Upload 1.28%
22:29:40:WU01:FS00:Upload 34.12%
22:29:46:WU01:FS00:Upload 73.36%
22:29:49:WU01:FS00:Upload complete
22:29:49:WU01:FS00:Server responded PLEASE_WAIT (464)
22:29:49:WARNING:WU01:FS00:Failed to send results, will try again later
22:29:50:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
22:29:50:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
22:29:50:WU01:FS00:Connecting to 140.163.4.241:8080
22:29:56:WU01:FS00:Upload 35.82%
22:30:02:WU01:FS00:Upload 77.19%
22:30:05:WU01:FS00:Upload complete
22:30:05:WU01:FS00:Server responded PLEASE_WAIT (464)
22:30:05:WARNING:WU01:FS00:Failed to send results, will try again later
22:30:50:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
22:30:50:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
22:30:50:WU01:FS00:Connecting to 140.163.4.241:8080
22:31:30:WU01:FS00:Upload 1.28%
22:31:36:WU01:FS00:Upload 38.81%
22:31:42:WU01:FS00:Upload 74.63%
22:31:45:WU01:FS00:Upload complete
22:31:45:WU01:FS00:Server responded PLEASE_WAIT (464)
22:31:45:WARNING:WU01:FS00:Failed to send results, will try again later
22:32:27:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
22:32:27:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
22:32:27:WU01:FS00:Connecting to 140.163.4.241:8080
22:33:43:WU01:FS00:Upload 1.28%
22:33:49:WU01:FS00:Upload 39.66%
22:33:55:WU01:FS00:Upload 64.40%
22:34:00:WU01:FS00:Upload complete
22:34:00:WU01:FS00:Server responded PLEASE_WAIT (464)
22:34:00:WARNING:WU01:FS00:Failed to send results, will try again later
22:35:04:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
22:35:04:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
22:35:04:WU01:FS00:Connecting to 140.163.4.241:8080
22:35:10:WU01:FS00:Upload 4.69%
22:35:16:WU01:FS00:Upload 45.63%
22:35:22:WU01:FS00:Upload 87.86%
22:35:23:WU01:FS00:Upload complete
22:35:23:WU01:FS00:Server responded PLEASE_WAIT (464)
22:35:23:WARNING:WU01:FS00:Failed to send results, will try again later
22:39:18:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
22:39:18:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
22:39:18:WU01:FS00:Connecting to 140.163.4.241:8080
22:39:34:WU01:FS00:Upload 1.28%
22:39:40:WU01:FS00:Upload 32.84%
22:39:46:WU01:FS00:Upload 73.36%
22:39:50:WU01:FS00:Upload complete
22:39:50:WU01:FS00:Server responded PLEASE_WAIT (464)
22:39:50:WARNING:WU01:FS00:Failed to send results, will try again later
22:46:10:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
22:46:10:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
22:46:10:WU01:FS00:Connecting to 140.163.4.241:8080
22:47:05:WU01:FS00:Upload 1.28%
22:47:11:WU01:FS00:Upload 40.52%
22:47:17:WU01:FS00:Upload 82.31%
22:47:19:WU01:FS00:Upload complete
22:47:19:WU01:FS00:Server responded PLEASE_WAIT (464)
22:47:19:WARNING:WU01:FS00:Failed to send results, will try again later
22:57:15:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
22:57:15:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
22:57:15:WU01:FS00:Connecting to 140.163.4.241:8080
22:58:23:WU01:FS00:Upload 1.28%
22:58:29:WU01:FS00:Upload 35.82%
22:58:35:WU01:FS00:Upload 77.19%
22:58:38:WU01:FS00:Upload complete
22:58:38:WU01:FS00:Server responded PLEASE_WAIT (464)
22:58:38:WARNING:WU01:FS00:Failed to send results, will try again later
23:15:12:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
23:15:12:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
23:15:12:WU01:FS00:Connecting to 140.163.4.241:8080
23:15:18:WU01:FS00:Upload 28.57%
23:15:24:WU01:FS00:Upload 70.37%
23:15:28:WU01:FS00:Upload complete
23:15:28:WU01:FS00:Server responded PLEASE_WAIT (464)
23:15:28:WARNING:WU01:FS00:Failed to send results, will try again later
23:44:14:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
23:44:14:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
23:44:14:WU01:FS00:Connecting to 140.163.4.241:8080
23:44:38:WU01:FS00:Upload 1.28%
23:44:44:WU01:FS00:Upload 38.81%
23:44:50:WU01:FS00:Upload 64.83%
23:44:55:WU01:FS00:Upload complete
23:44:55:WU01:FS00:Server responded PLEASE_WAIT (464)
23:44:55:WARNING:WU01:FS00:Failed to send results, will try again later
00:31:13:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
00:31:13:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
00:31:13:WU01:FS00:Connecting to 140.163.4.241:8080
00:32:18:WU01:FS00:Upload 1.28%
00:32:24:WU01:FS00:Upload 20.04%
00:32:30:WU01:FS00:Upload 43.07%
00:32:36:WU01:FS00:Upload 66.11%
00:32:42:WU01:FS00:Upload 84.87%
00:32:46:WU01:FS00:Upload complete
00:32:46:WU01:FS00:Server responded PLEASE_WAIT (464)
00:32:46:WARNING:WU01:FS00:Failed to send results, will try again later
00:55:35:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
00:55:35:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
00:55:35:WU01:FS00:Connecting to 140.163.4.241:8080
00:55:41:WU01:FS00:Upload 26.02%
00:55:47:WU01:FS00:Upload 58.00%
00:55:53:WU01:FS00:Upload 93.40%
00:55:54:WU01:FS00:Upload complete
00:55:54:WU01:FS00:Server responded PLEASE_WAIT (464)
00:55:54:WARNING:WU01:FS00:Failed to send results, will try again later
00:57:12:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
00:57:12:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
00:57:12:WU01:FS00:Connecting to 140.163.4.241:8080
00:57:57:WU01:FS00:Upload 0.85%
00:58:28:WU01:FS00:Upload 1.28%
00:58:34:WU01:FS00:Upload 39.24%
00:58:40:WU01:FS00:Upload 81.46%
00:58:42:WU01:FS00:Upload complete
00:58:42:WU01:FS00:Server responded PLEASE_WAIT (464)
00:58:42:WARNING:WU01:FS00:Failed to send results, will try again later
00:59:49:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
00:59:49:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
00:59:49:WU01:FS00:Connecting to 140.163.4.241:8080
00:59:55:WU01:FS00:Upload 3.84%
01:00:01:WU01:FS00:Upload 43.07%
01:00:07:WU01:FS00:Upload 82.74%
01:00:09:WU01:FS00:Upload complete
01:00:09:WU01:FS00:Server responded PLEASE_WAIT (464)
01:00:09:WARNING:WU01:FS00:Failed to send results, will try again later
01:04:03:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:8259 gen:87 core:0x22 unit:0x000000778ca304f15e6bc3978784ac1f
01:04:03:WU01:FS00:Uploading 14.65MiB to 140.163.4.241
01:04:03:WU01:FS00:Connecting to 140.163.4.241:8080
01:04:28:WU01:FS00:Upload 1.28%
01:04:34:WU01:FS00:Upload 17.91%
01:04:40:WU01:FS00:Upload 34.55%
01:04:46:WU01:FS00:Upload 56.72%
01:04:52:WU01:FS00:Upload 75.91%
01:04:58:WU01:FS00:Upload 98.52%
01:04:58:WU01:FS00:Upload complete
01:04:58:WU01:FS00:Server responded PLEASE_WAIT (464)
01:04:58:WARNING:WU01:FS00:Failed to send results, will try again later

it had tried 14 times in the last few hours but keeps getting errors this is the 2nd WU that i have had do this. in as many days.

[PantherX]

Welcome to the F@H Forum cbigfoot,

Please note that the F@H Team is aware of that. The servers in that lab are getting some TLC so in the meantime, just leave your client as is. It will automatically retry and hopefully, it will be uploaded before the Expiration date

[cbigfoot]

Welcome to the F@H Forum cbigfoot,

Please note that the F@H Team is aware of that. The servers in that lab are getting some TLC so in the meantime, just leave your client as is. It will automatically retry and hopefully, it will be uploaded before the Expiration date

thanks it just went a few mins ago.

[EmrldPhoenix]

I'm having the same problem with the same two servers. Any updates the servers?

EDIT: Issue resolved. WU managed to be uploaded.
I restarted the client so that the next send attempt would be sooner, and that particular attempt was successful.

[kwthom]

Issue, yet server stats page shows server still up...and not full:

Code: Select all

21:17:10:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11745 run:0 clone:1874 gen:65 core:0x22 unit:0x000000618ca304f15e67ef8cac6849e4
21:17:10:WU01:FS01:Uploading 14.65MiB to 140.163.4.241
21:17:10:WU01:FS01:Connecting to 140.163.4.241:8080
21:17:18:WU01:FS01:Upload 0.85%
21:18:17:WU01:FS01:Upload 1.28%
21:18:23:WU01:FS01:Upload 24.31%
21:18:29:WU01:FS01:Upload 49.90%
21:18:35:WU01:FS01:Upload 73.79%
21:18:41:WU01:FS01:Upload 99.81%
21:18:41:WU01:FS01:Upload complete
21:18:41:WU01:FS01:Server responded PLEASE_WAIT (464)
21:18:41:WARNING:WU01:FS01:Failed to send results, will try again later

[schapman1978]

It's doing it again - 0026 UTC - I'm stuck in a upload complete / server responding PLEASE WAIT loop

140.163.4.241

Might need someone to bump the rack real quick on your end! =- )

[schapman1978]

Jeez. 11 attempts later and it's going to try again in 2 hours... Do they assign the value at the time of unit completion or when they are able to receive them on their end?

Code: Select all

03:42:04:WU02:FS01:Uploading 21.92MiB to 140.163.4.241
03:42:04:WU02:FS01:Connecting to 140.163.4.241:8080
03:42:12:WU02:FS01:Upload 0.57%
03:42:49:WU04:FS01:0x22:Completed 670000 out of 1000000 steps (67%)
03:43:06:WU02:FS01:Upload 0.86%
03:43:12:WU02:FS01:Upload 29.36%
03:43:18:WU02:FS01:Upload 66.14%
03:43:24:WU02:FS01:Upload 97.21%
03:43:24:WU02:FS01:Upload complete
03:43:24:WU02:FS01:Server responded PLEASE_WAIT (464)

[JohnChodera]

@scapman1978: Apologies for this---this is a six-year-old server under heavy load! I've restarted the WS for 140.163.4.241 as an alternative to 'bumping the rack'. Hope your WU gets in soon!

We're still working on WS updates to reduce the PLEASE_WAITs under heavy load---thanks for bearing with us!

~ John Chodera // MSKCC

[ursmii]

I've the same problem with the same server and the credits do counting down and the delay increases
if a transfer is completed store it and credit later but don't punish us for heavy load

Code: Select all

18:29:44:WU02:FS02:Uploading 12.58MiB to 140.163.4.241
18:29:44:WU02:FS02:Connecting to 140.163.4.241:8080
18:29:50:WU02:FS02:Upload 20.87%
18:29:56:WU02:FS02:Upload 45.72%
18:30:02:WU02:FS02:Upload 67.10%
18:30:08:WU02:FS02:Upload 96.92%
18:30:08:WU02:FS02:Upload complete
18:30:09:WU02:FS02:Server responded PLEASE_WAIT (464)
18:30:09:WARNING:WU02:FS02:Failed to send results, will try again later

edit: upload completed after 17th attemp and lost of about 40'000 credits

[philtodd]

Afternoon from the UK.

Looks like the WS has choked. Upload failures again. Been stalled since 10-47Z.

Server response is:- PLEASE_WAIT (464)

Does it need a poke with a pointy stick? Maybe more coal on the fire or more cheese for the mice in the wheel?

[JohnChodera]

Pointy stick deployed! Hopefully that will help get the WUs in.

~ John Chodera // MSKCC

[philtodd]

Cheers!

Your stick work was successful.

Phil