Collection Server: 0.0.0.0
I have about 70 Work Units accumulated over the last day or so which try to upload results to 128.252.203.2, but which fail at any random percentage amount. Included are samples of the logs.
Folding Machine F5
Code: Select all
23:59:03:WU28:FS00:0x22:Completed 200000 out of 500000 steps (40%)
00:00:02:WU26:FS01:0x22:Completed 780000 out of 2000000 steps (39%)
00:00:15:WU18:FS00:Sending unit results: id:18 state:SEND error:NO_ERROR project:14563 run:0 clone:1293 gen:0 core:0x22 unit:0x0000000080fccb025e9615b6fa2851ff
00:00:15:WU18:FS00:Uploading 68.10MiB to 128.252.203.2
00:00:15:WU18:FS00:Connecting to 128.252.203.2:8080
00:00:29:WU27:FS05:0x22:Completed 680000 out of 2000000 steps (34%)
00:00:46:WU23:FS00:Upload 1.50%
00:00:47:WU18:FS00:Upload 0.09%
00:00:50:WU21:FS02:0x22:Completed 240000 out of 2000000 steps (12%)
00:00:52:WU23:FS00:Upload 7.98%
00:00:58:WU23:FS00:Upload 14.08%
00:01:04:WU23:FS00:Upload 20.27%
00:01:08:WU28:FS00:0x22:Completed 205000 out of 500000 steps (41%)
00:01:10:WU23:FS00:Upload 26.47%
00:01:16:WU23:FS00:Upload 32.94%
00:01:22:WU23:FS00:Upload 38.95%
00:01:22:WU20:FS04:0x22:Completed 340000 out of 2000000 steps (17%)
00:01:28:WU23:FS00:Upload 45.71%
00:01:34:WU23:FS00:Upload 51.53%
00:01:39:WU10:FS01:Upload 1.10%
00:01:40:WU23:FS00:Upload 57.25%
00:01:42:WU12:FS00:Upload 1.41%
00:01:46:WU23:FS00:Upload 61.10%
00:01:46:WU10:FS01:Upload 2.29%
00:01:48:WU12:FS00:Upload 3.19%
00:01:52:WU23:FS00:Upload 64.48%
00:01:52:WU10:FS01:Upload 3.86%
00:01:54:WU12:FS00:Upload 4.60%
00:01:58:WU10:FS01:Upload 5.69%
00:01:58:WU23:FS00:Upload 67.30%
00:02:01:WU12:FS00:Upload 6.48%
00:02:04:WU23:FS00:Upload 69.17%
00:02:04:WU10:FS01:Upload 7.99%
00:02:07:WU12:FS00:Upload 8.73%
00:02:10:WU10:FS01:Upload 10.19%
00:02:10:WU23:FS00:Upload 71.05%
00:02:13:WU12:FS00:Upload 11.54%
00:02:16:WU10:FS01:Upload 12.02%
00:02:16:WU23:FS00:Upload 72.83%
00:02:19:WU12:FS00:Upload 13.80%
00:02:22:WU23:FS00:Upload 75.18%
00:02:22:WU10:FS01:Upload 14.32%
00:02:30:WU26:FS01:0x22:Completed 800000 out of 2000000 steps (40%)
00:02:35:WU23:FS00:Upload 76.96%
00:02:35:WU12:FS00:Upload 15.67%
00:02:35:WU10:FS01:Upload 15.33%
00:02:36:WU18:FS00:Upload 0.55%
00:02:36:WARNING:WU12:FS00:Exception: Failed to send results to work server: Transfer failed
00:02:36:WARNING:WU23:FS00:Exception: Failed to send results to work server: Transfer failed
00:02:36:WARNING:WU10:FS01:Exception: Failed to send results to work server: Transfer failed
00:02:36:WARNING:WU18:FS00:Exception: Failed to send results to work server: Transfer failed
00:02:56:WU28:FS00:0x22:Completed 210000 out of 500000 steps (42%)
00:03:04:WU27:FS05:0x22:Completed 700000 out of 2000000 steps (35%)
00:03:14:WU21:FS02:0x22:Completed 260000 out of 2000000 steps (13%)
Code: Select all
2020-04-19:00:13:05:WU06:FS02:Sending unit results: id:06 state:SEND error:NO_ERROR project:14561 run:0 clone:911 gen:0 core:0x22 unit:0x0000000080fccb025e9615c04aca7225
2020-04-19:00:13:05:WU06:FS02:Uploading 66.58MiB to 128.252.203.2
2020-04-19:00:13:05:WU06:FS02:Connecting to 128.252.203.2:8080
2020-04-19:00:13:50:WU14:FS03:0x22:Completed 310000 out of 500000 steps (62%)
2020-04-19:00:14:29:WU07:FS05:0x22:Completed 640000 out of 2000000 steps (32%)
2020-04-19:00:15:05:WU24:FS04:0x22:Completed 620000 out of 2000000 steps (31%)
2020-04-19:00:15:12:WU17:FS00:0x22:Completed 480000 out of 2000000 steps (24%)
2020-04-19:00:15:14:WU14:FS03:0x22:Completed 315000 out of 500000 steps (63%)
2020-04-19:00:16:38:WU14:FS03:0x22:Completed 320000 out of 500000 steps (64%)
2020-04-19:00:16:59:WU07:FS05:0x22:Completed 660000 out of 2000000 steps (33%)
2020-04-19:00:17:27:WU24:FS04:0x22:Completed 640000 out of 2000000 steps (32%)
2020-04-19:00:17:34:WU17:FS00:0x22:Completed 500000 out of 2000000 steps (25%)
2020-04-19:00:17:51:WU15:FS04:Upload 0.66%
2020-04-19:00:17:51:WU21:FS03:Upload 0.47%
2020-04-19:00:17:51:WU12:FS01:Upload 0.77%
2020-04-19:00:17:51:WU22:FS01:Upload 0.66%
2020-04-19:00:17:51:WU08:FS04:Upload 0.73%
2020-04-19:00:17:57:WU22:FS01:Upload 2.53%
2020-04-19:00:17:57:WU12:FS01:Upload 1.99%
2020-04-19:00:17:57:WU15:FS04:Upload 1.88%
2020-04-19:00:17:57:WU21:FS03:Upload 1.88%
2020-04-19:00:17:57:WU08:FS04:Upload 1.56%
2020-04-19:00:18:03:WU12:FS01:Upload 3.10%
2020-04-19:00:18:03:WU08:FS04:Upload 2.48%
2020-04-19:00:18:03:WU21:FS03:Upload 3.10%
2020-04-19:00:18:03:WU22:FS01:Upload 4.13%
2020-04-19:00:18:03:WU15:FS04:Upload 3.65%
2020-04-19:00:18:09:WU21:FS03:Upload 4.04%
2020-04-19:00:18:09:WU12:FS01:Upload 5.20%
2020-04-19:00:18:09:WU15:FS04:Upload 5.20%
2020-04-19:00:18:09:WU22:FS01:Upload 5.07%
2020-04-19:00:18:10:WU08:FS04:Upload 3.95%
2020-04-19:00:18:14:WU14:FS03:0x22:Completed 325000 out of 500000 steps (65%)
2020-04-19:00:18:15:WU22:FS01:Upload 6.38%
2020-04-19:00:18:15:WU21:FS03:Upload 5.35%
2020-04-19:00:18:15:WU15:FS04:Upload 6.53%
2020-04-19:00:18:15:WU12:FS01:Upload 7.08%
2020-04-19:00:18:16:WU08:FS04:Upload 5.23%
2020-04-19:00:18:21:WU12:FS01:Upload 8.52%
2020-04-19:00:18:21:WU15:FS04:Upload 7.86%
2020-04-19:00:18:21:WU22:FS01:Upload 7.79%
2020-04-19:00:18:21:WU21:FS03:Upload 6.57%
2020-04-19:00:18:22:WU08:FS04:Upload 6.42%
2020-04-19:00:18:27:WU15:FS04:Upload 9.08%
2020-04-19:00:18:27:WU12:FS01:Upload 10.52%
2020-04-19:00:18:27:WU21:FS03:Upload 7.70%
2020-04-19:00:18:27:WU22:FS01:Upload 8.92%
2020-04-19:00:18:28:WU08:FS04:Upload 8.08%
2020-04-19:00:18:33:WU12:FS01:Upload 12.40%
2020-04-19:00:18:33:WU22:FS01:Upload 10.23%
2020-04-19:00:18:33:WU15:FS04:Upload 10.52%
2020-04-19:00:18:33:WU21:FS03:Upload 8.54%
2020-04-19:00:18:34:WU08:FS04:Upload 9.18%
2020-04-19:00:18:39:WU15:FS04:Upload 11.84%
2020-04-19:00:18:39:WU22:FS01:Upload 11.92%
2020-04-19:00:18:39:WU12:FS01:Upload 13.73%
2020-04-19:00:18:39:WU21:FS03:Upload 9.48%
2020-04-19:00:18:40:WU08:FS04:Upload 11.01%
2020-04-19:00:18:45:WU15:FS04:Upload 13.17%
2020-04-19:00:18:45:WU21:FS03:Upload 10.70%
2020-04-19:00:18:45:WU12:FS01:Upload 14.83%
2020-04-19:00:18:45:WU22:FS01:Upload 12.95%
2020-04-19:00:18:46:WU08:FS04:Upload 12.57%
2020-04-19:00:18:51:WU12:FS01:Upload 15.83%
2020-04-19:00:18:51:WU15:FS04:Upload 14.50%
2020-04-19:00:18:51:WU21:FS03:Upload 12.01%
2020-04-19:00:18:51:WU22:FS01:Upload 13.61%
2020-04-19:00:18:52:WU08:FS04:Upload 13.86%
2020-04-19:00:18:57:WU22:FS01:Upload 14.36%
2020-04-19:00:18:57:WU15:FS04:Upload 15.50%
2020-04-19:00:18:57:WU21:FS03:Upload 12.86%
2020-04-19:00:18:57:WU12:FS01:Upload 16.83%
2020-04-19:00:18:58:WU08:FS04:Upload 14.59%
2020-04-19:00:19:00:WU06:FS02:Upload 1.22%
2020-04-19:00:19:03:WU21:FS03:Upload 13.80%
2020-04-19:00:19:03:WU15:FS04:Upload 16.71%
2020-04-19:00:19:03:WU12:FS01:Upload 17.93%
2020-04-19:00:19:03:WU22:FS01:Upload 15.30%
2020-04-19:00:19:04:WU08:FS04:Upload 15.33%
2020-04-19:00:19:07:WU06:FS02:Upload 2.72%
2020-04-19:00:19:09:WU15:FS04:Upload 17.60%
2020-04-19:00:19:09:WU22:FS01:Upload 16.24%
2020-04-19:00:19:09:WU21:FS03:Upload 14.83%
2020-04-19:00:19:09:WU12:FS01:Upload 18.93%
2020-04-19:00:19:11:WU08:FS04:Upload 16.25%
2020-04-19:00:19:13:WU06:FS02:Upload 3.75%
2020-04-19:00:19:15:WU15:FS04:Upload 18.49%
2020-04-19:00:19:15:WU22:FS01:Upload 17.08%
2020-04-19:00:19:15:WU21:FS03:Upload 15.67%
2020-04-19:00:19:15:WU12:FS01:Upload 19.81%
2020-04-19:00:19:18:WU08:FS04:Upload 17.07%
2020-04-19:00:19:21:WU22:FS01:Upload 18.30%
2020-04-19:00:19:21:WU06:FS02:Upload 4.88%
2020-04-19:00:19:21:WU12:FS01:Upload 20.59%
2020-04-19:00:19:21:WU15:FS04:Upload 19.37%
2020-04-19:00:19:21:WU21:FS03:Upload 16.99%
2020-04-19:00:19:24:WU08:FS04:Upload 17.81%
2020-04-19:00:19:29:WU07:FS05:0x22:Completed 680000 out of 2000000 steps (34%)
2020-04-19:00:19:36:WU06:FS02:Upload 6.01%
2020-04-19:00:19:36:WU15:FS04:Upload 20.26%
2020-04-19:00:19:36:WARNING:WU06:FS02:Exception: Failed to send results to work server: Transfer failed
2020-04-19:00:19:36:WU22:FS01:Upload 19.62%
2020-04-19:00:19:36:WU08:FS04:Upload 18.17%
2020-04-19:00:19:36:WU21:FS03:Upload 17.64%
2020-04-19:00:19:36:WU12:FS01:Upload 21.36%
2020-04-19:00:19:36:WARNING:WU07:FS05:Detected clock skew (6 mins 31 secs), I/O delay, laptop hibernation or other slowdown noted, adjusting time estimates
2020-04-19:00:19:36:WARNING:WU15:FS04:Exception: Failed to send results to work server: Transfer failed
2020-04-19:00:19:36:WARNING:WU17:FS00:Detected clock skew (6 mins 31 secs), I/O delay, laptop hibernation or other slowdown noted, adjusting time estimates
2020-04-19:00:19:37:WARNING:WU22:FS01:Exception: Failed to send results to work server: Transfer failed
2020-04-19:00:19:37:WARNING:WU08:FS04:Exception: Failed to send results to work server: Transfer failed
2020-04-19:00:19:37:WARNING:WU21:FS03:Exception: Failed to send results to work server: Transfer failed
2020-04-19:00:19:37:WARNING:WU12:FS01:Exception: Failed to send results to work server: Transfer failed
2020-04-19:00:19:38:WARNING:WU24:FS04:Detected clock skew (6 mins 33 secs), I/O delay, laptop hibernation or other slowdown noted, adjusting time estimates
2020-04-19:00:19:38:WARNING:WU14:FS03:Detected clock skew (6 mins 33 secs), I/O delay, laptop hibernation or other slowdown noted, adjusting time estimates
2020-04-19:00:19:39:WU14:FS03:0x22:Completed 330000 out of 500000 steps (66%)
2020-04-19:00:19:49:WU24:FS04:0x22:Completed 660000 out of 2000000 steps (33%)
2020-04-19:00:19:56:WU17:FS00:0x22:Completed 520000 out of 2000000 steps (26%)
2020-04-19:00:21:03:WU14:FS03:0x22:Completed 335000 out of 500000 steps (67%)
2020-04-19:00:21:25:WU04:FS03:Sending unit results: id:04 state:SEND error:NO_ERROR project:14562 run:0 clone:1112 gen:0 core:0x22 unit:0x0000000080fccb025e9615bc2c46d87c
2020-04-19:00:21:25:WU04:FS03:Uploading 56.46MiB to 128.252.203.2
2020-04-19:00:21:25:WU04:FS03:Connecting to 128.252.203.2:8080
2020-04-19:00:21:26:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:14561 run:0 clone:1001 gen:0 core:0x22 unit:0x0000000080fccb025e9615c0ce4724b8
2020-04-19:00:21:26:WU01:FS00:Uploading 66.60MiB to 128.252.203.2
2020-04-19:00:21:26:WU01:FS00:Connecting to 128.252.203.2:8080
2020-04-19:00:21:59:WU07:FS05:0x22:Completed 700000 out of 2000000 steps (35%)
2020-04-19:00:22:11:WU24:FS04:0x22:Completed 680000 out of 2000000 steps (34%)
2020-04-19:00:22:18:WU17:FS00:0x22:Completed 540000 out of 2000000 steps (27%)
2020-04-19:00:22:27:WU14:FS03:0x22:Completed 340000 out of 500000 steps (68%)
2020-04-19:00:24:03:WU14:FS03:0x22:Completed 345000 out of 500000 steps (69%)
2020-04-19:00:24:30:WU07:FS05:0x22:Completed 720000 out of 2000000 steps (36%)
2020-04-19:00:24:33:WU24:FS04:0x22:Completed 700000 out of 2000000 steps (35%)
2020-04-19:00:24:40:WU17:FS00:0x22:Completed 560000 out of 2000000 steps (28%)
2020-04-19:00:25:27:WU14:FS03:0x22:Completed 350000 out of 500000 steps (70%)
2020-04-19:00:26:52:WU14:FS03:0x22:Completed 355000 out of 500000 steps (71%)
2020-04-19:00:26:55:WU24:FS04:0x22:Completed 720000 out of 2000000 steps (36%)
2020-04-19:00:27:00:WU07:FS05:0x22:Completed 740000 out of 2000000 steps (37%)
2020-04-19:00:27:02:WU17:FS00:0x22:Completed 580000 out of 2000000 steps (29%)
2020-04-19:00:27:15:WU04:FS03:Upload 1.55%
2020-04-19:00:27:18:WU01:FS00:Upload 1.41%
2020-04-19:00:27:21:WU04:FS03:Upload 5.53%
2020-04-19:00:27:24:WU01:FS00:Upload 2.91%
2020-04-19:00:27:28:WU04:FS03:Upload 8.08%
2020-04-19:00:27:30:WU01:FS00:Upload 5.07%
2020-04-19:00:27:34:WU04:FS03:Upload 10.29%
2020-04-19:00:27:36:WU01:FS00:Upload 8.07%
2020-04-19:00:27:40:WU04:FS03:Upload 11.62%
2020-04-19:00:27:42:WU01:FS00:Upload 10.61%
2020-04-19:00:27:46:WU04:FS03:Upload 13.28%
2020-04-19:00:27:48:WU01:FS00:Upload 13.51%
2020-04-19:00:27:52:WU04:FS03:Upload 15.50%
2020-04-19:00:27:54:WU01:FS00:Upload 15.39%
2020-04-19:00:27:58:WU04:FS03:Upload 18.49%
2020-04-19:00:28:00:WU01:FS00:Upload 16.89%
2020-04-19:00:28:04:WU04:FS03:Upload 21.58%
2020-04-19:00:28:07:WU01:FS00:Upload 18.68%
2020-04-19:00:28:16:WU14:FS03:0x22:Completed 360000 out of 500000 steps (72%)
2020-04-19:00:28:19:WU01:FS00:Upload 19.80%
2020-04-19:00:28:19:WU04:FS03:Upload 24.57%
2020-04-19:00:28:19:WARNING:WU01:FS00:Exception: Failed to send results to work server: Transfer failed
2020-04-19:00:28:19:WARNING:WU04:FS03:Exception: Failed to send results to work server: Transfer failed
2020-04-19:00:29:17:WU24:FS04:0x22:Completed 740000 out of 2000000 steps (37%)
2020-04-19:00:29:24:WU17:FS00:0x22:Completed 600000 out of 2000000 steps (30%)