Can't connect to 18.188.125.154

[JimF]

This server appears to be down.

Code: Select all

22:58:37:WU00:FS00:0x22:*********************** Log Started 2020-12-17T22:58:37Z ***********************
22:58:37:WU00:FS00:0x22:*************************** Core22 Folding@home Core ***************************
22:58:37:WU00:FS00:0x22:       Core: Core22
22:58:37:WU00:FS00:0x22:       Type: 0x22
22:58:37:WU00:FS00:0x22:    Version: 0.0.13
22:58:37:WU00:FS00:0x22:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
22:58:37:WU00:FS00:0x22:  Copyright: 2020 foldingathome.org
22:58:37:WU00:FS00:0x22:   Homepage: https://foldingathome.org/
22:58:37:WU00:FS00:0x22:       Date: Sep 19 2020
22:58:37:WU00:FS00:0x22:       Time: 01:10:35
22:58:37:WU00:FS00:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
22:58:37:WU00:FS00:0x22:     Branch: core22-0.0.13
22:58:37:WU00:FS00:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
22:58:37:WU00:FS00:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
22:58:37:WU00:FS00:0x22:             -funroll-loops -DOPENMM_GIT_HASH=\"\\\"189320d0\\\"\"
22:58:37:WU00:FS00:0x22:   Platform: linux2 4.19.76-linuxkit
22:58:37:WU00:FS00:0x22:       Bits: 64
22:58:37:WU00:FS00:0x22:       Mode: Release
22:58:37:WU00:FS00:0x22:Maintainers: John Chodera <john.chodera@choderalab.org> and Peter Eastman
22:58:37:WU00:FS00:0x22:             <peastman@stanford.edu>
22:58:37:WU00:FS00:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 28695 -checkpoint 15
22:58:37:WU00:FS00:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
22:58:37:WU00:FS00:0x22:             0 -gpu 0
22:58:37:WU00:FS00:0x22:************************************ libFAH ************************************
22:58:37:WU00:FS00:0x22:       Date: Sep 15 2020
22:58:37:WU00:FS00:0x22:       Time: 05:14:43
22:58:37:WU00:FS00:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
22:58:37:WU00:FS00:0x22:     Branch: HEAD
22:58:37:WU00:FS00:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
22:58:37:WU00:FS00:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
22:58:37:WU00:FS00:0x22:             -funroll-loops
22:58:37:WU00:FS00:0x22:   Platform: linux2 4.19.76-linuxkit
22:58:37:WU00:FS00:0x22:       Bits: 64
22:58:37:WU00:FS00:0x22:       Mode: Release
22:58:37:WU00:FS00:0x22:************************************ CBang *************************************
22:58:37:WU00:FS00:0x22:       Date: Sep 15 2020
22:58:37:WU00:FS00:0x22:       Time: 05:11:04
22:58:37:WU00:FS00:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
22:58:37:WU00:FS00:0x22:     Branch: HEAD
22:58:37:WU00:FS00:0x22:   Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
22:58:37:WU00:FS00:0x22:    Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
22:58:37:WU00:FS00:0x22:             -funroll-loops -fPIC
22:58:37:WU00:FS00:0x22:   Platform: linux2 4.19.76-linuxkit
22:58:37:WU00:FS00:0x22:       Bits: 64
22:58:37:WU00:FS00:0x22:       Mode: Release
22:58:37:WU00:FS00:0x22:************************************ System ************************************
22:58:37:WU00:FS00:0x22:        CPU: AMD Ryzen 9 3950X 16-Core Processor
22:58:37:WU00:FS00:0x22:     CPU ID: AuthenticAMD Family 23 Model 113 Stepping 0
22:58:37:WU00:FS00:0x22:       CPUs: 32
22:58:37:WU00:FS00:0x22:     Memory: 46.99GiB
22:58:37:WU00:FS00:0x22:Free Memory: 29.81GiB
22:58:37:WU00:FS00:0x22:    Threads: POSIX_THREADS
22:58:37:WU00:FS00:0x22: OS Version: 5.4
22:58:37:WU00:FS00:0x22:Has Battery: false
22:58:37:WU00:FS00:0x22: On Battery: false
22:58:37:WU00:FS00:0x22: UTC Offset: -5
22:58:37:WU00:FS00:0x22:        PID: 28699
22:58:37:WU00:FS00:0x22:        CWD: /var/lib/fahclient/work
22:58:37:WU00:FS00:0x22:************************************ OpenMM ************************************
22:58:37:WU00:FS00:0x22:   Revision: 189320d0
22:58:37:WU00:FS00:0x22:********************************************************************************
22:58:37:WU00:FS00:0x22:Project: 13438 (Run 7128, Clone 29, Gen 0)
22:58:37:WU00:FS00:0x22:Unit: 0x0000000112bc7d9a000000001bd8001d
22:58:37:WU00:FS00:0x22:Reading tar file core.xml
22:58:37:WU00:FS00:0x22:Reading tar file integrator.xml.bz2
22:58:37:WU00:FS00:0x22:Reading tar file state.xml.bz2
22:58:37:WU00:FS00:0x22:Reading tar file system.xml.bz2
22:58:37:WU00:FS00:0x22:Digital signatures verified
22:58:37:WU00:FS00:0x22:Folding@home GPU Core22 Folding@home Core
22:58:37:WU00:FS00:0x22:Version 0.0.13
22:58:37:WU00:FS00:0x22:  Checkpoint write interval: 50000 steps (5%) [20 total]
22:58:37:WU00:FS00:0x22:  JSON viewer frame write interval: 10000 steps (1%) [100 total]
22:58:37:WU00:FS00:0x22:  XTC frame write interval: 250000 steps (25%) [4 total]
22:58:37:WU00:FS00:0x22:  Global context and integrator variables write interval: 25000 steps (2.5%) [40 total]
22:58:37:WU00:FS00:0x22:There are 4 platforms available.
22:58:37:WU00:FS00:0x22:Platform 0: Reference
22:58:37:WU00:FS00:0x22:Platform 1: CPU
22:58:37:WU00:FS00:0x22:Platform 2: OpenCL
22:58:37:WU00:FS00:0x22:  opencl-device 0 specified
22:58:37:WU00:FS00:0x22:Platform 3: CUDA
22:58:37:WU00:FS00:0x22:  cuda-device 0 specified
22:58:42:WU01:FS00:Upload 57.40%
22:58:44:WU00:FS00:0x22:Attempting to create CUDA context:
22:58:44:WU00:FS00:0x22:  Configuring platform CUDA
22:58:45:WU01:FS00:Upload complete
22:58:45:WU01:FS00:Server responded WORK_ACK (400)
22:58:45:WU01:FS00:Final credit estimate, 204455.00 points
22:58:45:WU01:FS00:Cleaning up
22:58:51:WU00:FS00:0x22:  Using CUDA and gpu 0
22:58:51:WU00:FS00:0x22:Completed 0 out of 1000000 steps (0%)
22:58:51:WU00:FS00:0x22:Checkpoint completed at step 0
23:00:20:WU00:FS00:0x22:Completed 10000 out of 1000000 steps (1%)
23:01:49:WU00:FS00:0x22:Completed 20000 out of 1000000 steps (2%)
23:03:18:WU00:FS00:0x22:Completed 30000 out of 1000000 steps (3%)
23:04:47:WU00:FS00:0x22:Completed 40000 out of 1000000 steps (4%)
23:06:16:WU00:FS00:0x22:Completed 50000 out of 1000000 steps (5%)
23:06:16:WU00:FS00:0x22:Checkpoint completed at step 50000
23:07:46:WU00:FS00:0x22:Completed 60000 out of 1000000 steps (6%)
23:09:15:WU00:FS00:0x22:Completed 70000 out of 1000000 steps (7%)
23:10:44:WU00:FS00:0x22:Completed 80000 out of 1000000 steps (8%)
23:12:14:WU00:FS00:0x22:Completed 90000 out of 1000000 steps (9%)
23:13:44:WU00:FS00:0x22:Completed 100000 out of 1000000 steps (10%)
23:13:44:WU00:FS00:0x22:Checkpoint completed at step 100000
23:15:13:WU00:FS00:0x22:Completed 110000 out of 1000000 steps (11%)
23:16:43:WU00:FS00:0x22:Completed 120000 out of 1000000 steps (12%)
23:18:12:WU00:FS00:0x22:Completed 130000 out of 1000000 steps (13%)
23:19:42:WU00:FS00:0x22:Completed 140000 out of 1000000 steps (14%)
23:21:12:WU00:FS00:0x22:Completed 150000 out of 1000000 steps (15%)
23:21:12:WU00:FS00:0x22:Checkpoint completed at step 150000
23:22:41:WU00:FS00:0x22:Completed 160000 out of 1000000 steps (16%)
23:24:11:WU00:FS00:0x22:Completed 170000 out of 1000000 steps (17%)
23:25:41:WU00:FS00:0x22:Completed 180000 out of 1000000 steps (18%)
23:27:11:WU00:FS00:0x22:Completed 190000 out of 1000000 steps (19%)
23:28:41:WU00:FS00:0x22:Completed 200000 out of 1000000 steps (20%)
23:28:41:WU00:FS00:0x22:Checkpoint completed at step 200000
23:30:11:WU00:FS00:0x22:Completed 210000 out of 1000000 steps (21%)
23:31:40:WU00:FS00:0x22:Completed 220000 out of 1000000 steps (22%)
23:33:10:WU00:FS00:0x22:Completed 230000 out of 1000000 steps (23%)
23:34:40:WU00:FS00:0x22:Completed 240000 out of 1000000 steps (24%)
23:36:10:WU00:FS00:0x22:Completed 250000 out of 1000000 steps (25%)
23:36:10:WU00:FS00:0x22:Checkpoint completed at step 250000
23:37:40:WU00:FS00:0x22:Completed 260000 out of 1000000 steps (26%)
23:39:11:WU00:FS00:0x22:Completed 270000 out of 1000000 steps (27%)
23:40:41:WU00:FS00:0x22:Completed 280000 out of 1000000 steps (28%)
23:42:12:WU00:FS00:0x22:Completed 290000 out of 1000000 steps (29%)
23:43:42:WU00:FS00:0x22:Completed 300000 out of 1000000 steps (30%)
23:43:42:WU00:FS00:0x22:Checkpoint completed at step 300000
23:45:13:WU00:FS00:0x22:Completed 310000 out of 1000000 steps (31%)
23:46:43:WU00:FS00:0x22:Completed 320000 out of 1000000 steps (32%)
23:48:13:WU00:FS00:0x22:Completed 330000 out of 1000000 steps (33%)
23:49:44:WU00:FS00:0x22:Completed 340000 out of 1000000 steps (34%)
23:51:14:WU00:FS00:0x22:Completed 350000 out of 1000000 steps (35%)
23:51:15:WU00:FS00:0x22:Checkpoint completed at step 350000
23:52:45:WU00:FS00:0x22:Completed 360000 out of 1000000 steps (36%)
23:54:15:WU00:FS00:0x22:Completed 370000 out of 1000000 steps (37%)
23:55:46:WU00:FS00:0x22:Completed 380000 out of 1000000 steps (38%)
23:57:16:WU00:FS00:0x22:Completed 390000 out of 1000000 steps (39%)
23:58:47:WU00:FS00:0x22:Completed 400000 out of 1000000 steps (40%)
23:58:47:WU00:FS00:0x22:Checkpoint completed at step 400000
00:00:18:WU00:FS00:0x22:Completed 410000 out of 1000000 steps (41%)
00:01:48:WU00:FS00:0x22:Completed 420000 out of 1000000 steps (42%)
00:03:19:WU00:FS00:0x22:Completed 430000 out of 1000000 steps (43%)
00:04:49:WU00:FS00:0x22:Completed 440000 out of 1000000 steps (44%)
00:06:19:WU00:FS00:0x22:Completed 450000 out of 1000000 steps (45%)
00:06:20:WU00:FS00:0x22:Checkpoint completed at step 450000
00:07:50:WU00:FS00:0x22:Completed 460000 out of 1000000 steps (46%)
00:09:21:WU00:FS00:0x22:Completed 470000 out of 1000000 steps (47%)
00:10:51:WU00:FS00:0x22:Completed 480000 out of 1000000 steps (48%)
00:12:22:WU00:FS00:0x22:Completed 490000 out of 1000000 steps (49%)
00:13:52:WU00:FS00:0x22:Completed 500000 out of 1000000 steps (50%)
00:13:53:WU00:FS00:0x22:Checkpoint completed at step 500000
00:15:23:WU00:FS00:0x22:Completed 510000 out of 1000000 steps (51%)
00:16:53:WU00:FS00:0x22:Completed 520000 out of 1000000 steps (52%)
00:18:23:WU00:FS00:0x22:Completed 530000 out of 1000000 steps (53%)
00:19:53:WU00:FS00:0x22:Completed 540000 out of 1000000 steps (54%)
00:21:23:WU00:FS00:0x22:Completed 550000 out of 1000000 steps (55%)
00:21:23:WU00:FS00:0x22:Checkpoint completed at step 550000
00:22:53:WU00:FS00:0x22:Completed 560000 out of 1000000 steps (56%)
00:24:23:WU00:FS00:0x22:Completed 570000 out of 1000000 steps (57%)
00:25:53:WU00:FS00:0x22:Completed 580000 out of 1000000 steps (58%)
00:27:23:WU00:FS00:0x22:Completed 590000 out of 1000000 steps (59%)
00:28:53:WU00:FS00:0x22:Completed 600000 out of 1000000 steps (60%)
00:28:54:WU00:FS00:0x22:Checkpoint completed at step 600000
00:30:24:WU00:FS00:0x22:Completed 610000 out of 1000000 steps (61%)
00:31:54:WU00:FS00:0x22:Completed 620000 out of 1000000 steps (62%)
00:33:24:WU00:FS00:0x22:Completed 630000 out of 1000000 steps (63%)
00:34:54:WU00:FS00:0x22:Completed 640000 out of 1000000 steps (64%)
00:36:24:WU00:FS00:0x22:Completed 650000 out of 1000000 steps (65%)
00:36:24:WU00:FS00:0x22:Checkpoint completed at step 650000
00:37:54:WU00:FS00:0x22:Completed 660000 out of 1000000 steps (66%)
00:39:24:WU00:FS00:0x22:Completed 670000 out of 1000000 steps (67%)
00:40:54:WU00:FS00:0x22:Completed 680000 out of 1000000 steps (68%)
00:42:24:WU00:FS00:0x22:Completed 690000 out of 1000000 steps (69%)
00:43:54:WU00:FS00:0x22:Completed 700000 out of 1000000 steps (70%)
00:43:55:WU00:FS00:0x22:Checkpoint completed at step 700000
00:45:25:WU00:FS00:0x22:Completed 710000 out of 1000000 steps (71%)
00:46:55:WU00:FS00:0x22:Completed 720000 out of 1000000 steps (72%)
00:48:25:WU00:FS00:0x22:Completed 730000 out of 1000000 steps (73%)
00:49:55:WU00:FS00:0x22:Completed 740000 out of 1000000 steps (74%)
00:51:25:WU00:FS00:0x22:Completed 750000 out of 1000000 steps (75%)
00:51:25:WU00:FS00:0x22:Checkpoint completed at step 750000
00:52:56:WU00:FS00:0x22:Completed 760000 out of 1000000 steps (76%)
00:54:26:WU00:FS00:0x22:Completed 770000 out of 1000000 steps (77%)
00:55:57:WU00:FS00:0x22:Completed 780000 out of 1000000 steps (78%)
00:57:27:WU00:FS00:0x22:Completed 790000 out of 1000000 steps (79%)
00:58:58:WU00:FS00:0x22:Completed 800000 out of 1000000 steps (80%)
00:58:58:WU00:FS00:0x22:Checkpoint completed at step 800000
01:00:29:WU00:FS00:0x22:Completed 810000 out of 1000000 steps (81%)
01:01:59:WU00:FS00:0x22:Completed 820000 out of 1000000 steps (82%)
01:03:30:WU00:FS00:0x22:Completed 830000 out of 1000000 steps (83%)
01:05:00:WU00:FS00:0x22:Completed 840000 out of 1000000 steps (84%)
01:06:31:WU00:FS00:0x22:Completed 850000 out of 1000000 steps (85%)
01:06:31:WU00:FS00:0x22:Checkpoint completed at step 850000
01:08:02:WU00:FS00:0x22:Completed 860000 out of 1000000 steps (86%)
******************************* Date: 2020-12-18 *******************************
01:09:32:WU00:FS00:0x22:Completed 870000 out of 1000000 steps (87%)
01:11:03:WU00:FS00:0x22:Completed 880000 out of 1000000 steps (88%)
01:12:33:WU00:FS00:0x22:Completed 890000 out of 1000000 steps (89%)
01:14:04:WU00:FS00:0x22:Completed 900000 out of 1000000 steps (90%)
01:14:04:WU00:FS00:0x22:Checkpoint completed at step 900000
01:15:35:WU00:FS00:0x22:Completed 910000 out of 1000000 steps (91%)
01:17:05:WU00:FS00:0x22:Completed 920000 out of 1000000 steps (92%)
01:18:36:WU00:FS00:0x22:Completed 930000 out of 1000000 steps (93%)
01:20:06:WU00:FS00:0x22:Completed 940000 out of 1000000 steps (94%)
01:21:37:WU00:FS00:0x22:Completed 950000 out of 1000000 steps (95%)
01:21:37:WU00:FS00:0x22:Checkpoint completed at step 950000
01:23:08:WU00:FS00:0x22:Completed 960000 out of 1000000 steps (96%)
01:24:39:WU00:FS00:0x22:Completed 970000 out of 1000000 steps (97%)
01:26:09:WU00:FS00:0x22:Completed 980000 out of 1000000 steps (98%)
01:27:40:WU00:FS00:0x22:Completed 990000 out of 1000000 steps (99%)
01:27:41:WU01:FS00:Connecting to assign1.foldingathome.org:80
01:27:41:WU01:FS00:Assigned to work server 18.188.125.154
01:27:41:WU01:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:TU106 [Geforce RTX 2060] from 18.188.125.154
01:27:41:WU01:FS00:Connecting to 18.188.125.154:8080
01:29:10:WU00:FS00:0x22:Completed 1000000 out of 1000000 steps (100%)
01:29:10:WU00:FS00:0x22:Average performance: 95.3642 ns/day
01:29:11:WU00:FS00:0x22:Checkpoint completed at step 1000000
01:29:18:WU00:FS00:0x22:Saving result file ../logfile_01.txt
01:29:18:WU00:FS00:0x22:Saving result file checkpointIntegrator.xml.bz2
01:29:18:WU00:FS00:0x22:Saving result file checkpointState.xml.bz2
01:29:18:WU00:FS00:0x22:Saving result file globals.csv
01:29:18:WU00:FS00:0x22:Saving result file positions.xtc
01:29:18:WU00:FS00:0x22:Saving result file science.log
01:29:18:WU00:FS00:0x22:Folding@home Core Shutdown: FINISHED_UNIT
01:29:18:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
01:29:18:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13438 run:7128 clone:29 gen:0 core:0x22 unit:0x0000000112bc7d9a000000001bd8001d
01:29:18:WU00:FS00:Uploading 8.49MiB to 18.188.125.154
01:29:18:WU00:FS00:Connecting to 18.188.125.154:8080
\x1b[93m01:29:52:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80\x1b[0m
01:29:52:WU01:FS00:Connecting to 18.188.125.154:80
\x1b[93m01:31:28:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80\x1b[0m
01:31:28:WU00:FS00:Connecting to 18.188.125.154:80
\x1b[91m01:32:03:ERROR:WU01:FS00:Exception: Failed to connect to 18.188.125.154:80: Connection timed out\x1b[0m
01:32:03:WU01:FS00:Connecting to assign1.foldingathome.org:80
01:32:03:WU01:FS00:Assigned to work server 18.188.125.154
01:32:03:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:TU106 [Geforce RTX 2060] from 18.188.125.154
01:32:03:WU01:FS00:Connecting to 18.188.125.154:8080
\x1b[93m01:33:39:WARNING:WU00:FS00:Exception: Failed to send results to work server: Failed to connect to 18.188.125.154:80: Connection timed out\x1b[0m
01:33:39:WU00:FS00:Trying to send results to collection server
01:33:39:WU00:FS00:Uploading 8.49MiB to 150.136.14.110
01:33:39:WU00:FS00:Connecting to 150.136.14.110:8080
01:33:45:WU00:FS00:Upload 71.39%
01:33:50:WU00:FS00:Upload complete
01:33:50:WU00:FS00:Server responded PLEASE_WAIT (464)
\x1b[93m01:33:50:WARNING:WU00:FS00:Failed to send results, will try again later\x1b[0m
01:33:50:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13438 run:7128 clone:29 gen:0 core:0x22 unit:0x0000000112bc7d9a000000001bd8001d
01:33:50:WU00:FS00:Uploading 8.49MiB to 18.188.125.154
01:33:50:WU00:FS00:Connecting to 18.188.125.154:8080
\x1b[93m01:34:14:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80\x1b[0m
01:34:14:WU01:FS00:Connecting to 18.188.125.154:80
\x1b[93m01:36:00:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80\x1b[0m
01:36:00:WU00:FS00:Connecting to 18.188.125.154:80
\x1b[91m01:36:25:ERROR:WU01:FS00:Exception: Failed to connect to 18.188.125.154:80: Connection timed out\x1b[0m
01:36:25:WU01:FS00:Connecting to assign1.foldingathome.org:80
01:36:26:WU01:FS00:Assigned to work server 18.188.125.154
01:36:26:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:TU106 [Geforce RTX 2060] from 18.188.125.154
01:36:26:WU01:FS00:Connecting to 18.188.125.154:8080
\x1b[93m01:38:12:WARNING:WU00:FS00:Exception: Failed to send results to work server: Failed to connect to 18.188.125.154:80: Connection timed out\x1b[0m
01:38:12:WU00:FS00:Trying to send results to collection server
01:38:12:WU00:FS00:Uploading 8.49MiB to 150.136.14.110
01:38:12:WU00:FS00:Connecting to 150.136.14.110:8080
01:38:35:WU00:FS00:Upload 10.30%
\x1b[93m01:38:36:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80\x1b[0m
01:38:36:WU01:FS00:Connecting to 18.188.125.154:80
01:38:46:WU00:FS00:Upload complete
01:38:46:WU00:FS00:Server responded PLEASE_WAIT (464)
\x1b[93m01:38:46:WARNING:WU00:FS00:Failed to send results, will try again later\x1b[0m
01:38:46:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13438 run:7128 clone:29 gen:0 core:0x22 unit:0x0000000112bc7d9a000000001bd8001d
01:38:46:WU00:FS00:Uploading 8.49MiB to 18.188.125.154
01:38:46:WU00:FS00:Connecting to 18.188.125.154:8080
\x1b[91m01:40:47:ERROR:WU01:FS00:Exception: Failed to connect to 18.188.125.154:80: Connection timed out\x1b[0m
01:40:47:WU01:FS00:Connecting to assign1.foldingathome.org:80
01:40:48:WU01:FS00:Assigned to work server 18.188.125.154
01:40:48:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:TU106 [Geforce RTX 2060] from 18.188.125.154
01:40:48:WU01:FS00:Connecting to 18.188.125.154:8080
\x1b[93m01:40:57:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80\x1b[0m
01:40:57:WU00:FS00:Connecting to 18.188.125.154:80
\x1b[93m01:42:58:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80\x1b[0m
01:42:58:WU01:FS00:Connecting to 18.188.125.154:80
\x1b[93m01:43:08:WARNING:WU00:FS00:Exception: Failed to send results to work server: Failed to connect to 18.188.125.154:80: Connection timed out\x1b[0m
01:43:08:WU00:FS00:Trying to send results to collection server
01:43:08:WU00:FS00:Uploading 8.49MiB to 150.136.14.110
01:43:08:WU00:FS00:Connecting to 150.136.14.110:8080
01:43:33:WU00:FS00:Upload 10.30%
01:43:49:WU00:FS00:Upload complete
01:43:49:WU00:FS00:Server responded PLEASE_WAIT (464)
\x1b[93m01:43:49:WARNING:WU00:FS00:Failed to send results, will try again later\x1b[0m
01:43:49:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13438 run:7128 clone:29 gen:0 core:0x22 unit:0x0000000112bc7d9a000000001bd8001d
01:43:49:WU00:FS00:Uploading 8.49MiB to 18.188.125.154
01:43:49:WU00:FS00:Connecting to 18.188.125.154:8080

[VAcharonD1]

Different error message:

Code: Select all

02:11:31:WU00:FS00:Connecting to 18.188.125.154:8080
02:11:32:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
02:11:32:WU00:FS00:Connecting to 18.188.125.154:80
02:11:33:ERROR:WU00:FS00:Exception: Failed to connect to 18.188.125.154:80: No connection could be made because the target machine actively refused it.

Edit: Never mind, it went through a few seconds ago.

[Joe_H]

Server status now lists this one as up for 13 minutes, and it appears to have had its server code updated. Are there still WUs not uploading?

[rexts217]

Server status now lists this one as up for 13 minutes, and it appears to have had its server code updated. Are there still WUs not uploading?

It is still error 10002 for me.

13:45:32:WU02:FS00:Uploading 8.50MiB to 18.188.125.154
13:45:32:WU02:FS00:Connecting to 18.188.125.154:8080
13:45:53:WU05:FS00:0x22:Completed 150000 out of 1250000 steps (12%)
13:45:54:WU05:FS00:0x22:Checkpoint completed at step 150000
13:46:02:WARNING:WU00:FS00:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
13:46:02:WU00:FS00:Trying to send r

[bruce]

If I paste 18.188.125.154 in my browser, it does connect. That suggests that your firewall is blocking FAHClient from connecting,,, or maybe it was fixed since you posted.

[foldingfanmucde]

Hi,

The same issue with that server exists for me too for one of my rigs (Win10 Pro, F@H 7.6.21) on the other rig it currently works fine (Win10 Pro, F@H 7.6.13). Same firewall. No changes.
It's being doing this in a continuous loop for some time and the credit is going down down down the whole time (a new WU is already being processed).
Both the servers are reachable via IP address using the browser, so appear to be "alive" in some way, but seem not to be collecting correctly.
Initially the work server is attempted without sucess and then it reverts to the collection server, also without success - see log below.
This same server was working fine for me up until recently.

Code: Select all

00:36:33:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:17319 run:0 clone:107 gen:20 core:0x22 unit:0x0000006b00000014000043a700000000
00:36:33:WU01:FS01:Uploading 24.36MiB to 140.163.4.200
00:36:33:WU01:FS01:Connecting to 140.163.4.200:8080
00:37:03:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
00:37:03:WU01:FS01:Trying to send results to collection server
00:37:03:WU01:FS01:Uploading 24.36MiB to 18.188.125.154
00:37:03:WU01:FS01:Connecting to 18.188.125.154:8080
00:37:26:WU00:FS01:0x22:Completed 325000 out of 1250000 steps (26%)
00:37:27:WU00:FS01:0x22:Checkpoint completed at step 325000
00:37:33:ERROR:WU01:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0
00:38:57:WU00:FS01:0x22:Completed 337500 out of 1250000 steps (27%)

Hopefully this can be solved soon.

Thanks!

[bruce]

A firewall exception is required, then, for FAHClient.exe

[foldingfanmucde]

Hi again,

Re-posting with some additional info:

The same issue with that server exists for me too for one of my rigs (Win10 Pro, F@H 7.6.21, number 2 in my signature).
On the other rig it currently works fine (Win10 Pro, F@H 7.6.13, number 1 in my signature).

Both rigs use the same hardware firewall. No changes. The program/process FAHClient.exe is explicitly allowed in the software firewalls. No changes.

It's being doing this in a continuous loop for some time and the credit is going down down down the whole time (a new WU is already being processed).
Worst of all, the 24MB result file is not being delivered.
Both the servers are reachable via IP address using the browser, and also via telnet on port 80, 8080, 443 - so appear to be "alive" in some way, but seem not to be collecting correctly in all cases.
Initially the work server is attempted without sucess and then it reverts to the collection server, also without success - see log below.
This same server was working fine for me up until recently.

Code: Select all

00:36:33:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:17319 run:0 clone:107 gen:20 core:0x22 unit:0x0000006b00000014000043a700000000
00:36:33:WU01:FS01:Uploading 24.36MiB to 140.163.4.200
00:36:33:WU01:FS01:Connecting to 140.163.4.200:8080
00:37:03:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
00:37:03:WU01:FS01:Trying to send results to collection server
00:37:03:WU01:FS01:Uploading 24.36MiB to 18.188.125.154
00:37:03:WU01:FS01:Connecting to 18.188.125.154:8080
00:37:26:WU00:FS01:0x22:Completed 325000 out of 1250000 steps (26%)
00:37:27:WU00:FS01:0x22:Checkpoint completed at step 325000
00:37:33:ERROR:WU01:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0
00:38:57:WU00:FS01:0x22:Completed 337500 out of 1250000 steps (27%)

Hopefully this can be solved soon.

Thanks!

1. AMD Ryzen 9 3900X / 64GB RAM / 2x NVIDIA RTX 2080 Ti / Win10 64 Pro / F@H 7.6.13 / ~6-8M PPD /
2. Intel Core i7 4790K / 32GB RAM / 1x AMD RX 5700 XT / Win10 64 Pro / F@H 7.6.21 / ~1-1.5M PPD /

[foldingfanmucde]

Further update:
The next WU was completed and results uploaded sucessfully. (meaning there is no firewall issue)
The previous WU described above is still stuck in "Send" - attempts do continue at intervals ever increasing in time - but none was yet successful.
It seems that WU was run without any value for science and appears to be a total write-off (~300K points).

[sacampb]

I am having the same problem as mucde except the collection server is 150.136.14.110. One slot is working and uploading fine. the other cant upload.

[mgetz]

It's looking based on server stats like somehow they over weighted aws3.foldingathome.org and it's refusing HTTP connections completely. I'm also having the sending an getting WUs issue. That said the server is up... just unable to handle the incoming connections.

[rexts217]

I can't upload results to 150.136.14.110 and 18.188.125.154. All 4 work units from PRCG 13458 are stuck in queue for more than 2 days.

[foldingfanmucde]

Further update:
Same issue still present for me. The WU result has not been able to be uploaded for around 11 hours now.
All other WU results that were completed since then have had no trouble being uploaded (on both rigs) including some to the exact same server IP (but those result files were all smaller).

[Just a hypothesis, but could it be, that larger result files (24MB) are an issue and smaller ones (7,7MB) are not?
(My internet connection is 250 Mbit/s downlink und 50Mbits uplink so that is not likely an issue)]
=> Edit: I've just seen another folder (rexts217) has reported the same issue with file sizes ~8,5MB in another parallel thread, so it seems my hypothesis is invalid.
Ref: viewtopic.php?f=18&t=36591

Just for completeness, here the current log file output (unchanged situation).

Code: Select all

09:25:01:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:17319 run:0 clone:107 gen:20 core:0x22 unit:0x0000006b00000014000043a700000000
09:25:01:WU01:FS01:Uploading 24.36MiB to 140.163.4.200
09:25:01:WU01:FS01:Connecting to 140.163.4.200:8080
09:25:31:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
09:25:31:WU01:FS01:Trying to send results to collection server
09:25:31:WU01:FS01:Uploading 24.36MiB to 18.188.125.154
09:25:31:WU01:FS01:Connecting to 18.188.125.154:8080
09:26:02:ERROR:WU01:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0

[foldingfanmucde]

Further update:
Strangely, the log looked like this just now. Refer to second last line in the log extract below. It actually seemed to try to upload....
"12:13:21:WU01:FS01:Upload 0.26%"
Puzzling.

Code: Select all

12:12:29:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:17319 run:0 clone:107 gen:20 core:0x22 unit:0x0000006b00000014000043a700000000
12:12:29:WU01:FS01:Uploading 24.36MiB to 140.163.4.200
12:12:29:WU01:FS01:Connecting to 140.163.4.200:8080
12:12:40:WU02:FS01:0x22:Completed 825000 out of 1250000 steps (66%)
12:12:41:WU02:FS01:0x22:Checkpoint completed at step 825000
12:12:59:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
12:12:59:WU01:FS01:Trying to send results to collection server
12:12:59:WU01:FS01:Uploading 24.36MiB to 18.188.125.154
12:12:59:WU01:FS01:Connecting to 18.188.125.154:8080
12:13:20:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
12:13:20:WU01:FS01:Connecting to 18.188.125.154:80
12:13:21:WU01:FS01:Upload 0.26%
12:13:51:ERROR:WU01:FS01:Exception: 10002: Received short response, expected 512 bytes, got 0

[Knish]

funny thing, i was also waiting for upload to 18.* when I suffered a stuck download, so I rebooted.... then everything uploaded!

edit: u know how a stuck download starts out as downloaded some small % but then it never finishes? I also see in my log upload of 0.30% but that also never finishes... perhaps this is like a stuck upload?

edit 2: another peculiar thing: Proj 13438 uploaded after i rebooted at 0831Z However checking the apps/cpu, I apparently got the credits much earlier - 284,077 2020-12-21 02:46:02 2020-12-21 04:05:41 2020-12-21 04:05:14

Code: Select all

08:31:51:WU01:FS01:Uploading 8.50MiB to 18.188.125.154
08:31:51:WU01:FS01:Connecting to 18.188.125.154:8080
08:31:53:WU01:FS01:Upload complete
08:31:54:WU01:FS01:Server responded WORK_ACK (400)
08:31:54:WU01:FS01:Final credit estimate, 135950.00 points