Uploading project 13800 failing [WS 128.252.203.4]

[Glennmas]

Wu keeps failing to upload :
11:03:23:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13800 run:0 clone:2123 gen:121 core:0xa7 unit:0x0000009a80fccb0458a5fcd72acd289a
11:03:23:WU00:FS00:Uploading 16.57MiB to 128.252.203.4
11:03:23:WU00:FS00:Connecting to 128.252.203.4:8080
11:03:48:WU00:FS00:Upload 0.75%
11:03:48:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed

Now im uploading to collection server 0.0.0.0 when I look to the status of the completed wu.
in the log it still tries to upload to 0.75procent then crashes the collection server is (128.252.203.4)

Any solution?

[Joe_H]

I have sent a message to the person managing the 128.252.203.4 WS.

A CS setting of 0.0.0.0 means there is no alternative upload point for the WU, it goes back to the WS only. The primary destination is always the WS that assigned the WU, where no CS is defined then it also acts as CS.

[FAMAS]

I have sent a message to the person managing the 128.252.203.4 WS.

A CS setting of 0.0.0.0 means there is no alternative upload point for the WU, it goes back to the WS only. The primary destination is always the WS that assigned the WU, where no CS is defined then it also acts as CS.

i wish to know how uploading to the zero ip address works.

[bruce]

A Collection Server is a secondary place to which WU can be uploaded when the primary Work Server is not accepting uploads. Under normal circumstances, the secondary is not used and not needed, although they're typically assigned.

Glennmas is using the wrong term when he calls 128.252.203.4 a CS; it's the WS.

In this case, no CS has been assigned. The zero IP address indicates that there is no Collection Server, and as you suggest, uploading to a zero IP address does not work. Uploads to the WS will continue to retry.

[Glennmas]

Wu has been uploaded thanks for the help.

[Joe_H]

I got a response back that the WS was restarted, it should be good for now.

[krilenko]

Hello,

Seven working hours blown away because server 128.252.203.4 didn't "like" the result? What is that?
There's is no OC (cpu, graphic card, RAM), temps are good.

Code: Select all

02:28:59:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13805 run:0 clone:1403 gen:65 core:0xa7 unit:0x0000004f80fccb045907bbfe6776ad75
02:31:21:WU01:FS00:0xa4:Completed 2500000 out of 2500000 steps  (100%)
02:31:21:WU01:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
02:31:31:WU01:FS00:0xa4:
02:31:31:WU01:FS00:0xa4:Finished Work Unit:
02:31:31:WU01:FS00:0xa4:- Reading up to 1953936 from "01/wudata_01.trr": Read 1953936
02:31:31:WU01:FS00:0xa4:trr file hash check passed.
02:31:31:WU01:FS00:0xa4:- Reading up to 2463836 from "01/wudata_01.xtc": Read 2463836
02:31:31:WU01:FS00:0xa4:xtc file hash check passed.
02:31:31:WU01:FS00:0xa4:edr file hash check passed.
02:31:32:WU01:FS00:0xa4:logfile size: 56050
02:31:32:WU01:FS00:0xa4:Leaving Run
02:31:33:WU01:FS00:0xa4:- Writing 4504382 bytes of core data to disk...
02:31:33:WU01:FS00:0xa4:Done: 4503870 -> 4362738 (compressed to 96.8 percent)
02:31:33:WU01:FS00:0xa4:  ... Done.
02:31:35:WU01:FS00:0xa4:- Shutting down core
02:31:35:WU01:FS00:0xa4:
02:31:35:WU01:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
02:31:35:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:31:35:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:8651 run:452 clone:0 gen:49 core:0xa4 unit:0x000000340002894c57fbf6d4a0aa9395
02:31:35:WU01:FS00:Uploading 4.16MiB to 155.247.166.220
02:31:35:WU00:FS00:Starting
02:31:35:WU01:FS00:Connecting to 155.247.166.220:8080
02:31:35:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/markus/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 704 -lifeline 6540 -checkpoint 25 -np 4
02:31:35:WU00:FS00:Started FahCore on PID 7560
02:31:36:WU00:FS00:Core PID:8412
02:31:36:WU00:FS00:FahCore 0xa7 started
02:31:37:WU00:FS00:0xa7:*********************** Log Started 2017-07-23T02:31:37Z ***********************
02:31:37:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
02:31:37:WU00:FS00:0xa7:       Type: 0xa7
02:31:37:WU00:FS00:0xa7:       Core: Gromacs
02:31:37:WU00:FS00:0xa7:    Website: http://folding.stanford.edu/
02:31:37:WU00:FS00:0xa7:  Copyright: (c) 2009-2016 Stanford University
02:31:37:WU00:FS00:0xa7:     Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:31:37:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 704 -lifeline 7560 -checkpoint 25 -np 4
02:31:37:WU00:FS00:0xa7:     Config: <none>
02:31:37:WU00:FS00:0xa7:************************************ Build *************************************
02:31:37:WU00:FS00:0xa7:    Version: 0.0.11
02:31:37:WU00:FS00:0xa7:       Date: Sep 21 2016
02:31:37:WU00:FS00:0xa7:       Time: 01:43:48
02:31:37:WU00:FS00:0xa7: Repository: Git
02:31:37:WU00:FS00:0xa7:   Revision: 957bd90e68d95ddcf1594dc15ff6c64cc4555146
02:31:37:WU00:FS00:0xa7:     Branch: master
02:31:37:WU00:FS00:0xa7:   Compiler: GNU 4.2.1 Compatible Clang 3.9.0 (trunk 274080)
02:31:37:WU00:FS00:0xa7:    Options: -std=gnu++98 -O3 -funroll-loops -ffast-math -mfpmath=sse
02:31:37:WU00:FS00:0xa7:             -fno-unsafe-math-optimizations -msse2 -I/mingw64/include
02:31:37:WU00:FS00:0xa7:             -Wno-inconsistent-dllimport -Wno-parentheses-equality
02:31:37:WU00:FS00:0xa7:             -Wno-deprecated-register -Wno-unused-local-typedef
02:31:37:WU00:FS00:0xa7:   Platform: linux2 4.6.0-1-amd64
02:31:37:WU00:FS00:0xa7:       Bits: 64
02:31:37:WU00:FS00:0xa7:       Mode: Release
02:31:37:WU00:FS00:0xa7:       SIMD: avx_256
02:31:37:WU00:FS00:0xa7:************************************ System ************************************
02:31:37:WU00:FS00:0xa7:        CPU: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz
02:31:37:WU00:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
02:31:37:WU00:FS00:0xa7:       CPUs: 4
02:31:37:WU00:FS00:0xa7:     Memory: 7.58GiB
02:31:37:WU00:FS00:0xa7:Free Memory: 5.20GiB
02:31:37:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
02:31:37:WU00:FS00:0xa7: OS Version: 6.1
02:31:37:WU00:FS00:0xa7:Has Battery: false
02:31:37:WU00:FS00:0xa7: On Battery: false
02:31:37:WU00:FS00:0xa7: UTC Offset: -3
02:31:37:WU00:FS00:0xa7:        PID: 8412
02:31:37:WU00:FS00:0xa7:        CWD: C:\Users\markus\AppData\Roaming\FAHClient\work
02:31:37:WU00:FS00:0xa7:         OS: Windows 7 Ultimate Service Pack 1
02:31:37:WU00:FS00:0xa7:    OS Arch: AMD64
02:31:37:WU00:FS00:0xa7:********************************************************************************
02:31:37:WU00:FS00:0xa7:Project: 13805 (Run 0, Clone 1403, Gen 65)
02:31:37:WU00:FS00:0xa7:Unit: 0x0000004f80fccb045907bbfe6776ad75
02:31:37:WU00:FS00:0xa7:Reading tar file core.xml
02:31:37:WU00:FS00:0xa7:Reading tar file frame65.tpr
02:31:37:WU00:FS00:0xa7:Digital signatures verified
02:31:37:WU00:FS00:0xa7:Calling: mdrun -s frame65.tpr -o frame65.trr -x frame65.xtc -cpt 25 -nt 4
02:31:37:WU00:FS00:0xa7:Steps: first=16250000 total=250000
02:31:39:WU00:FS00:0xa7:Completed 1 out of 250000 steps (0%)
02:31:41:WU01:FS00:Upload 13.52%
02:31:47:WU01:FS00:Upload 28.54%
02:31:53:WU01:FS00:Upload 43.56%
02:31:59:WU01:FS00:Upload 57.08%
02:32:05:WU01:FS00:Upload 72.10%
02:32:11:WU01:FS00:Upload 87.12%
02:32:17:WU01:FS00:Upload complete
02:32:18:WU01:FS00:Server responded WORK_ACK (400)
02:32:18:WU01:FS00:Final credit estimate, 1313.00 points
02:32:18:WU01:FS00:Cleaning up
02:36:13:WU00:FS00:0xa7:Completed 2500 out of 250000 steps (1%)
02:40:37:WU00:FS00:0xa7:Completed 5000 out of 250000 steps (2%)
02:45:00:WU00:FS00:0xa7:Completed 7500 out of 250000 steps (3%)
02:49:22:WU00:FS00:0xa7:Completed 10000 out of 250000 steps (4%)
02:53:44:WU00:FS00:0xa7:Completed 12500 out of 250000 steps (5%)
02:58:07:WU00:FS00:0xa7:Completed 15000 out of 250000 steps (6%)
03:02:30:WU00:FS00:0xa7:Completed 17500 out of 250000 steps (7%)
03:06:52:WU00:FS00:0xa7:Completed 20000 out of 250000 steps (8%)
03:11:16:WU00:FS00:0xa7:Completed 22500 out of 250000 steps (9%)
03:15:39:WU00:FS00:0xa7:Completed 25000 out of 250000 steps (10%)
03:20:02:WU00:FS00:0xa7:Completed 27500 out of 250000 steps (11%)
03:24:26:WU00:FS00:0xa7:Completed 30000 out of 250000 steps (12%)
03:28:48:WU00:FS00:0xa7:Completed 32500 out of 250000 steps (13%)
03:33:12:WU00:FS00:0xa7:Completed 35000 out of 250000 steps (14%)
03:37:46:WU00:FS00:0xa7:Completed 37500 out of 250000 steps (15%)
******************************* Date: 2017-07-23 *******************************
03:42:10:WU00:FS00:0xa7:Completed 40000 out of 250000 steps (16%)
03:46:33:WU00:FS00:0xa7:Completed 42500 out of 250000 steps (17%)
03:50:56:WU00:FS00:0xa7:Completed 45000 out of 250000 steps (18%)
03:55:19:WU00:FS00:0xa7:Completed 47500 out of 250000 steps (19%)
03:59:41:WU00:FS00:0xa7:Completed 50000 out of 250000 steps (20%)
04:04:04:WU00:FS00:0xa7:Completed 52500 out of 250000 steps (21%)
04:08:26:WU00:FS00:0xa7:Completed 55000 out of 250000 steps (22%)
04:12:50:WU00:FS00:0xa7:Completed 57500 out of 250000 steps (23%)
04:17:12:WU00:FS00:0xa7:Completed 60000 out of 250000 steps (24%)
04:21:35:WU00:FS00:0xa7:Completed 62500 out of 250000 steps (25%)
04:25:59:WU00:FS00:0xa7:Completed 65000 out of 250000 steps (26%)
04:30:21:WU00:FS00:0xa7:Completed 67500 out of 250000 steps (27%)
04:34:45:WU00:FS00:0xa7:Completed 70000 out of 250000 steps (28%)
04:39:24:WU00:FS00:0xa7:Completed 72500 out of 250000 steps (29%)
04:43:52:WU00:FS00:0xa7:Completed 75000 out of 250000 steps (30%)
04:48:14:WU00:FS00:0xa7:Completed 77500 out of 250000 steps (31%)
04:52:37:WU00:FS00:0xa7:Completed 80000 out of 250000 steps (32%)
04:57:00:WU00:FS00:0xa7:Completed 82500 out of 250000 steps (33%)
05:01:24:WU00:FS00:0xa7:Completed 85000 out of 250000 steps (34%)
05:05:48:WU00:FS00:0xa7:Completed 87500 out of 250000 steps (35%)
05:10:12:WU00:FS00:0xa7:Completed 90000 out of 250000 steps (36%)
05:14:35:WU00:FS00:0xa7:Completed 92500 out of 250000 steps (37%)
05:18:59:WU00:FS00:0xa7:Completed 95000 out of 250000 steps (38%)
05:23:23:WU00:FS00:0xa7:Completed 97500 out of 250000 steps (39%)
05:27:47:WU00:FS00:0xa7:Completed 100000 out of 250000 steps (40%)
05:32:11:WU00:FS00:0xa7:Completed 102500 out of 250000 steps (41%)
05:36:35:WU00:FS00:0xa7:Completed 105000 out of 250000 steps (42%)
05:41:15:WU00:FS00:0xa7:Completed 107500 out of 250000 steps (43%)
05:45:41:WU00:FS00:0xa7:Completed 110000 out of 250000 steps (44%)
05:50:04:WU00:FS00:0xa7:Completed 112500 out of 250000 steps (45%)
05:54:28:WU00:FS00:0xa7:Completed 115000 out of 250000 steps (46%)
05:58:51:WU00:FS00:0xa7:Completed 117500 out of 250000 steps (47%)
06:03:15:WU00:FS00:0xa7:Completed 120000 out of 250000 steps (48%)
06:07:37:WU00:FS00:0xa7:Completed 122500 out of 250000 steps (49%)
06:12:02:WU00:FS00:0xa7:Completed 125000 out of 250000 steps (50%)
06:16:25:WU00:FS00:0xa7:Completed 127500 out of 250000 steps (51%)
06:20:49:WU00:FS00:0xa7:Completed 130000 out of 250000 steps (52%)
06:25:13:WU00:FS00:0xa7:Completed 132500 out of 250000 steps (53%)
06:29:35:WU00:FS00:0xa7:Completed 135000 out of 250000 steps (54%)
06:33:59:WU00:FS00:0xa7:Completed 137500 out of 250000 steps (55%)
06:38:21:WU00:FS00:0xa7:Completed 140000 out of 250000 steps (56%)
06:42:58:WU00:FS00:0xa7:Completed 142500 out of 250000 steps (57%)
06:47:20:WU00:FS00:0xa7:Completed 145000 out of 250000 steps (58%)
06:51:43:WU00:FS00:0xa7:Completed 147500 out of 250000 steps (59%)
07:00:08:WU00:FS00:0xa7:Completed 150000 out of 250000 steps (60%)
07:04:32:WU00:FS00:0xa7:Completed 152500 out of 250000 steps (61%)
07:08:54:WU00:FS00:0xa7:Completed 155000 out of 250000 steps (62%)
07:13:18:WU00:FS00:0xa7:Completed 157500 out of 250000 steps (63%)
07:17:41:WU00:FS00:0xa7:Completed 160000 out of 250000 steps (64%)
07:22:05:WU00:FS00:0xa7:Completed 162500 out of 250000 steps (65%)
07:26:28:WU00:FS00:0xa7:Completed 165000 out of 250000 steps (66%)
07:30:50:WU00:FS00:0xa7:Completed 167500 out of 250000 steps (67%)
07:35:14:WU00:FS00:0xa7:Completed 170000 out of 250000 steps (68%)
07:39:37:WU00:FS00:0xa7:Completed 172500 out of 250000 steps (69%)
07:44:15:WU00:FS00:0xa7:Completed 175000 out of 250000 steps (70%)
07:48:37:WU00:FS00:0xa7:Completed 177500 out of 250000 steps (71%)
07:53:00:WU00:FS00:0xa7:Completed 180000 out of 250000 steps (72%)
07:57:23:WU00:FS00:0xa7:Completed 182500 out of 250000 steps (73%)
08:01:47:WU00:FS00:0xa7:Completed 185000 out of 250000 steps (74%)
08:06:10:WU00:FS00:0xa7:Completed 187500 out of 250000 steps (75%)
08:10:33:WU00:FS00:0xa7:Completed 190000 out of 250000 steps (76%)
08:14:57:WU00:FS00:0xa7:Completed 192500 out of 250000 steps (77%)
08:19:20:WU00:FS00:0xa7:Completed 195000 out of 250000 steps (78%)
08:23:45:WU00:FS00:0xa7:Completed 197500 out of 250000 steps (79%)
08:28:07:WU00:FS00:0xa7:Completed 200000 out of 250000 steps (80%)
08:32:31:WU00:FS00:0xa7:Completed 202500 out of 250000 steps (81%)
08:36:53:WU00:FS00:0xa7:Completed 205000 out of 250000 steps (82%)
08:41:17:WU00:FS00:0xa7:Completed 207500 out of 250000 steps (83%)
08:45:58:WU00:FS00:0xa7:Completed 210000 out of 250000 steps (84%)
08:50:22:WU00:FS00:0xa7:Completed 212500 out of 250000 steps (85%)
08:54:45:WU00:FS00:0xa7:Completed 215000 out of 250000 steps (86%)
08:59:08:WU00:FS00:0xa7:Completed 217500 out of 250000 steps (87%)
09:03:31:WU00:FS00:0xa7:Completed 220000 out of 250000 steps (88%)
09:07:55:WU00:FS00:0xa7:Completed 222500 out of 250000 steps (89%)
09:12:19:WU00:FS00:0xa7:Completed 225000 out of 250000 steps (90%)
09:16:42:WU00:FS00:0xa7:Completed 227500 out of 250000 steps (91%)
09:21:05:WU00:FS00:0xa7:Completed 230000 out of 250000 steps (92%)
09:25:28:WU00:FS00:0xa7:Completed 232500 out of 250000 steps (93%)
09:29:51:WU00:FS00:0xa7:Completed 235000 out of 250000 steps (94%)
09:34:15:WU00:FS00:0xa7:Completed 237500 out of 250000 steps (95%)
09:38:38:WU00:FS00:0xa7:Completed 240000 out of 250000 steps (96%)
******************************* Date: 2017-07-23 *******************************
09:43:15:WU00:FS00:0xa7:Completed 242500 out of 250000 steps (97%)
09:47:37:WU00:FS00:0xa7:Completed 245000 out of 250000 steps (98%)
09:52:00:WU00:FS00:0xa7:Completed 247500 out of 250000 steps (99%)
09:52:01:WU01:FS00:Connecting to 171.67.108.45:8080
09:52:44:WU01:FS00:Connecting to 171.67.108.45:8080
09:53:44:WU01:FS00:Connecting to 171.67.108.45:8080
09:55:21:WU01:FS00:Connecting to 171.67.108.45:8080
09:56:23:WU00:FS00:0xa7:Completed 250000 out of 250000 steps (100%)
09:56:26:WU00:FS00:0xa7:Saving result file ..\logfile_01.txt
09:56:26:WU00:FS00:0xa7:Saving result file frame65.trr
09:56:26:WU00:FS00:0xa7:Saving result file frame65.xtc
09:56:26:WU00:FS00:0xa7:Saving result file md.log
09:56:26:WU00:FS00:0xa7:Saving result file science.log
09:56:26:WU00:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
09:56:27:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:56:27:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13805 run:0 clone:1403 gen:65 core:0xa7 unit:0x0000004f80fccb045907bbfe6776ad75
09:56:27:WU00:FS00:Uploading 11.29MiB to 128.252.203.4
09:56:27:WU00:FS00:Connecting to 128.252.203.4:8080
09:57:08:WU00:FS00:Upload 1.11%
09:57:08:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
09:57:08:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13805 run:0 clone:1403 gen:65 core:0xa7 unit:0x0000004f80fccb045907bbfe6776ad75
09:57:08:WU00:FS00:Uploading 11.29MiB to 128.252.203.4
09:57:08:WU00:FS00:Connecting to 128.252.203.4:8080
09:57:58:WU01:FS00:Connecting to 171.67.108.45:8080
09:57:59:WU01:FS00:Assigned to work server 155.247.166.220
09:57:59:WU01:FS00:Requesting new work unit for slot 00: READY cpu:4 from 155.247.166.220
09:57:59:WU01:FS00:Connecting to 155.247.166.220:8080
09:58:00:WU01:FS00:Downloading 334.13KiB
09:58:01:WU01:FS00:Download complete
09:58:01:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:8646 run:273 clone:0 gen:44 core:0xa4 unit:0x000000330002894c57e0c430a45080ab
09:58:01:WU01:FS00:Starting
09:58:01:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/markus/AppData/Roaming/FAHClient/cores/fahwebx.stanford.edu/cores/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 6540 -checkpoint 25 -np 4
09:58:01:WU01:FS00:Started FahCore on PID 8860
09:58:01:WU01:FS00:Core PID:7052
09:58:01:WU01:FS00:FahCore 0xa4 started
09:58:02:WU01:FS00:0xa4:
09:58:02:WU01:FS00:0xa4:*------------------------------*
09:58:02:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
09:58:02:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
09:58:02:WU01:FS00:0xa4:
09:58:02:WU01:FS00:0xa4:Preparing to commence simulation
09:58:02:WU01:FS00:0xa4:- Looking at optimizations...
09:58:02:WU01:FS00:0xa4:- Created dyn
09:58:02:WU01:FS00:0xa4:- Files status OK
09:58:02:WU01:FS00:0xa4:- Expanded 341641 -> 539152 (decompressed 157.8 percent)
09:58:02:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=341641 data_size=539152, decompressed_data_size=539152 diff=0
09:58:02:WU01:FS00:0xa4:- Digital signature verified
09:58:02:WU01:FS00:0xa4:
09:58:02:WU01:FS00:0xa4:Project: 8646 (Run 273, Clone 0, Gen 44)
09:58:02:WU01:FS00:0xa4:
09:58:02:WU01:FS00:0xa4:Assembly optimizations on if available.
09:58:02:WU01:FS00:0xa4:Entering M.D.
09:58:08:WU01:FS00:0xa4:Mapping NT from 4 to 4 
09:58:08:WU01:FS00:0xa4:Completed 0 out of 2500000 steps  (0%)
10:00:35:WU01:FS00:0xa4:Completed 25000 out of 2500000 steps  (1%)
10:03:02:WU01:FS00:0xa4:Completed 50000 out of 2500000 steps  (2%)
10:05:29:WU01:FS00:0xa4:Completed 75000 out of 2500000 steps  (3%)
10:07:56:WU01:FS00:0xa4:Completed 100000 out of 2500000 steps  (4%)
10:10:24:WU01:FS00:0xa4:Completed 125000 out of 2500000 steps  (5%)
10:12:52:WU01:FS00:0xa4:Completed 150000 out of 2500000 steps  (6%)
10:15:19:WU01:FS00:0xa4:Completed 175000 out of 2500000 steps  (7%)
10:17:47:WU01:FS00:0xa4:Completed 200000 out of 2500000 steps  (8%)
10:20:14:WU01:FS00:0xa4:Completed 225000 out of 2500000 steps  (9%)
10:22:42:WU01:FS00:0xa4:Completed 250000 out of 2500000 steps  (10%)
10:25:09:WU01:FS00:0xa4:Completed 275000 out of 2500000 steps  (11%)
10:27:36:WU01:FS00:0xa4:Completed 300000 out of 2500000 steps  (12%)
10:30:03:WU01:FS00:0xa4:Completed 325000 out of 2500000 steps  (13%)
10:32:32:WU01:FS00:0xa4:Completed 350000 out of 2500000 steps  (14%)
10:33:34:WU00:FS00:Upload 3.32%
10:33:40:WU00:FS00:Upload 8.30%
10:33:46:WU00:FS00:Upload 13.84%
10:33:52:WU00:FS00:Upload 19.38%
10:33:58:WU00:FS00:Upload 24.91%
10:34:04:WU00:FS00:Upload 30.45%
10:34:10:WU00:FS00:Upload 35.43%
10:34:16:WU00:FS00:Upload 40.97%
10:34:22:WU00:FS00:Upload 46.51%
10:34:28:WU00:FS00:Upload 52.04%
10:34:34:WU00:FS00:Upload 57.02%
10:34:40:WU00:FS00:Upload 62.56%
10:34:46:WU00:FS00:Upload 67.54%
10:34:52:WU00:FS00:Upload 73.08%
10:34:58:WU00:FS00:Upload 78.62%
10:34:59:WU01:FS00:0xa4:Completed 375000 out of 2500000 steps  (15%)
10:35:04:WU00:FS00:Upload 84.15%
10:35:10:WU00:FS00:Upload 89.13%
10:35:16:WU00:FS00:Upload 94.67%
10:35:22:WU00:FS00:Upload 100.00%
10:35:23:WU00:FS00:Upload complete
10:35:23:WU00:FS00:Server responded WORK_QUIT (404)
10:35:23:WARNING:WU00:FS00:Server did not like results, dumping
10:35:23:WU00:FS00:Cleaning up

[Joe_H]

@krilenko I have merged your post with the prior report of problems uploading to 128.252.203.4. The cause of the problems are related. The WU was probably corrupted in some way during the upload process and not received. The server restart should fix this problem going forward.

[krilenko]

Thanks a lot Joe_H.

[verdeva]

I'm seeing this problem again today. i guess this server a reset.

[Joe_H]

The WS appears to be down, possibly in the process of being reset. I will send a message to verify that.

Edit: heard back that a reset has been done, should be working again.

[SchwartzBros]

The WS appears to be having issues again. I've been trying to upload a WU for several hours now.

[bollix47]

PL notified.

[goodyca]

I am also seeing this problem. Here is the log file.

Code: Select all

[06:26:55:WU00:FS00:Connecting to 171.67.108.45:8080
06:26:55:WU00:FS00:Assigned to work server 128.252.203.4
06:26:55:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:12 from 128.252.203.4
06:26:55:WU00:FS00:Connecting to 128.252.203.4:8080
06:26:58:WU00:FS00:Downloading 6.83MiB
06:27:04:WU00:FS00:Download 19.23%
06:27:14:WU00:FS00:Download 40.29%
06:27:14:WU00:FS00:Download complete
06:27:15:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13805 run:0 clone:545 gen:89 core:0xa7 unit:0x0000007380fccb045907bc448c6bb323
06:27:15:WU00:FS00:Starting
06:27:15:WU00:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/fahwebx.stanford.edu/cores/Linux/AMD64/AVX/Core_a7.fah/FahCore_a7 -dir 00 -suffix 01 -version 704 -lifeline 1965 -checkpoint 15 -np 12
06:27:15:WU00:FS00:0xa7:Project: 13805 (Run 0, Clone 545, Gen 89)
06:27:15:WU00:FS00:0xa7:Unit: 0x0000007380fccb045907bc448c6bb323
06:27:15:WU00:FS00:0xa7:Reading tar file core.xml
06:27:15:WU00:FS00:0xa7:Reading tar file frame89.tpr
06:27:15:WU00:FS00:0xa7:Digital signatures verified
06:27:15:WU00:FS00:0xa7:Calling: mdrun -s frame89.tpr -o frame89.trr -x frame89.xtc -cpt 15 -nt 12
06:27:15:WU00:FS00:0xa7:Steps: first=22250000 total=250000
06:27:17:WU00:FS00:0xa7:Completed 1 out of 250000 steps (0%)
06:29:49:WU00:FS00:0xa7:Completed 2500 out of 250000 steps (1%)
06:32:20:WU00:FS00:0xa7:Completed 5000 out of 250000 steps (2%)
...
10:59:49:WU00:FS00:0xa7:Completed 247500 out of 250000 steps (99%)
11:02:21:WU00:FS00:0xa7:Completed 250000 out of 250000 steps (100%)
11:02:23:WU00:FS00:0xa7:Saving result file ../logfile_01.txt
11:02:23:WU00:FS00:0xa7:Saving result file frame89.trr
11:02:23:WU00:FS00:0xa7:Saving result file frame89.xtc
11:02:23:WU00:FS00:0xa7:Saving result file md.log
11:02:23:WU00:FS00:0xa7:Saving result file science.log
11:02:23:WU00:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
11:02:24:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
11:02:24:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13805 run:0 clone:545 gen:89 core:0xa7 unit:0x0000007380fccb045907bc448c6bb323
11:02:24:WU00:FS00:Uploading 11.33MiB to 128.252.203.4
11:02:24:WU00:FS00:Connecting to 128.252.203.4:8080
11:04:32:WU00:FS00:Upload 1.10%
11:04:32:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
11:04:32:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13805 run:0 clone:545 gen:89 core:0xa7 unit:0x0000007380fccb045907bc448c6bb323
11:04:32:WU00:FS00:Uploading 11.33MiB to 128.252.203.4
11:04:32:WU00:FS00:Connecting to 128.252.203.4:8080
11:05:38:WU00:FS00:Upload 1.10%
11:05:38:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
11:05:38:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13805 run:0 clone:545 gen:89 core:0xa7 unit:0x0000007380fccb045907bc448c6bb323
11:05:38:WU00:FS00:Uploading 11.33MiB to 128.252.203.4
11:05:38:WU00:FS00:Connecting to 128.252.203.4:8080
11:07:48:WU00:FS00:Upload 1.10%
11:07:48:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
11:07:49:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13805 run:0 clone:545 gen:89 core:0xa7 unit:0x0000007380fccb045907bc448c6bb323
11:07:49:WU00:FS00:Uploading 11.33MiB to 128.252.203.4
11:07:49:WU00:FS00:Connecting to 128.252.203.4:8080
11:09:55:WU00:FS00:Upload 1.10%
11:09:55:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
11:10:26:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13805 run:0 clone:545 gen:89 core:0xa7 unit:0x0000007380fccb045907bc448c6bb323
11:10:26:WU00:FS00:Uploading 11.33MiB to 128.252.203.4
11:10:26:WU00:FS00:Connecting to 128.252.203.4:8080
11:12:31:WU00:FS00:Upload 1.10%
11:12:31:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
11:14:40:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13805 run:0 clone:545 gen:89 core:0xa7 unit:0x0000007380fccb045907bc448c6bb323
11:14:40:WU00:FS00:Uploading 11.33MiB to 128.252.203.4
11:14:40:WU00:FS00:Connecting to 128.252.203.4:8080
11:16:49:WU00:FS00:Upload 1.10%
11:16:49:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
11:21:32:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13805 run:0 clone:545 gen:89 core:0xa7 unit:0x0000007380fccb045907bc448c6bb323
11:21:32:WU00:FS00:Uploading 11.33MiB to 128.252.203.4
11:21:32:WU00:FS00:Connecting to 128.252.203.4:8080
11:23:39:WU00:FS00:Upload 1.10%
11:23:39:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
11:32:37:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13805 run:0 clone:545 gen:89 core:0xa7 unit:0x0000007380fccb045907bc448c6bb323
11:32:37:WU00:FS00:Uploading 11.33MiB to 128.252.203.4
11:32:37:WU00:FS00:Connecting to 128.252.203.4:8080
11:34:46:WU00:FS00:Upload 1.10%
11:34:46:WARNING:WU00:FS00:Exception: Failed to send results to work server: Transfer failed
11:50:34:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:13805 run:0 clone:545 gen:89 core:0xa7 unit:0x0000007380fccb045907bc448c6bb323
11:50:34:WU00:FS00:Uploading 11.33MiB to 128.252.203.4
11:50:34:WU00:FS00:Connecting to 128.252.203.4:8080
11:50:43:WU00:FS00:Upload 1.10%

Mod edit: fixed trailing Code tag