Project 8568 (Run:1 Clone:1 Gen:2) Completed, But No Upload

[DrBB1]

This WU completed several hours ago, but has not been accepted by either server. I checked the status of the two servers and (at least from what I can tell) they are active and receiving WUs. Perhaps the error is on my end and I will continue to troubleshoot here, but the error message suggests it may be on the server side: "No connection could be made because the target machine actively refused it." For this reason, I wanted to report it ASAP in case others were having the same problem.

I hope the log snippet below is helpful in identifying the problem. If I solve it on my end, I will report back.

Code: Select all

12:31:38:WU01:FS01:0xa3:Completed 480000 out of 500000 steps  (96%)
12:50:19:WU01:FS01:0xa3:Completed 485000 out of 500000 steps  (97%)
13:08:59:WU01:FS01:0xa3:Completed 490000 out of 500000 steps  (98%)
13:27:44:WU01:FS01:0xa3:Completed 495000 out of 500000 steps  (99%)
13:46:24:WU01:FS01:0xa3:Completed 500000 out of 500000 steps  (100%)
13:46:26:WU01:FS01:0xa3:DynamicWrapper: Finished Work Unit: sleep=10000
13:46:36:WU01:FS01:0xa3:
13:46:36:WU01:FS01:0xa3:Finished Work Unit:
13:46:36:WU01:FS01:0xa3:- Reading up to 8056320 from "01/wudata_01.trr": Read 8056320
13:46:36:WU01:FS01:0xa3:trr file hash check passed.
13:46:36:WU01:FS01:0xa3:edr file hash check passed.
13:46:36:WU01:FS01:0xa3:logfile size: 61728
13:46:36:WU01:FS01:0xa3:Leaving Run
13:46:40:WU01:FS01:0xa3:- Writing 8154880 bytes of core data to disk...
13:46:42:WU01:FS01:0xa3:Done: 8154368 -> 7530932 (compressed to 92.3 percent)
13:46:42:WU01:FS01:0xa3:  ... Done.
13:46:43:WU01:FS01:0xa3:- Shutting down core
13:46:43:WU01:FS01:0xa3:
13:46:43:WU01:FS01:0xa3:Folding@home Core Shutdown: FINISHED_UNIT
13:46:44:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
13:46:44:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
13:46:44:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
13:46:44:WU01:FS01:Connecting to 128.143.231.202:8080
13:58:42:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
13:58:42:WU01:FS01:Connecting to 128.143.231.202:80
14:44:23:WARNING:WU01:FS01:Exception: Failed to send results to work server: Failed to connect to 128.143.231.202:80: No connection could be made because the target machine actively refused it.
14:44:23:WU01:FS01:Trying to send results to collection server
14:44:23:WU01:FS01:Uploading 7.18MiB to 128.143.199.97
14:44:23:WU01:FS01:Connecting to 128.143.199.97:8080
14:52:27:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
14:52:27:WU01:FS01:Connecting to 128.143.199.97:80
14:59:02:ERROR:WU01:FS01:Exception: Failed to connect to 128.143.199.97:80: No connection could be made because the target machine actively refused it.
14:59:03:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
14:59:03:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
14:59:03:WU01:FS01:Connecting to 128.143.231.202:8080
15:06:08:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
15:06:08:WU01:FS01:Connecting to 128.143.231.202:80
15:12:13:WARNING:WU01:FS01:Exception: Failed to send results to work server: Failed to connect to 128.143.231.202:80: No connection could be made because the target machine actively refused it.
15:12:13:WU01:FS01:Trying to send results to collection server
15:12:13:WU01:FS01:Uploading 7.18MiB to 128.143.199.97
15:12:13:WU01:FS01:Connecting to 128.143.199.97:8080
15:18:18:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
15:18:18:WU01:FS01:Connecting to 128.143.199.97:80
15:23:53:ERROR:WU01:FS01:Exception: Failed to connect to 128.143.199.97:80: No connection could be made because the target machine actively refused it.
15:23:53:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
15:23:53:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
15:23:53:WU01:FS01:Connecting to 128.143.231.202:8080
15:30:29:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
15:30:29:WU01:FS01:Connecting to 128.143.231.202:80
15:35:33:WARNING:WU01:FS01:Exception: Failed to send results to work server: Failed to connect to 128.143.231.202:80: No connection could be made because the target machine actively refused it.
15:35:33:WU01:FS01:Trying to send results to collection server
15:35:33:WU01:FS01:Uploading 7.18MiB to 128.143.199.97
15:35:33:WU01:FS01:Connecting to 128.143.199.97:8080
15:42:08:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
15:42:08:WU01:FS01:Connecting to 128.143.199.97:80
15:54:49:ERROR:WU01:FS01:Exception: Failed to connect to 128.143.199.97:80: No connection could be made because the target machine actively refused it.
15:54:49:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
15:54:49:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
15:54:49:WU01:FS01:Connecting to 128.143.231.202:8080
16:01:55:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
16:01:55:WU01:FS01:Connecting to 128.143.231.202:80
******************************* Date: 2013-09-09 *******************************
16:16:38:WARNING:WU01:FS01:Exception: Failed to send results to work server: Failed to connect to 128.143.231.202:80: No connection could be made because the target machine actively refused it.
16:16:38:WU01:FS01:Trying to send results to collection server
16:16:38:WU01:FS01:Uploading 7.18MiB to 128.143.199.97
16:16:38:WU01:FS01:Connecting to 128.143.199.97:8080
16:22:12:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
16:22:12:WU01:FS01:Connecting to 128.143.199.97:80
16:29:48:ERROR:WU01:FS01:Exception: Failed to connect to 128.143.199.97:80: No connection could be made because the target machine actively refused it.
16:29:49:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
16:29:49:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
16:29:49:WU01:FS01:Connecting to 128.143.231.202:8080
16:37:55:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
16:37:55:WU01:FS01:Connecting to 128.143.231.202:80
16:46:33:WARNING:WU01:FS01:Exception: Failed to send results to work server: Failed to connect to 128.143.231.202:80: No connection could be made because the target machine actively refused it.
16:46:33:WU01:FS01:Trying to send results to collection server
16:46:33:WU01:FS01:Uploading 7.18MiB to 128.143.199.97
16:46:33:WU01:FS01:Connecting to 128.143.199.97:8080
16:55:09:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
16:55:09:WU01:FS01:Connecting to 128.143.199.97:80
17:03:16:ERROR:WU01:FS01:Exception: Failed to connect to 128.143.199.97:80: No connection could be made because the target machine actively refused it.
17:03:16:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
17:03:17:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
17:03:17:WU01:FS01:Connecting to 128.143.231.202:8080
17:11:23:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
17:11:23:WU01:FS01:Connecting to 128.143.231.202:80
17:17:59:WARNING:WU01:FS01:Exception: Failed to send results to work server: Failed to connect to 128.143.231.202:80: No connection could be made because the target machine actively refused it.
17:17:59:WU01:FS01:Trying to send results to collection server
17:17:59:WU01:FS01:Uploading 7.18MiB to 128.143.199.97
17:17:59:WU01:FS01:Connecting to 128.143.199.97:8080
17:23:33:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
17:23:33:WU01:FS01:Connecting to 128.143.199.97:80
17:30:09:ERROR:WU01:FS01:Exception: Failed to connect to 128.143.199.97:80: No connection could be made because the target machine actively refused it.
17:30:09:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
17:30:09:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
17:30:09:WU01:FS01:Connecting to 128.143.231.202:8080
17:36:14:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
17:36:14:WU01:FS01:Connecting to 128.143.231.202:80
17:42:50:WARNING:WU01:FS01:Exception: Failed to send results to work server: Failed to connect to 128.143.231.202:80: No connection could be made because the target machine actively refused it.
17:42:50:WU01:FS01:Trying to send results to collection server
17:42:50:WU01:FS01:Uploading 7.18MiB to 128.143.199.97
17:42:50:WU01:FS01:Connecting to 128.143.199.97:8080
17:51:27:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
17:51:27:WU01:FS01:Connecting to 128.143.199.97:80
18:15:47:ERROR:WU01:FS01:Exception: Failed to connect to 128.143.199.97:80: No connection could be made because the target machine actively refused it.
18:15:48:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
18:15:48:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
18:15:48:WU01:FS01:Connecting to 128.143.231.202:8080
18:22:53:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
18:22:53:WU01:FS01:Connecting to 128.143.231.202:80
18:30:29:WARNING:WU01:FS01:Exception: Failed to send results to work server: Failed to connect to 128.143.231.202:80: No connection could be made because the target machine actively refused it.
18:30:29:WU01:FS01:Trying to send results to collection server
18:30:29:WU01:FS01:Uploading 7.18MiB to 128.143.199.97
18:30:29:WU01:FS01:Connecting to 128.143.199.97:8080
18:37:35:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
18:37:35:WU01:FS01:Connecting to 128.143.199.97:80
18:45:11:ERROR:WU01:FS01:Exception: Failed to connect to 128.143.199.97:80: No connection could be made because the target machine actively refused it.
18:45:12:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
18:45:12:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
18:45:12:WU01:FS01:Connecting to 128.143.231.202:8080
18:52:48:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
18:52:48:WU01:FS01:Connecting to 128.143.231.202:80
18:59:23:WARNING:WU01:FS01:Exception: Failed to send results to work server: Failed to connect to 128.143.231.202:80: No connection could be made because the target machine actively refused it.
18:59:23:WU01:FS01:Trying to send results to collection server
18:59:23:WU01:FS01:Uploading 7.18MiB to 128.143.199.97
18:59:23:WU01:FS01:Connecting to 128.143.199.97:8080
19:07:30:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
19:07:30:WU01:FS01:Connecting to 128.143.199.97:80
19:15:37:ERROR:WU01:FS01:Exception: Failed to connect to 128.143.199.97:80: No connection could be made because the target machine actively refused it.
19:15:37:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
19:15:37:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
19:15:37:WU01:FS01:Connecting to 128.143.231.202:8080
19:32:51:WARNING:WU01:FS01:WorkServer connection failed on port 8080 trying 80
19:32:51:WU01:FS01:Connecting to 128.143.231.202:80
20:31:15:WU01:FS01:Upload 0.87%
20:31:15:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
20:31:15:WU01:FS01:Trying to send results to collection server
20:31:15:WU01:FS01:Uploading 7.18MiB to 128.143.199.97
20:31:15:WU01:FS01:Connecting to 128.143.199.97:8080
20:31:16:ERROR:WU01:FS01:Exception: Transfer failed
20:31:16:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
20:31:16:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
20:31:16:WU01:FS01:Connecting to 128.143.231.202:8080
20:31:16:WARNING:WU01:FS01:Exception: Failed to send results to work server: Transfer failed
20:31:16:WU01:FS01:Trying to send results to collection server
20:31:16:WU01:FS01:Uploading 7.18MiB to 128.143.199.97
20:31:16:WU01:FS01:Connecting to 128.143.199.97:8080
20:31:16:ERROR:WU01:FS01:Exception: Transfer failed

[bruce]

Thanks for the report. According to the server-status page, everything was fine when the last report was generated some 19 minutes ago. Reports normally are updated every 20 minutes, so we'll probably get a refresh any time now.

I am unable to open either http://128.143.199.97:8080 or http://128.143.231.202:8080 from my browser, which is a pretty good sign that something is wrong but I'll give it a little longer before notifying the owner, in case he's actively working on those machines.

[bruce]

I notice that the log says the "...actively refused it." messages happened between 14:44:23 and 19:15:37 GMT, which doesn't make much sense. What day was that?

Then it switched to Transfer failed after an upload of only 0.87%. That makes it look like a problem on your end. The servers are both sending and receiving WUs.

Those servers are expected to fail the http tests. They're supposed to have an extra level of security.

[DrBB1]

bruce,

Although not definitive, I think it the issue was either a random event or an issue with my firewall, which has been causing difficulties recently with my Web browsing. To turn off the firewall, I had to reboot my PC. As you can see from the code below, the upload seemed to go smoothly after reboot. With the firewall back on, I'll check whether I have a similar issue when the next WU completes, ETA about 28 hours. [BTW, different project, but the same server (128.143.231.202).]

Regarding your confusion about the time:

I notice that the log says the "...actively refused it." messages happened between 14:44:23 and 19:15:37 GMT, which doesn't make much sense. What day was that?

That was today (9 Sept ). Could it be you are confused because the time is an hour off? I noticed in my Forum settings that my local time (EST) was not corrected for Daylight Savings, so my post may be an hour off. I have since corrected that setting. If you are responding to something else about the time, I'm stumped.

Thanks for your help! Glad it was not a server problem.

Code: Select all

21:48:50:Trying to access database...
21:48:56:Successfully acquired database lock
21:48:56:Enabled folding slot 01: READY cpu:4
21:49:00:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:8568 run:1 clone:1 gen:2 core:0xa3 unit:0x0000001c0a3b1e595228819fcbdc39c3
21:49:00:WU01:FS01:Uploading 7.18MiB to 128.143.231.202
21:49:00:WU01:FS01:Connecting to 128.143.231.202:8080
21:49:01:WU00:FS01:Starting
21:49:01:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Main/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 00 -suffix 01 -version 703 -lifeline 2064 -checkpoint 30 -np 4
21:49:06:WU01:FS01:Upload 87.89%
21:49:07:WU01:FS01:Upload complete
21:49:21:WU00:FS01:Started FahCore on PID 1208
21:49:31:WU00:FS01:Core PID:4212
21:49:31:WU00:FS01:FahCore 0xa3 started
21:49:31:WU00:FS01:0xa3:
21:49:31:WU00:FS01:0xa3:*------------------------------*
21:49:31:WU00:FS01:0xa3:Folding@Home Gromacs SMP Core
21:49:31:WU00:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
21:49:31:WU00:FS01:0xa3:
21:49:31:WU00:FS01:0xa3:Preparing to commence simulation
21:49:31:WU00:FS01:0xa3:- Looking at optimizations...
21:49:31:WU00:FS01:0xa3:- Files status OK
21:49:32:WU00:FS01:0xa3:- Expanded 3849387 -> 4387808 (decompressed 113.9 percent)
21:49:32:WU00:FS01:0xa3:Called DecompressByteArray: compressed_data_size=3849387 data_size=4387808, decompressed_data_size=4387808 diff=0
21:49:32:WU00:FS01:0xa3:- Digital signature verified
21:49:32:WU00:FS01:0xa3:
21:49:32:WU00:FS01:0xa3:Project: 8580 (Run 0, Clone 0, Gen 217)
21:49:32:WU00:FS01:0xa3:
21:49:32:WU00:FS01:0xa3:Assembly optimizations on if available.
21:49:32:WU00:FS01:0xa3:Entering M.D.
21:49:34:WU01:FS01:Server responded WORK_ACK (400)
21:49:34:WU01:FS01:Final credit estimate, 8005.00 points
21:49:35:WU01:FS01:Cleaning up
21:49:38:WU00:FS01:0xa3:Using Gromacs checkpoints
21:49:39:WU00:FS01:0xa3:Mapping NT from 4 t