171.64.65.98 (Was: 7.3.6 Results not sending)

[bruce]

Collection server 171.65.103.160 is working exactly as it's supposed to. The primary WorkServer for this project, 171.64.65.98, is off-line so your client was redirected and successfully uploaded to the CS. That WU was rejected.

I can think of several reasons why it might have been rejected.

1) The WU might already have been received by the WS but the CS doesn't know that yet.
2) The WU might already have been received by the CS but it doesn't have an error message for that.
3) The WU might actually be corrupt.
4) Any number of other reasons that I don't understand.

I'm sure it will all be cleared up when the primary WS comes back on-line.

Topics Merged.

[7im]

4a) When the work server goes down before being able to update the list of outstanding WUs on the collection server, the collection server will refuse all work units not on the list. It's a security feature.

I'm sure it will all be cleared up when the primary WS comes back on-line.

[bison88]

Oop, well it appears to have uploaded just fine (minus a few thousand greedy points lol), guess I was just a little too impatient. Thanks for the clarification and the quick responses

[bruce]

Regarding the thousands of greedy points ... that's supposed to work (based on when the WU actually uploaded to either a WS or a CS). Find (some of) the upload attempts that I can compare with the official upload time.

[bison88]

Regarding the thousands of greedy points ... that's supposed to work (based on when the WU actually uploaded to either a WS or a CS). Find (some of) the upload attempts that I can compare with the official upload time.

Yeah its happened a couple of times, I know the drill.

Honestly it isn't worth the extra hassle or your time since I went from doing 6.5K a day to nearly 200K recently, but I do appreciate knowing that it could be remedied easily that's awfully kind for those where every point matters.

[bruce]

I wasn't suggesting I could remedy it. I was attempting to gather enough data to (A) Determine that it's working correctly or (B) to document the problem in a way that somebody could attempt to fix it.

[bison88]

No problem, in that case here's the logs as cleaned up as best from when it grabbed the WU to when it started failing:

Code: Select all

19:07:06:WU01:FS00:Connecting to assign-GPU.stanford.edu:80
19:07:06:WU01:FS00:News: Welcome to Folding@Home
19:07:06:WU01:FS00:Assigned to work server 171.64.65.98
19:07:06:WU01:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:GK110 [GeForce GTX 780] from 171.64.65.98
19:07:06:WU01:FS00:Connecting to 171.64.65.98:8080
19:07:06:WU01:FS00:Downloading 2.08MiB
19:07:07:WU01:FS00:Download complete
19:07:07:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:7810 run:0 clone:424 gen:291 core:0x17 unit:0x000001350a3b1e8651d34a72797a193b
19:07:14:WU00:FS00:0x17:Saving result file logfile_01.txt
19:07:14:WU00:FS00:0x17:Saving result file checkpointState.xml
19:07:15:WU00:FS00:0x17:Saving result file checkpt.crc
19:07:15:WU00:FS00:0x17:Saving result file log.txt
19:07:15:WU00:FS00:0x17:Saving result file positions.xtc
19:07:16:WU00:FS00:0x17:Folding@home Core Shutdown: FINISHED_UNIT
19:07:16:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:07:16:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:7811 run:0 clone:368 gen:417 core:0x17 unit:0x000001af0a3b1e8651db4977b2db3c18
19:07:16:WU00:FS00:Uploading 4.27MiB to 171.64.65.98
19:07:16:WU00:FS00:Connecting to 171.64.65.98:8080
19:07:16:WU01:FS00:Starting
19:07:16:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Admin/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 3840 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
19:07:16:WU01:FS00:Started FahCore on PID 6020
19:07:16:WU01:FS00:Core PID:7076
19:07:16:WU01:FS00:FahCore 0x17 started
19:07:17:WU01:FS00:0x17:*********************** Log Started 2013-10-11T19:07:16Z ***********************
19:07:17:WU01:FS00:0x17:Project: 7810 (Run 0, Clone 424, Gen 291)
19:07:17:WU01:FS00:0x17:Unit: 0x000001350a3b1e8651d34a72797a193b
19:07:17:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
19:07:17:WU01:FS00:0x17:Machine: 0
19:07:17:WU01:FS00:0x17:Reading tar file state.xml
19:07:17:WU01:FS00:0x17:Reading tar file system.xml
19:07:17:WU01:FS00:0x17:Reading tar file integrator.xml
19:07:17:WU01:FS00:0x17:Reading tar file core.xml
19:07:17:WU01:FS00:0x17:Digital signatures verified
19:07:22:WU00:FS00:Upload 36.61%
19:07:28:WU00:FS00:Upload 73.23%
19:07:35:WU00:FS00:Upload complete
19:07:35:WU00:FS00:Server responded WORK_ACK (400)
19:07:35:WU00:FS00:Final credit estimate, 11971.00 points
19:07:35:WU00:FS00:Cleaning up
19:08:00:WU01:FS00:0x17:Completed 0 out of 2000000 steps (0%)
19:09:39:WU01:FS00:0x17:Completed 20000 out of 2000000 steps (1%)
19:11:07:WU01:FS00:0x17:Completed 40000 out of 2000000 steps (2%)
19:12:47:WU01:FS00:0x17:Completed 60000 out of 2000000 steps (3%)
19:14:15:WU01:FS00:0x17:Completed 80000 out of 2000000 steps (4%)
19:15:43:WU01:FS00:0x17:Completed 100000 out of 2000000 steps (5%)
19:17:23:WU01:FS00:0x17:Completed 120000 out of 2000000 steps (6%)
19:18:51:WU01:FS00:0x17:Completed 140000 out of 2000000 steps (7%)
19:20:31:WU01:FS00:0x17:Completed 160000 out of 2000000 steps (8%)
19:21:59:WU01:FS00:0x17:Completed 180000 out of 2000000 steps (9%)
19:23:27:WU01:FS00:0x17:Completed 200000 out of 2000000 steps (10%)
19:25:07:WU01:FS00:0x17:Completed 220000 out of 2000000 steps (11%)
19:26:35:WU01:FS00:0x17:Completed 240000 out of 2000000 steps (12%)
19:28:14:WU01:FS00:0x17:Completed 260000 out of 2000000 steps (13%)
19:29:43:WU01:FS00:0x17:Completed 280000 out of 2000000 steps (14%)
19:31:11:WU01:FS00:0x17:Completed 300000 out of 2000000 steps (15%)
19:32:50:WU01:FS00:0x17:Completed 320000 out of 2000000 steps (16%)
19:34:19:WU01:FS00:0x17:Completed 340000 out of 2000000 steps (17%)
19:35:58:WU01:FS00:0x17:Completed 360000 out of 2000000 steps (18%)
19:37:26:WU01:FS00:0x17:Completed 380000 out of 2000000 steps (19%)
19:38:55:WU01:FS00:0x17:Completed 400000 out of 2000000 steps (20%)
19:40:34:WU01:FS00:0x17:Completed 420000 out of 2000000 steps (21%)
19:42:02:WU01:FS00:0x17:Completed 440000 out of 2000000 steps (22%)
19:43:41:WU01:FS00:0x17:Completed 460000 out of 2000000 steps (23%)
19:45:10:WU01:FS00:0x17:Completed 480000 out of 2000000 steps (24%)
19:46:38:WU01:FS00:0x17:Completed 500000 out of 2000000 steps (25%)
19:48:18:WU01:FS00:0x17:Completed 520000 out of 2000000 steps (26%)
19:49:46:WU01:FS00:0x17:Completed 540000 out of 2000000 steps (27%)
19:51:25:WU01:FS00:0x17:Completed 560000 out of 2000000 steps (28%)
19:52:54:WU01:FS00:0x17:Completed 580000 out of 2000000 steps (29%)
19:54:22:WU01:FS00:0x17:Completed 600000 out of 2000000 steps (30%)
19:56:01:WU01:FS00:0x17:Completed 620000 out of 2000000 steps (31%)
19:57:29:WU01:FS00:0x17:Completed 640000 out of 2000000 steps (32%)
19:59:09:WU01:FS00:0x17:Completed 660000 out of 2000000 steps (33%)
20:00:37:WU01:FS00:0x17:Completed 680000 out of 2000000 steps (34%)
20:02:06:WU01:FS00:0x17:Completed 700000 out of 2000000 steps (35%)
20:03:45:WU01:FS00:0x17:Completed 720000 out of 2000000 steps (36%)
20:05:13:WU01:FS00:0x17:Completed 740000 out of 2000000 steps (37%)
20:06:52:WU01:FS00:0x17:Completed 760000 out of 2000000 steps (38%)
20:08:20:WU01:FS00:0x17:Completed 780000 out of 2000000 steps (39%)
20:09:49:WU01:FS00:0x17:Completed 800000 out of 2000000 steps (40%)
20:11:28:WU01:FS00:0x17:Completed 820000 out of 2000000 steps (41%)
20:12:57:WU01:FS00:0x17:Completed 840000 out of 2000000 steps (42%)
20:14:36:WU01:FS00:0x17:Completed 860000 out of 2000000 steps (43%)
20:16:05:WU01:FS00:0x17:Completed 880000 out of 2000000 steps (44%)
20:17:33:WU01:FS00:0x17:Completed 900000 out of 2000000 steps (45%)
20:19:12:WU01:FS00:0x17:Completed 920000 out of 2000000 steps (46%)
20:20:41:WU01:FS00:0x17:Completed 940000 out of 2000000 steps (47%)
20:22:20:WU01:FS00:0x17:Completed 960000 out of 2000000 steps (48%)
20:23:48:WU01:FS00:0x17:Completed 980000 out of 2000000 steps (49%)
20:25:17:WU01:FS00:0x17:Completed 1000000 out of 2000000 steps (50%)
20:26:56:WU01:FS00:0x17:Completed 1020000 out of 2000000 steps (51%)
20:28:24:WU01:FS00:0x17:Completed 1040000 out of 2000000 steps (52%)
20:30:04:WU01:FS00:0x17:Completed 1060000 out of 2000000 steps (53%)
20:31:33:WU01:FS00:0x17:Completed 1080000 out of 2000000 steps (54%)
20:33:01:WU01:FS00:0x17:Completed 1100000 out of 2000000 steps (55%)
20:34:40:WU01:FS00:0x17:Completed 1120000 out of 2000000 steps (56%)
20:36:09:WU01:FS00:0x17:Completed 1140000 out of 2000000 steps (57%)
20:37:48:WU01:FS00:0x17:Completed 1160000 out of 2000000 steps (58%)
20:39:17:WU01:FS00:0x17:Completed 1180000 out of 2000000 steps (59%)
20:40:45:WU01:FS00:0x17:Completed 1200000 out of 2000000 steps (60%)
20:42:25:WU01:FS00:0x17:Completed 1220000 out of 2000000 steps (61%)
20:43:53:WU01:FS00:0x17:Completed 1240000 out of 2000000 steps (62%)
20:45:32:WU01:FS00:0x17:Completed 1260000 out of 2000000 steps (63%)
20:47:01:WU01:FS00:0x17:Completed 1280000 out of 2000000 steps (64%)
20:48:29:WU01:FS00:0x17:Completed 1300000 out of 2000000 steps (65%)
20:50:09:WU01:FS00:0x17:Completed 1320000 out of 2000000 steps (66%)
20:51:37:WU01:FS00:0x17:Completed 1340000 out of 2000000 steps (67%)
20:53:16:WU01:FS00:0x17:Completed 1360000 out of 2000000 steps (68%)
20:54:44:WU01:FS00:0x17:Completed 1380000 out of 2000000 steps (69%)
20:56:12:WU01:FS00:0x17:Completed 1400000 out of 2000000 steps (70%)
20:57:52:WU01:FS00:0x17:Completed 1420000 out of 2000000 steps (71%)
20:59:20:WU01:FS00:0x17:Completed 1440000 out of 2000000 steps (72%)
21:01:00:WU01:FS00:0x17:Completed 1460000 out of 2000000 steps (73%)
21:02:28:WU01:FS00:0x17:Completed 1480000 out of 2000000 steps (74%)
21:03:56:WU01:FS00:0x17:Completed 1500000 out of 2000000 steps (75%)
21:05:36:WU01:FS00:0x17:Completed 1520000 out of 2000000 steps (76%)
21:07:04:WU01:FS00:0x17:Completed 1540000 out of 2000000 steps (77%)
21:08:44:WU01:FS00:0x17:Completed 1560000 out of 2000000 steps (78%)
21:10:12:WU01:FS00:0x17:Completed 1580000 out of 2000000 steps (79%)
21:11:41:WU01:FS00:0x17:Completed 1600000 out of 2000000 steps (80%)
21:13:20:WU01:FS00:0x17:Completed 1620000 out of 2000000 steps (81%)
21:14:48:WU01:FS00:0x17:Completed 1640000 out of 2000000 steps (82%)
21:16:28:WU01:FS00:0x17:Completed 1660000 out of 2000000 steps (83%)
21:17:56:WU01:FS00:0x17:Completed 1680000 out of 2000000 steps (84%)
21:19:25:WU01:FS00:0x17:Completed 1700000 out of 2000000 steps (85%)
21:21:04:WU01:FS00:0x17:Completed 1720000 out of 2000000 steps (86%)
21:22:32:WU01:FS00:0x17:Completed 1740000 out of 2000000 steps (87%)
21:24:12:WU01:FS00:0x17:Completed 1760000 out of 2000000 steps (88%)
21:25:40:WU01:FS00:0x17:Completed 1780000 out of 2000000 steps (89%)
21:27:08:WU01:FS00:0x17:Completed 1800000 out of 2000000 steps (90%)
21:28:48:WU01:FS00:0x17:Completed 1820000 out of 2000000 steps (91%)
21:30:16:WU01:FS00:0x17:Completed 1840000 out of 2000000 steps (92%)
21:31:56:WU01:FS00:0x17:Completed 1860000 out of 2000000 steps (93%)
21:33:24:WU01:FS00:0x17:Completed 1880000 out of 2000000 steps (94%)
21:34:52:WU01:FS00:0x17:Completed 1900000 out of 2000000 steps (95%)
21:36:32:WU01:FS00:0x17:Completed 1920000 out of 2000000 steps (96%)
21:38:00:WU01:FS00:0x17:Completed 1940000 out of 2000000 steps (97%)
21:39:40:WU01:FS00:0x17:Completed 1960000 out of 2000000 steps (98%)
21:41:08:WU01:FS00:0x17:Completed 1980000 out of 2000000 steps (99%)
21:42:36:WU01:FS00:0x17:Completed 2000000 out of 2000000 steps (100%)
21:42:37:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
21:42:37:WU02:FS00:News: Welcome to Folding@Home
21:42:37:WU02:FS00:Assigned to work server 171.64.65.69
21:42:37:WU02:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:GK110 [GeForce GTX 780] from 171.64.65.69
21:42:37:WU02:FS00:Connecting to 171.64.65.69:8080
21:42:37:WU02:FS00:Downloading 4.17MiB
21:42:40:WU02:FS00:Download complete
21:42:40:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:830 clone:0 gen:56 core:0x17 unit:0x00000055028c126651a6df41c9fb5b75
21:42:48:WU01:FS00:0x17:Saving result file logfile_01.txt
21:42:48:WU01:FS00:0x17:Saving result file checkpointState.xml
21:42:49:WU01:FS00:0x17:Saving result file checkpt.crc
21:42:49:WU01:FS00:0x17:Saving result file log.txt
21:42:49:WU01:FS00:0x17:Saving result file positions.xtc
21:42:50:WU01:FS00:0x17:Folding@home Core Shutdown: FINISHED_UNIT
21:42:50:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
21:42:50:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:7810 run:0 clone:424 gen:291 core:0x17 unit:0x000001350a3b1e8651d34a72797a193b
21:42:50:WU01:FS00:Uploading 5.77MiB to 171.64.65.98
21:42:50:WU02:FS00:Starting
21:42:50:WU01:FS00:Connecting to 171.64.65.98:8080
21:42:50:WU02:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Admin/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 3840 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
21:42:50:WU02:FS00:Started FahCore on PID 4184
21:42:50:WU02:FS00:Core PID:7040
21:42:50:WU02:FS00:FahCore 0x17 started
21:42:51:WU02:FS00:0x17:*********************** Log Started 2013-10-11T21:42:50Z ***********************
21:42:51:WU02:FS00:0x17:Project: 8900 (Run 830, Clone 0, Gen 56)
21:42:51:WU02:FS00:0x17:Unit: 0x00000055028c126651a6df41c9fb5b75
21:42:51:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
21:42:51:WU02:FS00:0x17:Machine: 0
21:42:51:WU02:FS00:0x17:Reading tar file state.xml
21:42:51:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
21:42:51:WU01:FS00:Connecting to 171.64.65.98:80
21:42:52:WU02:FS00:0x17:Reading tar file system.xml
21:42:52:WU02:FS00:0x17:Reading tar file integrator.xml
21:42:52:WU02:FS00:0x17:Reading tar file core.xml
21:42:52:WU02:FS00:0x17:Digital signatures verified
21:42:53:WARNING:WU01:FS00:Exception: Failed to send results to work server: Failed to connect to 171.64.65.98:80: No connection could be made because the target machine actively refused it.
21:42:53:WU01:FS00:Trying to send results to collection server
21:42:53:WU01:FS00:Uploading 5.77MiB to 171.65.103.160
21:42:53:WU01:FS00:Connecting to 171.65.103.160:8080
21:42:59:WU01:FS00:Upload 25.99%
21:43:05:WU01:FS00:Upload 50.89%
21:43:11:WU01:FS00:Upload 77.96%
21:43:16:WU01:FS00:Upload complete
21:43:16:WU01:FS00:Server responded PLEASE_WAIT (464)
21:43:16:WARNING:WU01:FS00:Failed to send results, will try again later
21:43:16:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:7810 run:0 clone:424 gen:291 core:0x17 unit:0x000001350a3b1e8651d34a72797a193b
21:43:16:WU01:FS00:Uploading 5.77MiB to 171.64.65.98
21:43:16:WU01:FS00:Connecting to 171.64.65.98:8080
21:43:17:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
21:43:17:WU01:FS00:Connecting to 171.64.65.98:80
21:43:18:WARNING:WU01:FS00:Exception: Failed to send results to work server: Failed to connect to 171.64.65.98:80: No connection could be made because the target machine actively refused it.
21:43:18:WU01:FS00:Trying to send results to collection server
21:43:18:WU01:FS00:Uploading 5.77MiB to 171.65.103.160
21:43:18:WU01:FS00:Connecting to 171.65.103.160:8080
21:43:24:WU01:FS00:Upload 22.74%
21:43:30:WU01:FS00:Upload 49.81%
21:43:36:WU01:FS00:Upload 75.79%
21:43:41:WU01:FS00:Upload complete
21:43:41:WU01:FS00:Server responded PLEASE_WAIT (464)
21:43:41:WARNING:WU01:FS00:Failed to send results, will try again later
21:44:16:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:7810 run:0 clone:424 gen:291 core:0x17 unit:0x000001350a3b1e8651d34a72797a193b
21:44:16:WU01:FS00:Uploading 5.77MiB to 171.64.65.98
21:44:16:WU01:FS00:Connecting to 171.64.65.98:8080
21:44:17:WARNING:WU01:FS00:WorkServer connection failed on port 8080 trying 80
21:44:17:WU01:FS00:Connecting to 171.64.65.98:80
21:44:19:WARNING:WU01:FS00:Exception: Failed to send results to work server: Failed to connect to 171.64.65.98:80: No connection could be made because the target machine actively refused it.
21:44:19:WU01:FS00:Trying to send results to collection server
21:44:19:WU01:FS00:Uploading 5.77MiB to 171.65.103.160
21:44:19:WU01:FS00:Connecting to 171.65.103.160:8080
21:44:25:WU01:FS00:Upload 25.99%
21:44:29:WU00:FS01:0x17:Completed 560000 out of 2000000 steps (28%)
21:44:31:WU01:FS00:Upload 53.06%
21:44:37:WU01:FS00:Upload 77.96%
21:44:42:WU01:FS00:Upload complete
21:44:42:WU01:FS00:Server responded PLEASE_WAIT (464)
21:44:42:WARNING:WU01:FS00:Failed to send results, will try again later

[Joe_H]

One thing I would recommend based on your log is setting the client-type to advanced instead of beta. Unless you are actively participating in the Beta Team, we do not recommend use of beta. In this case it does not appear to be linked to your upload problem, but recently a beta core did go out that caused WU's to be rejected on return. The three projects using Core_17 so far have all been moved to advanced status, so using the advanced setting should usually get assignments from those projects.

[7im]

Forum guidelines suggest any beta discussion get moved to the beta section. No further discussions in this public section.