Project 6903

[Jester]

Project 6903
Run 5, Clone 16, Gen 16
Completed and uploaded in 2.5 days but only base points ?

[Nathan_P]

and downloaded when?

by the sounds of it you machine has downloaded the WU, started it - had to abort for some reason and has restarted and completed the WU, but the server clock starts ticking from the initial download. Check back through the logs for any error messages and then let us know what they say - hopefully we can point you in the right direction for troubleshooting

[bruce]

Confirming what Nathan_P suggested. You'll have to search back to: 2011-11-24 13:43:37 PST or 21:43:37 UTC to see when it was originally assigned.

[Jester]

Confirming what Nathan_P suggested. You'll have to search back to: 2011-11-24 13:43:37 PST or 21:43:37 UTC to see when it was originally assigned.

No record in the logs of that Wu previously back to the 20th (November),
Project 6903
Run 5, Clone 16, Gen 16

downloaded 28th, uploaded 30th, back as far as the 20th it's all P6904 Wu's, this is on the only system configured for BA12 Wu's,
other running rigs are Win based so no BA12 Wu's for them anyway.....

[codysluder]

Please post the segment of the log surrounding the time mentioned by bruce. I'm beginning to suspect a system-wide bug but I have not seen enough data to know what we might need to be looking for.

[Jester]

Please post the segment of the log surrounding the time mentioned by bruce. I'm beginning to suspect a system-wide bug but I have not seen enough data to know what we might need to be looking for.

Here's the log file with only the working frames removed:

Code: Select all

[08:25:22] Core found.
[08:25:22] Working on queue slot 09 [November 21 08:25:22 UTC]
[08:25:22] + Working ...
[08:25:22] 
[08:25:22] *------------------------------*
[08:25:22] Folding@Home Gromacs SMP Core
[08:25:22] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[08:25:22] 
[08:25:22] Preparing to commence simulation
[08:25:22] - Assembly optimizations manually forced on.
[08:25:22] - Not checking prior termination.
[08:25:26] - Expanded 57217101 -> 71843392 (decompressed 50.4 percent)
[08:25:26] Called DecompressByteArray: compressed_data_size=57217101 data_size=71843392, decompressed_data_size=71843392 diff=0
[08:25:26] - Digital signature verified
[08:25:26] 
[08:25:26] Project: 6904 (Run 1, Clone 7, Gen 49)
[08:25:26] 
[08:25:26] Assembly optimizations on if available.
[08:25:26] Entering M.D.
[08:25:33] Mapping NT from 16 to 16 
[08:25:38] Completed 0 out of 250000 steps  (0%)
[09:15:47] Completed 2500 out of 250000 steps  (1%)
[19:50:06] Completed 250000 out of 250000 steps  (100%)
[19:50:26] DynamicWrapper: Finished Work Unit: sleep=10000
[19:50:36] 
[19:50:36] Finished Work Unit:
[19:50:36] - Reading up to 121544064 from "work/wudata_09.trr": Read 121544064
[19:50:37] trr file hash check passed.
[19:50:37] - Reading up to 108715236 from "work/wudata_09.xtc": Read 108715236
[19:50:37] xtc file hash check passed.
[19:50:37] edr file hash check passed.
[19:50:37] logfile size: 217753
[19:50:37] Leaving Run
[19:50:40] - Writing 230650045 bytes of core data to disk...
[19:51:13] Done: 230649533 -> 222315470 (compressed to 3.2 percent)
[19:51:13]   ... Done.
[20:40:05] - Shutting down core
[20:40:05] 
[20:40:05] Folding@home Core Shutdown: FINISHED_UNIT
[20:45:18] CoreStatus = 64 (100)
[20:45:18] Sending work to server
[20:45:18] Project: 6904 (Run 1, Clone 7, Gen 49)


[20:45:18] + Attempting to send results [November 24 20:45:18 UTC]
[21:19:11] - Couldn't send HTTP request to server
[21:19:11] + Could not connect to Work Server (results)
[21:19:11]     (130.237.232.237:8080)
[21:19:11] + Retrying using alternative port
[21:30:11] - Couldn't send HTTP request to server
[21:30:11] + Could not connect to Work Server (results)
[21:30:11]     (130.237.232.237:80)
[21:30:11] - Error: Could not transmit unit 09 (completed November 24) to work server.
[21:30:11]   Keeping unit 09 in queue.
[21:30:11] Project: 6904 (Run 1, Clone 7, Gen 49)


[21:30:11] + Attempting to send results [November 24 21:30:11 UTC]
[21:37:49] - Couldn't send HTTP request to server
[21:37:49] + Could not connect to Work Server (results)
[21:37:49]     (130.237.232.237:8080)
[21:37:49] + Retrying using alternative port
[21:37:52] - Couldn't send HTTP request to server
[21:37:52] + Could not connect to Work Server (results)
[21:37:52]     (130.237.232.237:80)
[21:37:52] - Error: Could not transmit unit 09 (completed November 24) to work server.


[21:37:52] + Attempting to send results [November 24 21:37:52 UTC]
[21:37:53] - Couldn't send HTTP request to server
[21:37:53] + Could not connect to Work Server (results)
[21:37:53]     (130.237.165.141:8080)
[21:37:53] + Retrying using alternative port
[21:37:53] - Couldn't send HTTP request to server
[21:37:53] + Could not connect to Work Server (results)
[21:37:53]     (130.237.165.141:80)
[21:37:53]   Could not transmit unit 09 to Collection server; keeping in queue.
[21:37:53] - Preparing to get new work unit...
[21:37:53] Cleaning up work directory
[21:43:28] + Attempting to get work packet
[21:43:28] Passkey found
[21:43:28] - Connecting to assignment server
[21:44:08] + Could not connect to Assignment Server
[21:44:13] + Could not connect to Assignment Server 2
[21:44:13] + Couldn't get work instructions.
[21:44:13] - Attempt #1  to get work failed, and no other work to do.
Waiting before retry.
[21:44:27] + Attempting to get work packet
[21:44:27] Passkey found
[21:44:27] - Connecting to assignment server
[21:44:28] - Successful: assigned to (130.237.232.237).
[21:44:28] + News From Folding@Home: Welcome to Folding@Home
[21:44:28] Loaded queue successfully.
[23:16:17] + Could not get Work unit data from Work Server
[23:16:17] - Attempt #2  to get work failed, and no other work to do.
Waiting before retry.
[23:16:36] + Attempting to get work packet
[23:16:36] Passkey found
[23:16:36] - Connecting to assignment server
[23:16:37] - Successful: assigned to (130.237.232.237).
[23:16:37] + News From Folding@Home: Welcome to Folding@Home
[23:16:38] Loaded queue successfully.
[23:24:32] Project: 6904 (Run 1, Clone 7, Gen 49)


[23:24:32] + Attempting to send results [November 24 23:24:32 UTC]
[00:10:13] + Results successfully sent
[00:10:13] Thank you for your contribution to Folding@Home.
[00:10:13] + Number of Units Completed: 71

[00:30:20] + Closed connections
[00:30:20] 
[00:30:20] + Processing work unit
[00:30:20] Core required: FahCore_a5.exe
[00:30:20] Core found.
[00:30:20] Working on queue slot 00 [November 25 00:30:20 UTC]
[00:30:20] + Working ...
[00:30:20] 
[00:30:20] *------------------------------*
[00:30:20] Folding@Home Gromacs SMP Core
[00:30:20] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[00:30:20] 
[00:30:20] Preparing to commence simulation
[00:30:20] - Assembly optimizations manually forced on.
[00:30:20] - Not checking prior termination.
[00:30:24] - Expanded 57218013 -> 71843392 (decompressed 50.4 percent)
[00:30:24] Called DecompressByteArray: compressed_data_size=57218013 data_size=71843392, decompressed_data_size=71843392 diff=0
[00:30:24] - Digital signature verified
[00:30:24] 
[00:30:24] Project: 6904 (Run 0, Clone 37, Gen 47)
[00:30:24] 
[00:30:24] Assembly optimizations on if available.
[00:30:24] Entering M.D.
[00:30:32] Mapping NT from 16 to 16 
[00:30:37] Completed 0 out of 250000 steps  (0%)
[01:20:23] Completed 2500 out of 250000 steps  (1%)

[11:27:03] Completed 250000 out of 250000 steps  (100%)
[11:27:23] DynamicWrapper: Finished Work Unit: sleep=10000
[11:27:33] 
[11:27:33] Finished Work Unit:
[11:27:33] - Reading up to 121544064 from "work/wudata_00.trr": Read 121544064
[11:27:34] trr file hash check passed.
[11:27:34] - Reading up to 108711744 from "work/wudata_00.xtc": Read 108711744
[11:27:34] xtc file hash check passed.
[11:27:34] edr file hash check passed.
[11:27:34] logfile size: 217625
[11:27:34] Leaving Run
[11:27:37] - Writing 230646425 bytes of core data to disk...
[11:28:10] Done: 230645913 -> 222314095 (compressed to 3.2 percent)
[11:28:10]   ... Done.
[12:16:37] - Shutting down core
[12:16:37] 
[12:16:37] Folding@home Core Shutdown: FINISHED_UNIT
[12:21:47] CoreStatus = 64 (100)
[12:21:47] Sending work to server
[12:21:47] Project: 6904 (Run 0, Clone 37, Gen 47)


[12:21:47] + Attempting to send results [November 28 12:21:47 UTC]
[13:42:12] + Results successfully sent
[13:42:12] Thank you for your contribution to Folding@Home.
[13:42:12] + Number of Units Completed: 72

[14:02:08] - Preparing to get new work unit...
[14:02:08] Cleaning up work directory
[14:04:35] + Attempting to get work packet
[14:04:35] Passkey found
[14:04:35] - Connecting to assignment server
[14:04:36] - Successful: assigned to (130.237.232.237).
[14:04:36] + News From Folding@Home: Welcome to Folding@Home
[14:04:36] Loaded queue successfully.
[14:14:10] + Closed connections
[14:14:10] 
[14:14:10] + Processing work unit
[14:14:10] Core required: FahCore_a5.exe
[14:14:10] Core found.
[14:14:10] Working on queue slot 01 [November 28 14:14:10 UTC]
[14:14:10] + Working ...
[14:14:10] 
[14:14:10] *------------------------------*
[14:14:10] Folding@Home Gromacs SMP Core
[14:14:10] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[14:14:10] 
[14:14:10] Preparing to commence simulation
[14:14:10] - Assembly optimizations manually forced on.
[14:14:10] - Not checking prior termination.
[14:14:14] - Expanded 57243864 -> 71846524 (decompressed 50.4 percent)
[14:14:14] Called DecompressByteArray: compressed_data_size=57243864 data_size=71846524, decompressed_data_size=71846524 diff=0
[14:14:14] - Digital signature verified
[14:14:14] 
[14:14:14] Project: 6903 (Run 5, Clone 16, Gen 16)
[14:14:14] 
[14:14:14] Assembly optimizations on if available.
[14:14:14] Entering M.D.
[14:14:21] Mapping NT from 16 to 16 
[14:14:24] Completed 0 out of 250000 steps  (0%)
[14:48:06] Completed 2500 out of 250000 steps  (1%)

[22:17:42] Completed 250000 out of 250000 steps  (100%)
[22:18:02] DynamicWrapper: Finished Work Unit: sleep=10000
[22:18:12] 
[22:18:12] Finished Work Unit:
[22:18:12] - Reading up to 121622496 from "work/wudata_01.trr": Read 121622496
[22:18:13] trr file hash check passed.
[22:18:13] - Reading up to 108849940 from "work/wudata_01.xtc": Read 108849940
[22:18:13] xtc file hash check passed.
[22:18:13] edr file hash check passed.
[22:18:13] logfile size: 210299
[22:18:13] Leaving Run
[22:18:15] - Writing 230855727 bytes of core data to disk...
[22:18:49] Done: 230855215 -> 222503058 (compressed to 3.3 percent)
[22:18:49]   ... Done.
[23:07:00] - Shutting down core
[23:07:00] 
[23:07:00] Folding@home Core Shutdown: FINISHED_UNIT
[23:12:08] CoreStatus = 64 (100)
[23:12:08] Sending work to server
[23:12:08] Project: 6903 (Run 5, Clone 16, Gen 16)


[23:12:08] + Attempting to send results [November 30 23:12:08 UTC]
[00:03:05] + Results successfully sent
[00:03:05] Thank you for your contribution to Folding@Home.
[00:03:05] + Number of Units Completed: 73

[bruce]

Wow. The message "Could not get Work unit data from Work Server" is sort of an uncommon message but I've never seen it take an hour and a half to recognize an error. I wonder what it was doing during that time?

Code: Select all

[21:44:28] + News From Folding@Home: Welcome to Folding@Home
[21:44:28] Loaded queue successfully.
[23:16:17] + Could not get Work unit data from Work Server
[23:16:17] - Attempt #2  to get work failed, and no other work to do.

A one minute difference between the server clock and your local clock can easily account for the difference between 21:43:37 and 21:44:28.

[Jester]

Whatever it was doing there's nothing there to suggest it uploaded the Wu in question and then
somehow deleted it ?
I had a look in the "previous" log too, it's been sending and receiving with no hint of missing deadlines.

[bruce]

Given the history of that server, it was very likely was having troubles at that time. I suppose it checked out a WU to issue to you and then something unexplained happened. Later the server reissued the same WU to you and you completed it. When the QRB sees two reports of a WU being downloaded, it always measures the time from the oldest one until the WU was returned.

[Jester]

Well, at least the Wu got to where it was supposed to,
I might not have noticed the missing bonus when all rigs were folding Bigadv Wu's,
but thanks to the "Changes" in the last few months the SR-2 is the only rig Folding now so it "stuck out" a little,
just another little "bitter pill" to swallow I suppose.......