Page 1 of 2
129.74.85.48 - Server has no record of unit
Posted: Thu Apr 01, 2010 2:16 am
by Hyperlife
I've got a lone p10005 WU that can't be uploaded because this server has no record of the WU:
Code: Select all
[01:29:22] - Autosending finished units... [April 1 01:29:22 UTC]
[01:29:22] Trying to send all finished work units
[01:29:22] Project: 10005 (Run 4930, Clone 0, Gen 9)
[01:29:22] - Read packet limit of 540015616... Set to 524286976.
[01:29:22] + Attempting to send results [April 1 01:29:22 UTC]
[01:29:22] - Reading file work/wuresults_05.dat from core
[01:29:23] (Read 1247883 bytes from disk)
[01:29:23] Connecting to http://129.74.85.48:8080/
[01:30:29] Posted data.
[01:30:29] Initial: 0000; - Uploaded at ~18 kB/s
[01:30:29] - Averaged speed for that direction ~26 kB/s
[01:30:29] - Server does not have record of this unit. Will try again later.
[01:30:29] - Error: Could not transmit unit 05 (completed March 30) to work server.
[01:30:29] - 18 failed uploads of this unit.
[01:30:29] - Read packet limit of 540015616... Set to 524286976.
[01:30:29] + Attempting to send results [April 1 01:30:29 UTC]
[01:30:29] - Reading file work/wuresults_05.dat from core
[01:30:29] (Read 1247883 bytes from disk)
[01:30:29] Connecting to http://129.74.85.49:8080/
[01:31:42] Posted data.
[01:31:42] Initial: 0000; - Uploaded at ~16 kB/s
[01:31:42] - Averaged speed for that direction ~24 kB/s
[01:31:42] - Server does not have record of this unit. Will try again later.
[01:31:42] Could not transmit unit 05 to Collection server; keeping in queue.
[01:31:42] + Sent 0 of 1 completed units to the server
[01:31:42] - Autosend completed
I notice that p10005 has been taken off of psummary -- could this be why the server doesn't want the WU?
Note that this server (.48) is the actual work server and not the collection server (which is 129.74.85.49).
Re: 129.74.85.48 - Server has no record of unit
Posted: Thu Apr 01, 2010 3:43 am
by tacoma43
I'm having the same problem with
Project: 10008 (Run 2455, Clone 0, Gen 12)
Re: 129.74.85.48 - Server has no record of unit
Posted: Thu Apr 01, 2010 7:24 am
by bruce
Well, it's better for a Collection Server to tell you that it can't upload your WU than to accept it and then discard it. The primary server does have a problem with a NETLOAD that is out of sight. I'll notify the server owner, but it's 03:30 there, so everybody is sleeping.
Re: 129.74.85.48 - Server has no record of unit
Posted: Thu Apr 01, 2010 12:38 pm
by _r2w_ben
bruce wrote:The primary server does have a problem with a NETLOAD that is out of sight. I'll notify the server owner, but it's 03:30 there, so everybody is sleeping.
There isn't enough classic work available so as soon as .48 tells the AS it has work to assign, it gets swamped.
Earlier this week,
gbowman stopped assignments on 171.67.108.13 because of NETLOAD. That appears to have stabilized and in the meantime has created 12000+ work units. Handing those out would reduce the load on .48 and provide work to quite a number of idling clients.
Re: 129.74.85.48 - Server has no record of unit
Posted: Thu Apr 01, 2010 1:22 pm
by abdulwahidc
bruce wrote:Well, it's better for a Collection Server to tell you that it can't upload your WU than to accept it and then discard it. The primary server does have a problem with a NETLOAD that is out of sight. I'll notify the server owner, but it's 03:30 there, so everybody is sleeping.
We're aware of the problem and working to fix it.
Thanks
Re: 129.74.85.48 - Server has no record of unit
Posted: Thu Apr 01, 2010 10:56 pm
by tacoma43
Your efforts will be too late for me — my client has magically stopped trying to send my WU and reports that no unsent units remain even though the logs show that it was never sent and the files remain in my Work folder.
When my current WU is finished in a few minutes and successfully submitted, I'm shutting down my client and giving it a lo-o-o-o-o-o-ng rest to give the people at Stanford a chance to get their act together.
Unless. of course, somebody can suggest something to minimize the chances of having completed WUs rejected because of errors or no records...
Re: 129.74.85.48 - Server has no record of unit
Posted: Fri Apr 02, 2010 12:17 am
by 7im
I'd like to see that log. WUs don't magically stop trying to send unless something happens.
Please also post the Project, Run, Clone, and Gen number for that work unit so someone can look in to the problem, check server logs, that sort of thing. It's hard to suggest anything without more information.
Re: 129.74.85.48 - Server has no record of unit
Posted: Fri Apr 02, 2010 1:22 am
by bruce
7im wrote:I'd like to see that log. WUs don't magically stop trying to send unless something happens.
Please also post the Project, Run, Clone, and Gen number for that work unit so someone can look in to the problem, check server logs, that sort of thing. It's hard to suggest anything without more information.
One thing that's certain to happen to WUs that don't upload is that eventually they'll expire and be deleted by the client. That may not be what happened in your case, but 7im's request for FAHlog is a reasonable request.
Re: 129.74.85.48 - Server has no record of unit
Posted: Fri Apr 02, 2010 9:31 am
by KroontjesPen
For the record.
Code: Select all
[21:23:08] - Machine ID: 1
[21:23:08]
[21:23:08] Loaded queue successfully.
[21:23:08] Initialization complete
[21:23:08]
[21:23:08] + Processing work unit
[21:23:08] Project: 10008 (Run 1519, Clone 0, Gen 11)
[21:23:08] - Read packet limit of 540015616... Set to 524286976.
[21:23:08] + Attempting to send results [April 1 21:23:08 UTC]
[21:23:08] Core required: FahCore_78.exe
[21:23:08] Core found.
[21:23:08] Working on queue slot 06 [April 1 21:23:08 UTC]
[21:23:08] + Working ...
[21:23:08]
[21:23:08] *------------------------------*
[21:23:08] Folding@Home Gromacs Core
[21:23:08] Version 1.90 (March 8, 2006)
[21:23:08]
[21:23:08] Preparing to commence simulation
[21:23:08] - Looking at optimizations...
[21:23:08] - Files status OK
[21:23:08] - Expanded 463366 -> 2244013 (decompressed 484.2 percent)
[21:23:08]
[21:23:08] Project: 6313 (Run 716, Clone 9, Gen 24)
[21:23:08]
[21:23:08] Assembly optimizations on if available.
[21:23:08] Entering M.D.
[21:23:09] - Couldn't send HTTP request to server
[21:23:09] + Could not connect to Work Server (results)
[21:23:09] (129.74.85.48:8080)
[21:23:09] + Retrying using alternative port
[21:23:28] (Starting from checkpoint)
[21:23:28] Protein: p6313_sh3_with_ALA_frags
[21:23:28]
[21:23:28] Writing local files
[21:23:28] Completed 75000 out of 500000 steps (15%)
[21:23:28] Extra SSE boost OK.
[21:23:30] - Couldn't send HTTP request to server
[21:23:30] + Could not connect to Work Server (results)
[21:23:30] (129.74.85.48:80)
[21:23:30] - Error: Could not transmit unit 05 (completed April 1) to work server.
[21:23:30] - Read packet limit of 540015616... Set to 524286976.
[21:23:30] + Attempting to send results [April 1 21:23:30 UTC]
[21:24:27] - Server does not have record of this unit. Will try again later.
[21:24:27] Could not transmit unit 05 to Collection server; keeping in queue.
[21:33:04] Writing local files
[21:33:04] Completed 80000 out of 500000 steps (16%)
[21:42:38] Writing local files
............
.........
[03:12:17] Completed 255000 out of 500000 steps (51%)
[03:21:56] Writing local files
[03:21:56] Completed 260000 out of 500000 steps (52%)
[03:24:28] Project: 10008 (Run 1519, Clone 0, Gen 11)
[03:24:28] - Read packet limit of 540015616... Set to 524286976.
[03:24:28] + Attempting to send results [April 2 03:24:28 UTC]
[03:27:02] - Server reports problem with unit.
[03:31:34] Writing local files
[03:31:34] Completed 265000 out of 500000 steps (53%)
..........
......
[09:27:40] Printing Queue Information
Current Queue:
Slot 07 Empty/Deleted
Project: 1771 (Run 3, Clone 86, Gen 2), Core: a0
Work server: 134.139.127.31:8080
Collection server: 134.139.127.34
Download date: March 25 09:08:35
Finished date: March 27 12:15:13
Slot 08 Empty/Deleted
Project: 6316 (Run 269, Clone 8, Gen 33), Core: 78
Work server: 171.64.65.111:8080
Collection server: 171.67.108.17
Download date: March 27 12:16:27
Finished date: March 28 03:37:02
Slot 09 Empty/Deleted
Project: 2613 (Run 37, Clone 5, Gen 138), Core: 78
Work server: 171.64.65.65:8080
Collection server: 171.67.108.25
Download date: March 28 03:38:23
Finished date: March 29 04:07:52
Slot 00 Empty/Deleted
Project: 6316 (Run 360, Clone 5, Gen 37), Core: 78
Work server: 171.64.65.111:8080
Collection server: 171.67.108.17
Download date: March 29 07:41:09
Finished date: March 29 23:56:10
Slot 01 Empty/Deleted
Project: 10004 (Run 3508, Clone 0, Gen 5), Core: b4
Work server: 129.74.85.48:8080
Collection server: 129.74.85.49
Download date: March 29 23:57:16
Finished date: March 30 08:00:03
Failed uploads: 1
Slot 02 Empty/Deleted
Project: 6314 (Run 113, Clone 14, Gen 42), Core: 78
Work server: 171.64.65.111:8080
Collection server: 171.67.108.17
Download date: March 30 08:24:32
Finished date: March 31 00:42:42
Slot 03 Empty/Deleted
Project: 6316 (Run 175, Clone 10, Gen 42), Core: 78
Work server: 171.64.65.111:8080
Collection server: 171.67.108.17
Download date: March 31 00:43:49
Finished date: March 31 16:51:18
Slot 04 Empty/Deleted
Project: 6316 (Run 234, Clone 11, Gen 42), Core: 78
Work server: 171.64.65.111:8080
Collection server: 171.67.108.17
Download date: March 31 16:53:26
Finished date: April 1 09:20:44
******************************************************************
Slot 05 Empty/Deleted
Project: 10008 (Run 1519, Clone 0, Gen 11), Core: b4
Work server: 129.74.85.48:8080
Collection server: 129.74.85.16
Download date: April 1 09:21:47
Finished date: April 1 18:51:47
*****************************************************************
Slot 06 *Ready
Project: 6313 (Run 716, Clone 9, Gen 24), Core: 78
Work server: 171.64.65.111:8080
Collection server: 171.67.108.17
Download date: April 1 18:54:26
Deadline date: May 23 18:54:26
PF: 0.982998 based on last 4 slot(s)
High lights ****** round slot 5 done by me.
Re: 129.74.85.48 - Server has no record of unit
Posted: Fri Apr 02, 2010 2:39 pm
by tacoma43
On close inspection of my FAHlog, I have found the dreaded...
Code: Select all
[09:15:51] - Server reports problem with unit.
[edit]As I noted in my OP it was Project: 10008 (Run 2455, Clone 0, Gen 12).[/edit]
This is the second WU in a row (plus at least one other since November) that has been lost due to this ambiguous "problem", which elsewhere in this Forum has been attributed to being due to either my client or computer.
You can't possibly know what has happened to
my client or computer, and I can't even begin to guess what might have changed.
Is it time to uninstall and then download/install all new software?
Re: 129.74.85.48 - Server has no record of unit
Posted: Fri Apr 02, 2010 3:06 pm
by Hyperlife
For what it's worth, my WU did upload correctly last night:
Code: Select all
[07:37:19] - Autosending finished units... [April 2 07:37:19 UTC]
[07:37:19] Trying to send all finished work units
[07:37:19] Project: 10005 (Run 4930, Clone 0, Gen 9)
[07:37:19] - Read packet limit of 540015616... Set to 524286976.
[07:37:19] + Attempting to send results [April 2 07:37:19 UTC]
[07:37:19] - Reading file work/wuresults_05.dat from core
[07:37:19] (Read 1247883 bytes from disk)
[07:37:19] Connecting to http://129.74.85.48:8080/
[07:40:15] Posted data.
[07:40:15] Initial: 0000; - Uploaded at ~6 kB/s
[07:40:15] - Averaged speed for that direction ~35 kB/s
[07:40:15] + Results successfully sent
[07:40:15] Thank you for your contribution to Folding@Home.
[07:40:15] + Number of Units Completed: 569
[07:40:16] + Sent 1 of 1 completed units to the server
[07:40:16] - Autosend completed
Re: 129.74.85.48 - Server has no record of unit
Posted: Fri Apr 02, 2010 3:49 pm
by abdulwahidc
Hyperlife wrote:For what it's worth, my WU did upload correctly last night
We did get the servers back up last night.
Re: 129.74.85.48 - Server has no record of unit
Posted: Fri Apr 02, 2010 9:01 pm
by tacoma43
I was able to successfully upload a Project: 4604 WU yesterday so, temporarily at least, my time and CPUs aren't being wasted.
I think both of the previous WUs that failed to upload were Project: 10008s, all of which suggests the problem is at the Stanford end.
Re: 129.74.85.48 - Server has no record of unit
Posted: Fri Apr 02, 2010 11:00 pm
by Flathead74
tacoma43 wrote:I was able to successfully upload a Project: 4604 WU yesterday so, temporarily at least, my time and CPUs aren't being wasted.
I think both of the previous WUs that failed to upload were Project: 10008s, all of which suggests the problem is at the Stanford end.
Someone most likely
could tell the cause of failure, if you had/would post your Fahlog including the portions that show
how F@H is being started, especially if you are employing the -verbosity 9 flag.
The portion that you did post could be caused by the relavent server being temporarily off-line.
[09:15:51] - Server reports problem with unit.
The client will automatically attempt to upload any completed work units, every six hours.
Happy Folding
Re: 129.74.85.48 - Server has no record of unit
Posted: Sat Apr 03, 2010 12:14 am
by tacoma43
Code: Select all
Launch directory: C:\FAH
Executable: C:\FAH\fah6.exe
Arguments: -verbosity 9
[02:56:29] - Ask before connecting: No
[02:56:29] - User name: tacoma43 (Team 35586)
[02:56:29] - User ID: 1980A72A033B07F2
[02:56:29] - Machine ID: 1
[02:56:29]
[02:56:29] Loaded queue successfully.
[02:56:29]
[02:56:29] + Processing work unit
[02:56:29] Core required: FahCore_82.exe
[02:56:29] Core found.
[02:56:29] - Autosending finished units... [April 1 02:56:29 UTC]
[02:56:29] Trying to send all finished work units
[02:56:29] Project: 10008 (Run 2455, Clone 0, Gen 12)
[02:56:29] + Attempting to send results [April 1 02:56:29 UTC]
[02:56:29] - Reading file work/wuresults_02.dat from core
[02:56:29] Working on queue slot 03 [April 1 02:56:29 UTC]
[02:56:29] + Working ...
[02:56:29] - Calling '.\FahCore_82.exe -dir work/ -suffix 03 -priority 96 -checkpoint 3 -verbose -lifeline 3720 -version 623'
[02:56:29] (Read 978732 bytes from disk)
[02:56:29] Connecting to http://129.74.85.48:8080/
[02:56:55]
[02:56:55] *------------------------------*
[02:56:55] Folding@Home PMD Core
[02:56:55] Version 1.03 (September 7, 2005)
[02:56:55]
[02:56:55] Preparing to commence simulation
[02:56:55] - Looking at optimizations...
[02:56:59] - Files status OK
[02:57:03] - Expanded 16928 -> 105488 (decompressed 623.1 percent)
[02:57:03]
[02:57:03] Project: 4604 (Run 16, Clone 173, Gen 39)
[02:57:03]
[02:57:14] Assembly optimizations on if available.
[02:57:14] Entering M.D.
[02:59:18] - Couldn't send HTTP request to server
[02:59:18] + Could not connect to Work Server (results)
[02:59:18] (129.74.85.48:8080)
[02:59:18] + Retrying using alternative port
[02:59:18] Connecting to http://129.74.85.48:80/
[02:59:39] - Couldn't send HTTP request to server
[02:59:39] + Could not connect to Work Server (results)
[02:59:39] (129.74.85.48:80)
[02:59:39] - Error: Could not transmit unit 02 (completed March 30) to work server.
[02:59:39] - 7 failed uploads of this unit.
[02:59:39] + Attempting to send results [April 1 02:59:39 UTC]
[02:59:39] - Reading file work/wuresults_02.dat from core
[02:59:39] (Read 978732 bytes from disk)
[02:59:39] Connecting to http://129.74.85.49:8080/
[03:08:46] Posted data.
[03:08:46] Initial: 0000; - Uploaded at ~1 kB/s
[03:08:46] - Averaged speed for that direction ~2 kB/s
[03:08:46] - Server does not have record of this unit. Will try again later.
[03:08:46] Could not transmit unit 02 to Collection server; keeping in queue.
[03:08:46] + Sent 0 of 1 completed units to the server
[03:08:46] - Autosend completed
[03:13:37] Protein: p4604_T0_ww-12_minout
[03:13:37]
[03:13:37] Completed 330400 out of 2500000 steps (13%)
[03:13:37] Writing checkpoint files
[03:16:38] Writing checkpoint files
[03:19:38] Writing checkpoint files
[03:22:38] Writing checkpoint files
[03:24:55] Writing local files
[03:24:55] Completed 350000 out of 2500000 steps (14%)
[03:24:55] Writing checkpoint files
[03:27:55] Writing checkpoint files
[03:30:56] Writing checkpoint files
[03:33:57] Writing checkpoint files
[03:36:58] Writing checkpoint files
[03:39:51] Writing local files
[03:39:51] Completed 375000 out of 2500000 steps (15%)
[03:39:59] Writing checkpoint files
[03:43:00] Writing checkpoint files
[03:46:00] Writing checkpoint files
[03:49:00] Writing checkpoint files
[03:52:00] Writing checkpoint files
[03:54:33] Writing local files
[03:54:33] Completed 400000 out of 2500000 steps (16%)
[03:54:33] Writing checkpoint files
[03:57:33] Writing checkpoint files
[04:00:33] Writing checkpoint files
[04:03:33] Writing checkpoint files
[04:06:33] Writing checkpoint files
[04:07:30] Writing local files
[04:07:30] Completed 425000 out of 2500000 steps (17%)
[04:09:34] Writing checkpoint files
[04:12:35] Writing checkpoint files
[04:15:38] Writing checkpoint files
[04:18:39] Writing checkpoint files
[04:21:40] Writing checkpoint files
[04:24:40] Writing checkpoint files
[04:27:40] Writing checkpoint files
[04:30:41] Writing checkpoint files
[04:33:41] Writing checkpoint files
[04:36:48] Writing checkpoint files
[04:39:59] Writing checkpoint files
[04:43:01] Writing checkpoint files
[04:46:02] Writing checkpoint files
[04:46:48] Writing local files
[04:46:48] Completed 450000 out of 2500000 steps (18%)
[04:46:48] Writing checkpoint files
[04:49:49] Writing checkpoint files
[04:52:50] Writing checkpoint files
[04:55:50] Writing checkpoint files
[04:58:51] Writing checkpoint files
[05:01:51] Writing checkpoint files
[05:04:50] Writing checkpoint files
[05:05:55] Writing local files
[05:05:55] Completed 475000 out of 2500000 steps (19%)
[05:07:50] Writing checkpoint files
[05:10:50] Writing checkpoint files
[05:13:50] Writing checkpoint files
[05:16:50] Writing checkpoint files
[05:18:36] Writing local files
[05:18:36] Completed 500000 out of 2500000 steps (20%)
[05:18:36] Writing checkpoint files
[05:21:37] Writing checkpoint files
[05:24:37] Writing checkpoint files
[05:27:36] Writing checkpoint files
[05:30:37] Writing checkpoint files
[05:31:14] Writing local files
[05:31:14] Completed 525000 out of 2500000 steps (21%)
[05:33:36] Writing checkpoint files
[05:36:37] Writing checkpoint files
[05:39:37] Writing checkpoint files
[05:42:37] Writing checkpoint files
[05:44:01] Writing local files
[05:44:01] Completed 550000 out of 2500000 steps (22%)
[05:44:01] Writing checkpoint files
[05:47:02] Writing checkpoint files
[05:50:03] Writing checkpoint files
[05:53:04] Writing checkpoint files
[05:56:05] Writing checkpoint files
[05:56:41] Writing local files
[05:56:41] Completed 575000 out of 2500000 steps (23%)
[05:59:06] Writing checkpoint files
[06:02:07] Writing checkpoint files
[06:05:08] Writing checkpoint files
[06:08:09] Writing checkpoint files
[06:09:30] Writing local files
[06:09:30] Completed 600000 out of 2500000 steps (24%)
[06:09:30] Writing checkpoint files
[06:12:31] Writing checkpoint files
[06:15:32] Writing checkpoint files
[06:18:33] Writing checkpoint files
[06:21:33] Writing checkpoint files
[06:22:08] Writing local files
[06:22:08] Completed 625000 out of 2500000 steps (25%)
[06:24:33] Writing checkpoint files
[06:27:33] Writing checkpoint files
[06:30:33] Writing checkpoint files
[06:33:34] Writing checkpoint files
[06:34:47] Writing local files
[06:34:47] Completed 650000 out of 2500000 steps (26%)
[06:34:47] Writing checkpoint files
[06:37:47] Writing checkpoint files
[06:40:47] Writing checkpoint files
[06:43:47] Writing checkpoint files
[06:46:48] Writing checkpoint files
[06:47:39] Writing local files
[06:47:39] Completed 675000 out of 2500000 steps (27%)
[06:49:47] Writing checkpoint files
[06:52:48] Writing checkpoint files
[06:55:49] Writing checkpoint files
[06:58:49] Writing checkpoint files
[07:00:33] Writing local files
[07:00:33] Completed 700000 out of 2500000 steps (28%)
[07:00:33] Writing checkpoint files
[07:03:33] Writing checkpoint files
[07:06:34] Writing checkpoint files
[07:09:34] Writing checkpoint files
[07:12:34] Writing checkpoint files
[07:13:10] Writing local files
[07:13:10] Completed 725000 out of 2500000 steps (29%)
[07:15:35] Writing checkpoint files
[07:18:35] Writing checkpoint files
[07:21:35] Writing checkpoint files
[07:24:36] Writing checkpoint files
[07:25:45] Writing local files
[07:25:45] Completed 750000 out of 2500000 steps (30%)
[07:25:45] Writing checkpoint files
[07:28:46] Writing checkpoint files
[07:31:47] Writing checkpoint files
[07:34:48] Writing checkpoint files
[07:37:48] Writing checkpoint files
[07:38:27] Writing local files
[07:38:27] Completed 775000 out of 2500000 steps (31%)
[07:40:48] Writing checkpoint files
[07:43:48] Writing checkpoint files
[07:46:48] Writing checkpoint files
[07:49:48] Writing checkpoint files
[07:51:14] Writing local files
[07:51:14] Completed 800000 out of 2500000 steps (32%)
[07:51:14] Writing checkpoint files
[07:54:14] Writing checkpoint files
[07:57:15] Writing checkpoint files
[08:00:15] Writing checkpoint files
[08:03:14] Writing checkpoint files
[08:03:47] Writing local files
[08:03:47] Completed 825000 out of 2500000 steps (33%)
[08:06:15] Writing checkpoint files
[08:09:15] Writing checkpoint files
[08:12:16] Writing checkpoint files
[08:15:16] Writing checkpoint files
[08:16:39] Writing local files
[08:16:39] Completed 850000 out of 2500000 steps (34%)
[08:16:39] Writing checkpoint files
[08:19:39] Writing checkpoint files
[08:22:40] Writing checkpoint files
[08:25:40] Writing checkpoint files
[08:28:40] Writing checkpoint files
[08:30:00] Writing local files
[08:30:00] Completed 875000 out of 2500000 steps (35%)
[08:31:40] Writing checkpoint files
[08:34:40] Writing checkpoint files
[08:37:40] Writing checkpoint files
[08:40:41] Writing checkpoint files
[08:43:14] Writing local files
[08:43:14] Completed 900000 out of 2500000 steps (36%)
[08:43:14] Writing checkpoint files
[08:46:15] Writing checkpoint files
[08:49:16] Writing checkpoint files
[08:52:17] Writing checkpoint files
[08:55:18] Writing checkpoint files
[08:56:01] Writing local files
[08:56:01] Completed 925000 out of 2500000 steps (37%)
[08:58:18] Writing checkpoint files
[09:01:19] Writing checkpoint files
[09:04:18] Writing checkpoint files
[09:07:18] Writing checkpoint files
[09:08:43] Writing local files
[09:08:43] Completed 950000 out of 2500000 steps (38%)
[09:08:43] Writing checkpoint files
[09:08:46] - Autosending finished units... [April 1 09:08:46 UTC]
[09:08:46] Trying to send all finished work units
[09:08:46] Project: 10008 (Run 2455, Clone 0, Gen 12)
[09:08:46] + Attempting to send results [April 1 09:08:46 UTC]
[09:08:46] - Reading file work/wuresults_02.dat from core
[09:08:46] (Read 978732 bytes from disk)
[09:08:46] Connecting to http://129.74.85.48:8080/
[09:11:43] Writing checkpoint files
[09:14:44] Writing checkpoint files
[09:15:51] Posted data.
[09:15:51] Initial: 0000; - Uploaded at ~2 kB/s
[09:15:51] - Averaged speed for that direction ~2 kB/s
[09:15:51] - Server reports problem with unit.
[09:15:51] + Sent 0 of 1 completed units to the server
[09:15:51] - Autosend completed
[09:17:43] Writing checkpoint files
[09:20:43] Writing checkpoint files
[09:21:30] Writing local files
[09:21:30] Completed 975000 out of 2500000 steps (39%)
[09:23:44] Writing checkpoint files
[09:26:44] Writing checkpoint files
[09:29:43] Writing checkpoint files
[09:32:44] Writing checkpoint files
[09:34:08] Writing local files
[09:34:08] Completed 1000000 out of 2500000 steps (40%)
[09:34:08] Writing checkpoint files
[09:37:09] Writing checkpoint files
[09:40:09] Writing checkpoint files
[09:43:10] Writing checkpoint files
[09:46:11] Writing checkpoint files
[09:46:44] Writing local files
[09:46:44] Completed 1025000 out of 2500000 steps (41%)
[09:49:12] Writing checkpoint files
[09:52:13] Writing checkpoint files
[09:55:14] Writing checkpoint files
[09:58:14] Writing checkpoint files
[09:59:40] Writing local files
[09:59:40] Completed 1050000 out of 2500000 steps (42%)
[09:59:40] Writing checkpoint files
[10:02:41] Writing checkpoint files
[10:05:41] Writing checkpoint files
[10:08:42] Writing checkpoint files
[10:11:42] Writing checkpoint files
[10:12:22] Writing local files
[10:12:22] Completed 1075000 out of 2500000 steps (43%)
[10:14:43] Writing checkpoint files
[10:17:43] Writing checkpoint files
[10:20:43] Writing checkpoint files
[10:23:43] Writing checkpoint files
[10:25:09] Writing local files
[10:25:09] Completed 1100000 out of 2500000 steps (44%)
[10:25:09] Writing checkpoint files
[10:28:10] Writing checkpoint files
[10:31:09] Writing checkpoint files
[10:34:10] Writing checkpoint files
[10:37:10] Writing checkpoint files
[10:38:34] Writing local files
[10:38:34] Completed 1125000 out of 2500000 steps (45%)
[10:40:09] Writing checkpoint files
[10:43:09] Writing checkpoint files
[10:46:10] Writing checkpoint files
[10:49:09] Writing checkpoint files
[10:52:10] Writing checkpoint files
[10:52:12] Writing local files
[10:52:12] Completed 1150000 out of 2500000 steps (46%)
[10:52:12] Writing checkpoint files
[10:55:13] Writing checkpoint files
[10:58:12] Writing checkpoint files
[11:01:13] Writing checkpoint files
[11:04:14] Writing checkpoint files
[11:05:46] Writing local files
[11:05:46] Completed 1175000 out of 2500000 steps (47%)
[11:07:15] Writing checkpoint files
[11:10:16] Writing checkpoint files
[11:13:17] Writing checkpoint files
[11:16:18] Writing checkpoint files
[11:19:08] Writing local files
[11:19:08] Completed 1200000 out of 2500000 steps (48%)
[11:19:08] Writing checkpoint files
[11:22:09] Writing checkpoint files
[11:25:10] Writing checkpoint files
[11:28:11] Writing checkpoint files
[11:31:12] Writing checkpoint files
[11:32:37] Writing local files
[11:32:37] Completed 1225000 out of 2500000 steps (49%)
[11:34:13] Writing checkpoint files
[11:37:14] Writing checkpoint files
[11:40:14] Writing checkpoint files
[11:43:14] Writing checkpoint files
[11:45:55] Writing local files
[11:45:55] Completed 1250000 out of 2500000 steps (50%)
[11:45:55] Writing checkpoint files
[11:48:55] Writing checkpoint files
[11:51:55] Writing checkpoint files
[11:54:56] Writing checkpoint files
[11:57:55] Writing checkpoint files
[11:59:26] Writing local files
[11:59:26] Completed 1275000 out of 2500000 steps (51%)
[12:00:55] Writing checkpoint files
[12:03:56] Writing checkpoint files
[12:06:55] Writing checkpoint files
[12:09:56] Writing checkpoint files
[12:12:56] Writing checkpoint files
[12:12:59] Writing local files
[12:12:59] Completed 1300000 out of 2500000 steps (52%)
[12:12:59] Writing checkpoint files
[12:15:59] Writing checkpoint files
[12:19:00] Writing checkpoint files
[12:21:59] Writing checkpoint files
[12:25:00] Writing checkpoint files
[12:26:20] Writing local files
[12:26:20] Completed 1325000 out of 2500000 steps (53%)
[12:28:00] Writing checkpoint files
[12:31:01] Writing checkpoint files
[12:34:01] Writing checkpoint files
[12:37:02] Writing checkpoint files
[12:39:40] Writing local files
[12:39:40] Completed 1350000 out of 2500000 steps (54%)
[12:39:40] Writing checkpoint files
[12:42:41] Writing checkpoint files
[12:45:42] Writing checkpoint files
[12:48:43] Writing checkpoint files
[12:51:44] Writing checkpoint files
[12:52:56] Writing local files
[12:52:56] Completed 1375000 out of 2500000 steps (55%)
[12:54:44] Writing checkpoint files
[12:57:45] Writing checkpoint files
[13:00:46] Writing checkpoint files
[13:03:47] Writing checkpoint files
[13:05:48] Writing local files
[13:05:48] Completed 1400000 out of 2500000 steps (56%)
[13:05:48] Writing checkpoint files
[13:08:48] Writing checkpoint files
[13:11:48] Writing checkpoint files
[13:14:49] Writing checkpoint files
[13:17:48] Writing checkpoint files
[13:18:30] Writing local files
[13:18:30] Completed 1425000 out of 2500000 steps (57%)
[13:20:48] Writing checkpoint files
[13:23:48] Writing checkpoint files
[13:26:48] Writing checkpoint files
[13:29:49] Writing checkpoint files
[13:31:12] Writing local files
[13:31:12] Completed 1450000 out of 2500000 steps (58%)
[13:31:12] Writing checkpoint files
[13:34:11] Writing checkpoint files
[13:37:11] Writing checkpoint files
[13:40:12] Writing checkpoint files
[13:43:12] Writing checkpoint files
[13:43:54] Writing local files
[13:43:54] Completed 1475000 out of 2500000 steps (59%)
[13:46:12] Writing checkpoint files
[13:49:12] Writing checkpoint files
[13:52:12] Writing checkpoint files
[13:55:13] Writing checkpoint files
[13:56:37] Writing local files
[13:56:37] Completed 1500000 out of 2500000 steps (60%)
[13:56:37] Writing checkpoint files
[13:59:38] Writing checkpoint files
[14:02:38] Writing checkpoint files
[14:05:39] Writing checkpoint files
[14:08:39] Writing checkpoint files
[14:09:19] Writing local files
[14:09:19] Completed 1525000 out of 2500000 steps (61%)
[14:11:40] Writing checkpoint files
[14:14:41] Writing checkpoint files
[14:17:42] Writing checkpoint files
[14:20:43] Writing checkpoint files
[14:21:55] Writing local files
[14:21:55] Completed 1550000 out of 2500000 steps (62%)
[14:21:55] Writing checkpoint files
[14:24:55] Writing checkpoint files
[14:27:55] Writing checkpoint files
[14:30:55] Writing checkpoint files
[14:33:55] Writing checkpoint files
[14:34:42] Writing local files
[14:34:42] Completed 1575000 out of 2500000 steps (63%)
[14:36:55] Writing checkpoint files
[14:39:55] Writing checkpoint files
[14:42:55] Writing checkpoint files
[14:45:56] Writing checkpoint files
[14:48:57] Writing checkpoint files
[14:50:24] Writing local files
[14:50:24] Completed 1600000 out of 2500000 steps (64%)
[14:50:24] Writing checkpoint files
[14:53:24] Writing checkpoint files
[14:56:25] Writing checkpoint files
[14:59:26] Writing checkpoint files
[15:02:26] Writing checkpoint files
[15:04:58] Writing local files
[15:04:58] Completed 1625000 out of 2500000 steps (65%)
[15:05:27] Writing checkpoint files
[15:08:28] Writing checkpoint files
[15:11:29] Writing checkpoint files
[15:14:28] Writing checkpoint files
[15:15:51] - Autosending finished units... [April 1 15:15:51 UTC]
[15:15:51] Trying to send all finished work units
[15:15:51] + No unsent completed units remaining.
[15:15:51] - Autosend completed
[15:17:29] Writing checkpoint files
[15:18:35] Writing local files
[15:18:35] Completed 1650000 out of 2500000 steps (66%)