Page 3 of 6
Re: Bigadv Collection and or Assighnment server is broken
Posted: Sun Sep 30, 2012 6:18 pm
by Ben_Lamb
Grandpa_01 wrote:The servers are working properly again so no need to dump WU's , but the odds of getting credit for the previously run WU's is not real high. I had 3 -8102's and an 8101 turned in during the server mess up so aprox 1,600,000 points loss but as the saying goes it will not do any good to cry over spilled milk.
I wouldn't be crying if I had your server power Grandpa ! I will have to fold smp for a day or two now as I binned three units over the cockup and dont want to have my bonus cancelled due to that.
Re: Bigadv Collection and or Assighnment server is broken
Posted: Sun Sep 30, 2012 6:32 pm
by -alias-
Got the same message on two different computers at in about the same time period, respectively [7:13:57] - Server reports problem with unit. and [7:44:52] - Server reports problem with unit.
820K points down the drain!
The machines have different units, but get the same unit again as the server reported the error on. I've been away for a few days and discovered the issue right now. The log shows no problems with any of the WUs. Based on the log they both delivered flawless 8102 prior to this. I think the problem must be on the work server!
The log from both:
Code: Select all
The first rig:
Xeon MP 4P E5-4650
[18:12:28] Completed 242500 out of 250000 steps (97%)
[18:19:53] Completed 245000 out of 250000 steps (98%)
[18:27:21] Completed 247500 out of 250000 steps (99%)
[18:33:47] - Autosending finished units... [September 29 18:33:47 UTC]
[18:33:47] Trying to send all finished work units
[18:33:47] + No unsent completed units remaining.
[18:33:47] - Autosend completed
[18:34:47] Completed 250000 out of 250000 steps (100%)
[18:34:59] DynamicWrapper: Finished Work Unit: sleep=10000
[18:35:09]
[18:35:09] Finished Work Unit:
[18:35:09] - Reading up to 64407792 from "work/wudata_06.trr": Read 64407792
[18:35:09] trr file hash check passed.
[18:35:09] - Reading up to 31749064 from "work/wudata_06.xtc": Read 31749064
[18:35:09] xtc file hash check passed.
[18:35:09] edr file hash check passed.
[18:35:09] logfile size: 202715
[18:35:09] Leaving Run
[18:35:13] - Writing 96520447 bytes of core data to disk...
[18:35:28] Done: 96519935 -> 91758383 (compressed to 6.0 percent)
[18:35:28] ... Done.
[18:35:44] - Shutting down core
[18:35:44]
[18:35:44] Folding@home Core Shutdown: FINISHED_UNIT
[18:35:46] CoreStatus = 64 (100)
[18:35:46] Unit 6 finished with 87 percent of time to deadline remaining.
[18:35:46] Updated performance fraction: 0.848720
[18:35:46] Sending work to server
[18:35:46] Project: 8102 (Run 0, Clone 24, Gen 46)
[18:35:46] + Attempting to send results [September 29 18:35:46 UTC]
[18:35:46] - Reading file work/wuresults_06.dat from core
[18:35:46] (Read 91758895 bytes from disk)
[18:35:46] Connecting to http://128.143.231.201:8080/
[18:38:42] Posted data.
[18:38:42] Initial: 0000; - Uploaded at ~509 kB/s
[18:38:42] - Averaged speed for that direction ~553 kB/s
[18:38:42] + Results successfully sent
[18:38:42] Thank you for your contribution to Folding@Home.
[18:38:42] + Number of Units Completed: 76
[18:38:47] Trying to send all finished work units
[18:38:47] + No unsent completed units remaining.
[18:38:47] - Preparing to get new work unit...
[18:38:47] Cleaning up work directory
[18:38:49] + Attempting to get work packet
[18:38:49] Passkey found
[18:38:49] - Will indicate memory of 32206 MB
[18:38:49] - Connecting to assignment server
[18:38:49] Connecting to http://assign.stanford.edu:8080/
[18:38:50] Posted data.
[18:38:50] Initial: 8F80; - Successful: assigned to (128.143.231.201).
[18:38:50] + News From Folding@Home: Welcome to Folding@Home
[18:38:50] Loaded queue successfully.
[18:38:50] Sent data
[18:38:50] Connecting to http://128.143.231.201:8080/
[18:38:57] Posted data.
[18:38:57] Initial: 0000; - Receiving payload (expected size: 30340500)
[18:39:25] - Downloaded at ~1058 kB/s
[18:39:25] - Averaged speed for that direction ~865 kB/s
[18:39:25] + Received work.
[18:39:26] Trying to send all finished work units
[18:39:26] + No unsent completed units remaining.
[18:39:26] + Closed connections
[18:39:26]
[18:39:26] + Processing work unit
[18:39:26] Core required: FahCore_a5.exe
[18:39:26] Core found.
[18:39:26] Working on queue slot 07 [September 29 18:39:26 UTC]
[18:39:26] + Working ...
[18:39:26] - Calling './FahCore_a5.exe -dir work/ -nice 19 -suffix 07 -np 64 -checkpoint 3 -verbose -lifeline 2442 -version 634'
[18:39:26]
[18:39:26] *------------------------------*
[18:39:26] Folding@Home Gromacs SMP Core
[18:39:26] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[18:39:26]
[18:39:26] Preparing to commence simulation
[18:39:26] - Looking at optimizations...
[18:39:26] - Created dyn
[18:39:26] - Files status OK
[18:39:28] - Expanded 30339988 -> 33163648 (decompressed 109.3 percent)
[18:39:28] Called DecompressByteArray: compressed_data_size=30339988 data_size=33163648, decompressed_data_size=33163648 diff=0
[18:39:28] - Digital signature verified
[18:39:28]
[18:39:28] Project: 8102 (Run 0, Clone 24, Gen 47)
[18:39:28]
[18:39:28] Assembly optimizations on if available.
[18:39:28] Entering M.D.
[18:39:35] Mapping NT from 64 to 64
[18:39:40] Completed 0 out of 250000 steps (0%)
[18:47:25] Completed 2500 out of 250000 steps (1%)
[18:54:56] Completed 5000 out of 250000 steps (2%)
[19:02:25] Completed 7500 out of 250000 steps (3%)
[19:09:57] Completed 10000 out of 250000 steps (4%)
[19:17:25] Completed 12500 out of 250000 steps (5%)
[19:24:57] Completed 15000 out of 250000 steps (6%)
[19:32:26] Completed 17500 out of 250000 steps (7%)
[19:39:58] Completed 20000 out of 250000 steps (8%)
[19:47:28] Completed 22500 out of 250000 steps (9%)
[19:54:59] Completed 25000 out of 250000 steps (10%)
[20:02:28] Completed 27500 out of 250000 steps (11%)
[20:09:59] Completed 30000 out of 250000 steps (12%)
[20:17:29] Completed 32500 out of 250000 steps (13%)
[20:24:59] Completed 35000 out of 250000 steps (14%)
[20:32:29] Completed 37500 out of 250000 steps (15%)
[20:39:59] Completed 40000 out of 250000 steps (16%)
[20:47:27] Completed 42500 out of 250000 steps (17%)
[20:54:58] Completed 45000 out of 250000 steps (18%)
[21:02:26] Completed 47500 out of 250000 steps (19%)
[21:09:56] Completed 50000 out of 250000 steps (20%)
[21:17:24] Completed 52500 out of 250000 steps (21%)
[21:24:54] Completed 55000 out of 250000 steps (22%)
[21:32:21] Completed 57500 out of 250000 steps (23%)
[21:39:51] Completed 60000 out of 250000 steps (24%)
[21:47:19] Completed 62500 out of 250000 steps (25%)
[21:54:49] Completed 65000 out of 250000 steps (26%)
[22:02:17] Completed 67500 out of 250000 steps (27%)
[22:09:48] Completed 70000 out of 250000 steps (28%)
[22:17:16] Completed 72500 out of 250000 steps (29%)
[22:24:46] Completed 75000 out of 250000 steps (30%)
[22:32:14] Completed 77500 out of 250000 steps (31%)
[22:39:45] Completed 80000 out of 250000 steps (32%)
[22:47:13] Completed 82500 out of 250000 steps (33%)
[22:54:43] Completed 85000 out of 250000 steps (34%)
[23:02:11] Completed 87500 out of 250000 steps (35%)
[23:09:40] Completed 90000 out of 250000 steps (36%)
[23:17:11] Completed 92500 out of 250000 steps (37%)
[23:24:39] Completed 95000 out of 250000 steps (38%)
[23:32:11] Completed 97500 out of 250000 steps (39%)
[23:39:40] Completed 100000 out of 250000 steps (40%)
[23:47:12] Completed 102500 out of 250000 steps (41%)
[23:54:41] Completed 105000 out of 250000 steps (42%)
[00:02:12] Completed 107500 out of 250000 steps (43%)
[00:09:45] Completed 110000 out of 250000 steps (44%)
[00:17:14] Completed 112500 out of 250000 steps (45%)
[00:24:46] Completed 115000 out of 250000 steps (46%)
[00:32:15] Completed 117500 out of 250000 steps (47%)
[00:33:47] - Autosending finished units... [September 30 00:33:47 UTC]
[00:33:47] Trying to send all finished work units
[00:33:47] + No unsent completed units remaining.
[00:33:47] - Autosend completed
[00:39:47] Completed 120000 out of 250000 steps (48%)
[00:47:16] Completed 122500 out of 250000 steps (49%)
[00:54:47] Completed 125000 out of 250000 steps (50%)
[01:02:16] Completed 127500 out of 250000 steps (51%)
[01:09:46] Completed 130000 out of 250000 steps (52%)
[01:17:15] Completed 132500 out of 250000 steps (53%)
[01:24:45] Completed 135000 out of 250000 steps (54%)
[01:32:14] Completed 137500 out of 250000 steps (55%)
[01:39:44] Completed 140000 out of 250000 steps (56%)
[01:47:12] Completed 142500 out of 250000 steps (57%)
[01:54:40] Completed 145000 out of 250000 steps (58%)
[02:02:10] Completed 147500 out of 250000 steps (59%)
[02:09:39] Completed 150000 out of 250000 steps (60%)
[02:17:09] Completed 152500 out of 250000 steps (61%)
[02:24:37] Completed 155000 out of 250000 steps (62%)
[02:32:08] Completed 157500 out of 250000 steps (63%)
[02:39:36] Completed 160000 out of 250000 steps (64%)
[02:47:07] Completed 162500 out of 250000 steps (65%)
[02:54:35] Completed 165000 out of 250000 steps (66%)
[03:02:06] Completed 167500 out of 250000 steps (67%)
[03:09:36] Completed 170000 out of 250000 steps (68%)
[03:17:07] Completed 172500 out of 250000 steps (69%)
[03:24:35] Completed 175000 out of 250000 steps (70%)
[03:32:05] Completed 177500 out of 250000 steps (71%)
[03:39:34] Completed 180000 out of 250000 steps (72%)
[03:47:05] Completed 182500 out of 250000 steps (73%)
[03:54:33] Completed 185000 out of 250000 steps (74%)
[04:02:05] Completed 187500 out of 250000 steps (75%)
[04:09:33] Completed 190000 out of 250000 steps (76%)
[04:17:03] Completed 192500 out of 250000 steps (77%)
[04:24:32] Completed 195000 out of 250000 steps (78%)
[04:32:04] Completed 197500 out of 250000 steps (79%)
[04:39:33] Completed 200000 out of 250000 steps (80%)
[04:47:05] Completed 202500 out of 250000 steps (81%)
[04:54:34] Completed 205000 out of 250000 steps (82%)
[05:02:06] Completed 207500 out of 250000 steps (83%)
[05:09:36] Completed 210000 out of 250000 steps (84%)
[05:17:06] Completed 212500 out of 250000 steps (85%)
[05:24:36] Completed 215000 out of 250000 steps (86%)
[05:32:07] Completed 217500 out of 250000 steps (87%)
[05:39:36] Completed 220000 out of 250000 steps (88%)
[05:47:07] Completed 222500 out of 250000 steps (89%)
[05:54:36] Completed 225000 out of 250000 steps (90%)
[06:03:00] Completed 227500 out of 250000 steps (91%)
[06:10:31] Completed 230000 out of 250000 steps (92%)
[06:18:01] Completed 232500 out of 250000 steps (93%)
[06:25:33] Completed 235000 out of 250000 steps (94%)
[06:33:02] Completed 237500 out of 250000 steps (95%)
[06:33:47] - Autosending finished units... [September 30 06:33:47 UTC]
[06:33:47] Trying to send all finished work units
[06:33:47] + No unsent completed units remaining.
[06:33:47] - Autosend completed
[06:40:33] Completed 240000 out of 250000 steps (96%)
[06:48:01] Completed 242500 out of 250000 steps (97%)
[06:55:33] Completed 245000 out of 250000 steps (98%)
[07:03:02] Completed 247500 out of 250000 steps (99%)
[07:10:34] Completed 250000 out of 250000 steps (100%)
[07:10:46] DynamicWrapper: Finished Work Unit: sleep=10000
[07:10:56]
[07:10:56] Finished Work Unit:
[07:10:56] - Reading up to 64407792 from "work/wudata_07.trr": Read 64407792
[07:10:56] trr file hash check passed.
[07:10:56] - Reading up to 31622512 from "work/wudata_07.xtc": Read 31622512
[07:10:57] xtc file hash check passed.
[07:10:57] edr file hash check passed.
[07:10:57] logfile size: 202844
[07:10:57] Leaving Run
[07:10:57] - Writing 96394024 bytes of core data to disk...
[07:11:12] Done: 96393512 -> 91629940 (compressed to 5.9 percent)
[07:11:12] ... Done.
[07:11:28] - Shutting down core
[07:11:28]
[07:11:28] Folding@home Core Shutdown: FINISHED_UNIT
[07:11:30] CoreStatus = 64 (100)
[07:11:30] Unit 7 finished with 87 percent of time to deadline remaining.
[07:11:30] Updated performance fraction: 0.852862
[07:11:30] Sending work to server
[07:11:30] Project: 8102 (Run 0, Clone 24, Gen 47)
[07:11:30] + Attempting to send results [September 30 07:11:30 UTC]
[07:11:30] - Reading file work/wuresults_07.dat from core
[07:11:30] (Read 91630452 bytes from disk)
[07:11:30] Connecting to http://128.143.231.201:8080/
[07:13:57] Posted data.
[07:13:57] Initial: 0000; - Uploaded at ~608 kB/s
[07:13:57] - Averaged speed for that direction ~564 kB/s
[07:13:57] - Server reports problem with unit.
[07:13:57] Trying to send all finished work units
[07:13:57] + No unsent completed units remaining.
[07:13:57] - Preparing to get new work unit...
[07:13:57] Cleaning up work directory
[07:13:58] + Attempting to get work packet
[07:13:58] Passkey found
[07:13:58] - Will indicate memory of 32206 MB
[07:13:58] - Connecting to assignment server
[07:13:58] Connecting to http://assign.stanford.edu:8080/
[07:14:00] Posted data.
[07:14:00] Initial: 8F80; - Successful: assigned to (128.143.231.201).
[07:14:00] + News From Folding@Home: Welcome to Folding@Home
[07:14:00] Loaded queue successfully.
[07:14:00] Sent data
[07:14:00] Connecting to http://128.143.231.201:8080/
[07:14:07] Posted data.
[07:14:07] Initial: 0000; - Receiving payload (expected size: 30340500)
[07:15:19] - Downloaded at ~411 kB/s
[07:15:19] - Averaged speed for that direction ~774 kB/s
[07:15:19] + Received work.
[07:15:19] Trying to send all finished work units
[07:15:19] + No unsent completed units remaining.
[07:15:19] + Closed connections
[07:15:19]
[07:15:19] + Processing work unit
[07:15:19] Core required: FahCore_a5.exe
[07:15:19] Core found.
[07:15:19] Working on queue slot 08 [September 30 07:15:19 UTC]
[07:15:19] + Working ...
[07:15:19] - Calling './FahCore_a5.exe -dir work/ -nice 19 -suffix 08 -np 64 -checkpoint 3 -verbose -lifeline 2442 -version 634'
[07:15:19]
[07:15:19] *------------------------------*
[07:15:19] Folding@Home Gromacs SMP Core
[07:15:19] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[07:15:19]
[07:15:19] Preparing to commence simulation
[07:15:19] - Looking at optimizations...
[07:15:19] - Created dyn
[07:15:19] - Files status OK
[07:15:22] - Expanded 30339988 -> 33163648 (decompressed 109.3 percent)
[07:15:22] Called DecompressByteArray: compressed_data_size=30339988 data_size=33163648, decompressed_data_size=33163648 diff=0
[07:15:22] - Digital signature verified
[07:15:22]
[07:15:22] Project: 8102 (Run 0, Clone 24, Gen 47)
[07:15:22]
[07:15:22] Assembly optimizations on if available.
[07:15:22] Entering M.D.
[07:15:28] Mapping NT from 64 to 64
[07:15:32] Completed 0 out of 250000 steps (0%)
[07:23:14] Completed 2500 out of 250000 steps (1%)
[07:30:42] Completed 5000 out of 250000 steps (2%)
[07:38:08] Completed 7500 out of 250000 steps (3%)
[07:45:37] Completed 10000 out of 250000 steps (4%)
[07:53:02] Completed 12500 out of 250000 steps (5%)
Next rig:
G34 4P 6176se
[14:17:48] Completed 242500 out of 250000 steps (97%)
[14:27:51] Completed 245000 out of 250000 steps (98%)
[14:37:51] Completed 247500 out of 250000 steps (99%)
[14:47:52] Completed 250000 out of 250000 steps (100%)
[14:48:04] DynamicWrapper: Finished Work Unit: sleep=10000
[14:48:14]
[14:48:14] Finished Work Unit:
[14:48:14] - Reading up to 64407792 from "work/wudata_05.trr": Read 64407792
[14:48:14] trr file hash check passed.
[14:48:14] - Reading up to 31558180 from "work/wudata_05.xtc": Read 31558180
[14:48:15] xtc file hash check passed.
[14:48:15] edr file hash check passed.
[14:48:15] logfile size: 208838
[14:48:15] Leaving Run
[14:48:16] - Writing 96335686 bytes of core data to disk...
[14:48:46] Done: 96335174 -> 91571502 (compressed to 5.8 percent)
[14:48:46] ... Done.
[14:49:06] - Shutting down core
[14:49:06]
[14:49:06] Folding@home Core Shutdown: FINISHED_UNIT
[14:49:09] CoreStatus = 64 (100)
[14:49:09] Unit 5 finished with 83 percent of time to deadline remaining.
[14:49:09] Updated performance fraction: 0.807950
[14:49:09] Sending work to server
[14:49:09] Project: 8102 (Run 0, Clone 35, Gen 56)
[14:49:09] + Attempting to send results [September 29 14:49:09 UTC]
[14:49:09] - Reading file work/wuresults_05.dat from core
[14:49:09] (Read 91572014 bytes from disk)
[14:49:09] Connecting to http://128.143.231.201:8080/
[14:52:04] Posted data.
[14:52:04] Initial: 0000; - Uploaded at ~511 kB/s
[14:52:04] - Averaged speed for that direction ~553 kB/s
[14:52:04] + Results successfully sent
[14:52:04] Thank you for your contribution to Folding@Home.
[14:52:04] + Number of Units Completed: 160
[14:52:11] Trying to send all finished work units
[14:52:11] + No unsent completed units remaining.
[14:52:11] - Preparing to get new work unit...
[14:52:11] Cleaning up work directory
[14:52:13] + Attempting to get work packet
[14:52:13] Passkey found
[14:52:13] - Will indicate memory of 16073 MB
[14:52:13] - Connecting to assignment server
[14:52:13] Connecting to http://assign.stanford.edu:8080/
[14:52:14] Posted data.
[14:52:14] Initial: 8F80; - Successful: assigned to (128.143.231.201).
[14:52:14] + News From Folding@Home: Welcome to Folding@Home
[14:52:14] Loaded queue successfully.
[14:52:14] Sent data
[14:52:14] Connecting to http://128.143.231.201:8080/
[14:52:21] Posted data.
[14:52:21] Initial: 0000; - Receiving payload (expected size: 30342094)
[14:52:46] - Downloaded at ~1185 kB/s
[14:52:46] - Averaged speed for that direction ~804 kB/s
[14:52:46] + Received work.
[14:52:47] Trying to send all finished work units
[14:52:47] + No unsent completed units remaining.
[14:52:47] + Closed connections
[14:52:47]
[14:52:47] + Processing work unit
[14:52:47] Core required: FahCore_a5.exe
[14:52:47] Core found.
[14:52:47] Working on queue slot 06 [September 29 14:52:47 UTC]
[14:52:47] + Working ...
[14:52:47] - Calling './FahCore_a5.exe -dir work/ -nice 19 -suffix 06 -np 48 -checkpoint 3 -verbose -lifeline 2154 -version 634'
[14:52:47]
[14:52:47] *------------------------------*
[14:52:47] Folding@Home Gromacs SMP Core
[14:52:47] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[14:52:47]
[14:52:47] Preparing to commence simulation
[14:52:47] - Looking at optimizations...
[14:52:47] - Created dyn
[14:52:47] - Files status OK
[14:52:51] - Expanded 30341582 -> 33163648 (decompressed 109.3 percent)
[14:52:51] Called DecompressByteArray: compressed_data_size=30341582 data_size=33163648, decompressed_data_size=33163648 diff=0
[14:52:51] - Digital signature verified
[14:52:51]
[14:52:51] Project: 8102 (Run 0, Clone 35, Gen 57)
[14:52:51]
[14:52:51] Assembly optimizations on if available.
[14:52:51] Entering M.D.
[14:52:58] Mapping NT from 48 to 48
[14:53:02] Completed 0 out of 250000 steps (0%)
[14:57:21] ng M.D.
[14:57:27] Using Gromacs checkpoints
[14:57:31] Mapping NT from 48 to 48
[14:58:24] Resuming from checkpoint
[14:58:34] Verified work/wudata_06.log
[14:58:34] Verified work/wudata_06.trr
[14:58:34] Verified work/wudata_06.xtc
[14:58:34] Verified work/wudata_06.edr
[14:58:34] Completed 705 out of 250000 steps (0%)
[15:05:46] Completed 2500 out of 250000 steps (1%)
[15:15:50] Completed 5000 out of 250000 steps (2%)
[15:25:51] Completed 7500 out of 250000 steps (3%)
[15:35:52] Completed 10000 out of 250000 steps (4%)
[15:45:56] Completed 12500 out of 250000 steps (5%)
[15:55:57] Completed 15000 out of 250000 steps (6%)
[16:05:59] Completed 17500 out of 250000 steps (7%)
[16:16:03] Completed 20000 out of 250000 steps (8%)
[16:26:03] Completed 22500 out of 250000 steps (9%)
[16:36:05] Completed 25000 out of 250000 steps (10%)
[16:46:10] Completed 27500 out of 250000 steps (11%)
[16:56:11] Completed 30000 out of 250000 steps (12%)
[17:06:13] Completed 32500 out of 250000 steps (13%)
[17:16:17] Completed 35000 out of 250000 steps (14%)
[17:26:18] Completed 37500 out of 250000 steps (15%)
[17:36:21] Completed 40000 out of 250000 steps (16%)
[17:46:27] Completed 42500 out of 250000 steps (17%)
[17:56:29] Completed 45000 out of 250000 steps (18%)
[18:06:32] Completed 47500 out of 250000 steps (19%)
[18:16:38] Completed 50000 out of 250000 steps (20%)
[18:26:41] Completed 52500 out of 250000 steps (21%)
[18:36:47] Completed 55000 out of 250000 steps (22%)
[18:46:49] Completed 57500 out of 250000 steps (23%)
[18:56:52] Completed 60000 out of 250000 steps (24%)
[19:06:57] Completed 62500 out of 250000 steps (25%)
[19:16:59] Completed 65000 out of 250000 steps (26%)
[19:27:01] Completed 67500 out of 250000 steps (27%)
[19:37:07] Completed 70000 out of 250000 steps (28%)
[19:47:09] Completed 72500 out of 250000 steps (29%)
[19:57:11] Completed 75000 out of 250000 steps (30%)
[20:07:18] Completed 77500 out of 250000 steps (31%)
[20:17:20] - Autosending finished units... [September 29 20:17:20 UTC]
[20:17:20] Trying to send all finished work units
[20:17:20] + No unsent completed units remaining.
[20:17:20] - Autosend completed
[20:17:22] Completed 80000 out of 250000 steps (32%)
[20:27:25] Completed 82500 out of 250000 steps (33%)
[20:37:30] Completed 85000 out of 250000 steps (34%)
[20:47:32] Completed 87500 out of 250000 steps (35%)
[20:57:36] Completed 90000 out of 250000 steps (36%)
[21:07:41] Completed 92500 out of 250000 steps (37%)
[21:17:44] Completed 95000 out of 250000 steps (38%)
[21:27:50] Completed 97500 out of 250000 steps (39%)
[21:37:52] Completed 100000 out of 250000 steps (40%)
[21:47:55] Completed 102500 out of 250000 steps (41%)
[21:58:00] Completed 105000 out of 250000 steps (42%)
[22:08:02] Completed 107500 out of 250000 steps (43%)
[22:18:06] Completed 110000 out of 250000 steps (44%)
[22:28:12] Completed 112500 out of 250000 steps (45%)
[22:38:15] Completed 115000 out of 250000 steps (46%)
[22:48:17] Completed 117500 out of 250000 steps (47%)
[22:58:24] Completed 120000 out of 250000 steps (48%)
[23:08:26] Completed 122500 out of 250000 steps (49%)
[23:18:29] Completed 125000 out of 250000 steps (50%)
[23:28:33] Completed 127500 out of 250000 steps (51%)
[23:38:36] Completed 130000 out of 250000 steps (52%)
[23:48:39] Completed 132500 out of 250000 steps (53%)
[23:58:45] Completed 135000 out of 250000 steps (54%)
[00:08:48] Completed 137500 out of 250000 steps (55%)
[00:18:54] Completed 140000 out of 250000 steps (56%)
[00:28:57] Completed 142500 out of 250000 steps (57%)
[00:38:59] Completed 145000 out of 250000 steps (58%)
[00:49:06] Completed 147500 out of 250000 steps (59%)
[00:59:08] Completed 150000 out of 250000 steps (60%)
[01:09:11] Completed 152500 out of 250000 steps (61%)
[01:19:17] Completed 155000 out of 250000 steps (62%)
[01:29:19] Completed 157500 out of 250000 steps (63%)
[01:39:22] Completed 160000 out of 250000 steps (64%)
[01:49:27] Completed 162500 out of 250000 steps (65%)
[01:59:30] Completed 165000 out of 250000 steps (66%)
[02:09:32] Completed 167500 out of 250000 steps (67%)
[02:17:20] - Autosending finished units... [September 30 02:17:20 UTC]
[02:17:20] Trying to send all finished work units
[02:17:20] + No unsent completed units remaining.
[02:17:20] - Autosend completed
[02:19:37] Completed 170000 out of 250000 steps (68%)
[02:29:40] Completed 172500 out of 250000 steps (69%)
[02:39:45] Completed 175000 out of 250000 steps (70%)
[02:49:48] Completed 177500 out of 250000 steps (71%)
[02:59:50] Completed 180000 out of 250000 steps (72%)
[03:09:55] Completed 182500 out of 250000 steps (73%)
[03:19:57] Completed 185000 out of 250000 steps (74%)
[03:29:59] Completed 187500 out of 250000 steps (75%)
[03:40:04] Completed 190000 out of 250000 steps (76%)
[03:50:06] Completed 192500 out of 250000 steps (77%)
[04:00:07] Completed 195000 out of 250000 steps (78%)
[04:10:11] Completed 197500 out of 250000 steps (79%)
[04:20:13] Completed 200000 out of 250000 steps (80%)
[04:30:15] Completed 202500 out of 250000 steps (81%)
[04:40:19] Completed 205000 out of 250000 steps (82%)
[04:50:21] Completed 207500 out of 250000 steps (83%)
[05:00:23] Completed 210000 out of 250000 steps (84%)
[05:10:26] Completed 212500 out of 250000 steps (85%)
[05:20:28] Completed 215000 out of 250000 steps (86%)
[05:30:29] Completed 217500 out of 250000 steps (87%)
[05:40:35] Completed 220000 out of 250000 steps (88%)
[05:50:37] Completed 222500 out of 250000 steps (89%)
[06:00:38] Completed 225000 out of 250000 steps (90%)
[06:10:42] Completed 227500 out of 250000 steps (91%)
[06:20:45] Completed 230000 out of 250000 steps (92%)
[06:30:50] Completed 232500 out of 250000 steps (93%)
[06:40:50] Completed 235000 out of 250000 steps (94%)
[06:50:52] Completed 237500 out of 250000 steps (95%)
[07:00:57] Completed 240000 out of 250000 steps (96%)
[07:10:58] Completed 242500 out of 250000 steps (97%)
[07:21:00] Completed 245000 out of 250000 steps (98%)
[07:31:05] Completed 247500 out of 250000 steps (99%)
[07:41:08] Completed 250000 out of 250000 steps (100%)
[07:41:20] DynamicWrapper: Finished Work Unit: sleep=10000
[07:41:30]
[07:41:30] Finished Work Unit:
[07:41:30] - Reading up to 64407792 from "work/wudata_06.trr": Read 64407792
[07:41:30] trr file hash check passed.
[07:41:30] - Reading up to 31558840 from "work/wudata_06.xtc": Read 31558840
[07:41:30] xtc file hash check passed.
[07:41:30] edr file hash check passed.
[07:41:30] logfile size: 208898
[07:41:30] Leaving Run
[07:41:32] - Writing 96336406 bytes of core data to disk...
[07:42:01] Done: 96335894 -> 91578205 (compressed to 5.8 percent)
[07:42:02] ... Done.
[07:42:23] - Shutting down core
[07:42:23]
[07:42:23] Folding@home Core Shutdown: FINISHED_UNIT
[07:42:25] CoreStatus = 64 (100)
[07:42:25] Unit 6 finished with 82 percent of time to deadline remaining.
[07:42:25] Updated performance fraction: 0.811303
[07:42:25] Sending work to server
[07:42:25] Project: 8102 (Run 0, Clone 35, Gen 57)
[07:42:25] + Attempting to send results [September 30 07:42:25 UTC]
[07:42:25] - Reading file work/wuresults_06.dat from core
[07:42:25] (Read 91578717 bytes from disk)
[07:42:25] Connecting to http://128.143.231.201:8080/
[07:44:52] Posted data.
[07:44:52] Initial: 0000; - Uploaded at ~608 kB/s
[07:44:52] - Averaged speed for that direction ~564 kB/s
[07:44:52] - Server reports problem with unit.
[07:44:52] Trying to send all finished work units
[07:44:52] + No unsent completed units remaining.
[07:44:52] - Preparing to get new work unit...
[07:44:52] Cleaning up work directory
[07:44:54] + Attempting to get work packet
[07:44:54] Passkey found
[07:44:54] - Will indicate memory of 16073 MB
[07:44:54] - Connecting to assignment server
[07:44:54] Connecting to http://assign.stanford.edu:8080/
[07:44:56] Posted data.
[07:44:56] Initial: 8F80; - Successful: assigned to (128.143.231.201).
[07:44:56] + News From Folding@Home: Welcome to Folding@Home
[07:44:56] Loaded queue successfully.
[07:44:56] Sent data
[07:44:56] Connecting to http://128.143.231.201:8080/
[07:45:04] Posted data.
[07:45:04] Initial: 0000; - Receiving payload (expected size: 30342094)
[07:46:15] - Downloaded at ~417 kB/s
[07:46:15] - Averaged speed for that direction ~727 kB/s
[07:46:15] + Received work.
[07:46:15] Trying to send all finished work units
[07:46:15] + No unsent completed units remaining.
[07:46:15] + Closed connections
[07:46:15]
[07:46:15] + Processing work unit
[07:46:15] Core required: FahCore_a5.exe
[07:46:15] Core found.
[07:46:15] Working on queue slot 07 [September 30 07:46:15 UTC]
[07:46:15] + Working ...
[07:46:15] - Calling './FahCore_a5.exe -dir work/ -nice 19 -suffix 07 -np 48 -checkpoint 3 -verbose -lifeline 2154 -version 634'
[07:46:15]
[07:46:15] *------------------------------*
[07:46:15] Folding@Home Gromacs SMP Core
[07:46:15] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[07:46:15]
[07:46:15] Preparing to commence simulation
[07:46:15] - Looking at optimizations...
[07:46:15] - Created dyn
[07:46:15] - Files status OK
[07:46:19] - Expanded 30341582 -> 33163648 (decompressed 109.3 percent)
[07:46:19] Called DecompressByteArray: compressed_data_size=30341582 data_size=33163648, decompressed_data_size=33163648 diff=0
[07:46:19] - Digital signature verified
[07:46:19]
[07:46:19] Project: 8102 (Run 0, Clone 35, Gen 57)
[07:46:19]
[07:46:19] Assembly optimizations on if available.
[07:46:19] Entering M.D.
[07:46:27] Mapping NT from 48 to 48
[07:46:30] Completed 0 out of 250000 steps (0%)
[07:50:49] ng M.D.
[07:50:55] Using Gromacs checkpoints
[07:50:59] Mapping NT from 48 to 48
[07:51:53] Resuming from checkpoint
[07:52:02] Verified work/wudata_07.log
[07:52:02] Verified work/wudata_07.trr
[07:52:02] Verified work/wudata_07.xtc
[07:52:02] Verified work/wudata_07.edr
[07:52:03] Completed 710 out of 250000 steps (0%)
[07:59:14] Completed 2500 out of 250000 steps (1%)
[08:09:21] Completed 5000 out of 250000 steps (2%)
[08:17:20] - Autosending finished units... [September 30 08:17:20 UTC]
[08:17:20] Trying to send all finished work units
[08:17:20] + No unsent completed units remaining.
[08:17:20] - Autosend completed
[08:19:24] Completed 7500 out of 250000 steps (3%)
[08:29:27] Completed 10000 out of 250000 steps (4%)
Lost this 8101 to:
Code: Select all
[13:27:55]
[13:27:55] Assembly optimizations on if available.
[13:27:55] Entering M.D.
[13:28:03] Mapping NT from 48 to 48
[13:28:10] Completed 0 out of 250000 steps (0%)
[13:43:49] Completed 2500 out of 250000 steps (1%)
[13:59:06] Completed 5000 out of 250000 steps (2%)
[14:14:22] Completed 7500 out of 250000 steps (3%)
[14:29:39] Completed 10000 out of 250000 steps (4%)
[14:44:56] Completed 12500 out of 250000 steps (5%)
[15:00:12] Completed 15000 out of 250000 steps (6%)
[15:15:28] Completed 17500 out of 250000 steps (7%)
[15:30:47] Completed 20000 out of 250000 steps (8%)
[15:46:04] Completed 22500 out of 250000 steps (9%)
[16:01:24] Completed 25000 out of 250000 steps (10%)
[16:16:42] Completed 27500 out of 250000 steps (11%)
[16:31:59] Completed 30000 out of 250000 steps (12%)
[16:47:15] Completed 32500 out of 250000 steps (13%)
[17:02:32] Completed 35000 out of 250000 steps (14%)
[17:04:21] - Autosending finished units... [September 30 17:04:21 UTC]
[17:04:21] Trying to send all finished work units
[17:04:21] Project: 8101 (Run 26, Clone 2, Gen 53)
[17:04:21] + Attempting to send results [September 30 17:04:21 UTC]
[17:04:21] - Reading file work/wuresults_06.dat from core
[17:04:21] (Read 91523380 bytes from disk)
[17:04:21] Connecting to http://128.143.231.201:8080/
[17:06:54] Posted data.
[17:06:54] Initial: 0000; - Uploaded at ~584 kB/s
[17:06:54] - Averaged speed for that direction ~367 kB/s
[17:06:54] - Server reports problem with unit.
[17:06:54] + Sent 0 of 1 completed units to the server
[17:06:54] - Autosend completed
[17:17:49] Completed 37500 out of 250000 steps (15%)
And this 8101 also!
Code: Select all
[03:23:43] Completed 50000 out of 250000 steps (20%)
[03:37:04] Completed 52500 out of 250000 steps (21%)
[03:50:31] Completed 55000 out of 250000 steps (22%)
[03:57:23] - Autosending finished units... [September 30 03:57:23 UTC]
[03:57:23] Trying to send all finished work units
[03:57:23] Project: 8101 (Run 7, Clone 4, Gen 82)
[03:57:23] + Attempting to send results [September 30 03:57:23 UTC]
[03:57:23] - Reading file work/wuresults_01.dat from core
[03:57:23] (Read 91518578 bytes from disk)
[03:57:23] Connecting to http://128.143.231.201:8080/
[03:59:50] Posted data.
[03:59:50] Initial: 0000; - Uploaded at ~607 kB/s
[03:59:50] - Averaged speed for that direction ~585 kB/s
[03:59:50] - Server reports problem with unit.
[03:59:50] + Sent 0 of 1 completed units to the server
[03:59:50] - Autosend completed
[04:03:50] Completed 57500 out of 250000 steps (23%)
[04:17:15] Completed 60000 out of 250000 steps (24%)
So all together I lost about 1455p the last 12 hour or so!.
Re: Server reports problem with unit.
Posted: Sun Sep 30, 2012 6:40 pm
by orion456
I have two P4 rigs doing 8101 that have both reported a problem with the unit. No credit given.
This has never happened before, and two units on two separate machines in a row seems more than a coincidence.
Here is the log, the error is at 4:48.
Code: Select all
[06:36:54] + Attempting to send results [September 29 06:36:54 UTC]
[06:36:54] - Reading file work/wuresults_01.dat from core
[06:36:55] (Read 91615610 bytes from disk)
[06:36:55] Connecting to http://128.143.231.201:8080/
[06:37:56] Posted data.
[06:37:56] Initial: 0000; - Uploaded at ~1466 kB/s
[06:37:56] - Averaged speed for that direction ~1272 kB/s
[06:37:56] + Results successfully sent
[06:37:56] Thank you for your contribution to Folding@Home.
[06:37:56] + Number of Units Completed: 70
thekraken: The Kraken 0.7-pre15 (compiled Wed Aug 1 13:17:14 CDT 2012 by don@Tiger2)
thekraken: Processor affinity wrapper for Folding@Home
thekraken: The Kraken comes with ABSOLUTELY NO WARRANTY; licensed under GPLv2
thekraken: PID: 27170
thekraken: Logging to thekraken.log
[06:38:00] Trying to send all finished work units
[06:38:00] + No unsent completed units remaining.
[06:38:00] - Preparing to get new work unit...
[06:38:00] Cleaning up work directory
[06:38:02] + Attempting to get work packet
[06:38:02] Passkey found
[06:38:02] - Will indicate memory of 32216 MB
[06:38:02] - Connecting to assignment server
[06:38:02] Connecting to http://assign.stanford.edu:8080/
[06:38:02] Posted data.
[06:38:02] Initial: 8F80; - Successful: assigned to (128.143.231.201).
[06:38:02] + News From Folding@Home: Welcome to Folding@Home
[06:38:02] Loaded queue successfully.
[06:38:02] Sent data
[06:38:02] Connecting to http://128.143.231.201:8080/
[06:38:09] Posted data.
[06:38:09] Initial: 0000; - Receiving payload (expected size: 30302219)
[06:38:55] - Downloaded at ~643 kB/s
[06:38:55] - Averaged speed for that direction ~629 kB/s
[06:38:55] + Received work.
[06:38:55] Trying to send all finished work units
[06:38:55] + No unsent completed units remaining.
[06:38:55] + Closed connections
[06:38:55]
[06:38:55] + Processing work unit
[06:38:55] Core required: FahCore_a5.exe
[06:38:55] Core found.
[06:38:55] Working on queue slot 02 [September 29 06:38:55 UTC]
[06:38:55] + Working ...
[06:38:55] - Calling './FahCore_a5.exe -dir work/ -nice 19 -suffix 02 -np 64 -checkpoint 15 -verbose -lifeline 2686 -version 634'
thekraken: The Kraken 0.7-pre15 (compiled Wed Aug 1 13:17:14 CDT 2012 by don@Tiger2)
thekraken: Processor affinity wrapper for Folding@Home
thekraken: The Kraken comes with ABSOLUTELY NO WARRANTY; licensed under GPLv2
thekraken: PID: 27174
thekraken: Logging to thekraken.log
[06:38:55]
[06:38:55] *------------------------------*
[06:38:55] Folding@Home Gromacs SMP Core
[06:38:55] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[06:38:55]
[06:38:55] Preparing to commence simulation
[06:38:55] - Looking at optimizations...
[06:38:55] - Created dyn
[06:38:55] - Files status OK
[06:38:59] - Expanded 30301707 -> 33158020 (decompressed 109.4 percent)
[06:38:59] Called DecompressByteArray: compressed_data_size=30301707 data_size=33158020, decompressed_data_size=33158020 diff=0
[06:38:59] - Digital signature verified
[06:38:59]
[06:38:59] Project: 8101 (Run 8, Clone 4, Gen 73)
[06:38:59]
[06:38:59] Assembly optimizations on if available.
[06:38:59] Entering M.D.
:-) G R O M A C S (-:
Groningen Machine for Chemical Simulation
:-) VERSION 4.5.3 (-:
Written by Emile Apol, Rossen Apostolov, Herman J.C. Berendsen,
Aldert van Buuren, Pär Bjelkmar, Rudi van Drunen, Anton Feenstra,
Gerrit Groenhof, Peter Kasson, Per Larsson, Pieter Meulenhoff,
Teemu Murtola, Szilard Pall, Sander Pronk, Roland Schulz,
Michael Shirts, Alfons Sijbers, Peter Tieleman,
Berk Hess, David van der Spoel, and Erik Lindahl.
Copyright (c) 1991-2000, University of Groningen, The Netherlands.
Copyright (c) 2001-2010, The GROMACS development team at
Uppsala University & The Royal Institute of Technology, Sweden.
check out http://www.gromacs.org for more information.
:-) Gromacs (-:
Reading file work/wudata_02.tpr, VERSION 4.5.5-dev-20120903-d64b9e3 (single precision)
[06:39:06] Mapping NT from 64 to 64
Starting 64 threads
Making 2D domain decomposition 8 x 8 x 1
starting mdrun 'FP_membrane in water'
18500000 steps, 74000.0 ps (continuing from step 18250000, 73000.0 ps).
[06:39:11] Completed 0 out of 250000 steps (0%)
NOTE: Turning on dynamic load balancing
[06:52:50] Completed 2500 out of 250000 steps (1%)
[07:06:16] Completed 5000 out of 250000 steps (2%)
[07:19:30] Completed 7500 out of 250000 steps (3%)
[07:32:44] Completed 10000 out of 250000 steps (4%)
[07:46:00] Completed 12500 out of 250000 steps (5%)
[07:59:15] Completed 15000 out of 250000 steps (6%)
[08:12:28] Completed 17500 out of 250000 steps (7%)
[08:15:20] - Autosending finished units... [September 29 08:15:20 UTC]
[08:15:20] Trying to send all finished work units
[08:15:20] + No unsent completed units remaining.
[08:15:20] - Autosend completed
[08:25:43] Completed 20000 out of 250000 steps (8%)
[08:38:54] Completed 22500 out of 250000 steps (9%)
[08:52:09] Completed 25000 out of 250000 steps (10%)
[09:05:23] Completed 27500 out of 250000 steps (11%)
[09:18:39] Completed 30000 out of 250000 steps (12%)
[09:31:51] Completed 32500 out of 250000 steps (13%)
[09:45:03] Completed 35000 out of 250000 steps (14%)
[09:58:16] Completed 37500 out of 250000 steps (15%)
[10:11:29] Completed 40000 out of 250000 steps (16%)
[10:24:40] Completed 42500 out of 250000 steps (17%)
[10:37:49] Completed 45000 out of 250000 steps (18%)
[10:51:02] Completed 47500 out of 250000 steps (19%)
[11:04:16] Completed 50000 out of 250000 steps (20%)
[11:17:29] Completed 52500 out of 250000 steps (21%)
[11:30:41] Completed 55000 out of 250000 steps (22%)
[11:43:57] Completed 57500 out of 250000 steps (23%)
[11:57:11] Completed 60000 out of 250000 steps (24%)
[12:10:25] Completed 62500 out of 250000 steps (25%)
[12:23:35] Completed 65000 out of 250000 steps (26%)
[12:36:48] Completed 67500 out of 250000 steps (27%)
[12:50:35] Completed 70000 out of 250000 steps (28%)
[13:03:48] Completed 72500 out of 250000 steps (29%)
[13:17:00] Completed 75000 out of 250000 steps (30%)
[13:30:12] Completed 77500 out of 250000 steps (31%)
[13:43:24] Completed 80000 out of 250000 steps (32%)
[13:56:35] Completed 82500 out of 250000 steps (33%)
[14:09:47] Completed 85000 out of 250000 steps (34%)
[14:15:20] - Autosending finished units... [September 29 14:15:20 UTC]
[14:15:20] Trying to send all finished work units
[14:15:20] + No unsent completed units remaining.
[14:15:20] - Autosend completed
[14:22:56] Completed 87500 out of 250000 steps (35%)
[14:36:11] Completed 90000 out of 250000 steps (36%)
[14:49:26] Completed 92500 out of 250000 steps (37%)
[15:02:40] Completed 95000 out of 250000 steps (38%)
[15:15:53] Completed 97500 out of 250000 steps (39%)
[15:29:04] Completed 100000 out of 250000 steps (40%)
[15:42:16] Completed 102500 out of 250000 steps (41%)
[15:55:30] Completed 105000 out of 250000 steps (42%)
[16:08:43] Completed 107500 out of 250000 steps (43%)
[16:21:55] Completed 110000 out of 250000 steps (44%)
[16:35:10] Completed 112500 out of 250000 steps (45%)
[16:48:22] Completed 115000 out of 250000 steps (46%)
[17:01:36] Completed 117500 out of 250000 steps (47%)
[17:14:52] Completed 120000 out of 250000 steps (48%)
[17:28:07] Completed 122500 out of 250000 steps (49%)
[17:41:22] Completed 125000 out of 250000 steps (50%)
[17:54:37] Completed 127500 out of 250000 steps (51%)
[18:07:49] Completed 130000 out of 250000 steps (52%)
[18:21:05] Completed 132500 out of 250000 steps (53%)
[18:34:21] Completed 135000 out of 250000 steps (54%)
[18:47:39] Completed 137500 out of 250000 steps (55%)
[19:00:56] Completed 140000 out of 250000 steps (56%)
[19:14:11] Completed 142500 out of 250000 steps (57%)
[19:27:26] Completed 145000 out of 250000 steps (58%)
[19:40:44] Completed 147500 out of 250000 steps (59%)
[19:53:57] Completed 150000 out of 250000 steps (60%)
[20:07:13] Completed 152500 out of 250000 steps (61%)
[20:15:20] - Autosending finished units... [September 29 20:15:20 UTC]
[20:15:20] Trying to send all finished work units
[20:15:20] + No unsent completed units remaining.
[20:15:20] - Autosend completed
[20:20:30] Completed 155000 out of 250000 steps (62%)
[20:33:48] Completed 157500 out of 250000 steps (63%)
[20:47:04] Completed 160000 out of 250000 steps (64%)
[21:00:22] Completed 162500 out of 250000 steps (65%)
[21:13:38] Completed 165000 out of 250000 steps (66%)
[21:26:54] Completed 167500 out of 250000 steps (67%)
[21:40:12] Completed 170000 out of 250000 steps (68%)
[21:53:23] Completed 172500 out of 250000 steps (69%)
[22:06:39] Completed 175000 out of 250000 steps (70%)
[22:19:56] Completed 177500 out of 250000 steps (71%)
[22:33:14] Completed 180000 out of 250000 steps (72%)
[22:46:32] Completed 182500 out of 250000 steps (73%)
[22:59:48] Completed 185000 out of 250000 steps (74%)
[23:13:04] Completed 187500 out of 250000 steps (75%)
[23:26:23] Completed 190000 out of 250000 steps (76%)
[23:39:39] Completed 192500 out of 250000 steps (77%)
[23:52:51] Completed 195000 out of 250000 steps (78%)
[00:06:07] Completed 197500 out of 250000 steps (79%)
[00:19:25] Completed 200000 out of 250000 steps (80%)
[00:32:43] Completed 202500 out of 250000 steps (81%)
[00:45:57] Completed 205000 out of 250000 steps (82%)
[00:59:10] Completed 207500 out of 250000 steps (83%)
[01:12:22] Completed 210000 out of 250000 steps (84%)
[01:25:39] Completed 212500 out of 250000 steps (85%)
[01:38:49] Completed 215000 out of 250000 steps (86%)
[01:52:02] Completed 217500 out of 250000 steps (87%)
[02:05:15] Completed 220000 out of 250000 steps (88%)
[02:15:20] - Autosending finished units... [September 30 02:15:20 UTC]
[02:15:20] Trying to send all finished work units
[02:15:20] + No unsent completed units remaining.
[02:15:20] - Autosend completed
[02:18:27] Completed 222500 out of 250000 steps (89%)
[02:31:43] Completed 225000 out of 250000 steps (90%)
[02:44:59] Completed 227500 out of 250000 steps (91%)
[02:58:15] Completed 230000 out of 250000 steps (92%)
[03:11:30] Completed 232500 out of 250000 steps (93%)
[03:24:48] Completed 235000 out of 250000 steps (94%)
[03:38:02] Completed 237500 out of 250000 steps (95%)
[03:51:17] Completed 240000 out of 250000 steps (96%)
[04:04:33] Completed 242500 out of 250000 steps (97%)
[04:17:47] Completed 245000 out of 250000 steps (98%)
[04:31:00] Completed 247500 out of 250000 steps (99%)
[04:44:12] Completed 250000 out of 250000 steps (100%)
Writing final coordinates.
Average load imbalance: 0.5 %
Part of the total run time spent waiting due to load imbalance: 0.1 %
Steps where the load balancing was limited by -rdd, -rcon and/or -dds: X 0 % Y 0 %
Parallel run - timing based on wallclock.
NODE (s) Real (s) (%)
Time: 79603.690 79603.690 100.0
22h06:43
(Mnbf/s) (GFlops) (ns/day) (hour/ns)
Performance: 1365.305 71.605 1.085 22.112
Thanx for Using GROMACS - Have a Nice Day
[04:45:54] DynamicWrapper: Finished Work Unit: sleep=10000
[04:46:04]
[04:46:04] Finished Work Unit:
[04:46:04] - Reading up to 64340496 from "work/wudata_02.trr": Read 64340496
[04:46:24] trr file hash check passed.
[04:46:24] - Reading up to 31615084 from "work/wudata_02.xtc": Read 31615084
[04:46:25] xtc file hash check passed.
[04:46:25] edr file hash check passed.
[04:46:25] logfile size: 192471
[04:46:25] Leaving Run
[04:46:30] - Writing 96308927 bytes of core data to disk...
[04:46:57] Done: 96308415 -> 91554256 (compressed to 5.8 percent)
[04:46:58] ... Done.
[04:47:12] - Shutting down core
[04:47:12]
[04:47:12] Folding@home Core Shutdown: FINISHED_UNIT
[04:47:13] CoreStatus = 64 (100)
[04:47:13] Unit 2 finished with 77 percent of time to deadline remaining.
[04:47:13] Updated performance fraction: 0.773624
[04:47:13] Sending work to server
[04:47:13] Project: 8101 (Run 8, Clone 4, Gen 73)
[04:47:13] + Attempting to send results [September 30 04:47:13 UTC]
[04:47:13] - Reading file work/wuresults_02.dat from core
[04:47:14] (Read 91554768 bytes from disk)
[04:47:14] Connecting to http://128.143.231.201:8080/
[04:48:05] Posted data.
[04:48:05] Initial: 0000; - Uploaded at ~1753 kB/s
[04:48:05] - Averaged speed for that direction ~1368 kB/s
[04:48:05] - Server reports problem with unit.
[04:48:05] Trying to send all finished work units
[04:48:05] + No unsent completed units remaining.
[04:48:05] - Preparing to get new work unit...
[04:48:05] Cleaning up work directory
[04:48:06] + Attempting to get work packet
[04:48:06] Passkey found
[04:48:06] - Will indicate memory of 32216 MB
[04:48:06] - Connecting to assignment server
[04:48:06] Connecting to http://assign.stanford.edu:8080/
[04:48:06] Posted data.
[04:48:06] Initial: 8F80; - Successful: assigned to (128.143.231.201).
[04:48:06] + News From Folding@Home: Welcome to Folding@Home
[04:48:06] Loaded queue successfully.
[04:48:06] Sent data
[04:48:06] Connecting to http://128.143.231.201:8080/
[04:48:14] Posted data.
[04:48:14] Initial: 0000; - Receiving payload (expected size: 30302219)
[04:49:02] - Downloaded at ~629 kB/s
[04:49:02] - Averaged speed for that direction ~629 kB/s
[04:49:02] + Received work.
[04:49:03] Trying to send all finished work units
[04:49:03] + No unsent completed units remaining.
[04:49:03] + Closed connections
[04:49:03]
[04:49:03] + Processing work unit
[04:49:03] Core required: FahCore_a5.exe
[04:49:03] Core found.
[04:49:03] Working on queue slot 03 [September 30 04:49:03 UTC]
[04:49:03] + Working ...
[04:49:03] - Calling './FahCore_a5.exe -dir work/ -nice 19 -suffix 03 -np 64 -checkpoint 15 -verbose -lifeline 2686 -version 634'
thekraken: The Kraken 0.7-pre15 (compiled Wed Aug 1 13:17:14 CDT 2012 by don@Tiger2)
thekraken: Processor affinity wrapper for Folding@Home
thekraken: The Kraken comes with ABSOLUTELY NO WARRANTY; licensed under GPLv2
thekraken: PID: 27866
thekraken: Logging to thekraken.log
[04:49:03]
[04:49:03] *------------------------------*
[04:49:03] Folding@Home Gromacs SMP Core
[04:49:03] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[04:49:03]
[04:49:03] Preparing to commence simulation
[04:49:03] - Looking at optimizations...
[04:49:03] - Created dyn
[04:49:03] - Files status OK
[04:49:07] - Expanded 30301707 -> 33158020 (decompressed 109.4 percent)
[04:49:07] Called DecompressByteArray: compressed_data_size=30301707 data_size=33158020, decompressed_data_size=33158020 diff=0
[04:49:07] - Digital signature verified
[04:49:07]
[04:49:07] Project: 8101 (Run 8, Clone 4, Gen 73)
[04:49:07]
[04:49:07] Assembly optimizations on if available.
[04:49:07] Entering M.D.
:-) G R O M A C S (-:
Groningen Machine for Chemical Simulation
:-) VERSION 4.5.3 (-:
Written by Emile Apol, Rossen Apostolov, Herman J.C. Berendsen,
Aldert van Buuren, Pär Bjelkmar, Rudi van Drunen, Anton Feenstra,
Gerrit Groenhof, Peter Kasson, Per Larsson, Pieter Meulenhoff,
Teemu Murtola, Szilard Pall, Sander Pronk, Roland Schulz,
Michael Shirts, Alfons Sijbers, Peter Tieleman,
Berk Hess, David van der Spoel, and Erik Lindahl.
Copyright (c) 1991-2000, University of Groningen, The Netherlands.
Copyright (c) 2001-2010, The GROMACS development team at
Uppsala University & The Royal Institute of Technology, Sweden.
check out http://www.gromacs.org for more information.
:-) Gromacs (-:
Reading file work/wudata_03.tpr, VERSION 4.5.5-dev-20120903-d64b9e3 (single precision)
[04:49:14] Mapping NT from 64 to 64
Starting 64 threads
Making 2D domain decomposition 8 x 8 x 1
starting mdrun 'FP_membrane in water'
18500000 steps, 74000.0 ps (continuing from step 18250000, 73000.0 ps).
[04:49:19] Completed 0 out of 250000 steps (0%)
NOTE: Turning on dynamic load balancing
Re: Server reports problem with unit.
Posted: Sun Sep 30, 2012 6:47 pm
by bollix47
The good news is the problem may now be fixed:
viewtopic.php?p=225241#p225241
Re: Server reports problem with unit.
Posted: Sun Sep 30, 2012 6:50 pm
by orion456
Considering my WU just reported an hour ago, and had the error, it must have been a quick fix since then.
Re: Bigadv Collection and or Assighnment server is broken
Posted: Sun Sep 30, 2012 7:05 pm
by Grandpa_01
texinga wrote:Grandpa, just curious...how do you know the Servers are working properly again? Are you seeing Bigadvs that are now being received and credited properly? Thanks.
Yes I have returned 2 today both got the thank your for contribution to folding@home message and the Number of units completed message
Re: Server reports problem with unit.
Posted: Sun Sep 30, 2012 7:07 pm
by bollix47
All I can say for certain is that Grandpa received bigadv points on the last EOC update so for him it was fixed at least 3 hours ago. We haven't heard anything official from Dr. Kasson since page 1 where he said he was going to look into the problem.
Re: Bigadv Collection and or Assighnment server is broken
Posted: Sun Sep 30, 2012 7:07 pm
by Grandpa_01
texinga wrote:Also, I lost an 8102 ~12:30am today due to this same problem with the Servers. My 4P was represented with that same WU (same Run,Clone,Gen) and will be finishing it (for a second time) in about 1.5hrs. Do we know if the WUs that were rejected today were in fact discarded? I'd just like to know if this repeat that I'm doing of that same WU is for naught or if it will be useful.
And yes they will be accepted this time both of mine were reruns
Server reports problem with unit (8102)
Posted: Sun Sep 30, 2012 7:31 pm
by [T]yphoon
ok, i just finished with a 8102 but it seems i cant upload it to the server (not using a proxy)
and i dont know if its a bad WU or something, but its finished
you might want to scroll down, big list
Code: Select all
# Linux SMP Console Edition ###################################################
###############################################################################
Folding@Home Client Version 6.34
http://folding.stanford.edu
###############################################################################
###############################################################################
Launch directory: /home/zs-006fah/Desktop/FAH
Executable: ./fah6
Arguments: -smp 12 -bigadv
[19:55:49] - Ask before connecting: No
[19:55:49] - User name: [T]yphoon (Team 37726)
[19:55:49] - User ID: 636BF593922220E
[19:55:49] - Machine ID: 1
[19:55:49]
[19:55:49] Loaded queue successfully.
[19:55:49]
[19:55:49] + Processing work unit
[19:55:49] Core required: FahCore_a5.exe
[19:55:49] Core found.
[19:55:49] Working on queue slot 03 [September 28 19:55:49 UTC]
[19:55:49] + Working ...
[19:55:49]
[19:55:49] *------------------------------*
[19:55:49] Folding@Home Gromacs SMP Core
[19:55:49] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[19:55:49]
[19:55:49] Preparing to commence simulation
[19:55:49] - Looking at optimizations...
[19:55:49] - Files status OK
[19:55:51] - Expanded 30341103 -> 33163648 (decompressed 109.3 percent)
[19:55:51] Called DecompressByteArray: compressed_data_size=30341103 data_size=33163648, decompressed_data_size=33163648 diff=0
[19:55:51] - Digital signature verified
[19:55:51]
[19:55:51] Project: 8102 (Run 0, Clone 35, Gen 55)
[19:55:51]
[19:55:51] Assembly optimizations on if available.
[19:55:51] Entering M.D.
[19:55:57] Using Gromacs checkpoints
[19:55:58] Mapping NT from 12 to 12
[19:56:06] Resuming from checkpoint
[19:56:07] Verified work/wudata_03.log
[19:56:07] Verified work/wudata_03.trr
[19:56:07] Verified work/wudata_03.xtc
[19:56:07] Verified work/wudata_03.edr
[19:56:09] Completed 68215 out of 250000 steps (27%)
[20:15:52] Completed 70000 out of 250000 steps (28%)
[20:43:46] Completed 72500 out of 250000 steps (29%)
[21:10:41] Completed 75000 out of 250000 steps (30%)
[21:37:46] Completed 77500 out of 250000 steps (31%)
[22:06:23] Completed 80000 out of 250000 steps (32%)
[22:33:54] Completed 82500 out of 250000 steps (33%)
[23:01:31] Completed 85000 out of 250000 steps (34%)
[23:29:17] Completed 87500 out of 250000 steps (35%)
[23:58:42] Completed 90000 out of 250000 steps (36%)
[00:26:32] Completed 92500 out of 250000 steps (37%)
[00:54:49] Completed 95000 out of 250000 steps (38%)
[01:23:08] Completed 97500 out of 250000 steps (39%)
[01:51:45] Completed 100000 out of 250000 steps (40%)
[02:20:36] Completed 102500 out of 250000 steps (41%)
[02:49:15] Completed 105000 out of 250000 steps (42%)
[03:17:24] Completed 107500 out of 250000 steps (43%)
[03:46:17] Completed 110000 out of 250000 steps (44%)
[04:14:36] Completed 112500 out of 250000 steps (45%)
[04:42:45] Completed 115000 out of 250000 steps (46%)
[05:11:33] Completed 117500 out of 250000 steps (47%)
[05:40:04] Completed 120000 out of 250000 steps (48%)
[06:08:31] Completed 122500 out of 250000 steps (49%)
[06:36:51] Completed 125000 out of 250000 steps (50%)
[07:04:55] Completed 127500 out of 250000 steps (51%)
[07:33:17] Completed 130000 out of 250000 steps (52%)
[08:01:15] Completed 132500 out of 250000 steps (53%)
[08:29:26] Completed 135000 out of 250000 steps (54%)
[08:58:35] Completed 137500 out of 250000 steps (55%)
[09:27:36] Completed 140000 out of 250000 steps (56%)
[09:55:39] Completed 142500 out of 250000 steps (57%)
[10:23:39] Completed 145000 out of 250000 steps (58%)
[10:51:54] Completed 147500 out of 250000 steps (59%)
[11:20:14] Completed 150000 out of 250000 steps (60%)
[11:49:25] Completed 152500 out of 250000 steps (61%)
[12:17:39] Completed 155000 out of 250000 steps (62%)
[12:45:53] Completed 157500 out of 250000 steps (63%)
[13:15:41] Completed 160000 out of 250000 steps (64%)
[14:39:29] Completed 162500 out of 250000 steps (65%)
[15:08:17] Completed 165000 out of 250000 steps (66%)
[15:37:07] Completed 167500 out of 250000 steps (67%)
[16:06:36] Completed 170000 out of 250000 steps (68%)
[16:34:55] Completed 172500 out of 250000 steps (69%)
[17:03:36] Completed 175000 out of 250000 steps (70%)
[17:32:04] Completed 177500 out of 250000 steps (71%)
[18:01:00] Completed 180000 out of 250000 steps (72%)
[18:30:52] Completed 182500 out of 250000 steps (73%)
[18:59:28] Completed 185000 out of 250000 steps (74%)
[19:27:01] Completed 187500 out of 250000 steps (75%)
[19:54:26] Completed 190000 out of 250000 steps (76%)
[20:21:36] Completed 192500 out of 250000 steps (77%)
[20:48:56] Completed 195000 out of 250000 steps (78%)
[21:16:50] Completed 197500 out of 250000 steps (79%)
[21:44:24] Completed 200000 out of 250000 steps (80%)
[22:11:33] Completed 202500 out of 250000 steps (81%)
[22:38:58] Completed 205000 out of 250000 steps (82%)
[23:06:22] Completed 207500 out of 250000 steps (83%)
[23:33:49] Completed 210000 out of 250000 steps (84%)
[00:02:10] Completed 212500 out of 250000 steps (85%)
[00:30:19] Completed 215000 out of 250000 steps (86%)
[00:58:06] Completed 217500 out of 250000 steps (87%)
[01:26:36] Completed 220000 out of 250000 steps (88%)
[01:54:45] Completed 222500 out of 250000 steps (89%)
[02:23:54] Completed 225000 out of 250000 steps (90%)
[02:52:27] Completed 227500 out of 250000 steps (91%)
[03:19:23] Completed 230000 out of 250000 steps (92%)
[03:46:39] Completed 232500 out of 250000 steps (93%)
[04:13:40] Completed 235000 out of 250000 steps (94%)
[04:40:53] Completed 237500 out of 250000 steps (95%)
[05:07:49] Completed 240000 out of 250000 steps (96%)
[05:35:08] Completed 242500 out of 250000 steps (97%)
[06:02:59] Completed 245000 out of 250000 steps (98%)
[06:30:00] Completed 247500 out of 250000 steps (99%)
[06:57:39] Completed 250000 out of 250000 steps (100%)
[06:57:49] DynamicWrapper: Finished Work Unit: sleep=10000
[06:57:59]
[06:57:59] Finished Work Unit:
[06:57:59] - Reading up to 64407792 from "work/wudata_03.trr": Read 64407792
[06:57:59] trr file hash check passed.
[06:57:59] - Reading up to 31746692 from "work/wudata_03.xtc": Read 31746692
[06:57:59] xtc file hash check passed.
[06:57:59] edr file hash check passed.
[06:57:59] logfile size: 198855
[06:57:59] Leaving Run
[06:58:04] - Writing 96514215 bytes of core data to disk...
[06:58:16] Done: 96513703 -> 91761108 (compressed to 6.0 percent)
[06:58:16] ... Done.
[06:59:59] - Shutting down core
[06:59:59]
[06:59:59] Folding@home Core Shutdown: FINISHED_UNIT
[07:00:13] CoreStatus = 64 (100)
[07:00:13] Sending work to server
[07:00:13] Project: 8102 (Run 0, Clone 35, Gen 55)
[07:00:13] + Attempting to send results [September 30 07:00:13 UTC]
[07:08:37] - Server reports problem with unit.
[07:08:37] - Preparing to get new work unit...
Re: Bigadv Collection and or Assighnment server is broken
Posted: Sun Sep 30, 2012 8:09 pm
by bollix47
Welcome to the folding support forum [T]yphoon.
As you can see I've moved your post to this thread discussing the problem that you and others have had. We've had at least one report that the situation has been corrected.
Re: Server reports problem with unit.
Posted: Sun Sep 30, 2012 8:12 pm
by bruce
bollix47 wrote:All I can say for certain is that Grandpa received bigadv points on the last EOC update so for him it was fixed at least 3 hours ago. We haven't heard anything official from Dr. Kasson since page 1 where he said he was going to look into the problem.
That's not uncommon. If a PG member fixes a problem, they assume you'll be paying attention and will see the change on your end. (This case is a bit unusual, as you have to finish another WU to really tell.) It's only if they find a problem that cannot be fixed promptly that you'll get a notification not to expect any fixes soon.
Re: Bigadv Collection and or Assighnment server is broken
Posted: Sun Sep 30, 2012 8:14 pm
by kasson
I haven't heard anything back yet--I'll post more when I have more information. I'm glad some returns seem to be running successfully, but I'd like to track this down so I can be sure it's resolved (and so I can do my best to prevent it from happening again.)
Re: Bigadv Collection and or Assighnment server is broken
Posted: Sun Sep 30, 2012 8:15 pm
by -alias-
I got this just a few minutes ago on my SR-2?
Code: Select all
[19:58:22] - Autosending finished units... [September 30 19:58:22 UTC]
[19:58:22] + Processing work unit
[19:58:22] Trying to send all finished work units
[19:58:22] Project: 8101 (Run 3, Clone 12, Gen 19)
[19:58:22] Core required: FahCore_a5.exe
[19:58:22] Core found.
[19:58:22] + Attempting to send results [September 30 19:58:22 UTC]
[19:58:22] - Reading file work/wuresults_04.dat from core
[19:58:23] Working on queue slot 08 [September 30 19:58:23 UTC]
[19:58:23] + Working ...
[19:58:23] - Calling './FahCore_a5.exe -dir work/ -nice 19 -suffix 08 -np 24 -checkpoint 3 -verbose -lifeline 1830 -version 634'
[19:58:23] (Read 91631428 bytes from disk)
[19:58:23] Connecting to http://128.143.231.201:8080/
[19:58:23]
[19:58:23] *------------------------------*
[19:58:23] Folding@Home Gromacs SMP Core
[19:58:23] Version 2.27 (Thu Feb 10 09:46:40 PST 2011)
[19:58:23]
[19:58:23] Preparing to commence simulation
[19:58:23] - Ensuring status. Please wait.
[19:58:33] - Looking at optimizations...
[19:58:33] - Working with standard loops on this execution.
[19:58:33] - Previous termination of core was improper.
[19:58:33] - Files status OK
[19:58:35] - Expanded 24863922 -> 30796292 (decompressed 123.8 percent)
[19:58:35] Called DecompressByteArray: compressed_data_size=24863922 data_size=30796292, decompressed_data_size=30796292 diff=0
[19:58:35] - Digital signature verified
[19:58:35]
[19:58:35] Project: 6901 (Run 14, Clone 0, Gen 317)
[19:58:35]
[19:58:35] Entering M.D.
[19:58:42] Mapping NT from 24 to 24
[19:58:44] Completed 0 out of 250000 steps (0%)
[20:00:52] Posted data.
[20:00:52] Initial: 0000; - Uploaded at ~600 kB/s
[20:00:52] - Averaged speed for that direction ~564 kB/s
[20:00:52] - Server reports problem with unit.
[20:00:52] + Sent 0 of 1 completed units to the server
[20:00:52] - Autosend completed
Re: Bigadv Collection and or Assighnment server is broken
Posted: Sun Sep 30, 2012 8:15 pm
by patonb
I just uploaded and 8101 too,
Code: Select all
[19:42:43] Folding@home Core Shutdown: FINISHED_UNIT
[19:42:45] CoreStatus = 64 (100)
[19:42:45] Unit 7 finished with 44 percent of time to deadline remaining.
[19:42:45] Updated performance fraction: 0.624860
[19:42:45] Sending work to server
[19:42:45] Project: 8101 (Run 20, Clone 0, Gen 32)
[19:42:45] + Attempting to send results [September 30 19:42:45 UTC]
[19:42:45] - Reading file work/wuresults_07.dat from core
[19:42:46] (Read 91520179 bytes from disk)
[19:42:46] Connecting to http://128.143.231.201:8080/
[20:09:44] Posted data.
[20:09:44] Initial: 0000; - Uploaded at ~55 kB/s
[20:09:44] - Averaged speed for that direction ~54 kB/s
[20:09:44] - Server reports problem with unit.
[20:09:44] Trying to send all finished work units
[20:09:44] + No unsent completed units remaining.
[20:09:44] - Preparing to get new work unit...
[20:09:44] Cleaning up work directory
[20:09:45] + Attempting to get work packet
[20:09:45] Passkey found
[20:09:45] - Will indicate memory of 6584 MB
[20:09:45] - Connecting to assignment server
[20:09:45] Connecting to http://assign.stanford.edu:8080/
[20:09:45] Posted data.
[20:09:45] Initial: 8F80; - Successful: assigned to (128.143.231.201).
[20:09:45] + News From Folding@Home: Welcome to Folding@Home
[20:09:45] Loaded queue successfully.
[20:09:45] Sent data
[20:09:45] Connecting to http://128.143.231.201:8080/
[20:09:51] Posted data.
[20:09:51] Initial: 0000; - Receiving payload (expected size: 30309430)
[20:10:16] - Downloaded at ~1183 kB/s
[20:10:16] - Averaged speed for that direction ~1063 kB/s
[20:10:16] + Received work.
[20:10:16] Trying to send all finished work units
[20:10:16] + No unsent completed units remaining.
[20:10:16] + Closed connections
[20:10:16]
[20:10:16] + Processing work unit
[20:10:16] Core required: FahCore_a5.exe
[20:10:16] Core found.
[20:10:16] Working on queue slot 08 [September 30 20:10:16 UTC]
[20:10:16] + Working ...
[20:10:16] - Calling './FahCore_a5.exe -dir work/ -nice 19 -suffix 08 -np 24 -priority 96 -checkpoint 30 -verbose -lifeline 1617 -version 634'
Re: Bigadv Collection and or Assighnment server is broken
Posted: Sun Sep 30, 2012 8:20 pm
by kromberg
kasson wrote:I haven't heard anything back yet--I'll post more when I have more information. I'm glad some returns seem to be running successfully, but I'd like to track this down so I can be sure it's resolved (and so I can do my best to prevent it from happening again.)
This stuff still is not resolved. Why do these outages continuely happen? Every 2 to 3 months it is the same thing. Over and over again.