Project: 6504 (Run 7, Clone 243, Gen 78) ERROR 0X0 at ~64%

[karlinhigh]

I'm a bit late reporting this, but I had a work unit that consistently failed shortly after reaching 64%. Apparently it's not an Early Unit End, because it deleted it and started over. After 3 occurrences, it gave up and moved on to a different work unit. I didn't notice until later when I checked the logs. FYI: The machine is a Dell Optiplex GX270, Pentium 4 2.8 GHz, 1.5 GB RAM, running Untangle Linux 8.1.1.

Code: Select all

# Linux Console Edition #######################################################
###############################################################################

                       Folding@Home Client Version 6.02

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/karlin/FAH
Executable: ./fah6
Arguments: -verbosity 9 

[22:28:30] - Ask before connecting: No
[22:28:30] - User name: desktopsvcs.com (Team 35054)
[22:28:30] - User ID: 23F8368F4A5765C7
[22:28:30] - Machine ID: 1

### Skip to relevant section ###

[02:43:59] - Preparing to get new work unit...
[02:43:59] + Attempting to get work packet
[02:43:59] - Will indicate memory of 1510 MB
[02:43:59] - Connecting to assignment server
[02:43:59] Connecting to http://assign.stanford.edu:8080/
[02:43:59] Posted data.
[02:43:59] Initial: 40AB; - Successful: assigned to (171.64.65.62).
[02:43:59] + News From Folding@Home: Welcome to Folding@Home
[02:43:59] Loaded queue successfully.
[02:43:59] Connecting to http://171.64.65.62:8080/
[02:44:00] Posted data.
[02:44:00] Initial: 0000; - Receiving payload (expected size: 717400)
[02:44:01] - Downloaded at ~700 kB/s
[02:44:01] - Averaged speed for that direction ~540 kB/s
[02:44:01] + Received work.
[02:44:01] Trying to send all finished work units
[02:44:01] + No unsent completed units remaining.
[02:44:01] + Closed connections
[02:44:01] 
[02:44:01] + Processing work unit
[02:44:01] Core required: FahCore_78.exe
[02:44:01] Core found.
[02:44:01] Working on Unit 09 [May 30 02:44:01]
[02:44:01] + Working ...
[02:44:01] - Calling './FahCore_78.exe -dir work/ -suffix 09 -checkpoint 15 -verbose -lifeline 16313 -version 602'

[02:44:01] 
[02:44:01] *------------------------------*
[02:44:01] Folding@Home Gromacs Core
[02:44:01] Version 1.90 (March 8, 2006)
[02:44:01] 
[02:44:01] Preparing to commence simulation
[02:44:01] - Looking at optimizations...
[02:44:01] - Created dyn
[02:44:01] - Files status OK
[02:44:02] - Expanded 716888 -> 3538317 (decompressed 493.5 percent)
[02:44:02] - Starting from initial work packet
[02:44:02] 
[02:44:02] Project: 6504 (Run 7, Clone 243, Gen 78)
[02:44:02] 
[02:44:02] Assembly optimizations on if available.
[02:44:02] Entering M.D.
[02:44:08] Protein: TR568_8 in water
[02:44:08] 
[02:44:08] Writing local files
[02:44:08] Extra SSE boost OK.
[02:44:09] Writing local files
[02:44:09] Completed 0 out of 250000 steps  (0%)
[02:59:09] Timered checkpoint triggered.
[02:59:34] Writing local files
[02:59:34] Completed 2500 out of 250000 steps  (1%)
[03:14:35] Timered checkpoint triggered.
[03:15:21] Writing local files
[03:15:21] Completed 5000 out of 250000 steps  (2%)
[03:30:22] Timered checkpoint triggered.
[03:30:49] Writing local files
[03:30:49] Completed 7500 out of 250000 steps  (3%)
[03:45:50] Timered checkpoint triggered.
[03:46:17] Writing local files
[03:46:17] Completed 10000 out of 250000 steps  (4%)
[04:01:18] Timered checkpoint triggered.
[04:01:44] Writing local files
[04:01:44] Completed 12500 out of 250000 steps  (5%)
[04:16:45] Timered checkpoint triggered.
[04:17:34] Writing local files
[04:17:34] Completed 15000 out of 250000 steps  (6%)
[04:28:30] - Autosending finished units...
[04:28:30] Trying to send all finished work units
[04:28:30] + No unsent completed units remaining.
[04:28:30] - Autosend completed
[04:32:34] Timered checkpoint triggered.
[04:33:02] Writing local files
[04:33:02] Completed 17500 out of 250000 steps  (7%)
[04:48:03] Timered checkpoint triggered.
[04:48:29] Writing local files
[04:48:29] Completed 20000 out of 250000 steps  (8%)
[05:03:30] Timered checkpoint triggered.
[05:03:57] Writing local files
[05:03:57] Completed 22500 out of 250000 steps  (9%)
[05:18:58] Timered checkpoint triggered.
[05:19:46] Writing local files
[05:19:46] Completed 25000 out of 250000 steps  (10%)
[05:34:47] Timered checkpoint triggered.
[05:35:22] Writing local files
[05:35:22] Completed 27500 out of 250000 steps  (11%)
[05:50:23] Timered checkpoint triggered.
[05:50:48] Writing local files
[05:50:48] Completed 30000 out of 250000 steps  (12%)
[06:05:49] Timered checkpoint triggered.
[06:06:15] Writing local files
[06:06:15] Completed 32500 out of 250000 steps  (13%)
[06:21:15] Timered checkpoint triggered.
[06:22:03] Writing local files
[06:22:03] Completed 35000 out of 250000 steps  (14%)
[06:37:04] Timered checkpoint triggered.
[06:37:30] Writing local files
[06:37:30] Completed 37500 out of 250000 steps  (15%)
[06:52:31] Timered checkpoint triggered.
[06:52:58] Writing local files
[06:52:58] Completed 40000 out of 250000 steps  (16%)
[07:07:59] Timered checkpoint triggered.
[07:09:01] Writing local files
[07:09:02] Completed 42500 out of 250000 steps  (17%)
[07:24:02] Timered checkpoint triggered.
[07:24:50] Writing local files
[07:24:50] Completed 45000 out of 250000 steps  (18%)
[07:39:51] Timered checkpoint triggered.
[07:40:19] Writing local files
[07:40:19] Completed 47500 out of 250000 steps  (19%)
[07:55:19] Timered checkpoint triggered.
[07:55:46] Writing local files
[07:55:46] Completed 50000 out of 250000 steps  (20%)
[08:10:47] Timered checkpoint triggered.
[08:11:14] Writing local files
[08:11:14] Completed 52500 out of 250000 steps  (21%)
[08:26:14] Timered checkpoint triggered.
[08:27:01] Writing local files
[08:27:01] Completed 55000 out of 250000 steps  (22%)
[08:42:02] Timered checkpoint triggered.
[08:42:29] Writing local files
[08:42:29] Completed 57500 out of 250000 steps  (23%)
[08:57:29] Timered checkpoint triggered.
[08:57:54] Writing local files
[08:57:54] Completed 60000 out of 250000 steps  (24%)
[09:12:54] Timered checkpoint triggered.
[09:13:21] Writing local files
[09:13:21] Completed 62500 out of 250000 steps  (25%)
[09:28:22] Timered checkpoint triggered.
[09:29:11] Writing local files
[09:29:11] Completed 65000 out of 250000 steps  (26%)
[09:44:11] Timered checkpoint triggered.
[09:44:39] Writing local files
[09:44:39] Completed 67500 out of 250000 steps  (27%)
[09:59:40] Timered checkpoint triggered.
[10:00:07] Writing local files
[10:00:07] Completed 70000 out of 250000 steps  (28%)
[10:15:07] Timered checkpoint triggered.
[10:15:34] Writing local files
[10:15:34] Completed 72500 out of 250000 steps  (29%)
[10:28:30] - Autosending finished units...
[10:28:30] Trying to send all finished work units
[10:28:30] + No unsent completed units remaining.
[10:28:30] - Autosend completed
[10:30:35] Timered checkpoint triggered.
[10:31:22] Writing local files
[10:31:22] Completed 75000 out of 250000 steps  (30%)
[10:46:23] Timered checkpoint triggered.
[10:46:49] Writing local files
[10:46:49] Completed 77500 out of 250000 steps  (31%)
[11:01:50] Timered checkpoint triggered.
[11:02:16] Writing local files
[11:02:17] Completed 80000 out of 250000 steps  (32%)
[11:17:17] Timered checkpoint triggered.
[11:17:43] Writing local files
[11:17:43] Completed 82500 out of 250000 steps  (33%)
[11:32:44] Timered checkpoint triggered.
[11:33:32] Writing local files
[11:33:32] Completed 85000 out of 250000 steps  (34%)
[11:48:33] Timered checkpoint triggered.
[11:48:58] Writing local files
[11:48:58] Completed 87500 out of 250000 steps  (35%)
[12:03:59] Timered checkpoint triggered.
[12:04:24] Writing local files
[12:04:24] Completed 90000 out of 250000 steps  (36%)
[12:19:25] Timered checkpoint triggered.
[12:19:51] Writing local files
[12:19:51] Completed 92500 out of 250000 steps  (37%)
[12:34:52] Timered checkpoint triggered.
[12:35:38] Writing local files
[12:35:38] Completed 95000 out of 250000 steps  (38%)
[12:50:38] Timered checkpoint triggered.
[12:51:04] Writing local files
[12:51:04] Completed 97500 out of 250000 steps  (39%)
[13:06:04] Timered checkpoint triggered.
[13:06:29] Writing local files
[13:06:29] Completed 100000 out of 250000 steps  (40%)
[13:21:30] Timered checkpoint triggered.
[13:21:55] Writing local files
[13:21:55] Completed 102500 out of 250000 steps  (41%)
[13:36:56] Timered checkpoint triggered.
[13:37:45] Writing local files
[13:37:45] Completed 105000 out of 250000 steps  (42%)
[13:52:46] Timered checkpoint triggered.
[13:53:10] Writing local files
[13:53:10] Completed 107500 out of 250000 steps  (43%)
[14:08:11] Timered checkpoint triggered.
[14:08:38] Writing local files
[14:08:38] Completed 110000 out of 250000 steps  (44%)
[14:23:38] Timered checkpoint triggered.
[14:24:07] Writing local files
[14:24:07] Completed 112500 out of 250000 steps  (45%)
[14:39:08] Timered checkpoint triggered.
[14:39:54] Writing local files
[14:39:54] Completed 115000 out of 250000 steps  (46%)
[14:54:55] Timered checkpoint triggered.
[14:55:22] Writing local files
[14:55:22] Completed 117500 out of 250000 steps  (47%)
[15:10:23] Timered checkpoint triggered.
[15:10:52] Writing local files
[15:10:52] Completed 120000 out of 250000 steps  (48%)
[15:25:53] Timered checkpoint triggered.
[15:26:20] Writing local files
[15:26:20] Completed 122500 out of 250000 steps  (49%)
[15:41:21] Timered checkpoint triggered.
[15:42:09] Writing local files
[15:42:09] Completed 125000 out of 250000 steps  (50%)
[15:57:10] Timered checkpoint triggered.
[15:57:35] Writing local files
[15:57:35] Completed 127500 out of 250000 steps  (51%)
[16:12:36] Timered checkpoint triggered.
[16:13:01] Writing local files
[16:13:01] Completed 130000 out of 250000 steps  (52%)
[16:28:02] Timered checkpoint triggered.
[16:28:30] - Autosending finished units...
[16:28:30] Trying to send all finished work units
[16:28:30] + No unsent completed units remaining.
[16:28:30] - Autosend completed
[16:28:36] Writing local files
[16:28:36] Completed 132500 out of 250000 steps  (53%)
[16:43:37] Timered checkpoint triggered.
[16:44:44] Writing local files
[16:44:44] Completed 135000 out of 250000 steps  (54%)
[16:59:44] Timered checkpoint triggered.
[17:00:15] Writing local files
[17:00:15] Completed 137500 out of 250000 steps  (55%)
[17:15:15] Timered checkpoint triggered.
[17:15:38] Writing local files
[17:15:38] Completed 140000 out of 250000 steps  (56%)
[17:30:38] Timered checkpoint triggered.
[17:31:10] Writing local files
[17:31:11] Completed 142500 out of 250000 steps  (57%)
[17:46:11] Timered checkpoint triggered.
[17:46:57] Writing local files
[17:46:57] Completed 145000 out of 250000 steps  (58%)
[18:01:58] Timered checkpoint triggered.
[18:02:22] Writing local files
[18:02:22] Completed 147500 out of 250000 steps  (59%)
[18:17:23] Timered checkpoint triggered.
[18:17:46] Writing local files
[18:17:47] Completed 150000 out of 250000 steps  (60%)
[18:32:47] Timered checkpoint triggered.
[18:33:25] Writing local files
[18:33:25] Completed 152500 out of 250000 steps  (61%)
[18:48:25] Timered checkpoint triggered.
[18:49:03] Writing local files
[18:49:03] Completed 155000 out of 250000 steps  (62%)
[19:04:04] Timered checkpoint triggered.
[19:04:31] Writing local files
[19:04:31] Completed 157500 out of 250000 steps  (63%)
[19:19:32] Timered checkpoint triggered.
[19:19:59] Writing local files
[19:19:59] Completed 160000 out of 250000 steps  (64%)
[19:22:23] CoreStatus = 0 (0)
[19:22:23] Client-core communications error: ERROR 0x0
[19:22:23] Deleting current work unit & continuing...
[19:22:40] Trying to send all finished work units
[19:22:40] + No unsent completed units remaining.
[19:22:40] - Preparing to get new work unit...
[19:22:40] + Attempting to get work packet
[19:22:40] - Will indicate memory of 1510 MB
[19:22:40] - Connecting to assignment server
[19:22:40] Connecting to http://assign.stanford.edu:8080/
[19:22:41] Posted data.
[19:22:41] Initial: 40AB; - Successful: assigned to (171.64.65.62).
[19:22:41] + News From Folding@Home: Welcome to Folding@Home
[19:22:41] Loaded queue successfully.
[19:22:41] Connecting to http://171.64.65.62:8080/
[19:22:42] Posted data.
[19:22:42] Initial: 0000; - Receiving payload (expected size: 717400)
[19:22:43] - Downloaded at ~700 kB/s
[19:22:43] - Averaged speed for that direction ~572 kB/s
[19:22:43] + Received work.
[19:22:43] + Closed connections
[19:22:48] 
[19:22:48] + Processing work unit
[19:22:48] Core required: FahCore_78.exe
[19:22:48] Core found.
[19:22:48] Working on Unit 00 [May 30 19:22:48]
[19:22:48] + Working ...
[19:22:48] - Calling './FahCore_78.exe -dir work/ -suffix 00 -checkpoint 15 -verbose -lifeline 16313 -version 602'

[19:22:48] 
[19:22:48] *------------------------------*
[19:22:48] Folding@Home Gromacs Core
[19:22:48] Version 1.90 (March 8, 2006)
[19:22:48] 
[19:22:48] Preparing to commence simulation
[19:22:48] - Looking at optimizations...
[19:22:48] - Created dyn
[19:22:48] - Files status OK
[19:22:48] - Expanded 716888 -> 3538317 (decompressed 493.5 percent)
[19:22:48] - Starting from initial work packet
[19:22:48] 
[19:22:48] Project: 6504 (Run 7, Clone 243, Gen 78)
[19:22:48] 
[19:22:48] Assembly optimizations on if available.
[19:22:48] Entering M.D.
[19:22:55] Protein: TR568_8 in water
[19:22:55] 
[19:22:55] Writing local files
[19:22:55] Extra SSE boost OK.
[19:22:55] Writing local files
[19:22:55] Completed 0 out of 250000 steps  (0%)
[19:37:56] Timered checkpoint triggered.
[19:38:30] Writing local files
[19:38:30] Completed 2500 out of 250000 steps  (1%)
[19:53:31] Timered checkpoint triggered.
[19:53:41] Writing local files
[19:53:41] Completed 5000 out of 250000 steps  (2%)
[20:08:41] Timered checkpoint triggered.
[20:08:53] Writing local files
[20:08:53] Completed 7500 out of 250000 steps  (3%)
[20:23:54] Timered checkpoint triggered.
[20:24:23] Writing local files
[20:24:23] Completed 10000 out of 250000 steps  (4%)
[20:39:24] Timered checkpoint triggered.
[20:40:16] Writing local files
[20:40:16] Completed 12500 out of 250000 steps  (5%)
[20:55:16] Timered checkpoint triggered.
[20:55:45] Writing local files
[20:55:45] Completed 15000 out of 250000 steps  (6%)
[21:10:46] Timered checkpoint triggered.
[21:11:16] Writing local files
[21:11:16] Completed 17500 out of 250000 steps  (7%)
[21:26:16] Timered checkpoint triggered.
[21:26:57] Writing local files
[21:26:57] Completed 20000 out of 250000 steps  (8%)
[21:41:57] Timered checkpoint triggered.
[21:42:48] Writing local files
[21:42:48] Completed 22500 out of 250000 steps  (9%)
[21:57:48] Timered checkpoint triggered.
[21:58:16] Writing local files
[21:58:16] Completed 25000 out of 250000 steps  (10%)
[22:13:17] Timered checkpoint triggered.
[22:13:47] Writing local files
[22:13:47] Completed 27500 out of 250000 steps  (11%)
[22:28:30] - Autosending finished units...
[22:28:30] Trying to send all finished work units
[22:28:30] + No unsent completed units remaining.
[22:28:30] - Autosend completed
[22:28:47] Timered checkpoint triggered.
[22:29:13] Writing local files
[22:29:13] Completed 30000 out of 250000 steps  (12%)
[22:44:14] Timered checkpoint triggered.
[22:44:53] Writing local files
[22:44:53] Completed 32500 out of 250000 steps  (13%)
[22:59:53] Timered checkpoint triggered.
[23:00:06] Writing local files
[23:00:06] Completed 35000 out of 250000 steps  (14%)
[23:15:07] Timered checkpoint triggered.
[23:15:21] Writing local files
[23:15:21] Completed 37500 out of 250000 steps  (15%)
[23:30:21] Timered checkpoint triggered.
[23:30:37] Writing local files
[23:30:37] Completed 40000 out of 250000 steps  (16%)
[23:45:38] Timered checkpoint triggered.
[23:46:14] Writing local files
[23:46:14] Completed 42500 out of 250000 steps  (17%)
[00:01:15] Timered checkpoint triggered.
[00:01:29] Writing local files
[00:01:29] Completed 45000 out of 250000 steps  (18%)
[00:16:30] Timered checkpoint triggered.
[00:16:44] Writing local files
[00:16:44] Completed 47500 out of 250000 steps  (19%)
[00:31:45] Timered checkpoint triggered.
[00:32:01] Writing local files
[00:32:01] Completed 50000 out of 250000 steps  (20%)
[00:47:00] Timered checkpoint triggered.
[00:47:35] Writing local files
[00:47:36] Completed 52500 out of 250000 steps  (21%)
[01:02:36] Timered checkpoint triggered.
[01:02:51] Writing local files
[01:02:51] Completed 55000 out of 250000 steps  (22%)
[01:17:52] Timered checkpoint triggered.
[01:18:06] Writing local files
[01:18:06] Completed 57500 out of 250000 steps  (23%)
[01:33:07] Timered checkpoint triggered.
[01:33:21] Writing local files
[01:33:21] Completed 60000 out of 250000 steps  (24%)
[01:48:22] Timered checkpoint triggered.
[01:48:58] Writing local files
[01:48:58] Completed 62500 out of 250000 steps  (25%)
[02:03:58] Timered checkpoint triggered.
[02:04:13] Writing local files
[02:04:13] Completed 65000 out of 250000 steps  (26%)
[02:19:14] Timered checkpoint triggered.
[02:19:25] Writing local files
[02:19:25] Completed 67500 out of 250000 steps  (27%)
[02:34:26] Timered checkpoint triggered.
[02:34:47] Writing local files
[02:34:47] Completed 70000 out of 250000 steps  (28%)
[02:49:48] Timered checkpoint triggered.
[02:50:22] Writing local files
[02:50:22] Completed 72500 out of 250000 steps  (29%)
[03:05:23] Timered checkpoint triggered.
[03:05:34] Writing local files
[03:05:34] Completed 75000 out of 250000 steps  (30%)
[03:20:35] Timered checkpoint triggered.
[03:20:45] Writing local files
[03:20:45] Completed 77500 out of 250000 steps  (31%)
[03:35:46] Timered checkpoint triggered.
[03:35:57] Writing local files
[03:35:57] Completed 80000 out of 250000 steps  (32%)
[03:50:58] Timered checkpoint triggered.
[03:51:30] Writing local files
[03:51:30] Completed 82500 out of 250000 steps  (33%)
[04:06:31] Timered checkpoint triggered.
[04:06:40] Writing local files
[04:06:40] Completed 85000 out of 250000 steps  (34%)
[04:21:41] Timered checkpoint triggered.
[04:21:50] Writing local files
[04:21:50] Completed 87500 out of 250000 steps  (35%)
[04:28:30] - Autosending finished units...
[04:28:30] Trying to send all finished work units
[04:28:30] + No unsent completed units remaining.
[04:28:30] - Autosend completed
[04:36:51] Timered checkpoint triggered.
[04:37:13] Writing local files
[04:37:13] Completed 90000 out of 250000 steps  (36%)
[04:52:14] Timered checkpoint triggered.
[04:52:47] Writing local files
[04:52:47] Completed 92500 out of 250000 steps  (37%)
[05:07:47] Timered checkpoint triggered.
[05:07:56] Writing local files
[05:07:57] Completed 95000 out of 250000 steps  (38%)
[05:22:57] Timered checkpoint triggered.
[05:23:07] Writing local files
[05:23:07] Completed 97500 out of 250000 steps  (39%)
[05:38:08] Timered checkpoint triggered.
[05:38:17] Writing local files
[05:38:17] Completed 100000 out of 250000 steps  (40%)
[05:53:18] Timered checkpoint triggered.
[05:53:39] Writing local files
[05:53:39] Completed 102500 out of 250000 steps  (41%)
[06:08:40] Timered checkpoint triggered.
[06:08:59] Writing local files
[06:08:59] Completed 105000 out of 250000 steps  (42%)
[06:24:00] Timered checkpoint triggered.
[06:24:08] Writing local files
[06:24:08] Completed 107500 out of 250000 steps  (43%)
[06:39:09] Timered checkpoint triggered.
[06:39:19] Writing local files
[06:39:19] Completed 110000 out of 250000 steps  (44%)
[06:54:19] Timered checkpoint triggered.
[06:54:28] Writing local files
[06:54:28] Completed 112500 out of 250000 steps  (45%)
[07:09:28] Timered checkpoint triggered.
[07:10:37] Writing local files
[07:10:38] Completed 115000 out of 250000 steps  (46%)
[07:25:39] Timered checkpoint triggered.
[07:25:49] Writing local files
[07:25:49] Completed 117500 out of 250000 steps  (47%)
[07:40:50] Timered checkpoint triggered.
[07:41:01] Writing local files
[07:41:01] Completed 120000 out of 250000 steps  (48%)
[07:56:02] Timered checkpoint triggered.
[07:56:11] Writing local files
[07:56:11] Completed 122500 out of 250000 steps  (49%)
[08:11:11] Timered checkpoint triggered.
[08:11:42] Writing local files
[08:11:42] Completed 125000 out of 250000 steps  (50%)
[08:26:43] Timered checkpoint triggered.
[08:26:51] Writing local files
[08:26:52] Completed 127500 out of 250000 steps  (51%)
[08:41:51] Timered checkpoint triggered.
[08:42:00] Writing local files
[08:42:01] Completed 130000 out of 250000 steps  (52%)
[08:57:02] Timered checkpoint triggered.
[08:57:09] Writing local files
[08:57:09] Completed 132500 out of 250000 steps  (53%)
[09:12:10] Timered checkpoint triggered.
[09:12:38] Writing local files
[09:12:39] Completed 135000 out of 250000 steps  (54%)
[09:27:39] Timered checkpoint triggered.
[09:27:45] Writing local files
[09:27:46] Completed 137500 out of 250000 steps  (55%)
[09:42:46] Timered checkpoint triggered.
[09:42:55] Writing local files
[09:42:55] Completed 140000 out of 250000 steps  (56%)
[09:57:56] Timered checkpoint triggered.
[09:58:04] Writing local files
[09:58:04] Completed 142500 out of 250000 steps  (57%)
[10:13:05] Timered checkpoint triggered.
[10:13:34] Writing local files
[10:13:34] Completed 145000 out of 250000 steps  (58%)
[10:28:30] - Autosending finished units...
[10:28:30] Trying to send all finished work units
[10:28:30] + No unsent completed units remaining.
[10:28:30] - Autosend completed
[10:28:35] Timered checkpoint triggered.
[10:28:43] Writing local files
[10:28:43] Completed 147500 out of 250000 steps  (59%)
[10:43:44] Timered checkpoint triggered.
[10:43:52] Writing local files
[10:43:52] Completed 150000 out of 250000 steps  (60%)
[10:58:53] Timered checkpoint triggered.
[10:59:01] Writing local files
[10:59:01] Completed 152500 out of 250000 steps  (61%)
[11:14:02] Timered checkpoint triggered.
[11:14:30] Writing local files
[11:14:30] Completed 155000 out of 250000 steps  (62%)
[11:29:31] Timered checkpoint triggered.
[11:29:40] Writing local files
[11:29:40] Completed 157500 out of 250000 steps  (63%)
[11:44:40] Timered checkpoint triggered.
[11:44:50] Writing local files
[11:44:51] Completed 160000 out of 250000 steps  (64%)
[11:47:12] CoreStatus = 0 (0)
[11:47:12] Client-core communications error: ERROR 0x0
[11:47:12] Deleting current work unit & continuing...
[11:47:29] Trying to send all finished work units
[11:47:29] + No unsent completed units remaining.
[11:47:29] - Preparing to get new work unit...
[11:47:29] + Attempting to get work packet
[11:47:29] - Will indicate memory of 1510 MB
[11:47:29] - Connecting to assignment server
[11:47:29] Connecting to http://assign.stanford.edu:8080/
[11:47:29] Posted data.
[11:47:29] Initial: 40AB; - Successful: assigned to (171.64.65.62).
[11:47:29] + News From Folding@Home: Welcome to Folding@Home
[11:47:29] Loaded queue successfully.
[11:47:29] Connecting to http://171.64.65.62:8080/
[11:47:30] Posted data.
[11:47:30] Initial: 0000; - Receiving payload (expected size: 717400)
[11:47:31] - Downloaded at ~700 kB/s
[11:47:31] - Averaged speed for that direction ~598 kB/s
[11:47:31] + Received work.
[11:47:31] + Closed connections
[11:47:36] 
[11:47:36] + Processing work unit
[11:47:36] Core required: FahCore_78.exe
[11:47:36] Core found.
[11:47:36] Working on Unit 01 [May 31 11:47:36]
[11:47:36] + Working ...
[11:47:36] - Calling './FahCore_78.exe -dir work/ -suffix 01 -checkpoint 15 -verbose -lifeline 16313 -version 602'

[11:47:36] 
[11:47:36] *------------------------------*
[11:47:36] Folding@Home Gromacs Core
[11:47:36] Version 1.90 (March 8, 2006)
[11:47:36] 
[11:47:36] Preparing to commence simulation
[11:47:36] - Looking at optimizations...
[11:47:36] - Created dyn
[11:47:36] - Files status OK
[11:47:37] - Expanded 716888 -> 3538317 (decompressed 493.5 percent)
[11:47:37] - Starting from initial work packet
[11:47:37] 
[11:47:37] Project: 6504 (Run 7, Clone 243, Gen 78)
[11:47:37] 
[11:47:37] Assembly optimizations on if available.
[11:47:37] Entering M.D.
[11:47:43] Protein: TR568_8 in water
[11:47:43] 
[11:47:43] Writing local files
[11:47:43] Extra SSE boost OK.
[11:47:44] Writing local files
[11:47:44] Completed 0 out of 250000 steps  (0%)
[12:02:44] Timered checkpoint triggered.
[12:03:09] Writing local files
[12:03:09] Completed 2500 out of 250000 steps  (1%)
[12:18:09] Timered checkpoint triggered.
[12:18:56] Writing local files
[12:18:56] Completed 5000 out of 250000 steps  (2%)
[12:33:56] Timered checkpoint triggered.
[12:34:22] Writing local files
[12:34:22] Completed 7500 out of 250000 steps  (3%)
[12:49:22] Timered checkpoint triggered.
[12:49:49] Writing local files
[12:49:49] Completed 10000 out of 250000 steps  (4%)
[13:04:49] Timered checkpoint triggered.
[13:05:15] Writing local files
[13:05:15] Completed 12500 out of 250000 steps  (5%)
[13:20:15] Timered checkpoint triggered.
[13:21:04] Writing local files
[13:21:04] Completed 15000 out of 250000 steps  (6%)
[13:36:03] Timered checkpoint triggered.
[13:36:32] Writing local files
[13:36:32] Completed 17500 out of 250000 steps  (7%)
[13:51:32] Timered checkpoint triggered.
[13:51:58] Writing local files
[13:51:59] Completed 20000 out of 250000 steps  (8%)
[14:06:58] Timered checkpoint triggered.
[14:07:25] Writing local files
[14:07:25] Completed 22500 out of 250000 steps  (9%)
[14:22:25] Timered checkpoint triggered.
[14:23:14] Writing local files
[14:23:14] Completed 25000 out of 250000 steps  (10%)
[14:38:13] Timered checkpoint triggered.
[14:38:45] Writing local files
[14:38:45] Completed 27500 out of 250000 steps  (11%)
[14:53:44] Timered checkpoint triggered.
[14:54:26] Writing local files
[14:54:27] Completed 30000 out of 250000 steps  (12%)
[15:09:26] Timered checkpoint triggered.
[15:10:00] Writing local files
[15:10:00] Completed 32500 out of 250000 steps  (13%)
[15:25:00] Timered checkpoint triggered.
[15:25:52] Writing local files
[15:25:52] Completed 35000 out of 250000 steps  (14%)
[15:40:52] Timered checkpoint triggered.
[15:41:22] Writing local files
[15:41:22] Completed 37500 out of 250000 steps  (15%)
[15:56:22] Timered checkpoint triggered.
[15:56:52] Writing local files
[15:56:52] Completed 40000 out of 250000 steps  (16%)
[16:11:52] Timered checkpoint triggered.
[16:12:21] Writing local files
[16:12:21] Completed 42500 out of 250000 steps  (17%)
[16:27:21] Timered checkpoint triggered.
[16:28:13] Writing local files
[16:28:13] Completed 45000 out of 250000 steps  (18%)
[16:28:30] - Autosending finished units...
[16:28:30] Trying to send all finished work units
[16:28:30] + No unsent completed units remaining.
[16:28:30] - Autosend completed
[16:43:12] Timered checkpoint triggered.
[16:43:42] Writing local files
[16:43:43] Completed 47500 out of 250000 steps  (19%)
[16:58:42] Timered checkpoint triggered.
[16:59:12] Writing local files
[16:59:13] Completed 50000 out of 250000 steps  (20%)
[17:14:12] Timered checkpoint triggered.
[17:14:41] Writing local files
[17:14:41] Completed 52500 out of 250000 steps  (21%)
[17:29:41] Timered checkpoint triggered.
[17:30:34] Writing local files
[17:30:34] Completed 55000 out of 250000 steps  (22%)
[17:45:33] Timered checkpoint triggered.
[17:46:03] Writing local files
[17:46:03] Completed 57500 out of 250000 steps  (23%)
[18:01:03] Timered checkpoint triggered.
[18:01:34] Writing local files
[18:01:34] Completed 60000 out of 250000 steps  (24%)
[18:16:34] Timered checkpoint triggered.
[18:17:26] Writing local files
[18:17:26] Completed 62500 out of 250000 steps  (25%)
[18:32:26] Timered checkpoint triggered.
[18:33:21] Writing local files
[18:33:21] Completed 65000 out of 250000 steps  (26%)
[18:48:21] Timered checkpoint triggered.
[18:49:06] Writing local files
[18:49:06] Completed 67500 out of 250000 steps  (27%)
[19:04:06] Timered checkpoint triggered.
[19:04:59] Writing local files
[19:04:59] Completed 70000 out of 250000 steps  (28%)
[19:20:00] Timered checkpoint triggered.
[19:20:51] Writing local files
[19:20:51] Completed 72500 out of 250000 steps  (29%)
[19:35:51] Timered checkpoint triggered.
[19:36:24] Writing local files
[19:36:24] Completed 75000 out of 250000 steps  (30%)
[19:51:24] Timered checkpoint triggered.
[19:51:54] Writing local files
[19:51:54] Completed 77500 out of 250000 steps  (31%)
[20:06:53] Timered checkpoint triggered.
[20:07:23] Writing local files
[20:07:23] Completed 80000 out of 250000 steps  (32%)
[20:22:23] Timered checkpoint triggered.
[20:23:15] Writing local files
[20:23:15] Completed 82500 out of 250000 steps  (33%)
[20:38:15] Timered checkpoint triggered.
[20:38:45] Writing local files
[20:38:45] Completed 85000 out of 250000 steps  (34%)
[20:53:46] Timered checkpoint triggered.
[20:54:15] Writing local files
[20:54:15] Completed 87500 out of 250000 steps  (35%)
[21:09:15] Timered checkpoint triggered.
[21:09:44] Writing local files
[21:09:44] Completed 90000 out of 250000 steps  (36%)
[21:24:44] Timered checkpoint triggered.
[21:25:46] Writing local files
[21:25:46] Completed 92500 out of 250000 steps  (37%)
[21:40:46] Timered checkpoint triggered.
[21:41:20] Writing local files
[21:41:20] Completed 95000 out of 250000 steps  (38%)
[21:56:20] Timered checkpoint triggered.
[21:56:50] Writing local files
[21:56:50] Completed 97500 out of 250000 steps  (39%)
[22:11:50] Timered checkpoint triggered.
[22:12:18] Writing local files
[22:12:18] Completed 100000 out of 250000 steps  (40%)
[22:27:18] Timered checkpoint triggered.
[22:28:08] Writing local files
[22:28:08] Completed 102500 out of 250000 steps  (41%)
[22:28:30] - Autosending finished units...
[22:28:30] Trying to send all finished work units
[22:28:30] + No unsent completed units remaining.
[22:28:30] - Autosend completed
[22:43:08] Timered checkpoint triggered.
[22:43:39] Writing local files
[22:43:39] Completed 105000 out of 250000 steps  (42%)
[22:58:39] Timered checkpoint triggered.
[22:59:16] Writing local files
[22:59:17] Completed 107500 out of 250000 steps  (43%)
[23:14:16] Timered checkpoint triggered.
[23:14:46] Writing local files
[23:14:46] Completed 110000 out of 250000 steps  (44%)
[23:29:45] Timered checkpoint triggered.
[23:30:37] Writing local files
[23:30:37] Completed 112500 out of 250000 steps  (45%)
[23:45:37] Timered checkpoint triggered.
[23:46:07] Writing local files
[23:46:07] Completed 115000 out of 250000 steps  (46%)
[00:01:07] Timered checkpoint triggered.
[00:01:38] Writing local files
[00:01:38] Completed 117500 out of 250000 steps  (47%)
[00:16:37] Timered checkpoint triggered.
[00:17:07] Writing local files
[00:17:07] Completed 120000 out of 250000 steps  (48%)
[00:32:07] Timered checkpoint triggered.
[00:32:58] Writing local files
[00:32:58] Completed 122500 out of 250000 steps  (49%)
[00:47:58] Timered checkpoint triggered.
[00:48:26] Writing local files
[00:48:26] Completed 125000 out of 250000 steps  (50%)
[01:03:26] Timered checkpoint triggered.
[01:03:54] Writing local files
[01:03:54] Completed 127500 out of 250000 steps  (51%)
[01:18:54] Timered checkpoint triggered.
[01:19:22] Writing local files
[01:19:22] Completed 130000 out of 250000 steps  (52%)
[01:34:22] Timered checkpoint triggered.
[01:35:12] Writing local files
[01:35:12] Completed 132500 out of 250000 steps  (53%)
[01:50:13] Timered checkpoint triggered.
[01:50:40] Writing local files
[01:50:40] Completed 135000 out of 250000 steps  (54%)
[02:05:40] Timered checkpoint triggered.
[02:06:05] Writing local files
[02:06:05] Completed 137500 out of 250000 steps  (55%)
[02:21:05] Timered checkpoint triggered.
[02:21:37] Writing local files
[02:21:37] Completed 140000 out of 250000 steps  (56%)
[02:36:37] Timered checkpoint triggered.
[02:37:23] Writing local files
[02:37:23] Completed 142500 out of 250000 steps  (57%)
[02:52:23] Timered checkpoint triggered.
[02:52:47] Writing local files
[02:52:47] Completed 145000 out of 250000 steps  (58%)
[03:07:47] Timered checkpoint triggered.
[03:08:12] Writing local files
[03:08:12] Completed 147500 out of 250000 steps  (59%)
[03:23:12] Timered checkpoint triggered.
[03:23:37] Writing local files
[03:23:37] Completed 150000 out of 250000 steps  (60%)
[03:38:36] Timered checkpoint triggered.
[03:39:24] Writing local files
[03:39:24] Completed 152500 out of 250000 steps  (61%)
[03:54:24] Timered checkpoint triggered.
[03:54:48] Writing local files
[03:54:48] Completed 155000 out of 250000 steps  (62%)
[04:09:48] Timered checkpoint triggered.
[04:10:12] Writing local files
[04:10:12] Completed 157500 out of 250000 steps  (63%)
[04:25:12] Timered checkpoint triggered.
[04:25:39] Writing local files
[04:25:39] Completed 160000 out of 250000 steps  (64%)
[04:28:02] CoreStatus = 0 (0)
[04:28:02] Client-core communications error: ERROR 0x0
[04:28:02] - Attempting to download new core...
[04:28:02] + Downloading new core: FahCore_78.exe
[04:28:02] Downloading core (/~pande/Linux/x86/Core_78.fah from www.stanford.edu)
[04:28:03] Initial: AFDE; + 10240 bytes downloaded
[04:28:03] Initial: CC14; + 20480 bytes downloaded
[04:28:03] Initial: BEE8; + 30720 bytes downloaded
[04:28:03] Initial: DAAF; + 40960 bytes downloaded
[04:28:03] Initial: 1C7A; + 51200 bytes downloaded
[04:28:03] Initial: 5758; + 61440 bytes downloaded
[04:28:03] Initial: 4CCD; + 71680 bytes downloaded
[04:28:03] Initial: 15EF; + 81920 bytes downloaded
[04:28:03] Initial: 48E8; + 92160 bytes downloaded
[04:28:03] Initial: D320; + 102400 bytes downloaded
[04:28:03] Initial: 82DB; + 112640 bytes downloaded
[04:28:03] Initial: 4576; + 122880 bytes downloaded
[04:28:03] Initial: FB62; + 133120 bytes downloaded
[04:28:03] Initial: 71CD; + 143360 bytes downloaded
[04:28:03] Initial: F63A; + 153600 bytes downloaded
[04:28:03] Initial: 0B66; + 163840 bytes downloaded
[04:28:03] Initial: C516; + 174080 bytes downloaded
[04:28:03] Initial: 3E7D; + 184320 bytes downloaded
[04:28:03] Initial: D29C; + 194560 bytes downloaded
[04:28:03] Initial: E3AD; + 204800 bytes downloaded
[04:28:03] Initial: ACFA; + 215040 bytes downloaded
[04:28:03] Initial: 348C; + 225280 bytes downloaded
[04:28:03] Initial: F2B6; + 235520 bytes downloaded
[04:28:03] Initial: CC9E; + 245760 bytes downloaded
[04:28:03] Initial: 1231; + 256000 bytes downloaded
[04:28:03] Initial: 9693; + 266240 bytes downloaded
[04:28:03] Initial: 4073; + 276480 bytes downloaded
[04:28:03] Initial: 616B; + 286720 bytes downloaded
[04:28:03] Initial: 5E96; + 296960 bytes downloaded
[04:28:03] Initial: 4430; + 307200 bytes downloaded
[04:28:03] Initial: B959; + 317440 bytes downloaded
[04:28:03] Initial: 48AC; + 327680 bytes downloaded
[04:28:03] Initial: 7846; + 337920 bytes downloaded
[04:28:03] Initial: 0B78; + 348160 bytes downloaded
[04:28:03] Initial: 653D; + 358400 bytes downloaded
[04:28:03] Initial: B0D6; + 368640 bytes downloaded
[04:28:03] Initial: 841B; + 378880 bytes downloaded
[04:28:03] Initial: 75AF; + 389120 bytes downloaded
[04:28:03] Initial: B47C; + 399360 bytes downloaded
[04:28:03] Initial: 4DC0; + 409600 bytes downloaded
[04:28:03] Initial: 8F7E; + 419840 bytes downloaded
[04:28:04] Initial: 9EF4; + 430080 bytes downloaded
[04:28:04] Initial: 0181; + 440320 bytes downloaded
[04:28:04] Initial: 503C; + 450560 bytes downloaded
[04:28:04] Initial: 2D30; + 460800 bytes downloaded
[04:28:04] Initial: 8867; + 471040 bytes downloaded
[04:28:04] Initial: CE43; + 481280 bytes downloaded
[04:28:04] Initial: 614C; + 491520 bytes downloaded
[04:28:04] Initial: 96F2; + 501760 bytes downloaded
[04:28:04] Initial: 252D; + 512000 bytes downloaded
[04:28:04] Initial: 97FE; + 522240 bytes downloaded
[04:28:04] Initial: 1024; + 532480 bytes downloaded
[04:28:04] Initial: 0666; + 542720 bytes downloaded
[04:28:04] Initial: 53CF; + 552960 bytes downloaded
[04:28:04] Initial: D31E; + 563200 bytes downloaded
[04:28:04] Initial: 1A46; + 573440 bytes downloaded
[04:28:04] Initial: B2C1; + 583680 bytes downloaded
[04:28:04] Initial: 17AF; + 593920 bytes downloaded
[04:28:04] Initial: BE0D; + 604160 bytes downloaded
[04:28:04] Initial: 79C2; + 614400 bytes downloaded
[04:28:04] Initial: 6B14; + 624640 bytes downloaded
[04:28:04] Initial: 1611; + 634880 bytes downloaded
[04:28:04] Initial: 4B64; + 645120 bytes downloaded
[04:28:04] Initial: E520; + 655360 bytes downloaded
[04:28:04] Initial: ADD2; + 665600 bytes downloaded
[04:28:04] Initial: 4218; + 675840 bytes downloaded
[04:28:04] Initial: 7E58; + 686080 bytes downloaded
[04:28:04] Initial: 913F; + 696320 bytes downloaded
[04:28:04] Initial: A369; + 706560 bytes downloaded
[04:28:04] Initial: 8E3A; + 716800 bytes downloaded
[04:28:04] Initial: D3A6; + 727040 bytes downloaded
[04:28:04] Initial: D3CB; + 737280 bytes downloaded
[04:28:04] Initial: 6736; + 747520 bytes downloaded
[04:28:04] Initial: 071F; + 757760 bytes downloaded
[04:28:04] Initial: AC46; + 768000 bytes downloaded
[04:28:04] Initial: 1B7F; + 778240 bytes downloaded
[04:28:04] Initial: 1E88; + 788480 bytes downloaded
[04:28:04] Initial: 5A90; + 798720 bytes downloaded
[04:28:04] Initial: 5F2E; + 808960 bytes downloaded
[04:28:04] Initial: AC86; + 819200 bytes downloaded
[04:28:04] Initial: 0E27; + 829440 bytes downloaded
[04:28:04] Initial: 9AFA; + 839680 bytes downloaded
[04:28:04] Initial: 5A8B; + 849920 bytes downloaded
[04:28:04] Initial: 9D8E; + 860160 bytes downloaded
[04:28:04] Initial: 63B7; + 870400 bytes downloaded
[04:28:05] Initial: 7E7F; + 880640 bytes downloaded
[04:28:05] Initial: CC68; + 890880 bytes downloaded
[04:28:05] Initial: 0C12; + 901120 bytes downloaded
[04:28:05] Initial: EA6C; + 911360 bytes downloaded
[04:28:05] Initial: 07EE; + 921600 bytes downloaded
[04:28:05] Initial: 45B7; + 931840 bytes downloaded
[04:28:05] Initial: F8C7; + 942080 bytes downloaded
[04:28:05] Initial: DEE6; + 952320 bytes downloaded
[04:28:05] Initial: C4DF; + 962560 bytes downloaded
[04:28:05] Initial: 5CEC; + 972800 bytes downloaded
[04:28:05] Initial: C871; + 983040 bytes downloaded
[04:28:05] Initial: F427; + 993280 bytes downloaded
[04:28:05] Initial: F6DF; + 1003520 bytes downloaded
[04:28:05] Initial: 19B3; + 1013760 bytes downloaded
[04:28:05] Initial: 1DE1; + 1024000 bytes downloaded
[04:28:05] Initial: F17C; + 1034240 bytes downloaded
[04:28:05] Initial: A200; + 1044480 bytes downloaded
[04:28:05] Initial: 93DE; + 1054720 bytes downloaded
[04:28:05] Initial: 5E7D; + 1064960 bytes downloaded
[04:28:05] Initial: F350; + 1075200 bytes downloaded
[04:28:05] Initial: C54F; + 1085440 bytes downloaded
[04:28:05] Initial: 4D25; + 1095680 bytes downloaded
[04:28:05] Initial: 1289; + 1105920 bytes downloaded
[04:28:05] Initial: B74E; + 1116160 bytes downloaded
[04:28:05] Initial: EF43; + 1126400 bytes downloaded
[04:28:05] Initial: 6B45; + 1134407 bytes downloaded
[04:28:05] Verifying core Core_78.fah...
[04:28:05] Signature is VALID
[04:28:05] 
[04:28:05] Trying to unzip core FahCore_78.exe
[04:28:06] Decompressed FahCore_78.exe (3435296 bytes) successfully
[04:28:06] + Core successfully engaged
[04:28:06] Deleting current work unit & continuing...
[04:28:24] Trying to send all finished work units
[04:28:24] + No unsent completed units remaining.
[04:28:24] - Preparing to get new work unit...
[04:28:24] + Attempting to get work packet
[04:28:24] - Will indicate memory of 1510 MB
[04:28:24] - Connecting to assignment server
[04:28:24] Connecting to http://assign.stanford.edu:8080/
[04:28:24] Posted data.
[04:28:24] Initial: 40AB; - Successful: assigned to (171.64.65.62).
[04:28:24] + News From Folding@Home: Welcome to Folding@Home
[04:28:24] Loaded queue successfully.
[04:28:24] Connecting to http://171.64.65.62:8080/
[04:28:25] Posted data.
[04:28:25] Initial: 0000; - Receiving payload (expected size: 717400)
[04:28:26] - Downloaded at ~700 kB/s
[04:28:26] - Averaged speed for that direction ~618 kB/s
[04:28:26] + Received work.
[04:28:26] + Closed connections
[04:28:30] - Autosending finished units...
[04:28:30] Trying to send all finished work units
[04:28:30] + No unsent completed units remaining.
[04:28:30] - Autosend completed
[04:28:31] 
[04:28:31] + Processing work unit
[04:28:31] Core required: FahCore_78.exe
[04:28:31] Core found.
[04:28:31] Working on Unit 02 [June 1 04:28:31]
[04:28:31] + Working ...
[04:28:31] - Calling './FahCore_78.exe -dir work/ -suffix 02 -checkpoint 15 -verbose -lifeline 16313 -version 602'

[04:28:31] 
[04:28:31] *------------------------------*
[04:28:31] Folding@Home Gromacs Core
[04:28:31] Version 1.90 (March 8, 2006)
[04:28:31] 
[04:28:31] Preparing to commence simulation
[04:28:31] - Looking at optimizations...
[04:28:31] - Created dyn
[04:28:31] - Files status OK
[04:28:31] - Expanded 716888 -> 3538317 (decompressed 493.5 percent)
[04:28:31] - Starting from initial work packet
[04:28:31] 
[04:28:31] Project: 6504 (Run 7, Clone 243, Gen 78)
[04:28:31] 
[04:28:31] Assembly optimizations on if available.
[04:28:31] Entering M.D.
[04:28:38] Protein: TR568_8 in water
[04:28:38] 
[04:28:38] Writing local files
[04:28:38] Extra SSE boost OK.
[04:28:38] Writing local files
[04:28:38] Completed 0 out of 250000 steps  (0%)
[04:43:39] Timered checkpoint triggered.
[04:44:27] Writing local files
[04:44:27] Completed 2500 out of 250000 steps  (1%)
[04:59:28] Timered checkpoint triggered.
[04:59:53] Writing local files
[04:59:53] Completed 5000 out of 250000 steps  (2%)
[05:14:54] Timered checkpoint triggered.
[05:15:20] Writing local files
[05:15:20] Completed 7500 out of 250000 steps  (3%)
[05:30:21] Timered checkpoint triggered.
[05:30:51] Writing local files
[05:30:51] Completed 10000 out of 250000 steps  (4%)
[05:45:51] Timered checkpoint triggered.
[05:46:40] Writing local files
[05:46:40] Completed 12500 out of 250000 steps  (5%)
[06:01:41] Timered checkpoint triggered.
[06:02:09] Writing local files
[06:02:09] Completed 15000 out of 250000 steps  (6%)
[06:17:10] Timered checkpoint triggered.
[06:17:37] Writing local files
[06:17:37] Completed 17500 out of 250000 steps  (7%)
[06:32:38] Timered checkpoint triggered.
[06:33:05] Writing local files
[06:33:05] Completed 20000 out of 250000 steps  (8%)
[06:48:06] Timered checkpoint triggered.
[06:48:55] Writing local files
[06:48:55] Completed 22500 out of 250000 steps  (9%)
[07:03:55] Timered checkpoint triggered.
[07:04:23] Writing local files
[07:04:23] Completed 25000 out of 250000 steps  (10%)
[07:19:24] Timered checkpoint triggered.
[07:20:28] Writing local files
[07:20:29] Completed 27500 out of 250000 steps  (11%)
[07:35:29] Timered checkpoint triggered.
[07:36:08] Writing local files
[07:36:08] Completed 30000 out of 250000 steps  (12%)
[07:51:09] Timered checkpoint triggered.
[07:51:45] Writing local files
[07:51:45] Completed 32500 out of 250000 steps  (13%)
[08:06:45] Timered checkpoint triggered.
[08:07:12] Writing local files
[08:07:12] Completed 35000 out of 250000 steps  (14%)
[08:22:12] Timered checkpoint triggered.
[08:22:40] Writing local files
[08:22:40] Completed 37500 out of 250000 steps  (15%)
[08:37:41] Timered checkpoint triggered.
[08:38:10] Writing local files
[08:38:10] Completed 40000 out of 250000 steps  (16%)
[08:53:10] Timered checkpoint triggered.
[08:53:58] Writing local files
[08:53:58] Completed 42500 out of 250000 steps  (17%)
[09:08:59] Timered checkpoint triggered.
[09:09:28] Writing local files
[09:09:28] Completed 45000 out of 250000 steps  (18%)
[09:24:28] Timered checkpoint triggered.
[09:24:57] Writing local files
[09:24:57] Completed 47500 out of 250000 steps  (19%)
[09:39:58] Timered checkpoint triggered.
[09:40:28] Writing local files
[09:40:28] Completed 50000 out of 250000 steps  (20%)
[09:55:29] Timered checkpoint triggered.
[09:56:17] Writing local files
[09:56:17] Completed 52500 out of 250000 steps  (21%)
[10:11:17] Timered checkpoint triggered.
[10:11:44] Writing local files
[10:11:44] Completed 55000 out of 250000 steps  (22%)
[10:26:45] Timered checkpoint triggered.
[10:27:13] Writing local files
[10:27:13] Completed 57500 out of 250000 steps  (23%)
[10:28:30] - Autosending finished units...
[10:28:30] Trying to send all finished work units
[10:28:30] + No unsent completed units remaining.
[10:28:30] - Autosend completed
[10:42:14] Timered checkpoint triggered.
[10:42:40] Writing local files
[10:42:40] Completed 60000 out of 250000 steps  (24%)
[10:57:40] Timered checkpoint triggered.
[10:58:30] Writing local files
[10:58:31] Completed 62500 out of 250000 steps  (25%)
[11:13:31] Timered checkpoint triggered.
[11:13:58] Writing local files
[11:13:59] Completed 65000 out of 250000 steps  (26%)
[11:28:59] Timered checkpoint triggered.
[11:29:29] Writing local files
[11:29:29] Completed 67500 out of 250000 steps  (27%)
[11:44:29] Timered checkpoint triggered.
[11:45:06] Writing local files
[11:45:06] Completed 70000 out of 250000 steps  (28%)
[12:00:07] Timered checkpoint triggered.
[12:00:57] Writing local files
[12:00:57] Completed 72500 out of 250000 steps  (29%)
[12:15:57] Timered checkpoint triggered.
[12:16:26] Writing local files
[12:16:26] Completed 75000 out of 250000 steps  (30%)
[12:31:26] Timered checkpoint triggered.
[12:32:06] Writing local files
[12:32:06] Completed 77500 out of 250000 steps  (31%)
[12:47:07] Timered checkpoint triggered.
[12:47:34] Writing local files
[12:47:34] Completed 80000 out of 250000 steps  (32%)
[13:02:35] Timered checkpoint triggered.
[13:03:24] Writing local files
[13:03:24] Completed 82500 out of 250000 steps  (33%)
[13:18:24] Timered checkpoint triggered.
[13:19:03] Writing local files
[13:19:03] Completed 85000 out of 250000 steps  (34%)
[13:34:04] Timered checkpoint triggered.
[13:34:39] Writing local files
[13:34:39] Completed 87500 out of 250000 steps  (35%)
[13:49:39] Timered checkpoint triggered.
[13:50:07] Writing local files
[13:50:07] Completed 90000 out of 250000 steps  (36%)
[14:05:08] Timered checkpoint triggered.
[14:05:56] Writing local files
[14:05:56] Completed 92500 out of 250000 steps  (37%)
[14:20:57] Timered checkpoint triggered.
[14:21:23] Writing local files
[14:21:24] Completed 95000 out of 250000 steps  (38%)
[14:36:24] Timered checkpoint triggered.
[14:36:51] Writing local files
[14:36:51] Completed 97500 out of 250000 steps  (39%)
[14:51:52] Timered checkpoint triggered.
[14:52:18] Writing local files
[14:52:18] Completed 100000 out of 250000 steps  (40%)
[15:07:18] Timered checkpoint triggered.
[15:08:06] Writing local files
[15:08:06] Completed 102500 out of 250000 steps  (41%)
[15:23:07] Timered checkpoint triggered.
[15:23:35] Writing local files
[15:23:35] Completed 105000 out of 250000 steps  (42%)
[15:38:36] Timered checkpoint triggered.
[15:39:04] Writing local files
[15:39:04] Completed 107500 out of 250000 steps  (43%)
[15:54:05] Timered checkpoint triggered.
[15:54:51] Writing local files
[15:54:52] Completed 110000 out of 250000 steps  (44%)
[16:09:52] Timered checkpoint triggered.
[16:10:27] Writing local files
[16:10:27] Completed 112500 out of 250000 steps  (45%)
[16:25:28] Timered checkpoint triggered.
[16:25:58] Writing local files
[16:25:59] Completed 115000 out of 250000 steps  (46%)
[16:28:30] - Autosending finished units...
[16:28:30] Trying to send all finished work units
[16:28:30] + No unsent completed units remaining.
[16:28:30] - Autosend completed
[16:40:59] Timered checkpoint triggered.
[16:41:30] Writing local files
[16:41:30] Completed 117500 out of 250000 steps  (47%)
[16:56:31] Timered checkpoint triggered.
[16:57:23] Writing local files
[16:57:23] Completed 120000 out of 250000 steps  (48%)
[17:12:23] Timered checkpoint triggered.
[17:12:53] Writing local files
[17:12:53] Completed 122500 out of 250000 steps  (49%)
[17:27:54] Timered checkpoint triggered.
[17:28:26] Writing local files
[17:28:26] Completed 125000 out of 250000 steps  (50%)
[17:43:26] Timered checkpoint triggered.
[17:43:56] Writing local files
[17:43:56] Completed 127500 out of 250000 steps  (51%)
[17:58:57] Timered checkpoint triggered.
[17:59:56] Writing local files
[17:59:56] Completed 130000 out of 250000 steps  (52%)
[18:14:57] Timered checkpoint triggered.
[18:15:31] Writing local files
[18:15:31] Completed 132500 out of 250000 steps  (53%)
[18:30:32] Timered checkpoint triggered.
[18:31:07] Writing local files
[18:31:07] Completed 135000 out of 250000 steps  (54%)
[18:46:07] Timered checkpoint triggered.
[18:46:39] Writing local files
[18:46:39] Completed 137500 out of 250000 steps  (55%)
[19:01:39] Timered checkpoint triggered.
[19:02:33] Writing local files
[19:02:33] Completed 140000 out of 250000 steps  (56%)
[19:17:33] Timered checkpoint triggered.
[19:18:02] Writing local files
[19:18:02] Completed 142500 out of 250000 steps  (57%)
[19:33:02] Timered checkpoint triggered.
[19:33:34] Writing local files
[19:33:34] Completed 145000 out of 250000 steps  (58%)
[19:48:35] Timered checkpoint triggered.
[19:49:08] Writing local files
[19:49:08] Completed 147500 out of 250000 steps  (59%)
[20:04:08] Timered checkpoint triggered.
[20:05:14] Writing local files
[20:05:14] Completed 150000 out of 250000 steps  (60%)
[20:20:14] Timered checkpoint triggered.
[20:20:58] Writing local files
[20:20:58] Completed 152500 out of 250000 steps  (61%)
[20:35:59] Timered checkpoint triggered.
[20:36:41] Writing local files
[20:36:41] Completed 155000 out of 250000 steps  (62%)
[20:51:42] Timered checkpoint triggered.
[20:52:26] Writing local files
[20:52:27] Completed 157500 out of 250000 steps  (63%)
[21:07:27] Timered checkpoint triggered.
[21:08:34] Writing local files
[21:08:34] Completed 160000 out of 250000 steps  (64%)
[21:11:01] CoreStatus = 0 (0)
[21:11:01] Client-core communications error: ERROR 0x0
[21:11:01] Deleting current work unit & continuing...
[21:11:18] Trying to send all finished work units
[21:11:18] + No unsent completed units remaining.
[21:11:18] - Preparing to get new work unit...
[21:11:18] + Attempting to get work packet
[21:11:18] - Will indicate memory of 1510 MB
[21:11:18] - Connecting to assignment server
[21:11:18] Connecting to http://assign.stanford.edu:8080/
[21:11:19] Posted data.
[21:11:19] Initial: 8F80; - Successful: assigned to (128.143.48.226).
[21:11:19] + News From Folding@Home: Welcome to Folding@Home
[21:11:19] Loaded queue successfully.
[21:11:19] Connecting to http://128.143.48.226:8080/
[21:11:20] Posted data.
[21:11:20] Initial: 0000; - Receiving payload (expected size: 1010646)
[21:11:21] - Downloaded at ~986 kB/s
[21:11:21] - Averaged speed for that direction ~692 kB/s
[21:11:21] + Received work.
[21:11:21] + Closed connections
[21:11:26] 
[21:11:26] + Processing work unit
[21:11:26] Core required: FahCore_a6.exe
[21:11:26] Core not found.
[21:11:26] - Core is not present or corrupted.
[21:11:26] - Attempting to download new core...
[21:11:26] + Downloading new core: FahCore_a6.exe

### Goes on to successfully fold, Project: 3865 (Run 90, Clone 0, Gen 0) ###

I have no idea if it's relevant, but this was in the linux dmesg log:

Code: Select all

[252481.525290] FahCore_78.exe[14473]: segfault at 2a4cb0e0 ip 08087a1c sp bf7fe3dc error 4 in FahCore_78.exe[8048000+322000]
[311586.919032] FahCore_78.exe[20421]: segfault at 2a4cb0e0 ip 08087a1c sp bf7fe3dc error 4 in FahCore_78.exe[8048000+322000]
[371654.114112] FahCore_78.exe[24721]: segfault at 2a4cb0e0 ip 08087a1c sp bf7fe3dc error 4 in FahCore_78.exe[8048000+322000]
[431847.293466] FahCore_78.exe[31366]: segfault at 2a4cb0e0 ip 08087a1c sp bf7fe3dc error 4 in FahCore_78.exe[8048000+322000]

[bruce]

The WU (P6504,R7,C243,G78) has been reported as a bad WU.

[karlinhigh]

Reported as bad WU - just now, or has it been that way? Is there some place to look that up? I searched the forum for the PRCG info, but didn't find anything.

[MtM]

Only moderators have access to the wu look up database, this is the same source of information used when you see a moderator checking credit assigned to a particular work unit ect.

Most of the time we don't notice the bad wu's since their taken out of the mix when their reported by others so we won't download the same bad wu which never finished anyway, it's just in the unfortunate event we ourselves run into them we have to take action like you done and reported it here so we can prevent others from getting the same wu assigned.

You can always check this forum section, I always do a search for the project number ( not prcg as sometimes thread titles are shortend ect ) and look through the entries if my prcg is in there. If it is, I add to the existing thread ( which mostly is an indication the wu is bad as I'm not the first with an issue ) or I make a new thread and wait if another donor is able to finish the wu ( if that's so, I will need to do stress testing to ensure my stability ).

A clear clue for a bad unit is a unit which fails at the same exact step every time like your's.

[bruce]

The servers are supposed to take bad WUs out of circulation but I've never determined what criteria they use or how frequently it works. As a group, the Mods do take a certain percentage of WUs out of circulation that are not handled by the automated processes.

When we get a report here on the forum, we check the database and often find that others have already had trouble with the same WU -- which is exactly what happened here.

Any one report, whether in the Mod DB or from an on-line report like karlinhigh's report does not prove it's a bad WU. We have no way of knowing if there's something strange happening on any one machine so if it's the first report we mark the topic for a recheck later. (No, you can't tell if the topic is marked, but we generally say so in a post.)

Sometimes after somebody has trouble with a WU, somebody else finishes it and science moves on. Only if we're convinced that nobody will be able to finish the WU do we report it as a bad WU, and it's removed from future distribution.

The V7 client and the new server code both have improvements that will automate more of this process.

[karlinhigh]

Thank you for explaining, MtM and bruce.