Project: 2563 (Run 19, Clone 107, Gen 46)

[dutchmm]

This WU terminated, with a seg fault, after ~7 seconds. I cleared the queue, restarted folding, and the next time I got a D/L, same unit, same outcome. I copied the folding directory - inlcuding the linux 6.01 beta 2 software - to another system running the same Linux, and re-ran. Same crash, same place. Please advise what I need to do next? Oh yes, and since the original system has a very mild overclock, I also ran mprime95 x 2 on it for fifteen hours with no errors. The second system runs at stock, though.

[ChelseaOilman]

This must be a defective WU. I received it last night and also had an EUE. However, I did nothing and the client moved on to the next WU without any issues.

[07:07:09] Working on Unit 05 [March 13 07:07:09]
[07:07:09] + Working ...
[07:07:09] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 05 -checkpoint 15 -forceasm -verbose -lifeline 5885 -version 601'

[07:07:09]
[07:07:09] *------------------------------*
[07:07:09] Folding@Home Gromacs SMP Core
[07:07:09] Version 1.74 (November 27, 2006)
[07:07:09]
[07:07:09] Preparing to commence simulation
[07:07:09] - Ensuring status. Please wait.
[07:07:26] - Assembly optimizations manually forced on.
[07:07:26] - Not checking prior termination.
[07:07:27] - Expanded 2432663 -> 12862801 (decompressed 528.7 percent)
[07:07:27] - Starting from initial work packet
[07:07:27]
[07:07:27] Project: 2653 (Run 19, Clone 107, Gen 46)
[07:07:27]
[07:07:27] Assembly optimizations on if available.
[07:07:27] Entering M.D.
[07:07:33] Rejecting checkpoint
[07:07:33] Protein: Protein in POPC
[07:07:33] Writing local files
[07:07:34] Extra SSE boost OK.
[07:07:34] Writing local files
[07:07:34] Completed 0 out of 500000 steps (0 percent)
[07:07:38] CoreStatus = 0 (0)
[07:07:38] Client-core communications error: ERROR 0x0
[07:07:38] Deleting current work unit & continuing...
[07:11:59] - Warning: Could not delete all work unit files (5): Core returned invalid code
[07:11:59] Trying to send all finished work units
[07:11:59] + No unsent completed units remaining.
[07:11:59] - Preparing to get new work unit...
[07:11:59] + Attempting to get work packet
[07:11:59] - Will indicate memory of 128 MB
[07:11:59] - Connecting to assignment server
[07:11:59] Connecting to http://assign.stanford.edu:8080/
[07:12:00] Posted data.
[07:12:00] Initial: 40AB; - Successful: assigned to (171.64.65.56).
[07:12:00] + News From Folding@Home: Welcome to Folding@Home
[07:12:00] Loaded queue successfully.
[07:12:00] Connecting to http://171.64.65.56:8080/
[07:12:03] Posted data.
[07:12:03] Initial: 0000; - Receiving payload (expected size: 2442078)
[07:12:04] - Downloaded at ~2384 kB/s
[07:12:04] - Averaged speed for that direction ~1504 kB/s
[07:12:04] + Received work.
[07:12:04] + Closed connections
[07:12:09]
[07:12:09] + Processing work unit
[07:12:09] Core required: FahCore_a1.exe
[07:12:09] Core found.
[07:12:09] Working on Unit 06 [March 13 07:12:09]
[07:12:09] + Working ...
[07:12:09] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 06 -checkpoint 15 -forceasm -verbose -lifeline 5885 -version 601'

[07:12:09]
[07:12:09] *------------------------------*
[07:12:09] Folding@Home Gromacs SMP Core
[07:12:09] Version 1.74 (November 27, 2006)
[07:12:09]
[07:12:09] Preparing to commence simulation
[07:12:09] - Ensuring status. Please wait.
[07:12:26] - Assembly optimizations manually forced on.
[07:12:26] - Not checking prior termination.
[07:12:26] Error: Work unit read from disk is invalid
[07:12:26] Finalizing output
[07:12:27] - Expanded 2441566 -> 12886017 (decompressed 527.7 percent)
[07:12:27] - Starting from initial work packet
[07:12:27]
[07:12:27] Project: 2605 (Run 3, Clone 3, Gen 21)
[07:12:27]
[07:12:27] Assembly optimizations on if available.
[07:12:27] Entering M.D.
[07:12:33] Rejecting checkpoint
[07:12:34] OPC
[07:12:34] Writing local files
[07:12:34] Extra SSE boost OK.
[07:12:34]
[07:12:34] Extra SSE boost OK.
[07:12:34] Writing local files
[07:12:34] Completed 0 out of 500000 steps (0 percent)
[07:24:52] Writing local files
[07:24:52] Completed 5000 out of 500000 steps (1 percent)

[kasson]

Yes, this one is verified defective. We may try to fix and re-issue in the future, but for the moment, I'm stopping new assigns of it.

[bruce]

. . . since the original system has a very mild overclock, I also ran mprime95 x 2 on it for fifteen hours with no errors.

You wasted 15 hours. A system which is "stable" with Mprime95 can be unstable with FAH. You'll find many threads in this forum recommending stresscpu2 -- often along with other tests. No single test will catch all of the instabilites but the correlation between the prime95 programs and the SSE work done in FAH is pretty weak.

It doesn't really matter, since this wasn't really your problem, but you can file it away for future reference.

[ChelseaOilman]

I'm stopping new assigns of it.

I was assigned this WU 2 more times last night.

[03:47:23] Working on Unit 07 [March 14 03:47:23]
[03:47:23] + Working ...
[03:47:23] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 07 -checkpoint 15 -forceasm -verbose -lifeline 5885 -version 601'

[03:47:23]
[03:47:23] *------------------------------*
[03:47:23] Folding@Home Gromacs SMP Core
[03:47:23] Version 1.74 (November 27, 2006)
[03:47:23]
[03:47:23] Preparing to commence simulation
[03:47:23] - Ensuring status. Please wait.
[03:47:40] - Assembly optimizations manually forced on.
[03:47:40] - Not checking prior termination.
[03:47:41] - Expanded 2432663 -> 12862801 (decompressed 528.7 percent)
[03:47:41] - Starting from initial work packet
[03:47:41]
[03:47:41] Project: 2653 (Run 19, Clone 107, Gen 46)
[03:47:41]
[03:47:41] Assembly optimizations on if available.
[03:47:41] Entering M.D.
[03:47:47] Rejecting checkpoint
[03:47:48] OPC
[03:47:48] Writing local files
[03:47:48] Extra SSE boost OK.
[03:47:48]
[03:47:48] Extra SSE boost OK.
[03:47:48] Writing local files
[03:47:48] Completed 0 out of 500000 steps (0 percent)
[03:47:53] CoreStatus = 0 (0)
[03:47:53] Client-core communications error: ERROR 0x0
[03:47:53] Deleting current work unit & continuing...
[03:52:15] - Warning: Could not delete all work unit files (7): Core returned invalid code
[03:52:15] Trying to send all finished work units
[03:52:15] + No unsent completed units remaining.
[03:52:15] - Preparing to get new work unit...
[03:52:15] + Attempting to get work packet
[03:52:15] - Will indicate memory of 128 MB
[03:52:15] - Connecting to assignment server
[03:52:15] Connecting to http://assign.stanford.edu:8080/
[03:52:15] Posted data.
[03:52:15] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[03:52:15] + News From Folding@Home: Welcome to Folding@Home
[03:52:15] Loaded queue successfully.
[03:52:15] Connecting to http://171.64.65.64:8080/
[03:52:18] Posted data.
[03:52:18] Initial: 0000; - Receiving payload (expected size: 2433175)
[03:52:20] - Downloaded at ~1188 kB/s
[03:52:20] - Averaged speed for that direction ~1390 kB/s
[03:52:20] + Received work.
[03:52:20] + Closed connections
[03:52:25]
[03:52:25] + Processing work unit
[03:52:25] Core required: FahCore_a1.exe
[03:52:25] Core found.
[03:52:25] Working on Unit 08 [March 14 03:52:25]
[03:52:25] + Working ...
[03:52:25] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 08 -checkpoint 15 -forceasm -verbose -lifeline 5885 -version 601'

[03:52:25]
[03:52:25] *------------------------------*
[03:52:25] Folding@Home Gromacs SMP Core
[03:52:25] Version 1.74 (November 27, 2006)
[03:52:25]
[03:52:25] Preparing to commence simulation
[03:52:25] - Ensuring status. Please wait.
[03:52:42] - Assembly optimizations manually forced on.
[03:52:42] - Not checking prior termination.
[03:52:43] - Expanded 2432663 -> 12862801 (decompressed 528.7 percent)
[03:52:43] - Starting from initial work packet
[03:52:43]
[03:52:43] Project: 2653 (Run 19, Clone 107, Gen 46)
[03:52:43]
[03:52:43] Assembly optimizations on if available.
[03:52:43] Entering M.D.
[03:52:49] Rejecting checkpoint
[03:52:49] Protein: Protein in POPCExtra SSE boost OK.
[03:52:49]
[03:52:49] Extra SSE boost OK.
[03:52:50] Writing local files
[03:52:50] Completed 0 out of 500000 steps (0 percent)
[03:52:54] CoreStatus = 0 (0)
[03:52:54] Client-core communications error: ERROR 0x0
[03:52:54] Deleting current work unit & continuing...

[Tigerbiten]

Just got it here.

Code: Select all

[01:09:59] Project: 2653 (Run 19, Clone 107, Gen 46)
[01:09:59] 
[01:10:12] Assembly optimizations on if available.
[01:10:12] Entering M.D.
[01:10:19] Protein: Protein in POPC
[01:10:19] Writing local files
[01:10:20] Extra SSE boost OK.
[01:10:21] gfile size: 8293G- Writing 8829 bytes of core data to disk...
[01:10:21]   ... Done.
[01:10:21] ave done.
[01:10:21] logfile size: 8293
[01:10:21] - Writing 8829 bytes of core data to disk...
[01:10:21]   ... Done.
[01:10:21] - Failed to delete worNo C.P. to deletWarning:  check for stray files
[01:10:21] es
[01:10:21] 
[01:10:21] Folding@home Core Shutdown: EARLY_UNIT_END
[01:10:21] Finalizing output
[01:12:21] utdown: EARLY_UNIT_END
[01:12:25] CoreStatus = 7B (123)
[01:12:25] Client-core communications error: ERROR 0x7b
[01:12:25] Deleting current work unit & continuing...
[01:14:45] - Preparing to get new work unit...
[01:14:45] + Attempting to get work packet
[01:14:45] - Connecting to assignment server
[01:14:47] - Successful: assigned to (171.64.65.64).
[01:14:47] + News From Folding@Home: Welcome to Folding@Home
[01:14:48] Loaded queue successfully.
[01:15:12] + Closed connections
[01:15:17] 
[01:15:17] + Processing work unit
[01:15:17] Core required: FahCore_a1.exe
[01:15:17] Core found.
[01:15:17] Working on Unit 03 [March 20 01:15:17]
[01:15:17] + Working ...
[01:15:17] 
[01:15:17] *------------------------------*
[01:15:17] Folding@Home Gromacs SMP Core
[01:15:17] Version 1.74 (March 10, 2007)
[01:15:17] 
[01:15:17] Preparing to commence simulation
[01:15:17] - Ensuring status. Please wait.
[01:15:34] - Assembly optimizations manually forced on.
[01:15:34] - Not checking prior termination.
[01:15:39] - Expanded 2432663 -> 12862801 (decompressed 528.7 percent)
[01:15:39] - Starting from initial work packet
[01:15:39] 
[01:15:39] Project: 2653 (Run 19, Clone 107, Gen 46)
[01:15:39] 
[01:15:41]  from initial work packet
[01:15:41] 
[01:15:41] Project: 2653 (Run 19, Clone 107, Gen 46)
[01:15:41] 
[01:15:54] Assembly optimizations on if available.
[01:15:54] Entering M.D.
[01:16:01] Protein: Protein in POPC
[01:16:01] Writing local files
[01:16:01] Extra SSE boost OK.
[01:16:03] Gromacs cannot continue further.
[01:16:03] Going to send back what have done.
[01:16:03] logfile size: 8781
[01:16:03] - Writing 9317 bytes of core data to disk...
[01:16:03]   ... Done.
[01:16:03] ...
[01:16:03]   ... Done.
[01:16:03] - Failed to delete work/wudata_03.sas
[01:16:03] - Failed to delete work/wudata_03.goe
[01:16:03] Warning:  check for stray files
[01:16:03] ing:  check for stray files
[01:16:03] ck for stray files
[01:16:03] 
[01:16:03] Folding@home Core Shutdown: EARLY_UNIT_END
[01:16:03] Finalizing output
[01:18:05] CoreStatus = 7B (123)
[01:18:05] Client-core communications error: ERROR 0x7b
[01:18:05] Deleting current work unit & continuing...
[01:20:25] - Preparing to get new work unit...
[01:20:25] + Attempting to get work packet
[01:20:25] - Connecting to assignment server
[01:20:26] - Successful: assigned to (171.64.65.64).
[01:20:26] + News From Folding@Home: Welcome to Folding@Home
[01:20:26] Loaded queue successfully.
[01:20:51] + Closed connections
[01:20:56] 
[01:20:56] + Processing work unit
[01:20:56] Core required: FahCore_a1.exe
[01:20:56] Core found.
[01:20:56] Working on Unit 04 [March 20 01:20:56]
[01:20:56] + Working ...
[01:20:56] 
[01:20:56] *------------------------------*
[01:20:56] Folding@Home Gromacs SMP Core
[01:20:56] Version 1.74 (March 10, 2007)
[01:20:56] 
[01:20:56] Preparing to commence simulation
[01:20:56] - Ensuring status. Please wait.
[01:21:13] - Assembly optimizations manually forced on.
[01:21:13] - Not checking prior termination.
[01:21:19] - Expanded 2432663 -> 12862801 (decompressed 528.7 percent)
[01:21:20] - Starting from initial work packet
[01:21:20] 
[01:21:20] Project: 2653 (Run 19, Clone 107, Gen 46)
[01:21:20] 
[01:21:32] Assembly optimizations on if available.
[01:21:32] Entering M.D.
[01:21:38] Rejecting checkpoint
[01:21:38] Protein: Protein in POPC
[01:21:39] xtra SSE boost OK.
[01:21:39] 
[01:21:40] Extra SSE boost OK.
[01:21:40] ue further.
[01:21:40] Going to send back what have done.
[01:21:40] logfile size: 8781
[01:21:40] - Writing 9317 bytes of core data to disk...
[01:21:40]   ... Done.
[01:21:40] No C.P. to delete.
[01:21:40] ize: 8293
[01:21:40] - Writing 8829 bytes of core data to disk...
[01:21:40]   Warning:  check for stray files
[01:21:40] elete work/wudata_04.sas
[01:21:40] - Failed to delete work/wudata_04.goe
[01:21:40] Warning:  check for stray files
[01:21:40] 
[01:21:40] Folding@home Core Shutdown: EARLY_UNIT_END
[01:21:40] Finalizing output
[01:23:44] CoreStatus = 7B (123)
[01:23:44] Client-core communications error: ERROR 0x7b

Luck .............

[kasson]

We're looking into why the server hasn't stopped assigning this WU after we told it to...

[Xilikon]

I just got this 3x (2653 (Run 19, Clone 107, Gen 46)) on a known stable E6300 box at stock. It always give a 0x7B error immediatly each time this WU is downloaded. After 3 times, it was assigned a different one and it's now running smoothly.

[matte.2]

The WU surfaced again, my non-overclocked q6600 had 3 folding attempts last night, each time folding stopped almost immediately with EARLY_UNIT_END.
After the third attempt a new FahCore_a1.exe core was automatically downloaded
for information

Code: Select all

[02:45:10] - Preparing to get new work unit...
[02:45:10] + Attempting to get work packet
[02:45:10] - Will indicate memory of 2047 MB
[02:45:10] - Connecting to assignment server
[02:45:10] Connecting to http://assign.stanford.edu:8080/
[02:45:11] Posted data.
[02:45:11] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[02:45:11] + News From Folding@Home: Welcome to Folding@Home
[02:45:11] Loaded queue successfully.
[02:45:11] Connecting to http://171.64.65.64:8080/
[02:45:14] Posted data.
[02:45:14] Initial: 0000; - Receiving payload (expected size: 2433175)
[02:45:23] - Downloaded at ~264 kB/s
[02:45:23] - Averaged speed for that direction ~260 kB/s
[02:45:23] + Received work.
[02:45:23] Trying to send all finished work units
[02:45:23] + No unsent completed units remaining.
[02:45:23] + Closed connections
[02:45:23] 
[02:45:23] + Processing work unit
[02:45:23] Core required: FahCore_a1.exe
[02:45:23] Core found.
[02:45:23] Working on Unit 09 [May 12 02:45:23]
[02:45:23] + Working ...
[02:45:23] - Calling 'mpiexec -channel auto -np 4 FahCore_a1.exe -dir work/ -suffix 09 -checkpoint 10 -forceasm -verbose -lifeline 4808 -version 591'

[02:45:23] 
[02:45:23] *------------------------------*
[02:45:23] Folding@Home Gromacs SMP Core
[02:45:23] Version 1.74 (March 10, 2007)
[02:45:23] 
[02:45:23] Preparing to commence simulation
[02:45:23] - Ensuring status. Please wait.
[02:45:40] - Assembly optimizations manually forced on.
[02:45:40] - Not checking prior termination.
[02:45:47] - Expanded 2432663 -> 12862801 (decompressed 528.7 percent)
[02:45:47] - Starting from initial work packet
[02:45:47] 
[02:45:47] Project: 2653 (Run 19, Clone 107, Gen 46)
[02:45:47] 
[02:45:48] Assembly optimizations on if available.
[02:45:48] Entering M.D.
[02:45:54] Rejecting checkpoint
[02:45:55] Protein: Protein in POPC
[02:45:56] xtra SSE boost OK.
[02:45:56] 
[02:45:57] romacs cannot continue further.
[02:45:57] Going to send back what have done.
[02:45:57] logfile size: 8293
[02:45:57] - Writing 8019 bytes of core data to disk...
[02:45:57]   ... Done.
[02:45:57] - Failed to delete work/wudata_09.xtc
[02:45:57] No C.P. to delete.
[02:45:57] Warning:  check for stray files
[02:45:57] ailed to delete work/wudata_09.xtc
[02:45:57] No C.P. to delete.
[02:45:57] Warning:  check for stray files
[02:45:57] 
[02:45:57] Folding@home Core Shutdown: EARLY_UNIT_END
[02:45:57] 
[02:45:57] Folding@home Core Shutdown: EARLY_UNIT_END
[02:46:01] CoreStatus = 7B (123)
[02:46:01] Client-core communications error: ERROR 0x7b
[02:46:01] Deleting current work unit & continuing...
[02:48:21] - Warning: Could not delete all work unit files (9): Core returned invalid code
[02:48:21] Trying to send all finished work units
[02:48:21] + No unsent completed units remaining.
[02:48:21] - Preparing to get new work unit...
[02:48:21] + Attempting to get work packet
[02:48:21] - Will indicate memory of 2047 MB
[02:48:21] - Connecting to assignment server
[02:48:21] Connecting to http://assign.stanford.edu:8080/
[02:48:22] Posted data.
[02:48:22] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[02:48:22] + News From Folding@Home: Welcome to Folding@Home
[02:48:22] Loaded queue successfully.
[02:48:22] Connecting to http://171.64.65.64:8080/
[02:48:25] Posted data.
[02:48:25] Initial: 0000; - Receiving payload (expected size: 2433175)
[02:48:35] - Downloaded at ~237 kB/s
[02:48:35] - Averaged speed for that direction ~256 kB/s
[02:48:35] + Received work.
[02:48:35] + Closed connections
[02:48:40] 
[02:48:40] + Processing work unit
[02:48:40] Core required: FahCore_a1.exe
[02:48:40] Core found.
[02:48:40] Working on Unit 00 [May 12 02:48:40]
[02:48:40] + Working ...
[02:48:40] - Calling 'mpiexec -channel auto -np 4 FahCore_a1.exe -dir work/ -suffix 00 -checkpoint 10 -forceasm -verbose -lifeline 4808 -version 591'

[02:48:40] 
[02:48:40] *------------------------------*
[02:48:40] Folding@Home Gromacs SMP Core
[02:48:40] Version 1.74 (March 10, 2007)
[02:48:40] 
[02:48:40] Preparing to commence simulation
[02:48:40] - Ensuring status. Please wait.
[02:48:57] - Assembly optimizations manually forced on.
[02:48:57] - Not checking prior termination.
[02:49:04] - Expanded 2432663 -> 12862801 (decompressed 528.7 percent)
[02:49:04] - Starting from initial work packet
[02:49:04] 
[02:49:04] Project: 2653 (Run 19, Clone 107, Gen 46)
[02:49:04] 
[02:49:05] Assembly optimizations on if available.
[02:49:05] Entering M.D.
[02:49:11] Rejecting checkpoint
[02:49:12] ProtWriting local files
[02:49:12] 
[02:49:12] Writing local files
[02:49:14] Extra SSE boost OK.
[02:49:14] ue further.
[02:49:14] Going to send back what have done.
[02:49:14] logfile size: 8293
[02:49:14] - Writing 8829 bytes of core data to disk...
[02:49:14]   ... Done.
[02:49:14] - Failed to delete work/wudata_00.arc
[02:49:14] No C.P. to delete.
[02:49:14] Warning:  check for stray files
[02:49:14] 
[02:49:14] Folding@home Core Shutdown: EARLY_No C.P. to delete.
[02:49:14] Warning:  check for stray files
[02:51:14] 
[02:51:14] Folding@home Core Shutdown: EARLY_UNIT_END
[02:51:14] 
[02:51:14] Folding@home Core Shutdown: EARLY_UNIT_END
[02:51:19] CoreStatus = 7B (123)
[02:51:19] Client-core communications error: ERROR 0x7b
[02:51:19] Deleting current work unit & continuing...
[02:53:39] - Warning: Could not delete all work unit files (0): Core returned invalid code
[02:53:39] Trying to send all finished work units
[02:53:39] + No unsent completed units remaining.
[02:53:39] - Preparing to get new work unit...
[02:53:39] + Attempting to get work packet
[02:53:39] - Will indicate memory of 2047 MB
[02:53:39] - Connecting to assignment server
[02:53:39] Connecting to http://assign.stanford.edu:8080/
[02:53:39] Posted data.
[02:53:39] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[02:53:39] + News From Folding@Home: Welcome to Folding@Home
[02:53:39] Loaded queue successfully.
[02:53:39] Connecting to http://171.64.65.64:8080/
[02:53:42] Posted data.
[02:53:42] Initial: 0000; - Receiving payload (expected size: 2433175)
[02:53:51] - Downloaded at ~264 kB/s
[02:53:51] - Averaged speed for that direction ~257 kB/s
[02:53:51] + Received work.
[02:53:51] + Closed connections
[02:53:56] 
[02:53:56] + Processing work unit
[02:53:56] Core required: FahCore_a1.exe
[02:53:56] Core found.
[02:53:56] Working on Unit 01 [May 12 02:53:56]
[02:53:56] + Working ...
[02:53:56] - Calling 'mpiexec -channel auto -np 4 FahCore_a1.exe -dir work/ -suffix 01 -checkpoint 10 -forceasm -verbose -lifeline 4808 -version 591'

[02:53:56] 
[02:53:56] *------------------------------*
[02:53:56] Folding@Home Gromacs SMP Core
[02:53:56] Version 1.74 (March 10, 2007)
[02:53:56] 
[02:53:56] Preparing to commence simulation
[02:53:56] - Ensuring status. Please wait.
[02:54:13] - Assembly optimizations manually forced on.
[02:54:13] - Not checking prior termination.
[02:54:20] - Expanded 2432663 -> 12862801 (decompressed 528.7 percent)
[02:54:20] - Starting from initial work packet
[02:54:20] 
[02:54:20] Project: 2653 (Run 19, Clone 107, Gen 46)
[02:54:20] 
[02:54:20]  from initial work packet
[02:54:20] 
[02:54:20] Project: 2653 (Run 19, Clone 107, Gen 46)
[02:54:20] 
[02:54:21] Assembly optimizations on if available.
[02:54:21] Entering M.D.
[02:54:28] Protein: Protein in POPC
[02:54:28] Writing local files
[02:54:29] Extra SSE boost OK.
[02:54:30] Gromacs cannot continue further.
[02:54:30] Going to send back what have done.
[02:54:30] logfil- Failed to delete work/wudata_01.arc
[02:54:30] No C.P. to delete.
[02:54:30] Warning:  check for stray files
[02:54:30] 
[02:54:30] Folding@home Core Shutdown: EARLY_UNIT_END
[02:54:30] Finalizing output
[02:54:30]   check for stray files
[02:56:30] 
[02:56:30] Folding@home Core Shutdown: EARLY_UNIT_END
[02:56:30] 
[02:56:30] Folding@home Core Shutdown: EARLY_UNIT_END
[02:56:34] CoreStatus = 7B (123)
[02:56:34] Client-core communications error: ERROR 0x7b
[02:56:34] - Attempting to download new core...
[02:56:34] + Downloading new core: FahCore_a1.exe
[02:56:34] Downloading core (/~pande/Win32/x86//Core_a1.fah from www.stanford.edu)
[02:56:35] Initial: AFDE; + 10240 bytes downloaded
[02:56:36] Initial: AD21; + 20480 bytes downloaded
[02:56:36] Initial: CC38; + 30720 bytes downloaded
[02:56:36] Initial: 8501; + 40960 bytes downloaded
[02:56:36] Initial: F56A; + 51200 bytes downloaded
[02:56:36] Initial: ABAE; + 61440 bytes downloaded
[02:56:36] Initial: B6B0; + 71680 bytes downloaded
[02:56:36] Initial: 783A; + 81920 bytes downloaded
[02:56:36] Initial: B2A6; + 92160 bytes downloaded
[02:56:36] Initial: 1409; + 102400 bytes downloaded
[02:56:36] Initial: BBF0; + 112640 bytes downloaded
[02:56:37] Initial: 1861; + 122880 bytes downloaded
[02:56:37] Initial: 5950; + 133120 bytes downloaded
[02:56:37] Initial: 1081; + 143360 bytes downloaded
[02:56:37] Initial: 26BC; + 153600 bytes downloaded
[02:56:37] Initial: FE4A; + 163840 bytes downloaded
[02:56:37] Initial: C1C3; + 174080 bytes downloaded
[02:56:37] Initial: 9B49; + 184320 bytes downloaded
[02:56:37] Initial: 9EE5; + 194560 bytes downloaded
[02:56:37] Initial: D79D; + 204800 bytes downloaded
[02:56:37] Initial: 7801; + 215040 bytes downloaded
[02:56:37] Initial: 8B51; + 225280 bytes downloaded
[02:56:37] Initial: E26E; + 235520 bytes downloaded
[02:56:37] Initial: EDB0; + 245760 bytes downloaded
[02:56:37] Initial: 0919; + 256000 bytes downloaded
[02:56:37] Initial: CDDE; + 266240 bytes downloaded
[02:56:37] Initial: 7A7E; + 276480 bytes downloaded
[02:56:37] Initial: 034E; + 286720 bytes downloaded
[02:56:37] Initial: 88D0; + 296960 bytes downloaded
[02:56:37] Initial: D66D; + 307200 bytes downloaded
[02:56:37] Initial: 6A52; + 317440 bytes downloaded
[02:56:37] Initial: B478; + 327680 bytes downloaded
[02:56:37] Initial: CF8A; + 337920 bytes downloaded
[02:56:37] Initial: 8407; + 348160 bytes downloaded
[02:56:37] Initial: 2246; + 358400 bytes downloaded
[02:56:37] Initial: 1C69; + 368640 bytes downloaded
[02:56:37] Initial: 1287; + 378880 bytes downloaded
[02:56:37] Initial: 19B3; + 389120 bytes downloaded
[02:56:37] Initial: 1AD1; + 399360 bytes downloaded
[02:56:37] Initial: 5791; + 409600 bytes downloaded
[02:56:37] Initial: 76C5; + 419840 bytes downloaded
[02:56:37] Initial: 9B77; + 430080 bytes downloaded
[02:56:37] Initial: E82F; + 440320 bytes downloaded
[02:56:37] Initial: D0D3; + 450560 bytes downloaded
[02:56:38] Initial: 0F5E; + 460800 bytes downloaded
[02:56:38] Initial: D743; + 471040 bytes downloaded
[02:56:38] Initial: 0B7C; + 481280 bytes downloaded
[02:56:38] Initial: FAFD; + 491520 bytes downloaded
[02:56:38] Initial: 0E14; + 501760 bytes downloaded
[02:56:38] Initial: 4048; + 512000 bytes downloaded
[02:56:38] Initial: 21A5; + 522240 bytes downloaded
[02:56:38] Initial: C1A5; + 532480 bytes downloaded
[02:56:38] Initial: F716; + 542720 bytes downloaded
[02:56:38] Initial: DD98; + 552960 bytes downloaded
[02:56:38] Initial: 9F7B; + 563200 bytes downloaded
[02:56:38] Initial: 1CC0; + 573440 bytes downloaded
[02:56:38] Initial: 4D37; + 583680 bytes downloaded
[02:56:38] Initial: 222A; + 593920 bytes downloaded
[02:56:38] Initial: 8E33; + 604160 bytes downloaded
[02:56:38] Initial: D3C9; + 614400 bytes downloaded
[02:56:38] Initial: 9821; + 624640 bytes downloaded
[02:56:38] Initial: 236E; + 634880 bytes downloaded
[02:56:38] Initial: 1A7A; + 645120 bytes downloaded
[02:56:38] Initial: 6D64; + 655360 bytes downloaded
[02:56:38] Initial: 4ADC; + 665600 bytes downloaded
[02:56:38] Initial: 3854; + 675840 bytes downloaded
[02:56:38] Initial: CB5C; + 686080 bytes downloaded
[02:56:38] Initial: 2A88; + 696320 bytes downloaded
[02:56:38] Initial: 1199; + 706560 bytes downloaded
[02:56:38] Initial: 0512; + 716800 bytes downloaded
[02:56:38] Initial: 316E; + 727040 bytes downloaded
[02:56:38] Initial: D89D; + 737280 bytes downloaded
[02:56:38] Initial: E6A3; + 747520 bytes downloaded
[02:56:38] Initial: B488; + 757760 bytes downloaded
[02:56:38] Initial: BAFD; + 768000 bytes downloaded
[02:56:38] Initial: 34A0; + 778240 bytes downloaded
[02:56:38] Initial: DD6C; + 788480 bytes downloaded
[02:56:38] Initial: D2E9; + 789667 bytes downloaded
[02:56:38] Verifying core Core_a1.fah...
[02:56:39] Signature is VALID
[02:56:39] 
[02:56:39] Trying to unzip core FahCore_a1.exe
[02:56:39] Decompressed FahCore_a1.exe (2035712 bytes) successfully
[02:56:39] + Core successfully engaged
[02:56:39] Deleting current work unit & continuing...
[02:58:59] - Warning: Could not delete all work unit files (1): Core returned invalid code
[02:58:59] Trying to send all finished work units
[02:58:59] + No unsent completed units remaining.
[02:58:59] - Preparing to get new work unit...
[02:58:59] + Attempting to get work packet
[02:58:59] - Will indicate memory of 2047 MB
[02:58:59] - Connecting to assignment server
[02:58:59] Connecting to http://assign.stanford.edu:8080/
[02:58:59] Posted data.
[02:58:59] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[02:58:59] + News From Folding@Home: Welcome to Folding@Home
[02:59:00] Loaded queue successfully.
[02:59:00] Connecting to http://171.64.65.64:8080/
[02:59:00] Posted data.
[02:59:00] Initial: 0000; - Error: Bad packet type from server, expected work assignment
[02:59:00] - Error: Attempt #1  to get work failed, and no other work to do.
             Waiting before retry.
[02:59:12] + Attempting to get work packet
[02:59:12] - Will indicate memory of 2047 MB
[02:59:12] - Connecting to assignment server
[02:59:12] Connecting to http://assign.stanford.edu:8080/
[02:59:12] Posted data.
[02:59:12] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[02:59:12] + News From Folding@Home: Welcome to Folding@Home
[02:59:13] Loaded queue successfully.
[02:59:13] Connecting to http://171.64.65.64:8080/
[02:59:16] Posted data.
[02:59:16] Initial: 0000; - Receiving payload (expected size: 2444186)
[02:59:26] - Downloaded at ~238 kB/s
[02:59:26] - Averaged speed for that direction ~253 kB/s
[02:59:26] + Received work.
[02:59:26] + Closed connections
[02:59:31] 
[02:59:31] + Processing work unit
[02:59:31] Core required: FahCore_a1.exe
[02:59:31] Core found.
[02:59:31] Working on Unit 02 [May 12 02:59:31]
[02:59:31] + Working ...
[02:59:31] - Calling 'mpiexec -channel auto -np 4 FahCore_a1.exe -dir work/ -suffix 02 -checkpoint 10 -forceasm -verbose -lifeline 4808 -version 591'

[02:59:31] 
[02:59:31] *------------------------------*
[02:59:31] Folding@Home Gromacs SMP Core
[02:59:31] Version 1.74 (March 10, 2007)
[02:59:31] 
[02:59:31] Preparing to commence simulation
[02:59:31] - Ensuring status. Please wait.
[02:59:48] - Assembly optimizations manually forced on.
[02:59:48] - Not checking prior termination.
[02:59:55] - Expanded 2443674 -> 12905281 (decompressed 528.1 percent)
[02:59:55] - Starting from initial work packet
[02:59:55] 
[02:59:55] Project: 2653 (Run 33, Clone 19, Gen 59)