Project: 2665 (Run 0, Clone 545, Gen 48)
Posted: Sat Oct 04, 2008 2:23 am
Project: 2665 (Run 0, Clone 545, Gen 48)
Please check the DB for any information in this WU. Thanks in advance!
Note this WU failed twice in exactly the same spot, with exactly the same error!
Log summary:
[21:10:16] Completed 62500 out of 250000 steps (25 percent)
[21:22:04] Warning: long 1-4 interactions
[21:22:04] Quit 101 - NaN detected: (ener[20])
[21:22:04]
[21:22:04] Simulation instability has been encountered. The run has entered a
[21:22:04] state from which no further progress can be made.
[21:22:04] This may be the correct result of the simulation, however if you
[21:22:04] often see other project units terminating early like this
[21:22:04] too, you may wish to check the stability of your computer (issues
[21:22:04] such as high temperature, overclocking, etc.).
[21:22:04] Going to send back what have done.
[21:22:04] logfile size: 56168
[21:22:04] - Writing 56718 bytes of core data to disk...
[21:22:04] ... Done.
[21:24:04]
[21:24:04] Folding@home Core Shutdown: EARLY_UNIT_END
[21:24:04]
[21:24:04] Folding@home Core Shutdown: EARLY_UNIT_END
[21:24:07] CoreStatus = 7B (123)
[21:24:07] Client-core communications error: ERROR 0x7b
[21:24:07] Deleting current work unit & continuing...
[21:24:07] Using generic mpiexec calls
[21:26:09] - Warning: Could not delete all work unit files (6): Core returned invalid code
[21:26:09] Trying to send all finished work units
[21:26:09] + No unsent completed units remaining.
Please check the DB for any information in this WU. Thanks in advance!
Note this WU failed twice in exactly the same spot, with exactly the same error!
It will probably fail a third time in the same spot, it's still running and just hasn't reached that spot yet.
[21:10:16] Completed 62500 out of 250000 steps (25 percent)
[21:22:04] Warning: long 1-4 interactions
[21:22:04] Quit 101 - NaN detected: (ener[20])
Log summary:
[21:10:16] Completed 62500 out of 250000 steps (25 percent)
[21:22:04] Warning: long 1-4 interactions
[21:22:04] Quit 101 - NaN detected: (ener[20])
[21:22:04]
[21:22:04] Simulation instability has been encountered. The run has entered a
[21:22:04] state from which no further progress can be made.
[21:22:04] This may be the correct result of the simulation, however if you
[21:22:04] often see other project units terminating early like this
[21:22:04] too, you may wish to check the stability of your computer (issues
[21:22:04] such as high temperature, overclocking, etc.).
[21:22:04] Going to send back what have done.
[21:22:04] logfile size: 56168
[21:22:04] - Writing 56718 bytes of core data to disk...
[21:22:04] ... Done.
[21:24:04]
[21:24:04] Folding@home Core Shutdown: EARLY_UNIT_END
[21:24:04]
[21:24:04] Folding@home Core Shutdown: EARLY_UNIT_END
[21:24:07] CoreStatus = 7B (123)
[21:24:07] Client-core communications error: ERROR 0x7b
[21:24:07] Deleting current work unit & continuing...
[21:24:07] Using generic mpiexec calls
[21:26:09] - Warning: Could not delete all work unit files (6): Core returned invalid code
[21:26:09] Trying to send all finished work units
[21:26:09] + No unsent completed units remaining.
Code: Select all
# Windows SMP Console Edition #################################################
###############################################################################
Folding@Home Client Version 6.22 SMP Beta2r3
http://folding.stanford.edu
###############################################################################
###############################################################################
Launch directory: C:\Users\GatoPrimo\Fah2ndSmpClient
Executable: C:\Users\GatoPrimo\Fah2ndSmpClient\Folding@home-Win32-x86.exe
Arguments: -smp -verbosity 9
[04:07:17] - Ask before connecting: No
[04:07:17] - User name: [EV]LithiumSmp (Team 104636)
[04:07:17] - User ID: C7BCBFB2C868C07
[04:07:17] - Machine ID: 3
[04:07:17]
[01:22:41] + Attempting to get work packet
[01:22:41] - Will indicate memory of 3070 MB
[01:22:41] - Connecting to assignment server
[01:22:41] Connecting to http://assign.stanford.edu:8080/
[01:22:41] Posted data.
[01:22:41] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[01:22:41] + News From Folding@Home: Welcome to Folding@Home
[01:22:41] Loaded queue successfully.
[01:22:41] Connecting to http://171.64.65.64:8080/
[01:22:46] Posted data.
[01:22:46] Initial: 0000; - Receiving payload (expected size: 4684476)
[01:22:59] - Downloaded at ~351 kB/s
[01:22:59] - Averaged speed for that direction ~298 kB/s
[01:22:59] + Received work.
[01:22:59] Trying to send all finished work units
[01:22:59] + No unsent completed units remaining.
[01:22:59] + Closed connections
[01:22:59]
[01:22:59] + Processing work unit
[01:22:59] Work type a1 not eligible for variable processors
[01:22:59] Core required: FahCore_a1.exe
[01:22:59] Core found.
[01:22:59] Using generic mpiexec calls
[01:22:59] Working on queue slot 05 [October 3 01:22:59 UTC]
[01:22:59] + Working ...
[01:22:59] - Calling 'mpiexec -np 4 -channel auto -host 127.0.0.1 FahCore_a1.exe -dir work/ -suffix 05 -checkpoint 30 -verbose -lifeline 5204 -version 622'
[01:22:59]
[01:22:59] *------------------------------*
[01:22:59] Folding@Home Gromacs SMP Core
[01:22:59] Version 1.74 (March 10, 2007)
[01:22:59]
[01:22:59] Preparing to commence simulation
[01:22:59] - Ensuring status. Please wait.
[01:23:06] - Starting from initial work packet
[01:23:07]
[01:23:07] Project: 2665 (Run 0, Clone 545, Gen 48)
[01:23:07]
[01:23:07] Assembly optimizations on if available.
[01:23:07] Entering M.D.
[01:23:26] al work packet
[01:23:26]
[01:23:26] Project: 2665 (Run 0, Clone 545, Gen 48)
[01:23:26]
[01:23:27] Entering M.D.
[01:23:37] ne 545, Gen 48)
[01:23:37]
[01:23:38] Entering M.D.
[01:23:44] Rejecting checkpoint
[01:23:46] Protein: HGG in water
[01:23:46] Writing local files
[01:24:00] Extra SSE boost OK.
[01:24:00] Writing local files
[01:24:01] Completed 0 out of 250000 steps (0 percent)
[01:49:12] Writing local files
[01:49:12] Completed 2500 out of 250000 steps (1 percent)
[02:14:17] Writing local files
[02:14:17] Completed 5000 out of 250000 steps (2 percent)
[02:39:14] Writing local files
[02:39:14] Completed 7500 out of 250000 steps (3 percent)
[03:04:24] Writing local files
[03:04:24] Completed 10000 out of 250000 steps (4 percent)
[03:29:19] Writing local files
[03:29:19] Completed 12500 out of 250000 steps (5 percent)
[03:54:14] Writing local files
[03:54:14] Completed 15000 out of 250000 steps (6 percent)
[04:19:08] Writing local files
[04:19:08] Completed 17500 out of 250000 steps (7 percent)
[04:23:39] - Autosending finished units... [October 3 04:23:39 UTC]
[04:23:39] Trying to send all finished work units
[04:23:39] + No unsent completed units remaining.
[04:23:39] - Autosend completed
[04:44:02] Writing local files
[04:44:03] Completed 20000 out of 250000 steps (8 percent)
[05:08:58] Writing local files
[05:08:58] Completed 22500 out of 250000 steps (9 percent)
[05:33:51] Writing local files
[05:33:52] Completed 25000 out of 250000 steps (10 percent)
[05:58:46] Writing local files
[05:58:47] Completed 27500 out of 250000 steps (11 percent)
[06:23:42] Writing local files
[06:23:43] Completed 30000 out of 250000 steps (12 percent)
[06:48:36] Writing local files
[06:48:36] Completed 32500 out of 250000 steps (13 percent)
[07:13:30] Writing local files
[07:13:31] Completed 35000 out of 250000 steps (14 percent)
[07:38:25] Writing local files
[07:38:26] Completed 37500 out of 250000 steps (15 percent)
[08:03:21] Writing local files
[08:03:21] Completed 40000 out of 250000 steps (16 percent)
[08:28:15] Writing local files
[08:28:15] Completed 42500 out of 250000 steps (17 percent)
[08:53:36] Writing local files
[08:53:36] Completed 45000 out of 250000 steps (18 percent)
[09:16:00] Writing local files
[09:16:00] Completed 47500 out of 250000 steps (19 percent)
[09:37:38] Writing local files
[09:37:38] Completed 50000 out of 250000 steps (20 percent)
[09:59:14] Writing local files
[09:59:14] Completed 52500 out of 250000 steps (21 percent)
[10:20:52] Writing local files
[10:20:52] Completed 55000 out of 250000 steps (22 percent)
[10:23:38] - Autosending finished units... [October 3 10:23:38 UTC]
[10:23:38] Trying to send all finished work units
[10:23:38] + No unsent completed units remaining.
[10:23:38] - Autosend completed
[10:42:29] Writing local files
[10:42:29] Completed 57500 out of 250000 steps (23 percent)
[11:04:06] Writing local files
[11:04:06] Completed 60000 out of 250000 steps (24 percent)
[11:25:39] Writing local files
[11:25:39] Completed 62500 out of 250000 steps (25 percent)
[11:36:41] Warning: long 1-4 interactions
[11:36:42] Quit 101 - NaN detected: (ener[20])
[11:36:42]
[11:36:42] Simulation instability has been encountered. The run has entered a
[11:36:42] state from which no further progress can be made.
[11:36:42] This may be the correct result of the simulation, however if you
[11:36:42] often see other project units terminating early like this
[11:36:42] too, you may wish to check the stability of your computer (issues
[11:36:42] such as high temperature, overclocking, etc.).
[11:36:42] Going to send back what have done.
[11:36:42] logfile size: 9422
[11:36:42] - Writing 9972 bytes of core data to disk...
[11:36:42] ... Done.
[11:36:42] - Failed to delete work/wudata_05.arc
[11:36:42] Warning: check for stray files
[11:38:42]
[11:38:42] Folding@home Core Shutdown: EARLY_UNIT_END
[11:38:42]
[11:38:42] Folding@home Core Shutdown: EARLY_UNIT_END
[11:38:46] CoreStatus = 7B (123)
[11:38:46] Client-core communications error: ERROR 0x7b
[11:38:46] Deleting current work unit & continuing...
[11:38:46] Using generic mpiexec calls
[11:40:48] - Warning: Could not delete all work unit files (5): Core returned invalid code
[11:40:48] Trying to send all finished work units
[11:40:48] + No unsent completed units remaining.
[11:40:48] - Preparing to get new work unit...
[11:40:48] + Attempting to get work packet
[11:40:48] - Will indicate memory of 3070 MB
[11:40:48] - Connecting to assignment server
[11:40:48] Connecting to http://assign.stanford.edu:8080/
[11:40:48] Posted data.
[11:40:48] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[11:40:48] + News From Folding@Home: Welcome to Folding@Home
[11:40:49] Loaded queue successfully.
[11:40:49] Connecting to http://171.64.65.64:8080/
[11:40:54] Posted data.
[11:40:54] Initial: 0000; - Receiving payload (expected size: 4684476)
[11:41:05] - Downloaded at ~415 kB/s
[11:41:05] - Averaged speed for that direction ~321 kB/s
[11:41:05] + Received work.
[11:41:06] + Closed connections
[11:41:11]
[11:41:11] + Processing work unit
[11:41:11] Work type a1 not eligible for variable processors
[11:41:11] Core required: FahCore_a1.exe
[11:41:11] Core found.
[11:41:11] Using generic mpiexec calls
[11:41:11] Working on queue slot 06 [October 3 11:41:11 UTC]
[11:41:11] + Working ...
[11:41:11] - Calling 'mpiexec -np 4 -channel auto -host 127.0.0.1 FahCore_a1.exe -dir work/ -suffix 06 -checkpoint 30 -verbose -lifeline 5204 -version 622'
[11:41:11]
[11:41:11] *------------------------------*
[11:41:11] Folding@Home Gromacs SMP Core
[11:41:11] Version 1.74 (March 10, 2007)
[11:41:11]
[11:41:11] Preparing to commence simulation
[11:41:11] - Ensuring status. Please wait.
[11:41:17] - Starting from initial work packet
[11:41:18]
[11:41:18] Project: 2665 (Run 0, Clone 545, Gen 48)
[11:41:18]
[11:41:18] Assembly optimizations on if available.
[11:41:18] Entering M.D.
[11:41:42] percent)
[11:41:42] - Starting from initial work packet
[11:41:42]
[11:41:42] Project: 2665 (Run 0, Clone 545, Gen 48)
[11:41:42]
[11:41:42] Entering M.D.
[11:41:53] Rejecting checkpoint
[11:41:55]
[11:41:55] Writing local files
[11:41:56]
[11:41:56] Writing local files
[11:42:08] Extra SSE boost OK.
[11:42:08] Writing local files
[11:42:09] Completed 0 out of 250000 steps (0 percent)
[12:05:00] Writing local files
[12:05:00] Completed 2500 out of 250000 steps (1 percent)
[12:27:51] Writing local files
[12:27:51] Completed 5000 out of 250000 steps (2 percent)
[12:50:43] Writing local files
[12:50:43] Completed 7500 out of 250000 steps (3 percent)
[13:13:37] Writing local files
[13:13:37] Completed 10000 out of 250000 steps (4 percent)
[13:36:30] Writing local files
[13:36:31] Completed 12500 out of 250000 steps (5 percent)
[13:59:25] Writing local files
[13:59:25] Completed 15000 out of 250000 steps (6 percent)
[14:22:19] Writing local files
[14:22:19] Completed 17500 out of 250000 steps (7 percent)
[14:45:07] Writing local files
[14:45:07] Completed 20000 out of 250000 steps (8 percent)
[15:07:58] Writing local files
[15:07:58] Completed 22500 out of 250000 steps (9 percent)
[15:30:51] Writing local files
[15:30:51] Completed 25000 out of 250000 steps (10 percent)
[15:53:41] Writing local files
[15:53:41] Completed 27500 out of 250000 steps (11 percent)
[16:16:33] Writing local files
[16:16:33] Completed 30000 out of 250000 steps (12 percent)
[16:23:38] - Autosending finished units... [October 3 16:23:38 UTC]
[16:23:38] Trying to send all finished work units
[16:23:38] + No unsent completed units remaining.
[16:23:38] - Autosend completed
[16:39:26] Writing local files
[16:39:26] Completed 32500 out of 250000 steps (13 percent)
[17:02:21] Writing local files
[17:02:22] Completed 35000 out of 250000 steps (14 percent)
[17:25:15] Writing local files
[17:25:16] Completed 37500 out of 250000 steps (15 percent)
[17:48:07] Writing local files
[17:48:07] Completed 40000 out of 250000 steps (16 percent)
[18:10:49] Writing local files
[18:10:50] Completed 42500 out of 250000 steps (17 percent)
[18:33:02] Writing local files
[18:33:02] Completed 45000 out of 250000 steps (18 percent)
[18:55:16] Writing local files
[18:55:16] Completed 47500 out of 250000 steps (19 percent)
[19:17:30] Writing local files
[19:17:30] Completed 50000 out of 250000 steps (20 percent)
[19:39:47] Writing local files
[19:39:47] Completed 52500 out of 250000 steps (21 percent)
[20:02:01] Writing local files
[20:02:01] Completed 55000 out of 250000 steps (22 percent)
[20:24:25] Writing local files
[20:24:25] Completed 57500 out of 250000 steps (23 percent)
[20:47:19] Writing local files
[20:47:19] Completed 60000 out of 250000 steps (24 percent)
[21:10:15] Writing local files
[21:10:16] Completed 62500 out of 250000 steps (25 percent)
[21:22:04] Warning: long 1-4 interactions
[21:22:04] Quit 101 - NaN detected: (ener[20])
[21:22:04]
[21:22:04] Simulation instability has been encountered. The run has entered a
[21:22:04] state from which no further progress can be made.
[21:22:04] This may be the correct result of the simulation, however if you
[21:22:04] often see other project units terminating early like this
[21:22:04] too, you may wish to check the stability of your computer (issues
[21:22:04] such as high temperature, overclocking, etc.).
[21:22:04] Going to send back what have done.
[21:22:04] logfile size: 56168
[21:22:04] - Writing 56718 bytes of core data to disk...
[21:22:04] ... Done.
[21:24:04]
[21:24:04] Folding@home Core Shutdown: EARLY_UNIT_END
[21:24:04]
[21:24:04] Folding@home Core Shutdown: EARLY_UNIT_END
[21:24:07] CoreStatus = 7B (123)
[21:24:07] Client-core communications error: ERROR 0x7b
[21:24:07] Deleting current work unit & continuing...
[21:24:07] Using generic mpiexec calls
[21:26:09] - Warning: Could not delete all work unit files (6): Core returned invalid code
[21:26:09] Trying to send all finished work units
[21:26:09] + No unsent completed units remaining.
[21:26:09] - Preparing to get new work unit...
[21:26:09] + Attempting to get work packet
[21:26:09] - Will indicate memory of 3070 MB
[21:26:09] - Connecting to assignment server
[21:26:09] Connecting to http://assign.stanford.edu:8080/
[21:26:10] Posted data.
[21:26:10] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[21:26:10] + News From Folding@Home: Welcome to Folding@Home
[21:26:10] Loaded queue successfully.
[21:26:10] Connecting to http://171.64.65.64:8080/
[21:26:15] Posted data.
[21:26:15] Initial: 0000; - Receiving payload (expected size: 4684476)
[21:26:41] - Downloaded at ~175 kB/s
[21:26:41] - Averaged speed for that direction ~292 kB/s
[21:26:41] + Received work.
[21:26:41] + Closed connections
[21:26:46]
[21:26:46] + Processing work unit
[21:26:46] Work type a1 not eligible for variable processors
[21:26:46] Core required: FahCore_a1.exe
[21:26:46] Core found.
[21:26:46] Using generic mpiexec calls
[21:26:46] Working on queue slot 07 [October 3 21:26:46 UTC]
[21:26:46] + Working ...
[21:26:46] - Calling 'mpiexec -np 4 -channel auto -host 127.0.0.1 FahCore_a1.exe -dir work/ -suffix 07 -checkpoint 30 -verbose -lifeline 5204 -version 622'
[21:26:46]
[21:26:46] *------------------------------*
[21:26:46] Folding@Home Gromacs SMP Core
[21:26:46] Version 1.74 (March 10, 2007)
[21:26:46]
[21:26:46] Preparing to commence simulation
[21:26:46] - Ensuring status. Please wait.
[21:26:53] - Starting from initial work packet
[21:26:53]
[21:26:53] Project: 2665 (Run 0, Clone 545, Gen 48)
[21:26:53]
[21:26:53] Assembly optimizations on if available.
[21:26:53] Entering M.D.
[21:27:13] al work packet
[21:27:13]
[21:27:13] Project: 2665 (Run 0, Clone 545, Gen 48)
[21:27:13]
[21:27:13] Entering M.D.
[21:27:24] ne 545, Gen 48)
[21:27:24]
[21:27:25] Entering M.D.
[21:27:31] Rejecting checkpoint
[21:27:34] Protein: HGG in water
[21:27:34] Writing local files
[21:27:47] Extra SSE boost OK.
[21:27:47] Writing local files
[21:27:48] Completed 0 out of 250000 steps (0 percent)
[21:52:39] Writing local files
[21:52:39] Completed 2500 out of 250000 steps (1 percent)
[22:17:31] Writing local files
[22:17:32] Completed 5000 out of 250000 steps (2 percent)
[22:23:38] - Autosending finished units... [October 3 22:23:38 UTC]
[22:23:38] Trying to send all finished work units
[22:23:38] + No unsent completed units remaining.
[22:23:38] - Autosend completed
[22:42:24] Writing local files
[22:42:25] Completed 7500 out of 250000 steps (3 percent)
[23:07:19] Writing local files
[23:07:19] Completed 10000 out of 250000 steps (4 percent)
[23:32:09] Writing local files
[23:32:09] Completed 12500 out of 250000 steps (5 percent)
[23:57:00] Writing local files
[23:57:00] Completed 15000 out of 250000 steps (6 percent)
[00:21:52] Writing local files
[00:21:52] Completed 17500 out of 250000 steps (7 percent)
[00:46:57] Writing local files
[00:46:57] Completed 20000 out of 250000 steps (8 percent)
[01:12:11] Writing local files
[01:12:11] Completed 22500 out of 250000 steps (9 percent)
[01:37:17] Writing local files
[01:37:18] Completed 25000 out of 250000 steps (10 percent)
[02:02:16] Writing local files
[02:02:16] Completed 27500 out of 250000 steps (11 percent)
...Still running at the moment... But notice the two prior runs of this same WU failing at the same spot above...