Project: 2665 (Run 0, Clone 50, Gen 6)

[Datsun 1600]

Just noticed this so posting log, not to worried as it wasted very little time.

Datsun 1600

Code: Select all

[09:11:09] Completed 500000 out of 500000 steps  (100 percent)
[09:11:09] Writing final coordinates.
[09:11:10] Past main M.D. loop
[09:11:10] Will end MPI now
[09:12:10] 
[09:12:10] Finished Work Unit:
[09:12:10] - Reading up to 3727488 from "work/wudata_01.arc": Read 3727488
[09:12:10] - Reading up to 1785388 from "work/wudata_01.xtc": Read 1785388
[09:12:10] goefile size: 0
[09:12:10] logfile size: 17309
[09:12:10] Leaving Run
[09:12:14] - Writing 5534585 bytes of core data to disk...
[09:12:14]   ... Done.
[09:12:14] - Failed to delete work/wudata_01.sas
[09:12:14] - Failed to delete work/wudata_01.goe
[09:12:14] Warning:  check for stray files
[09:12:14] - Shutting down core
[09:14:14] 
[09:14:14] Folding@home Core Shutdown: FINISHED_UNIT
[09:14:14] 
[09:14:14] Folding@home Core Shutdown: FINISHED_UNIT
[09:14:18] CoreStatus = 64 (100)
[09:14:18] Sending work to server


[09:14:18] + Attempting to send results
[09:17:29] + Results successfully sent
[09:17:29] Thank you for your contribution to Folding@Home.
[09:17:29] + Number of Units Completed: 236

[09:19:49] - Preparing to get new work unit...
[09:19:49] + Attempting to get work packet
[09:19:49] - Connecting to assignment server
[09:19:49] - Successful: assigned to (171.64.65.64).
[09:19:49] + News From Folding@Home: Welcome to Folding@Home
[09:19:50] Loaded queue successfully.
[09:20:51] + Closed connections
[09:20:51] 
[09:20:51] + Processing work unit
[09:20:51] Core required: FahCore_a1.exe
[09:20:51] Core found.
[09:20:51] Working on Unit 02 [June 30 09:20:51]
[09:20:51] + Working ...
[09:20:51] 
[09:20:51] *------------------------------*
[09:20:51] Folding@Home Gromacs SMP Core
[09:20:51] Version 1.74 (March 10, 2007)
[09:20:51] 
[09:20:51] Preparing to commence simulation
[09:20:51] - Ensuring status. Please wait.
[09:21:08] - Assembly optimizations manually forced on.
[09:21:08] - Not checking prior termination.
[09:21:22] - Expanded 4825542 -> 24426905 (decompressed 506.2 percent)
[09:21:22] - Starting from initial work packet
[09:21:22] 
[09:21:22] Project: 2665 (Run 0, Clone 50, Gen 6)
[09:21:22] 
[09:21:24] Assembly optimizations on if available.
[09:21:24] Entering M.D.
[09:21:30] Rejecting checkpoint
[09:21:32] NaN detected: x[11415][0]=5.19565 v[11415][0]=NaN
[09:21:32] utdown: BAD_CORE_FILES
[09:21:32] Finalizing output
[09:23:32] ES
[09:23:32] 
[09:23:32] Folding@home Core Shutdown: BAD_CORE_FILES
[09:23:32] aN
[09:23:32] 
[09:23:32] Folding@home Core Shutdown: BAD_CORE_FILES
[09:23:32] Finalizing output
[09:25:35] CoreStatus = 1 (1)
[09:25:35] Client-core communications error: ERROR 0x1
[09:25:35] Deleting current work unit & continuing...
[09:27:57] - Preparing to get new work unit...
[09:27:57] + Attempting to get work packet
[09:27:57] - Connecting to assignment server
[09:27:58] - Successful: assigned to (171.64.65.64).
[09:27:58] + News From Folding@Home: Welcome to Folding@Home
[09:27:58] Loaded queue successfully.
[09:29:07] + Closed connections
[09:29:12] 
[09:29:12] + Processing work unit
[09:29:12] Core required: FahCore_a1.exe
[09:29:12] Core found.
[09:29:12] Working on Unit 03 [June 30 09:29:12]
[09:29:12] + Working ...
[09:29:12] 
[09:29:12] *------------------------------*
[09:29:12] Folding@Home Gromacs SMP Core
[09:29:12] Version 1.74 (March 10, 2007)
[09:29:12] 
[09:29:12] Preparing to commence simulation
[09:29:12] - Ensuring status. Please wait.
[09:29:29] - Assembly optimizations manually forced on.
[09:29:29] - Not checking prior termination.
[09:29:43] - Expanded 4825542 -> 24426905 (decompressed 506.2 percent)
[09:29:43] - Starting from initial work packet
[09:29:43] 
[09:29:43] Project: 2665 (Run 0, Clone 50, Gen 6)
[09:29:43] 
[09:29:45] Assembly optimizations on if available.
[09:29:45] Entering M.D.
[09:29:51] Rejecting checkpoint
[09:29:53] NaN detected: x[11415][0]=5.19565 v[11415][0]=NaN
[09:29:53] utdown: BAD_CORE_FILES
[09:29:53] Finalizing output
[09:31:53] ES
[09:31:54] 
[09:31:54] Folding@home Core Shutdown: BAD_CORE_FILES
[09:31:54] aN
[09:31:54] 
[09:31:54] Folding@home Core Shutdown: BAD_CORE_FILES
[09:31:54] Finalizing output
[09:33:59] CoreStatus = 1 (1)
[09:33:59] Client-core communications error: ERROR 0x1
[09:33:59] Deleting current work unit & continuing...
[09:36:19] - Preparing to get new work unit...
[09:36:19] + Attempting to get work packet
[09:36:19] - Connecting to assignment server
[09:36:22] - Successful: assigned to (171.64.65.64).
[09:36:22] + News From Folding@Home: Welcome to Folding@Home
[09:36:22] Loaded queue successfully.
[09:37:17] + Closed connections
[09:37:22] 
[09:37:22] + Processing work unit
[09:37:22] Core required: FahCore_a1.exe
[09:37:22] Core found.
[09:37:22] Working on Unit 04 [June 30 09:37:22]
[09:37:22] + Working ...
[09:37:22] 
[09:37:22] *------------------------------*
[09:37:22] Folding@Home Gromacs SMP Core
[09:37:22] Version 1.74 (March 10, 2007)
[09:37:22] 
[09:37:22] Preparing to commence simulation
[09:37:22] - Ensuring status. Please wait.
[09:37:39] - Assembly optimizations manually forced on.
[09:37:39] - Not checking prior termination.
[09:37:53] - Expanded 4825542 -> 24426905 (decompressed 506.2 percent)
[09:37:53] - Starting from initial work packet
[09:37:53] 
[09:37:53] Project: 2665 (Run 0, Clone 50, Gen 6)
[09:37:53] 
[09:37:55] Assembly optimizations on if available.
[09:37:55] Entering M.D.
[09:38:01] Rejecting checkpoint
[09:38:03] NaN detected: x[11415][0]=5.19565 v[11415][0]=NaN
[09:38:03] utdown: BAD_CORE_FILES
[09:38:03] Finalizing output
[09:40:03] ES
[09:40:04] 
[09:40:04] Folding@home Core Shutdown: BAD_CORE_FILES
[09:40:04] aN
[09:40:04] 
[09:40:04] Folding@home Core Shutdown: BAD_CORE_FILES
[09:40:04] Finalizing output
[09:42:06] CoreStatus = 1 (1)
[09:42:06] Client-core communications error: ERROR 0x1
[09:42:06] - Attempting to download new core...
[09:42:06] + Downloading new core: FahCore_a1.exe
[09:42:07] + 10240 bytes downloaded

[09:42:17] + 789667 bytes downloaded
[09:42:17] Verifying core Core_a1.fah...
[09:42:17] Signature is VALID
[09:42:17] 
[09:42:17] Trying to unzip core FahCore_a1.exe
[09:42:18] Decompressed FahCore_a1.exe (2035712 bytes) successfully
[09:42:18] + Core successfully engaged
[09:42:18] Deleting current work unit & continuing...
[09:44:22] - Preparing to get new work unit...
[09:44:22] + Attempting to get work packet
[09:44:22] - Connecting to assignment server
[09:44:24] - Successful: assigned to (171.64.65.64).
[09:44:24] + News From Folding@Home: Welcome to Folding@Home
[09:44:24] Loaded queue successfully.
[09:44:27] - Error: Attempt #1  to get work failed, and no other work to do.
             Waiting before retry.
[09:44:35] + Attempting to get work packet
[09:44:35] - Connecting to assignment server
[09:44:39] - Successful: assigned to (171.64.65.64).
[09:44:39] + News From Folding@Home: Welcome to Folding@Home
[09:44:39] Loaded queue successfully.
[09:49:03] + Closed connections
[09:49:08] 
[09:49:08] + Processing work unit
[09:49:08] Core required: FahCore_a1.exe
[09:49:08] Core found.
[09:49:08] Working on Unit 05 [June 30 09:49:08]
[09:49:08] + Working ...
[09:49:09] 
[09:49:09] *------------------------------*
[09:49:09] Folding@Home Gromacs SMP Core
[09:49:09] Version 1.74 (March 10, 2007)
[09:49:09] 
[09:49:09] Preparing to commence simulation
[09:49:09] - Ensuring status. Please wait.
[09:49:26] - Assembly optimizations manually forced on.
[09:49:26] - Not checking prior termination.
[09:49:37] - Expanded 4734885 -> 24426905 (decompressed 515.8 percent)
[09:49:38] - Starting from initial work packet
[09:49:38] 
[09:49:38] Project: 2665 (Run 0, Clone 495, Gen 22)
[09:49:38] 
[09:49:41] Assembly optimizations on if available.
[09:49:41] Entering M.D.
[09:49:48] Rejecting checkpoint
[09:49:49] Protein: HGG in water
[09:49:49] Writing local files
[09:49:56] Extra SSE boost OK.
[09:49:56] Writing local files
[09:49:57] Completed 0 out of 250000 steps  (0 percent)
[10:06:03] Writing local files
[10:06:04] Completed 2500 out of 250000 steps  (1 percent)
[10:22:11] Writing local files
[10:22:12] Completed 5000 out of 250000 steps  (2 percent)
[10:38:18] Writing local files
[10:38:19] Completed 7500 out of 250000 steps  (3 percent)
[10:54:26] Writing local files
[10:54:26] Completed 10000 out of 250000 steps  (4 percent)
[11:10:34] Writing local files
[11:10:35] Completed 12500 out of 250000 steps  (5 percent)

[toTOW]

Wow it's the first time I see this error

[kasson]

This is a new one for me too. I would suspect either file corruption or hardware instability. Try deleting the FahCore_xx.exe files so the client will re-download them.

[bruce]

Wow it's the first time I see this error

"NaN detected" isn't really a new error -- the message is just worded differently.

@Datsun_1600:
It might be a FahCore file corruption, but downloading a fresh copy may cure that.

It might be a hardware error or a so-called "bad WU." The only way I know to know the difference is to see if somebody else finishes the WU when it is reassigned. At this time, nobody has returned the WU. Ask us about it in six days and we'll check again.

[Datsun 1600]

It downloaded a new core all by itself before it started on it's next WU, which it completed and is well into the next WU after that.

Yes it is an overclocked (E6750 2.66GHz @ 3.4GHZ) comp, but I usually run my comps 300MHz less than any other stability program that I try is rock solid at. I do get the odd EUE, but they always stop at the same frame, three consecutive times before downloading the next WU. I go away for weeks at a time and for me stability it utmost in importance, I don't like coming home to locked up comps.

To Kasson: When can we see the a2 client or am I going to have to jump on the Graphics Client and forget about the SMP Client (doing about 60 WUs here per week).

Datsun 1600

[craigmdq6700]

Just downloaded this core and got the same error - tried it again with my O/C turned off and same problem.

Error reads:
NaN detected: x[11415][0]=5.19565 v[11415][0]=NaN

After a couple minutes it says BAD_CORE_FILES twice and then client-core communications error : ERROR0x1
Deleting Work Unit & continuing.......

Then it tries to download the same core and shows the same error again.

Oh Well - will try deleting the xx files and getting a new unit - hate these 2665s anyway too slow

[toTOW]

No one was able to return that WU ...

[DocJonz]

One of my rigs pulled this one down ... then spat it out (I've saved the log this time )
I guess if no one has returned it successfully, someone should take a look ....

Code: Select all

[14:17:39] Writing local files
[14:17:39] Completed 237500 out of 250000 steps  (95 percent)
[14:39:44] Writing local files
[14:39:44] Completed 240000 out of 250000 steps  (96 percent)
[15:01:50] Writing local files
[15:01:50] Completed 242500 out of 250000 steps  (97 percent)
[15:23:56] Writing local files
[15:23:56] Completed 245000 out of 250000 steps  (98 percent)
[15:46:06] Writing local files
[15:46:06] Completed 247500 out of 250000 steps  (99 percent)
[16:08:22] Writing local files
[16:08:22] Completed 250000 out of 250000 steps  (100 percent)
[16:08:22] Writing final coordinates.
[16:08:24] Past main M.D. loop
[16:08:24] Will end MPI now
[16:09:24] 
[16:09:24] Finished Work Unit:
[16:09:24] - Reading up to 21310704 from "work/wudata_06.arc": Read 21310704
[16:09:24] - Reading up to 552624 from "work/wudata_06.xtc": Read 552624
[16:09:24] goefile size: 0
[16:09:24] logfile size: 203288
[16:09:24] Leaving Run
[16:09:27] - Writing 22072988 bytes of core data to disk...
[16:09:28]   ... Done.
[16:09:29] - Failed to delete work/wudata_06.sas
[16:09:29] - Failed to delete work/wudata_06.goe
[16:09:29] Warning:  check for stray files
[16:09:29] - Shutting down core
[16:11:29] 
[16:11:29] Folding@home Core Shutdown: FINISHED_UNIT
[16:11:29] 
[16:11:29] Folding@home Core Shutdown: FINISHED_UNIT
[16:11:33] CoreStatus = 64 (100)
[16:11:33] Sending work to server


[16:11:33] + Attempting to send results
[16:25:52] + Results successfully sent
[16:25:52] Thank you for your contribution to Folding@Home.
[16:25:52] + Number of Units Completed: 112

[16:28:13] - Preparing to get new work unit...
[16:28:13] + Attempting to get work packet
[16:28:13] - Connecting to assignment server
[16:28:13] - Successful: assigned to (171.64.65.64).
[16:28:13] + News From Folding@Home: Welcome to Folding@Home
[16:28:14] Loaded queue successfully.
[16:30:59] + Closed connections
[16:30:59] 
[16:30:59] + Processing work unit
[16:30:59] Core required: FahCore_a1.exe
[16:30:59] Core found.
[16:30:59] Working on Unit 07 [July 15 16:30:59]
[16:30:59] + Working ...
[16:31:00] 
[16:31:00] *------------------------------*
[16:31:00] Folding@Home Gromacs SMP Core
[16:31:00] Version 1.74 (March 10, 2007)
[16:31:00] 
[16:31:00] Preparing to commence simulation
[16:31:00] - Ensuring status. Please wait.
[16:31:17] - Assembly optimizations manually forced on.
[16:31:17] - Not checking prior termination.
[16:31:36] - Expanded 4825542 -> 24426905 (decompressed 506.2 percent)
[16:31:37] - Starting from initial work packet
[16:31:38] 
[16:31:38] Project: 2665 (Run 0, Clone 50, Gen 6)
[16:31:38] 
[16:31:38] lone 50, Gen 6)
[16:31:38] 
[16:31:39] tions on if available.
[16:31:39] Entering M.D.
[16:31:39] e.
[16:31:39] Entering M.D.
[16:31:46] int
[16:31:48] NaN detected: x[11415][0]=5.19565 v[11415][0]=NaN
[16:31:48] utdown: BAD_CORE_FILES
[16:31:48] Finalizing output
[16:33:48] ES
[16:33:48] 
[16:33:48] Folding@home Core Shutdown: BAD_CORE_FILES
[16:33:48] aN
[16:33:48]  v[12716][2]=NaN
[16:33:48] e Shutdown: BAD_CORE_FILES
[16:33:48] Finalizing output
[16:35:48] inalizing output
[16:35:52] CoreStatus = 1 (1)
[16:35:52] Client-core communications error: ERROR 0x1
[16:35:52] Deleting current work unit & continuing...
[16:38:12] - Preparing to get new work unit...
[16:38:12] + Attempting to get work packet
[16:38:12] - Connecting to assignment server
[16:38:13] - Successful: assigned to (171.64.65.64).
[16:38:13] + News From Folding@Home: Welcome to Folding@Home
[16:38:13] Loaded queue successfully.
[16:40:14] + Closed connections
[16:40:19] 
[16:40:19] + Processing work unit
[16:40:19] Core required: FahCore_a1.exe
[16:40:19] Core found.
[16:40:19] Working on Unit 08 [July 15 16:40:19]
[16:40:19] + Working ...
[16:40:20] 
[16:40:20] *------------------------------*
[16:40:20] Folding@Home Gromacs SMP Core
[16:40:20] Version 1.74 (March 10, 2007)
[16:40:20] 
[16:40:20] Preparing to commence simulation
[16:40:20] - Ensuring status. Please wait.
[16:40:37] - Assembly optimizations manually forced on.
[16:40:37] - Not checking prior termination.
[16:40:53] - Expanded 4825542 -> 24426905 (decompressed 506.2 percent)
[16:40:53] - Starting from initial work packet
[16:40:53] 
[16:40:53] Project: 2665 (Run 0, Clone 50, Gen 6)
[16:40:53] 
[16:40:56] Assembly optimizations on if available.
[16:40:56] Entering M.D.
[16:41:03] Rejecting checkpoint
[16:41:05] NaN detected: x[11415][0]=5.19565 v[11415][0]=NaN
[16:41:05] utdown: BAD_CORE_FILES
[16:41:05] Finalizing output
[16:43:05] ES
[16:43:05] 
[16:43:05] Folding@home Core Shutdown: BAD_CORE_FILES
[16:43:06] aN
[16:43:06] 
[16:43:06] Folding@home Core Shutdown: BAD_CORE_FILES
[16:43:06] Finalizing output

[jebo_4jc]

Also having the same issue with this wu. Tried to delete fahcore file, but no luck.

Code: Select all

[13:38:57] - Ask before connecting: No
[13:38:57] - User name: jebo_4jc (Team 77826)
[13:38:57] - User ID: 268411DD7433073B
[13:38:57] - Machine ID: 1
[13:38:57] 
[13:38:57] Work directory not found. Creating...
[13:38:57] Could not open work queue, generating new queue...
[13:38:57] - Preparing to get new work unit...
[13:38:57] + Attempting to get work packet
[13:38:57] - Connecting to assignment server
[13:38:57] - Successful: assigned to (171.64.65.64).
[13:38:57] + News From Folding@Home: Welcome to Folding@Home
[13:38:57] Loaded queue successfully.
[13:39:35] + Closed connections
[13:39:35] 
[13:39:35] + Processing work unit
[13:39:35] Core required: FahCore_a1.exe
[13:39:35] Core not found.
[13:39:35] - Core is not present or corrupted.
[13:39:35] - Attempting to download new core...
[13:39:35] + Downloading new core: FahCore_a1.exe
[13:39:36] + 10240 bytes downloaded

(snip)

[13:39:42] + 789667 bytes downloaded
[13:39:42] Verifying core Core_a1.fah...
[13:39:42] Signature is VALID
[13:39:42] 
[13:39:42] Trying to unzip core FahCore_a1.exe
[13:39:42] Decompressed FahCore_a1.exe (2035712 bytes) successfully
[13:39:42] + Core successfully engaged
[13:39:47] 
[13:39:47] + Processing work unit
[13:39:47] Core required: FahCore_a1.exe
[13:39:47] Core found.
[13:39:47] Working on Unit 01 [July 24 13:39:47]
[13:39:47] + Working ...
[13:39:48] 
[13:39:48] *------------------------------*
[13:39:48] Folding@Home Gromacs SMP Core
[13:39:48] Version 1.74 (March 10, 2007)
[13:39:48] 
[13:39:48] Preparing to commence simulation
[13:39:48] - Ensuring status. Please wait.
[13:39:55] - Starting from initial work packet
[13:39:55] 
[13:39:55] Project: 2665 (Run 0, Clone 50, Gen 6)
[13:39:55] 
[13:39:55] Assembly optimizations on if available.
[13:39:55] Entering M.D.
[13:40:21]  on if available.
[13:40:21] Entering M.D.
[13:40:29] Rejecting checkpoint
[13:40:31] ][0]=5.19565 v[11415][0]=NaN
[13:40:31] 
[13:40:31] Folding@home Core Shutdown: BAD_CORE_FILES
[13:40:31] Finalizing output
[13:42:31] NaN detected: x[12716][2]=8.56374 v[12716][2]=NaN
[13:42:31] 
[13:42:31] Folding@home Core Shutdown: BAD_CORE_FILES
[13:42:31] Finalizing output
[13:44:34] CoreStatus = 1 (1)
[13:44:34] Client-core communications error: ERROR 0x1
[13:44:34] Deleting current work unit & continuing...

[ChelseaOilman]

Same "Folding@home Core Shutdown: BAD_CORE_FILES" for me as well.

Code: Select all

[13:09:37] Working on Unit 05 [July 25 13:09:37]
[13:09:37] + Working ...
[13:09:37] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 05 -checkpoint 15 -forceasm -verbose -lifeline 5945 -version 601'

[13:09:38] 
[13:09:38] *------------------------------*
[13:09:38] Folding@Home Gromacs SMP Core
[13:09:38] Version 1.74 (November 27, 2006)
[13:09:38] 
[13:09:38] Preparing to commence simulation
[13:09:38] - Ensuring status. Please wait.
[13:09:55] - Assembly optimizations manually forced on.
[13:09:55] - Not checking prior termination.
[13:09:56] - Expanded 4825542 -> 24426905 (decompressed 506.2 percent)
[13:09:56] - Starting from initial work packet
[13:09:56] 
[13:09:56] Project: 2665 (Run 0, Clone 50, Gen 6)
[13:09:56] 
[13:09:56] Assembly optimizations on if available.
[13:09:56] Entering M.D.
[13:10:02] Rejecting checkpoint
[13:10:03] ][0]=5.19565 v[11415][0]=NaN
[13:10:03] Finalizing output
[13:10:03] NaN detected: x[12716][2]=8.56374 v[12716][2]=NaN
[13:10:08] CoreStatus = 71 (113)
[13:10:08] + Work unit files corrupt
[13:10:08] Possibly received incorrectly.
[13:10:08] Deleting current work unit & continuing...
[13:14:13] - Warning: Could not delete all work unit files (5): Core returned invalid code
[13:14:13] Trying to send all finished work units
[13:14:13] + No unsent completed units remaining.
[13:14:13] - Preparing to get new work unit...
[13:14:13] + Attempting to get work packet
[13:14:13] - Will indicate memory of 128 MB
[13:14:13] - Connecting to assignment server
[13:14:13] Connecting to http://assign.stanford.edu:8080/
[13:14:13] Posted data.
[13:14:13] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[13:14:13] + News From Folding@Home: Welcome to Folding@Home
[13:14:14] Loaded queue successfully.
[13:14:14] Connecting to http://171.64.65.64:8080/
[13:14:19] Posted data.
[13:14:19] Initial: 0000; - Receiving payload (expected size: 4826054)
[13:14:21] - Downloaded at ~2356 kB/s
[13:14:21] - Averaged speed for that direction ~1890 kB/s
[13:14:21] + Received work.
[13:14:21] + Closed connections
[13:14:26] 
[13:14:26] + Processing work unit
[13:14:26] Core required: FahCore_a1.exe
[13:14:26] Core found.
[13:14:26] Working on Unit 06 [July 25 13:14:26]
[13:14:26] + Working ...
[13:14:26] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 06 -checkpoint 15 -forceasm -verbose -lifeline 5945 -version 601'

[13:14:26] 
[13:14:26] *------------------------------*
[13:14:26] Folding@Home Gromacs SMP Core
[13:14:26] Version 1.74 (November 27, 2006)
[13:14:26] 
[13:14:26] Preparing to commence simulation
[13:14:26] - Ensuring status. Please wait.
[13:14:43] - Assembly optimizations manually forced on.
[13:14:43] - Not checking prior termination.
[13:14:44] - Expanded 4825542 -> 24426905 (decompressed 506.2 percent)
[13:14:44] - Starting from initial work packet
[13:14:44] 
[13:14:44] Project: 2665 (Run 0, Clone 50, Gen 6)
[13:14:44] 
[13:14:44] Assembly optimizations on if available.
[13:14:44] Entering M.D.
[13:14:51] Rejecting checkpoint
[13:14:52] NaN detected: x[11415][0]=5.19565 v[11415][0]=NaN
[13:14:52] 
[13:14:52] Folding@home Core Shutdown: BAD_CORE_FILES
[13:14:52] aN
[13:14:57] CoreStatus = 71 (113)
[13:14:57] + Work unit files corrupt
[13:14:57] Possibly received incorrectly.
[13:14:57] Deleting current work unit & continuing...
[13:19:02] - Warning: Could not delete all work unit files (6): Core returned invalid code
[13:19:02] Trying to send all finished work units
[13:19:02] + No unsent completed units remaining.