Project: 10632 NaNs detected

[kg4icg]

well here are some of the 10632 wu's that went wrong for me

Code: Select all

[09:06:09] + Processing work unit
[09:06:09] Core required: FahCore_15.exe
[09:06:09] Core found.
[09:06:09] Working on queue slot 02 [October 4 09:06:09 UTC]
[09:06:09] + Working ...
[09:06:09] 
[09:06:09] *------------------------------*
[09:06:09] Folding@Home GPU Core -- Beta
[09:06:09] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[09:06:09] 
[09:06:09] Build host: SimbiosNvdWin7
[09:06:09] Board Type: Nvidia
[09:06:09] Core      : 
[09:06:09] Preparing to commence simulation
[09:06:09] - Looking at optimizations...
[09:06:09] DeleteFrameFiles: successfully deleted file=work/wudata_02.ckp
[09:06:09] - Created dyn
[09:06:09] - Files status OK
[09:06:09] sizeof(CORE_PACKET_HDR) = 512 file=<>
[09:06:09] - Expanded 43867 -> 163067 (decompressed 371.7 percent)
[09:06:09] Called DecompressByteArray: compressed_data_size=43867 data_size=163067, decompressed_data_size=163067 diff=0
[09:06:09] - Digital signature verified
[09:06:09] 
[09:06:09] Project: 10632 (Run 22, Clone 73, Gen 37)
[09:06:09] 
[09:06:09] Assembly optimizations on if available.
[09:06:09] Entering M.D.
[09:06:15] Tpr hash work/wudata_02.tpr:  2820152622 229856728 1606910069 1299462813 2184962060
[09:06:15] Working on 582 p2750_N68H_AM03
[09:06:15] Client config found, loading data.
[09:06:15] Starting GUI Server
[09:07:07] Completed 1%
[09:08:00] Completed 2%
[09:08:52] Completed 3%
[09:09:45] Completed 4%
[09:10:38] Completed 5%
[09:11:30] Completed 6%
[09:12:22] Completed 7%
[09:13:14] Completed 8%
[09:14:05] Completed 9%
[09:14:57] Completed 10%
[09:15:50] Completed 11%
[09:16:43] Completed 12%
[09:17:35] Completed 13%
[09:18:28] Completed 14%
[09:19:21] Completed 15%
[09:20:13] Completed 16%
[09:21:05] Completed 17%
[09:21:57] Completed 18%
[09:22:50] Completed 19%
[09:23:42] Completed 20%
[09:24:35] Completed 21%
[09:25:27] Completed 22%
[09:26:19] Completed 23%
[09:27:11] Completed 24%
[09:28:04] Completed 25%
[09:28:56] Completed 26%
[09:29:49] Completed 27%
[09:30:42] Completed 28%
[09:31:34] Completed 29%
[09:32:26] Completed 30%
[09:33:18] Completed 31%
[09:34:10] Completed 32%
[09:35:03] Completed 33%
[09:35:55] Completed 34%
[09:36:47] Completed 35%
[09:37:40] Completed 36%
[09:38:32] Completed 37%
[09:39:25] Completed 38%
[09:40:16] Completed 39%
[09:41:09] Completed 40%
[09:42:01] Completed 41%
[09:42:53] Completed 42%
[09:43:45] Completed 43%
[09:44:38] Completed 44%
[09:45:30] Completed 45%
[09:46:22] Completed 46%
[09:47:15] Completed 47%
[09:48:08] Completed 48%
[09:49:00] Completed 49%
[09:49:53] Completed 50%
[09:50:45] Completed 51%
[09:51:38] Completed 52%
[09:52:30] Completed 53%
[09:53:22] Completed 54%
[09:54:14] Completed 55%
[09:55:06] Completed 56%
[09:55:58] Completed 57%
[09:55:58] mdrun_gpu returned 
[09:55:58] NANs detected on GPU
[09:55:58] 
[09:55:58] Folding@home Core Shutdown: UNSTABLE_MACHINE
[09:56:01] CoreStatus = 7A (122)
[09:56:01] Sending work to server
[09:56:01] Project: 10632 (Run 22, Clone 73, Gen 37)
[09:56:01] - Error: Could not get length of results file work/wuresults_02.dat
[09:56:01] - Error: Could not read unit 02 file. Removing from queue.
[09:56:01] - Preparing to get new work unit...

[kg4icg]

And currently this one has started going screwy on me.

Code: Select all

[23:28:30] + News From Folding@Home: Welcome to Folding@Home
[23:28:30] Loaded queue successfully.
[23:28:30] Gpu type=3 species=30.
[23:28:31] + Closed connections
[23:28:31] 
[23:28:31] + Processing work unit
[23:28:31] Core required: FahCore_15.exe
[23:28:31] Core found.
[23:28:31] Working on queue slot 03 [October 5 23:28:31 UTC]
[23:28:31] + Working ...
[23:28:31] 
[23:28:31] *------------------------------*
[23:28:31] Folding@Home GPU Core -- Beta
[23:28:31] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[23:28:31] 
[23:28:31] Build host: SimbiosNvdWin7
[23:28:31] Board Type: Nvidia
[23:28:31] Core      : 
[23:28:31] Preparing to commence simulation
[23:28:31] - Looking at optimizations...
[23:28:31] DeleteFrameFiles: successfully deleted file=work/wudata_03.ckp
[23:28:31] - Created dyn
[23:28:31] - Files status OK
[23:28:31] sizeof(CORE_PACKET_HDR) = 512 file=<>
[23:28:31] - Expanded 43867 -> 163067 (decompressed 371.7 percent)
[23:28:31] Called DecompressByteArray: compressed_data_size=43867 data_size=163067, decompressed_data_size=163067 diff=0
[23:28:31] - Digital signature verified
[23:28:31] 
[23:28:31] Project: 10632 (Run 22, Clone 73, Gen 37)
[23:28:31] 
[23:28:31] Assembly optimizations on if available.
[23:28:31] Entering M.D.
[23:28:37] Tpr hash work/wudata_03.tpr:  2820152622 229856728 1606910069 1299462813 2184962060
[23:28:37] Working on 582 p2750_N68H_AM03
[23:28:37] Client config found, loading data.
[23:28:37] Starting GUI Server
[23:29:29] Completed 1%
[23:30:22] Completed 2%
[23:31:14] Completed 3%
[23:32:07] Completed 4%
[23:32:59] Completed 5%
[23:33:51] Completed 6%
[23:34:44] Completed 7%
[23:35:36] Completed 8%
[23:36:29] Completed 9%
[23:37:21] Completed 10%
[23:38:13] Completed 11%
[23:39:06] Completed 12%
[23:39:58] Completed 13%
[23:40:50] Completed 14%
[23:41:43] Completed 15%
[23:42:36] Completed 16%
[23:43:29] Completed 17%
[23:44:21] Completed 18%
[23:45:13] Completed 19%
[23:46:06] Completed 20%
[23:46:58] Completed 21%
[23:47:51] Completed 22%
[23:48:43] Completed 23%
[23:49:36] Completed 24%
[23:50:28] Completed 25%
[23:51:21] Completed 26%
[23:52:14] Completed 27%
[23:53:07] Completed 28%
[23:53:59] Completed 29%
[23:54:52] Completed 30%
[23:55:44] Completed 31%
[23:56:37] Completed 32%
[23:57:30] Completed 33%
[23:58:22] Completed 34%
[23:59:15] Completed 35%
[00:00:07] Completed 36%
[00:01:00] Completed 37%
[00:01:52] Completed 38%
[00:02:44] Completed 39%
[00:03:37] Completed 40%
[00:04:29] Completed 41%
[00:05:22] Completed 42%
[00:06:15] Completed 43%
[00:07:07] Completed 44%
[00:07:59] Completed 45%
[00:08:52] Completed 46%
[00:09:44] Completed 47%
[00:10:37] Completed 48%
[00:11:29] Completed 49%
[00:12:22] Completed 50%
[00:13:15] Completed 51%
[00:14:07] Completed 52%
[00:15:00] Completed 53%
[00:15:52] Completed 54%
[00:16:44] Completed 55%
[00:17:37] Completed 56%
[00:18:29] Completed 57%
[00:19:22] Completed 58%
[00:20:14] Completed 59%
[00:21:07] Completed 60%
[00:22:00] Completed 61%
[00:22:52] Completed 62%
[00:23:45] Completed 63%
[00:24:37] Completed 64%
[00:25:30] Completed 65%
[00:26:22] Completed 66%
[00:27:15] Completed 67%
[00:28:07] Completed 68%
[00:29:00] Completed 69%
[00:29:52] Completed 70%
[00:30:44] Completed 71%
[00:31:37] Completed 72%
[00:32:30] Completed 73%
[00:33:22] Completed 74%
[00:34:14] Completed 75%
[00:35:07] Completed 76%
[00:35:59] Completed 77%
[00:36:52] Completed 78%
[00:37:44] Completed 79%
[00:38:36] Completed 80%
[00:39:29] Completed 81%
[00:40:22] Completed 82%
[00:41:14] Completed 83%
[00:42:08] Completed 84%
[00:43:00] Completed 85%
[00:43:52] Completed 86%
[00:44:45] Completed 87%
[00:45:37] Completed 88%
[00:46:30] Completed 89%
[00:47:22] Completed 90%
[00:48:16] Completed 91%
[00:49:08] Completed 92%
[00:50:00] Completed 93%
[00:50:52] Completed 94%
[00:51:44] Completed 95%
[00:52:37] Completed 96%
[00:53:30] Completed 97%
[00:54:22] Completed 98%
[00:55:15] Completed 99%
[00:56:08] Completed 100%
[00:56:08] Finished fah_main
[00:56:08] 
[00:56:08] Successful run
[00:56:08] DynamicWrapper: Finished Work Unit: sleep=10000
[00:56:18] Reserved 11384 bytes for xtc file; Cosm status=0
[00:56:18] Allocated 11384 bytes for xtc file
[00:56:18] - Reading up to 11384 from "work/wudata_03.xtc": Read 11384
[00:56:18] Read 11384 bytes from xtc file; available packet space=786419080
[00:56:18] xtc file hash check passed.
[00:56:18] Reserved 3621840 3621840 786419080 bytes for arc file=<work/wudata_03.trr> Cosm status=0
[00:56:18] Allocated 3621840 bytes for arc file
[00:56:18] - Reading up to 3621840 from "work/wudata_03.trr": Read 3621840
[00:56:18] Read 3621840 bytes from arc file; available packet space=782797240
[00:56:18] trr file hash check passed.
[00:56:18] Allocated 544 bytes for edr file
[00:56:18] Read bedfile
[00:56:18] edr file hash check passed.
[00:56:18] Allocated 497528 bytes for logfile
[00:56:18] Read logfile
[00:56:18] GuardedRun: success in DynamicWrapper
[00:56:18] GuardedRun: done
[00:56:18] Run: GuardedRun completed.
[00:56:21] + Opened results file
[00:56:21] - Writing 4131808 bytes of core data to disk...
[00:56:22] Done: 4131296 -> 3245045 (compressed to 78.5 percent)
[00:56:22]   ... Done.
[00:56:22] DeleteFrameFiles: successfully deleted file=work/wudata_03.ckp
[00:56:22] Shutting down core 
[00:56:22] 
[00:56:22] Folding@home Core Shutdown: FINISHED_UNIT
[00:56:25] CoreStatus = 64 (100)
[00:56:25] Sending work to server
[00:56:25] Project: 10632 (Run 22, Clone 73, Gen 37)


[00:56:25] + Attempting to send results [October 6 00:56:25 UTC]
[00:56:25] Gpu type=3 species=30.
[00:56:47] + Results successfully sent
[00:56:47] Thank you for your contribution to Folding@Home.
[00:56:47] + Number of Units Completed: 21

[00:56:52] - Preparing to get new work unit...
[00:56:52] Cleaning up work directory
[00:56:52] + Attempting to get work packet
[00:56:52] Passkey found
[00:56:52] Gpu type=3 species=30.
[00:56:52] - Connecting to assignment server
[00:56:53] - Successful: assigned to (171.67.108.20).
[00:56:53] + News From Folding@Home: Welcome to Folding@Home
[00:56:53] Loaded queue successfully.
[00:56:53] Gpu type=3 species=30.
[00:56:54] + Closed connections
[00:56:54] 
[00:56:54] + Processing work unit
[00:56:54] Core required: FahCore_15.exe
[00:56:54] Core found.
[00:56:54] Working on queue slot 04 [October 6 00:56:54 UTC]
[00:56:54] + Working ...
[00:56:54] 
[00:56:54] *------------------------------*
[00:56:54] Folding@Home GPU Core -- Beta
[00:56:54] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[00:56:54] 
[00:56:54] Build host: SimbiosNvdWin7
[00:56:54] Board Type: Nvidia
[00:56:54] Core      : 
[00:56:54] Preparing to commence simulation
[00:56:54] - Looking at optimizations...
[00:56:54] DeleteFrameFiles: successfully deleted file=work/wudata_04.ckp
[00:56:54] - Created dyn
[00:56:54] - Files status OK
[00:56:54] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:56:54] - Expanded 43834 -> 163067 (decompressed 372.0 percent)
[00:56:54] Called DecompressByteArray: compressed_data_size=43834 data_size=163067, decompressed_data_size=163067 diff=0
[00:56:54] - Digital signature verified
[00:56:54] 
[00:56:54] Project: 10632 (Run 95, Clone 85, Gen 20)
[00:56:54] 
[00:56:54] Assembly optimizations on if available.
[00:56:54] Entering M.D.
[00:57:00] Tpr hash work/wudata_04.tpr:  2707253262 2954419434 1685696532 2247247917 2631148219
[00:57:00] Working on 582 p2750_N68H_AM03
[00:57:00] Client config found, loading data.
[00:57:00] Starting GUI Server
[00:57:53] Completed 1%
[00:58:45] Completed 2%
[00:59:37] Completed 3%
[01:00:30] Completed 4%
[01:01:23] Completed 5%
[01:02:15] Completed 6%
[01:03:08] Completed 7%
[01:04:00] Completed 8%
[01:04:53] Completed 9%
[01:05:46] Completed 10%
[01:06:38] Completed 11%
[01:07:30] Completed 12%
[01:08:22] Completed 13%
[01:09:15] Completed 14%
[01:10:08] Completed 15%
[01:11:01] Completed 16%
[01:11:53] Completed 17%
[01:12:46] Completed 18%
[01:13:38] Completed 19%
[01:14:31] Completed 20%
[01:15:23] Completed 21%
[01:16:15] Completed 22%
[01:17:08] Completed 23%
[01:18:00] Completed 24%
[01:18:53] Completed 25%
[01:19:45] Completed 26%
[01:20:38] Completed 27%
[01:21:30] Completed 28%
[01:22:23] Completed 29%
[01:23:16] Completed 30%
[01:24:08] Completed 31%
[01:25:01] Completed 32%
[01:25:53] Completed 33%
[01:26:45] Completed 34%
[01:27:37] Completed 35%
[01:28:30] Completed 36%
[01:29:23] Completed 37%
[01:30:15] Completed 38%
[01:31:07] Completed 39%
[01:32:00] Completed 40%
[01:32:52] Completed 41%
[01:33:45] Completed 42%
[01:34:37] Completed 43%
[01:35:29] Completed 44%
[01:36:22] Completed 45%
[01:37:14] Completed 46%
[01:38:07] Completed 47%
[01:38:59] Completed 48%
[01:39:51] Completed 49%
[01:40:44] Completed 50%
[01:41:36] Completed 51%
[01:42:29] Completed 52%
[01:43:21] Completed 53%
[01:44:14] Completed 54%
[01:45:06] Completed 55%
[01:45:58] Completed 56%
[01:46:51] Completed 57%
[01:47:44] Completed 58%
[01:48:37] Completed 59%
[01:49:30] Completed 60%
[01:50:22] Completed 61%
[01:51:15] Completed 62%
[01:52:07] Completed 63%
[01:53:00] Completed 64%
[01:53:52] Completed 65%
[01:54:44] Completed 66%
[01:55:37] Completed 67%
[01:56:30] Completed 68%
[01:57:22] Completed 69%
[01:58:15] Completed 70%
[01:59:08] Completed 71%
[02:00:00] Completed 72%
[02:00:53] Completed 73%
[02:01:45] Completed 74%
[02:02:37] Completed 75%
[02:03:29] Completed 76%
[02:04:22] Completed 77%
[02:05:14] Completed 78%
[02:06:07] Completed 79%
[02:06:59] Completed 80%
[02:07:51] Completed 81%
[02:08:44] Completed 82%
[02:09:36] Completed 83%
[02:10:29] Completed 84%
[02:11:21] Completed 85%
[02:12:14] Completed 86%
[02:13:06] Completed 87%
[02:13:59] Completed 88%
[02:14:52] Completed 89%
[02:15:45] Completed 90%
[02:16:38] Completed 91%
[02:17:30] Completed 92%
[02:18:22] Completed 93%
[02:19:15] Completed 94%
[02:20:07] Completed 95%
[02:20:59] Completed 96%
[02:21:52] Completed 97%
[02:22:44] Completed 98%
[02:23:37] Completed 99%
[02:24:29] Completed 100%
[02:24:29] Finished fah_main
[02:24:29] 
[02:24:29] Successful run
[02:24:29] DynamicWrapper: Finished Work Unit: sleep=10000
[02:24:39] Reserved 11388 bytes for xtc file; Cosm status=0
[02:24:39] Allocated 11388 bytes for xtc file
[02:24:39] - Reading up to 11388 from "work/wudata_04.xtc": Read 11388
[02:24:39] Read 11388 bytes from xtc file; available packet space=786419076
[02:24:39] xtc file hash check passed.
[02:24:39] Reserved 3621840 3621840 786419076 bytes for arc file=<work/wudata_04.trr> Cosm status=0
[02:24:39] Allocated 3621840 bytes for arc file
[02:24:39] - Reading up to 3621840 from "work/wudata_04.trr": Read 3621840
[02:24:39] Read 3621840 bytes from arc file; available packet space=782797236
[02:24:39] trr file hash check passed.
[02:24:39] Allocated 544 bytes for edr file
[02:24:39] Read bedfile
[02:24:39] edr file hash check passed.
[02:24:39] Allocated 497527 bytes for logfile
[02:24:39] Read logfile
[02:24:39] GuardedRun: success in DynamicWrapper
[02:24:39] GuardedRun: done
[02:24:39] Run: GuardedRun completed.
[02:24:44] + Opened results file
[02:24:44] - Writing 4131811 bytes of core data to disk...
[02:24:45] Done: 4131299 -> 3233220 (compressed to 78.2 percent)
[02:24:45]   ... Done.
[02:24:45] DeleteFrameFiles: successfully deleted file=work/wudata_04.ckp
[02:24:46] Shutting down core 
[02:24:46] 
[02:24:46] Folding@home Core Shutdown: FINISHED_UNIT
[02:24:49] CoreStatus = 64 (100)
[02:24:49] Sending work to server
[02:24:49] Project: 10632 (Run 95, Clone 85, Gen 20)


[02:24:49] + Attempting to send results [October 6 02:24:49 UTC]
[02:24:49] Gpu type=3 species=30.
[02:25:11] + Results successfully sent
[02:25:11] Thank you for your contribution to Folding@Home.
[02:25:11] + Number of Units Completed: 22

[02:25:15] - Preparing to get new work unit...
[02:25:15] Cleaning up work directory
[02:25:15] + Attempting to get work packet
[02:25:15] Passkey found
[02:25:15] Gpu type=3 species=30.
[02:25:15] - Connecting to assignment server
[02:25:16] - Successful: assigned to (171.67.108.20).
[02:25:16] + News From Folding@Home: Welcome to Folding@Home
[02:25:16] Loaded queue successfully.
[02:25:16] Gpu type=3 species=30.
[02:25:17] + Closed connections
[02:25:17] 
[02:25:17] + Processing work unit
[02:25:17] Core required: FahCore_15.exe
[02:25:17] Core found.
[02:25:17] Working on queue slot 05 [October 6 02:25:17 UTC]
[02:25:17] + Working ...
[02:25:17] 
[02:25:17] *------------------------------*
[02:25:17] Folding@Home GPU Core -- Beta
[02:25:17] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[02:25:17] 
[02:25:17] Build host: SimbiosNvdWin7
[02:25:17] Board Type: Nvidia
[02:25:17] Core      : 
[02:25:17] Preparing to commence simulation
[02:25:17] - Looking at optimizations...
[02:25:17] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[02:25:17] - Created dyn
[02:25:17] - Files status OK
[02:25:17] sizeof(CORE_PACKET_HDR) = 512 file=<>
[02:25:17] - Expanded 43807 -> 163067 (decompressed 372.2 percent)
[02:25:17] Called DecompressByteArray: compressed_data_size=43807 data_size=163067, decompressed_data_size=163067 diff=0
[02:25:17] - Digital signature verified
[02:25:17] 
[02:25:17] Project: 10632 (Run 98, Clone 88, Gen 2)
[02:25:17] 
[02:25:17] Assembly optimizations on if available.
[02:25:17] Entering M.D.
[02:25:23] Tpr hash work/wudata_05.tpr:  2874344414 125532616 1810127382 1142773392 180547365
[02:25:23] Working on 582 p2750_N68H_AM03
[02:25:23] Client config found, loading data.
[02:25:23] Starting GUI Server
[02:26:15] Completed 1%
[02:27:08] Completed 2%
[02:28:00] Completed 3%
[02:28:53] Completed 4%
[02:29:45] Completed 5%
[02:30:38] Completed 6%
[02:31:30] Completed 7%
[02:32:23] Completed 8%
[02:33:15] Completed 9%
[02:34:07] Completed 10%
[02:35:00] Completed 11%
[02:35:53] Completed 12%
[02:36:46] Completed 13%
[02:37:39] Completed 14%
[02:38:31] Completed 15%
[02:39:24] Completed 16%
[02:40:17] Completed 17%
[02:41:10] Completed 18%
[02:42:02] Completed 19%
[02:42:54] Completed 20%
[02:43:47] Completed 21%
[02:44:40] Completed 22%
[02:45:32] Completed 23%
[02:46:25] Completed 24%
[02:47:17] Completed 25%
[02:48:10] Completed 26%
[02:49:03] Completed 27%
[02:49:55] Completed 28%
[02:50:47] Completed 29%
[02:51:40] Completed 30%
[02:52:32] Completed 31%
[02:53:24] Completed 32%
[02:54:16] Completed 33%
[02:55:09] Completed 34%
[02:56:01] Completed 35%
[02:56:54] Completed 36%
[02:57:47] Completed 37%
[02:58:39] Completed 38%
[02:59:31] Completed 39%
[03:00:24] Completed 40%
[03:01:17] Completed 41%
[03:02:09] Completed 42%
[03:03:02] Completed 43%
[03:03:54] Completed 44%
[03:04:47] Completed 45%
[03:05:40] Completed 46%
[03:06:33] Completed 47%
[03:07:25] Completed 48%
[03:08:17] Completed 49%
[03:09:10] Completed 50%
[03:10:02] Completed 51%
[03:10:55] Completed 52%
[03:11:47] Completed 53%
[03:12:40] Completed 54%
[03:13:33] Completed 55%
[03:14:25] Completed 56%
[03:15:17] Completed 57%
[03:16:10] Completed 58%
[03:17:03] Completed 59%
[03:17:55] Completed 60%
[03:18:47] Completed 61%
[03:19:40] Completed 62%
[03:20:32] Completed 63%
[03:21:25] Completed 64%
[03:22:18] Completed 65%
[03:23:10] Completed 66%
[03:23:22] + Working...
[03:24:03] Completed 67%
[03:24:56] Completed 68%
[03:25:48] Completed 69%
[03:26:41] Completed 70%
[03:27:33] Completed 71%
[03:28:26] Completed 72%
[03:29:18] Completed 73%
[03:30:11] Completed 74%
[03:31:03] Completed 75%
[03:31:56] Completed 76%
[03:32:48] Completed 77%
[03:33:40] Completed 78%
[03:34:33] Completed 79%
[03:35:25] Completed 80%
[03:36:18] Completed 81%
[03:37:10] Completed 82%
[03:38:02] Completed 83%
[03:38:55] Completed 84%
[03:39:47] Completed 85%
[03:40:39] Completed 86%
[03:41:31] Completed 87%
[03:42:24] Completed 88%
[03:43:16] Completed 89%
[03:44:09] Completed 90%
[03:45:02] Completed 91%
[03:45:54] Completed 92%
[03:46:47] Completed 93%
[03:47:40] Completed 94%
[03:48:32] Completed 95%
[03:49:24] Completed 96%
[03:50:17] Completed 97%
[03:51:09] Completed 98%
[03:52:02] Completed 99%
[03:52:55] Completed 100%
[03:52:55] Finished fah_main
[03:52:55] 
[03:52:55] Successful run
[03:52:55] DynamicWrapper: Finished Work Unit: sleep=10000
[03:53:05] Reserved 11408 bytes for xtc file; Cosm status=0
[03:53:05] Allocated 11408 bytes for xtc file
[03:53:05] - Reading up to 11408 from "work/wudata_05.xtc": Read 11408
[03:53:05] Read 11408 bytes from xtc file; available packet space=786419056
[03:53:05] xtc file hash check passed.
[03:53:05] Reserved 3621840 3621840 786419056 bytes for arc file=<work/wudata_05.trr> Cosm status=0
[03:53:05] Allocated 3621840 bytes for arc file
[03:53:05] - Reading up to 3621840 from "work/wudata_05.trr": Read 3621840
[03:53:05] Read 3621840 bytes from arc file; available packet space=782797216
[03:53:05] trr file hash check passed.
[03:53:05] Allocated 544 bytes for edr file
[03:53:05] Read bedfile
[03:53:05] edr file hash check passed.
[03:53:05] Allocated 492527 bytes for logfile
[03:53:05] Read logfile
[03:53:05] GuardedRun: success in DynamicWrapper
[03:53:05] GuardedRun: done
[03:53:05] Run: GuardedRun completed.
[03:53:07] + Opened results file
[03:53:07] - Writing 4126831 bytes of core data to disk...
[03:53:08] Done: 4126319 -> 3216649 (compressed to 77.9 percent)
[03:53:08]   ... Done.
[03:53:08] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[03:53:08] Shutting down core 
[03:53:08] 
[03:53:08] Folding@home Core Shutdown: FINISHED_UNIT
[03:53:11] CoreStatus = 64 (100)
[03:53:11] Sending work to server
[03:53:11] Project: 10632 (Run 98, Clone 88, Gen 2)


[03:53:11] + Attempting to send results [October 6 03:53:11 UTC]
[03:53:11] Gpu type=3 species=30.
[03:53:33] + Results successfully sent
[03:53:33] Thank you for your contribution to Folding@Home.
[03:53:33] + Number of Units Completed: 23

[03:53:38] - Preparing to get new work unit...
[03:53:38] Cleaning up work directory
[03:53:38] + Attempting to get work packet
[03:53:38] Passkey found
[03:53:38] Gpu type=3 species=30.
[03:53:38] - Connecting to assignment server
[03:53:39] - Successful: assigned to (171.67.108.20).
[03:53:39] + News From Folding@Home: Welcome to Folding@Home
[03:53:39] Loaded queue successfully.
[03:53:39] Gpu type=3 species=30.
[03:53:40] + Closed connections
[03:53:40] 
[03:53:40] + Processing work unit
[03:53:40] Core required: FahCore_15.exe
[03:53:40] Core found.
[03:53:40] Working on queue slot 06 [October 6 03:53:40 UTC]
[03:53:40] + Working ...
[03:53:40] 
[03:53:40] *------------------------------*
[03:53:40] Folding@Home GPU Core -- Beta
[03:53:40] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[03:53:40] 
[03:53:40] Build host: SimbiosNvdWin7
[03:53:40] Board Type: Nvidia
[03:53:40] Core      : 
[03:53:40] Preparing to commence simulation
[03:53:40] - Looking at optimizations...
[03:53:40] DeleteFrameFiles: successfully deleted file=work/wudata_06.ckp
[03:53:40] - Created dyn
[03:53:40] - Files status OK
[03:53:40] sizeof(CORE_PACKET_HDR) = 512 file=<>
[03:53:40] - Expanded 43727 -> 163067 (decompressed 372.9 percent)
[03:53:40] Called DecompressByteArray: compressed_data_size=43727 data_size=163067, decompressed_data_size=163067 diff=0
[03:53:40] - Digital signature verified
[03:53:40] 
[03:53:40] Project: 10632 (Run 44, Clone 83, Gen 16)
[03:53:40] 
[03:53:40] Assembly optimizations on if available.
[03:53:40] Entering M.D.
[03:53:46] Tpr hash work/wudata_06.tpr:  1504491601 4137337591 1091143014 2732174843 2270474420
[03:53:46] Working on 582 p2750_N68H_AM03
[03:53:46] Client config found, loading data.
[03:53:46] Starting GUI Server
[03:54:38] Completed 1%
[03:54:38] mdrun_gpu returned 
[03:54:38] NANs detected on GPU
[03:54:38] 
[03:54:38] Folding@home Core Shutdown: UNSTABLE_MACHINE
[03:54:42] CoreStatus = 7A (122)
[03:54:42] Sending work to server
[03:54:42] Project: 10632 (Run 44, Clone 83, Gen 16)
[03:54:42] - Error: Could not get length of results file work/wuresults_06.dat
[03:54:42] - Error: Could not read unit 06 file. Removing from queue.
[03:54:42] - Preparing to get new work unit...
[03:54:42] Cleaning up work directory
[03:54:42] + Attempting to get work packet
[03:54:42] Passkey found
[03:54:42] Gpu type=3 species=30.
[03:54:42] - Connecting to assignment server
[03:54:42] - Successful: assigned to (171.67.108.20).
[03:54:42] + News From Folding@Home: Welcome to Folding@Home
[03:54:43] Loaded queue successfully.
[03:54:43] Gpu type=3 species=30.
[03:54:43] + Closed connections
[03:54:48] 
[03:54:48] + Processing work unit
[03:54:48] Core required: FahCore_15.exe
[03:54:48] Core found.
[03:54:48] Working on queue slot 07 [October 6 03:54:48 UTC]
[03:54:48] + Working ...
[03:54:49] 
[03:54:49] *------------------------------*
[03:54:49] Folding@Home GPU Core -- Beta
[03:54:49] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[03:54:49] 
[03:54:49] Build host: SimbiosNvdWin7
[03:54:49] Board Type: Nvidia
[03:54:49] Core      : 
[03:54:49] Preparing to commence simulation
[03:54:49] - Looking at optimizations...
[03:54:49] DeleteFrameFiles: successfully deleted file=work/wudata_07.ckp
[03:54:49] - Created dyn
[03:54:49] - Files status OK
[03:54:49] sizeof(CORE_PACKET_HDR) = 512 file=<>
[03:54:49] - Expanded 43727 -> 163067 (decompressed 372.9 percent)
[03:54:49] Called DecompressByteArray: compressed_data_size=43727 data_size=163067, decompressed_data_size=163067 diff=0
[03:54:49] - Digital signature verified
[03:54:49] 
[03:54:49] Project: 10632 (Run 44, Clone 83, Gen 16)
[03:54:49] 
[03:54:49] Assembly optimizations on if available.
[03:54:49] Entering M.D.
[03:54:55] Tpr hash work/wudata_07.tpr:  1504491601 4137337591 1091143014 2732174843 2270474420
[03:54:55] Working on 582 p2750_N68H_AM03
[03:54:55] Client config found, loading data.
[03:54:55] Starting GUI Server
[03:55:48] Completed 1%
[03:56:40] Completed 2%
[03:57:34] Completed 3%
[03:58:27] Completed 4%
[03:59:19] Completed 5%
[04:00:13] Completed 6%
[04:01:06] Completed 7%
[04:02:00] Completed 8%
[04:02:53] Completed 9%
[04:03:45] Completed 10%
[04:04:38] Completed 11%
[04:05:30] Completed 12%
[04:06:23] Completed 13%
[04:07:16] Completed 14%
[04:08:09] Completed 15%
[04:09:02] Completed 16%
[04:09:55] Completed 17%
[04:10:48] Completed 18%
[04:11:42] Completed 19%
[04:12:34] Completed 20%
[04:13:27] Completed 21%
[04:14:20] Completed 22%
[04:15:12] Completed 23%
[04:16:04] Completed 24%
[04:16:04] mdrun_gpu returned 
[04:16:04] NANs detected on GPU
[04:16:04] 
[04:16:04] Folding@home Core Shutdown: UNSTABLE_MACHINE
[04:16:07] CoreStatus = 7A (122)
[04:16:07] Sending work to server
[04:16:07] Project: 10632 (Run 44, Clone 83, Gen 16)
[04:16:07] - Error: Could not get length of results file work/wuresults_07.dat
[04:16:07] - Error: Could not read unit 07 file. Removing from queue.
[04:16:07] - Preparing to get new work unit...
[04:16:07] Cleaning up work directory

and you can see from the previous 10632's they are running but some are causing trouble.

[kg4icg]

The spikes in the gpu usage in the evga precision display are being caused by the 10632 wu's when they are running. The 11000, and the 10900 series wu's do not cause this.

[sortofageek]

well here are some of the 10632 wu's that went wrong for me

Project: 10632 (Run 22, Clone 73, Gen 37) (second try finished)
I don't see results for you, unless your folding name is different than your forum name?)

One other folder completed successfully for full credit.

Project: 10632 (Run 95, Clone 85, Gen 20)
One folder with yet a different user name completed this one successfully.

Project: 10632 (Run 98, Clone 88, Gen 2)
This one was completed successfully by another folder.

Project: 10632 (Run 44, Clone 83, Gen 16)
[03:54:38] Folding@home Core Shutdown: UNSTABLE_MACHINE
[03:54:42] CoreStatus = 7A (122)
Completed successfully by another folder.

Project: 10632 (Run 44, Clone 83, Gen 16)
[04:16:04] Folding@home Core Shutdown: UNSTABLE_MACHINE
[04:16:07] CoreStatus = 7A (122)
Completed successfully by another folder.

All of these folders have unique names, none of them the same as each other and none the same as your member name.

[Flathead74]

Your first log shows that Project: 10632 (Run 22, Clone 73, Gen 37) failed at 57%, with a "NANs detected on GPU" error.

Your second log shows that you completed the very same WU, Project: 10632 (Run 22, Clone 73, Gen 37),
and that the results were successfully uploaded.

However, your system then had another failure.

This behavior seems to be hardware related on your end.

While other WUs will run at high(er) overclocks, this project does not seem favorable to the same.
69°C seems a tad warm for this card; Perhaps manually increasing the fan speed to 70% would help.

Code: Select all

[09:06:09] Project: 10632 (Run 22, Clone 73, Gen 37)
[09:06:09]
[09:06:09] Assembly optimizations on if available.
[09:06:09] Entering M.D.
[09:06:15] Tpr hash work/wudata_02.tpr:  2820152622 229856728 1606910069 1299462813 2184962060
[09:06:15] Working on 582 p2750_N68H_AM03
[09:06:15] Client config found, loading data.
[09:06:15] Starting GUI Server
[09:07:07] Completed 1%

--snip---

[09:55:58] Completed 57%
[09:55:58] mdrun_gpu returned
[09:55:58] NANs detected on GPU
[09:55:58]
[09:55:58] Folding@home Core Shutdown: UNSTABLE_MACHINE
[09:56:01] CoreStatus = 7A (122)

Code: Select all

[00:56:08] Completed 100%
[00:56:08] Finished fah_main
[00:56:08]
[00:56:08] Successful run
[00:56:08] DynamicWrapper: Finished Work Unit: sleep=10000
[00:56:18] Reserved 11384 bytes for xtc file; Cosm status=0
[00:56:18] Allocated 11384 bytes for xtc file
[00:56:18] - Reading up to 11384 from "work/wudata_03.xtc": Read 11384
[00:56:18] Read 11384 bytes from xtc file; available packet space=786419080
[00:56:18] xtc file hash check passed.
[00:56:18] Reserved 3621840 3621840 786419080 bytes for arc file=<work/wudata_03.trr> Cosm status=0
[00:56:18] Allocated 3621840 bytes for arc file
[00:56:18] - Reading up to 3621840 from "work/wudata_03.trr": Read 3621840
[00:56:18] Read 3621840 bytes from arc file; available packet space=782797240
[00:56:18] trr file hash check passed.
[00:56:18] Allocated 544 bytes for edr file
[00:56:18] Read bedfile
[00:56:18] edr file hash check passed.
[00:56:18] Allocated 497528 bytes for logfile
[00:56:18] Read logfile
[00:56:18] GuardedRun: success in DynamicWrapper
[00:56:18] GuardedRun: done
[00:56:18] Run: GuardedRun completed.
[00:56:21] + Opened results file
[00:56:21] - Writing 4131808 bytes of core data to disk...
[00:56:22] Done: 4131296 -> 3245045 (compressed to 78.5 percent)
[00:56:22]   ... Done.
[00:56:22] DeleteFrameFiles: successfully deleted file=work/wudata_03.ckp
[00:56:22] Shutting down core
[00:56:22]
[00:56:22] Folding@home Core Shutdown: FINISHED_UNIT
[00:56:25] CoreStatus = 64 (100)
[00:56:25] Sending work to server
[00:56:25] Project: 10632 (Run 22, Clone 73, Gen 37)

[03:53:11] + Attempting to send results [October 6 03:53:11 UTC]
[03:53:11] Gpu type=3 species=30.
[03:53:33] + Results successfully sent
[03:53:33] Thank you for your contribution to Folding@Home.
[03:53:33] + Number of Units Completed: 23

[kg4icg]

What you are not seeing is that every last 10632 that I have folded is causing a spike on my gpu usage every 15 to 17 seconds, while the other openmmgpu wu's are not. I know my temps aren't at issue becuase I haven't even gone over 71'C on my vid card while folding. I only fold under my nick of kg4icg. 71'C under full load is normal for this card and other 460 GTXs', by the way, the fan is on automatic in which it would increase it speed if needed for additional cooling.

[PantherX]

The spiking or fluctuation of the GPU Usage isn't an issue. It was observed with some GPU2 Projects and can be considered normal for GPU3 Projects too unless a PG Member says otherwise.

[Flathead74]

What you are not seeing is that every last 10632 that I have folded is causing a spike on my gpu usage every 15 to 17 seconds, while the other openmmgpu wu's are not. I know my temps aren't at issue becuase I haven't even gone over 71'C on my vid card while folding. I only fold under my nick of kg4icg. 71'C under full load is normal for this card and other 460 GTXs', by the way, the fan is on automatic in which it would increase it speed if needed for additional cooling.

Maybe your high(er) temperatures are due to ambient (room) temperature?

I'm not trying to argue with you.

I also fold with a GTX 460. It runs all WUs while being overclocked to 910/1820/1900 (C/S/M)
I run the fan at 70% and the temperatures do not exceed 50°C.
Room temp right now is 25.5°C/78°F, and the 460 is running at 47°C.

I have never seen temps at 70°C on my GTX 460, even on much warmer days during the summer. (35°C/95°F)

I was just trying to help, but I guess you know more about it than I do.

Good luck.

[Nathan_P]

What you are not seeing is that every last 10632 that I have folded is causing a spike on my gpu usage every 15 to 17 seconds, while the other openmmgpu wu's are not. I know my temps aren't at issue becuase I haven't even gone over 71'C on my vid card while folding. I only fold under my nick of kg4icg. 71'C under full load is normal for this card and other 460 GTXs', by the way, the fan is on automatic in which it would increase it speed if needed for additional cooling.

Maybe your high(er) temperatures are due to ambient (room) temperature?

I'm not trying to argue with you.

I also fold with a GTX 460. It runs all WUs while being overclocked to 910/1820/1900 (C/S/M)
I run the fan at 70% and the temperatures do not exceed 50°C.
Room temp right now is 25.5°C/78°F, and the 460 is running at 47°C.

I have never seen temps at 70°C on my GTX 460, even on much warmer days during the summer. (35°C/95°F)

I was just trying to help, but I guess you know more about it than I do.

Good luck.

I've currently got my 460 running at 69deg C and have had it up to 77, i've not had a problem so far with temps but i have noticed this. THe 611pointers drive the card hotter than other units, it may be the case that this, in conjucntion with the very high over clock is causing an issue. Try pulling the overclock back and see what happens

[codysluder]

There are several posts in other topics that suggest that Project 10632 may be the most critical test of GPU stability known to man and that they run fine with less critical settings. Let us know what you find.

[shdbcamping]

There are several posts in other topics that suggest that Project 10632 may be the most critical test of GPU stability known to man and that they run fine with less critical settings. Let us know what you find.

This is true with the fermi's as it was with the 200's and the g80's. It is the evolution of science/folding . And yet we are back to a 'user' choice on what their HW is running . If you 'dial back a card because of "Rogue" software builds, you will lose the Gain for science on the mainstream WU's.

Just trying to put it all into perspective .

Sean

[bruce]

There is no such thing as a Rogue software build. Is prime95 a rogue software build because it did a better job of loading a CPU than anything else before it? Is stresscpu2 a rogue software build because it manages to generate higher temperatures than prime95?

No, they're just code that works the hardware more intensely and demonstrates that certain overclock settings are not stable when the software happens to be more efficient and use the hardware more effectively than whatever else has been used to "prove" something is stable.

[shdbcamping]

There is no such thing as a Rogue software build. Is prime95 a rogue software build because it did a better job of loading a CPU than anything else before it? Is stresscpu2 a rogue software build because it manages to generate higher temperatures than prime95?

No, they're just code that works the hardware more intensely and demonstrates that certain overclock settings are not stable when the software happens to be more efficient and use the hardware more effectively than whatever else has been used to "prove" something is stable.

Bruce,
You are missing my point. If the WU's for the Donor HW were more similar as far as heat/working GPUs, there would be no issue
When a Donor HW needs "DOWNCLOCKED" for an occassional WU, it hurts the overall Science because ALL the WUs get turned in slower. And Pande and the Forums here have not been light on "pushing" for 'fastest Science results'.

Not looking to pick an 'anything' here. Just looking for some continuity of reccommendations..... and what's best for the science throughput.

I'll put a 2X gtx460 rig together and u'clock it for the 'burners' as long as we agree that 'less overall' science throughput is not 'neccessarilly' in the best interest of science.

My Father in Law is now (as of 4 days ago) on hospice for terminal cancer. Six of my friends from childhood are already dead from cancer. Not that that is any excuse for my position on this, but it is an explanation. I only ask again that the Forum Mods/admin and regular posters here remain conscious that those of the donors that do what they do for Pande Group "might" have DEEP PERSONAL reasons. Casual and at times 'flippant' responses, even when not intentional can strike a very, very, very, 'Personal" nerve.

Long live F@H and our community
Sean

[kg4icg]

Here is another 10632 going wrong after successfully folding 2 other 10632's before ending up EUEing this time, running on the 258.96 nvidia driver with factory clocks on my 460GTX.

Code: Select all

[21:20:06] Folding@home Core Shutdown: FINISHED_UNIT
[21:20:09] CoreStatus = 64 (100)
[21:20:09] Sending work to server
[21:20:09] Project: 11254 (Run 0, Clone 201, Gen 0)


[21:20:09] + Attempting to send results [October 7 21:20:09 UTC]
[21:20:09] Gpu type=3 species=30.
[21:20:16] + Results successfully sent
[21:20:16] Thank you for your contribution to Folding@Home.
[21:20:16] + Number of Units Completed: 40

[21:20:20] - Preparing to get new work unit...
[21:20:20] Cleaning up work directory
[21:20:20] + Attempting to get work packet
[21:20:20] Passkey found
[21:20:20] Gpu type=3 species=30.
[21:20:20] - Connecting to assignment server
[21:20:21] - Successful: assigned to (171.67.108.20).
[21:20:21] + News From Folding@Home: Welcome to Folding@Home
[21:20:21] Loaded queue successfully.
[21:20:21] Gpu type=3 species=30.
[21:20:22] + Closed connections
[21:20:22] 
[21:20:22] + Processing work unit
[21:20:22] Core required: FahCore_15.exe
[21:20:22] Core found.
[21:20:22] Working on queue slot 05 [October 7 21:20:22 UTC]
[21:20:22] + Working ...
[21:20:22] 
[21:20:22] *------------------------------*
[21:20:22] Folding@Home GPU Core -- Beta
[21:20:22] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[21:20:22] 
[21:20:22] Build host: SimbiosNvdWin7
[21:20:22] Board Type: Nvidia
[21:20:22] Core      : 
[21:20:22] Preparing to commence simulation
[21:20:22] - Looking at optimizations...
[21:20:22] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[21:20:22] - Created dyn
[21:20:22] - Files status OK
[21:20:22] sizeof(CORE_PACKET_HDR) = 512 file=<>
[21:20:22] - Expanded 43837 -> 163067 (decompressed 371.9 percent)
[21:20:22] Called DecompressByteArray: compressed_data_size=43837 data_size=163067, decompressed_data_size=163067 diff=0
[21:20:22] - Digital signature verified
[21:20:22] 
[21:20:22] Project: 10632 (Run 20, Clone 87, Gen 10)
[21:20:22] 
[21:20:22] Assembly optimizations on if available.
[21:20:22] Entering M.D.
[21:20:28] Tpr hash work/wudata_05.tpr:  2229346861 3115633238 674712927 2655567160 1767066168
[21:20:28] Working on 582 p2750_N68H_AM03
[21:20:28] Client config found, loading data.
[21:20:29] Starting GUI Server
[21:21:21] Completed 1%
[21:22:13] Completed 2%
[21:23:06] Completed 3%
[21:23:58] Completed 4%
[21:24:50] Completed 5%
[21:25:42] Completed 6%
[21:26:34] Completed 7%
[21:27:27] Completed 8%
[21:28:19] Completed 9%
[21:29:11] Completed 10%
[21:30:04] Completed 11%
[21:30:56] Completed 12%
[21:31:49] Completed 13%
[21:32:41] Completed 14%
[21:33:34] Completed 15%
[21:34:27] Completed 16%
[21:35:19] Completed 17%
[21:36:12] Completed 18%
[21:37:04] Completed 19%
[21:37:56] Completed 20%
[21:38:49] Completed 21%
[21:39:42] Completed 22%
[21:40:34] Completed 23%
[21:41:27] Completed 24%
[21:42:19] Completed 25%
[21:43:12] Completed 26%
[21:44:04] Completed 27%
[21:44:57] Completed 28%
[21:45:49] Completed 29%
[21:46:42] Completed 30%
[21:47:35] Completed 31%
[21:48:27] Completed 32%
[21:49:20] Completed 33%
[21:50:12] Completed 34%
[21:51:04] Completed 35%
[21:51:57] Completed 36%
[21:52:49] Completed 37%
[21:53:42] Completed 38%
[21:54:34] Completed 39%
[21:55:27] Completed 40%
[21:56:19] Completed 41%
[21:57:12] Completed 42%
[21:58:04] Completed 43%
[21:58:57] Completed 44%
[21:59:49] Completed 45%
[22:00:41] Completed 46%
[22:01:34] Completed 47%
[22:02:26] Completed 48%
[22:03:19] Completed 49%
[22:04:11] Completed 50%
[22:05:04] Completed 51%
[22:05:56] Completed 52%
[22:06:49] Completed 53%
[22:07:41] Completed 54%
[22:08:34] Completed 55%
[22:09:26] Completed 56%
[22:10:19] Completed 57%
[22:11:11] Completed 58%
[22:12:05] Completed 59%
[22:12:57] Completed 60%
[22:13:50] Completed 61%
[22:14:42] Completed 62%
[22:14:54] + Working...
[22:15:34] Completed 63%
[22:16:26] Completed 64%
[22:17:18] Completed 65%
[22:18:11] Completed 66%
[22:19:03] Completed 67%
[22:19:55] Completed 68%
[22:20:48] Completed 69%
[22:21:40] Completed 70%
[22:22:33] Completed 71%
[22:23:25] Completed 72%
[22:24:18] Completed 73%
[22:25:10] Completed 74%
[22:26:02] Completed 75%
[22:26:55] Completed 76%
[22:27:47] Completed 77%
[22:28:39] Completed 78%
[22:29:32] Completed 79%
[22:30:24] Completed 80%
[22:31:17] Completed 81%
[22:32:10] Completed 82%
[22:33:02] Completed 83%
[22:33:56] Completed 84%
[22:34:48] Completed 85%
[22:35:41] Completed 86%
[22:36:33] Completed 87%
[22:37:25] Completed 88%
[22:38:17] Completed 89%
[22:39:10] Completed 90%
[22:40:02] Completed 91%
[22:40:55] Completed 92%
[22:41:47] Completed 93%
[22:42:39] Completed 94%
[22:43:32] Completed 95%
[22:44:24] Completed 96%
[22:45:17] Completed 97%
[22:46:09] Completed 98%
[22:47:02] Completed 99%
[22:47:54] Completed 100%
[22:47:54] Finished fah_main
[22:47:54] 
[22:47:54] Successful run
[22:47:54] DynamicWrapper: Finished Work Unit: sleep=10000
[22:48:04] Reserved 11352 bytes for xtc file; Cosm status=0
[22:48:04] Allocated 11352 bytes for xtc file
[22:48:04] - Reading up to 11352 from "work/wudata_05.xtc": Read 11352
[22:48:04] Read 11352 bytes from xtc file; available packet space=786419112
[22:48:04] xtc file hash check passed.
[22:48:04] Reserved 3621840 3621840 786419112 bytes for arc file=<work/wudata_05.trr> Cosm status=0
[22:48:04] Allocated 3621840 bytes for arc file
[22:48:04] - Reading up to 3621840 from "work/wudata_05.trr": Read 3621840
[22:48:04] Read 3621840 bytes from arc file; available packet space=782797272
[22:48:04] trr file hash check passed.
[22:48:04] Allocated 544 bytes for edr file
[22:48:04] Read bedfile
[22:48:04] edr file hash check passed.
[22:48:04] Allocated 492528 bytes for logfile
[22:48:04] Read logfile
[22:48:04] GuardedRun: success in DynamicWrapper
[22:48:04] GuardedRun: done
[22:48:04] Run: GuardedRun completed.
[22:48:07] + Opened results file
[22:48:07] - Writing 4126776 bytes of core data to disk...
[22:48:08] Done: 4126264 -> 3192132 (compressed to 77.3 percent)
[22:48:08]   ... Done.
[22:48:08] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[22:48:09] Shutting down core 
[22:48:09] 
[22:48:09] Folding@home Core Shutdown: FINISHED_UNIT
[22:48:13] CoreStatus = 64 (100)
[22:48:13] Sending work to server
[22:48:13] Project: 10632 (Run 20, Clone 87, Gen 10)


[22:48:13] + Attempting to send results [October 7 22:48:13 UTC]
[22:48:13] Gpu type=3 species=30.
[22:48:35] + Results successfully sent
[22:48:35] Thank you for your contribution to Folding@Home.
[22:48:35] + Number of Units Completed: 41

[22:48:40] - Preparing to get new work unit...
[22:48:40] Cleaning up work directory
[22:48:40] + Attempting to get work packet
[22:48:40] Passkey found
[22:48:40] Gpu type=3 species=30.
[22:48:40] - Connecting to assignment server
[22:48:41] - Successful: assigned to (171.67.108.20).
[22:48:41] + News From Folding@Home: Welcome to Folding@Home
[22:48:41] Loaded queue successfully.
[22:48:41] Gpu type=3 species=30.
[22:48:42] + Closed connections
[22:48:42] 
[22:48:42] + Processing work unit
[22:48:42] Core required: FahCore_15.exe
[22:48:42] Core found.
[22:48:42] Working on queue slot 06 [October 7 22:48:42 UTC]
[22:48:42] + Working ...
[22:48:42] 
[22:48:42] *------------------------------*
[22:48:42] Folding@Home GPU Core -- Beta
[22:48:42] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[22:48:42] 
[22:48:42] Build host: SimbiosNvdWin7
[22:48:42] Board Type: Nvidia
[22:48:42] Core      : 
[22:48:42] Preparing to commence simulation
[22:48:42] - Looking at optimizations...
[22:48:42] DeleteFrameFiles: successfully deleted file=work/wudata_06.ckp
[22:48:42] - Created dyn
[22:48:42] - Files status OK
[22:48:42] sizeof(CORE_PACKET_HDR) = 512 file=<>
[22:48:42] - Expanded 43843 -> 163067 (decompressed 371.9 percent)
[22:48:42] Called DecompressByteArray: compressed_data_size=43843 data_size=163067, decompressed_data_size=163067 diff=0
[22:48:42] - Digital signature verified
[22:48:42] 
[22:48:42] Project: 10632 (Run 78, Clone 93, Gen 12)
[22:48:42] 
[22:48:42] Assembly optimizations on if available.
[22:48:42] Entering M.D.
[22:48:48] Tpr hash work/wudata_06.tpr:  3063730200 871158123 2100868883 4257497660 3187544846
[22:48:48] Working on 582 p2750_N68H_AM03
[22:48:48] Client config found, loading data.
[22:48:48] Starting GUI Server
[22:49:40] Completed 1%
[22:50:32] Completed 2%
[22:51:25] Completed 3%
[22:52:17] Completed 4%
[22:53:10] Completed 5%
[22:54:02] Completed 6%
[22:54:54] Completed 7%
[22:55:47] Completed 8%
[22:56:40] Completed 9%
[22:57:33] Completed 10%
[22:58:26] Completed 11%
[22:59:19] Completed 12%
[23:00:11] Completed 13%
[23:01:03] Completed 14%
[23:01:56] Completed 15%
[23:02:49] Completed 16%
[23:03:41] Completed 17%
[23:04:33] Completed 18%
[23:05:27] Completed 19%
[23:06:19] Completed 20%
[23:07:12] Completed 21%
[23:08:04] Completed 22%
[23:08:56] Completed 23%
[23:09:49] Completed 24%
[23:10:41] Completed 25%
[23:11:34] Completed 26%
[23:12:26] Completed 27%
[23:13:20] Completed 28%
[23:14:13] Completed 29%
[23:15:05] Completed 30%
[23:15:57] Completed 31%
[23:16:50] Completed 32%
[23:17:43] Completed 33%
[23:18:35] Completed 34%
[23:19:28] Completed 35%
[23:20:21] Completed 36%
[23:21:13] Completed 37%
[23:22:05] Completed 38%
[23:22:58] Completed 39%
[23:23:50] Completed 40%
[23:24:42] Completed 41%
[23:25:35] Completed 42%
[23:26:27] Completed 43%
[23:27:19] Completed 44%
[23:28:12] Completed 45%
[23:29:04] Completed 46%
[23:29:57] Completed 47%
[23:30:49] Completed 48%
[23:31:41] Completed 49%
[23:32:34] Completed 50%
[23:33:26] Completed 51%
[23:34:19] Completed 52%
[23:35:11] Completed 53%
[23:36:04] Completed 54%
[23:36:57] Completed 55%
[23:37:49] Completed 56%
[23:38:42] Completed 57%
[23:39:34] Completed 58%
[23:40:27] Completed 59%
[23:41:20] Completed 60%
[23:42:13] Completed 61%
[23:43:05] Completed 62%
[23:43:58] Completed 63%
[23:44:50] Completed 64%
[23:45:42] Completed 65%
[23:46:35] Completed 66%
[23:47:27] Completed 67%
[23:48:20] Completed 68%
[23:49:12] Completed 69%
[23:50:05] Completed 70%
[23:50:57] Completed 71%
[23:51:49] Completed 72%
[23:52:42] Completed 73%
[23:53:35] Completed 74%
[23:54:27] Completed 75%
[23:55:20] Completed 76%
[23:56:12] Completed 77%
[23:57:06] Completed 78%
[23:57:58] Completed 79%
[23:58:51] Completed 80%
[23:59:43] Completed 81%
[00:00:35] Completed 82%
[00:01:28] Completed 83%
[00:02:20] Completed 84%
[00:03:12] Completed 85%
[00:04:05] Completed 86%
[00:04:57] Completed 87%
[00:05:49] Completed 88%
[00:06:42] Completed 89%
[00:07:34] Completed 90%
[00:08:27] Completed 91%
[00:09:20] Completed 92%
[00:10:12] Completed 93%
[00:11:04] Completed 94%
[00:11:56] Completed 95%
[00:12:48] Completed 96%
[00:13:41] Completed 97%
[00:14:33] Completed 98%
[00:15:26] Completed 99%
[00:16:18] Completed 100%
[00:16:18] Finished fah_main
[00:16:18] 
[00:16:18] Successful run
[00:16:18] DynamicWrapper: Finished Work Unit: sleep=10000
[00:16:28] Reserved 11388 bytes for xtc file; Cosm status=0
[00:16:28] Allocated 11388 bytes for xtc file
[00:16:28] - Reading up to 11388 from "work/wudata_06.xtc": Read 11388
[00:16:28] Read 11388 bytes from xtc file; available packet space=786419076
[00:16:28] xtc file hash check passed.
[00:16:28] Reserved 3621840 3621840 786419076 bytes for arc file=<work/wudata_06.trr> Cosm status=0
[00:16:28] Allocated 3621840 bytes for arc file
[00:16:28] - Reading up to 3621840 from "work/wudata_06.trr": Read 3621840
[00:16:28] Read 3621840 bytes from arc file; available packet space=782797236
[00:16:28] trr file hash check passed.
[00:16:28] Allocated 544 bytes for edr file
[00:16:28] Read bedfile
[00:16:28] edr file hash check passed.
[00:16:28] Allocated 492620 bytes for logfile
[00:16:28] Read logfile
[00:16:28] GuardedRun: success in DynamicWrapper
[00:16:28] GuardedRun: done
[00:16:28] Run: GuardedRun completed.
[00:16:32] + Opened results file
[00:16:32] - Writing 4126904 bytes of core data to disk...
[00:16:33] Done: 4126392 -> 3150362 (compressed to 76.3 percent)
[00:16:33]   ... Done.
[00:16:33] DeleteFrameFiles: successfully deleted file=work/wudata_06.ckp
[00:16:34] Shutting down core 
[00:16:34] 
[00:16:34] Folding@home Core Shutdown: FINISHED_UNIT
[00:16:37] CoreStatus = 64 (100)
[00:16:37] Sending work to server
[00:16:37] Project: 10632 (Run 78, Clone 93, Gen 12)


[00:16:37] + Attempting to send results [October 8 00:16:37 UTC]
[00:16:37] Gpu type=3 species=30.
[00:16:58] + Results successfully sent
[00:16:58] Thank you for your contribution to Folding@Home.
[00:16:58] + Number of Units Completed: 42

[00:17:02] - Preparing to get new work unit...
[00:17:02] Cleaning up work directory
[00:17:02] + Attempting to get work packet
[00:17:02] Passkey found
[00:17:02] Gpu type=3 species=30.
[00:17:02] - Connecting to assignment server
[00:17:03] - Successful: assigned to (171.67.108.20).
[00:17:03] + News From Folding@Home: Welcome to Folding@Home
[00:17:03] Loaded queue successfully.
[00:17:03] Gpu type=3 species=30.
[00:17:04] + Closed connections
[00:17:04] 
[00:17:04] + Processing work unit
[00:17:04] Core required: FahCore_15.exe
[00:17:04] Core found.
[00:17:04] Working on queue slot 07 [October 8 00:17:04 UTC]
[00:17:04] + Working ...
[00:17:04] 
[00:17:04] *------------------------------*
[00:17:04] Folding@Home GPU Core -- Beta
[00:17:04] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[00:17:04] 
[00:17:04] Build host: SimbiosNvdWin7
[00:17:04] Board Type: Nvidia
[00:17:04] Core      : 
[00:17:04] Preparing to commence simulation
[00:17:04] - Looking at optimizations...
[00:17:04] DeleteFrameFiles: successfully deleted file=work/wudata_07.ckp
[00:17:04] - Created dyn
[00:17:04] - Files status OK
[00:17:04] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:17:04] - Expanded 43844 -> 163067 (decompressed 371.9 percent)
[00:17:04] Called DecompressByteArray: compressed_data_size=43844 data_size=163067, decompressed_data_size=163067 diff=0
[00:17:04] - Digital signature verified
[00:17:04] 
[00:17:04] Project: 10632 (Run 78, Clone 93, Gen 13)
[00:17:04] 
[00:17:04] Assembly optimizations on if available.
[00:17:04] Entering M.D.
[00:17:10] Tpr hash work/wudata_07.tpr:  2263033610 276835825 2146270520 4263555344 1788974010
[00:17:10] Working on 582 p2750_N68H_AM03
[00:17:10] Client config found, loading data.
[00:17:10] Starting GUI Server
[00:18:03] Completed 1%
[00:18:56] Completed 2%
[00:19:48] Completed 3%
[00:20:40] Completed 4%
[00:21:33] Completed 5%
[00:22:25] Completed 6%
[00:23:18] Completed 7%
[00:24:10] Completed 8%
[00:25:03] Completed 9%
[00:25:55] Completed 10%
[00:26:47] Completed 11%
[00:27:39] Completed 12%
[00:28:32] Completed 13%
[00:29:25] Completed 14%
[00:30:17] Completed 15%
[00:31:09] Completed 16%
[00:32:03] Completed 17%
[00:32:55] Completed 18%
[00:33:48] Completed 19%
[00:34:40] Completed 20%
[00:35:33] Completed 21%
[00:36:25] Completed 22%
[00:37:18] Completed 23%
[00:38:10] Completed 24%
[00:39:02] Completed 25%
[00:39:55] Completed 26%
[00:40:48] Completed 27%
[00:41:40] Completed 28%
[00:42:33] Completed 29%
[00:43:26] Completed 30%
[00:44:18] Completed 31%
[00:45:10] Completed 32%
[00:46:03] Completed 33%
[00:46:54] Completed 34%
[00:46:54] mdrun_gpu returned 
[00:46:54] NANs detected on GPU
[00:46:54] 
[00:46:54] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:46:58] CoreStatus = 7A (122)
[00:46:58] Sending work to server
[00:46:58] Project: 10632 (Run 78, Clone 93, Gen 13)
[00:46:58] - Error: Could not get length of results file work/wuresults_07.dat
[00:46:58] - Error: Could not read unit 07 file. Removing from queue.
[00:46:58] - Preparing to get new work unit...
[00:46:58] Cleaning up work directory
[00:46:58] + Attempting to get work packet
[00:46:58] Passkey found
[00:46:58] Gpu type=3 species=30.
[00:46:58] - Connecting to assignment server
[00:46:59] - Successful: assigned to (171.67.108.20).
[00:46:59] + News From Folding@Home: Welcome to Folding@Home
[00:46:59] Loaded queue successfully.
[00:46:59] Gpu type=3 species=30.
[00:47:00] + Closed connections
[00:47:05] 
[00:47:05] + Processing work unit
[00:47:05] Core required: FahCore_15.exe
[00:47:05] Core found.
[00:47:05] Working on queue slot 08 [October 8 00:47:05 UTC]
[00:47:05] + Working ...
[00:47:05] 
[00:47:05] *------------------------------*
[00:47:05] Folding@Home GPU Core -- Beta
[00:47:05] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[00:47:05] 
[00:47:05] Build host: SimbiosNvdWin7
[00:47:05] Board Type: Nvidia
[00:47:05] Core      : 
[00:47:05] Preparing to commence simulation
[00:47:05] - Looking at optimizations...
[00:47:05] DeleteFrameFiles: successfully deleted file=work/wudata_08.ckp
[00:47:05] - Created dyn
[00:47:05] - Files status OK
[00:47:05] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:47:05] - Expanded 43844 -> 163067 (decompressed 371.9 percent)
[00:47:05] Called DecompressByteArray: compressed_data_size=43844 data_size=163067, decompressed_data_size=163067 diff=0
[00:47:05] - Digital signature verified
[00:47:05] 
[00:47:05] Project: 10632 (Run 78, Clone 93, Gen 13)
[00:47:05] 
[00:47:05] Assembly optimizations on if available.
[00:47:05] Entering M.D.
[00:47:11] Tpr hash work/wudata_08.tpr:  2263033610 276835825 2146270520 4263555344 1788974010
[00:47:11] Working on 582 p2750_N68H_AM03
[00:47:11] Client config found, loading data.
[00:47:13] Starting GUI Server
[00:48:04] Completed 1%
[00:48:56] Completed 2%
[00:49:48] Completed 3%
[00:50:41] Completed 4%
[00:51:34] Completed 5%
[00:52:26] Completed 6%
[00:53:19] Completed 7%
[00:54:12] Completed 8%
[00:55:04] Completed 9%
[00:55:56] Completed 10%
[00:56:48] Completed 11%
[00:57:41] Completed 12%
[00:58:33] Completed 13%
[00:58:33] mdrun_gpu returned 
[00:58:33] NANs detected on GPU
[00:58:33] 
[00:58:33] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:58:35] CoreStatus = 7A (122)
[00:58:35] Sending work to server
[00:58:35] Project: 10632 (Run 78, Clone 93, Gen 13)
[00:58:35] - Error: Could not get length of results file work/wuresults_08.dat
[00:58:35] - Error: Could not read unit 08 file. Removing from queue.
[00:58:35] - Preparing to get new work unit...
[00:58:35] Cleaning up work directory
[00:58:35] + Attempting to get work packet
[00:58:35] Passkey found
[00:58:35] Gpu type=3 species=30.
[00:58:35] - Connecting to assignment server
[00:58:36] - Successful: assigned to (171.67.108.20).
[00:58:36] + News From Folding@Home: Welcome to Folding@Home
[00:58:36] Loaded queue successfully.
[00:58:36] Gpu type=3 species=30.
[00:58:38] + Closed connections
[00:58:43] 
[00:58:43] + Processing work unit
[00:58:43] Core required: FahCore_15.exe
[00:58:43] Core found.
[00:58:43] Working on queue slot 09 [October 8 00:58:43 UTC]
[00:58:43] + Working ...
[00:58:43] 
[00:58:43] *------------------------------*
[00:58:43] Folding@Home GPU Core -- Beta
[00:58:43] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[00:58:43] 
[00:58:43] Build host: SimbiosNvdWin7
[00:58:43] Board Type: Nvidia
[00:58:43] Core      : 
[00:58:43] Preparing to commence simulation
[00:58:43] - Looking at optimizations...
[00:58:43] DeleteFrameFiles: successfully deleted file=work/wudata_09.ckp
[00:58:43] - Created dyn
[00:58:43] - Files status OK
[00:58:43] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:58:43] - Expanded 43844 -> 163067 (decompressed 371.9 percent)
[00:58:43] Called DecompressByteArray: compressed_data_size=43844 data_size=163067, decompressed_data_size=163067 diff=0
[00:58:43] - Digital signature verified
[00:58:43] 
[00:58:43] Project: 10632 (Run 78, Clone 93, Gen 13)
[00:58:43] 
[00:58:43] Assembly optimizations on if available.
[00:58:43] Entering M.D.
[00:58:49] Tpr hash work/wudata_09.tpr:  2263033610 276835825 2146270520 4263555344 1788974010
[00:58:49] Working on 582 p2750_N68H_AM03
[00:58:49] Client config found, loading data.
[00:58:50] Starting GUI Server
[00:59:42] Completed 1%
[01:00:35] Completed 2%
[01:01:27] Completed 3%
[01:02:20] Completed 4%
[01:03:11] Completed 5%
[01:03:11] mdrun_gpu returned 
[01:03:11] NANs detected on GPU
[01:03:11] 
[01:03:11] Folding@home Core Shutdown: UNSTABLE_MACHINE
[01:03:13] CoreStatus = 7A (122)
[01:03:13] Sending work to server
[01:03:13] Project: 10632 (Run 78, Clone 93, Gen 13)
[01:03:13] - Error: Could not get length of results file work/wuresults_09.dat
[01:03:13] - Error: Could not read unit 09 file. Removing from queue.
[01:03:13] - Preparing to get new work unit...
[01:03:13] Cleaning up work directory
[01:03:13] + Attempting to get work packet
[01:03:13] Passkey found
[01:03:13] Gpu type=3 species=30.
[01:03:13] - Connecting to assignment server
[01:03:14] - Successful: assigned to (171.67.108.20).
[01:03:14] + News From Folding@Home: Welcome to Folding@Home
[01:03:14] Loaded queue successfully.
[01:03:14] Gpu type=3 species=30.
[01:03:15] + Closed connections
[01:03:20] 
[01:03:20] + Processing work unit
[01:03:20] Core required: FahCore_15.exe
[01:03:20] Core found.
[01:03:20] Working on queue slot 00 [October 8 01:03:20 UTC]
[01:03:20] + Working ...
[01:03:20] 
[01:03:20] *------------------------------*
[01:03:20] Folding@Home GPU Core -- Beta
[01:03:20] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[01:03:20] 
[01:03:20] Build host: SimbiosNvdWin7
[01:03:20] Board Type: Nvidia
[01:03:20] Core      : 
[01:03:20] Preparing to commence simulation
[01:03:20] - Looking at optimizations...
[01:03:20] DeleteFrameFiles: successfully deleted file=work/wudata_00.ckp
[01:03:20] - Created dyn
[01:03:20] - Files status OK
[01:03:20] sizeof(CORE_PACKET_HDR) = 512 file=<>
[01:03:20] - Expanded 43844 -> 163067 (decompressed 371.9 percent)
[01:03:20] Called DecompressByteArray: compressed_data_size=43844 data_size=163067, decompressed_data_size=163067 diff=0
[01:03:20] - Digital signature verified
[01:03:20] 
[01:03:20] Project: 10632 (Run 78, Clone 93, Gen 13)
[01:03:20] 
[01:03:20] Assembly optimizations on if available.
[01:03:20] Entering M.D.
[01:03:26] Tpr hash work/wudata_00.tpr:  2263033610 276835825 2146270520 4263555344 1788974010
[01:03:26] Working on 582 p2750_N68H_AM03
[01:03:26] Client config found, loading data.
[01:03:27] Starting GUI Server
[01:04:19] Completed 1%
[01:05:11] Completed 2%
[01:06:04] Completed 3%
[01:06:56] Completed 4%
[01:07:48] Completed 5%
[01:08:41] Completed 6%
[01:09:32] Completed 7%
[01:09:32] mdrun_gpu returned 
[01:09:32] NANs detected on GPU
[01:09:32] 
[01:09:32] Folding@home Core Shutdown: UNSTABLE_MACHINE
[01:09:35] CoreStatus = 7A (122)
[01:09:35] Sending work to server
[01:09:35] Project: 10632 (Run 78, Clone 93, Gen 13)
[01:09:35] - Error: Could not get length of results file work/wuresults_00.dat
[01:09:35] - Error: Could not read unit 00 file. Removing from queue.
[01:09:35] - Preparing to get new work unit...
[01:09:35] Cleaning up work directory
[01:09:35] + Attempting to get work packet
[01:09:35] Passkey found
[01:09:35] Gpu type=3 species=30.
[01:09:35] - Connecting to assignment server
[01:09:35] - Successful: assigned to (171.67.108.20).
[01:09:35] + News From Folding@Home: Welcome to Folding@Home
[01:09:36] Loaded queue successfully.
[01:09:36] Gpu type=3 species=30.
[01:09:36] + Closed connections
[01:09:41] 
[01:09:41] + Processing work unit
[01:09:41] Core required: FahCore_15.exe
[01:09:41] Core found.
[01:09:41] Working on queue slot 01 [October 8 01:09:41 UTC]
[01:09:41] + Working ...
[01:09:41] 
[01:09:41] *------------------------------*
[01:09:41] Folding@Home GPU Core -- Beta
[01:09:41] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[01:09:41] 
[01:09:41] Build host: SimbiosNvdWin7
[01:09:41] Board Type: Nvidia
[01:09:41] Core      : 
[01:09:41] Preparing to commence simulation
[01:09:41] - Looking at optimizations...
[01:09:41] DeleteFrameFiles: successfully deleted file=work/wudata_01.ckp
[01:09:41] - Created dyn
[01:09:41] - Files status OK
[01:09:41] sizeof(CORE_PACKET_HDR) = 512 file=<>
[01:09:41] - Expanded 43844 -> 163067 (decompressed 371.9 percent)
[01:09:41] Called DecompressByteArray: compressed_data_size=43844 data_size=163067, decompressed_data_size=163067 diff=0
[01:09:41] - Digital signature verified
[01:09:41] 
[01:09:41] Project: 10632 (Run 78, Clone 93, Gen 13)
[01:09:41] 
[01:09:42] Assembly optimizations on if available.
[01:09:42] Entering M.D.
[01:09:48] Tpr hash work/wudata_01.tpr:  2263033610 276835825 2146270520 4263555344 1788974010
[01:09:48] Working on 582 p2750_N68H_AM03
[01:09:48] Client config found, loading data.
[01:09:48] Starting GUI Server
[01:10:40] Completed 1%
[01:11:33] Completed 2%
[01:12:24] Completed 3%
[01:12:24] mdrun_gpu returned 
[01:12:24] NANs detected on GPU
[01:12:24] 
[01:12:24] Folding@home Core Shutdown: UNSTABLE_MACHINE
[01:12:28] CoreStatus = 7A (122)
[01:12:28] Sending work to server
[01:12:28] Project: 10632 (Run 78, Clone 93, Gen 13)
[01:12:28] - Error: Could not get length of results file work/wuresults_01.dat
[01:12:28] - Error: Could not read unit 01 file. Removing from queue.
[01:12:28] EUE limit exceeded. Pausing 24 hours.

[sortofageek]

Given the log you posted, I can't explain this.

Project: 10632 (Run 20, Clone 87, Gen 10)
This one was completed successfully by another folder. I see no results for you.

Project: 10632 (Run 78, Clone 93, Gen 12)
This one was completed successfully by yet another folder. I see no results for you.


Project: 10632 (Run 78, Clone 93, Gen 13)
Hi kg4icg (team 75255),
Your WU (P10632 R78 C93 G13) was added to the stats database on 2010-10-07 18:07:57 for 611 points of credit.