Project: 10632 (Run 93, Clone 54, Gen 38)

derrickmcc · Post by **derrickmcc** » Sun Oct 10, 2010 12:32 am

Getting immediate NANs detected on GPU:

[00:05:14] - Preparing to get new work unit...
[00:05:14] Cleaning up work directory
[00:05:14] + Attempting to get work packet
[00:05:14] Passkey found
[00:05:14] Gpu type=3 species=30.
[00:05:14] - Connecting to assignment server
[00:05:16] - Successful: assigned to (171.67.108.20).
[00:05:16] + News From Folding@Home: Welcome to Folding@Home
[00:05:16] Loaded queue successfully.
[00:05:16] Gpu type=3 species=30.
[00:05:17] + Closed connections
[00:05:17] 
[00:05:17] + Processing work unit
[00:05:17] Core required: FahCore_15.exe
[00:05:17] Core found.
[00:05:17] Working on queue slot 05 [October 10 00:05:17 UTC]
[00:05:17] + Working ...
[00:05:17] 
[00:05:17] *------------------------------*
[00:05:17] Folding@Home GPU Core -- Beta
[00:05:17] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[00:05:17] 
[00:05:17] Build host: SimbiosNvdWin7
[00:05:17] Board Type: Nvidia
[00:05:17] Core      : 
[00:05:17] Preparing to commence simulation
[00:05:17] - Looking at optimizations...
[00:05:17] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[00:05:17] - Created dyn
[00:05:17] - Files status OK
[00:05:17] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:05:17] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[00:05:17] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[00:05:17] - Digital signature verified
[00:05:17] 
[00:05:17] Project: 10632 (Run 93, Clone 54, Gen 38)
[00:05:17] 
[00:05:17] Assembly optimizations on if available.
[00:05:17] Entering M.D.
[00:05:23] Tpr hash work/wudata_05.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[00:05:23] Working on 582 p2750_N68H_AM03
[00:05:23] Client config found, loading data.
[00:05:24] Starting GUI Server
[00:05:24] mdrun_gpu returned 
[00:05:24] NANs detected on GPU
[00:05:24] 
[00:05:24] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:05:27] CoreStatus = 7A (122)
[00:05:27] Sending work to server
[00:05:27] Project: 10632 (Run 93, Clone 54, Gen 38)
[00:05:27] - Read packet limit of 540015616... Set to 524286976.
[00:05:27] - Error: Could not get length of results file work/wuresults_05.dat
[00:05:27] - Error: Could not read unit 05 file. Removing from queue.
[00:05:27] - Preparing to get new work unit...
[00:05:27] Cleaning up work directory
[00:05:27] + Attempting to get work packet
[00:05:27] Passkey found
[00:05:27] Gpu type=3 species=30.
[00:05:27] - Connecting to assignment server
[00:05:28] - Successful: assigned to (171.67.108.20).
[00:05:28] + News From Folding@Home: Welcome to Folding@Home
[00:05:29] Loaded queue successfully.
[00:05:29] Gpu type=3 species=30.
[00:05:30] + Closed connections
[00:05:35] 
[00:05:35] + Processing work unit
[00:05:35] Core required: FahCore_15.exe
[00:05:35] Core found.
[00:05:35] Working on queue slot 06 [October 10 00:05:35 UTC]
[00:05:35] + Working ...
[00:05:35] 
[00:05:35] *------------------------------*
[00:05:35] Folding@Home GPU Core -- Beta
[00:05:35] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[00:05:35] 
[00:05:35] Build host: SimbiosNvdWin7
[00:05:35] Board Type: Nvidia
[00:05:35] Core      : 
[00:05:35] Preparing to commence simulation
[00:05:35] - Looking at optimizations...
[00:05:35] DeleteFrameFiles: successfully deleted file=work/wudata_06.ckp
[00:05:35] - Created dyn
[00:05:35] - Files status OK
[00:05:35] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:05:35] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[00:05:35] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[00:05:35] - Digital signature verified
[00:05:35] 
[00:05:35] Project: 10632 (Run 93, Clone 54, Gen 38)
[00:05:35] 
[00:05:35] Assembly optimizations on if available.
[00:05:35] Entering M.D.
[00:05:41] Tpr hash work/wudata_06.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[00:05:41] Working on 582 p2750_N68H_AM03
[00:05:41] Client config found, loading data.
[00:05:41] Starting GUI Server
[00:05:41] mdrun_gpu returned 
[00:05:41] NANs detected on GPU
[00:05:41] 
[00:05:41] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:05:45] CoreStatus = 7A (122)
[00:05:45] Sending work to server
[00:05:45] Project: 10632 (Run 93, Clone 54, Gen 38)
[00:05:45] - Read packet limit of 540015616... Set to 524286976.
[00:05:45] - Error: Could not get length of results file work/wuresults_06.dat
[00:05:45] - Error: Could not read unit 06 file. Removing from queue.
[00:05:45] - Preparing to get new work unit...
[00:05:45] Cleaning up work directory
[00:05:45] + Attempting to get work packet
[00:05:45] Passkey found
[00:05:45] Gpu type=3 species=30.
[00:05:45] - Connecting to assignment server
[00:05:46] - Successful: assigned to (171.67.108.20).
[00:05:46] + News From Folding@Home: Welcome to Folding@Home
[00:05:46] Loaded queue successfully.
[00:05:46] Gpu type=3 species=30.
[00:05:48] + Closed connections
[00:05:53] 
[00:05:53] + Processing work unit
[00:05:53] Core required: FahCore_15.exe
[00:05:53] Core found.
[00:05:53] Working on queue slot 07 [October 10 00:05:53 UTC]
[00:05:53] + Working ...
[00:05:53] 
[00:05:53] *------------------------------*
[00:05:53] Folding@Home GPU Core -- Beta
[00:05:53] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[00:05:53] 
[00:05:53] Build host: SimbiosNvdWin7
[00:05:53] Board Type: Nvidia
[00:05:53] Core      : 
[00:05:53] Preparing to commence simulation
[00:05:53] - Looking at optimizations...
[00:05:53] DeleteFrameFiles: successfully deleted file=work/wudata_07.ckp
[00:05:53] - Created dyn
[00:05:53] - Files status OK
[00:05:53] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:05:53] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[00:05:53] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[00:05:53] - Digital signature verified
[00:05:53] 
[00:05:53] Project: 10632 (Run 93, Clone 54, Gen 38)
[00:05:53] 
[00:05:53] Assembly optimizations on if available.
[00:05:53] Entering M.D.
[00:05:59] Tpr hash work/wudata_07.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[00:05:59] Working on 582 p2750_N68H_AM03
[00:05:59] Client config found, loading data.
[00:06:00] Starting GUI Server
[00:06:00] mdrun_gpu returned 
[00:06:00] NANs detected on GPU
[00:06:00] 
[00:06:00] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:06:03] CoreStatus = 7A (122)
[00:06:03] Sending work to server
[00:06:03] Project: 10632 (Run 93, Clone 54, Gen 38)
[00:06:03] - Read packet limit of 540015616... Set to 524286976.
[00:06:03] - Error: Could not get length of results file work/wuresults_07.dat
[00:06:03] - Error: Could not read unit 07 file. Removing from queue.
[00:06:03] - Preparing to get new work unit...
[00:06:03] Cleaning up work directory
[00:06:03] + Attempting to get work packet
[00:06:03] Passkey found
[00:06:03] Gpu type=3 species=30.
[00:06:03] - Connecting to assignment server
[00:06:05] - Successful: assigned to (171.67.108.20).
[00:06:05] + News From Folding@Home: Welcome to Folding@Home
[00:06:05] Loaded queue successfully.
[00:06:05] Gpu type=3 species=30.
[00:06:06] + Closed connections
[00:06:11] 
[00:06:11] + Processing work unit
[00:06:11] Core required: FahCore_15.exe
[00:06:11] Core found.
[00:06:11] Working on queue slot 08 [October 10 00:06:11 UTC]
[00:06:11] + Working ...
[00:06:12] 
[00:06:12] *------------------------------*
[00:06:12] Folding@Home GPU Core -- Beta
[00:06:12] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[00:06:12] 
[00:06:12] Build host: SimbiosNvdWin7
[00:06:12] Board Type: Nvidia
[00:06:12] Core      : 
[00:06:12] Preparing to commence simulation
[00:06:12] - Looking at optimizations...
[00:06:12] DeleteFrameFiles: successfully deleted file=work/wudata_08.ckp
[00:06:12] - Created dyn
[00:06:12] - Files status OK
[00:06:12] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:06:12] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[00:06:12] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[00:06:12] - Digital signature verified
[00:06:12] 
[00:06:12] Project: 10632 (Run 93, Clone 54, Gen 38)
[00:06:12] 
[00:06:12] Assembly optimizations on if available.
[00:06:12] Entering M.D.
[00:06:18] Tpr hash work/wudata_08.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[00:06:18] Working on 582 p2750_N68H_AM03
[00:06:18] Client config found, loading data.
[00:06:18] Starting GUI Server
[00:06:18] mdrun_gpu returned 
[00:06:18] NANs detected on GPU
[00:06:18] 
[00:06:18] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:06:22] CoreStatus = 7A (122)
[00:06:22] Sending work to server
[00:06:22] Project: 10632 (Run 93, Clone 54, Gen 38)
[00:06:22] - Read packet limit of 540015616... Set to 524286976.
[00:06:22] - Error: Could not get length of results file work/wuresults_08.dat
[00:06:22] - Error: Could not read unit 08 file. Removing from queue.
[00:06:22] - Preparing to get new work unit...
[00:06:22] Cleaning up work directory
[00:06:22] + Attempting to get work packet
[00:06:22] Passkey found
[00:06:22] Gpu type=3 species=30.
[00:06:22] - Connecting to assignment server
[00:06:23] - Successful: assigned to (171.67.108.20).
[00:06:23] + News From Folding@Home: Welcome to Folding@Home
[00:06:24] Loaded queue successfully.
[00:06:24] Gpu type=3 species=30.
[00:06:25] + Closed connections
[00:06:30] 
[00:06:30] + Processing work unit
[00:06:30] Core required: FahCore_15.exe
[00:06:30] Core found.
[00:06:30] Working on queue slot 09 [October 10 00:06:30 UTC]
[00:06:30] + Working ...
[00:06:30] 
[00:06:30] *------------------------------*
[00:06:30] Folding@Home GPU Core -- Beta
[00:06:30] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[00:06:30] 
[00:06:30] Build host: SimbiosNvdWin7
[00:06:30] Board Type: Nvidia
[00:06:30] Core      : 
[00:06:30] Preparing to commence simulation
[00:06:30] - Looking at optimizations...
[00:06:30] DeleteFrameFiles: successfully deleted file=work/wudata_09.ckp
[00:06:30] - Created dyn
[00:06:30] - Files status OK
[00:06:30] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:06:30] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[00:06:30] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[00:06:30] - Digital signature verified
[00:06:30] 
[00:06:30] Project: 10632 (Run 93, Clone 54, Gen 38)
[00:06:30] 
[00:06:30] Assembly optimizations on if available.
[00:06:30] Entering M.D.
[00:06:36] Tpr hash work/wudata_09.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[00:06:36] Working on 582 p2750_N68H_AM03
[00:06:36] Client config found, loading data.
[00:06:36] Starting GUI Server
[00:06:36] mdrun_gpu returned 
[00:06:36] NANs detected on GPU
[00:06:36] 
[00:06:36] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:06:40] CoreStatus = 7A (122)
[00:06:40] Sending work to server
[00:06:40] Project: 10632 (Run 93, Clone 54, Gen 38)
[00:06:40] - Read packet limit of 540015616... Set to 524286976.
[00:06:40] - Error: Could not get length of results file work/wuresults_09.dat
[00:06:40] - Error: Could not read unit 09 file. Removing from queue.
[00:06:40] EUE limit exceeded. Pausing 24 hours.

This follows from the same issue with the same WU earlier today!!!

Code: Select all

[13:36:49] - Preparing to get new work unit...
[13:36:49] Cleaning up work directory
[13:36:49] + Attempting to get work packet
[13:36:49] Passkey found
[13:36:49] Gpu type=3 species=30.
[13:36:49] - Connecting to assignment server
[13:36:49] - Successful: assigned to (171.67.108.20).
[13:36:49] + News From Folding@Home: Welcome to Folding@Home
[13:36:50] Loaded queue successfully.
[13:36:50] Gpu type=3 species=30.
[13:36:50] + Closed connections
[13:36:50] 
[13:36:50] + Processing work unit
[13:36:50] Core required: FahCore_15.exe
[13:36:50] Core found.
[13:36:50] Working on queue slot 00 [October 9 13:36:50 UTC]
[13:36:50] + Working ...
[13:36:51] 
[13:36:51] *------------------------------*
[13:36:51] Folding@Home GPU Core -- Beta
[13:36:51] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[13:36:51] 
[13:36:51] Build host: SimbiosNvdWin7
[13:36:51] Board Type: Nvidia
[13:36:51] Core      : 
[13:36:51] Preparing to commence simulation
[13:36:51] - Looking at optimizations...
[13:36:51] DeleteFrameFiles: successfully deleted file=work/wudata_00.ckp
[13:36:51] - Created dyn
[13:36:51] - Files status OK
[13:36:51] sizeof(CORE_PACKET_HDR) = 512 file=<>
[13:36:51] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[13:36:51] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[13:36:51] - Digital signature verified
[13:36:51] 
[13:36:51] Project: 10632 (Run 93, Clone 54, Gen 38)
[13:36:51] 
[13:36:51] Assembly optimizations on if available.
[13:36:51] Entering M.D.
[13:36:57] Tpr hash work/wudata_00.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[13:36:57] Working on 582 p2750_N68H_AM03
[13:36:57] Client config found, loading data.
[13:36:57] Starting GUI Server
[13:36:57] mdrun_gpu returned 
[13:36:57] NANs detected on GPU
[13:36:57] 
[13:36:57] Folding@home Core Shutdown: UNSTABLE_MACHINE
[13:37:01] CoreStatus = 7A (122)
[13:37:01] Sending work to server
[13:37:01] Project: 10632 (Run 93, Clone 54, Gen 38)
[13:37:01] - Read packet limit of 540015616... Set to 524286976.
[13:37:01] - Error: Could not get length of results file work/wuresults_00.dat
[13:37:01] - Error: Could not read unit 00 file. Removing from queue.
[13:37:01] - Preparing to get new work unit...
[13:37:01] Cleaning up work directory
[13:37:01] + Attempting to get work packet
[13:37:01] Passkey found
[13:37:01] Gpu type=3 species=30.
[13:37:01] - Connecting to assignment server
[13:37:02] - Successful: assigned to (171.67.108.20).
[13:37:02] + News From Folding@Home: Welcome to Folding@Home
[13:37:02] Loaded queue successfully.
[13:37:02] Gpu type=3 species=30.
[13:37:03] + Closed connections
[13:37:08] 
[13:37:08] + Processing work unit
[13:37:08] Core required: FahCore_15.exe
[13:37:08] Core found.
[13:37:08] Working on queue slot 01 [October 9 13:37:08 UTC]
[13:37:08] + Working ...
[13:37:08] 
[13:37:08] *------------------------------*
[13:37:08] Folding@Home GPU Core -- Beta
[13:37:08] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[13:37:08] 
[13:37:08] Build host: SimbiosNvdWin7
[13:37:08] Board Type: Nvidia
[13:37:08] Core      : 
[13:37:08] Preparing to commence simulation
[13:37:08] - Looking at optimizations...
[13:37:08] DeleteFrameFiles: successfully deleted file=work/wudata_01.ckp
[13:37:08] - Created dyn
[13:37:08] - Files status OK
[13:37:08] sizeof(CORE_PACKET_HDR) = 512 file=<>
[13:37:08] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[13:37:08] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[13:37:08] - Digital signature verified
[13:37:08] 
[13:37:08] Project: 10632 (Run 93, Clone 54, Gen 38)
[13:37:08] 
[13:37:08] Assembly optimizations on if available.
[13:37:08] Entering M.D.
[13:37:14] Tpr hash work/wudata_01.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[13:37:14] Working on 582 p2750_N68H_AM03
[13:37:14] Client config found, loading data.
[13:37:14] Starting GUI Server
[13:37:14] mdrun_gpu returned 
[13:37:14] NANs detected on GPU
[13:37:14] 
[13:37:14] Folding@home Core Shutdown: UNSTABLE_MACHINE
[13:37:18] CoreStatus = 7A (122)
[13:37:18] Sending work to server
[13:37:18] Project: 10632 (Run 93, Clone 54, Gen 38)
[13:37:18] - Read packet limit of 540015616... Set to 524286976.
[13:37:18] - Error: Could not get length of results file work/wuresults_01.dat
[13:37:18] - Error: Could not read unit 01 file. Removing from queue.
[13:37:18] - Preparing to get new work unit...
[13:37:18] Cleaning up work directory
[13:37:18] + Attempting to get work packet
[13:37:18] Passkey found
[13:37:18] Gpu type=3 species=30.
[13:37:18] - Connecting to assignment server
[13:37:19] - Successful: assigned to (171.67.108.20).
[13:37:19] + News From Folding@Home: Welcome to Folding@Home
[13:37:19] Loaded queue successfully.
[13:37:19] Gpu type=3 species=30.
[13:37:20] + Closed connections
[13:37:25] 
[13:37:25] + Processing work unit
[13:37:25] Core required: FahCore_15.exe
[13:37:25] Core found.
[13:37:25] Working on queue slot 02 [October 9 13:37:25 UTC]
[13:37:25] + Working ...
[13:37:25] 
[13:37:25] *------------------------------*
[13:37:25] Folding@Home GPU Core -- Beta
[13:37:25] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[13:37:25] 
[13:37:25] Build host: SimbiosNvdWin7
[13:37:25] Board Type: Nvidia
[13:37:25] Core      : 
[13:37:25] Preparing to commence simulation
[13:37:25] - Looking at optimizations...
[13:37:25] DeleteFrameFiles: successfully deleted file=work/wudata_02.ckp
[13:37:25] - Created dyn
[13:37:25] - Files status OK
[13:37:25] sizeof(CORE_PACKET_HDR) = 512 file=<>
[13:37:25] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[13:37:25] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[13:37:25] - Digital signature verified
[13:37:25] 
[13:37:25] Project: 10632 (Run 93, Clone 54, Gen 38)
[13:37:25] 
[13:37:25] Assembly optimizations on if available.
[13:37:25] Entering M.D.
[13:37:31] Tpr hash work/wudata_02.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[13:37:31] Working on 582 p2750_N68H_AM03
[13:37:31] Client config found, loading data.
[13:37:31] Starting GUI Server
[13:37:31] mdrun_gpu returned 
[13:37:31] NANs detected on GPU
[13:37:31] 
[13:37:31] Folding@home Core Shutdown: UNSTABLE_MACHINE
[13:37:35] CoreStatus = 7A (122)
[13:37:35] Sending work to server
[13:37:35] Project: 10632 (Run 93, Clone 54, Gen 38)
[13:37:35] - Read packet limit of 540015616... Set to 524286976.
[13:37:35] - Error: Could not get length of results file work/wuresults_02.dat
[13:37:35] - Error: Could not read unit 02 file. Removing from queue.
[13:37:35] - Preparing to get new work unit...
[13:37:35] Cleaning up work directory
[13:37:35] + Attempting to get work packet
[13:37:35] Passkey found
[13:37:35] Gpu type=3 species=30.
[13:37:35] - Connecting to assignment server
[13:37:36] - Successful: assigned to (171.67.108.20).
[13:37:36] + News From Folding@Home: Welcome to Folding@Home
[13:37:36] Loaded queue successfully.
[13:37:36] Gpu type=3 species=30.
[13:37:37] + Closed connections
[13:37:42] 
[13:37:42] + Processing work unit
[13:37:42] Core required: FahCore_15.exe
[13:37:42] Core found.
[13:37:42] Working on queue slot 03 [October 9 13:37:42 UTC]
[13:37:42] + Working ...
[13:37:42] 
[13:37:42] *------------------------------*
[13:37:42] Folding@Home GPU Core -- Beta
[13:37:42] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[13:37:42] 
[13:37:42] Build host: SimbiosNvdWin7
[13:37:42] Board Type: Nvidia
[13:37:42] Core      : 
[13:37:42] Preparing to commence simulation
[13:37:42] - Looking at optimizations...
[13:37:42] DeleteFrameFiles: successfully deleted file=work/wudata_03.ckp
[13:37:42] - Created dyn
[13:37:42] - Files status OK
[13:37:42] sizeof(CORE_PACKET_HDR) = 512 file=<>
[13:37:42] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[13:37:42] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[13:37:42] - Digital signature verified
[13:37:42] 
[13:37:42] Project: 10632 (Run 93, Clone 54, Gen 38)
[13:37:42] 
[13:37:42] Assembly optimizations on if available.
[13:37:42] Entering M.D.
[13:37:48] Tpr hash work/wudata_03.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[13:37:48] Working on 582 p2750_N68H_AM03
[13:37:48] Client config found, loading data.
[13:37:49] Starting GUI Server
[13:37:49] mdrun_gpu returned 
[13:37:49] NANs detected on GPU
[13:37:49] 
[13:37:49] Folding@home Core Shutdown: UNSTABLE_MACHINE
[13:37:52] CoreStatus = 7A (122)
[13:37:52] Sending work to server
[13:37:52] Project: 10632 (Run 93, Clone 54, Gen 38)
[13:37:52] - Read packet limit of 540015616... Set to 524286976.
[13:37:52] - Error: Could not get length of results file work/wuresults_03.dat
[13:37:52] - Error: Could not read unit 03 file. Removing from queue.
[13:37:52] - Preparing to get new work unit...
[13:37:52] Cleaning up work directory
[13:37:52] + Attempting to get work packet
[13:37:52] Passkey found
[13:37:52] Gpu type=3 species=30.
[13:37:52] - Connecting to assignment server
[13:37:53] - Successful: assigned to (171.67.108.20).
[13:37:53] + News From Folding@Home: Welcome to Folding@Home
[13:37:53] Loaded queue successfully.
[13:37:53] Gpu type=3 species=30.
[13:37:54] + Closed connections
[13:37:59] 
[13:37:59] + Processing work unit
[13:37:59] Core required: FahCore_15.exe
[13:37:59] Core found.
[13:37:59] Working on queue slot 04 [October 9 13:37:59 UTC]
[13:37:59] + Working ...
[13:37:59] 
[13:37:59] *------------------------------*
[13:37:59] Folding@Home GPU Core -- Beta
[13:37:59] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[13:37:59] 
[13:37:59] Build host: SimbiosNvdWin7
[13:37:59] Board Type: Nvidia
[13:37:59] Core      : 
[13:37:59] Preparing to commence simulation
[13:37:59] - Looking at optimizations...
[13:37:59] DeleteFrameFiles: successfully deleted file=work/wudata_04.ckp
[13:37:59] - Created dyn
[13:37:59] - Files status OK
[13:37:59] sizeof(CORE_PACKET_HDR) = 512 file=<>
[13:37:59] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[13:37:59] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[13:37:59] - Digital signature verified
[13:37:59] 
[13:37:59] Project: 10632 (Run 93, Clone 54, Gen 38)
[13:37:59] 
[13:37:59] Assembly optimizations on if available.
[13:37:59] Entering M.D.
[13:38:05] Tpr hash work/wudata_04.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[13:38:05] Working on 582 p2750_N68H_AM03
[13:38:05] Client config found, loading data.
[13:38:06] Starting GUI Server
[13:38:06] mdrun_gpu returned 
[13:38:06] NANs detected on GPU
[13:38:06] 
[13:38:06] Folding@home Core Shutdown: UNSTABLE_MACHINE
[13:38:10] CoreStatus = 7A (122)
[13:38:10] Sending work to server
[13:38:10] Project: 10632 (Run 93, Clone 54, Gen 38)
[13:38:10] - Read packet limit of 540015616... Set to 524286976.
[13:38:10] - Error: Could not get length of results file work/wuresults_04.dat
[13:38:10] - Error: Could not read unit 04 file. Removing from queue.
[13:38:10] EUE limit exceeded. Pausing 24 hours.

Even though I successfully folded another WU in between:

Code: Select all

[22:23:15] Gpu type=3 species=30.
[22:23:16] Loaded queue successfully.
[22:23:16] - Preparing to get new work unit...
[22:23:16] Cleaning up work directory
[22:23:16] + Attempting to get work packet
[22:23:16] Passkey found
[22:23:16] Gpu type=3 species=30.
[22:23:16] - Connecting to assignment server
[22:23:18] - Successful: assigned to (171.67.108.20).
[22:23:18] + News From Folding@Home: Welcome to Folding@Home
[22:23:18] Loaded queue successfully.
[22:23:18] Gpu type=3 species=30.
[22:23:20] + Closed connections
[22:23:20] 
[22:23:20] + Processing work unit
[22:23:20] Core required: FahCore_15.exe
[22:23:20] Core found.
[22:23:20] Working on queue slot 04 [October 9 22:23:20 UTC]
[22:23:20] + Working ...
[22:23:20] 
[22:23:20] *------------------------------*
[22:23:20] Folding@Home GPU Core -- Beta
[22:23:20] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[22:23:20] 
[22:23:20] Build host: SimbiosNvdWin7
[22:23:20] Board Type: Nvidia
[22:23:20] Core      : 
[22:23:20] Preparing to commence simulation
[22:23:20] - Looking at optimizations...
[22:23:20] DeleteFrameFiles: successfully deleted file=work/wudata_04.ckp
[22:23:20] - Created dyn
[22:23:20] - Files status OK
[22:23:20] sizeof(CORE_PACKET_HDR) = 512 file=<>
[22:23:20] - Expanded 43688 -> 163067 (decompressed 373.2 percent)
[22:23:20] Called DecompressByteArray: compressed_data_size=43688 data_size=163067, decompressed_data_size=163067 diff=0
[22:23:20] - Digital signature verified
[22:23:20] 
[22:23:20] Project: 10632 (Run 75, Clone 87, Gen 38)
[22:23:20] 
[22:23:20] Assembly optimizations on if available.
[22:23:20] Entering M.D.
[22:23:26] Tpr hash work/wudata_04.tpr:  3972616023 1936784576 3187598548 2513468161 1602375039
[22:23:26] Working on 582 p2750_N68H_AM03
[22:23:26] Client config found, loading data.
[22:23:26] Starting GUI Server
[22:24:19] Completed 1%
[22:25:11] Completed 2%
[22:26:04] Completed 3%
[22:26:56] Completed 4%
[22:27:48] Completed 5%
[22:28:41] Completed 6%
[22:29:33] Completed 7%
[22:30:26] Completed 8%
[22:31:19] Completed 9%
[22:32:11] Completed 10%
[22:33:04] Completed 11%
[22:33:56] Completed 12%
[22:34:49] Completed 13%
[22:35:42] Completed 14%
[22:36:34] Completed 15%
[22:37:28] Completed 16%
[22:38:20] Completed 17%
[22:39:13] Completed 18%
[22:40:06] Completed 19%
[22:40:58] Completed 20%
[22:41:51] Completed 21%
[22:42:43] Completed 22%
[22:43:36] Completed 23%
[22:44:28] Completed 24%
[22:45:20] Completed 25%
[22:46:13] Completed 26%
[22:47:06] Completed 27%
[22:47:58] Completed 28%
[22:48:51] Completed 29%
[22:49:43] Completed 30%
[22:50:36] Completed 31%
[22:51:28] Completed 32%
[22:52:20] Completed 33%
[22:53:13] Completed 34%
[22:54:05] Completed 35%
[22:54:58] Completed 36%
[22:55:50] Completed 37%
[22:56:42] Completed 38%
[22:57:35] Completed 39%
[22:58:27] Completed 40%
[22:59:20] Completed 41%
[23:00:12] Completed 42%
[23:01:04] Completed 43%
[23:01:57] Completed 44%
[23:02:49] Completed 45%
[23:03:42] Completed 46%
[23:04:34] Completed 47%
[23:05:27] Completed 48%
[23:06:19] Completed 49%
[23:07:12] Completed 50%
[23:08:04] Completed 51%
[23:08:57] Completed 52%
[23:09:50] Completed 53%
[23:10:42] Completed 54%

Folding@Home Client Shutdown.


--- Opening Log file [October 9 23:14:54 UTC] 


# Windows GPU Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.30r1

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\FAHGPU1
Service: C:\FAHGPU1\Folding@home-Win32-GPU.exe
Arguments: -svcstart -d C:\FAHGPU1 -gpu 0 

Launched as a service.
Entered C:\FAHGPU1 to do work.

[23:14:54] - Ask before connecting: No
[23:14:54] - User name: Derrickmcc (Team 170719)
[23:14:54] - User ID: 416D59990044B787
[23:14:54] - Machine ID: 1
[23:14:54] 
[23:14:54] Gpu type=3 species=30.
[23:14:55] Loaded queue successfully.
[23:14:55] 
[23:14:55] + Processing work unit
[23:14:55] Core required: FahCore_15.exe
[23:14:55] Core found.
[23:14:55] Working on queue slot 04 [October 9 23:14:55 UTC]
[23:14:55] + Working ...
[23:14:55] 
[23:14:55] *------------------------------*
[23:14:55] Folding@Home GPU Core -- Beta
[23:14:55] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[23:14:55] 
[23:14:55] Build host: SimbiosNvdWin7
[23:14:55] Board Type: Nvidia
[23:14:55] Core      : 
[23:14:55] Preparing to commence simulation
[23:14:55] - Ensuring status. Please wait.
[23:15:09] - Looking at optimizations...
[23:15:09] - Working with standard loops on this execution.
[23:15:11] - Files status OK
[23:15:11] sizeof(CORE_PACKET_HDR) = 512 file=<>
[23:15:11] - Expanded 43688 -> 163067 (decompressed 373.2 percent)
[23:15:11] Called DecompressByteArray: compressed_data_size=43688 data_size=163067, decompressed_data_size=163067 diff=0
[23:15:11] - Digital signature verified
[23:15:11] 
[23:15:11] Project: 10632 (Run 75, Clone 87, Gen 38)
[23:15:11] 
[23:15:11] Entering M.D.


--- Opening Log file [October 9 23:18:00 UTC] 


# Windows GPU Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.30r1

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\FAHGPU1
Service: C:\FAHGPU1\Folding@home-Win32-GPU.exe
Arguments: -svcstart -d C:\FAHGPU1 -gpu 0 

Launched as a service.
Entered C:\FAHGPU1 to do work.

[23:18:00] - Ask before connecting: No
[23:18:00] - User name: Derrickmcc (Team 170719)
[23:18:00] - User ID: 416D59990044B787
[23:18:00] - Machine ID: 1
[23:18:00] 
[23:18:00] Gpu type=3 species=30.
[23:18:00] Loaded queue successfully.
[23:18:00] 
[23:18:00] + Processing work unit
[23:18:00] Core required: FahCore_15.exe
[23:18:00] Core found.
[23:18:00] Working on queue slot 04 [October 9 23:18:00 UTC]
[23:18:00] + Working ...
[23:18:01] 
[23:18:01] *------------------------------*
[23:18:01] Folding@Home GPU Core -- Beta
[23:18:01] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[23:18:01] 
[23:18:01] Build host: SimbiosNvdWin7
[23:18:01] Board Type: Nvidia
[23:18:01] Core      : 
[23:18:01] Preparing to commence simulation
[23:18:01] - Ensuring status. Please wait.
[23:18:10] - Looking at optimizations...
[23:18:10] - Working with standard loops on this execution.
[23:18:11] - Files status OK
[23:18:11] sizeof(CORE_PACKET_HDR) = 512 file=<>
[23:18:11] - Expanded 43688 -> 163067 (decompressed 373.2 percent)
[23:18:11] Called DecompressByteArray: compressed_data_size=43688 data_size=163067, decompressed_data_size=163067 diff=0
[23:18:11] - Digital signature verified
[23:18:11] 
[23:18:11] Project: 10632 (Run 75, Clone 87, Gen 38)
[23:18:11] 
[23:18:11] Entering M.D.
[23:18:17] Will resume from checkpoint file work/wudata_04.ckp
[23:18:17] Tpr hash work/wudata_04.tpr:  3972616023 1936784576 3187598548 2513468161 1602375039
[23:18:17] Working on 582 p2750_N68H_AM03
[23:18:17] Client config found, loading data.
[23:18:17] Starting GUI Server
[23:18:17] Resuming from checkpoint
[23:18:17] fcCheckPointResume: retreived and current tpr file hash:
[23:18:17]    0   3972616023   3972616023
[23:18:17]    1   1936784576   1936784576
[23:18:17]    2   3187598548   3187598548
[23:18:17]    3   2513468161   2513468161
[23:18:17]    4   1602375039   1602375039
[23:18:17] fcCheckPointResume: file hashes same.
[23:18:17] fcCheckPointResume: state restored.
[23:18:17] fcCheckPointResume: name work/wudata_04.log Verified work/wudata_04.log
[23:18:17] fcCheckPointResume: name work/wudata_04.trr Verified work/wudata_04.trr
[23:18:18] fcCheckPointResume: name work/wudata_04.xtc Verified work/wudata_04.xtc
[23:18:18] fcCheckPointResume: name work/wudata_04.edr Verified work/wudata_04.edr
[23:18:18] fcCheckPointResume: state restored 2
[23:18:18] Resumed from checkpoint
[23:18:18] Completed 54%
[23:19:16] Completed 55%
[23:20:08] Completed 56%
[23:21:01] Completed 57%
[23:21:54] Completed 58%
[23:22:47] Completed 59%
[23:23:40] Completed 60%
[23:24:33] Completed 61%
[23:25:26] Completed 62%
[23:26:19] Completed 63%
[23:27:11] Completed 64%
[23:28:04] Completed 65%
[23:28:56] Completed 66%
[23:29:49] Completed 67%
[23:30:41] Completed 68%
[23:31:34] Completed 69%
[23:32:26] Completed 70%
[23:33:19] Completed 71%
[23:34:12] Completed 72%
[23:35:05] Completed 73%
[23:35:57] Completed 74%
[23:36:50] Completed 75%
[23:37:42] Completed 76%
[23:38:35] Completed 77%
[23:39:27] Completed 78%
[23:40:20] Completed 79%
[23:41:12] Completed 80%
[23:42:05] Completed 81%
[23:43:07] Completed 82%
[23:44:13] Completed 83%
[23:45:18] Completed 84%
[23:46:24] Completed 85%
[23:47:29] Completed 86%
[23:48:35] Completed 87%
[23:49:40] Completed 88%
[23:50:46] Completed 89%
[23:51:52] Completed 90%
[23:53:00] Completed 91%
[23:54:08] Completed 92%
[23:55:13] Completed 93%
[23:56:20] Completed 94%
[23:57:25] Completed 95%
[23:58:31] Completed 96%
[23:59:37] Completed 97%
[00:00:43] Completed 98%
[00:01:50] Completed 99%
[00:02:56] Completed 100%
[00:02:56] Finished fah_main
[00:02:56] 
[00:02:56] Successful run
[00:02:56] DynamicWrapper: Finished Work Unit: sleep=10000
[00:03:06] Reserved 11348 bytes for xtc file; Cosm status=0
[00:03:06] Allocated 11348 bytes for xtc file
[00:03:06] - Reading up to 11348 from "work/wudata_04.xtc": Read 11348
[00:03:06] Read 11348 bytes from xtc file; available packet space=786419116
[00:03:06] xtc file hash check passed.
[00:03:06] Reserved 3621840 3621840 786419116 bytes for arc file=<work/wudata_04.trr> Cosm status=0
[00:03:06] Allocated 3621840 bytes for arc file
[00:03:06] - Reading up to 3621840 from "work/wudata_04.trr": Read 3621840
[00:03:06] Read 3621840 bytes from arc file; available packet space=782797276
[00:03:06] trr file hash check passed.
[00:03:06] Allocated 544 bytes for edr file
[00:03:06] Read bedfile
[00:03:06] edr file hash check passed.
[00:03:06] Allocated 497753 bytes for logfile
[00:03:06] Read logfile
[00:03:06] GuardedRun: success in DynamicWrapper
[00:03:06] GuardedRun: done
[00:03:06] Run: GuardedRun completed.
[00:03:08] + Opened results file
[00:03:08] - Writing 4131997 bytes of core data to disk...
[00:03:09] Done: 4131485 -> 3086693 (compressed to 74.7 percent)
[00:03:09]   ... Done.
[00:03:09] DeleteFrameFiles: successfully deleted file=work/wudata_04.ckp
[00:03:10] Shutting down core 
[00:03:10] 
[00:03:10] Folding@home Core Shutdown: FINISHED_UNIT
[00:03:13] CoreStatus = 64 (100)
[00:03:13] Sending work to server
[00:03:13] Project: 10632 (Run 75, Clone 87, Gen 38)
[00:03:13] - Read packet limit of 540015616... Set to 524286976.


[00:03:13] + Attempting to send results [October 10 00:03:13 UTC]
[00:03:13] Gpu type=3 species=30.
[00:05:10] + Results successfully sent
[00:05:10] Thank you for your contribution to Folding@Home.
[00:05:10] + Number of Units Completed: 1308

Why has it come back again?

derrickmcc · Post by **derrickmcc** » Sun Oct 10, 2010 12:54 am

I have tried switching this WU to another GPU, but I I get exactly the same failure on the other GPU.
I have run MemtestG80 which has not reported any errors.

sortofageek · Post by **sortofageek** » Sun Oct 10, 2010 1:01 am

Thanks for the report, sorry about the issues. However, Project: 10632 (Run 93, Clone 54, Gen 38) was successfully completed by another folder.

derrickmcc · Post by **derrickmcc** » Sun Oct 10, 2010 1:23 am

sortofageek wrote:Thanks for the report, sorry about the issues. However, Project: 10632 (Run 93, Clone 54, Gen 38) was successfully completed by another folder.

Yes, but why is the Work Server still issuing the same WU to me, if it has already been completed by someone else?

I have tried deleting the work directory and queue.dat, and it still keeps coming back.

I have lost a day's folding on that one GPU and spent hours trying to overcome the issue, how do I progress?

Edit:
I have disabled my original GPU folder.
I have set up a 3rd GPU folder and assigned my original GPU to it with a machine ID of 3. This has now picked up a new 10632 WU which is folding.

fayzacantik · Post by **fayzacantik** » Sun Oct 10, 2010 2:14 am

for last 24 hours my GTX460 only receive 10632 with no fail,
honestly I hate it less PPD higher temp but did I have any choice ?

sortofageek · Post by **sortofageek** » Sun Oct 10, 2010 2:31 am

derrickmcc wrote: I have lost a day's folding on that one GPU and spent hours trying to overcome the issue, how do I progress?
Edit:
I have disabled my original GPU folder.
I have set up a 3rd GPU folder and assigned my original GPU to it with a machine ID of 3. This has now picked up a new 10632 WU which is folding.

I would have suggested changing the machine ID, too. Good choice.

sortofageek · Post by **sortofageek** » Sun Oct 10, 2010 2:32 am

fayzacantik wrote: I hate it less PPD higher temp but did I have any choice ?

For the most part, if we just fold, we all get some with higher PPD and some with lower. It tends to even out over time.

derrickmcc · Post by **derrickmcc** » Sun Oct 10, 2010 9:27 am

To misquote Sheakespeare (I think!):
Will nobody rid me of this pestilent WU?

It's back again, after completing Project: 10632 (Run 25, Clone 76, Gen 47):

Code: Select all

[08:54:15] Folding@home Core Shutdown: FINISHED_UNIT
[08:54:18] CoreStatus = 64 (100)
[08:54:18] Sending work to server
[08:54:18] Project: 10632 (Run 25, Clone 76, Gen 47)
[08:54:18] - Read packet limit of 540015616... Set to 524286976.


[08:54:18] + Attempting to send results [October 10 08:54:18 UTC]
[08:54:18] Gpu type=3 species=30.
[08:55:29] + Results successfully sent
[08:55:29] Thank you for your contribution to Folding@Home.
[08:55:29] + Number of Units Completed: 1309

[08:55:33] - Preparing to get new work unit...
[08:55:33] Cleaning up work directory
[08:55:33] + Attempting to get work packet
[08:55:33] Passkey found
[08:55:33] Gpu type=3 species=30.
[08:55:33] - Connecting to assignment server
[08:55:34] - Successful: assigned to (171.67.108.20).
[08:55:34] + News From Folding@Home: Welcome to Folding@Home
[08:55:35] Loaded queue successfully.
[08:55:35] Gpu type=3 species=30.
[08:55:36] + Closed connections
[08:55:36] 
[08:55:36] + Processing work unit
[08:55:36] Core required: FahCore_15.exe
[08:55:36] Core found.
[08:55:36] Working on queue slot 03 [October 10 08:55:36 UTC]
[08:55:36] + Working ...
[08:55:36] 
[08:55:36] *------------------------------*
[08:55:36] Folding@Home GPU Core -- Beta
[08:55:36] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[08:55:36] 
[08:55:36] Build host: SimbiosNvdWin7
[08:55:36] Board Type: Nvidia
[08:55:36] Core      : 
[08:55:36] Preparing to commence simulation
[08:55:36] - Looking at optimizations...
[08:55:36] DeleteFrameFiles: successfully deleted file=work/wudata_03.ckp
[08:55:36] - Created dyn
[08:55:36] - Files status OK
[08:55:36] sizeof(CORE_PACKET_HDR) = 512 file=<>
[08:55:36] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[08:55:36] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[08:55:36] - Digital signature verified
[08:55:36] 
[08:55:36] Project: 10632 (Run 93, Clone 54, Gen 38)
[08:55:36] 
[08:55:36] Assembly optimizations on if available.
[08:55:36] Entering M.D.
[08:55:42] Tpr hash work/wudata_03.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[08:55:42] Working on 582 p2750_N68H_AM03
[08:55:42] Client config found, loading data.
[08:55:42] Starting GUI Server
[08:55:42] mdrun_gpu returned 
[08:55:42] NANs detected on GPU
[08:55:42] 
[08:55:42] Folding@home Core Shutdown: UNSTABLE_MACHINE
[08:55:46] CoreStatus = 7A (122)
[08:55:46] Sending work to server
[08:55:46] Project: 10632 (Run 93, Clone 54, Gen 38)
[08:55:46] - Read packet limit of 540015616... Set to 524286976.
[08:55:46] - Error: Could not get length of results file work/wuresults_03.dat
[08:55:46] - Error: Could not read unit 03 file. Removing from queue.
[08:55:46] - Preparing to get new work unit...
[08:55:46] Cleaning up work directory
[08:55:46] + Attempting to get work packet
[08:55:46] Passkey found
[08:55:46] Gpu type=3 species=30.
[08:55:46] - Connecting to assignment server
[08:55:47] - Successful: assigned to (171.67.108.20).
[08:55:47] + News From Folding@Home: Welcome to Folding@Home
[08:55:47] Loaded queue successfully.
[08:55:47] Gpu type=3 species=30.
[08:55:48] + Closed connections
[08:55:53] 
[08:55:53] + Processing work unit
[08:55:53] Core required: FahCore_15.exe
[08:55:53] Core found.
[08:55:53] Working on queue slot 04 [October 10 08:55:53 UTC]
[08:55:53] + Working ...
[08:55:53] 
[08:55:53] *------------------------------*
[08:55:53] Folding@Home GPU Core -- Beta
[08:55:53] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[08:55:53] 
[08:55:53] Build host: SimbiosNvdWin7
[08:55:53] Board Type: Nvidia
[08:55:53] Core      : 
[08:55:53] Preparing to commence simulation
[08:55:53] - Looking at optimizations...
[08:55:53] DeleteFrameFiles: successfully deleted file=work/wudata_04.ckp
[08:55:53] - Created dyn
[08:55:53] - Files status OK
[08:55:53] sizeof(CORE_PACKET_HDR) = 512 file=<>
[08:55:53] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[08:55:53] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[08:55:53] - Digital signature verified
[08:55:53] 
[08:55:53] Project: 10632 (Run 93, Clone 54, Gen 38)
[08:55:53] 
[08:55:53] Assembly optimizations on if available.
[08:55:53] Entering M.D.
[08:55:59] Tpr hash work/wudata_04.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[08:55:59] Working on 582 p2750_N68H_AM03
[08:55:59] Client config found, loading data.
[08:55:59] Starting GUI Server
[08:55:59] mdrun_gpu returned 
[08:55:59] NANs detected on GPU
[08:55:59] 
[08:55:59] Folding@home Core Shutdown: UNSTABLE_MACHINE
[08:56:03] CoreStatus = 7A (122)
[08:56:03] Sending work to server
[08:56:03] Project: 10632 (Run 93, Clone 54, Gen 38)
[08:56:03] - Read packet limit of 540015616... Set to 524286976.
[08:56:03] - Error: Could not get length of results file work/wuresults_04.dat
[08:56:03] - Error: Could not read unit 04 file. Removing from queue.
[08:56:03] - Preparing to get new work unit...
[08:56:03] Cleaning up work directory
[08:56:03] + Attempting to get work packet
[08:56:03] Passkey found
[08:56:03] Gpu type=3 species=30.
[08:56:03] - Connecting to assignment server
[08:56:04] - Successful: assigned to (171.67.108.20).
[08:56:04] + News From Folding@Home: Welcome to Folding@Home
[08:56:04] Loaded queue successfully.
[08:56:04] Gpu type=3 species=30.
[08:56:05] + Closed connections
[08:56:10] 
[08:56:10] + Processing work unit
[08:56:10] Core required: FahCore_15.exe
[08:56:10] Core found.
[08:56:10] Working on queue slot 05 [October 10 08:56:10 UTC]
[08:56:10] + Working ...
[08:56:10] 
[08:56:10] *------------------------------*
[08:56:10] Folding@Home GPU Core -- Beta
[08:56:10] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[08:56:10] 
[08:56:10] Build host: SimbiosNvdWin7
[08:56:10] Board Type: Nvidia
[08:56:10] Core      : 
[08:56:10] Preparing to commence simulation
[08:56:10] - Looking at optimizations...
[08:56:10] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[08:56:10] - Created dyn
[08:56:10] - Files status OK
[08:56:10] sizeof(CORE_PACKET_HDR) = 512 file=<>
[08:56:10] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[08:56:10] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[08:56:10] - Digital signature verified
[08:56:10] 
[08:56:10] Project: 10632 (Run 93, Clone 54, Gen 38)
[08:56:10] 
[08:56:10] Assembly optimizations on if available.
[08:56:10] Entering M.D.
[08:56:16] Tpr hash work/wudata_05.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[08:56:16] Working on 582 p2750_N68H_AM03
[08:56:16] Client config found, loading data.
[08:56:16] Starting GUI Server
[08:56:16] mdrun_gpu returned 
[08:56:16] NANs detected on GPU
[08:56:16] 
[08:56:16] Folding@home Core Shutdown: UNSTABLE_MACHINE
[08:56:20] CoreStatus = 7A (122)
[08:56:20] Sending work to server
[08:56:20] Project: 10632 (Run 93, Clone 54, Gen 38)
[08:56:20] - Read packet limit of 540015616... Set to 524286976.
[08:56:20] - Error: Could not get length of results file work/wuresults_05.dat
[08:56:20] - Error: Could not read unit 05 file. Removing from queue.
[08:56:20] - Preparing to get new work unit...
[08:56:20] Cleaning up work directory
[08:56:20] + Attempting to get work packet
[08:56:20] Passkey found
[08:56:20] Gpu type=3 species=30.
[08:56:20] - Connecting to assignment server
[08:56:21] - Successful: assigned to (171.67.108.20).
[08:56:21] + News From Folding@Home: Welcome to Folding@Home
[08:56:21] Loaded queue successfully.
[08:56:21] Gpu type=3 species=30.
[08:56:22] + Closed connections
[08:56:27] 
[08:56:27] + Processing work unit
[08:56:27] Core required: FahCore_15.exe
[08:56:27] Core found.
[08:56:27] Working on queue slot 06 [October 10 08:56:27 UTC]
[08:56:27] + Working ...
[08:56:27] 
[08:56:27] *------------------------------*
[08:56:27] Folding@Home GPU Core -- Beta
[08:56:27] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[08:56:27] 
[08:56:27] Build host: SimbiosNvdWin7
[08:56:27] Board Type: Nvidia
[08:56:27] Core      : 
[08:56:27] Preparing to commence simulation
[08:56:27] - Looking at optimizations...
[08:56:27] DeleteFrameFiles: successfully deleted file=work/wudata_06.ckp
[08:56:27] - Created dyn
[08:56:27] - Files status OK
[08:56:27] sizeof(CORE_PACKET_HDR) = 512 file=<>
[08:56:27] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[08:56:27] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[08:56:27] - Digital signature verified
[08:56:27] 
[08:56:27] Project: 10632 (Run 93, Clone 54, Gen 38)
[08:56:27] 
[08:56:27] Assembly optimizations on if available.
[08:56:27] Entering M.D.
[08:56:33] Tpr hash work/wudata_06.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[08:56:33] Working on 582 p2750_N68H_AM03
[08:56:33] Client config found, loading data.
[08:56:34] Starting GUI Server
[08:56:34] mdrun_gpu returned 
[08:56:34] NANs detected on GPU
[08:56:34] 
[08:56:34] Folding@home Core Shutdown: UNSTABLE_MACHINE
[08:56:37] CoreStatus = 7A (122)
[08:56:37] Sending work to server
[08:56:37] Project: 10632 (Run 93, Clone 54, Gen 38)
[08:56:37] - Read packet limit of 540015616... Set to 524286976.
[08:56:37] - Error: Could not get length of results file work/wuresults_06.dat
[08:56:37] - Error: Could not read unit 06 file. Removing from queue.
[08:56:37] - Preparing to get new work unit...
[08:56:37] Cleaning up work directory
[08:56:37] + Attempting to get work packet
[08:56:37] Passkey found
[08:56:37] Gpu type=3 species=30.
[08:56:37] - Connecting to assignment server
[08:56:38] - Successful: assigned to (171.67.108.20).
[08:56:38] + News From Folding@Home: Welcome to Folding@Home
[08:56:38] Loaded queue successfully.
[08:56:38] Gpu type=3 species=30.
[08:56:39] + Closed connections
[08:56:44] 
[08:56:44] + Processing work unit
[08:56:44] Core required: FahCore_15.exe
[08:56:44] Core found.
[08:56:44] Working on queue slot 07 [October 10 08:56:44 UTC]
[08:56:44] + Working ...
[08:56:44] 
[08:56:44] *------------------------------*
[08:56:44] Folding@Home GPU Core -- Beta
[08:56:44] Version 2.09 (Thu May 20 11:58:42 PDT 2010)
[08:56:44] 
[08:56:44] Build host: SimbiosNvdWin7
[08:56:44] Board Type: Nvidia
[08:56:44] Core      : 
[08:56:44] Preparing to commence simulation
[08:56:44] - Looking at optimizations...
[08:56:44] DeleteFrameFiles: successfully deleted file=work/wudata_07.ckp
[08:56:44] - Created dyn
[08:56:44] - Files status OK
[08:56:44] sizeof(CORE_PACKET_HDR) = 512 file=<>
[08:56:44] - Expanded 28895 -> 163067 (decompressed 564.3 percent)
[08:56:44] Called DecompressByteArray: compressed_data_size=28895 data_size=163067, decompressed_data_size=163067 diff=0
[08:56:44] - Digital signature verified
[08:56:44] 
[08:56:44] Project: 10632 (Run 93, Clone 54, Gen 38)
[08:56:44] 
[08:56:44] Assembly optimizations on if available.
[08:56:44] Entering M.D.
[08:56:50] Tpr hash work/wudata_07.tpr:  3823246627 3796707283 429810980 2561810141 2930517220
[08:56:50] Working on 582 p2750_N68H_AM03
[08:56:50] Client config found, loading data.
[08:56:51] Starting GUI Server
[08:56:51] mdrun_gpu returned 
[08:56:51] NANs detected on GPU
[08:56:51] 
[08:56:51] Folding@home Core Shutdown: UNSTABLE_MACHINE
[08:56:54] CoreStatus = 7A (122)
[08:56:54] Sending work to server
[08:56:54] Project: 10632 (Run 93, Clone 54, Gen 38)
[08:56:54] - Read packet limit of 540015616... Set to 524286976.
[08:56:54] - Error: Could not get length of results file work/wuresults_07.dat
[08:56:54] - Error: Could not read unit 07 file. Removing from queue.
[08:56:54] EUE limit exceeded. Pausing 24 hours.

I will shut down this folder until the WU expires.

derrickmcc · Post by **derrickmcc** » Sun Oct 10, 2010 10:16 am

As a matter of interest, here is the WU data log file (the log is identical for each failed attempt to run this WU):

Code: Select all

Log file opened on Sun Oct 10 10:16:13 2010
Host: unknown  pid: 3480  nodeid: 0  nnodes:  1 fp=00000004
The Gromacs distribution was built Unknown date by
Anonymous@unknown [CMAKE] (Windows-6.1 x86)



++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
B. Hess and C. Kutzner and D. van der Spoel and E. Lindahl
GROMACS 4: Algorithms for highly efficient, load-balanced, and scalable
molecular simulation
J. Chem. Theory Comput. 4 (2008) pp. 435-447
-------- -------- --- Thank You --- -------- --------


++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
D. van der Spoel, E. Lindahl, B. Hess, G. Groenhof, A. E. Mark and H. J. C.
Berendsen
GROMACS: Fast, Flexible and Free
J. Comp. Chem. 26 (2005) pp. 1701-1719
-------- -------- --- Thank You --- -------- --------


++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
E. Lindahl and B. Hess and D. van der Spoel
GROMACS 3.0: A package for molecular simulation and trajectory analysis
J. Mol. Mod. 7 (2001) pp. 306-317
-------- -------- --- Thank You --- -------- --------


++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
H. J. C. Berendsen, D. van der Spoel and R. van Drunen
GROMACS: A message-passing parallel molecular dynamics implementation
Comp. Phys. Comm. 91 (1995) pp. 43-56
-------- -------- --- Thank You --- -------- --------


*-----------------------------------------------------------------------------------------*
GROMACS_FAH
Version:     2.09 (Thu May 20 11:58:58 PDT 2010) NVIDIA
Compilation: 11:59:19
Build host:  SimbiosNvdWin7

*-----------------------------------------------------------------------------------------*
Input Parameters:
   integrator           = sd
   nsteps               = 25000000
   init_step            = 950000000
   ns_type              = Simple
   nstlist              = 20000001
   ndelta               = 2
   nstcomm              = 1000000
   comm_mode            = Linear
   nstlog               = 5000
   nstxout              = 50000
   nstvout              = 5000000
   nstfout              = 5000000
   nstenergy            = 0
   nstxtcout            = 5000000
   init_t               = 0
   delta_t              = 0.002
   xtcprec              = 1000
   nkx                  = 0
   nky                  = 0
   nkz                  = 0
   pme_order            = 4
   ewald_rtol           = 1e-005
   ewald_geometry       = 0
   epsilon_surface      = 0
   optimize_fft         = FALSE
   ePBC                 = no
   bPeriodicMols        = FALSE
   bContinuation        = TRUE
   bShakeSOR            = FALSE
   etc                  = No
   epc                  = No
   epctype              = Isotropic
   tau_p                = 1
   ref_p (3x3):
      ref_p[    0]={0.00000e+000, 0.00000e+000, 0.00000e+000}
      ref_p[    1]={0.00000e+000, 0.00000e+000, 0.00000e+000}
      ref_p[    2]={0.00000e+000, 0.00000e+000, 0.00000e+000}
   compress (3x3):
      compress[    0]={0.00000e+000, 0.00000e+000, 0.00000e+000}
      compress[    1]={0.00000e+000, 0.00000e+000, 0.00000e+000}
      compress[    2]={0.00000e+000, 0.00000e+000, 0.00000e+000}
   refcoord_scaling     = No
   posres_com (3):
      posres_com[0]=0.00000e+000
      posres_com[1]=0.00000e+000
      posres_com[2]=0.00000e+000
   posres_comB (3):
      posres_comB[0]=0.00000e+000
      posres_comB[1]=0.00000e+000
      posres_comB[2]=0.00000e+000
   andersen_seed        = 815131
   rlist                = 100
   rtpi                 = 0.05
   coulombtype          = Cut-off
   rcoulomb_switch      = 0
   rcoulomb             = 100
   vdwtype              = Cut-off
   rvdw_switch          = 0
   rvdw                 = 100
   epsilon_r            = 1
   epsilon_rf           = 1
   tabext               = 1
   implicit_solvent     = GBSA
   gb_algorithm         = OBC
   gb_epsilon_solvent   = 80
   nstgbradii           = 1
   rgbradii             = 2
   gb_saltconc          = 0
   gb_obc_alpha         = 1
   gb_obc_beta          = 0.8
   gb_obc_gamma         = 4.85
   sa_surface_tension   = 2.092
   DispCorr             = No
   free_energy          = no
   init_lambda          = 0
   sc_alpha             = 0
   sc_power             = 0
   sc_sigma             = 0.3
   delta_lambda         = 0
   nwall                = 0
   wall_type            = 9-3
   wall_atomtype[0]     = -1
   wall_atomtype[1]     = -1
   wall_density[0]      = 0
   wall_density[1]      = 0
   wall_ewald_zfac      = 3
   pull                 = no
   disre                = No
   disre_weighting      = Conservative
   disre_mixed          = FALSE
   dr_fc                = 1000
   dr_tau               = 0
   nstdisreout          = 100
   orires_fc            = 0
   orires_tau           = 0
   nstorireout          = 100
   dihre-fc             = 1000
   em_stepsize          = 0.01
   em_tol               = 10
   niter                = 20
   fc_stepsize          = 0
   nstcgsteep           = 1000
   nbfgscorr            = 10
   ConstAlg             = Shake
   shake_tol            = 0.0001
   lincs_order          = 4
   lincs_warnangle      = 30
   lincs_iter           = 1
   bd_fric              = 0
   ld_seed              = 120096
   cos_accel            = 0
   deform (3x3):
      deform[    0]={0.00000e+000, 0.00000e+000, 0.00000e+000}
      deform[    1]={0.00000e+000, 0.00000e+000, 0.00000e+000}
      deform[    2]={0.00000e+000, 0.00000e+000, 0.00000e+000}
   userint1             = 0
   userint2             = 0
   userint3             = 0
   userint4             = 0
   userreal1            = 0
   userreal2            = 0
   userreal3            = 0
   userreal4            = 0
grpopts:
   nrdf:        1450
   ref_t:         300
   tau_t:     0.01099
anneal:          No
ann_npoints:           0
   acc:	           0           0           0
   nfreeze:           N           N           N
   energygrp_flags[  0]: 0
   efield-x:
      n = 0
   efield-xt:
      n = 0
   efield-y:
      n = 0
   efield-yt:
      n = 0
   efield-z:
      n = 0
   efield-zt:
      n = 0
   bQMMM                = FALSE
   QMconstraints        = 0
   QMMMscheme           = 0
   scalefactor          = 1
qm_opts:
   ngQM                 = 0
Table routines are used for coulomb: FALSE
Table routines are used for vdw:     FALSE
Cut-off's:   NS: 100   Coulomb: 100   LJ: 100
System total charge: 2.000
Generated table with 50500 data points for 1-4 COUL.
Tabscale = 500 points/nm
Generated table with 50500 data points for 1-4 LJ6.
Tabscale = 500 points/nm
Generated table with 50500 data points for 1-4 LJ12.
Tabscale = 500 points/nm
Configuring nonbonded kernels...



++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
J. P. Ryckaert and G. Ciccotti and H. J. C. Berendsen
Numerical Integration of the Cartesian Equations of Motion of a System with
Constraints; Molecular Dynamics of n-Alkanes
J. Comp. Phys. 23 (1977) pp. 327-341
-------- -------- --- Thank You --- -------- --------

Center of mass motion removal mode is Linear
We have the following groups for center of mass motion removal:
  0:  rest
There are: 582 Atoms
System name is <582 p2750_N68H_AM03>
FAH VERSION 209
Board type  NVIDIA
ljFactor=1.000 chargeFactor=1.000 14LJ=1.000 14QQ=0.833
Environment variable CUDA_DEVICE is not set.
Setting device for CUDA Platform: 0
OpenMM Platform: Cuda
Properties: 
CudaDevice: 0
CudaUseBlockingSync: true
SM: SM_20
OpenMMCudaBuild: Fermi
OpenMMCudaVersion: 3000
OpenMMVersion: 1.0
OpenMMSvnVersion: 2248M
WindowsVersion: 5.1
GpuBoard: GeForce GTX 460


Number of particles=582 forces=7
    0 COM frequency          1000000
    1 HarmonicBond           296
       0      579      581 1.2500000e-001 5.4894081e+005
       1      579      580 1.2500000e-001 5.4894081e+005
       2      575      577 1.4000000e-001 3.9245919e+005
       3        0        4 1.4710000e-001 3.0710559e+005
       4      573      575 1.4000000e-001 3.9245919e+005
    2 HarmonicAngle          1067
       0        1        0        2 1.9111355e+000 2.9288000e+002
       1        1        0        3 1.9111355e+000 2.9288000e+002
       2        1        0        4 1.9111355e+000 4.1839999e+002
       3        2        0        3 1.9111355e+000 2.9288000e+002
       4        2        0        4 1.9111355e+000 4.1839999e+002
    3 PeriodicTorsion        118
       0        4       21       19       20        2 3.1415927e+000 4.3931999e+001
       1       19       23       21       22        2 3.1415927e+000 4.6023998e+000
       2       23       32       30       31        2 3.1415927e+000 4.3931999e+001
       3       30       34       32       33        2 3.1415927e+000 4.6023998e+000
       4       34       44       42       43        2 3.1415927e+000 4.3931999e+001
    4 RBTorsion              1236
       0        1        0        4        5 6.5083998e-001 1.9525300e+000 0.0000000e+000 -2.6033800e+000 0.0000000e+000 0.0000000e+000
       1        1        0        4        6 6.5083998e-001 1.9525300e+000 0.0000000e+000 -2.6033800e+000 0.0000000e+000 0.0000000e+000
       2        1        0        4       19 6.5083998e-001 1.9525300e+000 0.0000000e+000 -2.6033800e+000 0.0000000e+000 0.0000000e+000
       3        2        0        4        5 6.5083998e-001 1.9525300e+000 0.0000000e+000 -2.6033800e+000 0.0000000e+000 0.0000000e+000
       4        2        0        4        6 6.5083998e-001 1.9525300e+000 0.0000000e+000 -2.6033800e+000 0.0000000e+000 0.0000000e+000
    5 NB                     atoms=582 Exceptions=3186 cutoff=1.000 rfDiel=78.3000 ewaldTol=5.000000e-004 method=NoCutoff
                             Box: [      2.0000       0.0000       0.0000]
                                  [      0.0000       2.0000       0.0000]
                                  [      0.0000       0.0000       2.0000]
NonExceptions
       0 1.0100000e-001 3.2499999e-001 7.1127993e-001
       1 2.1480000e-001 1.0690799e-001 6.5688793e-002
       2 2.1480000e-001 1.0690799e-001 6.5688793e-002
       3 2.1480000e-001 1.0690799e-001 6.5688793e-002
       4 1.0400000e-002 3.3996701e-001 4.5772997e-001
Exceptions
       0        0        7 2.1545805e-003 2.9497647e-001 1.0807766e-001
       1        0        8 2.1545805e-003 2.9497647e-001 1.0807766e-001
       2        0        9 2.8792265e-002 3.3248350e-001 2.8529555e-001
       3        0       20 -4.8082497e-002 3.1049597e-001 3.9527175e-001
       4        0       21 -4.5568537e-002 3.2499999e-001 3.5563996e-001
    6 Obc  (charge/radius/scaling factor)  582 dielectrics:[1.000 80.000]
       0  1.0100000e-001 1.6249999e-001 7.9000002e-001
       1  2.1480000e-001 1.1499999e-001 8.5000002e-001
       2  2.1480000e-001 1.1499999e-001 8.5000002e-001
       3  2.1480000e-001 1.1499999e-001 8.5000002e-001
       4  1.0400000e-002 1.9000000e-001 7.2000003e-001
Sample masses (for diagnostics)
   Mass      0    14.010000 0
   Mass      1     1.008000 1
   Mass      2     1.008000 2
   Mass      3     1.008000 0
   Mass      4    12.010000 1
   Mass    577    12.010000 1
   Mass    578     1.008000 2
   Mass    579    12.010000 0
   Mass    580    16.000000 1
   Mass    581    16.000000 2
Constraints 293
       0        0        1 1.0100000e-001
       1        0        2 1.0100000e-001
       2        0        3 1.0100000e-001
       3      577      578 1.0800000e-001
       4        4        5 1.0900000e-001
Integrator LangevinIntegrator
StepSize 2.0000001e-003
ConstraintTolerance 9.9999997e-005
Temperature 3.0000000e+002
Friction 9.0991806e+001
RandomNumberSeed 120096
Energies: KE=1.#QNAN00e+000 PE=1.#QNAN00e+000 1.#QNAN00e+000
Sample initial coords/velocities/forces
    0 x[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] v[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] f[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000]
    1 x[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] v[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] f[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000]
    2 x[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] v[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] f[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000]
    3 x[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] v[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] f[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000]
    4 x[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] v[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] f[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000]
    5 x[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] v[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] f[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000]
  577 x[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] v[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] f[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000]
  578 x[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] v[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] f[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000]
  579 x[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] v[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] f[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000]
  580 x[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] v[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] f[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000]
  581 x[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] v[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000] f[ 1.#QNAN000e+000  1.#QNAN000e+000  1.#QNAN000e+000]

Self-test: tolerance=5.00000e-002
                            KE:  1.#QNAN00e+000  1.#QNAN00e+000  1.#QNAN00e+000
                            PE:  1.#QNAN00e+000  1.#QNAN00e+000  1.#QNAN00e+000
Self-test: forces:
                            0 :  1.#QNAN00e+000  1.#QNAN00e+000  1.#QNAN00e+000
                            1 :  1.#QNAN00e+000  1.#QNAN00e+000  1.#QNAN00e+000
                            2 :  1.#QNAN00e+000  1.#QNAN00e+000  1.#QNAN00e+000
                            3 :  1.#QNAN00e+000  1.#QNAN00e+000  1.#QNAN00e+000
                            4 :  1.#QNAN00e+000  1.#QNAN00e+000  1.#QNAN00e+000
                            5 :  1.#QNAN00e+000  1.#QNAN00e+000  1.#QNAN00e+000
                            6 :  1.#QNAN00e+000  1.#QNAN00e+000  1.#QNAN00e+000
Self-test passed max relative error=-1.0000000e+000
Initial temperature: 1.#QNAN K

Started mdrun on node 0 Sun Oct 10 10:16:13 2010

Nan 0 [1.#QNAN 1.#QNAN 1.#QNAN]
Nan 0 [1.#QNAN 1.#QNAN 1.#QNAN]
Nan 0 [1.#QNAN 1.#QNAN 1.#QNAN]
FAH_ERROR 1: nans detected at step=950000002 x=1 v=1 f=1
checkKineticEnergy: Step=   950000002 T=       1.#QO avg=       1.#QO std=       1.#QO nrdf=  1450
Error detected at step 950000002 status=52

Can anyone cast any light on why the WU fails immediately, not being able to set the initial Energies?
What exactly is a QNAN?
I know someone else has successfully completed this WU, but I fail to understand why this fails in exactly the same way every time.
To me, as a programmer, this would indicate the likelyhood that the random number seed (which is the same each time this WU runs) is generating invalid values. Is there a test program or debug routine I could run to investigate this?

Post by **PantherX** » Sun Oct 10, 2010 1:09 pm

derrickmcc wrote:...Is there a test program or debug routine I could run to investigate this?

For the Nvidia GPU, there are two soft error checking applications:
MemtestG80
MemtestCL
For further details, please refer to GPU Guide, section "15 - Troubleshooting The GPU3 BETA Client " Point 3a and 3b.

derrickmcc · Post by **derrickmcc** » Mon Oct 11, 2010 6:30 pm

PantherX wrote:
derrickmcc wrote:...Is there a test program or debug routine I could run to investigate this?
For the Nvidia GPU, there are two soft error checking applications:
MemtestG80
MemtestCL
For further details, please refer to GPU Guide, section "15 - Troubleshooting The GPU3 BETA Client " Point 3a and 3b.

I have already tried both of these (one of my earlier posts mentions that I have run MemtestG80) with no errors reported.
What I am asking about is not a general memory tester but an investigation of the specific error where the core consistently fails to initialise correctly.

Post by **bruce** » Wed Oct 13, 2010 4:06 pm

derrickmcc wrote:What exactly is a QNAN?

NaN = Not a Number
QNAN = Quiet NaN
(Sometimes loosely called "infinity" but NaN is preferred since it's a more accurate term.)

Some kind of corruption has resulted in an impossible mathematical operation such as division by zero. That just leads back to a need to determine the cause of the corruption.

Folding Forum

Project: 10632 (Run 93, Clone 54, Gen 38)

Project: 10632 (Run 93, Clone 54, Gen 38)

Re: Project: 10632 (Run 93, Clone 54, Gen 38)

Re: Project: 10632 (Run 93, Clone 54, Gen 38)

Re: Project: 10632 (Run 93, Clone 54, Gen 38)

Re: Project: 10632 (Run 93, Clone 54, Gen 38)

Re: Project: 10632 (Run 93, Clone 54, Gen 38)

Re: Project: 10632 (Run 93, Clone 54, Gen 38)

Re: Project: 10632 (Run 93, Clone 54, Gen 38)

Re: Project: 10632 (Run 93, Clone 54, Gen 38)

Re: Project: 10632 (Run 93, Clone 54, Gen 38)

Re: Project: 10632 (Run 93, Clone 54, Gen 38)

Re: Project: 10632 (Run 93, Clone 54, Gen 38)