I restarted the client and it completes other wu fine and then gets same wonky wu again.
Is this a bad wu and why do I keep getting same RCG on same gpu? (I have 26 other gpu clients that don't seem to have got this specific RCG although I only have access to current logs) Have not recieved any other 5785's on this specific client today but other rigs have.
Machine is I7-920, 1200w PSU running 1xsmp A3 (OC:3.89) and 2 x gpu clients on GTX295 (stock clocks) Temps on gpu are 40C idle and 50C load (Project: 5769) checked after first 24 hrs pause. I have a 50cm high speed fan blowing directly at the intakes therefore the slightly cooler temps. I expect the 5785's to run hotter if I compare to my other rigs but seriously don't think it's a temp problem. Ambient is 21C. (rather cool today)
Has anyone else received and completed this RCG? I'm going to delete the work folder etc and restart client again.
Code: Select all
Launch directory: C:\Documents and Settings\Administrator\Application Data\Folding@home-gpu1
Arguments: -gpu 1 -forcegpu nvidia_g80 -verbosity 9 -advmethods
[00:14:09] - Preparing to get new work unit...
[00:14:09] + Attempting to get work packet
[00:14:09] - Will indicate memory of 8182 MB
[00:14:09] - Connecting to assignment server
[00:14:09] Connecting to http://assign-GPU.stanford.edu:8080/
[00:14:11] Posted data.
[00:14:11] Initial: 43AB; - Successful: assigned to (171.67.108.21).
[00:14:11] + News From Folding@Home: Welcome to Folding@Home
[00:14:11] Loaded queue successfully.
[00:14:11] Connecting to http://171.67.108.21:8080/
[00:14:12] Posted data.
[00:14:12] Initial: 0000; - Receiving payload (expected size: 65548)
[00:14:12] Conversation time very short, giving reduced weight in bandwidth avg
[00:14:12] - Downloaded at ~128 kB/s
[00:14:12] - Averaged speed for that direction ~70 kB/s
[00:14:12] + Received work.
[00:14:12] Trying to send all finished work units
[00:14:12] + No unsent completed units remaining.
[00:14:12] + Closed connections
[00:14:12]
[00:14:12] + Processing work unit
[00:14:12] Core required: FahCore_11.exe
[00:14:12] Core found.
[00:14:12] Working on queue slot 03 [April 29 00:14:12 UTC]
[00:14:12] + Working ...
[00:14:12] - Calling '.\FahCore_11.exe -dir work/ -suffix 03 -nocpulock -checkpoint 15 -verbose -lifeline 2748 -version 623'
[00:14:13]
[00:14:13] *------------------------------*
[00:14:13] Folding@Home GPU Core
[00:14:13] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[00:14:13]
[00:14:13] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[00:14:13] Build host: amoeba
[00:14:13] Board Type: Nvidia
[00:14:13] Core :
[00:14:13] Preparing to commence simulation
[00:14:13] - Looking at optimizations...
[00:14:13] DeleteFrameFiles: successfully deleted file=work/wudata_03.ckp
[00:14:13] - Created dyn
[00:14:13] - Files status OK
[00:14:13] - Expanded 65036 -> 343723 (decompressed 528.5 percent)
[00:14:13] Called DecompressByteArray: compressed_data_size=65036 data_size=343723, decompressed_data_size=343723 diff=0
[00:14:13] - Digital signature verified
[00:14:13]
[00:14:13] Project: 5785 (Run 9, Clone 39, Gen 73)
[00:14:13]
[00:14:13] Assembly optimizations on if available.
[00:14:13] Entering M.D.
[00:14:19] Tpr hash work/wudata_03.tpr: 1769416963 2721308566 1407196758 1823676737 11804267
[00:14:19]
[00:14:19] Calling fah_main args: 14 usage=100
[00:14:19]
[00:14:19] Working on Gromacs Runs One Microsecond At Cannonball Speeds
[00:14:20] Client config found, loading data.
[00:14:20] Starting GUI Server
[00:15:48] Completed 1%
[00:17:16] Completed 2%
[00:18:44] Completed 3%
[00:20:08] Completed 4%
[00:20:08] mdrun_gpu returned
[00:20:08] NANs detected on GPU
[00:20:08]
[00:20:08] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:20:11] CoreStatus = 7A (122)
[00:20:11] Sending work to server
[00:20:11] Project: 5785 (Run 9, Clone 39, Gen 73)
[00:20:11] - Read packet limit of 540015616... Set to 524286976.
[00:20:11] - Error: Could not get length of results file work/wuresults_03.dat
[00:20:11] - Error: Could not read unit 03 file. Removing from queue.
[00:20:11] Trying to send all finished work units
[00:20:11] + No unsent completed units remaining.
[00:20:11] - Preparing to get new work unit...
[00:20:11] + Attempting to get work packet
[00:20:11] - Will indicate memory of 8182 MB
[00:20:11] - Connecting to assignment server
[00:20:11] Connecting to http://assign-GPU.stanford.edu:8080/
[00:20:12] Posted data.
[00:20:12] Initial: 43AB; - Successful: assigned to (171.67.108.21).
[00:20:12] + News From Folding@Home: Welcome to Folding@Home
[00:20:13] Loaded queue successfully.
[00:20:13] Connecting to http://171.67.108.21:8080/
[00:20:14] Posted data.
[00:20:14] Initial: 0000; - Receiving payload (expected size: 65548)
[00:20:14] Conversation time very short, giving reduced weight in bandwidth avg
[00:20:14] - Downloaded at ~128 kB/s
[00:20:14] - Averaged speed for that direction ~79 kB/s
[00:20:14] + Received work.
[00:20:14] Trying to send all finished work units
[00:20:14] + No unsent completed units remaining.
[00:20:14] + Closed connections
[00:20:19]
[00:20:19] + Processing work unit
[00:20:19] Core required: FahCore_11.exe
[00:20:19] Core found.
[00:20:19] Working on queue slot 04 [April 29 00:20:19 UTC]
[00:20:19] + Working ...
[00:20:19] - Calling '.\FahCore_11.exe -dir work/ -suffix 04 -nocpulock -checkpoint 15 -verbose -lifeline 2748 -version 623'
[00:20:19]
[00:20:19] *------------------------------*
[00:20:19] Folding@Home GPU Core
[00:20:19] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[00:20:19]
[00:20:19] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[00:20:19] Build host: amoeba
[00:20:19] Board Type: Nvidia
[00:20:19] Core :
[00:20:19] Preparing to commence simulation
[00:20:19] - Looking at optimizations...
[00:20:19] DeleteFrameFiles: successfully deleted file=work/wudata_04.ckp
[00:20:19] - Created dyn
[00:20:19] - Files status OK
[00:20:19] - Expanded 65036 -> 343723 (decompressed 528.5 percent)
[00:20:19] Called DecompressByteArray: compressed_data_size=65036 data_size=343723, decompressed_data_size=343723 diff=0
[00:20:19] - Digital signature verified
[00:20:19]
[00:20:19] Project: 5785 (Run 9, Clone 39, Gen 73)
[00:20:19]
[00:20:19] Assembly optimizations on if available.
[00:20:19] Entering M.D.
[00:20:25] Tpr hash work/wudata_04.tpr: 1769416963 2721308566 1407196758 1823676737 11804267
[00:20:25]
[00:20:25] Calling fah_main args: 14 usage=100
[00:20:25]
[00:20:26] Working on Gromacs Runs One Microsecond At Cannonball Speeds
[00:20:26] Client config found, loading data.
[00:20:26] Starting GUI Server
[00:21:51] Completed 1%
[00:21:51] mdrun_gpu returned
[00:21:51] NANs detected on GPU
[00:21:51]
[00:21:51] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:21:53] CoreStatus = 7A (122)
[00:21:53] Sending work to server
[00:21:53] Project: 5785 (Run 9, Clone 39, Gen 73)
[00:21:53] - Read packet limit of 540015616... Set to 524286976.
[00:21:53] - Error: Could not get length of results file work/wuresults_04.dat
[00:21:53] - Error: Could not read unit 04 file. Removing from queue.
[00:21:53] Trying to send all finished work units
[00:21:53] + No unsent completed units remaining.
[00:21:53] - Preparing to get new work unit...
[00:21:53] + Attempting to get work packet
[00:21:53] - Will indicate memory of 8182 MB
[00:21:53] - Connecting to assignment server
[00:21:53] Connecting to http://assign-GPU.stanford.edu:8080/
[00:21:55] Posted data.
[00:21:55] Initial: 43AB; - Successful: assigned to (171.67.108.21).
[00:21:55] + News From Folding@Home: Welcome to Folding@Home
[00:21:55] Loaded queue successfully.
[00:21:55] Connecting to http://171.67.108.21:8080/
[00:21:56] Posted data.
[00:21:56] Initial: 0000; - Receiving payload (expected size: 65548)
[00:21:57] - Downloaded at ~64 kB/s
[00:21:57] - Averaged speed for that direction ~76 kB/s
[00:21:57] + Received work.
[00:21:57] Trying to send all finished work units
[00:21:57] + No unsent completed units remaining.
[00:21:57] + Closed connections
[00:22:02]
[00:22:02] + Processing work unit
[00:22:02] Core required: FahCore_11.exe
[00:22:02] Core found.
[00:22:02] Working on queue slot 05 [April 29 00:22:02 UTC]
[00:22:02] + Working ...
[00:22:02] - Calling '.\FahCore_11.exe -dir work/ -suffix 05 -nocpulock -checkpoint 15 -verbose -lifeline 2748 -version 623'
[00:22:02]
[00:22:02] *------------------------------*
[00:22:02] Folding@Home GPU Core
[00:22:02] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[00:22:02]
[00:22:02] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[00:22:02] Build host: amoeba
[00:22:02] Board Type: Nvidia
[00:22:02] Core :
[00:22:02] Preparing to commence simulation
[00:22:02] - Looking at optimizations...
[00:22:02] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[00:22:02] - Created dyn
[00:22:02] - Files status OK
[00:22:02] - Expanded 65036 -> 343723 (decompressed 528.5 percent)
[00:22:02] Called DecompressByteArray: compressed_data_size=65036 data_size=343723, decompressed_data_size=343723 diff=0
[00:22:02] - Digital signature verified
[00:22:02]
[00:22:02] Project: 5785 (Run 9, Clone 39, Gen 73)
[00:22:02]
[00:22:02] Assembly optimizations on if available.
[00:22:02] Entering M.D.
[00:22:08] Tpr hash work/wudata_05.tpr: 1769416963 2721308566 1407196758 1823676737 11804267
[00:22:08]
[00:22:08] Calling fah_main args: 14 usage=100
[00:22:08]
[00:22:09] Working on Gromacs Runs One Microsecond At Cannonball Speeds
[00:22:09] Client config found, loading data.
[00:22:09] Starting GUI Server
[00:23:37] Completed 1%
[00:25:05] Completed 2%
[00:26:33] Completed 3%
[00:28:01] Completed 4%
[00:29:29] Completed 5%
[00:30:57] Completed 6%
[00:32:25] Completed 7%
[00:33:53] Completed 8%
[00:35:21] Completed 9%
[00:36:49] Completed 10%
[00:38:17] Completed 11%
[00:39:45] Completed 12%
[00:41:10] Completed 13%
[00:41:10] mdrun_gpu returned
[00:41:10] NANs detected on GPU
[00:41:10]
[00:41:10] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:41:12] CoreStatus = 7A (122)
[00:41:12] Sending work to server
[00:41:12] Project: 5785 (Run 9, Clone 39, Gen 73)
[00:41:12] - Read packet limit of 540015616... Set to 524286976.
[00:41:12] - Error: Could not get length of results file work/wuresults_05.dat
[00:41:12] - Error: Could not read unit 05 file. Removing from queue.
[00:41:12] Trying to send all finished work units
[00:41:12] + No unsent completed units remaining.
[00:41:12] - Preparing to get new work unit...
[00:41:12] + Attempting to get work packet
[00:41:12] - Will indicate memory of 8182 MB
[00:41:12] - Connecting to assignment server
[00:41:12] Connecting to http://assign-GPU.stanford.edu:8080/
[00:41:14] Posted data.
[00:41:14] Initial: 43AB; - Successful: assigned to (171.67.108.21).
[00:41:14] + News From Folding@Home: Welcome to Folding@Home
[00:41:14] Loaded queue successfully.
[00:41:14] Connecting to http://171.67.108.21:8080/
[00:41:15] Posted data.
[00:41:15] Initial: 0000; - Receiving payload (expected size: 65548)
[00:41:16] - Downloaded at ~64 kB/s
[00:41:16] - Averaged speed for that direction ~73 kB/s
[00:41:16] + Received work.
[00:41:16] Trying to send all finished work units
[00:41:16] + No unsent completed units remaining.
[00:41:16] + Closed connections
[00:41:21]
[00:41:21] + Processing work unit
[00:41:21] Core required: FahCore_11.exe
[00:41:21] Core found.
[00:41:21] Working on queue slot 06 [April 29 00:41:21 UTC]
[00:41:21] + Working ...
[00:41:21] - Calling '.\FahCore_11.exe -dir work/ -suffix 06 -nocpulock -checkpoint 15 -verbose -lifeline 2748 -version 623'
[00:41:21]
[00:41:21] *------------------------------*
[00:41:21] Folding@Home GPU Core
[00:41:21] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[00:41:21]
[00:41:21] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[00:41:21] Build host: amoeba
[00:41:21] Board Type: Nvidia
[00:41:21] Core :
[00:41:21] Preparing to commence simulation
[00:41:21] - Looking at optimizations...
[00:41:21] DeleteFrameFiles: successfully deleted file=work/wudata_06.ckp
[00:41:21] - Created dyn
[00:41:21] - Files status OK
[00:41:21] - Expanded 65036 -> 343723 (decompressed 528.5 percent)
[00:41:21] Called DecompressByteArray: compressed_data_size=65036 data_size=343723, decompressed_data_size=343723 diff=0
[00:41:21] - Digital signature verified
[00:41:21]
[00:41:21] Project: 5785 (Run 9, Clone 39, Gen 73)
[00:41:21]
[00:41:21] Assembly optimizations on if available.
[00:41:21] Entering M.D.
[00:41:27] Tpr hash work/wudata_06.tpr: 1769416963 2721308566 1407196758 1823676737 11804267
[00:41:27]
[00:41:27] Calling fah_main args: 14 usage=100
[00:41:27]
[00:41:27] Working on Gromacs Runs One Microsecond At Cannonball Speeds
[00:41:28] Client config found, loading data.
[00:41:28] Starting GUI Server
[00:42:56] Completed 1%
[00:44:24] Completed 2%
[00:45:02] mdrun_gpu returned
[00:45:02] NANs detected on GPU
[00:45:02]
[00:45:02] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:45:05] CoreStatus = 7A (122)
[00:45:05] Sending work to server
[00:45:05] Project: 5785 (Run 9, Clone 39, Gen 73)
[00:45:05] - Read packet limit of 540015616... Set to 524286976.
[00:45:05] - Error: Could not get length of results file work/wuresults_06.dat
[00:45:05] - Error: Could not read unit 06 file. Removing from queue.
[00:45:05] Trying to send all finished work units
[00:45:05] + No unsent completed units remaining.
[00:45:05] - Preparing to get new work unit...
[00:45:05] + Attempting to get work packet
[00:45:05] - Will indicate memory of 8182 MB
[00:45:05] - Connecting to assignment server
[00:45:05] Connecting to http://assign-GPU.stanford.edu:8080/
[00:45:07] Posted data.
[00:45:07] Initial: 43AB; - Successful: assigned to (171.67.108.21).
[00:45:07] + News From Folding@Home: Welcome to Folding@Home
[00:45:07] Loaded queue successfully.
[00:45:07] Connecting to http://171.67.108.21:8080/
[00:45:08] Posted data.
[00:45:08] Initial: 0000; - Receiving payload (expected size: 65548)
[00:45:08] Conversation time very short, giving reduced weight in bandwidth avg
[00:45:08] - Downloaded at ~128 kB/s
[00:45:08] - Averaged speed for that direction ~79 kB/s
[00:45:08] + Received work.
[00:45:08] Trying to send all finished work units
[00:45:08] + No unsent completed units remaining.
[00:45:08] + Closed connections
[00:45:13]
[00:45:13] + Processing work unit
[00:45:13] Core required: FahCore_11.exe
[00:45:13] Core found.
[00:45:13] Working on queue slot 07 [April 29 00:45:13 UTC]
[00:45:13] + Working ...
[00:45:13] - Calling '.\FahCore_11.exe -dir work/ -suffix 07 -nocpulock -checkpoint 15 -verbose -lifeline 2748 -version 623'
[00:45:14]
[00:45:14] *------------------------------*
[00:45:14] Folding@Home GPU Core
[00:45:14] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[00:45:14]
[00:45:14] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[00:45:14] Build host: amoeba
[00:45:14] Board Type: Nvidia
[00:45:14] Core :
[00:45:14] Preparing to commence simulation
[00:45:14] - Looking at optimizations...
[00:45:14] DeleteFrameFiles: successfully deleted file=work/wudata_07.ckp
[00:45:14] - Created dyn
[00:45:14] - Files status OK
[00:45:14] - Expanded 65036 -> 343723 (decompressed 528.5 percent)
[00:45:14] Called DecompressByteArray: compressed_data_size=65036 data_size=343723, decompressed_data_size=343723 diff=0
[00:45:14] - Digital signature verified
[00:45:14]
[00:45:14] Project: 5785 (Run 9, Clone 39, Gen 73)
[00:45:14]
[00:45:14] Assembly optimizations on if available.
[00:45:14] Entering M.D.
[00:45:20] Tpr hash work/wudata_07.tpr: 1769416963 2721308566 1407196758 1823676737 11804267
[00:45:20]
[00:45:20] Calling fah_main args: 14 usage=100
[00:45:20]
[00:45:20] Working on Gromacs Runs One Microsecond At Cannonball Speeds
[00:45:21] Client config found, loading data.
[00:45:21] Starting GUI Server
[00:46:49] Completed 1%
[00:48:09] Completed 2%
[00:48:09] mdrun_gpu returned
[00:48:09] NANs detected on GPU
[00:48:09]
[00:48:09] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:48:12] CoreStatus = 7A (122)
[00:48:12] Sending work to server
[00:48:12] Project: 5785 (Run 9, Clone 39, Gen 73)
[00:48:12] - Read packet limit of 540015616... Set to 524286976.
[00:48:12] - Error: Could not get length of results file work/wuresults_07.dat
[00:48:12] - Error: Could not read unit 07 file. Removing from queue.
[00:48:12] EUE limit exceeded. Pausing 24 hours.
[03:16:51] - Autosending finished units... [April 29 03:16:51 UTC]
[03:16:51] Trying to send all finished work units
[03:16:51] + No unsent completed units remaining.
[03:16:51] - Autosend completed
[03:16:51] + Working...
[05:27:59] ***** Got a SIGTERM signal (2)
[05:27:59] Killing all core threads
Folding@Home Client Shutdown.
--- Opening Log file [April 29 05:28:12 UTC]
# Windows GPU Console Edition #################################################
###############################################################################
Folding@Home Client Version 6.23
http://folding.stanford.edu
###############################################################################
###############################################################################
Launch directory: C:\Documents and Settings\Administrator\Application Data\Folding@home-gpu1
Arguments: -gpu 1 -forcegpu nvidia_g80 -verbosity 9 -advmethods
[05:28:17]
[05:28:17] Project: 5769 (Run 10, Clone 67, Gen 159)
[05:28:17]
[05:28:17] Assembly optimizations on if available.
[05:28:17] Entering M.D.
[05:28:23] Tpr hash work/wudata_08.tpr: 3047899009 2271945777 3858323442 2111839499 2913605136
[05:28:23]
[05:28:23] Calling fah_main args: 14 usage=100
[05:28:23]
[05:28:23] Working on Protein
[05:28:23] Client config found, loading data.
[05:28:24] Starting GUI Server
[05:29:04] Completed 1%
[05:29:44] Completed 2%
{Reduced to save virtual trees}
[06:33:47] Completed 98%
[06:34:27] Completed 99%
[06:35:07] Completed 100%
[06:35:07] Successful run
[06:35:07] DynamicWrapper: Finished Work Unit: sleep=10000
[06:35:17] Reserved 75820 bytes for xtc file; Cosm status=0
[06:35:17] Allocated 75820 bytes for xtc file
[06:35:17] - Reading up to 75820 from "work/wudata_08.xtc": Read 75820
[06:35:17] Read 75820 bytes from xtc file; available packet space=786354644
[06:35:17] xtc file hash check passed.
[06:35:17] Reserved 15168 15168 786354644 bytes for arc file=<work/wudata_08.trr> Cosm status=0
[06:35:17] Allocated 15168 bytes for arc file
[06:35:17] - Reading up to 15168 from "work/wudata_08.trr": Read 15168
[06:35:17] Read 15168 bytes from arc file; available packet space=786339476
[06:35:17] trr file hash check passed.
[06:35:17] Allocated 560 bytes for edr file
[06:35:17] Read bedfile
[06:35:17] edr file hash check passed.
[06:35:17] Allocated 33304 bytes for logfile
[06:35:17] Read logfile
[06:35:17] GuardedRun: success in DynamicWrapper
[06:35:17] GuardedRun: done
[06:35:17] Run: GuardedRun completed.
[06:35:17] + Opened results file
[06:35:17] - Writing 125364 bytes of core data to disk...
[06:35:17] Done: 124852 -> 99274 (compressed to 79.5 percent)
[06:35:17] ... Done.
[06:35:17] DeleteFrameFiles: successfully deleted file=work/wudata_08.ckp
[06:35:17] Shutting down core
[06:35:17]
[06:35:17] Folding@home Core Shutdown: FINISHED_UNIT
[06:35:21] CoreStatus = 64 (100)
[06:35:21] Unit 8 finished with 98 percent of time to deadline remaining.
[06:35:21] Updated performance fraction: 0.987528
[06:35:21] Sending work to server
[06:35:21] Project: 5769 (Run 10, Clone 67, Gen 159)
[06:35:21] - Read packet limit of 540015616... Set to 524286976.
[06:35:21] + Attempting to send results [April 29 06:35:21 UTC]
[06:35:21] - Reading file work/wuresults_08.dat from core
[06:35:21] (Read 99786 bytes from disk)
[06:35:21] Connecting to http://171.67.108.11:8080/
[06:35:25] Posted data.
[06:35:25] Initial: 0000; - Uploaded at ~24 kB/s
[06:35:25] - Averaged speed for that direction ~27 kB/s
[06:35:25] + Results successfully sent
[06:35:25] Thank you for your contribution to Folding@Home.
[06:35:25] + Number of Units Completed: 3
[06:35:29] Trying to send all finished work units
[06:35:29] + No unsent completed units remaining.
[06:35:29] - Preparing to get new work unit...
[06:35:29] + Attempting to get work packet
[06:35:29] - Will indicate memory of 8182 MB
[06:35:29] - Connecting to assignment server
[06:35:29] Connecting to http://assign-GPU.stanford.edu:8080/
[06:35:31] Posted data.
[06:35:31] Initial: 43AB; - Successful: assigned to (171.67.108.11).
[06:35:31] + News From Folding@Home: Welcome to Folding@Home
[06:35:31] Loaded queue successfully.
[06:35:31] Connecting to http://171.67.108.11:8080/
[06:35:32] Posted data.
[06:35:32] Initial: 0000; - Receiving payload (expected size: 45936)
[06:35:34] - Downloaded at ~22 kB/s
[06:35:34] - Averaged speed for that direction ~59 kB/s
[06:35:34] + Received work.
[06:35:34] Trying to send all finished work units
[06:35:34] + No unsent completed units remaining.
[06:35:34] + Closed connections
[06:35:34]
[06:35:34] + Processing work unit
[06:35:34] Core required: FahCore_11.exe
[06:35:34] Core found.
[06:35:34] Working on queue slot 09 [April 29 06:35:34 UTC]
[06:35:34] + Working ...
[06:35:34] - Calling '.\FahCore_11.exe -dir work/ -suffix 09 -nocpulock -checkpoint 15 -verbose -lifeline 1544 -version 623'
[06:35:34]
[06:35:34] *------------------------------*
[06:35:34] Folding@Home GPU Core
[06:35:34] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[06:35:34]
[06:35:34] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[06:35:34] Build host: amoeba
[06:35:34] Board Type: Nvidia
[06:35:34] Core :
[06:35:34] Preparing to commence simulation
[06:35:34] - Looking at optimizations...
[06:35:34] DeleteFrameFiles: successfully deleted file=work/wudata_09.ckp
[06:35:34] - Created dyn
[06:35:34] - Files status OK
[06:35:34] - Expanded 45424 -> 251112 (decompressed 552.8 percent)
[06:35:34] Called DecompressByteArray: compressed_data_size=45424 data_size=251112, decompressed_data_size=251112 diff=0
[06:35:34] - Digital signature verified
[06:35:34]
[06:35:34] Project: 5770 (Run 6, Clone 238, Gen 1024)
[06:35:34]
[06:35:34] Assembly optimizations on if available.
[06:35:34] Entering M.D.
[06:35:40] Tpr hash work/wudata_09.tpr: 2940276608 471916799 4199021052 3433145548 701575525
[06:35:40]
[06:35:40] Calling fah_main args: 14 usage=100
[06:35:40]
[06:35:41] Working on Protein
[06:35:41] Client config found, loading data.
[06:35:41] Starting GUI Server
[06:36:21] Completed 1%
[06:37:01] Completed 2%
{Reduced to save virtual trees}
[07:41:05] Completed 98%
[07:41:45] Completed 99%
[07:42:25] Completed 100%
[07:42:25] Successful run
[07:42:25] DynamicWrapper: Finished Work Unit: sleep=10000
[07:42:35] Reserved 75812 bytes for xtc file; Cosm status=0
[07:42:35] Allocated 75812 bytes for xtc file
[07:42:35] - Reading up to 75812 from "work/wudata_09.xtc": Read 75812
[07:42:35] Read 75812 bytes from xtc file; available packet space=786354652
[07:42:35] xtc file hash check passed.
[07:42:35] Reserved 15168 15168 786354652 bytes for arc file=<work/wudata_09.trr> Cosm status=0
[07:42:35] Allocated 15168 bytes for arc file
[07:42:35] - Reading up to 15168 from "work/wudata_09.trr": Read 15168
[07:42:35] Read 15168 bytes from arc file; available packet space=786339484
[07:42:35] trr file hash check passed.
[07:42:35] Allocated 560 bytes for edr file
[07:42:35] Read bedfile
[07:42:35] edr file hash check passed.
[07:42:35] Allocated 33413 bytes for logfile
[07:42:35] Read logfile
[07:42:35] GuardedRun: success in DynamicWrapper
[07:42:35] GuardedRun: done
[07:42:35] Run: GuardedRun completed.
[07:42:39] + Opened results file
[07:42:39] - Writing 125465 bytes of core data to disk...
[07:42:39] Done: 124953 -> 99235 (compressed to 79.4 percent)
[07:42:39] ... Done.
[07:42:39] DeleteFrameFiles: successfully deleted file=work/wudata_09.ckp
[07:42:39] Shutting down core
[07:42:39]
[07:42:39] Folding@home Core Shutdown: FINISHED_UNIT
[07:42:43] CoreStatus = 64 (100)
[07:42:43] Unit 9 finished with 98 percent of time to deadline remaining.
[07:42:43] Updated performance fraction: 0.986760
[07:42:43] Sending work to server
[07:42:43] Project: 5770 (Run 6, Clone 238, Gen 1024)
[07:42:43] - Read packet limit of 540015616... Set to 524286976.
[07:42:43] + Attempting to send results [April 29 07:42:43 UTC]
[07:42:43] - Reading file work/wuresults_09.dat from core
[07:42:43] (Read 99747 bytes from disk)
[07:42:43] Connecting to http://171.67.108.11:8080/
[07:42:46] Posted data.
[07:42:47] Initial: 0000; - Uploaded at ~24 kB/s
[07:42:47] - Averaged speed for that direction ~26 kB/s
[07:42:47] + Results successfully sent
[07:42:47] Thank you for your contribution to Folding@Home.
[07:42:47] + Number of Units Completed: 4
[07:42:51] Trying to send all finished work units
[07:42:51] + No unsent completed units remaining.
[07:42:51] - Preparing to get new work unit...
[07:42:51] + Attempting to get work packet
[07:42:51] - Will indicate memory of 8182 MB
[07:42:51] - Connecting to assignment server
[07:42:51] Connecting to http://assign-GPU.stanford.edu:8080/
[07:42:53] Posted data.
[07:42:53] Initial: 40AB; - Successful: assigned to (171.64.65.61).
[07:42:53] + News From Folding@Home: Welcome to Folding@Home
[07:42:53] Loaded queue successfully.
[07:42:53] Connecting to http://171.64.65.61:8080/
[07:42:54] Posted data.
[07:42:54] Initial: 0000; - Receiving payload (expected size: 74190)
[07:42:56] - Downloaded at ~36 kB/s
[07:42:56] - Averaged speed for that direction ~54 kB/s
[07:42:56] + Received work.
[07:42:56] Trying to send all finished work units
[07:42:56] + No unsent completed units remaining.
[07:42:56] + Closed connections
[07:42:56]
[07:42:56] + Processing work unit
[07:42:56] Core required: FahCore_11.exe
[07:42:56] Core found.
[07:42:56] Working on queue slot 00 [April 29 07:42:56 UTC]
[07:42:56] + Working ...
[07:42:56] - Calling '.\FahCore_11.exe -dir work/ -suffix 00 -nocpulock -checkpoint 15 -verbose -lifeline 1544 -version 623'
[07:42:56]
[07:42:56] *------------------------------*
[07:42:56] Folding@Home GPU Core
[07:42:56] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[07:42:56]
[07:42:56] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[07:42:56] Build host: amoeba
[07:42:56] Board Type: Nvidia
[07:42:56] Core :
[07:42:56] Preparing to commence simulation
[07:42:56] - Looking at optimizations...
[07:42:56] DeleteFrameFiles: successfully deleted file=work/wudata_00.ckp
[07:42:56] - Created dyn
[07:42:56] - Files status OK
[07:42:56] - Expanded 73678 -> 383588 (decompressed 520.6 percent)
[07:42:56] Called DecompressByteArray: compressed_data_size=73678 data_size=383588, decompressed_data_size=383588 diff=0
[07:42:56] - Digital signature verified
[07:42:56]
[07:42:56] Project: 6602 (Run 3, Clone 442, Gen 47)
[07:42:56]
[07:42:56] Assembly optimizations on if available.
[07:42:56] Entering M.D.
[07:43:02] Tpr hash work/wudata_00.tpr: 3174812547 1747703973 2632973845 3373568808 53025961
[07:43:02]
[07:43:02] Calling fah_main args: 14 usage=100
[07:43:02]
[07:43:03] Working on Protein
[07:43:04] Client config found, loading data.
[07:43:04] Starting GUI Server
[07:43:53] Completed 1%
[07:44:42] Completed 2%
{Reduced to save virtual trees}
[09:03:31] Completed 98%
[09:04:20] Completed 99%
[09:05:10] Completed 100%
[09:05:10] Successful run
[09:05:10] DynamicWrapper: Finished Work Unit: sleep=10000
[09:05:20] Reserved 85064 bytes for xtc file; Cosm status=0
[09:05:20] Allocated 85064 bytes for xtc file
[09:05:20] - Reading up to 85064 from "work/wudata_00.xtc": Read 85064
[09:05:20] Read 85064 bytes from xtc file; available packet space=786345400
[09:05:20] xtc file hash check passed.
[09:05:20] Reserved 25248 25248 786345400 bytes for arc file=<work/wudata_00.trr> Cosm status=0
[09:05:20] Allocated 25248 bytes for arc file
[09:05:20] - Reading up to 25248 from "work/wudata_00.trr": Read 25248
[09:05:20] Read 25248 bytes from arc file; available packet space=786320152
[09:05:20] trr file hash check passed.
[09:05:20] Allocated 560 bytes for edr file
[09:05:20] Read bedfile
[09:05:20] edr file hash check passed.
[09:05:20] Allocated 31209 bytes for logfile
[09:05:20] Read logfile
[09:05:20] GuardedRun: success in DynamicWrapper
[09:05:20] GuardedRun: done
[09:05:20] Run: GuardedRun completed.
[09:05:21] + Opened results file
[09:05:21] - Writing 142593 bytes of core data to disk...
[09:05:21] Done: 142081 -> 119184 (compressed to 83.8 percent)
[09:05:21] ... Done.
[09:05:21] DeleteFrameFiles: successfully deleted file=work/wudata_00.ckp
[09:05:21] Shutting down core
[09:05:21]
[09:05:21] Folding@home Core Shutdown: FINISHED_UNIT
[09:05:25] CoreStatus = 64 (100)
[09:05:25] Unit 0 finished with 99 percent of time to deadline remaining.
[09:05:25] Updated performance fraction: 0.988135
[09:05:25] Sending work to server
[09:05:25] Project: 6602 (Run 3, Clone 442, Gen 47)
[09:05:25] - Read packet limit of 540015616... Set to 524286976.
[09:05:25] + Attempting to send results [April 29 09:05:25 UTC]
[09:05:25] - Reading file work/wuresults_00.dat from core
[09:05:25] (Read 119696 bytes from disk)
[09:05:25] Connecting to http://171.64.65.61:8080/
[09:05:29] Posted data.
[09:05:29] Initial: 0000; - Uploaded at ~29 kB/s
[09:05:29] - Averaged speed for that direction ~27 kB/s
[09:05:29] + Results successfully sent
[09:05:29] Thank you for your contribution to Folding@Home.
[09:05:29] + Number of Units Completed: 5
[09:05:33] Trying to send all finished work units
[09:05:33] + No unsent completed units remaining.
[09:05:33] - Preparing to get new work unit...
[09:05:33] + Attempting to get work packet
[09:05:33] - Will indicate memory of 8182 MB
[09:05:33] - Connecting to assignment server
[09:05:33] Connecting to http://assign-GPU.stanford.edu:8080/
[09:05:35] Posted data.
[09:05:35] Initial: 40AB; - Successful: assigned to (171.64.65.61).
[09:05:35] + News From Folding@Home: Welcome to Folding@Home
[09:05:35] Loaded queue successfully.
[09:05:35] Connecting to http://171.64.65.61:8080/
[09:05:36] Posted data.
[09:05:36] Initial: 0000; - Receiving payload (expected size: 74274)
[09:05:38] - Downloaded at ~36 kB/s
[09:05:38] - Averaged speed for that direction ~50 kB/s
[09:05:38] + Received work.
[09:05:38] Trying to send all finished work units
[09:05:38] + No unsent completed units remaining.
[09:05:38] + Closed connections
[09:05:38]
[09:05:38] + Processing work unit
[09:05:38] Core required: FahCore_11.exe
[09:05:38] Core found.
[09:05:38] Working on queue slot 01 [April 29 09:05:38 UTC]
[09:05:38] + Working ...
[09:05:38] - Calling '.\FahCore_11.exe -dir work/ -suffix 01 -nocpulock -checkpoint 15 -verbose -lifeline 1544 -version 623'
[09:05:38]
[09:05:38] *------------------------------*
[09:05:38] Folding@Home GPU Core
[09:05:38] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[09:05:38]
[09:05:38] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[09:05:38] Build host: amoeba
[09:05:38] Board Type: Nvidia
[09:05:38] Core :
[09:05:38] Preparing to commence simulation
[09:05:38] - Looking at optimizations...
[09:05:38] DeleteFrameFiles: successfully deleted file=work/wudata_01.ckp
[09:05:38] - Created dyn
[09:05:38] - Files status OK
[09:05:38] - Expanded 73762 -> 383588 (decompressed 520.0 percent)
[09:05:38] Called DecompressByteArray: compressed_data_size=73762 data_size=383588, decompressed_data_size=383588 diff=0
[09:05:38] - Digital signature verified
[09:05:38]
[09:05:38] Project: 6601 (Run 4, Clone 824, Gen 54)
[09:05:38]
[09:05:38] Assembly optimizations on if available.
[09:05:38] Entering M.D.
[09:05:44] Tpr hash work/wudata_01.tpr: 1948583955 2094329292 1498604014 3379907582 2544976698
[09:05:44]
[09:05:44] Calling fah_main args: 14 usage=100
[09:05:44]
[09:05:45] Working on Protein
[09:05:46] Client config found, loading data.
[09:05:46] Starting GUI Server
[09:06:35] Completed 1%
[09:07:24] Completed 2%
{Reduced to save virtual trees}
[10:26:13] Completed 98%
[10:27:02] Completed 99%
[10:27:51] Completed 100%
[10:27:51] Successful run
[10:27:51] DynamicWrapper: Finished Work Unit: sleep=10000
[10:28:01] Reserved 84728 bytes for xtc file; Cosm status=0
[10:28:01] Allocated 84728 bytes for xtc file
[10:28:01] - Reading up to 84728 from "work/wudata_01.xtc": Read 84728
[10:28:01] Read 84728 bytes from xtc file; available packet space=786345736
[10:28:01] xtc file hash check passed.
[10:28:01] Reserved 25248 25248 786345736 bytes for arc file=<work/wudata_01.trr> Cosm status=0
[10:28:01] Allocated 25248 bytes for arc file
[10:28:01] - Reading up to 25248 from "work/wudata_01.trr": Read 25248
[10:28:01] Read 25248 bytes from arc file; available packet space=786320488
[10:28:01] trr file hash check passed.
[10:28:01] Allocated 560 bytes for edr file
[10:28:01] Read bedfile
[10:28:01] edr file hash check passed.
[10:28:01] Allocated 31137 bytes for logfile
[10:28:01] Read logfile
[10:28:01] GuardedRun: success in DynamicWrapper
[10:28:01] GuardedRun: done
[10:28:01] Run: GuardedRun completed.
[10:28:03] + Opened results file
[10:28:03] - Writing 142185 bytes of core data to disk...
[10:28:03] Done: 141673 -> 118624 (compressed to 83.7 percent)
[10:28:03] ... Done.
[10:28:03] DeleteFrameFiles: successfully deleted file=work/wudata_01.ckp
[10:28:03] Shutting down core
[10:28:03]
[10:28:03] Folding@home Core Shutdown: FINISHED_UNIT
[10:28:06] CoreStatus = 64 (100)
[10:28:06] Unit 1 finished with 99 percent of time to deadline remaining.
[10:28:06] Updated performance fraction: 0.989235
[10:28:06] Sending work to server
[10:28:06] Project: 6601 (Run 4, Clone 824, Gen 54)
[10:28:06] - Read packet limit of 540015616... Set to 524286976.
[10:28:06] + Attempting to send results [April 29 10:28:06 UTC]
[10:28:06] - Reading file work/wuresults_01.dat from core
[10:28:06] (Read 119136 bytes from disk)
[10:28:06] Connecting to http://171.64.65.61:8080/
[10:28:10] Posted data.
[10:28:11] Initial: 0000; - Uploaded at ~23 kB/s
[10:28:11] - Averaged speed for that direction ~26 kB/s
[10:28:11] + Results successfully sent
[10:28:11] Thank you for your contribution to Folding@Home.
[10:28:11] + Number of Units Completed: 6
[10:28:15] Trying to send all finished work units
[10:28:15] + No unsent completed units remaining.
[10:28:15] - Preparing to get new work unit...
[10:28:15] + Attempting to get work packet
[10:28:15] - Will indicate memory of 8182 MB
[10:28:15] - Connecting to assignment server
[10:28:15] Connecting to http://assign-GPU.stanford.edu:8080/
[10:28:16] Posted data.
[10:28:16] Initial: 43AB; - Successful: assigned to (171.67.108.21).
[10:28:16] + News From Folding@Home: Welcome to Folding@Home
[10:28:17] Loaded queue successfully.
[10:28:17] Connecting to http://171.67.108.21:8080/
[10:28:18] Posted data.
[10:28:18] Initial: 0000; - Receiving payload (expected size: 65548)
[10:28:18] Conversation time very short, giving reduced weight in bandwidth avg
[10:28:18] - Downloaded at ~128 kB/s
[10:28:18] - Averaged speed for that direction ~59 kB/s
[10:28:18] + Received work.
[10:28:18] Trying to send all finished work units
[10:28:18] + No unsent completed units remaining.
[10:28:18] + Closed connections
[10:28:18]
[10:28:18] + Processing work unit
[10:28:18] Core required: FahCore_11.exe
[10:28:18] Core found.
[10:28:18] Working on queue slot 02 [April 29 10:28:18 UTC]
[10:28:18] + Working ...
[10:28:18] - Calling '.\FahCore_11.exe -dir work/ -suffix 02 -nocpulock -checkpoint 15 -verbose -lifeline 1544 -version 623'
[10:28:18]
[10:28:18] *------------------------------*
[10:28:18] Folding@Home GPU Core
[10:28:18] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[10:28:18]
[10:28:18] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[10:28:18] Build host: amoeba
[10:28:18] Board Type: Nvidia
[10:28:18] Core :
[10:28:18] Preparing to commence simulation
[10:28:18] - Looking at optimizations...
[10:28:18] DeleteFrameFiles: successfully deleted file=work/wudata_02.ckp
[10:28:18] - Created dyn
[10:28:18] - Files status OK
[10:28:18] - Expanded 65036 -> 343723 (decompressed 528.5 percent)
[10:28:18] Called DecompressByteArray: compressed_data_size=65036 data_size=343723, decompressed_data_size=343723 diff=0
[10:28:18] - Digital signature verified
[10:28:18]
[10:28:18] Project: 5785 (Run 9, Clone 39, Gen 73)
[10:28:18]
[10:28:18] Assembly optimizations on if available.
[10:28:18] Entering M.D.
[10:28:24] Tpr hash work/wudata_02.tpr: 1769416963 2721308566 1407196758 1823676737 11804267
[10:28:24]
[10:28:24] Calling fah_main args: 14 usage=100
[10:28:24]
[10:28:25] Working on Gromacs Runs One Microsecond At Cannonball Speeds
[10:28:25] Client config found, loading data.
[10:28:25] Starting GUI Server
[10:29:53] Completed 1%
[10:31:21] Completed 2%
[10:32:49] Completed 3%
[10:34:17] Completed 4%
[10:35:45] Completed 5%
[10:37:13] Completed 6%
[10:38:41] Completed 7%
[10:40:09] Completed 8%
[10:41:37] Completed 9%
[10:43:05] Completed 10%
[10:44:33] Completed 11%
[10:46:01] Completed 12%
[10:47:29] Completed 13%
[10:48:57] Completed 14%
[10:50:25] Completed 15%
[10:51:53] Completed 16%
[10:53:21] Completed 17%
[10:54:49] Completed 18%
[10:56:17] Completed 19%
[10:57:45] Completed 20%
[10:59:13] Completed 21%
[11:00:41] Completed 22%
[11:02:09] Completed 23%
[11:03:37] Completed 24%
[11:05:05] Completed 25%
[11:06:33] Completed 26%
[11:08:01] Completed 27%
[11:09:29] Completed 28%
[11:10:57] Completed 29%
[11:12:26] Completed 30%
[11:13:54] Completed 31%
[11:15:22] Completed 32%
[11:16:50] Completed 33%
[11:18:18] Completed 34%
[11:19:46] Completed 35%
[11:21:14] Completed 36%
[11:22:42] Completed 37%
[11:24:10] Completed 38%
[11:25:38] Completed 39%
[11:27:06] Completed 40%
[11:28:12] - Autosending finished units... [April 29 11:28:12 UTC]
[11:28:12] Trying to send all finished work units
[11:28:12] + No unsent completed units remaining.
[11:28:12] - Autosend completed
[11:28:12] + Working...
[11:28:34] Completed 41%
[11:30:02] Completed 42%
[11:31:30] Completed 43%
[11:32:58] Completed 44%
[11:34:26] Completed 45%
[11:35:54] Completed 46%
[11:37:22] Completed 47%
[11:38:42] Completed 48%
[11:38:42] mdrun_gpu returned
[11:38:42] NANs detected on GPU
[11:38:42]
[11:38:42] Folding@home Core Shutdown: UNSTABLE_MACHINE
[11:38:45] CoreStatus = 7A (122)
[11:38:45] Sending work to server
[11:38:45] Project: 5785 (Run 9, Clone 39, Gen 73)
[11:38:45] - Read packet limit of 540015616... Set to 524286976.
[11:38:45] - Error: Could not get length of results file work/wuresults_02.dat
[11:38:45] - Error: Could not read unit 02 file. Removing from queue.
[11:38:45] Trying to send all finished work units
[11:38:45] + No unsent completed units remaining.
[11:38:45] - Preparing to get new work unit...
[11:38:45] + Attempting to get work packet
[11:38:45] - Will indicate memory of 8182 MB
[11:38:45] - Connecting to assignment server
[11:38:45] Connecting to http://assign-GPU.stanford.edu:8080/
[11:38:46] Posted data.
[11:38:46] Initial: 43AB; - Successful: assigned to (171.67.108.21).
[11:38:46] + News From Folding@Home: Welcome to Folding@Home
[11:38:47] Loaded queue successfully.
[11:38:47] Connecting to http://171.67.108.21:8080/
[11:38:48] Posted data.
[11:38:48] Initial: 0000; - Receiving payload (expected size: 65548)
[11:38:48] Conversation time very short, giving reduced weight in bandwidth avg
[11:38:48] - Downloaded at ~128 kB/s
[11:38:48] - Averaged speed for that direction ~67 kB/s
[11:38:48] + Received work.
[11:38:48] Trying to send all finished work units
[11:38:48] + No unsent completed units remaining.
[11:38:48] + Closed connections
[11:38:53]
[11:38:53] + Processing work unit
[11:38:53] Core required: FahCore_11.exe
[11:38:53] Core found.
[11:38:53] Working on queue slot 03 [April 29 11:38:53 UTC]
[11:38:53] + Working ...
[11:38:53] - Calling '.\FahCore_11.exe -dir work/ -suffix 03 -nocpulock -checkpoint 15 -verbose -lifeline 1544 -version 623'
[11:38:53]
[11:38:53] *------------------------------*
[11:38:53] Folding@Home GPU Core
[11:38:53] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[11:38:53]
[11:38:53] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[11:38:53] Build host: amoeba
[11:38:53] Board Type: Nvidia
[11:38:53] Core :
[11:38:53] Preparing to commence simulation
[11:38:53] - Looking at optimizations...
[11:38:53] DeleteFrameFiles: successfully deleted file=work/wudata_03.ckp
[11:38:53] - Created dyn
[11:38:53] - Files status OK
[11:38:53] - Expanded 65036 -> 343723 (decompressed 528.5 percent)
[11:38:53] Called DecompressByteArray: compressed_data_size=65036 data_size=343723, decompressed_data_size=343723 diff=0
[11:38:53] - Digital signature verified
[11:38:53]
[11:38:53] Project: 5785 (Run 9, Clone 39, Gen 73)
[11:38:53]
[11:38:53] Assembly optimizations on if available.
[11:38:53] Entering M.D.
[11:38:59] Tpr hash work/wudata_03.tpr: 1769416963 2721308566 1407196758 1823676737 11804267
[11:38:59]
[11:38:59] Calling fah_main args: 14 usage=100
[11:38:59]
[11:39:00] Working on Gromacs Runs One Microsecond At Cannonball Speeds
[11:39:00] Client config found, loading data.
[11:39:00] Starting GUI Server
[11:40:28] Completed 1%
[11:41:56] Completed 2%
[11:43:24] Completed 3%
[11:44:52] Completed 4%
[11:46:20] Completed 5%
[11:47:48] Completed 6%
[11:48:58] Completed 7%
[11:48:58] mdrun_gpu returned
[11:48:58] NANs detected on GPU
[11:48:58]
[11:48:58] Folding@home Core Shutdown: UNSTABLE_MACHINE
[11:49:01] CoreStatus = 7A (122)
[11:49:01] Sending work to server
[11:49:01] Project: 5785 (Run 9, Clone 39, Gen 73)
[11:49:01] - Read packet limit of 540015616... Set to 524286976.
[11:49:01] - Error: Could not get length of results file work/wuresults_03.dat
[11:49:01] - Error: Could not read unit 03 file. Removing from queue.
[11:49:01] Trying to send all finished work units
[11:49:01] + No unsent completed units remaining.
[11:49:01] - Preparing to get new work unit...
[11:49:01] + Attempting to get work packet
[11:49:01] - Will indicate memory of 8182 MB
[11:49:01] - Connecting to assignment server
[11:49:01] Connecting to http://assign-GPU.stanford.edu:8080/
[11:49:03] Posted data.
[11:49:03] Initial: 43AB; - Successful: assigned to (171.67.108.21).
[11:49:03] + News From Folding@Home: Welcome to Folding@Home
[11:49:03] Loaded queue successfully.
[11:49:03] Connecting to http://171.67.108.21:8080/
[11:49:04] Posted data.
[11:49:04] Initial: 0000; - Receiving payload (expected size: 65548)
[11:49:05] - Downloaded at ~64 kB/s
[11:49:05] - Averaged speed for that direction ~66 kB/s
[11:49:05] + Received work.
[11:49:05] Trying to send all finished work units
[11:49:05] + No unsent completed units remaining.
[11:49:05] + Closed connections
[11:49:10]
[11:49:10] + Processing work unit
[11:49:10] Core required: FahCore_11.exe
[11:49:10] Core found.
[11:49:10] Working on queue slot 04 [April 29 11:49:10 UTC]
[11:49:10] + Working ...
[11:49:10] - Calling '.\FahCore_11.exe -dir work/ -suffix 04 -nocpulock -checkpoint 15 -verbose -lifeline 1544 -version 623'
[11:49:10]
[11:49:10] *------------------------------*
[11:49:10] Folding@Home GPU Core
[11:49:10] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[11:49:10]
[11:49:10] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[11:49:10] Build host: amoeba
[11:49:10] Board Type: Nvidia
[11:49:10] Core :
[11:49:10] Preparing to commence simulation
[11:49:10] - Looking at optimizations...
[11:49:10] DeleteFrameFiles: successfully deleted file=work/wudata_04.ckp
[11:49:10] - Created dyn
[11:49:10] - Files status OK
[11:49:10] - Expanded 65036 -> 343723 (decompressed 528.5 percent)
[11:49:10] Called DecompressByteArray: compressed_data_size=65036 data_size=343723, decompressed_data_size=343723 diff=0
[11:49:10] - Digital signature verified
[11:49:10]
[11:49:10] Project: 5785 (Run 9, Clone 39, Gen 73)
[11:49:10]
[11:49:10] Assembly optimizations on if available.
[11:49:10] Entering M.D.
[11:49:16] Tpr hash work/wudata_04.tpr: 1769416963 2721308566 1407196758 1823676737 11804267
[11:49:16]
[11:49:16] Calling fah_main args: 14 usage=100
[11:49:16]
[11:49:16] Working on Gromacs Runs One Microsecond At Cannonball Speeds
[11:49:17] Client config found, loading data.
[11:49:17] Starting GUI Server
[11:50:36] Completed 1%
[11:50:36] mdrun_gpu returned
[11:50:36] NANs detected on GPU
[11:50:36]
[11:50:36] Folding@home Core Shutdown: UNSTABLE_MACHINE
[11:50:38] CoreStatus = 7A (122)
[11:50:38] Sending work to server
[11:50:38] Project: 5785 (Run 9, Clone 39, Gen 73)
[11:50:38] - Read packet limit of 540015616... Set to 524286976.
[11:50:38] - Error: Could not get length of results file work/wuresults_04.dat
[11:50:38] - Error: Could not read unit 04 file. Removing from queue.
[11:50:38] Trying to send all finished work units
[11:50:38] + No unsent completed units remaining.
[11:50:38] - Preparing to get new work unit...
[11:50:38] + Attempting to get work packet
[11:50:38] - Will indicate memory of 8182 MB
[11:50:38] - Connecting to assignment server
[11:50:38] Connecting to http://assign-GPU.stanford.edu:8080/
[11:50:40] Posted data.
[11:50:40] Initial: 43AB; - Successful: assigned to (171.67.108.21).
[11:50:40] + News From Folding@Home: Welcome to Folding@Home
[11:50:40] Loaded queue successfully.
[11:50:40] Connecting to http://171.67.108.21:8080/
[11:50:41] Posted data.
[11:50:41] Initial: 0000; - Receiving payload (expected size: 65548)
[11:50:42] - Downloaded at ~64 kB/s
[11:50:42] - Averaged speed for that direction ~65 kB/s
[11:50:42] + Received work.
[11:50:42] Trying to send all finished work units
[11:50:42] + No unsent completed units remaining.
[11:50:42] + Closed connections
[11:50:47]
[11:50:47] + Processing work unit
[11:50:47] Core required: FahCore_11.exe
[11:50:47] Core found.
[11:50:47] Working on queue slot 05 [April 29 11:50:47 UTC]
[11:50:47] + Working ...
[11:50:47] - Calling '.\FahCore_11.exe -dir work/ -suffix 05 -nocpulock -checkpoint 15 -verbose -lifeline 1544 -version 623'
[11:50:47]
[11:50:47] *------------------------------*
[11:50:47] Folding@Home GPU Core
[11:50:47] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[11:50:47]
[11:50:47] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[11:50:47] Build host: amoeba
[11:50:47] Board Type: Nvidia
[11:50:47] Core :
[11:50:47] Preparing to commence simulation
[11:50:47] - Looking at optimizations...
[11:50:47] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[11:50:47] - Created dyn
[11:50:47] - Files status OK
[11:50:47] - Expanded 65036 -> 343723 (decompressed 528.5 percent)
[11:50:47] Called DecompressByteArray: compressed_data_size=65036 data_size=343723, decompressed_data_size=343723 diff=0
[11:50:47] - Digital signature verified
[11:50:47]
[11:50:47] Project: 5785 (Run 9, Clone 39, Gen 73)
[11:50:47]
[11:50:47] Assembly optimizations on if available.
[11:50:47] Entering M.D.
[11:50:53] Tpr hash work/wudata_05.tpr: 1769416963 2721308566 1407196758 1823676737 11804267
[11:50:53]
[11:50:53] Calling fah_main args: 14 usage=100
[11:50:53]
[11:50:53] Working on Gromacs Runs One Microsecond At Cannonball Speeds
[11:50:54] Client config found, loading data.
[11:50:54] Starting GUI Server
[11:52:22] Completed 1%
[11:53:50] Completed 2%
[11:55:18] Completed 3%
[11:56:46] Completed 4%
[11:58:14] Completed 5%
[11:59:33] Completed 6%
[11:59:33] mdrun_gpu returned
[11:59:33] NANs detected on GPU
[11:59:33]
[11:59:33] Folding@home Core Shutdown: UNSTABLE_MACHINE
[11:59:37] CoreStatus = 7A (122)
[11:59:37] Sending work to server
[11:59:37] Project: 5785 (Run 9, Clone 39, Gen 73)
[11:59:37] - Read packet limit of 540015616... Set to 524286976.
[11:59:37] - Error: Could not get length of results file work/wuresults_05.dat
[11:59:37] - Error: Could not read unit 05 file. Removing from queue.
[11:59:37] Trying to send all finished work units
[11:59:37] + No unsent completed units remaining.
[11:59:37] - Preparing to get new work unit...
[11:59:37] + Attempting to get work packet
[11:59:37] - Will indicate memory of 8182 MB
[11:59:37] - Connecting to assignment server
[11:59:37] Connecting to http://assign-GPU.stanford.edu:8080/
[11:59:38] Posted data.
[11:59:38] Initial: 43AB; - Successful: assigned to (171.67.108.21).
[11:59:38] + News From Folding@Home: Welcome to Folding@Home
[11:59:39] Loaded queue successfully.
[11:59:39] Connecting to http://171.67.108.21:8080/
[11:59:40] Posted data.
[11:59:40] Initial: 0000; - Receiving payload (expected size: 65548)
[11:59:40] Conversation time very short, giving reduced weight in bandwidth avg
[11:59:40] - Downloaded at ~128 kB/s
[11:59:40] - Averaged speed for that direction ~72 kB/s
[11:59:40] + Received work.
[11:59:40] Trying to send all finished work units
[11:59:40] + No unsent completed units remaining.
[11:59:40] + Closed connections
[11:59:45]
[11:59:45] + Processing work unit
[11:59:45] Core required: FahCore_11.exe
[11:59:45] Core found.
[11:59:45] Working on queue slot 06 [April 29 11:59:45 UTC]
[11:59:45] + Working ...
[11:59:45] - Calling '.\FahCore_11.exe -dir work/ -suffix 06 -nocpulock -checkpoint 15 -verbose -lifeline 1544 -version 623'
[11:59:46]
[11:59:46] *------------------------------*
[11:59:46] Folding@Home GPU Core
[11:59:46] Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
[11:59:46]
[11:59:46] Compiler : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86
[11:59:46] Build host: amoeba
[11:59:46] Board Type: Nvidia
[11:59:46] Core :
[11:59:46] Preparing to commence simulation
[11:59:46] - Looking at optimizations...
[11:59:46] DeleteFrameFiles: successfully deleted file=work/wudata_06.ckp
[11:59:46] - Created dyn
[11:59:46] - Files status OK
[11:59:46] - Expanded 65036 -> 343723 (decompressed 528.5 percent)
[11:59:46] Called DecompressByteArray: compressed_data_size=65036 data_size=343723, decompressed_data_size=343723 diff=0
[11:59:46] - Digital signature verified
[11:59:46]
[11:59:46] Project: 5785 (Run 9, Clone 39, Gen 73)
[11:59:46]
[11:59:46] Assembly optimizations on if available.
[11:59:46] Entering M.D.
[11:59:52] Tpr hash work/wudata_06.tpr: 1769416963 2721308566 1407196758 1823676737 11804267
[11:59:52]
[11:59:52] Calling fah_main args: 14 usage=100
[11:59:52]
[11:59:52] Working on Gromacs Runs One Microsecond At Cannonball Speeds
[11:59:53] Client config found, loading data.
[11:59:53] Starting GUI Server
[12:01:16] Completed 1%
[12:01:16] mdrun_gpu returned
[12:01:16] NANs detected on GPU
[12:01:16]
[12:01:16] Folding@home Core Shutdown: UNSTABLE_MACHINE
[12:01:20] CoreStatus = 7A (122)
[12:01:20] Sending work to server
[12:01:20] Project: 5785 (Run 9, Clone 39, Gen 73)
[12:01:20] - Read packet limit of 540015616... Set to 524286976.
[12:01:20] - Error: Could not get length of results file work/wuresults_06.dat
[12:01:20] - Error: Could not read unit 06 file. Removing from queue.
[12:01:20] EUE limit exceeded. Pausing 24 hours.