A few problems (faulty WUs/crash/hard-reset)
Posted: Sat Feb 01, 2014 1:10 pm
Heya,
Earlier today I decided to upgrade to F@H V7.4.2 beta just to try it out while keeping an eye on it. During the day everything seemed fine, so during the evening I went out. When I came back, I couldn't even get to the log in screen, and the computer just froze. The restart button didn't work, so I did a hard-reset. Ends up that couple of hours before I came back, the computer locked itself up due to F@H.
Checking the logs, I found that I had two faulty WUs back to back, followed by FahCore_a3 crashing.
After the hard-reset I went ahead and downgraded to V7.3.6. The logs showed that FahCore_a3 was on 40560 out of 500000 steps. As of right now it's happily folding. FahCore_17 continued from its last checkpoint (84%).
For your convenience I removed 7 hours from the log because everything was fine during that time.
Thanks!
Earlier today I decided to upgrade to F@H V7.4.2 beta just to try it out while keeping an eye on it. During the day everything seemed fine, so during the evening I went out. When I came back, I couldn't even get to the log in screen, and the computer just froze. The restart button didn't work, so I did a hard-reset. Ends up that couple of hours before I came back, the computer locked itself up due to F@H.
Checking the logs, I found that I had two faulty WUs back to back, followed by FahCore_a3 crashing.
After the hard-reset I went ahead and downgraded to V7.3.6. The logs showed that FahCore_a3 was on 40560 out of 500000 steps. As of right now it's happily folding. FahCore_17 continued from its last checkpoint (84%).
For your convenience I removed 7 hours from the log because everything was fine during that time.
Thanks!
Code: Select all
*********************** Log Started 2014-02-01T02:34:32Z ***********************
02:34:32:************************* Folding@home Client *************************
02:34:32: Website: http://folding.stanford.edu/
02:34:32: Copyright: (c) 2009-2014 Stanford University
02:34:32: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
02:34:32: Args: --open-web-control
02:34:32: Config: C:/Users/Matan/AppData/Roaming/FAHClient/config.xml
02:34:32:******************************** Build ********************************
02:34:32: Version: 7.4.2
02:34:32: Date: Jan 24 2014
02:34:32: Time: 13:51:17
02:34:32: SVN Rev: 4112
02:34:32: Branch: fah/trunk/client
02:34:32: Compiler: Intel(R) C++ MSVC 1500 mode 1200
02:34:32: Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
02:34:32: /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
02:34:32: Platform: win32 XP
02:34:32: Bits: 32
02:34:32: Mode: Release
02:34:32:******************************* System ********************************
02:34:32: CPU: Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz
02:34:32: CPU ID: GenuineIntel Family 6 Model 60 Stepping 3
02:34:32: CPUs: 8
02:34:32: Memory: 15.94GiB
02:34:32: Free Memory: 12.22GiB
02:34:32: Threads: WINDOWS_THREADS
02:34:32: OS Version: 6.1
02:34:32: Has Battery: false
02:34:32: On Battery: false
02:34:32: UTC Offset: 11
02:34:32: PID: 8444
02:34:32: CWD: C:/Users/Matan/AppData/Roaming/FAHClient
02:34:32: OS: Windows 7 Professional
02:34:32: OS Arch: AMD64
02:34:32: GPUs: 1
02:34:32: GPU 0: NVIDIA:3 GK104 [GeForce GTX 660 Ti]
02:34:32: CUDA: 3.0
02:34:32: CUDA Driver: 5050
02:34:32:Win32 Service: false
02:34:32:***********************************************************************
02:34:32:<config>
02:34:32: <!-- Folding Core -->
02:34:32: <checkpoint v='3'/>
02:34:32:
02:34:32: <!-- Network -->
02:34:32: <proxy v=':8080'/>
02:34:32:
02:34:32: <!-- Slot Control -->
02:34:32: <power v='full'/>
02:34:32:
02:34:32: <!-- User Information -->
02:34:32: <passkey v='********************************'/>
02:34:32: <team v='110285'/>
02:34:32: <user v='IsraeliRD'/>
02:34:32:
02:34:32: <!-- Folding Slots -->
02:34:32: <slot id='0' type='GPU'/>
02:34:32: <slot id='1' type='CPU'/>
02:34:32:</config>
02:34:32:Trying to access database...
02:34:32:Successfully acquired database lock
02:34:32:Enabled folding slot 00: READY gpu:0:GK104 [GeForce GTX 660 Ti]
02:34:32:Enabled folding slot 01: READY cpu:7
02:34:32:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
02:34:32:WU01:FS01:Connecting to assign3.stanford.edu:8080
02:34:33:WU01:FS01:Assigned to work server 171.64.65.124
02:34:33:WU01:FS01:Requesting new work unit for slot 01: READY cpu:7 from 171.64.65.124
02:34:33:WU00:FS00:Assigned to work server 171.64.65.69
02:34:33:WU01:FS01:Connecting to 171.64.65.124:8080
02:34:33:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GK104 [GeForce GTX 660 Ti] from 171.64.65.69
02:34:33:WU00:FS00:Connecting to 171.64.65.69:8080
02:34:41:WU01:FS01:Downloading 862.20KiB
02:34:41:WU00:FS00:Downloading 4.17MiB
02:34:43:WU01:FS01:Download complete
02:34:43:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9005 run:2 clone:29 gen:81 core:0xa4 unit:0x00000056664f2de452b80040bc3b8d33
02:34:43:WU01:FS01:Starting
02:34:43:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Matan/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 8444 -checkpoint 3 -np 7
02:34:43:WU01:FS01:Started FahCore on PID 7392
02:34:43:WU01:FS01:Core PID:6576
02:34:43:WU01:FS01:FahCore 0xa4 started
02:34:44:WU01:FS01:0xa4:
02:34:44:WU01:FS01:0xa4:*------------------------------*
02:34:44:WU01:FS01:0xa4:Folding@Home Gromacs GB Core
02:34:44:WU01:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
02:34:44:WU01:FS01:0xa4:
02:34:44:WU01:FS01:0xa4:Preparing to commence simulation
02:34:44:WU01:FS01:0xa4:- Looking at optimizations...
02:34:44:WU01:FS01:0xa4:- Created dyn
02:34:44:WU01:FS01:0xa4:- Files status OK
02:34:44:WU01:FS01:0xa4:- Expanded 882385 -> 1469104 (decompressed 166.4 percent)
02:34:44:WU01:FS01:0xa4:Called DecompressByteArray: compressed_data_size=882385 data_size=1469104, decompressed_data_size=1469104 diff=0
02:34:44:WU01:FS01:0xa4:- Digital signature verified
02:34:44:WU01:FS01:0xa4:
02:34:44:WU01:FS01:0xa4:Project: 9005 (Run 2, Clone 29, Gen 81)
02:34:44:WU01:FS01:0xa4:
02:34:44:WU01:FS01:0xa4:Assembly optimizations on if available.
02:34:44:WU01:FS01:0xa4:Entering M.D.
02:34:50:WU01:FS01:0xa4:Mapping NT from 7 to 7
02:34:50:WU01:FS01:0xa4:Completed 0 out of 250000 steps (0%)
02:34:51:WU00:FS00:Download 47.91%
02:34:57:WU00:FS00:Download 64.37%
02:35:07:WU00:FS00:Download 86.83%
02:35:07:WU00:FS00:Download complete
02:35:07:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:678 clone:2 gen:92 core:0x17 unit:0x00000083028c126651a6bd78010744de
02:35:07:WU00:FS00:Starting
02:35:07:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Matan/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 8444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
02:35:07:WU00:FS00:Started FahCore on PID 1984
02:35:07:WU00:FS00:Core PID:7212
02:35:07:WU00:FS00:FahCore 0x17 started
02:35:07:WU00:FS00:0x17:*********************** Log Started 2014-02-01T02:35:07Z ***********************
02:35:07:WU00:FS00:0x17:Project: 8900 (Run 678, Clone 2, Gen 92)
02:35:07:WU00:FS00:0x17:Unit: 0x00000083028c126651a6bd78010744de
02:35:07:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
02:35:07:WU00:FS00:0x17:Machine: 0
02:35:07:WU00:FS00:0x17:Reading tar file state.xml
02:35:08:WU00:FS00:0x17:Reading tar file system.xml
02:35:08:WU00:FS00:0x17:Reading tar file integrator.xml
02:35:08:WU00:FS00:0x17:Reading tar file core.xml
02:35:08:WU00:FS00:0x17:Digital signatures verified
02:35:08:WU00:FS00:0x17:Folding@home GPU core17
02:35:08:WU00:FS00:0x17:Version 0.0.52
02:36:16:WU01:FS01:0xa4:Completed 2500 out of 250000 steps (1%)
02:37:35:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
02:37:35:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
02:37:42:WU01:FS01:0xa4:Completed 5000 out of 250000 steps (2%)
02:39:07:WU01:FS01:0xa4:Completed 7500 out of 250000 steps (3%)
02:40:31:WU01:FS01:0xa4:Completed 10000 out of 250000 steps (4%)
02:41:55:WU01:FS01:0xa4:Completed 12500 out of 250000 steps (5%)
...
09:34:04:WU01:FS01:0xa4:Completed 240000 out of 250000 steps (96%)
09:35:28:WU01:FS01:0xa4:Completed 242500 out of 250000 steps (97%)
09:36:52:WU01:FS01:0xa4:Completed 245000 out of 250000 steps (98%)
09:37:45:WU00:FS00:0x17:Completed 1925000 out of 2500000 steps (77%)
09:38:16:WU01:FS01:0xa4:Completed 247500 out of 250000 steps (99%)
09:38:17:WU02:FS01:Connecting to assign3.stanford.edu:8080
09:38:18:WU02:FS01:Assigned to work server 128.143.199.97
09:38:18:WU02:FS01:Requesting new work unit for slot 01: RUNNING cpu:7 from 128.143.199.97
09:38:18:WU02:FS01:Connecting to 128.143.199.97:8080
09:38:25:WU02:FS01:Downloading 1.19MiB
09:38:26:WU02:FS01:Download complete
09:38:26:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:7501 run:0 clone:367 gen:476 core:0xa3 unit:0x00000273fbcb017d4de79ee2ecea8914
09:39:40:WU01:FS01:0xa4:Completed 250000 out of 250000 steps (100%)
09:39:40:WU01:FS01:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
09:39:50:WU01:FS01:0xa4:
09:39:50:WU01:FS01:0xa4:Finished Work Unit:
09:39:50:WU01:FS01:0xa4:- Reading up to 811800 from "01/wudata_01.trr": Read 811800
09:39:50:WU01:FS01:0xa4:trr file hash check passed.
09:39:50:WU01:FS01:0xa4:- Reading up to 746392 from "01/wudata_01.xtc": Read 746392
09:39:50:WU01:FS01:0xa4:xtc file hash check passed.
09:39:50:WU01:FS01:0xa4:edr file hash check passed.
09:39:50:WU01:FS01:0xa4:logfile size: 26168
09:39:50:WU01:FS01:0xa4:Leaving Run
09:39:51:WU01:FS01:0xa4:- Writing 1586848 bytes of core data to disk...
09:39:52:WU01:FS01:0xa4:Done: 1586336 -> 1539030 (compressed to 97.0 percent)
09:39:52:WU01:FS01:0xa4: ... Done.
09:39:52:WU01:FS01:0xa4:- Shutting down core
09:39:52:WU01:FS01:0xa4:
09:39:52:WU01:FS01:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
09:39:52:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:39:52:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9007 run:51 clone:18 gen:29 core:0xa4 unit:0x00000023664f2de452ba2c06df12d4c4
09:39:52:WU01:FS01:Uploading 1.47MiB to 171.64.65.124
09:39:52:WU01:FS01:Connecting to 171.64.65.124:8080
09:39:52:WU02:FS01:Starting
09:39:52:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Matan/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 02 -suffix 01 -version 704 -lifeline 8444 -checkpoint 3 -np 7
09:39:52:WU02:FS01:Started FahCore on PID 2120
09:39:52:WU02:FS01:Core PID:4648
09:39:52:WU02:FS01:FahCore 0xa3 started
09:39:53:WU02:FS01:0xa3:
09:39:53:WU02:FS01:0xa3:*------------------------------*
09:39:53:WU02:FS01:0xa3:Folding@Home Gromacs SMP Core
09:39:53:WU02:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
09:39:53:WU02:FS01:0xa3:
09:39:53:WU02:FS01:0xa3:Preparing to commence simulation
09:39:53:WU02:FS01:0xa3:- Looking at optimizations...
09:39:53:WU02:FS01:0xa3:- Created dyn
09:39:53:WU02:FS01:0xa3:- Files status OK
09:39:53:WU02:FS01:0xa3:- Expanded 1248198 -> 2077020 (decompressed 166.4 percent)
09:39:53:WU02:FS01:0xa3:Called DecompressByteArray: compressed_data_size=1248198 data_size=2077020, decompressed_data_size=2077020 diff=0
09:39:53:WU02:FS01:0xa3:- Digital signature verified
09:39:53:WU02:FS01:0xa3:
09:39:53:WU02:FS01:0xa3:Project: 7501 (Run 0, Clone 367, Gen 476)
09:39:53:WU02:FS01:0xa3:
09:39:53:WU02:FS01:0xa3:Assembly optimizations on if available.
09:39:53:WU02:FS01:0xa3:Entering M.D.
09:39:58:WU02:FS01:0xa3:Mapping NT from 7 to 7
09:39:58:WU02:FS01:0xa3:mdrun returned 255
09:39:58:WU02:FS01:0xa3:Going to send back what have done -- stepsTotalG=500000
09:39:58:WU02:FS01:0xa3:Work fraction=0.0000 steps=500000.
09:39:59:WU01:FS01:Upload 55.34%
09:40:02:WU02:FS01:0xa3:logfile size=0 infoLength=0 edr=0 trr=25
09:40:02:WU02:FS01:0xa3:logfile size: 0 info=0 bed=0 hdr=25
09:40:02:WU02:FS01:0xa3:- Writing 640 bytes of core data to disk...
09:40:02:WU02:FS01:0xa3:Done: 128 -> 144 (compressed to 112.5 percent)
09:40:02:WU02:FS01:0xa3: ... Done.
09:40:02:WU02:FS01:0xa3:
09:40:02:WU02:FS01:0xa3:Folding@home Core Shutdown: EARLY_UNIT_END
09:40:03:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
09:40:03:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:7501 run:0 clone:367 gen:476 core:0xa3 unit:0x00000273fbcb017d4de79ee2ecea8914
09:40:03:WU02:FS01:Uploading 656B to 128.143.199.97
09:40:03:WU02:FS01:Connecting to 128.143.199.97:8080
09:40:03:WU03:FS01:Connecting to assign3.stanford.edu:8080
09:40:03:WU02:FS01:Upload complete
09:40:03:WU02:FS01:Server responded WORK_ACK (400)
09:40:03:WU02:FS01:Cleaning up
09:40:04:WU03:FS01:Assigned to work server 128.143.199.97
09:40:04:WU03:FS01:Requesting new work unit for slot 01: READY cpu:7 from 128.143.199.97
09:40:04:WU03:FS01:Connecting to 128.143.199.97:8080
09:40:05:WU01:FS01:Upload complete
09:40:05:WU01:FS01:Server responded WORK_ACK (400)
09:40:05:WU01:FS01:Final credit estimate, 1636.00 points
09:40:05:WU01:FS01:Cleaning up
09:40:14:WU03:FS01:Downloading 1.20MiB
09:40:14:WU03:FS01:Download complete
09:40:14:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:7501 run:0 clone:387 gen:405 core:0xa3 unit:0x00000206fbcb017d4de79ef35202c322
09:40:14:WU03:FS01:Starting
09:40:14:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Matan/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 03 -suffix 01 -version 704 -lifeline 8444 -checkpoint 3 -np 7
09:40:14:WU03:FS01:Started FahCore on PID 8568
09:40:14:WU03:FS01:Core PID:1880
09:40:14:WU03:FS01:FahCore 0xa3 started
09:40:15:WU03:FS01:0xa3:
09:40:15:WU03:FS01:0xa3:*------------------------------*
09:40:15:WU03:FS01:0xa3:Folding@Home Gromacs SMP Core
09:40:15:WU03:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
09:40:15:WU03:FS01:0xa3:
09:40:15:WU03:FS01:0xa3:Preparing to commence simulation
09:40:15:WU03:FS01:0xa3:- Looking at optimizations...
09:40:15:WU03:FS01:0xa3:- Created dyn
09:40:15:WU03:FS01:0xa3:- Files status OK
09:40:15:WU03:FS01:0xa3:- Expanded 1254787 -> 2077020 (decompressed 165.5 percent)
09:40:15:WU03:FS01:0xa3:Called DecompressByteArray: compressed_data_size=1254787 data_size=2077020, decompressed_data_size=2077020 diff=0
09:40:15:WU03:FS01:0xa3:- Digital signature verified
09:40:15:WU03:FS01:0xa3:
09:40:15:WU03:FS01:0xa3:Project: 7501 (Run 0, Clone 387, Gen 405)
09:40:15:WU03:FS01:0xa3:
09:40:15:WU03:FS01:0xa3:Assembly optimizations on if available.
09:40:15:WU03:FS01:0xa3:Entering M.D.
09:40:21:WU03:FS01:0xa3:Mapping NT from 7 to 7
09:40:21:WU03:FS01:0xa3:mdrun returned 255
09:40:21:WU03:FS01:0xa3:Going to send back what have done -- stepsTotalG=500000
09:40:21:WU03:FS01:0xa3:Work fraction=0.0000 steps=500000.
09:40:25:WU03:FS01:0xa3:logfile size=0 infoLength=0 edr=0 trr=25
09:40:25:WU03:FS01:0xa3:logfile size: 0 info=0 bed=0 hdr=25
09:40:25:WU03:FS01:0xa3:- Writing 640 bytes of core data to disk...
09:40:25:WU03:FS01:0xa3:Done: 128 -> 144 (compressed to 112.5 percent)
09:40:25:WU03:FS01:0xa3: ... Done.
09:40:25:WU03:FS01:0xa3:
09:40:25:WU03:FS01:0xa3:Folding@home Core Shutdown: EARLY_UNIT_END
09:40:25:WARNING:WU03:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
09:40:25:WU03:FS01:Sending unit results: id:03 state:SEND error:FAULTY project:7501 run:0 clone:387 gen:405 core:0xa3 unit:0x00000206fbcb017d4de79ef35202c322
09:40:25:WU03:FS01:Uploading 656B to 128.143.199.97
09:40:25:WU03:FS01:Connecting to 128.143.199.97:8080
09:40:25:WU01:FS01:Connecting to assign3.stanford.edu:8080
09:40:26:WU03:FS01:Upload complete
09:40:26:WU03:FS01:Server responded WORK_ACK (400)
09:40:26:WU03:FS01:Cleaning up
09:40:29:WU01:FS01:Assigned to work server 128.143.199.97
09:40:29:WU01:FS01:Requesting new work unit for slot 01: READY cpu:7 from 128.143.199.97
09:40:29:WU01:FS01:Connecting to 128.143.199.97:8080
09:40:39:WU01:FS01:Downloading 1.84MiB
09:40:48:WU01:FS01:Download 37.44%
09:40:49:WU01:FS01:Download complete
09:40:49:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:7514 run:0 clone:100 gen:397 core:0xa3 unit:0x000001edfbcb017d4ff73d9e18140b52
09:40:49:WU01:FS01:Starting
09:40:49:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Matan/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 01 -suffix 01 -version 704 -lifeline 8444 -checkpoint 3 -np 7
09:40:49:WU01:FS01:Started FahCore on PID 7024
09:40:49:WU01:FS01:Core PID:8376
09:40:49:WU01:FS01:FahCore 0xa3 started
09:40:50:WU01:FS01:0xa3:
09:40:50:WU01:FS01:0xa3:*------------------------------*
09:40:50:WU01:FS01:0xa3:Folding@Home Gromacs SMP Core
09:40:50:WU01:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
09:40:50:WU01:FS01:0xa3:
09:40:50:WU01:FS01:0xa3:Preparing to commence simulation
09:40:50:WU01:FS01:0xa3:- Looking at optimizations...
09:40:50:WU01:FS01:0xa3:- Created dyn
09:40:50:WU01:FS01:0xa3:- Files status OK
09:40:50:WU01:FS01:0xa3:- Expanded 1924719 -> 2865272 (decompressed 148.8 percent)
09:40:50:WU01:FS01:0xa3:Called DecompressByteArray: compressed_data_size=1924719 data_size=2865272, decompressed_data_size=2865272 diff=0
09:40:50:WU01:FS01:0xa3:- Digital signature verified
09:40:50:WU01:FS01:0xa3:
09:40:50:WU01:FS01:0xa3:Project: 7514 (Run 0, Clone 100, Gen 397)
09:40:50:WU01:FS01:0xa3:
09:40:50:WU01:FS01:0xa3:Assembly optimizations on if available.
09:40:50:WU01:FS01:0xa3:Entering M.D.
09:40:55:WU01:FS01:0xa3:Mapping NT from 7 to 7
09:40:56:WU01:FS01:0xa3:Completed 0 out of 500000 steps (0%)
09:43:04:WU00:FS00:0x17:Completed 1950000 out of 2500000 steps (78%)
09:44:58:WU01:FS01:0xa3:Completed 5000 out of 500000 steps (1%)
09:48:39:WU00:FS00:0x17:Completed 1975000 out of 2500000 steps (79%)
09:49:00:WU01:FS01:0xa3:Completed 10000 out of 500000 steps (2%)
09:53:02:WU01:FS01:0xa3:Completed 15000 out of 500000 steps (3%)
09:53:58:WU00:FS00:0x17:Completed 2000000 out of 2500000 steps (80%)
09:57:04:WU01:FS01:0xa3:Completed 20000 out of 500000 steps (4%)
09:59:33:WU00:FS00:0x17:Completed 2025000 out of 2500000 steps (81%)
10:01:20:WU01:FS01:0xa3:Completed 25000 out of 500000 steps (5%)
10:04:53:WU00:FS00:0x17:Completed 2050000 out of 2500000 steps (82%)
10:05:22:WU01:FS01:0xa3:Completed 30000 out of 500000 steps (6%)
10:09:24:WU01:FS01:0xa3:Completed 35000 out of 500000 steps (7%)
10:10:29:WU00:FS00:0x17:Completed 2075000 out of 2500000 steps (83%)
10:12:55:WARNING:WU01:FS01:FahCore returned an unknown error code which probably indicates that it crashed
10:12:55:WARNING:WU01:FS01:FahCore returned: UNKNOWN_ENUM (-1073741783 = 0xc0000029)
10:12:56:WU01:FS01:Starting
10:12:56:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Matan/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 01 -suffix 01 -version 704 -lifeline 8444 -checkpoint 3 -np 7
10:12:56:WU01:FS01:Started FahCore on PID 1208
10:12:56:WU01:FS01:Core PID:8860
10:12:56:WU01:FS01:FahCore 0xa3 started
10:12:56:WU01:FS01:0xa3:
10:12:56:WU01:FS01:0xa3:*------------------------------*
10:12:56:WU01:FS01:0xa3:Folding@Home Gromacs SMP Core
10:12:56:WU01:FS01:0xa3:Version 2.27 (Dec. 15, 2010)
10:12:56:WU01:FS01:0xa3:
10:12:56:WU01:FS01:0xa3:Preparing to commence simulation
10:12:56:WU01:FS01:0xa3:- Ensuring status. Please wait.
10:13:05:WU01:FS01:0xa3:- Looking at optimizations...
10:13:05:WU01:FS01:0xa3:- Working with standard loops on this execution.
10:13:05:WU01:FS01:0xa3:- Previous termination of core was improper.
10:13:05:WU01:FS01:0xa3:- Files status OK
10:13:05:WU01:FS01:0xa3:- Expanded 1924719 -> 2865272 (decompressed 148.8 percent)
10:13:05:WU01:FS01:0xa3:Called DecompressByteArray: compressed_data_size=1924719 data_size=2865272, decompressed_data_size=2865272 diff=0
10:13:05:WU01:FS01:0xa3:- Digital signature verified
10:13:05:WU01:FS01:0xa3:
10:13:05:WU01:FS01:0xa3:Project: 7514 (Run 0, Clone 100, Gen 397)
10:13:05:WU01:FS01:0xa3:
10:13:05:WU01:FS01:0xa3:Entering M.D.
10:13:11:WU01:FS01:0xa3:Using Gromacs checkpoints
10:13:11:WU01:FS01:0xa3:Mapping NT from 7 to 7
10:13:12:WU01:FS01:0xa3:Resuming from checkpoint
10:13:12:WU01:FS01:0xa3:Verified 01/wudata_01.log
10:13:12:WU01:FS01:0xa3:Verified 01/wudata_01.trr
10:13:12:WU01:FS01:0xa3:Verified 01/wudata_01.xtc
10:13:12:WU01:FS01:0xa3:Verified 01/wudata_01.edr
10:13:12:WU01:FS01:0xa3:Completed 36910 out of 500000 steps (7%)
10:15:42:WU01:FS01:0xa3:Completed 40000 out of 500000 steps (8%)
10:15:49:WU00:FS00:0x17:Completed 2100000 out of 2500000 steps (84%)