Page 1 of 2
Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Wed Mar 26, 2014 8:06 pm
by Nert
I am unable to complete a work unit. I get a message saying "Bad_Work_Unit". I'm folding on both cores on my CPU. I'm also folding on my NVIDIA card, and this is the one with the error.
Here's the section of the log with the error message:
Code: Select all
23:26:55:WU01:FS00:0x17:*********************** Log Started 2014-03-23T23:26:54Z ***********************
23:26:55:WU01:FS00:0x17:Project: 13001 (Run 181, Clone 6, Gen 1)
23:26:55:WU01:FS00:0x17:Unit: 0x00000001538b3db75328831eabe5e094
23:26:55:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:26:55:WU01:FS00:0x17:Machine: 0
23:26:55:WU01:FS00:0x17:Reading tar file state.xml
23:26:56:WU01:FS00:0x17:Reading tar file system.xml
23:26:57:WU01:FS00:0x17:Reading tar file integrator.xml
23:26:57:WU01:FS00:0x17:Reading tar file core.xml
23:26:57:WU01:FS00:0x17:Digital signatures verified
23:26:57:WU01:FS00:0x17:Folding@home GPU core17
23:26:57:WU01:FS00:0x17:Version 0.0.52
23:33:21:WU01:FS00:0x17:ERROR:exception: Force RMSE error of 453.538 with threshold of 5
23:33:21:WU01:FS00:0x17:Saving result file logfile_01.txt
23:33:21:WU01:FS00:0x17:Saving result file log.txt
23:33:21:WU01:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:33:21:WARNING:WU01:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:33:21:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:13001 run:181 clone:6 gen:1 core:0x17 unit:0x00000001538b3db75328831eabe5e094
23:33:21:WU01:FS00:Uploading 2.25KiB to 140.163.4.231
23:33:21:WU01:FS00:Connecting to 140.163.4.231:8080
23:33:21:WU01:FS00:Upload complete
23:33:21:WU01:FS00:Server responded WORK_ACK (400)
23:33:21:WU01:FS00:Cleaning up
23:33:21:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
23:33:21:WU02:FS00:News: Welcome to Folding@Home
23:33:21:WU02:FS00:Assigned to work server 140.163.4.231
23:33:21:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
23:33:21:WU02:FS00:Connecting to 140.163.4.231:8080
23:33:23:WU02:FS00:Downloading 4.84MiB
23:33:26:WU02:FS00:Download complete
23:33:26:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13001 run:515 clone:2 gen:1 core:0x17 unit:0x00000001538b3db7532c8e3292c77516
23:33:26:WU02:FS00:Starting
23:33:26:WU02:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:33:26:WU02:FS00:Started FahCore on PID 6796
23:33:27:WU02:FS00:Core PID:4616
23:33:27:WU02:FS00:FahCore 0x17 started
Sorry if I'm not doing this right. I'm not real proficient with all this stuff. I'm just a contributor.
Rog
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Wed Mar 26, 2014 8:20 pm
by bollix47
Welcome to the folding@home support forum Nert.
Another folder was able to complete this work unit successfully.
Unfortunately there is an issue that is affecting a Maxwell's ability to fold the core_17 work units. Some people with those cards are using version 6 of the client which only gets core_15 work units and those do work okay. If you don't want to do that another option would be to shut down your GPU slot until the issue is resolved or you could leave it running and hope most of the work units you get are for core_15. Since core_17 WUs won't even start folding and they do notify the server of the problem there isn't a significant loss of time before the work unit is reassigned.
Also, in support of the last option, there may be something PG is doing to help with this:
viewtopic.php?p=261505#p261505
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Thu Mar 27, 2014 3:36 pm
by Nert
That's disappointing. I upgraded my video card mostly to allow me to do more folding (I really believe in this project). I looked at the link you provided and see that the analysis/resolution for this problem is still ongoing and apparently unresolved. I'll disable the GPU slot for now. Will deleting the gpu slot from the configure/slot window be sufficient to do this ? Is there anything else that I need to do to clear this problem from my system ? The reason I ask is because after I deleted the slot, the status window shows this slot's status as "cleanup".
Should I just check back periodically to see when the problem is resolved, or is there some way that I can be notified ?
Thanks,
Rog
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Thu Mar 27, 2014 4:03 pm
by PantherX
You can delete the GPU Slot and add it later when your Nvidia Maxwell GPU is supported. You can check the Forum to see if there is any update on the Maxwell issue but a safe bet would be that an official announcement about FahCore_17 supporting Maxwell GPUs mightl be posted on the Blog (
http://folding.stanford.edu/home/blog).
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Thu Mar 27, 2014 7:46 pm
by davidcoton
From the thread at the link bollix47 gave, if your card is a Maxwell it should now be assigned Core_15 WUs, which should work fine. If you try again and either part fails again, please post the log with the config section as well.
David
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Thu Mar 27, 2014 10:31 pm
by Nert
David,
I added the GPU slot back in. Is there something else that I need to do to get i5 only units ? In looking at the following log, it looks like I'm getting I7 units. The slot has failed again, and I have deleted it.
Code: Select all
21:40:05:Adding folding slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti]
21:40:05:Saving configuration to config.xml
21:40:05:<config>
21:40:05: <!-- Folding Slot Configuration -->
21:40:05: <power v='FULL'/>
21:40:05:
21:40:05: <!-- Network -->
21:40:05: <proxy v=':8080'/>
21:40:05:
21:40:05: <!-- User Information -->
21:40:05: <team v='165780'/>
21:40:05: <user v='nert'/>
21:40:05:
21:40:05: <!-- Folding Slots -->
21:40:05: <slot id='1' type='CPU'/>
21:40:05: <slot id='2' type='CPU'>
21:40:05: <cpus v='-1'/>
21:40:05: </slot>
21:40:05: <slot id='0' type='GPU'/>
21:40:05:</config>
21:40:05:WU03:FS00:Connecting to assign-GPU.stanford.edu:80
21:40:06:WU03:FS00:News: Welcome to Folding@Home
21:40:06:WU03:FS00:Assigned to work server 140.163.4.231
21:40:06:WU03:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
21:40:06:WU03:FS00:Connecting to 140.163.4.231:8080
21:40:07:WU03:FS00:Downloading 4.84MiB
21:40:11:WU03:FS00:Download complete
21:40:11:WU03:FS00:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13000 run:1821 clone:0 gen:4 core:0x17 unit:0x0000000a538b3db753119ead6aade1b5
21:40:11:WU03:FS00:Starting
21:40:11:WU03:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
21:40:11:WU03:FS00:Started FahCore on PID 7184
21:40:11:WU03:FS00:Core PID:5744
21:40:11:WU03:FS00:FahCore 0x17 started
21:40:13:WU03:FS00:0x17:*********************** Log Started 2014-03-27T21:40:13Z ***********************
21:40:13:WU03:FS00:0x17:Project: 13000 (Run 1821, Clone 0, Gen 4)
21:40:13:WU03:FS00:0x17:Unit: 0x0000000a538b3db753119ead6aade1b5
21:40:13:WU03:FS00:0x17:CPU: 0x00000000000000000000000000000000
21:40:13:WU03:FS00:0x17:Machine: 0
21:40:13:WU03:FS00:0x17:Reading tar file state.xml
21:40:14:WU03:FS00:0x17:Reading tar file system.xml
21:40:15:WU03:FS00:0x17:Reading tar file integrator.xml
21:40:15:WU03:FS00:0x17:Reading tar file core.xml
21:40:15:WU03:FS00:0x17:Digital signatures verified
21:40:15:WU03:FS00:0x17:Folding@home GPU core17
21:40:15:WU03:FS00:0x17:Version 0.0.52
21:47:17:WU03:FS00:0x17:ERROR:exception: Force RMSE error of 449.511 with threshold of 5
21:47:17:WU03:FS00:0x17:Saving result file logfile_01.txt
21:47:17:WU03:FS00:0x17:Saving result file log.txt
21:47:17:WU03:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
21:47:17:WARNING:WU03:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:47:17:WU03:FS00:Sending unit results: id:03 state:SEND error:FAULTY project:13000 run:1821 clone:0 gen:4 core:0x17 unit:0x0000000a538b3db753119ead6aade1b5
21:47:18:WU03:FS00:Uploading 2.25KiB to 140.163.4.231
21:47:18:WU03:FS00:Connecting to 140.163.4.231:8080
21:47:18:WU04:FS00:Connecting to assign-GPU.stanford.edu:80
21:47:18:WU03:FS00:Upload complete
21:47:18:WU03:FS00:Server responded WORK_ACK (400)
21:47:18:WU03:FS00:Cleaning up
21:47:18:WU04:FS00:News: Welcome to Folding@Home
21:47:18:WU04:FS00:Assigned to work server 140.163.4.231
21:47:18:WU04:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
21:47:18:WU04:FS00:Connecting to 140.163.4.231:8080
21:47:20:WU04:FS00:Downloading 4.84MiB
21:47:23:WU04:FS00:Download complete
21:47:23:WU04:FS00:Received Unit: id:04 state:DOWNLOAD error:NO_ERROR project:13000 run:366 clone:1 gen:4 core:0x17 unit:0x00000009538b3db753100326677f2ded
21:47:23:WU04:FS00:Starting
21:47:23:WU04:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
21:47:23:WU04:FS00:Started FahCore on PID 5072
21:47:23:WU04:FS00:Core PID:7172
21:47:23:WU04:FS00:FahCore 0x17 started
21:47:24:WU04:FS00:0x17:*********************** Log Started 2014-03-27T21:47:24Z ***********************
21:47:24:WU04:FS00:0x17:Project: 13000 (Run 366, Clone 1, Gen 4)
21:47:24:WU04:FS00:0x17:Unit: 0x00000009538b3db753100326677f2ded
21:47:24:WU04:FS00:0x17:CPU: 0x00000000000000000000000000000000
21:47:24:WU04:FS00:0x17:Machine: 0
21:47:24:WU04:FS00:0x17:Reading tar file state.xml
21:47:26:WU04:FS00:0x17:Reading tar file system.xml
21:47:26:WU04:FS00:0x17:Reading tar file integrator.xml
21:47:26:WU04:FS00:0x17:Reading tar file core.xml
21:47:26:WU04:FS00:0x17:Digital signatures verified
21:47:26:WU04:FS00:0x17:Folding@home GPU core17
21:47:26:WU04:FS00:0x17:Version 0.0.52
21:54:37:WU04:FS00:0x17:ERROR:exception: Force RMSE error of 454.658 with threshold of 5
21:54:37:WU04:FS00:0x17:Saving result file logfile_01.txt
21:54:37:WU04:FS00:0x17:Saving result file log.txt
21:54:37:WU04:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
21:54:43:WARNING:WU04:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:54:43:WU04:FS00:Sending unit results: id:04 state:SEND error:FAULTY project:13000 run:366 clone:1 gen:4 core:0x17 unit:0x00000009538b3db753100326677f2ded
21:54:43:WU04:FS00:Uploading 2.24KiB to 140.163.4.231
21:54:43:WU04:FS00:Connecting to 140.163.4.231:8080
21:54:44:WU03:FS00:Connecting to assign-GPU.stanford.edu:80
21:54:44:WU04:FS00:Upload complete
21:54:44:WU04:FS00:Server responded WORK_ACK (400)
21:54:44:WU04:FS00:Cleaning up
21:54:44:WU03:FS00:News: Welcome to Folding@Home
21:54:44:WU03:FS00:Assigned to work server 140.163.4.231
21:54:44:WU03:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
21:54:44:WU03:FS00:Connecting to 140.163.4.231:8080
21:54:46:WU03:FS00:Downloading 4.84MiB
21:54:48:WU03:FS00:Download complete
21:54:48:WU03:FS00:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13001 run:322 clone:1 gen:3 core:0x17 unit:0x0000000b538b3db75328aaf86441d0ab
21:54:49:WU03:FS00:Starting
21:54:49:WU03:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
21:54:49:WU03:FS00:Started FahCore on PID 2204
21:54:49:WU03:FS00:Core PID:5828
21:54:49:WU03:FS00:FahCore 0x17 started
21:54:50:WU03:FS00:0x17:*********************** Log Started 2014-03-27T21:54:50Z ***********************
21:54:50:WU03:FS00:0x17:Project: 13001 (Run 322, Clone 1, Gen 3)
21:54:50:WU03:FS00:0x17:Unit: 0x0000000b538b3db75328aaf86441d0ab
21:54:50:WU03:FS00:0x17:CPU: 0x00000000000000000000000000000000
21:54:50:WU03:FS00:0x17:Machine: 0
21:54:50:WU03:FS00:0x17:Reading tar file state.xml
21:54:51:WU03:FS00:0x17:Reading tar file system.xml
21:54:52:WU03:FS00:0x17:Reading tar file integrator.xml
21:54:52:WU03:FS00:0x17:Reading tar file core.xml
21:54:52:WU03:FS00:0x17:Digital signatures verified
21:54:52:WU03:FS00:0x17:Folding@home GPU core17
21:54:52:WU03:FS00:0x17:Version 0.0.52
Here is config.xml:
Code: Select all
<config>
<!-- Folding Slot Configuration -->
<power v='FULL'/>
<!-- Network -->
<proxy v=':8080'/>
<!-- User Information -->
<team v='165780'/>
<user v='nert'/>
<!-- Folding Slots -->
<slot id='1' type='CPU'/>
<slot id='2' type='CPU'>
<cpus v='-1'/>
</slot>
<slot id='0' type='GPU'/>
</config>
Rog
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Thu Mar 27, 2014 10:59 pm
by ChristianVirtual
@Nert: wonder why you configured two CPU slots ? Specially with unspecified number of cores for the first one and automatic for the second. There might be cases one would want several CPU slots, but those are rare.
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Fri Mar 28, 2014 12:05 am
by Nert
Christian,
I'm not sure why I did it that way. When I initially set it up, I didn't see an option for SMP, so I just started with one slot. When I did that, the CPU monitor only showed 50% utilized, so I guessed that the second core wasn't being used (my processor is only a Core 2 duo). So, to get the utilization up to 100% (where I usually ran it in the past), I just added a second cpu. I used to run the console only version, so this newest version is a bit confusing to me. It's pretty clear that I don't know what I'm doing with this.

Good news is that I'm making a contribution (although not anywhere near yours .... 69 million points. Wow).
I'd appreciate any suggestions about how to configure this better.
Thanks,
Rog
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Fri Mar 28, 2014 12:09 am
by P5-133XL
Nert wrote:David,
I added the GPU slot back in. Is there something else that I need to do to get i5 only units ? In looking at the following log, it looks like I'm getting I7 units. The slot has failed again, and I have deleted it.
To permanently remove the GPU slot you need to remove the GPU slot and then add the following extra client option gpu = false. That option will prevent the client from adding it back on its own. Another option, after you remove the GPU slot, is to change the client to run as a service. Windows, for security reasons, will not allow a service to access the video sub system. The main benefit of running the client as a service is the client will run even if no one is logged into Windows.
After you remove the surplus CPU slot, simply double click the remaining CPU slot and you can manually assign the number of cores/threads to be used with -1 being the default of letting the client choose. Do note that this will often only take effect after the current WU is finished.
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Fri Mar 28, 2014 12:29 am
by ChristianVirtual
I would suggest you to delete slot 2, set cpus=-1 for slot 1 and let the client figure out what is optimal. Having two CPU slots with each one core is less efficient compared to haveing one slot with two cores.
Once the maxwell issue is solved keep in mind that each NV card require one CPU core to drive the GPU. At least that is valid for today's working NV cards under 0x17 projects.
As my rule of thumb:
One CPU slot with cups=[number of physical or HT cores] - [number of NV GPUs] -1
The additional -1 is for OS, network and UI. My personal preference.
Hey, and as for contributions, another rule of thumb says: every WU counts !

Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Fri Mar 28, 2014 2:42 am
by PantherX
While not directly related to your GPU issue, you may consider getting a Passkey to earn bonus points once you have qualified for it (
http://folding.stanford.edu/home/faq/faq-passkey/).
Moreover, could you please post the system configuration which should look similar to this:
Code: Select all
*********************** Log Started 2014-03-25T07:54:28Z ***********************
07:54:28:************************* Folding@home Client *************************
07:54:28: Website: http://folding.stanford.edu/
07:54:28: Copyright: (c) 2009-2014 Stanford University
07:54:28: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
07:54:28: Args:
07:54:28: Config: C:/Users/PantherX/AppData/Roaming/FAHClient/config.xml
07:54:28:******************************** Build ********************************
07:54:28: Version: 7.4.4
07:54:28: Date: Mar 4 2014
07:54:28: Time: 20:26:54
07:54:28: SVN Rev: 4130
07:54:28: Branch: fah/trunk/client
07:54:28: Compiler: Intel(R) C++ MSVC 1500 mode 1200
07:54:28: Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
07:54:28: /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
07:54:28: Platform: win32 XP
07:54:28: Bits: 32
07:54:28: Mode: Release
07:54:28:******************************* System ********************************
07:54:28: CPU: Intel(R) Core(TM) i7 CPU 860 @ 2.80GHz
07:54:28: CPU ID: GenuineIntel Family 6 Model 30 Stepping 5
07:54:28: CPUs: 8
07:54:28: Memory: 7.99GiB
07:54:28: Free Memory: 6.70GiB
07:54:28: Threads: WINDOWS_THREADS
07:54:28: OS Version: 6.2
07:54:28: Has Battery: false
07:54:28: On Battery: false
07:54:28: UTC Offset: 3
07:54:28: PID: 4876
07:54:28: CWD: C:/Users/PantherX/AppData/Roaming/FAHClient
07:54:28: OS: Windows 8 Pro
07:54:28: OS Arch: AMD64
07:54:28: GPUs: 2
07:54:28: GPU 0: NVIDIA:3 GK104 [GeForce GTX 660 Ti]
07:54:28: GPU 1: NVIDIA:3 GK107 [GeForce GT 650]
07:54:28: CUDA: 3.0
07:54:28: CUDA Driver: 5050
07:54:28:Win32 Service: false
07:54:28:***********************************************************************
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Fri Mar 28, 2014 9:20 am
by davidcoton
What OS are you using? If Linux, Core_15 won't run. Deleting the GPU slot until the issue is fixed is the only option. But the servers at Stanford should still be set NOT to issue Core_17 WUs to Maxwell at present. If Windows, Core_15 will run and is supposed to be all that is issued to Maxwell.
We need to see the whole log, from a restart of FAH. This includes the system and config info that helps diagnose problems -- avoiding going round the loop so many times.
David
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Fri Mar 28, 2014 2:34 pm
by Nert
System is Windows Vista. I have not yet made suggested changes to config (wanted to isolate this specific problem before making changes).
I rebooted the system to clean up and restart FAH. Following is the start up log. I attempted to post the previous log from \ProgramData\FAHClient\logs, but I exceeded the character count maximum. I will try again with a separate message to see if the complete log will post. Character count for it is close to maximum (69917)
Code: Select all
*********************** Log Started 2014-03-28T14:09:13Z ***********************
14:09:14:************************* Folding@home Client *************************
14:09:14: Website: http://folding.stanford.edu/
14:09:14: Copyright: (c) 2009-2013 Stanford University
14:09:14: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
14:09:14: Args:
14:09:14: Config: C:/ProgramData/FAHClient/config.xml
14:09:14:******************************** Build ********************************
14:09:14: Version: 7.3.6
14:09:14: Date: Feb 18 2013
14:09:14: Time: 15:25:17
14:09:14: SVN Rev: 3923
14:09:14: Branch: fah/trunk/client
14:09:14: Compiler: Intel(R) C++ MSVC 1500 mode 1200
14:09:14: Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
14:09:14: /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
14:09:14: Platform: win32 XP
14:09:14: Bits: 32
14:09:14: Mode: Release
14:09:14:******************************* System ********************************
14:09:14: CPU: Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz
14:09:14: CPU ID: GenuineIntel Family 6 Model 15 Stepping 6
14:09:14: CPUs: 2
14:09:14: Memory: 2.87GiB
14:09:14: Free Memory: 1.69GiB
14:09:14: Threads: WINDOWS_THREADS
14:09:14: Has Battery: false
14:09:14: On Battery: false
14:09:14: UTC offset: -5
14:09:14: PID: 4376
14:09:14: CWD: C:/ProgramData/FAHClient
14:09:14: OS: Windows Vista (TM) Home Premium Service Pack 2
14:09:14: OS Arch: X86
14:09:14: GPUs: 1
14:09:14: GPU 0: NVIDIA:4 GM107 [GeForce GTX 750 Ti]
14:09:14: CUDA: 5.0
14:09:14: CUDA Driver: 6000
14:09:14:Win32 Service: false
14:09:14:***********************************************************************
14:09:14:<config>
14:09:14: <!-- Folding Slot Configuration -->
14:09:14: <power v='FULL'/>
14:09:14:
14:09:14: <!-- Network -->
14:09:14: <proxy v=':8080'/>
14:09:14:
14:09:14: <!-- User Information -->
14:09:14: <team v='165780'/>
14:09:14: <user v='nert'/>
14:09:14:
14:09:14: <!-- Folding Slots -->
14:09:14: <slot id='1' type='CPU'/>
14:09:14: <slot id='2' type='CPU'>
14:09:14: <cpus v='-1'/>
14:09:14: </slot>
14:09:14:</config>
14:09:14:Trying to access database...
14:09:21:Successfully acquired database lock
14:09:22:Enabled folding slot 01: READY cpu:2
14:09:22:Enabled folding slot 02: READY cpu:2
14:09:25:WU00:FS01:Cleaning up
14:09:29:WU02:FS02:Starting
14:09:29:WU02:FS02:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 703 -lifeline 4376 -checkpoint 15 -np 2
14:09:29:WU02:FS02:Started FahCore on PID 5068
14:09:33:WU02:FS02:Core PID:5168
14:09:33:WU02:FS02:FahCore 0xa4 started
14:09:34:WU02:FS02:0xa4:
14:09:34:WU02:FS02:0xa4:*------------------------------*
14:09:34:WU02:FS02:0xa4:Folding@Home Gromacs GB Core
14:09:34:WU02:FS02:0xa4:Version 2.27 (Dec. 15, 2010)
14:09:34:WU02:FS02:0xa4:
14:09:34:WU02:FS02:0xa4:Preparing to commence simulation
14:09:34:WU02:FS02:0xa4:- Ensuring status. Please wait.
14:09:35:WU01:FS01:Starting
14:09:35:WU01:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 703 -lifeline 4376 -checkpoint 15 -np 2
14:09:35:WU01:FS01:Started FahCore on PID 5192
14:09:36:WU01:FS01:Core PID:5216
14:09:36:WU01:FS01:FahCore 0xa4 started
14:09:36:WU01:FS01:0xa4:
14:09:36:WU01:FS01:0xa4:*------------------------------*
14:09:36:WU01:FS01:0xa4:Folding@Home Gromacs GB Core
14:09:36:WU01:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
14:09:36:WU01:FS01:0xa4:
14:09:36:WU01:FS01:0xa4:Preparing to commence simulation
14:09:36:WU01:FS01:0xa4:- Ensuring status. Please wait.
14:09:43:WU02:FS02:0xa4:- Looking at optimizations...
14:09:43:WU02:FS02:0xa4:- Working with standard loops on this execution.
14:09:43:WU02:FS02:0xa4:- Previous termination of core was improper.
14:09:43:WU02:FS02:0xa4:- Files status OK
14:09:43:WU02:FS02:0xa4:- Expanded 118421 -> 268472 (decompressed 226.7 percent)
14:09:43:WU02:FS02:0xa4:Called DecompressByteArray: compressed_data_size=118421 data_size=268472, decompressed_data_size=268472 diff=0
14:09:43:WU02:FS02:0xa4:- Digital signature verified
14:09:43:WU02:FS02:0xa4:
14:09:43:WU02:FS02:0xa4:Project: 6367 (Run 22, Clone 17, Gen 7)
14:09:43:WU02:FS02:0xa4:
14:09:43:WU02:FS02:0xa4:Entering M.D.
14:09:46:WU01:FS01:0xa4:- Looking at optimizations...
14:09:46:WU01:FS01:0xa4:- Working with standard loops on this execution.
14:09:46:WU01:FS01:0xa4:- Previous termination of core was improper.
14:09:46:WU01:FS01:0xa4:- Files status OK
14:09:46:WU01:FS01:0xa4:- Expanded 117235 -> 264000 (decompressed 225.1 percent)
14:09:46:WU01:FS01:0xa4:Called DecompressByteArray: compressed_data_size=117235 data_size=264000, decompressed_data_size=264000 diff=0
14:09:46:WU01:FS01:0xa4:- Digital signature verified
14:09:46:WU01:FS01:0xa4:
14:09:46:WU01:FS01:0xa4:Project: 6366 (Run 72, Clone 0, Gen 21)
14:09:46:WU01:FS01:0xa4:
14:09:46:WU01:FS01:0xa4:Entering M.D.
14:09:50:WU02:FS02:0xa4:Using Gromacs checkpoints
14:09:50:WU02:FS02:0xa4:Mapping NT from 2 to 2
14:09:52:WU01:FS01:0xa4:Using Gromacs checkpoints
14:09:52:WU01:FS01:0xa4:Mapping NT from 2 to 2
14:09:57:WU02:FS02:0xa4:Resuming from checkpoint
14:09:57:WU01:FS01:0xa4:Resuming from checkpoint
14:09:57:WU01:FS01:0xa4:Verified 01/wudata_01.log
14:09:57:WU02:FS02:0xa4:Verified 02/wudata_01.log
14:09:58:WU01:FS01:0xa4:Verified 01/wudata_01.trr
14:09:58:WU01:FS01:0xa4:Verified 01/wudata_01.xtc
14:09:58:WU02:FS02:0xa4:Verified 02/wudata_01.trr
14:09:58:WU02:FS02:0xa4:Verified 02/wudata_01.xtc
14:09:59:WU01:FS01:0xa4:Verified 01/wudata_01.edr
14:09:59:WU02:FS02:0xa4:Verified 02/wudata_01.edr
14:09:59:WU01:FS01:0xa4:Completed 4301700 out of 5000000 steps (86%)
14:09:59:WU02:FS02:0xa4:Completed 4111480 out of 5000000 steps (82%)
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Fri Mar 28, 2014 2:39 pm
by Nert
Previous log is too big. Here's the First half:
Code: Select all
*********************** Log Started 2014-03-23T23:07:26Z ***********************
23:07:26:************************* Folding@home Client *************************
23:07:26: Website: http://folding.stanford.edu/
23:07:26: Copyright: (c) 2009-2013 Stanford University
23:07:26: Author: Joseph Coffland <joseph@cauldrondevelopment.com>
23:07:26: Args: --open-web-control
23:07:26: Config: C:/ProgramData/FAHClient/config.xml
23:07:26:******************************** Build ********************************
23:07:26: Version: 7.3.6
23:07:26: Date: Feb 18 2013
23:07:26: Time: 15:25:17
23:07:26: SVN Rev: 3923
23:07:26: Branch: fah/trunk/client
23:07:26: Compiler: Intel(R) C++ MSVC 1500 mode 1200
23:07:26: Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
23:07:26: /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
23:07:26: Platform: win32 XP
23:07:26: Bits: 32
23:07:26: Mode: Release
23:07:26:******************************* System ********************************
23:07:26: CPU: Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz
23:07:26: CPU ID: GenuineIntel Family 6 Model 15 Stepping 6
23:07:26: CPUs: 2
23:07:26: Memory: 2.87GiB
23:07:26: Free Memory: 1.40GiB
23:07:26: Threads: WINDOWS_THREADS
23:07:26: Has Battery: false
23:07:26: On Battery: false
23:07:26: UTC offset: -5
23:07:26: PID: 1312
23:07:26: CWD: C:/ProgramData/FAHClient
23:07:26: OS: Windows Vista (TM) Home Premium Service Pack 2
23:07:26: OS Arch: X86
23:07:26: GPUs: 1
23:07:26: GPU 0: NVIDIA:4 GM107 [GeForce GTX 750 Ti]
23:07:26: CUDA: 5.0
23:07:26: CUDA Driver: 6000
23:07:26:Win32 Service: false
23:07:26:***********************************************************************
23:07:26:<config>
23:07:26: <!-- Folding Slot Configuration -->
23:07:26: <power v='full'/>
23:07:26:
23:07:26: <!-- Network -->
23:07:26: <proxy v=':8080'/>
23:07:26:
23:07:26: <!-- User Information -->
23:07:26: <team v='165780'/>
23:07:26: <user v='nert'/>
23:07:26:
23:07:26: <!-- Folding Slots -->
23:07:26: <slot id='1' type='CPU'/>
23:07:26: <slot id='2' type='CPU'>
23:07:26: <cpus v='-1'/>
23:07:26: </slot>
23:07:26:</config>
23:07:26:Trying to access database...
23:07:26:Successfully acquired database lock
23:07:26:Enabled folding slot 01: READY cpu:2
23:07:26:Enabled folding slot 02: READY cpu:2
23:07:33:WU00:FS01:Starting
23:07:33:WU00:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -np 2
23:07:33:WU00:FS01:Started FahCore on PID 5672
23:07:41:WU00:FS01:Core PID:6888
23:07:41:WU00:FS01:FahCore 0xa4 started
23:07:41:WU03:FS02:Starting
23:07:41:WU03:FS02:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a3.fah/FahCore_a3.exe -dir 03 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -np 2
23:07:44:WU03:FS02:Started FahCore on PID 7772
23:07:51:WU00:FS01:0xa4:
23:07:51:WU00:FS01:0xa4:*------------------------------*
23:07:51:WU00:FS01:0xa4:Folding@Home Gromacs GB Core
23:07:51:WU00:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
23:07:51:WU00:FS01:0xa4:
23:07:51:WU00:FS01:0xa4:Preparing to commence simulation
23:07:51:WU00:FS01:0xa4:- Looking at optimizations...
23:07:51:WU00:FS01:0xa4:- Files status OK
23:07:51:WU00:FS01:0xa4:- Expanded 117330 -> 264000 (decompressed 225.0 percent)
23:07:51:WU00:FS01:0xa4:Called DecompressByteArray: compressed_data_size=117330 data_size=264000, decompressed_data_size=264000 diff=0
23:07:51:WU00:FS01:0xa4:- Digital signature verified
23:07:51:WU00:FS01:0xa4:
23:07:51:WU00:FS01:0xa4:Project: 6366 (Run 13, Clone 30, Gen 6)
23:07:51:WU00:FS01:0xa4:
23:07:51:WU00:FS01:0xa4:Assembly optimizations on if available.
23:07:51:WU00:FS01:0xa4:Entering M.D.
23:07:54:WU03:FS02:Core PID:3744
23:07:54:WU03:FS02:FahCore 0xa3 started
23:07:54:WU03:FS02:0xa3:
23:07:54:WU03:FS02:0xa3:*------------------------------*
23:07:54:WU03:FS02:0xa3:Folding@Home Gromacs SMP Core
23:07:54:WU03:FS02:0xa3:Version 2.27 (Dec. 15, 2010)
23:07:54:WU03:FS02:0xa3:
23:07:54:WU03:FS02:0xa3:Preparing to commence simulation
23:07:54:WU03:FS02:0xa3:- Looking at optimizations...
23:07:54:WU03:FS02:0xa3:- Files status OK
23:07:54:WU03:FS02:0xa3:- Expanded 3851831 -> 4394668 (decompressed 114.0 percent)
23:07:54:WU03:FS02:0xa3:Called DecompressByteArray: compressed_data_size=3851831 data_size=4394668, decompressed_data_size=4394668 diff=0
23:07:55:WU03:FS02:0xa3:- Digital signature verified
23:07:55:WU03:FS02:0xa3:
23:07:55:WU03:FS02:0xa3:Project: 8585 (Run 1, Clone 2, Gen 283)
23:07:55:WU03:FS02:0xa3:
23:07:55:WU03:FS02:0xa3:Assembly optimizations on if available.
23:07:55:WU03:FS02:0xa3:Entering M.D.
23:07:57:WU00:FS01:0xa4:Using Gromacs checkpoints
23:07:57:WU00:FS01:0xa4:Mapping NT from 2 to 2
23:07:57:WU00:FS01:0xa4:Resuming from checkpoint
23:07:57:WU00:FS01:0xa4:Verified 00/wudata_01.log
23:07:57:WU00:FS01:0xa4:Verified 00/wudata_01.trr
23:07:57:WU00:FS01:0xa4:Verified 00/wudata_01.xtc
23:07:57:WU00:FS01:0xa4:Verified 00/wudata_01.edr
23:08:04:WU03:FS02:0xa3:Using Gromacs checkpoints
23:08:09:WU00:FS01:0xa4:Completed 2844130 out of 5000000 steps (56%)
23:08:11:WU03:FS02:0xa3:Mapping NT from 2 to 2
23:08:13:3:127.0.0.1:New Web connection
23:08:14:WU03:FS02:0xa3:Resuming from checkpoint
23:08:14:WU03:FS02:0xa3:Verified 03/wudata_01.log
23:08:14:WU03:FS02:0xa3:Verified 03/wudata_01.trr
23:08:14:WU03:FS02:0xa3:Verified 03/wudata_01.edr
23:08:16:WU03:FS02:0xa3:Completed 190125 out of 500000 steps (38%)
23:12:04:Adding folding slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti]
23:12:04:Saving configuration to config.xml
23:12:04:<config>
23:12:04: <!-- Folding Slot Configuration -->
23:12:04: <power v='full'/>
23:12:04:
23:12:04: <!-- Network -->
23:12:04: <proxy v=':8080'/>
23:12:04:
23:12:04: <!-- User Information -->
23:12:04: <team v='165780'/>
23:12:04: <user v='nert'/>
23:12:04:
23:12:04: <!-- Folding Slots -->
23:12:04: <slot id='1' type='CPU'/>
23:12:04: <slot id='2' type='CPU'>
23:12:04: <cpus v='-1'/>
23:12:04: </slot>
23:12:04: <slot id='0' type='GPU'/>
23:12:04:</config>
23:12:04:WU01:FS00:Connecting to assign-GPU.stanford.edu:80
23:12:05:WU01:FS00:News: Welcome to Folding@Home
23:12:05:WU01:FS00:Assigned to work server 140.163.4.231
23:12:05:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
23:12:05:WU01:FS00:Connecting to 140.163.4.231:8080
23:12:06:WU01:FS00:Downloading 4.84MiB
23:12:11:WU01:FS00:Download complete
23:12:11:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13000 run:757 clone:7 gen:3 core:0x17 unit:0x00000003538b3db75310717714ec170f
23:12:11:WU01:FS00:Starting
23:12:11:WU01:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:12:11:WU01:FS00:Started FahCore on PID 4804
23:12:11:WU01:FS00:Core PID:6268
23:12:11:WU01:FS00:FahCore 0x17 started
23:12:12:WU01:FS00:0x17:*********************** Log Started 2014-03-23T23:12:11Z ***********************
23:12:12:WU01:FS00:0x17:Project: 13000 (Run 757, Clone 7, Gen 3)
23:12:12:WU01:FS00:0x17:Unit: 0x00000003538b3db75310717714ec170f
23:12:12:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:12:12:WU01:FS00:0x17:Machine: 0
23:12:12:WU01:FS00:0x17:Reading tar file state.xml
23:12:13:WU01:FS00:0x17:Reading tar file system.xml
23:12:13:WU01:FS00:0x17:Reading tar file integrator.xml
23:12:13:WU01:FS00:0x17:Reading tar file core.xml
23:12:13:WU01:FS00:0x17:Digital signatures verified
23:12:13:WU01:FS00:0x17:Folding@home GPU core17
23:12:13:WU01:FS00:0x17:Version 0.0.52
23:13:55:WU00:FS01:0xa4:Completed 2850000 out of 5000000 steps (57%)
23:19:39:WU01:FS00:0x17:ERROR:exception: Force RMSE error of 453.016 with threshold of 5
23:19:39:WU01:FS00:0x17:Saving result file logfile_01.txt
23:19:39:WU01:FS00:0x17:Saving result file log.txt
23:19:39:WU01:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:19:40:WARNING:WU01:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:19:40:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:13000 run:757 clone:7 gen:3 core:0x17 unit:0x00000003538b3db75310717714ec170f
23:19:40:WU01:FS00:Uploading 2.23KiB to 140.163.4.231
23:19:40:WU01:FS00:Connecting to 140.163.4.231:8080
23:19:40:WU01:FS00:Upload complete
23:19:40:WU01:FS00:Server responded WORK_ACK (400)
23:19:40:WU01:FS00:Cleaning up
23:19:40:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
23:19:40:WU02:FS00:News: Welcome to Folding@Home
23:19:40:WU02:FS00:Assigned to work server 140.163.4.231
23:19:40:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
23:19:40:WU02:FS00:Connecting to 140.163.4.231:8080
23:19:42:WU02:FS00:Downloading 5.22MiB
23:19:45:WU02:FS00:Download complete
23:19:45:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13001 run:254 clone:7 gen:0 core:0x17 unit:0x00000000538b3db7532897de878b24a0
23:19:46:WU02:FS00:Starting
23:19:46:WU02:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:19:46:WU02:FS00:Started FahCore on PID 2212
23:19:46:WU02:FS00:Core PID:3020
23:19:46:WU02:FS00:FahCore 0x17 started
23:19:47:WU02:FS00:0x17:*********************** Log Started 2014-03-23T23:19:47Z ***********************
23:19:47:WU02:FS00:0x17:Project: 13001 (Run 254, Clone 7, Gen 0)
23:19:47:WU02:FS00:0x17:Unit: 0x00000000538b3db7532897de878b24a0
23:19:47:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:19:47:WU02:FS00:0x17:Machine: 0
23:19:47:WU02:FS00:0x17:Reading tar file system.xml
23:19:47:WU02:FS00:0x17:Reading tar file integrator.xml
23:19:47:WU02:FS00:0x17:Reading tar file state.xml
23:19:49:WU02:FS00:0x17:Reading tar file core.xml
23:19:49:WU02:FS00:0x17:Digital signatures verified
23:19:49:WU02:FS00:0x17:Folding@home GPU core17
23:19:49:WU02:FS00:0x17:Version 0.0.52
23:26:47:WU02:FS00:0x17:ERROR:exception: Force RMSE error of 454.958 with threshold of 5
23:26:47:WU02:FS00:0x17:Saving result file logfile_01.txt
23:26:47:WU02:FS00:0x17:Saving result file log.txt
23:26:47:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:26:47:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:26:47:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:13001 run:254 clone:7 gen:0 core:0x17 unit:0x00000000538b3db7532897de878b24a0
23:26:47:WU02:FS00:Uploading 2.24KiB to 140.163.4.231
23:26:47:WU02:FS00:Connecting to 140.163.4.231:8080
23:26:48:WU02:FS00:Upload complete
23:26:48:WU02:FS00:Server responded WORK_ACK (400)
23:26:48:WU02:FS00:Cleaning up
23:26:48:WU01:FS00:Connecting to assign-GPU.stanford.edu:80
23:26:48:WU01:FS00:News: Welcome to Folding@Home
23:26:48:WU01:FS00:Assigned to work server 140.163.4.231
23:26:48:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
23:26:48:WU01:FS00:Connecting to 140.163.4.231:8080
23:26:50:WU01:FS00:Downloading 4.84MiB
23:26:53:WU01:FS00:Download complete
23:26:53:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13001 run:181 clone:6 gen:1 core:0x17 unit:0x00000001538b3db75328831eabe5e094
23:26:54:WU01:FS00:Starting
23:26:54:WU01:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:26:54:WU01:FS00:Started FahCore on PID 4936
23:26:54:WU01:FS00:Core PID:7140
23:26:54:WU01:FS00:FahCore 0x17 started
23:26:55:WU01:FS00:0x17:*********************** Log Started 2014-03-23T23:26:54Z ***********************
23:26:55:WU01:FS00:0x17:Project: 13001 (Run 181, Clone 6, Gen 1)
23:26:55:WU01:FS00:0x17:Unit: 0x00000001538b3db75328831eabe5e094
23:26:55:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:26:55:WU01:FS00:0x17:Machine: 0
23:26:55:WU01:FS00:0x17:Reading tar file state.xml
23:26:56:WU01:FS00:0x17:Reading tar file system.xml
23:26:57:WU01:FS00:0x17:Reading tar file integrator.xml
23:26:57:WU01:FS00:0x17:Reading tar file core.xml
23:26:57:WU01:FS00:0x17:Digital signatures verified
23:26:57:WU01:FS00:0x17:Folding@home GPU core17
23:26:57:WU01:FS00:0x17:Version 0.0.52
23:33:21:WU01:FS00:0x17:ERROR:exception: Force RMSE error of 453.538 with threshold of 5
23:33:21:WU01:FS00:0x17:Saving result file logfile_01.txt
23:33:21:WU01:FS00:0x17:Saving result file log.txt
23:33:21:WU01:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:33:21:WARNING:WU01:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:33:21:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:13001 run:181 clone:6 gen:1 core:0x17 unit:0x00000001538b3db75328831eabe5e094
23:33:21:WU01:FS00:Uploading 2.25KiB to 140.163.4.231
23:33:21:WU01:FS00:Connecting to 140.163.4.231:8080
23:33:21:WU01:FS00:Upload complete
23:33:21:WU01:FS00:Server responded WORK_ACK (400)
23:33:21:WU01:FS00:Cleaning up
23:33:21:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
23:33:21:WU02:FS00:News: Welcome to Folding@Home
23:33:21:WU02:FS00:Assigned to work server 140.163.4.231
23:33:21:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
23:33:21:WU02:FS00:Connecting to 140.163.4.231:8080
23:33:23:WU02:FS00:Downloading 4.84MiB
23:33:26:WU02:FS00:Download complete
23:33:26:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:13001 run:515 clone:2 gen:1 core:0x17 unit:0x00000001538b3db7532c8e3292c77516
23:33:26:WU02:FS00:Starting
23:33:26:WU02:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:33:26:WU02:FS00:Started FahCore on PID 6796
23:33:27:WU02:FS00:Core PID:4616
23:33:27:WU02:FS00:FahCore 0x17 started
23:33:27:WU02:FS00:0x17:*********************** Log Started 2014-03-23T23:33:27Z ***********************
23:33:27:WU02:FS00:0x17:Project: 13001 (Run 515, Clone 2, Gen 1)
23:33:27:WU02:FS00:0x17:Unit: 0x00000001538b3db7532c8e3292c77516
23:33:27:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:33:27:WU02:FS00:0x17:Machine: 0
23:33:27:WU02:FS00:0x17:Reading tar file state.xml
23:33:28:WU02:FS00:0x17:Reading tar file system.xml
23:33:29:WU02:FS00:0x17:Reading tar file integrator.xml
23:33:29:WU02:FS00:0x17:Reading tar file core.xml
23:33:29:WU02:FS00:0x17:Digital signatures verified
23:33:29:WU02:FS00:0x17:Folding@home GPU core17
23:33:29:WU02:FS00:0x17:Version 0.0.52
23:39:48:WU02:FS00:0x17:ERROR:exception: Force RMSE error of 452.611 with threshold of 5
23:39:48:WU02:FS00:0x17:Saving result file logfile_01.txt
23:39:48:WU02:FS00:0x17:Saving result file log.txt
23:39:48:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:39:48:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:39:48:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:13001 run:515 clone:2 gen:1 core:0x17 unit:0x00000001538b3db7532c8e3292c77516
23:39:48:WU02:FS00:Uploading 2.23KiB to 140.163.4.231
23:39:48:WU02:FS00:Connecting to 140.163.4.231:8080
23:39:48:WU01:FS00:Connecting to assign-GPU.stanford.edu:80
23:39:49:WU02:FS00:Upload complete
23:39:49:WU02:FS00:Server responded WORK_ACK (400)
23:39:49:WU02:FS00:Cleaning up
23:39:49:WU01:FS00:News: Welcome to Folding@Home
23:39:49:WU01:FS00:Assigned to work server 140.163.4.231
23:39:49:WU01:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
23:39:49:WU01:FS00:Connecting to 140.163.4.231:8080
23:39:50:WU01:FS00:Downloading 5.22MiB
23:39:53:WU01:FS00:Download complete
23:39:53:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:13001 run:264 clone:7 gen:0 core:0x17 unit:0x00000000538b3db753289ab50393499a
23:39:54:WU01:FS00:Starting
23:39:54:WU01:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:39:54:WU01:FS00:Started FahCore on PID 6456
23:39:54:WU01:FS00:Core PID:2624
23:39:54:WU01:FS00:FahCore 0x17 started
23:39:55:WU01:FS00:0x17:*********************** Log Started 2014-03-23T23:39:54Z ***********************
23:39:55:WU01:FS00:0x17:Project: 13001 (Run 264, Clone 7, Gen 0)
23:39:55:WU01:FS00:0x17:Unit: 0x00000000538b3db753289ab50393499a
23:39:55:WU01:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:39:55:WU01:FS00:0x17:Machine: 0
23:39:55:WU01:FS00:0x17:Reading tar file system.xml
23:39:55:WU01:FS00:0x17:Reading tar file integrator.xml
23:39:55:WU01:FS00:0x17:Reading tar file state.xml
23:39:56:WU01:FS00:0x17:Reading tar file core.xml
23:39:56:WU01:FS00:0x17:Digital signatures verified
23:39:56:WU01:FS00:0x17:Folding@home GPU core17
23:39:56:WU01:FS00:0x17:Version 0.0.52
23:46:36:WU01:FS00:0x17:ERROR:exception: Force RMSE error of 455.313 with threshold of 5
23:46:36:WU01:FS00:0x17:Saving result file logfile_01.txt
23:46:36:WU01:FS00:0x17:Saving result file log.txt
23:46:36:WU01:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:46:36:WARNING:WU01:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:46:36:WU01:FS00:Sending unit results: id:01 state:SEND error:FAULTY project:13001 run:264 clone:7 gen:0 core:0x17 unit:0x00000000538b3db753289ab50393499a
23:46:36:WU01:FS00:Uploading 2.24KiB to 140.163.4.231
23:46:36:WU01:FS00:Connecting to 140.163.4.231:8080
23:46:36:WU01:FS00:Upload complete
23:46:36:WU01:FS00:Server responded WORK_ACK (400)
23:46:37:WU01:FS00:Cleaning up
23:59:10:WU00:FS01:0xa4:Completed 2900000 out of 5000000 steps (58%)
00:03:53:FS01:Shutting core down
00:03:53:FS02:Shutting core down
00:03:58:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
00:03:59:WU03:FS02:0xa3:Client no longer detected. Shutting down core
00:03:59:WU03:FS02:0xa3:
00:03:59:WU03:FS02:0xa3:Folding@home Core Shutdown: CLIENT_DIED
00:03:59:WU03:FS02:FahCore returned: INTERRUPTED (102 = 0x66)
00:31:22:WU00:FS01:Starting
00:31:22:WU00:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -np 2
00:31:22:WU00:FS01:Started FahCore on PID 5056
00:31:22:WU00:FS01:Core PID:4832
00:31:22:WU00:FS01:FahCore 0xa4 started
00:31:22:WU03:FS02:Starting
00:31:22:WU03:FS02:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a3.fah/FahCore_a3.exe -dir 03 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -np 2
00:31:22:WU03:FS02:Started FahCore on PID 5820
00:31:22:WU03:FS02:Core PID:6716
00:31:22:WU03:FS02:FahCore 0xa3 started
00:31:23:WU00:FS01:0xa4:
00:31:23:WU00:FS01:0xa4:*------------------------------*
00:31:23:WU00:FS01:0xa4:Folding@Home Gromacs GB Core
00:31:23:WU00:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
00:31:23:WU00:FS01:0xa4:
00:31:23:WU00:FS01:0xa4:Preparing to commence simulation
00:31:23:WU00:FS01:0xa4:- Looking at optimizations...
00:31:23:WU00:FS01:0xa4:- Files status OK
00:31:23:WU00:FS01:0xa4:- Expanded 117330 -> 264000 (decompressed 225.0 percent)
00:31:23:WU00:FS01:0xa4:Called DecompressByteArray: compressed_data_size=117330 data_size=264000, decompressed_data_size=264000 diff=0
00:31:23:WU00:FS01:0xa4:- Digital signature verified
00:31:23:WU00:FS01:0xa4:
00:31:23:WU00:FS01:0xa4:Project: 6366 (Run 13, Clone 30, Gen 6)
00:31:23:WU00:FS01:0xa4:
00:31:23:WU00:FS01:0xa4:Assembly optimizations on if available.
00:31:23:WU00:FS01:0xa4:Entering M.D.
00:31:23:WU03:FS02:0xa3:
00:31:23:WU03:FS02:0xa3:*------------------------------*
00:31:23:WU03:FS02:0xa3:Folding@Home Gromacs SMP Core
00:31:23:WU03:FS02:0xa3:Version 2.27 (Dec. 15, 2010)
00:31:23:WU03:FS02:0xa3:
00:31:23:WU03:FS02:0xa3:Preparing to commence simulation
00:31:23:WU03:FS02:0xa3:- Looking at optimizations...
00:31:23:WU03:FS02:0xa3:- Files status OK
00:31:23:WU03:FS02:0xa3:- Expanded 3851831 -> 4394668 (decompressed 114.0 percent)
00:31:23:WU03:FS02:0xa3:Called DecompressByteArray: compressed_data_size=3851831 data_size=4394668, decompressed_data_size=4394668 diff=0
00:31:23:WU03:FS02:0xa3:- Digital signature verified
00:31:23:WU03:FS02:0xa3:
00:31:23:WU03:FS02:0xa3:Project: 8585 (Run 1, Clone 2, Gen 283)
00:31:23:WU03:FS02:0xa3:
00:31:23:WU03:FS02:0xa3:Assembly optimizations on if available.
00:31:23:WU03:FS02:0xa3:Entering M.D.
00:31:28:WU00:FS01:0xa4:Using Gromacs checkpoints
00:31:28:WU00:FS01:0xa4:Mapping NT from 2 to 2
00:31:28:WU00:FS01:0xa4:Resuming from checkpoint
00:31:28:WU00:FS01:0xa4:Verified 00/wudata_01.log
00:31:28:WU00:FS01:0xa4:Verified 00/wudata_01.trr
00:31:28:WU00:FS01:0xa4:Verified 00/wudata_01.xtc
00:31:28:WU00:FS01:0xa4:Verified 00/wudata_01.edr
00:31:29:WU00:FS01:0xa4:Completed 2880060 out of 5000000 steps (57%)
00:31:29:WU03:FS02:0xa3:Using Gromacs checkpoints
00:31:29:WU03:FS02:0xa3:Mapping NT from 2 to 2
00:31:31:WU03:FS02:0xa3:Resuming from checkpoint
00:31:31:WU03:FS02:0xa3:Verified 03/wudata_01.log
00:31:31:WU03:FS02:0xa3:Verified 03/wudata_01.trr
00:31:31:WU03:FS02:0xa3:Verified 03/wudata_01.edr
00:31:33:WU03:FS02:0xa3:Completed 192065 out of 500000 steps (38%)
01:25:59:WU03:FS02:0xa3:Completed 195000 out of 500000 steps (39%)
02:13:30:WU00:FS01:0xa4:Completed 2900000 out of 5000000 steps (58%)
02:54:13:WU03:FS02:0xa3:Completed 200000 out of 500000 steps (40%)
04:12:08:WU03:FS02:0xa3:Completed 205000 out of 500000 steps (41%)
******************************* Date: 2014-03-24 *******************************
05:21:24:WU03:FS02:0xa3:Completed 210000 out of 500000 steps (42%)
06:16:40:WU00:FS01:0xa4:Completed 2950000 out of 5000000 steps (59%)
06:46:03:WU03:FS02:0xa3:Completed 215000 out of 500000 steps (43%)
07:53:58:WU03:FS02:0xa3:Completed 220000 out of 500000 steps (44%)
09:13:36:WU03:FS02:0xa3:Completed 225000 out of 500000 steps (45%)
09:43:30:WU00:FS01:0xa4:Completed 3000000 out of 5000000 steps (60%)
10:05:25:WU03:FS02:0xa3:Completed 230000 out of 500000 steps (46%)
11:02:57:WU03:FS02:0xa3:Completed 235000 out of 500000 steps (47%)
******************************* Date: 2014-03-24 *******************************
12:12:15:WU03:FS02:0xa3:Completed 240000 out of 500000 steps (48%)
12:49:24:WARNING:Exception: 63:127.0.0.1: Send error: 10053: An established connection was aborted by the software in your host machine.
13:10:06:WU00:FS01:0xa4:Completed 3050000 out of 5000000 steps (61%)
13:18:26:WU03:FS02:0xa3:Completed 245000 out of 500000 steps (49%)
13:49:00:FS01:Shutting core down
13:49:00:FS02:Shutting core down
13:49:06:WU00:FS01:0xa4:Client no longer detected. Shutting down core
13:49:06:WU00:FS01:0xa4:
13:49:06:WU00:FS01:0xa4:Folding@home Core Shutdown: CLIENT_DIED
13:49:07:WU00:FS01:FahCore returned: INTERRUPTED (102 = 0x66)
13:49:11:WU03:FS02:FahCore returned: INTERRUPTED (102 = 0x66)
16:54:31:WU00:FS01:Starting
16:54:31:WU00:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -np 2
16:54:31:WU00:FS01:Started FahCore on PID 4168
16:54:31:WU00:FS01:Core PID:6872
16:54:31:WU00:FS01:FahCore 0xa4 started
16:54:31:WU03:FS02:Starting
16:54:31:WU03:FS02:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a3.fah/FahCore_a3.exe -dir 03 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -np 2
16:54:31:WU03:FS02:Started FahCore on PID 7448
16:54:31:WU03:FS02:Core PID:6840
16:54:31:WU03:FS02:FahCore 0xa3 started
16:54:31:WU00:FS01:0xa4:
16:54:31:WU00:FS01:0xa4:*------------------------------*
16:54:31:WU00:FS01:0xa4:Folding@Home Gromacs GB Core
16:54:31:WU00:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
16:54:31:WU00:FS01:0xa4:
16:54:31:WU00:FS01:0xa4:Preparing to commence simulation
16:54:31:WU00:FS01:0xa4:- Looking at optimizations...
16:54:31:WU00:FS01:0xa4:- Files status OK
16:54:31:WU00:FS01:0xa4:- Expanded 117330 -> 264000 (decompressed 225.0 percent)
16:54:31:WU00:FS01:0xa4:Called DecompressByteArray: compressed_data_size=117330 data_size=264000, decompressed_data_size=264000 diff=0
16:54:31:WU00:FS01:0xa4:- Digital signature verified
16:54:31:WU00:FS01:0xa4:
16:54:31:WU00:FS01:0xa4:Project: 6366 (Run 13, Clone 30, Gen 6)
16:54:31:WU00:FS01:0xa4:
16:54:31:WU00:FS01:0xa4:Assembly optimizations on if available.
16:54:31:WU00:FS01:0xa4:Entering M.D.
16:54:31:WU03:FS02:0xa3:
16:54:31:WU03:FS02:0xa3:*------------------------------*
16:54:31:WU03:FS02:0xa3:Folding@Home Gromacs SMP Core
16:54:31:WU03:FS02:0xa3:Version 2.27 (Dec. 15, 2010)
16:54:31:WU03:FS02:0xa3:
16:54:31:WU03:FS02:0xa3:Preparing to commence simulation
16:54:31:WU03:FS02:0xa3:- Looking at optimizations...
16:54:31:WU03:FS02:0xa3:- Files status OK
16:54:32:WU03:FS02:0xa3:- Expanded 3851831 -> 4394668 (decompressed 114.0 percent)
16:54:32:WU03:FS02:0xa3:Called DecompressByteArray: compressed_data_size=3851831 data_size=4394668, decompressed_data_size=4394668 diff=0
16:54:32:WU03:FS02:0xa3:- Digital signature verified
16:54:32:WU03:FS02:0xa3:
16:54:32:WU03:FS02:0xa3:Project: 8585 (Run 1, Clone 2, Gen 283)
16:54:32:WU03:FS02:0xa3:
16:54:32:WU03:FS02:0xa3:Assembly optimizations on if available.
16:54:32:WU03:FS02:0xa3:Entering M.D.
16:54:37:WU00:FS01:0xa4:Using Gromacs checkpoints
16:54:37:WU00:FS01:0xa4:Mapping NT from 2 to 2
16:54:37:WU00:FS01:0xa4:Resuming from checkpoint
16:54:37:WU00:FS01:0xa4:Verified 00/wudata_01.log
16:54:37:WU00:FS01:0xa4:Verified 00/wudata_01.trr
16:54:37:WU00:FS01:0xa4:Verified 00/wudata_01.xtc
16:54:37:WU00:FS01:0xa4:Verified 00/wudata_01.edr
16:54:37:WU00:FS01:0xa4:Completed 3057350 out of 5000000 steps (61%)
16:54:38:WU03:FS02:0xa3:Using Gromacs checkpoints
16:54:38:WU03:FS02:0xa3:Mapping NT from 2 to 2
16:54:40:WU03:FS02:0xa3:Resuming from checkpoint
16:54:40:WU03:FS02:0xa3:Verified 03/wudata_01.log
16:54:40:WU03:FS02:0xa3:Verified 03/wudata_01.trr
16:54:40:WU03:FS02:0xa3:Verified 03/wudata_01.edr
16:54:42:WU03:FS02:0xa3:Completed 246920 out of 500000 steps (49%)
17:29:48:WU03:FS02:0xa3:Completed 250000 out of 500000 steps (50%)
******************************* Date: 2014-03-24 *******************************
18:21:39:WU03:FS02:0xa3:Completed 255000 out of 500000 steps (51%)
19:13:51:WU03:FS02:0xa3:Completed 260000 out of 500000 steps (52%)
19:49:57:WU00:FS01:0xa4:Completed 3100000 out of 5000000 steps (62%)
20:06:53:WU03:FS02:0xa3:Completed 265000 out of 500000 steps (53%)
20:58:46:WU03:FS02:0xa3:Completed 270000 out of 500000 steps (54%)
22:01:55:WU00:FS01:0xa4:Completed 3150000 out of 5000000 steps (63%)
22:09:59:WU03:FS02:0xa3:Completed 275000 out of 500000 steps (55%)
23:29:26:WU03:FS02:0xa3:Completed 280000 out of 500000 steps (56%)
******************************* Date: 2014-03-25 *******************************
01:16:23:WU00:FS01:0xa4:Completed 3200000 out of 5000000 steps (64%)
01:46:43:WU03:FS02:0xa3:Completed 285000 out of 500000 steps (57%)
02:51:54:WU03:FS02:0xa3:Completed 290000 out of 500000 steps (58%)
03:44:42:WU03:FS02:0xa3:Completed 295000 out of 500000 steps (59%)
04:41:07:WU00:FS01:0xa4:Completed 3250000 out of 5000000 steps (65%)
04:48:20:WU03:FS02:0xa3:Completed 300000 out of 500000 steps (60%)
05:50:48:WU03:FS02:0xa3:Completed 305000 out of 500000 steps (61%)
06:58:11:WU03:FS02:0xa3:Completed 310000 out of 500000 steps (62%)
******************************* Date: 2014-03-25 *******************************
08:08:29:WU03:FS02:0xa3:Completed 315000 out of 500000 steps (63%)
08:32:32:WU00:FS01:0xa4:Completed 3300000 out of 5000000 steps (66%)
09:34:02:WU03:FS02:0xa3:Completed 320000 out of 500000 steps (64%)
10:53:24:WU03:FS02:0xa3:Completed 325000 out of 500000 steps (65%)
12:09:45:WU00:FS01:0xa4:Completed 3350000 out of 5000000 steps (67%)
12:09:55:WU03:FS02:0xa3:Completed 330000 out of 500000 steps (66%)
13:04:34:WU03:FS02:0xa3:Completed 335000 out of 500000 steps (67%)
13:59:01:WU03:FS02:0xa3:Completed 340000 out of 500000 steps (68%)
******************************* Date: 2014-03-25 *******************************
15:17:24:WU03:FS02:0xa3:Completed 345000 out of 500000 steps (69%)
15:26:54:WU00:FS01:0xa4:Completed 3400000 out of 5000000 steps (68%)
16:54:42:WU03:FS02:0xa3:Completed 350000 out of 500000 steps (70%)
17:58:04:WU03:FS02:0xa3:Completed 355000 out of 500000 steps (71%)
18:53:00:WU03:FS02:0xa3:Completed 360000 out of 500000 steps (72%)
18:55:09:WU00:FS01:0xa4:Completed 3450000 out of 5000000 steps (69%)
19:45:02:WU03:FS02:0xa3:Completed 365000 out of 500000 steps (73%)
20:43:40:WU03:FS02:0xa3:Completed 370000 out of 500000 steps (74%)
******************************* Date: 2014-03-25 *******************************
21:18:51:WU00:FS01:0xa4:Completed 3500000 out of 5000000 steps (70%)
22:32:02:WU03:FS02:0xa3:Completed 375000 out of 500000 steps (75%)
22:39:46:WU00:FS01:0xa4:Completed 3550000 out of 5000000 steps (71%)
23:50:21:WU03:FS02:0xa3:Completed 380000 out of 500000 steps (76%)
00:55:32:WU03:FS02:0xa3:Completed 385000 out of 500000 steps (77%)
01:50:02:WU03:FS02:0xa3:Completed 390000 out of 500000 steps (78%)
02:22:57:WU00:FS01:0xa4:Completed 3600000 out of 5000000 steps (72%)
02:50:15:WU03:FS02:0xa3:Completed 395000 out of 500000 steps (79%)
******************************* Date: 2014-03-26 *******************************
03:49:53:WU03:FS02:0xa3:Completed 400000 out of 500000 steps (80%)
04:48:23:WU03:FS02:0xa3:Completed 405000 out of 500000 steps (81%)
05:47:04:WU03:FS02:0xa3:Completed 410000 out of 500000 steps (82%)
05:50:29:WU00:FS01:0xa4:Completed 3650000 out of 5000000 steps (73%)
06:41:35:WU03:FS02:0xa3:Completed 415000 out of 500000 steps (83%)
08:14:52:WU03:FS02:0xa3:Completed 420000 out of 500000 steps (84%)
09:41:33:WU03:FS02:0xa3:Completed 425000 out of 500000 steps (85%)
09:44:54:WU00:FS01:0xa4:Completed 3700000 out of 5000000 steps (74%)
******************************* Date: 2014-03-26 *******************************
11:02:11:WU03:FS02:0xa3:Completed 430000 out of 500000 steps (86%)
12:00:38:WU03:FS02:0xa3:Completed 435000 out of 500000 steps (87%)
12:58:17:WU03:FS02:0xa3:Completed 440000 out of 500000 steps (88%)
13:27:34:WU00:FS01:0xa4:Completed 3750000 out of 5000000 steps (75%)
14:02:21:WU03:FS02:0xa3:Completed 445000 out of 500000 steps (89%)
14:54:17:WU03:FS02:0xa3:Completed 450000 out of 500000 steps (90%)
16:08:39:WU03:FS02:0xa3:Completed 455000 out of 500000 steps (91%)
16:15:13:WU00:FS01:0xa4:Completed 3800000 out of 5000000 steps (76%)
******************************* Date: 2014-03-26 *******************************
17:37:22:WU03:FS02:0xa3:Completed 460000 out of 500000 steps (92%)
17:55:58:WU00:FS01:0xa4:Completed 3850000 out of 5000000 steps (77%)
18:53:13:WU03:FS02:0xa3:Completed 465000 out of 500000 steps (93%)
19:33:13:FS00:Finishing
19:33:35:FS00:Finishing
20:00:30:WU00:FS01:0xa4:Completed 3900000 out of 5000000 steps (78%)
20:02:10:WU03:FS02:0xa3:Completed 470000 out of 500000 steps (94%)
21:31:46:WU03:FS02:0xa3:Completed 475000 out of 500000 steps (95%)
22:57:38:WU03:FS02:0xa3:Completed 480000 out of 500000 steps (96%)
23:30:41:WARNING:WU00:FS01:Past final deadline 2014-03-26T23:30:40Z, dumping
23:30:41:WU00:FS01:Shutting core down
23:30:41:WU00:FS01:Cleaning up
23:30:41:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
23:30:41:WU00:FS01:Cleaning up
23:30:41:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
Re: Project: 13001 Run 264, Clone 7, Gen 0 Error
Posted: Fri Mar 28, 2014 2:40 pm
by Nert
Here's the second half:
Code: Select all
23:30:41:WU01:FS01:Connecting to assign3.stanford.edu:8080
23:30:42:WU01:FS01:News: Welcome to Folding@Home
23:30:42:WU01:FS01:Assigned to work server 155.247.166.219
23:30:42:WU01:FS01:Requesting new work unit for slot 01: RUNNING cpu:2 from 155.247.166.219
23:30:42:WU01:FS01:Connecting to 155.247.166.219:8080
23:30:43:WU01:FS01:Downloading 114.99KiB
23:30:43:WU01:FS01:Download complete
23:30:43:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:6366 run:72 clone:0 gen:21 core:0xa4 unit:0x000000170002894b530e7710f1c832e1
23:30:47:WU00:FS01:0xa4:Client no longer detected. Shutting down core
23:30:47:WU00:FS01:0xa4:
23:30:47:WU00:FS01:0xa4:Folding@home Core Shutdown: CLIENT_DIED
23:30:47:WU01:FS01:Starting
23:30:47:WU01:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -np 2
23:30:47:WU01:FS01:Started FahCore on PID 8000
23:30:48:WU01:FS01:Core PID:5092
23:30:48:WU01:FS01:FahCore 0xa4 started
23:30:48:WU01:FS01:0xa4:
23:30:48:WU01:FS01:0xa4:*------------------------------*
23:30:48:WU01:FS01:0xa4:Folding@Home Gromacs GB Core
23:30:48:WU01:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
23:30:48:WU01:FS01:0xa4:
23:30:48:WU01:FS01:0xa4:Preparing to commence simulation
23:30:48:WU01:FS01:0xa4:- Looking at optimizations...
23:30:48:WU01:FS01:0xa4:- Created dyn
23:30:48:WU01:FS01:0xa4:- Files status OK
23:30:48:WU01:FS01:0xa4:- Expanded 117235 -> 264000 (decompressed 225.1 percent)
23:30:48:WU01:FS01:0xa4:Called DecompressByteArray: compressed_data_size=117235 data_size=264000, decompressed_data_size=264000 diff=0
23:30:48:WU01:FS01:0xa4:- Digital signature verified
23:30:48:WU01:FS01:0xa4:
23:30:48:WU01:FS01:0xa4:Project: 6366 (Run 72, Clone 0, Gen 21)
23:30:48:WU01:FS01:0xa4:
23:30:48:WU01:FS01:0xa4:Assembly optimizations on if available.
23:30:48:WU01:FS01:0xa4:Entering M.D.
23:30:54:WU01:FS01:0xa4:Mapping NT from 2 to 2
23:30:55:WU01:FS01:0xa4:Completed 0 out of 5000000 steps (0%)
23:31:41:WU00:FS01:Cleaning up
23:31:41:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
23:33:19:WU00:FS01:Cleaning up
23:33:19:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
23:35:56:WU00:FS01:Cleaning up
23:35:56:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
******************************* Date: 2014-03-26 *******************************
23:40:10:WU00:FS01:Cleaning up
23:40:10:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
23:47:01:WU00:FS01:Cleaning up
23:47:01:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
23:58:07:WU00:FS01:Cleaning up
23:58:07:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
00:11:07:WU03:FS02:0xa3:Completed 485000 out of 500000 steps (97%)
00:16:04:WU00:FS01:Cleaning up
00:16:04:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
00:45:06:WU00:FS01:Cleaning up
00:45:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
01:32:05:WU00:FS01:Cleaning up
01:32:05:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
01:34:22:WU03:FS02:0xa3:Completed 490000 out of 500000 steps (98%)
01:34:22:WU02:FS02:Connecting to assign3.stanford.edu:8080
01:34:22:WU02:FS02:News: Welcome to Folding@Home
01:34:22:WU02:FS02:Assigned to work server 155.247.166.219
01:34:22:WU02:FS02:Requesting new work unit for slot 02: RUNNING cpu:2 from 155.247.166.219
01:34:22:WU02:FS02:Connecting to 155.247.166.219:8080
01:34:23:WU02:FS02:Downloading 116.15KiB
01:34:23:WU02:FS02:Download complete
01:34:23:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:6367 run:22 clone:17 gen:7 core:0xa4 unit:0x000000070002894b532345974e7c2323
02:35:55:WU03:FS02:0xa3:Completed 495000 out of 500000 steps (99%)
02:48:06:WU00:FS01:Cleaning up
02:48:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
03:03:58:WU01:FS01:0xa4:Completed 50000 out of 5000000 steps (1%)
03:50:16:WU03:FS02:0xa3:Completed 500000 out of 500000 steps (100%)
03:50:19:WU03:FS02:0xa3:DynamicWrapper: Finished Work Unit: sleep=10000
03:50:29:WU03:FS02:0xa3:
03:50:29:WU03:FS02:0xa3:Finished Work Unit:
03:50:29:WU03:FS02:0xa3:- Reading up to 8059680 from "03/wudata_01.trr": Read 8059680
03:50:29:WU03:FS02:0xa3:trr file hash check passed.
03:50:29:WU03:FS02:0xa3:edr file hash check passed.
03:50:29:WU03:FS02:0xa3:logfile size: 94386
03:50:29:WU03:FS02:0xa3:Leaving Run
03:50:33:WU03:FS02:0xa3:- Writing 8190898 bytes of core data to disk...
03:50:36:WU03:FS02:0xa3:Done: 8190386 -> 7536648 (compressed to 92.0 percent)
03:50:36:WU03:FS02:0xa3: ... Done.
03:50:46:WU03:FS02:0xa3:- Shutting down core
03:50:46:WU03:FS02:0xa3:
03:50:46:WU03:FS02:0xa3:Folding@home Core Shutdown: FINISHED_UNIT
03:50:49:WU03:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
03:50:49:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:8585 run:1 clone:2 gen:283 core:0xa3 unit:0x00000c190a3b1e5952288a213a0e0663
03:50:49:WU03:FS02:Uploading 7.19MiB to 128.143.231.202
03:50:49:WU03:FS02:Connecting to 128.143.231.202:8080
03:50:49:WU02:FS02:Starting
03:50:49:WU02:FS02:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -np 2
03:50:49:WU02:FS02:Started FahCore on PID 2784
03:50:50:WU02:FS02:Core PID:5188
03:50:50:WU02:FS02:FahCore 0xa4 started
03:50:50:WU02:FS02:0xa4:
03:50:50:WU02:FS02:0xa4:*------------------------------*
03:50:50:WU02:FS02:0xa4:Folding@Home Gromacs GB Core
03:50:50:WU02:FS02:0xa4:Version 2.27 (Dec. 15, 2010)
03:50:50:WU02:FS02:0xa4:
03:50:50:WU02:FS02:0xa4:Preparing to commence simulation
03:50:50:WU02:FS02:0xa4:- Looking at optimizations...
03:50:50:WU02:FS02:0xa4:- Created dyn
03:50:50:WU02:FS02:0xa4:- Files status OK
03:50:50:WU02:FS02:0xa4:- Expanded 118421 -> 268472 (decompressed 226.7 percent)
03:50:50:WU02:FS02:0xa4:Called DecompressByteArray: compressed_data_size=118421 data_size=268472, decompressed_data_size=268472 diff=0
03:50:50:WU02:FS02:0xa4:- Digital signature verified
03:50:50:WU02:FS02:0xa4:
03:50:50:WU02:FS02:0xa4:Project: 6367 (Run 22, Clone 17, Gen 7)
03:50:50:WU02:FS02:0xa4:
03:50:50:WU02:FS02:0xa4:Assembly optimizations on if available.
03:50:50:WU02:FS02:0xa4:Entering M.D.
03:50:56:WU02:FS02:0xa4:Mapping NT from 2 to 2
03:50:56:WU02:FS02:0xa4:Completed 0 out of 5000000 steps (0%)
03:50:56:WU03:FS02:Upload 8.70%
03:51:03:WU03:FS02:Upload 17.39%
03:51:10:WU03:FS02:Upload 26.09%
03:51:17:WU03:FS02:Upload 34.78%
03:51:26:WU03:FS02:Upload 46.08%
03:51:33:WU03:FS02:Upload 55.65%
03:51:39:WU03:FS02:Upload 61.73%
03:51:46:WU03:FS02:Upload 70.43%
03:51:53:WU03:FS02:Upload 78.26%
03:52:02:WU03:FS02:Upload 89.56%
03:52:12:WU03:FS02:Upload complete
03:52:12:WU03:FS02:Server responded WORK_ACK (400)
03:52:12:WU03:FS02:Final credit estimate, 1668.00 points
03:52:12:WU03:FS02:Cleaning up
04:03:47:WU01:FS01:0xa4:Completed 100000 out of 5000000 steps (2%)
04:14:13:WU02:FS02:0xa4:Completed 50000 out of 5000000 steps (1%)
04:24:41:WU01:FS01:0xa4:Completed 150000 out of 5000000 steps (3%)
04:39:03:WU02:FS02:0xa4:Completed 100000 out of 5000000 steps (2%)
04:46:52:WU01:FS01:0xa4:Completed 200000 out of 5000000 steps (4%)
04:51:05:WU00:FS01:Cleaning up
04:51:05:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
04:55:40:WU02:FS02:0xa4:Completed 150000 out of 5000000 steps (3%)
05:13:52:WU02:FS02:0xa4:Completed 200000 out of 5000000 steps (4%)
05:14:50:WU01:FS01:0xa4:Completed 250000 out of 5000000 steps (5%)
05:29:20:WU02:FS02:0xa4:Completed 250000 out of 5000000 steps (5%)
******************************* Date: 2014-03-27 *******************************
05:45:56:WU01:FS01:0xa4:Completed 300000 out of 5000000 steps (6%)
05:46:10:WU02:FS02:0xa4:Completed 300000 out of 5000000 steps (6%)
06:05:11:WU01:FS01:0xa4:Completed 350000 out of 5000000 steps (7%)
06:09:30:WU02:FS02:0xa4:Completed 350000 out of 5000000 steps (7%)
06:28:06:WU02:FS02:0xa4:Completed 400000 out of 5000000 steps (8%)
06:30:46:WU01:FS01:0xa4:Completed 400000 out of 5000000 steps (8%)
06:49:29:WU01:FS01:0xa4:Completed 450000 out of 5000000 steps (9%)
06:58:51:WU02:FS02:0xa4:Completed 450000 out of 5000000 steps (9%)
07:11:44:WU01:FS01:0xa4:Completed 500000 out of 5000000 steps (10%)
07:16:18:WU02:FS02:0xa4:Completed 500000 out of 5000000 steps (10%)
07:32:55:WU01:FS01:0xa4:Completed 550000 out of 5000000 steps (11%)
07:41:39:WU02:FS02:0xa4:Completed 550000 out of 5000000 steps (11%)
07:52:07:WU01:FS01:0xa4:Completed 600000 out of 5000000 steps (12%)
08:02:14:WU02:FS02:0xa4:Completed 600000 out of 5000000 steps (12%)
08:10:06:WU00:FS01:Cleaning up
08:10:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
08:19:19:WU01:FS01:0xa4:Completed 650000 out of 5000000 steps (13%)
08:20:38:WU02:FS02:0xa4:Completed 650000 out of 5000000 steps (13%)
08:38:13:WU02:FS02:0xa4:Completed 700000 out of 5000000 steps (14%)
08:44:47:WU01:FS01:0xa4:Completed 700000 out of 5000000 steps (14%)
08:57:39:WU02:FS02:0xa4:Completed 750000 out of 5000000 steps (15%)
09:08:06:WU01:FS01:0xa4:Completed 750000 out of 5000000 steps (15%)
09:22:40:WU02:FS02:0xa4:Completed 800000 out of 5000000 steps (16%)
09:28:01:WU01:FS01:0xa4:Completed 800000 out of 5000000 steps (16%)
09:44:32:WU01:FS01:0xa4:Completed 850000 out of 5000000 steps (17%)
09:50:42:WU02:FS02:0xa4:Completed 850000 out of 5000000 steps (17%)
10:00:02:WU01:FS01:0xa4:Completed 900000 out of 5000000 steps (18%)
10:16:06:WU01:FS01:0xa4:Completed 950000 out of 5000000 steps (19%)
10:22:49:WU02:FS02:0xa4:Completed 900000 out of 5000000 steps (18%)
10:33:29:WU01:FS01:0xa4:Completed 1000000 out of 5000000 steps (20%)
10:51:55:WU01:FS01:0xa4:Completed 1050000 out of 5000000 steps (21%)
10:55:15:WU02:FS02:0xa4:Completed 950000 out of 5000000 steps (19%)
11:10:19:WU01:FS01:0xa4:Completed 1100000 out of 5000000 steps (22%)
11:19:03:WU02:FS02:0xa4:Completed 1000000 out of 5000000 steps (20%)
11:33:33:WU01:FS01:0xa4:Completed 1150000 out of 5000000 steps (23%)
11:36:56:WU02:FS02:0xa4:Completed 1050000 out of 5000000 steps (21%)
******************************* Date: 2014-03-27 *******************************
11:52:16:WU02:FS02:0xa4:Completed 1100000 out of 5000000 steps (22%)
11:58:46:WU01:FS01:0xa4:Completed 1200000 out of 5000000 steps (24%)
12:12:16:WU02:FS02:0xa4:Completed 1150000 out of 5000000 steps (23%)
12:28:43:WU01:FS01:0xa4:Completed 1250000 out of 5000000 steps (25%)
12:29:10:WU02:FS02:0xa4:Completed 1200000 out of 5000000 steps (24%)
12:47:26:WU02:FS02:0xa4:Completed 1250000 out of 5000000 steps (25%)
12:53:23:WU01:FS01:0xa4:Completed 1300000 out of 5000000 steps (26%)
13:11:46:WU02:FS02:0xa4:Completed 1300000 out of 5000000 steps (26%)
13:13:59:WU01:FS01:0xa4:Completed 1350000 out of 5000000 steps (27%)
13:30:16:WU01:FS01:0xa4:Completed 1400000 out of 5000000 steps (28%)
13:32:06:WU00:FS01:Cleaning up
13:32:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
13:39:09:WU02:FS02:0xa4:Completed 1350000 out of 5000000 steps (27%)
13:51:46:WU01:FS01:0xa4:Completed 1450000 out of 5000000 steps (29%)
14:02:26:WU02:FS02:0xa4:Completed 1400000 out of 5000000 steps (28%)
14:10:14:WU01:FS01:0xa4:Completed 1500000 out of 5000000 steps (30%)
14:21:00:WU02:FS02:0xa4:Completed 1450000 out of 5000000 steps (29%)
14:38:28:WU01:FS01:0xa4:Completed 1550000 out of 5000000 steps (31%)
14:39:29:WU02:FS02:0xa4:Completed 1500000 out of 5000000 steps (30%)
14:55:20:WU01:FS01:0xa4:Completed 1600000 out of 5000000 steps (32%)
15:08:23:WU02:FS02:0xa4:Completed 1550000 out of 5000000 steps (31%)
15:19:18:WU01:FS01:0xa4:Completed 1650000 out of 5000000 steps (33%)
15:30:12:WU02:FS02:0xa4:Completed 1600000 out of 5000000 steps (32%)
15:32:52:Saving configuration to config.xml
15:32:52:<config>
15:32:52: <!-- Folding Slot Configuration -->
15:32:52: <power v='FULL'/>
15:32:52:
15:32:52: <!-- Network -->
15:32:52: <proxy v=':8080'/>
15:32:52:
15:32:52: <!-- User Information -->
15:32:52: <team v='165780'/>
15:32:52: <user v='nert'/>
15:32:52:
15:32:52: <!-- Folding Slots -->
15:32:52: <slot id='1' type='CPU'/>
15:32:52: <slot id='2' type='CPU'>
15:32:52: <cpus v='-1'/>
15:32:52: </slot>
15:32:52:</config>
15:43:56:WU01:FS01:0xa4:Completed 1700000 out of 5000000 steps (34%)
15:59:45:WU02:FS02:0xa4:Completed 1650000 out of 5000000 steps (33%)
16:12:58:WU01:FS01:0xa4:Completed 1750000 out of 5000000 steps (35%)
16:21:08:WU02:FS02:0xa4:Completed 1700000 out of 5000000 steps (34%)
16:39:19:WU02:FS02:0xa4:Completed 1750000 out of 5000000 steps (35%)
16:40:34:WU01:FS01:0xa4:Completed 1800000 out of 5000000 steps (36%)
17:00:26:WU02:FS02:0xa4:Completed 1800000 out of 5000000 steps (36%)
17:08:12:WU01:FS01:0xa4:Completed 1850000 out of 5000000 steps (37%)
17:23:53:WU01:FS01:0xa4:Completed 1900000 out of 5000000 steps (38%)
17:25:50:WU02:FS02:0xa4:Completed 1850000 out of 5000000 steps (37%)
17:43:40:WU02:FS02:0xa4:Completed 1900000 out of 5000000 steps (38%)
17:47:10:WU01:FS01:0xa4:Completed 1950000 out of 5000000 steps (39%)
******************************* Date: 2014-03-27 *******************************
18:04:21:WU01:FS01:0xa4:Completed 2000000 out of 5000000 steps (40%)
18:08:52:WU02:FS02:0xa4:Completed 1950000 out of 5000000 steps (39%)
18:27:38:WU01:FS01:0xa4:Completed 2050000 out of 5000000 steps (41%)
18:31:07:WU02:FS02:0xa4:Completed 2000000 out of 5000000 steps (40%)
18:47:22:WU01:FS01:0xa4:Completed 2100000 out of 5000000 steps (42%)
18:52:07:WU02:FS02:0xa4:Completed 2050000 out of 5000000 steps (41%)
19:10:33:WU02:FS02:0xa4:Completed 2100000 out of 5000000 steps (42%)
19:14:44:WU01:FS01:0xa4:Completed 2150000 out of 5000000 steps (43%)
19:29:08:WU02:FS02:0xa4:Completed 2150000 out of 5000000 steps (43%)
19:32:06:WU00:FS01:Cleaning up
19:32:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
19:43:01:WU01:FS01:0xa4:Completed 2200000 out of 5000000 steps (44%)
19:45:51:WU02:FS02:0xa4:Completed 2200000 out of 5000000 steps (44%)
20:00:06:WU01:FS01:0xa4:Completed 2250000 out of 5000000 steps (45%)
20:13:42:WU02:FS02:0xa4:Completed 2250000 out of 5000000 steps (45%)
20:23:04:WU01:FS01:0xa4:Completed 2300000 out of 5000000 steps (46%)
20:30:23:WU02:FS02:0xa4:Completed 2300000 out of 5000000 steps (46%)
20:47:14:WU02:FS02:0xa4:Completed 2350000 out of 5000000 steps (47%)
20:49:37:WU01:FS01:0xa4:Completed 2350000 out of 5000000 steps (47%)
21:06:10:WU01:FS01:0xa4:Completed 2400000 out of 5000000 steps (48%)
21:13:00:WU02:FS02:0xa4:Completed 2400000 out of 5000000 steps (48%)
21:24:10:WU01:FS01:0xa4:Completed 2450000 out of 5000000 steps (49%)
21:37:18:WU02:FS02:0xa4:Completed 2450000 out of 5000000 steps (49%)
21:40:05:Adding folding slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti]
21:40:05:Saving configuration to config.xml
21:40:05:<config>
21:40:05: <!-- Folding Slot Configuration -->
21:40:05: <power v='FULL'/>
21:40:05:
21:40:05: <!-- Network -->
21:40:05: <proxy v=':8080'/>
21:40:05:
21:40:05: <!-- User Information -->
21:40:05: <team v='165780'/>
21:40:05: <user v='nert'/>
21:40:05:
21:40:05: <!-- Folding Slots -->
21:40:05: <slot id='1' type='CPU'/>
21:40:05: <slot id='2' type='CPU'>
21:40:05: <cpus v='-1'/>
21:40:05: </slot>
21:40:05: <slot id='0' type='GPU'/>
21:40:05:</config>
21:40:05:WU03:FS00:Connecting to assign-GPU.stanford.edu:80
21:40:06:WU03:FS00:News: Welcome to Folding@Home
21:40:06:WU03:FS00:Assigned to work server 140.163.4.231
21:40:06:WU03:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
21:40:06:WU03:FS00:Connecting to 140.163.4.231:8080
21:40:07:WU03:FS00:Downloading 4.84MiB
21:40:11:WU03:FS00:Download complete
21:40:11:WU03:FS00:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13000 run:1821 clone:0 gen:4 core:0x17 unit:0x0000000a538b3db753119ead6aade1b5
21:40:11:WU03:FS00:Starting
21:40:11:WU03:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
21:40:11:WU03:FS00:Started FahCore on PID 7184
21:40:11:WU03:FS00:Core PID:5744
21:40:11:WU03:FS00:FahCore 0x17 started
21:40:13:WU03:FS00:0x17:*********************** Log Started 2014-03-27T21:40:13Z ***********************
21:40:13:WU03:FS00:0x17:Project: 13000 (Run 1821, Clone 0, Gen 4)
21:40:13:WU03:FS00:0x17:Unit: 0x0000000a538b3db753119ead6aade1b5
21:40:13:WU03:FS00:0x17:CPU: 0x00000000000000000000000000000000
21:40:13:WU03:FS00:0x17:Machine: 0
21:40:13:WU03:FS00:0x17:Reading tar file state.xml
21:40:14:WU03:FS00:0x17:Reading tar file system.xml
21:40:15:WU03:FS00:0x17:Reading tar file integrator.xml
21:40:15:WU03:FS00:0x17:Reading tar file core.xml
21:40:15:WU03:FS00:0x17:Digital signatures verified
21:40:15:WU03:FS00:0x17:Folding@home GPU core17
21:40:15:WU03:FS00:0x17:Version 0.0.52
21:47:17:WU03:FS00:0x17:ERROR:exception: Force RMSE error of 449.511 with threshold of 5
21:47:17:WU03:FS00:0x17:Saving result file logfile_01.txt
21:47:17:WU03:FS00:0x17:Saving result file log.txt
21:47:17:WU03:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
21:47:17:WARNING:WU03:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:47:17:WU03:FS00:Sending unit results: id:03 state:SEND error:FAULTY project:13000 run:1821 clone:0 gen:4 core:0x17 unit:0x0000000a538b3db753119ead6aade1b5
21:47:18:WU03:FS00:Uploading 2.25KiB to 140.163.4.231
21:47:18:WU03:FS00:Connecting to 140.163.4.231:8080
21:47:18:WU04:FS00:Connecting to assign-GPU.stanford.edu:80
21:47:18:WU03:FS00:Upload complete
21:47:18:WU03:FS00:Server responded WORK_ACK (400)
21:47:18:WU03:FS00:Cleaning up
21:47:18:WU04:FS00:News: Welcome to Folding@Home
21:47:18:WU04:FS00:Assigned to work server 140.163.4.231
21:47:18:WU04:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
21:47:18:WU04:FS00:Connecting to 140.163.4.231:8080
21:47:20:WU04:FS00:Downloading 4.84MiB
21:47:23:WU04:FS00:Download complete
21:47:23:WU04:FS00:Received Unit: id:04 state:DOWNLOAD error:NO_ERROR project:13000 run:366 clone:1 gen:4 core:0x17 unit:0x00000009538b3db753100326677f2ded
21:47:23:WU04:FS00:Starting
21:47:23:WU04:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
21:47:23:WU04:FS00:Started FahCore on PID 5072
21:47:23:WU04:FS00:Core PID:7172
21:47:23:WU04:FS00:FahCore 0x17 started
21:47:24:WU04:FS00:0x17:*********************** Log Started 2014-03-27T21:47:24Z ***********************
21:47:24:WU04:FS00:0x17:Project: 13000 (Run 366, Clone 1, Gen 4)
21:47:24:WU04:FS00:0x17:Unit: 0x00000009538b3db753100326677f2ded
21:47:24:WU04:FS00:0x17:CPU: 0x00000000000000000000000000000000
21:47:24:WU04:FS00:0x17:Machine: 0
21:47:24:WU04:FS00:0x17:Reading tar file state.xml
21:47:26:WU04:FS00:0x17:Reading tar file system.xml
21:47:26:WU04:FS00:0x17:Reading tar file integrator.xml
21:47:26:WU04:FS00:0x17:Reading tar file core.xml
21:47:26:WU04:FS00:0x17:Digital signatures verified
21:47:26:WU04:FS00:0x17:Folding@home GPU core17
21:47:26:WU04:FS00:0x17:Version 0.0.52
21:54:37:WU04:FS00:0x17:ERROR:exception: Force RMSE error of 454.658 with threshold of 5
21:54:37:WU04:FS00:0x17:Saving result file logfile_01.txt
21:54:37:WU04:FS00:0x17:Saving result file log.txt
21:54:37:WU04:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
21:54:43:WARNING:WU04:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:54:43:WU04:FS00:Sending unit results: id:04 state:SEND error:FAULTY project:13000 run:366 clone:1 gen:4 core:0x17 unit:0x00000009538b3db753100326677f2ded
21:54:43:WU04:FS00:Uploading 2.24KiB to 140.163.4.231
21:54:43:WU04:FS00:Connecting to 140.163.4.231:8080
21:54:44:WU03:FS00:Connecting to assign-GPU.stanford.edu:80
21:54:44:WU04:FS00:Upload complete
21:54:44:WU04:FS00:Server responded WORK_ACK (400)
21:54:44:WU04:FS00:Cleaning up
21:54:44:WU03:FS00:News: Welcome to Folding@Home
21:54:44:WU03:FS00:Assigned to work server 140.163.4.231
21:54:44:WU03:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
21:54:44:WU03:FS00:Connecting to 140.163.4.231:8080
21:54:46:WU03:FS00:Downloading 4.84MiB
21:54:48:WU03:FS00:Download complete
21:54:48:WU03:FS00:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13001 run:322 clone:1 gen:3 core:0x17 unit:0x0000000b538b3db75328aaf86441d0ab
21:54:49:WU03:FS00:Starting
21:54:49:WU03:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
21:54:49:WU03:FS00:Started FahCore on PID 2204
21:54:49:WU03:FS00:Core PID:5828
21:54:49:WU03:FS00:FahCore 0x17 started
21:54:50:WU03:FS00:0x17:*********************** Log Started 2014-03-27T21:54:50Z ***********************
21:54:50:WU03:FS00:0x17:Project: 13001 (Run 322, Clone 1, Gen 3)
21:54:50:WU03:FS00:0x17:Unit: 0x0000000b538b3db75328aaf86441d0ab
21:54:50:WU03:FS00:0x17:CPU: 0x00000000000000000000000000000000
21:54:50:WU03:FS00:0x17:Machine: 0
21:54:50:WU03:FS00:0x17:Reading tar file state.xml
21:54:51:WU03:FS00:0x17:Reading tar file system.xml
21:54:52:WU03:FS00:0x17:Reading tar file integrator.xml
21:54:52:WU03:FS00:0x17:Reading tar file core.xml
21:54:52:WU03:FS00:0x17:Digital signatures verified
21:54:52:WU03:FS00:0x17:Folding@home GPU core17
21:54:52:WU03:FS00:0x17:Version 0.0.52
22:01:36:WU03:FS00:0x17:ERROR:exception: Force RMSE error of 453.768 with threshold of 5
22:01:36:WU03:FS00:0x17:Saving result file logfile_01.txt
22:01:36:WU03:FS00:0x17:Saving result file log.txt
22:01:36:WU03:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:01:38:WARNING:WU03:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:01:38:WU03:FS00:Sending unit results: id:03 state:SEND error:FAULTY project:13001 run:322 clone:1 gen:3 core:0x17 unit:0x0000000b538b3db75328aaf86441d0ab
22:01:38:WU03:FS00:Uploading 2.25KiB to 140.163.4.231
22:01:38:WU03:FS00:Connecting to 140.163.4.231:8080
22:01:38:WU03:FS00:Upload complete
22:01:38:WU03:FS00:Server responded WORK_ACK (400)
22:01:38:WU03:FS00:Cleaning up
22:01:38:WU04:FS00:Connecting to assign-GPU.stanford.edu:80
22:01:39:WU04:FS00:News: Welcome to Folding@Home
22:01:39:WU04:FS00:Assigned to work server 140.163.4.231
22:01:39:WU04:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
22:01:39:WU04:FS00:Connecting to 140.163.4.231:8080
22:01:40:WU04:FS00:Downloading 4.84MiB
22:01:43:WU04:FS00:Download complete
22:01:43:WU04:FS00:Received Unit: id:04 state:DOWNLOAD error:NO_ERROR project:13001 run:431 clone:7 gen:3 core:0x17 unit:0x00000006538b3db75328ca0e19f86245
22:01:44:WU04:FS00:Starting
22:01:44:WU04:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:01:44:WU04:FS00:Started FahCore on PID 6124
22:01:44:WU04:FS00:Core PID:4036
22:01:44:WU04:FS00:FahCore 0x17 started
22:01:45:WU04:FS00:0x17:*********************** Log Started 2014-03-27T22:01:44Z ***********************
22:01:45:WU04:FS00:0x17:Project: 13001 (Run 431, Clone 7, Gen 3)
22:01:45:WU04:FS00:0x17:Unit: 0x00000006538b3db75328ca0e19f86245
22:01:45:WU04:FS00:0x17:CPU: 0x00000000000000000000000000000000
22:01:45:WU04:FS00:0x17:Machine: 0
22:01:45:WU04:FS00:0x17:Reading tar file state.xml
22:01:46:WU04:FS00:0x17:Reading tar file system.xml
22:01:47:WU04:FS00:0x17:Reading tar file integrator.xml
22:01:47:WU04:FS00:0x17:Reading tar file core.xml
22:01:47:WU04:FS00:0x17:Digital signatures verified
22:01:47:WU04:FS00:0x17:Folding@home GPU core17
22:01:47:WU04:FS00:0x17:Version 0.0.52
22:08:12:WU04:FS00:0x17:ERROR:exception: Force RMSE error of 452.193 with threshold of 5
22:08:12:WU04:FS00:0x17:Saving result file logfile_01.txt
22:08:12:WU04:FS00:0x17:Saving result file log.txt
22:08:12:WU04:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:08:12:WARNING:WU04:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:08:12:WU04:FS00:Sending unit results: id:04 state:SEND error:FAULTY project:13001 run:431 clone:7 gen:3 core:0x17 unit:0x00000006538b3db75328ca0e19f86245
22:08:12:WU04:FS00:Uploading 2.24KiB to 140.163.4.231
22:08:12:WU04:FS00:Connecting to 140.163.4.231:8080
22:08:12:WU04:FS00:Upload complete
22:08:12:WU04:FS00:Server responded WORK_ACK (400)
22:08:12:WU04:FS00:Cleaning up
22:08:13:WU03:FS00:Connecting to assign-GPU.stanford.edu:80
22:08:13:WU03:FS00:News: Welcome to Folding@Home
22:08:13:WU03:FS00:Assigned to work server 140.163.4.231
22:08:13:WU03:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
22:08:13:WU03:FS00:Connecting to 140.163.4.231:8080
22:08:14:WU03:FS00:Downloading 4.84MiB
22:08:17:WU03:FS00:Download complete
22:08:17:WU03:FS00:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13000 run:624 clone:0 gen:11 core:0x17 unit:0x00000010538b3db753104bd39660a5f8
22:08:18:WU03:FS00:Starting
22:08:18:WU03:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:08:18:WU03:FS00:Started FahCore on PID 4288
22:08:18:WU03:FS00:Core PID:7760
22:08:18:WU03:FS00:FahCore 0x17 started
22:08:19:WU03:FS00:0x17:*********************** Log Started 2014-03-27T22:08:18Z ***********************
22:08:19:WU03:FS00:0x17:Project: 13000 (Run 624, Clone 0, Gen 11)
22:08:19:WU03:FS00:0x17:Unit: 0x00000010538b3db753104bd39660a5f8
22:08:19:WU03:FS00:0x17:CPU: 0x00000000000000000000000000000000
22:08:19:WU03:FS00:0x17:Machine: 0
22:08:19:WU03:FS00:0x17:Reading tar file state.xml
22:08:20:WU03:FS00:0x17:Reading tar file system.xml
22:08:20:WU03:FS00:0x17:Reading tar file integrator.xml
22:08:20:WU03:FS00:0x17:Reading tar file core.xml
22:08:20:WU03:FS00:0x17:Digital signatures verified
22:08:20:WU03:FS00:0x17:Folding@home GPU core17
22:08:20:WU03:FS00:0x17:Version 0.0.52
22:15:05:WU03:FS00:0x17:ERROR:exception: Force RMSE error of 454.942 with threshold of 5
22:15:05:WU03:FS00:0x17:Saving result file logfile_01.txt
22:15:05:WU03:FS00:0x17:Saving result file log.txt
22:15:05:WU03:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:15:05:WARNING:WU03:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:15:05:WU03:FS00:Sending unit results: id:03 state:SEND error:FAULTY project:13000 run:624 clone:0 gen:11 core:0x17 unit:0x00000010538b3db753104bd39660a5f8
22:15:05:WU03:FS00:Uploading 2.25KiB to 140.163.4.231
22:15:05:WU03:FS00:Connecting to 140.163.4.231:8080
22:15:05:WU03:FS00:Upload complete
22:15:05:WU03:FS00:Server responded WORK_ACK (400)
22:15:05:WU03:FS00:Cleaning up
22:23:24:WU01:FS01:0xa4:Completed 2500000 out of 5000000 steps (50%)
22:27:03:Saving configuration to config.xml
22:27:03:<config>
22:27:03: <!-- Folding Slot Configuration -->
22:27:03: <power v='FULL'/>
22:27:03:
22:27:03: <!-- Network -->
22:27:03: <proxy v=':8080'/>
22:27:03:
22:27:03: <!-- User Information -->
22:27:03: <team v='165780'/>
22:27:03: <user v='nert'/>
22:27:03:
22:27:03: <!-- Folding Slots -->
22:27:03: <slot id='1' type='CPU'/>
22:27:03: <slot id='2' type='CPU'>
22:27:03: <cpus v='-1'/>
22:27:03: </slot>
22:27:03:</config>
22:35:20:WU02:FS02:0xa4:Completed 2500000 out of 5000000 steps (50%)
22:48:06:WU01:FS01:0xa4:Completed 2550000 out of 5000000 steps (51%)
23:01:28:WU02:FS02:0xa4:Completed 2550000 out of 5000000 steps (51%)
23:05:38:WU01:FS01:0xa4:Completed 2600000 out of 5000000 steps (52%)
23:22:18:WU01:FS01:0xa4:Completed 2650000 out of 5000000 steps (53%)
23:28:22:WU02:FS02:0xa4:Completed 2600000 out of 5000000 steps (52%)
23:48:41:WU01:FS01:0xa4:Completed 2700000 out of 5000000 steps (54%)
23:58:13:WU02:FS02:0xa4:Completed 2650000 out of 5000000 steps (53%)
******************************* Date: 2014-03-28 *******************************
00:10:03:WU01:FS01:0xa4:Completed 2750000 out of 5000000 steps (55%)
00:20:58:WU02:FS02:0xa4:Completed 2700000 out of 5000000 steps (54%)
00:33:09:WU01:FS01:0xa4:Completed 2800000 out of 5000000 steps (56%)
00:44:56:WU02:FS02:0xa4:Completed 2750000 out of 5000000 steps (55%)
00:59:21:WU01:FS01:0xa4:Completed 2850000 out of 5000000 steps (57%)
01:04:18:WU02:FS02:0xa4:Completed 2800000 out of 5000000 steps (56%)
01:18:31:WU01:FS01:0xa4:Completed 2900000 out of 5000000 steps (58%)
01:31:52:WU02:FS02:0xa4:Completed 2850000 out of 5000000 steps (57%)
01:32:06:WU00:FS01:Cleaning up
01:32:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
01:34:43:WU01:FS01:0xa4:Completed 2950000 out of 5000000 steps (59%)
01:52:40:WU01:FS01:0xa4:Completed 3000000 out of 5000000 steps (60%)
02:02:38:WU02:FS02:0xa4:Completed 2900000 out of 5000000 steps (58%)
02:17:31:WU01:FS01:0xa4:Completed 3050000 out of 5000000 steps (61%)
02:28:49:WU02:FS02:0xa4:Completed 2950000 out of 5000000 steps (59%)
02:33:44:WU01:FS01:0xa4:Completed 3100000 out of 5000000 steps (62%)
02:53:21:WU02:FS02:0xa4:Completed 3000000 out of 5000000 steps (60%)
02:55:13:WU01:FS01:0xa4:Completed 3150000 out of 5000000 steps (63%)
03:11:56:WU02:FS02:0xa4:Completed 3050000 out of 5000000 steps (61%)
03:22:14:WU01:FS01:0xa4:Completed 3200000 out of 5000000 steps (64%)
03:30:30:WU02:FS02:0xa4:Completed 3100000 out of 5000000 steps (62%)
03:47:05:WU01:FS01:0xa4:Completed 3250000 out of 5000000 steps (65%)
03:49:40:WU02:FS02:0xa4:Completed 3150000 out of 5000000 steps (63%)
04:10:01:WU02:FS02:0xa4:Completed 3200000 out of 5000000 steps (64%)
04:10:38:WU01:FS01:0xa4:Completed 3300000 out of 5000000 steps (66%)
04:26:46:WU01:FS01:0xa4:Completed 3350000 out of 5000000 steps (67%)
04:39:19:WU02:FS02:0xa4:Completed 3250000 out of 5000000 steps (65%)
04:47:37:WU01:FS01:0xa4:Completed 3400000 out of 5000000 steps (68%)
04:57:32:WU02:FS02:0xa4:Completed 3300000 out of 5000000 steps (66%)
05:10:18:WU01:FS01:0xa4:Completed 3450000 out of 5000000 steps (69%)
05:38:24:WU02:FS02:0xa4:Completed 3350000 out of 5000000 steps (67%)
05:56:33:WU01:FS01:0xa4:Completed 3500000 out of 5000000 steps (70%)
******************************* Date: 2014-03-28 *******************************
06:11:43:WU02:FS02:0xa4:Completed 3400000 out of 5000000 steps (68%)
06:30:49:WU01:FS01:0xa4:Completed 3550000 out of 5000000 steps (71%)
06:50:21:WU02:FS02:0xa4:Completed 3450000 out of 5000000 steps (69%)
07:25:31:WU01:FS01:0xa4:Completed 3600000 out of 5000000 steps (72%)
07:32:06:WU00:FS01:Cleaning up
07:32:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
07:40:48:WU02:FS02:0xa4:Completed 3500000 out of 5000000 steps (70%)
08:01:48:WU01:FS01:0xa4:Completed 3650000 out of 5000000 steps (73%)
08:57:09:WU02:FS02:0xa4:Completed 3550000 out of 5000000 steps (71%)
09:14:09:WU01:FS01:0xa4:Completed 3700000 out of 5000000 steps (74%)
09:37:27:WU02:FS02:0xa4:Completed 3600000 out of 5000000 steps (72%)
10:07:56:WU01:FS01:0xa4:Completed 3750000 out of 5000000 steps (75%)
10:20:47:WU02:FS02:0xa4:Completed 3650000 out of 5000000 steps (73%)
10:26:57:WU01:FS01:0xa4:Completed 3800000 out of 5000000 steps (76%)
10:43:09:WU01:FS01:0xa4:Completed 3850000 out of 5000000 steps (77%)
10:51:08:WU02:FS02:0xa4:Completed 3700000 out of 5000000 steps (74%)
11:02:45:WU01:FS01:0xa4:Completed 3900000 out of 5000000 steps (78%)
11:14:21:WU02:FS02:0xa4:Completed 3750000 out of 5000000 steps (75%)
11:22:29:WU01:FS01:0xa4:Completed 3950000 out of 5000000 steps (79%)
11:34:35:WU02:FS02:0xa4:Completed 3800000 out of 5000000 steps (76%)
11:48:52:WU01:FS01:0xa4:Completed 4000000 out of 5000000 steps (80%)
11:55:03:WU02:FS02:0xa4:Completed 3850000 out of 5000000 steps (77%)
12:06:58:WU01:FS01:0xa4:Completed 4050000 out of 5000000 steps (81%)
******************************* Date: 2014-03-28 *******************************
12:17:08:WU02:FS02:0xa4:Completed 3900000 out of 5000000 steps (78%)
12:28:10:WU01:FS01:0xa4:Completed 4100000 out of 5000000 steps (82%)
12:38:35:WU02:FS02:0xa4:Completed 3950000 out of 5000000 steps (79%)
12:53:48:WU01:FS01:0xa4:Completed 4150000 out of 5000000 steps (83%)
12:58:01:WU02:FS02:0xa4:Completed 4000000 out of 5000000 steps (80%)
13:12:34:WU01:FS01:0xa4:Completed 4200000 out of 5000000 steps (84%)
13:24:06:WU02:FS02:0xa4:Completed 4050000 out of 5000000 steps (81%)
13:32:06:WU00:FS01:Cleaning up
13:32:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
13:35:18:WU01:FS01:0xa4:Completed 4250000 out of 5000000 steps (85%)
13:45:19:WU02:FS02:0xa4:Completed 4100000 out of 5000000 steps (82%)
14:00:03:WU01:FS01:0xa4:Completed 4300000 out of 5000000 steps (86%)
14:04:30:WARNING:WU02:FS02:FahCore returned an unknown error code which probably indicates that it crashed
14:04:30:WARNING:WU02:FS02:FahCore returned: UNKNOWN_ENUM (-1073741510 = 0xc000013a)
14:04:31:WARNING:Console control signal 6 on PID 1312
14:04:31:Exiting, please wait. . .