I am unable to complete a work unit. I get a message saying "Bad_Work_Unit". I'm folding on both cores on my CPU. I'm also folding on my NVIDIA card, and this is the one with the error.
Here's the section of the log with the error message:
Another folder was able to complete this work unit successfully.
Unfortunately there is an issue that is affecting a Maxwell's ability to fold the core_17 work units. Some people with those cards are using version 6 of the client which only gets core_15 work units and those do work okay. If you don't want to do that another option would be to shut down your GPU slot until the issue is resolved or you could leave it running and hope most of the work units you get are for core_15. Since core_17 WUs won't even start folding and they do notify the server of the problem there isn't a significant loss of time before the work unit is reassigned.
Also, in support of the last option, there may be something PG is doing to help with this:
That's disappointing. I upgraded my video card mostly to allow me to do more folding (I really believe in this project). I looked at the link you provided and see that the analysis/resolution for this problem is still ongoing and apparently unresolved. I'll disable the GPU slot for now. Will deleting the gpu slot from the configure/slot window be sufficient to do this ? Is there anything else that I need to do to clear this problem from my system ? The reason I ask is because after I deleted the slot, the status window shows this slot's status as "cleanup".
Should I just check back periodically to see when the problem is resolved, or is there some way that I can be notified ?
You can delete the GPU Slot and add it later when your Nvidia Maxwell GPU is supported. You can check the Forum to see if there is any update on the Maxwell issue but a safe bet would be that an official announcement about FahCore_17 supporting Maxwell GPUs mightl be posted on the Blog (http://folding.stanford.edu/home/blog).
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time
From the thread at the link bollix47 gave, if your card is a Maxwell it should now be assigned Core_15 WUs, which should work fine. If you try again and either part fails again, please post the log with the config section as well.
I added the GPU slot back in. Is there something else that I need to do to get i5 only units ? In looking at the following log, it looks like I'm getting I7 units. The slot has failed again, and I have deleted it.
@Nert: wonder why you configured two CPU slots ? Specially with unspecified number of cores for the first one and automatic for the second. There might be cases one would want several CPU slots, but those are rare.
I'm not sure why I did it that way. When I initially set it up, I didn't see an option for SMP, so I just started with one slot. When I did that, the CPU monitor only showed 50% utilized, so I guessed that the second core wasn't being used (my processor is only a Core 2 duo). So, to get the utilization up to 100% (where I usually ran it in the past), I just added a second cpu. I used to run the console only version, so this newest version is a bit confusing to me. It's pretty clear that I don't know what I'm doing with this. Good news is that I'm making a contribution (although not anywhere near yours .... 69 million points. Wow).
I'd appreciate any suggestions about how to configure this better.
I added the GPU slot back in. Is there something else that I need to do to get i5 only units ? In looking at the following log, it looks like I'm getting I7 units. The slot has failed again, and I have deleted it.
To permanently remove the GPU slot you need to remove the GPU slot and then add the following extra client option gpu = false. That option will prevent the client from adding it back on its own. Another option, after you remove the GPU slot, is to change the client to run as a service. Windows, for security reasons, will not allow a service to access the video sub system. The main benefit of running the client as a service is the client will run even if no one is logged into Windows.
After you remove the surplus CPU slot, simply double click the remaining CPU slot and you can manually assign the number of cores/threads to be used with -1 being the default of letting the client choose. Do note that this will often only take effect after the current WU is finished.
I would suggest you to delete slot 2, set cpus=-1 for slot 1 and let the client figure out what is optimal. Having two CPU slots with each one core is less efficient compared to haveing one slot with two cores.
Once the maxwell issue is solved keep in mind that each NV card require one CPU core to drive the GPU. At least that is valid for today's working NV cards under 0x17 projects.
As my rule of thumb:
One CPU slot with cups=[number of physical or HT cores] - [number of NV GPUs] -1
The additional -1 is for OS, network and UI. My personal preference.
Hey, and as for contributions, another rule of thumb says: every WU counts !
What OS are you using? If Linux, Core_15 won't run. Deleting the GPU slot until the issue is fixed is the only option. But the servers at Stanford should still be set NOT to issue Core_17 WUs to Maxwell at present. If Windows, Core_15 will run and is supposed to be all that is issued to Maxwell.
We need to see the whole log, from a restart of FAH. This includes the system and config info that helps diagnose problems -- avoiding going round the loop so many times.
System is Windows Vista. I have not yet made suggested changes to config (wanted to isolate this specific problem before making changes).
I rebooted the system to clean up and restart FAH. Following is the start up log. I attempted to post the previous log from \ProgramData\FAHClient\logs, but I exceeded the character count maximum. I will try again with a separate message to see if the complete log will post. Character count for it is close to maximum (69917)
23:30:41:WU01:FS01:Connecting to assign3.stanford.edu:8080
23:30:42:WU01:FS01:News: Welcome to Folding@Home
23:30:42:WU01:FS01:Assigned to work server 155.247.166.219
23:30:42:WU01:FS01:Requesting new work unit for slot 01: RUNNING cpu:2 from 155.247.166.219
23:30:42:WU01:FS01:Connecting to 155.247.166.219:8080
23:30:43:WU01:FS01:Downloading 114.99KiB
23:30:43:WU01:FS01:Download complete
23:30:43:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:6366 run:72 clone:0 gen:21 core:0xa4 unit:0x000000170002894b530e7710f1c832e1
23:30:47:WU00:FS01:0xa4:Client no longer detected. Shutting down core
23:30:47:WU00:FS01:0xa4:
23:30:47:WU00:FS01:0xa4:Folding@home Core Shutdown: CLIENT_DIED
23:30:47:WU01:FS01:Starting
23:30:47:WU01:FS01:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -np 2
23:30:47:WU01:FS01:Started FahCore on PID 8000
23:30:48:WU01:FS01:Core PID:5092
23:30:48:WU01:FS01:FahCore 0xa4 started
23:30:48:WU01:FS01:0xa4:
23:30:48:WU01:FS01:0xa4:*------------------------------*
23:30:48:WU01:FS01:0xa4:Folding@Home Gromacs GB Core
23:30:48:WU01:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
23:30:48:WU01:FS01:0xa4:
23:30:48:WU01:FS01:0xa4:Preparing to commence simulation
23:30:48:WU01:FS01:0xa4:- Looking at optimizations...
23:30:48:WU01:FS01:0xa4:- Created dyn
23:30:48:WU01:FS01:0xa4:- Files status OK
23:30:48:WU01:FS01:0xa4:- Expanded 117235 -> 264000 (decompressed 225.1 percent)
23:30:48:WU01:FS01:0xa4:Called DecompressByteArray: compressed_data_size=117235 data_size=264000, decompressed_data_size=264000 diff=0
23:30:48:WU01:FS01:0xa4:- Digital signature verified
23:30:48:WU01:FS01:0xa4:
23:30:48:WU01:FS01:0xa4:Project: 6366 (Run 72, Clone 0, Gen 21)
23:30:48:WU01:FS01:0xa4:
23:30:48:WU01:FS01:0xa4:Assembly optimizations on if available.
23:30:48:WU01:FS01:0xa4:Entering M.D.
23:30:54:WU01:FS01:0xa4:Mapping NT from 2 to 2
23:30:55:WU01:FS01:0xa4:Completed 0 out of 5000000 steps (0%)
23:31:41:WU00:FS01:Cleaning up
23:31:41:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
23:33:19:WU00:FS01:Cleaning up
23:33:19:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
23:35:56:WU00:FS01:Cleaning up
23:35:56:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
******************************* Date: 2014-03-26 *******************************
23:40:10:WU00:FS01:Cleaning up
23:40:10:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
23:47:01:WU00:FS01:Cleaning up
23:47:01:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
23:58:07:WU00:FS01:Cleaning up
23:58:07:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
00:11:07:WU03:FS02:0xa3:Completed 485000 out of 500000 steps (97%)
00:16:04:WU00:FS01:Cleaning up
00:16:04:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
00:45:06:WU00:FS01:Cleaning up
00:45:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
01:32:05:WU00:FS01:Cleaning up
01:32:05:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
01:34:22:WU03:FS02:0xa3:Completed 490000 out of 500000 steps (98%)
01:34:22:WU02:FS02:Connecting to assign3.stanford.edu:8080
01:34:22:WU02:FS02:News: Welcome to Folding@Home
01:34:22:WU02:FS02:Assigned to work server 155.247.166.219
01:34:22:WU02:FS02:Requesting new work unit for slot 02: RUNNING cpu:2 from 155.247.166.219
01:34:22:WU02:FS02:Connecting to 155.247.166.219:8080
01:34:23:WU02:FS02:Downloading 116.15KiB
01:34:23:WU02:FS02:Download complete
01:34:23:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:6367 run:22 clone:17 gen:7 core:0xa4 unit:0x000000070002894b532345974e7c2323
02:35:55:WU03:FS02:0xa3:Completed 495000 out of 500000 steps (99%)
02:48:06:WU00:FS01:Cleaning up
02:48:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
03:03:58:WU01:FS01:0xa4:Completed 50000 out of 5000000 steps (1%)
03:50:16:WU03:FS02:0xa3:Completed 500000 out of 500000 steps (100%)
03:50:19:WU03:FS02:0xa3:DynamicWrapper: Finished Work Unit: sleep=10000
03:50:29:WU03:FS02:0xa3:
03:50:29:WU03:FS02:0xa3:Finished Work Unit:
03:50:29:WU03:FS02:0xa3:- Reading up to 8059680 from "03/wudata_01.trr": Read 8059680
03:50:29:WU03:FS02:0xa3:trr file hash check passed.
03:50:29:WU03:FS02:0xa3:edr file hash check passed.
03:50:29:WU03:FS02:0xa3:logfile size: 94386
03:50:29:WU03:FS02:0xa3:Leaving Run
03:50:33:WU03:FS02:0xa3:- Writing 8190898 bytes of core data to disk...
03:50:36:WU03:FS02:0xa3:Done: 8190386 -> 7536648 (compressed to 92.0 percent)
03:50:36:WU03:FS02:0xa3: ... Done.
03:50:46:WU03:FS02:0xa3:- Shutting down core
03:50:46:WU03:FS02:0xa3:
03:50:46:WU03:FS02:0xa3:Folding@home Core Shutdown: FINISHED_UNIT
03:50:49:WU03:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
03:50:49:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:8585 run:1 clone:2 gen:283 core:0xa3 unit:0x00000c190a3b1e5952288a213a0e0663
03:50:49:WU03:FS02:Uploading 7.19MiB to 128.143.231.202
03:50:49:WU03:FS02:Connecting to 128.143.231.202:8080
03:50:49:WU02:FS02:Starting
03:50:49:WU02:FS02:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -np 2
03:50:49:WU02:FS02:Started FahCore on PID 2784
03:50:50:WU02:FS02:Core PID:5188
03:50:50:WU02:FS02:FahCore 0xa4 started
03:50:50:WU02:FS02:0xa4:
03:50:50:WU02:FS02:0xa4:*------------------------------*
03:50:50:WU02:FS02:0xa4:Folding@Home Gromacs GB Core
03:50:50:WU02:FS02:0xa4:Version 2.27 (Dec. 15, 2010)
03:50:50:WU02:FS02:0xa4:
03:50:50:WU02:FS02:0xa4:Preparing to commence simulation
03:50:50:WU02:FS02:0xa4:- Looking at optimizations...
03:50:50:WU02:FS02:0xa4:- Created dyn
03:50:50:WU02:FS02:0xa4:- Files status OK
03:50:50:WU02:FS02:0xa4:- Expanded 118421 -> 268472 (decompressed 226.7 percent)
03:50:50:WU02:FS02:0xa4:Called DecompressByteArray: compressed_data_size=118421 data_size=268472, decompressed_data_size=268472 diff=0
03:50:50:WU02:FS02:0xa4:- Digital signature verified
03:50:50:WU02:FS02:0xa4:
03:50:50:WU02:FS02:0xa4:Project: 6367 (Run 22, Clone 17, Gen 7)
03:50:50:WU02:FS02:0xa4:
03:50:50:WU02:FS02:0xa4:Assembly optimizations on if available.
03:50:50:WU02:FS02:0xa4:Entering M.D.
03:50:56:WU02:FS02:0xa4:Mapping NT from 2 to 2
03:50:56:WU02:FS02:0xa4:Completed 0 out of 5000000 steps (0%)
03:50:56:WU03:FS02:Upload 8.70%
03:51:03:WU03:FS02:Upload 17.39%
03:51:10:WU03:FS02:Upload 26.09%
03:51:17:WU03:FS02:Upload 34.78%
03:51:26:WU03:FS02:Upload 46.08%
03:51:33:WU03:FS02:Upload 55.65%
03:51:39:WU03:FS02:Upload 61.73%
03:51:46:WU03:FS02:Upload 70.43%
03:51:53:WU03:FS02:Upload 78.26%
03:52:02:WU03:FS02:Upload 89.56%
03:52:12:WU03:FS02:Upload complete
03:52:12:WU03:FS02:Server responded WORK_ACK (400)
03:52:12:WU03:FS02:Final credit estimate, 1668.00 points
03:52:12:WU03:FS02:Cleaning up
04:03:47:WU01:FS01:0xa4:Completed 100000 out of 5000000 steps (2%)
04:14:13:WU02:FS02:0xa4:Completed 50000 out of 5000000 steps (1%)
04:24:41:WU01:FS01:0xa4:Completed 150000 out of 5000000 steps (3%)
04:39:03:WU02:FS02:0xa4:Completed 100000 out of 5000000 steps (2%)
04:46:52:WU01:FS01:0xa4:Completed 200000 out of 5000000 steps (4%)
04:51:05:WU00:FS01:Cleaning up
04:51:05:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
04:55:40:WU02:FS02:0xa4:Completed 150000 out of 5000000 steps (3%)
05:13:52:WU02:FS02:0xa4:Completed 200000 out of 5000000 steps (4%)
05:14:50:WU01:FS01:0xa4:Completed 250000 out of 5000000 steps (5%)
05:29:20:WU02:FS02:0xa4:Completed 250000 out of 5000000 steps (5%)
******************************* Date: 2014-03-27 *******************************
05:45:56:WU01:FS01:0xa4:Completed 300000 out of 5000000 steps (6%)
05:46:10:WU02:FS02:0xa4:Completed 300000 out of 5000000 steps (6%)
06:05:11:WU01:FS01:0xa4:Completed 350000 out of 5000000 steps (7%)
06:09:30:WU02:FS02:0xa4:Completed 350000 out of 5000000 steps (7%)
06:28:06:WU02:FS02:0xa4:Completed 400000 out of 5000000 steps (8%)
06:30:46:WU01:FS01:0xa4:Completed 400000 out of 5000000 steps (8%)
06:49:29:WU01:FS01:0xa4:Completed 450000 out of 5000000 steps (9%)
06:58:51:WU02:FS02:0xa4:Completed 450000 out of 5000000 steps (9%)
07:11:44:WU01:FS01:0xa4:Completed 500000 out of 5000000 steps (10%)
07:16:18:WU02:FS02:0xa4:Completed 500000 out of 5000000 steps (10%)
07:32:55:WU01:FS01:0xa4:Completed 550000 out of 5000000 steps (11%)
07:41:39:WU02:FS02:0xa4:Completed 550000 out of 5000000 steps (11%)
07:52:07:WU01:FS01:0xa4:Completed 600000 out of 5000000 steps (12%)
08:02:14:WU02:FS02:0xa4:Completed 600000 out of 5000000 steps (12%)
08:10:06:WU00:FS01:Cleaning up
08:10:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
08:19:19:WU01:FS01:0xa4:Completed 650000 out of 5000000 steps (13%)
08:20:38:WU02:FS02:0xa4:Completed 650000 out of 5000000 steps (13%)
08:38:13:WU02:FS02:0xa4:Completed 700000 out of 5000000 steps (14%)
08:44:47:WU01:FS01:0xa4:Completed 700000 out of 5000000 steps (14%)
08:57:39:WU02:FS02:0xa4:Completed 750000 out of 5000000 steps (15%)
09:08:06:WU01:FS01:0xa4:Completed 750000 out of 5000000 steps (15%)
09:22:40:WU02:FS02:0xa4:Completed 800000 out of 5000000 steps (16%)
09:28:01:WU01:FS01:0xa4:Completed 800000 out of 5000000 steps (16%)
09:44:32:WU01:FS01:0xa4:Completed 850000 out of 5000000 steps (17%)
09:50:42:WU02:FS02:0xa4:Completed 850000 out of 5000000 steps (17%)
10:00:02:WU01:FS01:0xa4:Completed 900000 out of 5000000 steps (18%)
10:16:06:WU01:FS01:0xa4:Completed 950000 out of 5000000 steps (19%)
10:22:49:WU02:FS02:0xa4:Completed 900000 out of 5000000 steps (18%)
10:33:29:WU01:FS01:0xa4:Completed 1000000 out of 5000000 steps (20%)
10:51:55:WU01:FS01:0xa4:Completed 1050000 out of 5000000 steps (21%)
10:55:15:WU02:FS02:0xa4:Completed 950000 out of 5000000 steps (19%)
11:10:19:WU01:FS01:0xa4:Completed 1100000 out of 5000000 steps (22%)
11:19:03:WU02:FS02:0xa4:Completed 1000000 out of 5000000 steps (20%)
11:33:33:WU01:FS01:0xa4:Completed 1150000 out of 5000000 steps (23%)
11:36:56:WU02:FS02:0xa4:Completed 1050000 out of 5000000 steps (21%)
******************************* Date: 2014-03-27 *******************************
11:52:16:WU02:FS02:0xa4:Completed 1100000 out of 5000000 steps (22%)
11:58:46:WU01:FS01:0xa4:Completed 1200000 out of 5000000 steps (24%)
12:12:16:WU02:FS02:0xa4:Completed 1150000 out of 5000000 steps (23%)
12:28:43:WU01:FS01:0xa4:Completed 1250000 out of 5000000 steps (25%)
12:29:10:WU02:FS02:0xa4:Completed 1200000 out of 5000000 steps (24%)
12:47:26:WU02:FS02:0xa4:Completed 1250000 out of 5000000 steps (25%)
12:53:23:WU01:FS01:0xa4:Completed 1300000 out of 5000000 steps (26%)
13:11:46:WU02:FS02:0xa4:Completed 1300000 out of 5000000 steps (26%)
13:13:59:WU01:FS01:0xa4:Completed 1350000 out of 5000000 steps (27%)
13:30:16:WU01:FS01:0xa4:Completed 1400000 out of 5000000 steps (28%)
13:32:06:WU00:FS01:Cleaning up
13:32:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
13:39:09:WU02:FS02:0xa4:Completed 1350000 out of 5000000 steps (27%)
13:51:46:WU01:FS01:0xa4:Completed 1450000 out of 5000000 steps (29%)
14:02:26:WU02:FS02:0xa4:Completed 1400000 out of 5000000 steps (28%)
14:10:14:WU01:FS01:0xa4:Completed 1500000 out of 5000000 steps (30%)
14:21:00:WU02:FS02:0xa4:Completed 1450000 out of 5000000 steps (29%)
14:38:28:WU01:FS01:0xa4:Completed 1550000 out of 5000000 steps (31%)
14:39:29:WU02:FS02:0xa4:Completed 1500000 out of 5000000 steps (30%)
14:55:20:WU01:FS01:0xa4:Completed 1600000 out of 5000000 steps (32%)
15:08:23:WU02:FS02:0xa4:Completed 1550000 out of 5000000 steps (31%)
15:19:18:WU01:FS01:0xa4:Completed 1650000 out of 5000000 steps (33%)
15:30:12:WU02:FS02:0xa4:Completed 1600000 out of 5000000 steps (32%)
15:32:52:Saving configuration to config.xml
15:32:52:<config>
15:32:52: <!-- Folding Slot Configuration -->
15:32:52: <power v='FULL'/>
15:32:52:
15:32:52: <!-- Network -->
15:32:52: <proxy v=':8080'/>
15:32:52:
15:32:52: <!-- User Information -->
15:32:52: <team v='165780'/>
15:32:52: <user v='nert'/>
15:32:52:
15:32:52: <!-- Folding Slots -->
15:32:52: <slot id='1' type='CPU'/>
15:32:52: <slot id='2' type='CPU'>
15:32:52: <cpus v='-1'/>
15:32:52: </slot>
15:32:52:</config>
15:43:56:WU01:FS01:0xa4:Completed 1700000 out of 5000000 steps (34%)
15:59:45:WU02:FS02:0xa4:Completed 1650000 out of 5000000 steps (33%)
16:12:58:WU01:FS01:0xa4:Completed 1750000 out of 5000000 steps (35%)
16:21:08:WU02:FS02:0xa4:Completed 1700000 out of 5000000 steps (34%)
16:39:19:WU02:FS02:0xa4:Completed 1750000 out of 5000000 steps (35%)
16:40:34:WU01:FS01:0xa4:Completed 1800000 out of 5000000 steps (36%)
17:00:26:WU02:FS02:0xa4:Completed 1800000 out of 5000000 steps (36%)
17:08:12:WU01:FS01:0xa4:Completed 1850000 out of 5000000 steps (37%)
17:23:53:WU01:FS01:0xa4:Completed 1900000 out of 5000000 steps (38%)
17:25:50:WU02:FS02:0xa4:Completed 1850000 out of 5000000 steps (37%)
17:43:40:WU02:FS02:0xa4:Completed 1900000 out of 5000000 steps (38%)
17:47:10:WU01:FS01:0xa4:Completed 1950000 out of 5000000 steps (39%)
******************************* Date: 2014-03-27 *******************************
18:04:21:WU01:FS01:0xa4:Completed 2000000 out of 5000000 steps (40%)
18:08:52:WU02:FS02:0xa4:Completed 1950000 out of 5000000 steps (39%)
18:27:38:WU01:FS01:0xa4:Completed 2050000 out of 5000000 steps (41%)
18:31:07:WU02:FS02:0xa4:Completed 2000000 out of 5000000 steps (40%)
18:47:22:WU01:FS01:0xa4:Completed 2100000 out of 5000000 steps (42%)
18:52:07:WU02:FS02:0xa4:Completed 2050000 out of 5000000 steps (41%)
19:10:33:WU02:FS02:0xa4:Completed 2100000 out of 5000000 steps (42%)
19:14:44:WU01:FS01:0xa4:Completed 2150000 out of 5000000 steps (43%)
19:29:08:WU02:FS02:0xa4:Completed 2150000 out of 5000000 steps (43%)
19:32:06:WU00:FS01:Cleaning up
19:32:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
19:43:01:WU01:FS01:0xa4:Completed 2200000 out of 5000000 steps (44%)
19:45:51:WU02:FS02:0xa4:Completed 2200000 out of 5000000 steps (44%)
20:00:06:WU01:FS01:0xa4:Completed 2250000 out of 5000000 steps (45%)
20:13:42:WU02:FS02:0xa4:Completed 2250000 out of 5000000 steps (45%)
20:23:04:WU01:FS01:0xa4:Completed 2300000 out of 5000000 steps (46%)
20:30:23:WU02:FS02:0xa4:Completed 2300000 out of 5000000 steps (46%)
20:47:14:WU02:FS02:0xa4:Completed 2350000 out of 5000000 steps (47%)
20:49:37:WU01:FS01:0xa4:Completed 2350000 out of 5000000 steps (47%)
21:06:10:WU01:FS01:0xa4:Completed 2400000 out of 5000000 steps (48%)
21:13:00:WU02:FS02:0xa4:Completed 2400000 out of 5000000 steps (48%)
21:24:10:WU01:FS01:0xa4:Completed 2450000 out of 5000000 steps (49%)
21:37:18:WU02:FS02:0xa4:Completed 2450000 out of 5000000 steps (49%)
21:40:05:Adding folding slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti]
21:40:05:Saving configuration to config.xml
21:40:05:<config>
21:40:05: <!-- Folding Slot Configuration -->
21:40:05: <power v='FULL'/>
21:40:05:
21:40:05: <!-- Network -->
21:40:05: <proxy v=':8080'/>
21:40:05:
21:40:05: <!-- User Information -->
21:40:05: <team v='165780'/>
21:40:05: <user v='nert'/>
21:40:05:
21:40:05: <!-- Folding Slots -->
21:40:05: <slot id='1' type='CPU'/>
21:40:05: <slot id='2' type='CPU'>
21:40:05: <cpus v='-1'/>
21:40:05: </slot>
21:40:05: <slot id='0' type='GPU'/>
21:40:05:</config>
21:40:05:WU03:FS00:Connecting to assign-GPU.stanford.edu:80
21:40:06:WU03:FS00:News: Welcome to Folding@Home
21:40:06:WU03:FS00:Assigned to work server 140.163.4.231
21:40:06:WU03:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
21:40:06:WU03:FS00:Connecting to 140.163.4.231:8080
21:40:07:WU03:FS00:Downloading 4.84MiB
21:40:11:WU03:FS00:Download complete
21:40:11:WU03:FS00:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13000 run:1821 clone:0 gen:4 core:0x17 unit:0x0000000a538b3db753119ead6aade1b5
21:40:11:WU03:FS00:Starting
21:40:11:WU03:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
21:40:11:WU03:FS00:Started FahCore on PID 7184
21:40:11:WU03:FS00:Core PID:5744
21:40:11:WU03:FS00:FahCore 0x17 started
21:40:13:WU03:FS00:0x17:*********************** Log Started 2014-03-27T21:40:13Z ***********************
21:40:13:WU03:FS00:0x17:Project: 13000 (Run 1821, Clone 0, Gen 4)
21:40:13:WU03:FS00:0x17:Unit: 0x0000000a538b3db753119ead6aade1b5
21:40:13:WU03:FS00:0x17:CPU: 0x00000000000000000000000000000000
21:40:13:WU03:FS00:0x17:Machine: 0
21:40:13:WU03:FS00:0x17:Reading tar file state.xml
21:40:14:WU03:FS00:0x17:Reading tar file system.xml
21:40:15:WU03:FS00:0x17:Reading tar file integrator.xml
21:40:15:WU03:FS00:0x17:Reading tar file core.xml
21:40:15:WU03:FS00:0x17:Digital signatures verified
21:40:15:WU03:FS00:0x17:Folding@home GPU core17
21:40:15:WU03:FS00:0x17:Version 0.0.52
21:47:17:WU03:FS00:0x17:ERROR:exception: Force RMSE error of 449.511 with threshold of 5
21:47:17:WU03:FS00:0x17:Saving result file logfile_01.txt
21:47:17:WU03:FS00:0x17:Saving result file log.txt
21:47:17:WU03:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
21:47:17:WARNING:WU03:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:47:17:WU03:FS00:Sending unit results: id:03 state:SEND error:FAULTY project:13000 run:1821 clone:0 gen:4 core:0x17 unit:0x0000000a538b3db753119ead6aade1b5
21:47:18:WU03:FS00:Uploading 2.25KiB to 140.163.4.231
21:47:18:WU03:FS00:Connecting to 140.163.4.231:8080
21:47:18:WU04:FS00:Connecting to assign-GPU.stanford.edu:80
21:47:18:WU03:FS00:Upload complete
21:47:18:WU03:FS00:Server responded WORK_ACK (400)
21:47:18:WU03:FS00:Cleaning up
21:47:18:WU04:FS00:News: Welcome to Folding@Home
21:47:18:WU04:FS00:Assigned to work server 140.163.4.231
21:47:18:WU04:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
21:47:18:WU04:FS00:Connecting to 140.163.4.231:8080
21:47:20:WU04:FS00:Downloading 4.84MiB
21:47:23:WU04:FS00:Download complete
21:47:23:WU04:FS00:Received Unit: id:04 state:DOWNLOAD error:NO_ERROR project:13000 run:366 clone:1 gen:4 core:0x17 unit:0x00000009538b3db753100326677f2ded
21:47:23:WU04:FS00:Starting
21:47:23:WU04:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
21:47:23:WU04:FS00:Started FahCore on PID 5072
21:47:23:WU04:FS00:Core PID:7172
21:47:23:WU04:FS00:FahCore 0x17 started
21:47:24:WU04:FS00:0x17:*********************** Log Started 2014-03-27T21:47:24Z ***********************
21:47:24:WU04:FS00:0x17:Project: 13000 (Run 366, Clone 1, Gen 4)
21:47:24:WU04:FS00:0x17:Unit: 0x00000009538b3db753100326677f2ded
21:47:24:WU04:FS00:0x17:CPU: 0x00000000000000000000000000000000
21:47:24:WU04:FS00:0x17:Machine: 0
21:47:24:WU04:FS00:0x17:Reading tar file state.xml
21:47:26:WU04:FS00:0x17:Reading tar file system.xml
21:47:26:WU04:FS00:0x17:Reading tar file integrator.xml
21:47:26:WU04:FS00:0x17:Reading tar file core.xml
21:47:26:WU04:FS00:0x17:Digital signatures verified
21:47:26:WU04:FS00:0x17:Folding@home GPU core17
21:47:26:WU04:FS00:0x17:Version 0.0.52
21:54:37:WU04:FS00:0x17:ERROR:exception: Force RMSE error of 454.658 with threshold of 5
21:54:37:WU04:FS00:0x17:Saving result file logfile_01.txt
21:54:37:WU04:FS00:0x17:Saving result file log.txt
21:54:37:WU04:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
21:54:43:WARNING:WU04:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:54:43:WU04:FS00:Sending unit results: id:04 state:SEND error:FAULTY project:13000 run:366 clone:1 gen:4 core:0x17 unit:0x00000009538b3db753100326677f2ded
21:54:43:WU04:FS00:Uploading 2.24KiB to 140.163.4.231
21:54:43:WU04:FS00:Connecting to 140.163.4.231:8080
21:54:44:WU03:FS00:Connecting to assign-GPU.stanford.edu:80
21:54:44:WU04:FS00:Upload complete
21:54:44:WU04:FS00:Server responded WORK_ACK (400)
21:54:44:WU04:FS00:Cleaning up
21:54:44:WU03:FS00:News: Welcome to Folding@Home
21:54:44:WU03:FS00:Assigned to work server 140.163.4.231
21:54:44:WU03:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
21:54:44:WU03:FS00:Connecting to 140.163.4.231:8080
21:54:46:WU03:FS00:Downloading 4.84MiB
21:54:48:WU03:FS00:Download complete
21:54:48:WU03:FS00:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13001 run:322 clone:1 gen:3 core:0x17 unit:0x0000000b538b3db75328aaf86441d0ab
21:54:49:WU03:FS00:Starting
21:54:49:WU03:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
21:54:49:WU03:FS00:Started FahCore on PID 2204
21:54:49:WU03:FS00:Core PID:5828
21:54:49:WU03:FS00:FahCore 0x17 started
21:54:50:WU03:FS00:0x17:*********************** Log Started 2014-03-27T21:54:50Z ***********************
21:54:50:WU03:FS00:0x17:Project: 13001 (Run 322, Clone 1, Gen 3)
21:54:50:WU03:FS00:0x17:Unit: 0x0000000b538b3db75328aaf86441d0ab
21:54:50:WU03:FS00:0x17:CPU: 0x00000000000000000000000000000000
21:54:50:WU03:FS00:0x17:Machine: 0
21:54:50:WU03:FS00:0x17:Reading tar file state.xml
21:54:51:WU03:FS00:0x17:Reading tar file system.xml
21:54:52:WU03:FS00:0x17:Reading tar file integrator.xml
21:54:52:WU03:FS00:0x17:Reading tar file core.xml
21:54:52:WU03:FS00:0x17:Digital signatures verified
21:54:52:WU03:FS00:0x17:Folding@home GPU core17
21:54:52:WU03:FS00:0x17:Version 0.0.52
22:01:36:WU03:FS00:0x17:ERROR:exception: Force RMSE error of 453.768 with threshold of 5
22:01:36:WU03:FS00:0x17:Saving result file logfile_01.txt
22:01:36:WU03:FS00:0x17:Saving result file log.txt
22:01:36:WU03:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:01:38:WARNING:WU03:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:01:38:WU03:FS00:Sending unit results: id:03 state:SEND error:FAULTY project:13001 run:322 clone:1 gen:3 core:0x17 unit:0x0000000b538b3db75328aaf86441d0ab
22:01:38:WU03:FS00:Uploading 2.25KiB to 140.163.4.231
22:01:38:WU03:FS00:Connecting to 140.163.4.231:8080
22:01:38:WU03:FS00:Upload complete
22:01:38:WU03:FS00:Server responded WORK_ACK (400)
22:01:38:WU03:FS00:Cleaning up
22:01:38:WU04:FS00:Connecting to assign-GPU.stanford.edu:80
22:01:39:WU04:FS00:News: Welcome to Folding@Home
22:01:39:WU04:FS00:Assigned to work server 140.163.4.231
22:01:39:WU04:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
22:01:39:WU04:FS00:Connecting to 140.163.4.231:8080
22:01:40:WU04:FS00:Downloading 4.84MiB
22:01:43:WU04:FS00:Download complete
22:01:43:WU04:FS00:Received Unit: id:04 state:DOWNLOAD error:NO_ERROR project:13001 run:431 clone:7 gen:3 core:0x17 unit:0x00000006538b3db75328ca0e19f86245
22:01:44:WU04:FS00:Starting
22:01:44:WU04:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:01:44:WU04:FS00:Started FahCore on PID 6124
22:01:44:WU04:FS00:Core PID:4036
22:01:44:WU04:FS00:FahCore 0x17 started
22:01:45:WU04:FS00:0x17:*********************** Log Started 2014-03-27T22:01:44Z ***********************
22:01:45:WU04:FS00:0x17:Project: 13001 (Run 431, Clone 7, Gen 3)
22:01:45:WU04:FS00:0x17:Unit: 0x00000006538b3db75328ca0e19f86245
22:01:45:WU04:FS00:0x17:CPU: 0x00000000000000000000000000000000
22:01:45:WU04:FS00:0x17:Machine: 0
22:01:45:WU04:FS00:0x17:Reading tar file state.xml
22:01:46:WU04:FS00:0x17:Reading tar file system.xml
22:01:47:WU04:FS00:0x17:Reading tar file integrator.xml
22:01:47:WU04:FS00:0x17:Reading tar file core.xml
22:01:47:WU04:FS00:0x17:Digital signatures verified
22:01:47:WU04:FS00:0x17:Folding@home GPU core17
22:01:47:WU04:FS00:0x17:Version 0.0.52
22:08:12:WU04:FS00:0x17:ERROR:exception: Force RMSE error of 452.193 with threshold of 5
22:08:12:WU04:FS00:0x17:Saving result file logfile_01.txt
22:08:12:WU04:FS00:0x17:Saving result file log.txt
22:08:12:WU04:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:08:12:WARNING:WU04:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:08:12:WU04:FS00:Sending unit results: id:04 state:SEND error:FAULTY project:13001 run:431 clone:7 gen:3 core:0x17 unit:0x00000006538b3db75328ca0e19f86245
22:08:12:WU04:FS00:Uploading 2.24KiB to 140.163.4.231
22:08:12:WU04:FS00:Connecting to 140.163.4.231:8080
22:08:12:WU04:FS00:Upload complete
22:08:12:WU04:FS00:Server responded WORK_ACK (400)
22:08:12:WU04:FS00:Cleaning up
22:08:13:WU03:FS00:Connecting to assign-GPU.stanford.edu:80
22:08:13:WU03:FS00:News: Welcome to Folding@Home
22:08:13:WU03:FS00:Assigned to work server 140.163.4.231
22:08:13:WU03:FS00:Requesting new work unit for slot 00: READY gpu:0:GM107 [GeForce GTX 750 Ti] from 140.163.4.231
22:08:13:WU03:FS00:Connecting to 140.163.4.231:8080
22:08:14:WU03:FS00:Downloading 4.84MiB
22:08:17:WU03:FS00:Download complete
22:08:17:WU03:FS00:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:13000 run:624 clone:0 gen:11 core:0x17 unit:0x00000010538b3db753104bd39660a5f8
22:08:18:WU03:FS00:Starting
22:08:18:WU03:FS00:Running FahCore: "C:\Program Files\FAHClient/FAHCoreWrapper.exe" C:/ProgramData/FAHClient/cores/www.stanford.edu/~pande/Win32/x86/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 703 -lifeline 1312 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
22:08:18:WU03:FS00:Started FahCore on PID 4288
22:08:18:WU03:FS00:Core PID:7760
22:08:18:WU03:FS00:FahCore 0x17 started
22:08:19:WU03:FS00:0x17:*********************** Log Started 2014-03-27T22:08:18Z ***********************
22:08:19:WU03:FS00:0x17:Project: 13000 (Run 624, Clone 0, Gen 11)
22:08:19:WU03:FS00:0x17:Unit: 0x00000010538b3db753104bd39660a5f8
22:08:19:WU03:FS00:0x17:CPU: 0x00000000000000000000000000000000
22:08:19:WU03:FS00:0x17:Machine: 0
22:08:19:WU03:FS00:0x17:Reading tar file state.xml
22:08:20:WU03:FS00:0x17:Reading tar file system.xml
22:08:20:WU03:FS00:0x17:Reading tar file integrator.xml
22:08:20:WU03:FS00:0x17:Reading tar file core.xml
22:08:20:WU03:FS00:0x17:Digital signatures verified
22:08:20:WU03:FS00:0x17:Folding@home GPU core17
22:08:20:WU03:FS00:0x17:Version 0.0.52
22:15:05:WU03:FS00:0x17:ERROR:exception: Force RMSE error of 454.942 with threshold of 5
22:15:05:WU03:FS00:0x17:Saving result file logfile_01.txt
22:15:05:WU03:FS00:0x17:Saving result file log.txt
22:15:05:WU03:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:15:05:WARNING:WU03:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:15:05:WU03:FS00:Sending unit results: id:03 state:SEND error:FAULTY project:13000 run:624 clone:0 gen:11 core:0x17 unit:0x00000010538b3db753104bd39660a5f8
22:15:05:WU03:FS00:Uploading 2.25KiB to 140.163.4.231
22:15:05:WU03:FS00:Connecting to 140.163.4.231:8080
22:15:05:WU03:FS00:Upload complete
22:15:05:WU03:FS00:Server responded WORK_ACK (400)
22:15:05:WU03:FS00:Cleaning up
22:23:24:WU01:FS01:0xa4:Completed 2500000 out of 5000000 steps (50%)
22:27:03:Saving configuration to config.xml
22:27:03:<config>
22:27:03: <!-- Folding Slot Configuration -->
22:27:03: <power v='FULL'/>
22:27:03:
22:27:03: <!-- Network -->
22:27:03: <proxy v=':8080'/>
22:27:03:
22:27:03: <!-- User Information -->
22:27:03: <team v='165780'/>
22:27:03: <user v='nert'/>
22:27:03:
22:27:03: <!-- Folding Slots -->
22:27:03: <slot id='1' type='CPU'/>
22:27:03: <slot id='2' type='CPU'>
22:27:03: <cpus v='-1'/>
22:27:03: </slot>
22:27:03:</config>
22:35:20:WU02:FS02:0xa4:Completed 2500000 out of 5000000 steps (50%)
22:48:06:WU01:FS01:0xa4:Completed 2550000 out of 5000000 steps (51%)
23:01:28:WU02:FS02:0xa4:Completed 2550000 out of 5000000 steps (51%)
23:05:38:WU01:FS01:0xa4:Completed 2600000 out of 5000000 steps (52%)
23:22:18:WU01:FS01:0xa4:Completed 2650000 out of 5000000 steps (53%)
23:28:22:WU02:FS02:0xa4:Completed 2600000 out of 5000000 steps (52%)
23:48:41:WU01:FS01:0xa4:Completed 2700000 out of 5000000 steps (54%)
23:58:13:WU02:FS02:0xa4:Completed 2650000 out of 5000000 steps (53%)
******************************* Date: 2014-03-28 *******************************
00:10:03:WU01:FS01:0xa4:Completed 2750000 out of 5000000 steps (55%)
00:20:58:WU02:FS02:0xa4:Completed 2700000 out of 5000000 steps (54%)
00:33:09:WU01:FS01:0xa4:Completed 2800000 out of 5000000 steps (56%)
00:44:56:WU02:FS02:0xa4:Completed 2750000 out of 5000000 steps (55%)
00:59:21:WU01:FS01:0xa4:Completed 2850000 out of 5000000 steps (57%)
01:04:18:WU02:FS02:0xa4:Completed 2800000 out of 5000000 steps (56%)
01:18:31:WU01:FS01:0xa4:Completed 2900000 out of 5000000 steps (58%)
01:31:52:WU02:FS02:0xa4:Completed 2850000 out of 5000000 steps (57%)
01:32:06:WU00:FS01:Cleaning up
01:32:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
01:34:43:WU01:FS01:0xa4:Completed 2950000 out of 5000000 steps (59%)
01:52:40:WU01:FS01:0xa4:Completed 3000000 out of 5000000 steps (60%)
02:02:38:WU02:FS02:0xa4:Completed 2900000 out of 5000000 steps (58%)
02:17:31:WU01:FS01:0xa4:Completed 3050000 out of 5000000 steps (61%)
02:28:49:WU02:FS02:0xa4:Completed 2950000 out of 5000000 steps (59%)
02:33:44:WU01:FS01:0xa4:Completed 3100000 out of 5000000 steps (62%)
02:53:21:WU02:FS02:0xa4:Completed 3000000 out of 5000000 steps (60%)
02:55:13:WU01:FS01:0xa4:Completed 3150000 out of 5000000 steps (63%)
03:11:56:WU02:FS02:0xa4:Completed 3050000 out of 5000000 steps (61%)
03:22:14:WU01:FS01:0xa4:Completed 3200000 out of 5000000 steps (64%)
03:30:30:WU02:FS02:0xa4:Completed 3100000 out of 5000000 steps (62%)
03:47:05:WU01:FS01:0xa4:Completed 3250000 out of 5000000 steps (65%)
03:49:40:WU02:FS02:0xa4:Completed 3150000 out of 5000000 steps (63%)
04:10:01:WU02:FS02:0xa4:Completed 3200000 out of 5000000 steps (64%)
04:10:38:WU01:FS01:0xa4:Completed 3300000 out of 5000000 steps (66%)
04:26:46:WU01:FS01:0xa4:Completed 3350000 out of 5000000 steps (67%)
04:39:19:WU02:FS02:0xa4:Completed 3250000 out of 5000000 steps (65%)
04:47:37:WU01:FS01:0xa4:Completed 3400000 out of 5000000 steps (68%)
04:57:32:WU02:FS02:0xa4:Completed 3300000 out of 5000000 steps (66%)
05:10:18:WU01:FS01:0xa4:Completed 3450000 out of 5000000 steps (69%)
05:38:24:WU02:FS02:0xa4:Completed 3350000 out of 5000000 steps (67%)
05:56:33:WU01:FS01:0xa4:Completed 3500000 out of 5000000 steps (70%)
******************************* Date: 2014-03-28 *******************************
06:11:43:WU02:FS02:0xa4:Completed 3400000 out of 5000000 steps (68%)
06:30:49:WU01:FS01:0xa4:Completed 3550000 out of 5000000 steps (71%)
06:50:21:WU02:FS02:0xa4:Completed 3450000 out of 5000000 steps (69%)
07:25:31:WU01:FS01:0xa4:Completed 3600000 out of 5000000 steps (72%)
07:32:06:WU00:FS01:Cleaning up
07:32:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
07:40:48:WU02:FS02:0xa4:Completed 3500000 out of 5000000 steps (70%)
08:01:48:WU01:FS01:0xa4:Completed 3650000 out of 5000000 steps (73%)
08:57:09:WU02:FS02:0xa4:Completed 3550000 out of 5000000 steps (71%)
09:14:09:WU01:FS01:0xa4:Completed 3700000 out of 5000000 steps (74%)
09:37:27:WU02:FS02:0xa4:Completed 3600000 out of 5000000 steps (72%)
10:07:56:WU01:FS01:0xa4:Completed 3750000 out of 5000000 steps (75%)
10:20:47:WU02:FS02:0xa4:Completed 3650000 out of 5000000 steps (73%)
10:26:57:WU01:FS01:0xa4:Completed 3800000 out of 5000000 steps (76%)
10:43:09:WU01:FS01:0xa4:Completed 3850000 out of 5000000 steps (77%)
10:51:08:WU02:FS02:0xa4:Completed 3700000 out of 5000000 steps (74%)
11:02:45:WU01:FS01:0xa4:Completed 3900000 out of 5000000 steps (78%)
11:14:21:WU02:FS02:0xa4:Completed 3750000 out of 5000000 steps (75%)
11:22:29:WU01:FS01:0xa4:Completed 3950000 out of 5000000 steps (79%)
11:34:35:WU02:FS02:0xa4:Completed 3800000 out of 5000000 steps (76%)
11:48:52:WU01:FS01:0xa4:Completed 4000000 out of 5000000 steps (80%)
11:55:03:WU02:FS02:0xa4:Completed 3850000 out of 5000000 steps (77%)
12:06:58:WU01:FS01:0xa4:Completed 4050000 out of 5000000 steps (81%)
******************************* Date: 2014-03-28 *******************************
12:17:08:WU02:FS02:0xa4:Completed 3900000 out of 5000000 steps (78%)
12:28:10:WU01:FS01:0xa4:Completed 4100000 out of 5000000 steps (82%)
12:38:35:WU02:FS02:0xa4:Completed 3950000 out of 5000000 steps (79%)
12:53:48:WU01:FS01:0xa4:Completed 4150000 out of 5000000 steps (83%)
12:58:01:WU02:FS02:0xa4:Completed 4000000 out of 5000000 steps (80%)
13:12:34:WU01:FS01:0xa4:Completed 4200000 out of 5000000 steps (84%)
13:24:06:WU02:FS02:0xa4:Completed 4050000 out of 5000000 steps (81%)
13:32:06:WU00:FS01:Cleaning up
13:32:06:ERROR:WU00:FS01:Exception: Failed to remove directory './work/00': boost::filesystem::remove: The process cannot access the file because it is being used by another process: ".\work\00\logfile_01.txt"
13:35:18:WU01:FS01:0xa4:Completed 4250000 out of 5000000 steps (85%)
13:45:19:WU02:FS02:0xa4:Completed 4100000 out of 5000000 steps (82%)
14:00:03:WU01:FS01:0xa4:Completed 4300000 out of 5000000 steps (86%)
14:04:30:WARNING:WU02:FS02:FahCore returned an unknown error code which probably indicates that it crashed
14:04:30:WARNING:WU02:FS02:FahCore returned: UNKNOWN_ENUM (-1073741510 = 0xc000013a)
14:04:31:WARNING:Console control signal 6 on PID 1312
14:04:31:Exiting, please wait. . .