HFM.NET - Monitoring Application for Folding@Home v7

DrBB1 · Post by **DrBB1** » Thu Nov 15, 2012 5:20 am

PinHead wrote: Next, the 8057 completed on 11/14/2012 at 10:02 PM shows a download time of 11/14/2012 at 11:51 PM and I am posting at 10:55 PM on 11/14/2012. ^^shrugs^^

Edit:
Upon further review, alot of my GPU WU show as completed a few hours before downloading in WU history.

My WuHistory.db3 file finally seems to be updating regularly; however, similar to PinHead, I now find the difference between the download and completion times don't make sense, in some cases showing the completion time is earlier than the download time. Since I am running SMP projects, this issue seems to be independent of the client.

Post by **bruce** » Thu Nov 15, 2012 2:38 pm

Have you checked FAH's log? The first thing I'd do is figure out if the servers are having trouble sending new WUs immediately or if the HFM times don't match what's in the log.

DrBB1 · Post by **DrBB1** » Thu Nov 15, 2012 6:10 pm

As far as I can tell, the log seem fine. I will need to have another couple of WUs completed to see if there is any pattern or whether my fix of updating the WuHistory.db3 file is related, though from my limited understanding of HFM.NET and the underlying architecture I don't believe it is. From what I can see, the WuHistory.db3 file may still not be updating each completed WU consistently because I don't see every Run, Clone, and Gen of the projects included in the logs over the past week represented in the WU Viewer.

BTW, if there a formal--or informal--reference document somewhere that explains all the settings in V. 0.9.1--Rev. 595 [particularly the "Preferences"]? If so, please share the link; I suspect that if I understood the effects of checking/unchecking all the options, I might be able to diagnose the problem. Thanks.

PinHead · Post by **PinHead** » Fri Nov 16, 2012 12:28 am

I don't recognize a line in the log that indicates a database update or WU completion insertion. I do see a pattern that when the times are wrong, the credited points are base points and not QRB points ( HFM reporting, not Stanford ).

I have some entries that show 1-2 hours to complete on WU's that take 3 to 6 hours to complete. Other's show that I completed the WU 2 hours before I received it ( would love to see QRB on those, ROFL ).
It doesn't do it on all clients and it doesn't do it consistantly on a given client.

It started in November, my first crazy entry is on Nov 5.

Biffa · Post by **Biffa** » Fri Nov 16, 2012 12:58 am

BTW I uninstalled and reinstalled and my web generating is working again

harlam357 · Post by **harlam357** » Sun Nov 18, 2012 6:10 pm

Sorry for my slowness and lack of time everyone... I want to get these issues fixed.

harlam357 wrote:I think the culprit with the WU History entries is the upgrade I did to the SQLite library because I didn't change my implementation code in this area. That's where I'll look first. Maybe it's a bug in the library... maybe I can simply update it to the newest version and the issue will cease. That's always a quick "fix".

Following up on this... regarding the duplicate entries in WU History. The newer version of SQLite is the culprit. It is writing the Date and Time entries with a "Z" for zulu or UTC in the entry. My unit tests didn't catch this. This is generally a problem when WUs take a long time to upload. On each refresh cycle the code simply sees a completed WU and tries to write it to the database. At this level it has no knowledge of its previous state or if it previously tried to write this unit to the database. The database itself checks to see whether a WU has already been written... this is based on P(R/C/G) and the Download Date and Time. Since this Download Date and Time now has a "Z" or zulu ack on it the code comparing the Date and Time isn't seeing an equivalent Date and Time because one is marked as local time and the other as UTC. Gonna take a code update to fix.

bruce wrote:Can I hide or remove a slot while still displaying another slot on the same V7 client?

Nope... but that's a fantastic idea! It's going in the backlog as a feature request.

DrBB1 wrote:UPDATE #3: I reported in viewtopic.php?f=14&t=9903&start=420#p228862 that the WuHistory.db3 file is updating at least intermittently, but not correctly: some of the completion times/dates precede the recorded download information. As long as the WuHistory.db3 file continues to update regularly (correctly or not), I will no longer update this post.

Hey DrBB1 - I apologize for all your trouble. I didn't see an error in the log you posted previously... but it wasn't a large chunk of time represented. I encourage you to run the logging on Info in lieu of Debug during normal opperation. Running it on Debug will only result in a much larger log file and generally not yield any further useful information for a user.

I suspect the issue you're seeing with date/time has to do with the update to the SQLite library in conjunction with something that changed in the v7.2.9 client. I just started testing the 7.2.9 client and I have a slow moving WU. Gonna take 24 hours before I can verify the same behavior.

@PinHead - this also speaks to the issue you're seeing.

@Biffa - good deal... I think you had some older xslt files in there. I was going to suggest making sure the files distributed with v0.9.1 were in there.

^w^ing · Post by **^w^ing** » Tue Nov 20, 2012 3:22 pm

sometimes a slot in HFM freezes at 100% after the WU has been completed and sent. This just happened again, my GPU slot (slot 0) in HFM shows a WU at 100% completion (even though that unit is already done, sent and deleted and another unit in that slot is already at 30%), the log for the unit within HFM shows

Code: Select all

08:26:11:WU01:FS00:Starting
08:26:11:WU01:FS00:Core PID:4844
08:26:11:WU01:FS00:FahCore 0x15 started
08:26:11:WU01:FS00:0x15:
08:26:11:WU01:FS00:0x15:*------------------------------*
08:26:11:WU01:FS00:0x15:Folding@Home GPU Core
08:26:11:WU01:FS00:0x15:Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
08:26:11:WU01:FS00:0x15:Build host             SimbiosNvdWin7
08:26:11:WU01:FS00:0x15:Board Type             NVIDIA/CUDA
08:26:11:WU01:FS00:0x15:Core                   15
08:26:11:WU01:FS00:0x15:
08:26:11:WU01:FS00:0x15:Window's signal control handler registered.
08:26:11:WU01:FS00:0x15:Preparing to commence simulation
08:26:11:WU01:FS00:0x15:- Assembly optimizations manually forced on.
08:26:11:WU01:FS00:0x15:- Not checking prior termination.
08:26:11:WU01:FS00:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
08:26:11:WU01:FS00:0x15:- Expanded 60158 -> 264278 (decompressed 439.3 percent)
08:26:11:WU01:FS00:0x15:Called DecompressByteArray: compressed_data_size=60158 data_size=264278, decompressed_data_size=264278 diff=0
08:26:11:WU01:FS00:0x15:- Digital signature verified
08:26:11:WU01:FS00:0x15:
08:26:11:WU01:FS00:0x15:Project: 8054 (Run 0, Clone 691, Gen 131)
08:26:11:WU01:FS00:0x15:
08:26:11:WU01:FS00:0x15:Assembly optimizations on if available.
08:26:11:WU01:FS00:0x15:Entering M.D.
08:26:13:WU01:FS00:0x15:Tpr hash 01/wudata_01.tpr:  323956482 4055225601 3288241545 3295378515 1454487113
08:26:13:WU01:FS00:0x15:GPU device info: vendor=0 device=0 name=<NA> match=0
08:26:13:WU01:FS00:0x15:Working on Good ROcking Metal Altar for Chronical Sinners
08:26:13:WU01:FS00:0x15:Client config unavailable.
08:26:13:WU01:FS00:0x15:Starting GUI Server
08:27:14:WU01:FS00:0x15:Setting checkpoint frequency: 500000
08:27:14:WU01:FS00:0x15:Completed         3 out of 50000000 steps (0%).
08:29:40:WU01:FS00:0x15:Completed    500000 out of 50000000 steps (1%).
08:32:07:WU01:FS00:0x15:Completed   1000000 out of 50000000 steps (2%).
08:34:34:WU01:FS00:0x15:Completed   1500000 out of 50000000 steps (3%).
08:37:01:WU01:FS00:0x15:Completed   2000000 out of 50000000 steps (4%).
08:39:28:WU01:FS00:0x15:Completed   2500000 out of 50000000 steps (5%).
08:41:54:WU01:FS00:0x15:Completed   3000000 out of 50000000 steps (6%).
08:44:21:WU01:FS00:0x15:Completed   3500000 out of 50000000 steps (7%).
08:46:48:WU01:FS00:0x15:Completed   4000000 out of 50000000 steps (8%).
08:49:15:WU01:FS00:0x15:Completed   4500000 out of 50000000 steps (9%).
08:51:42:WU01:FS00:0x15:Completed   5000000 out of 50000000 steps (10%).
08:54:09:WU01:FS00:0x15:Completed   5500000 out of 50000000 steps (11%).
08:56:36:WU01:FS00:0x15:Completed   6000000 out of 50000000 steps (12%).
08:59:03:WU01:FS00:0x15:Completed   6500000 out of 50000000 steps (13%).
09:01:29:WU01:FS00:0x15:Completed   7000000 out of 50000000 steps (14%).
09:03:56:WU01:FS00:0x15:Completed   7500000 out of 50000000 steps (15%).
09:06:23:WU01:FS00:0x15:Completed   8000000 out of 50000000 steps (16%).
09:08:50:WU01:FS00:0x15:Completed   8500000 out of 50000000 steps (17%).
09:11:17:WU01:FS00:0x15:Completed   9000000 out of 50000000 steps (18%).
09:13:44:WU01:FS00:0x15:Completed   9500000 out of 50000000 steps (19%).
09:16:10:WU01:FS00:0x15:Completed  10000000 out of 50000000 steps (20%).
09:18:37:WU01:FS00:0x15:Completed  10500000 out of 50000000 steps (21%).
09:21:04:WU01:FS00:0x15:Completed  11000000 out of 50000000 steps (22%).
09:23:31:WU01:FS00:0x15:Completed  11500000 out of 50000000 steps (23%).
09:25:58:WU01:FS00:0x15:Completed  12000000 out of 50000000 steps (24%).
09:28:25:WU01:FS00:0x15:Completed  12500000 out of 50000000 steps (25%).
09:30:51:WU01:FS00:0x15:Completed  13000000 out of 50000000 steps (26%).
09:33:18:WU01:FS00:0x15:Completed  13500000 out of 50000000 steps (27%).
09:35:45:WU01:FS00:0x15:Completed  14000000 out of 50000000 steps (28%).
09:38:12:WU01:FS00:0x15:Completed  14500000 out of 50000000 steps (29%).
09:40:39:WU01:FS00:0x15:Completed  15000000 out of 50000000 steps (30%).
09:43:06:WU01:FS00:0x15:Completed  15500000 out of 50000000 steps (31%).
09:45:32:WU01:FS00:0x15:Completed  16000000 out of 50000000 steps (32%).
09:47:59:WU01:FS00:0x15:Completed  16500000 out of 50000000 steps (33%).
09:50:26:WU01:FS00:0x15:Completed  17000000 out of 50000000 steps (34%).
09:52:53:WU01:FS00:0x15:Completed  17500000 out of 50000000 steps (35%).
09:55:20:WU01:FS00:0x15:Completed  18000000 out of 50000000 steps (36%).
09:57:47:WU01:FS00:0x15:Completed  18500000 out of 50000000 steps (37%).
10:00:13:WU01:FS00:0x15:Completed  19000000 out of 50000000 steps (38%).
10:02:40:WU01:FS00:0x15:Completed  19500000 out of 50000000 steps (39%).
10:05:07:WU01:FS00:0x15:Completed  20000000 out of 50000000 steps (40%).
10:07:34:WU01:FS00:0x15:Completed  20500000 out of 50000000 steps (41%).
10:10:01:WU01:FS00:0x15:Completed  21000000 out of 50000000 steps (42%).
10:12:28:WU01:FS00:0x15:Completed  21500000 out of 50000000 steps (43%).
10:14:54:WU01:FS00:0x15:Completed  22000000 out of 50000000 steps (44%).
10:17:21:WU01:FS00:0x15:Completed  22500000 out of 50000000 steps (45%).
10:19:48:WU01:FS00:0x15:Completed  23000000 out of 50000000 steps (46%).
10:22:15:WU01:FS00:0x15:Completed  23500000 out of 50000000 steps (47%).
10:24:42:WU01:FS00:0x15:Completed  24000000 out of 50000000 steps (48%).
10:27:09:WU01:FS00:0x15:Completed  24500000 out of 50000000 steps (49%).
10:29:35:WU01:FS00:0x15:Completed  25000000 out of 50000000 steps (50%).
10:32:02:WU01:FS00:0x15:Completed  25500000 out of 50000000 steps (51%).
10:34:29:WU01:FS00:0x15:Completed  26000000 out of 50000000 steps (52%).
10:36:56:WU01:FS00:0x15:Completed  26500000 out of 50000000 steps (53%).
10:39:23:WU01:FS00:0x15:Completed  27000000 out of 50000000 steps (54%).
10:41:50:WU01:FS00:0x15:Completed  27500000 out of 50000000 steps (55%).
10:44:16:WU01:FS00:0x15:Completed  28000000 out of 50000000 steps (56%).
10:46:43:WU01:FS00:0x15:Completed  28500000 out of 50000000 steps (57%).
10:49:10:WU01:FS00:0x15:Completed  29000000 out of 50000000 steps (58%).
10:51:37:WU01:FS00:0x15:Completed  29500000 out of 50000000 steps (59%).
10:54:04:WU01:FS00:0x15:Completed  30000000 out of 50000000 steps (60%).
10:56:31:WU01:FS00:0x15:Completed  30500000 out of 50000000 steps (61%).
10:58:57:WU01:FS00:0x15:Completed  31000000 out of 50000000 steps (62%).
11:01:24:WU01:FS00:0x15:Completed  31500000 out of 50000000 steps (63%).
11:03:51:WU01:FS00:0x15:Completed  32000000 out of 50000000 steps (64%).
11:06:19:WU01:FS00:0x15:Completed  32500000 out of 50000000 steps (65%).
11:08:46:WU01:FS00:0x15:Completed  33000000 out of 50000000 steps (66%).
11:11:14:WU01:FS00:0x15:Completed  33500000 out of 50000000 steps (67%).
11:13:42:WU01:FS00:0x15:Completed  34000000 out of 50000000 steps (68%).
11:16:12:WU01:FS00:0x15:Completed  34500000 out of 50000000 steps (69%).
11:18:48:WU01:FS00:0x15:Completed  35000000 out of 50000000 steps (70%).
11:21:25:WU01:FS00:0x15:Completed  35500000 out of 50000000 steps (71%).
11:24:04:WU01:FS00:0x15:Completed  36000000 out of 50000000 steps (72%).
11:26:43:WU01:FS00:0x15:Completed  36500000 out of 50000000 steps (73%).
11:29:22:WU01:FS00:0x15:Completed  37000000 out of 50000000 steps (74%).
11:32:01:WU01:FS00:0x15:Completed  37500000 out of 50000000 steps (75%).
11:34:38:WU01:FS00:0x15:Completed  38000000 out of 50000000 steps (76%).
11:37:09:WU01:FS00:0x15:Completed  38500000 out of 50000000 steps (77%).
11:39:39:WU01:FS00:0x15:Completed  39000000 out of 50000000 steps (78%).
11:42:07:WU01:FS00:0x15:Completed  39500000 out of 50000000 steps (79%).
11:44:36:WU01:FS00:0x15:Completed  40000000 out of 50000000 steps (80%).
11:47:04:WU01:FS00:0x15:Completed  40500000 out of 50000000 steps (81%).
11:49:34:WU01:FS00:0x15:Completed  41000000 out of 50000000 steps (82%).
11:52:08:WU01:FS00:0x15:Completed  41500000 out of 50000000 steps (83%).
11:54:47:WU01:FS00:0x15:Completed  42000000 out of 50000000 steps (84%).
11:57:26:WU01:FS00:0x15:Completed  42500000 out of 50000000 steps (85%).
12:00:03:WU01:FS00:0x15:Completed  43000000 out of 50000000 steps (86%).
12:02:42:WU01:FS00:0x15:Completed  43500000 out of 50000000 steps (87%).
12:05:20:WU01:FS00:0x15:Completed  44000000 out of 50000000 steps (88%).
12:07:57:WU01:FS00:0x15:Completed  44500000 out of 50000000 steps (89%).
12:10:27:WU01:FS00:0x15:Completed  45000000 out of 50000000 steps (90%).
12:12:57:WU01:FS00:0x15:Completed  45500000 out of 50000000 steps (91%).
12:15:29:WU01:FS00:0x15:Completed  46000000 out of 50000000 steps (92%).
12:18:06:WU01:FS00:0x15:Completed  46500000 out of 50000000 steps (93%).
12:20:42:WU01:FS00:0x15:Completed  47000000 out of 50000000 steps (94%).
12:23:21:WU01:FS00:0x15:Completed  47500000 out of 50000000 steps (95%).
12:26:00:WU01:FS00:0x15:Completed  48000000 out of 50000000 steps (96%).
12:28:38:WU01:FS00:0x15:Completed  48500000 out of 50000000 steps (97%).
12:31:17:WU01:FS00:0x15:Completed  49000000 out of 50000000 steps (98%).
12:33:54:WU01:FS00:0x15:Completed  49500000 out of 50000000 steps (99%).
12:36:21:WU01:FS00:0x15:Completed  50000000 out of 50000000 steps (100%).
12:36:22:WU01:FS00:0x15:Finished fah_main status=0
12:36:22:WU01:FS00:0x15:Successful run
12:36:22:WU01:FS00:0x15:DynamicWrapper: Finished Work Unit: sleep=10000
12:36:32:WU01:FS00:0x15:Reserved 330048 bytes for xtc file; Cosm status=0
12:36:32:WU01:FS00:0x15:Allocated 330048 bytes for xtc file
12:36:32:WU01:FS00:0x15:- Reading up to 330048 from "01/wudata_01.xtc": Read 330048
12:36:32:WU01:FS00:0x15:Read 330048 bytes from xtc file; available packet space=786100416
12:36:32:WU01:FS00:0x15:xtc file hash check passed.
12:36:32:WU01:FS00:0x15:Reserved 20616 20616 786100416 bytes for arc file=<01/wudata_01.trr> Cosm status=0
12:36:32:WU01:FS00:0x15:Allocated 20616 bytes for arc file
12:36:32:WU01:FS00:0x15:- Reading up to 20616 from "01/wudata_01.trr": Read 20616
12:36:32:WU01:FS00:0x15:Read 20616 bytes from arc file; available packet space=786079800
12:36:32:WU01:FS00:0x15:trr file hash check passed.
12:36:32:WU01:FS00:0x15:Allocated 544 bytes for edr file
12:36:32:WU01:FS00:0x15:Read bedfile
12:36:32:WU01:FS00:0x15:edr file hash check passed.
12:36:32:WU01:FS00:0x15:Allocated 36862 bytes for logfile
12:36:32:WU01:FS00:0x15:Read logfile
12:36:32:WU01:FS00:0x15:GuardedRun: success in DynamicWrapper
12:36:32:WU01:FS00:0x15:GuardedRun: done
12:36:32:WU01:FS00:0x15:Run: GuardedRun completed.
12:36:32:WU01:FS00:0x15:+ Opened results file
12:36:32:WU01:FS00:0x15:- Writing 388582 bytes of core data to disk...
12:36:32:WU01:FS00:0x15:Done: 388070 -> 357107 (compressed to 92.0 percent)
12:36:32:WU01:FS00:0x15:  ... Done.
12:36:32:WU01:FS00:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
12:36:32:WU01:FS00:0x15:Shutting down core 
12:36:32:WU01:FS00:0x15:
12:36:32:WU01:FS00:0x15:Folding@home Core Shutdown: FINISHED_UNIT
12:36:32:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
12:36:32:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:8054 run:0 clone:691 gen:131 core:0x15 unit:0x000000996953ee2f50626ab27dfed731
12:36:32:WU01:FS00:Uploading 349.24KiB to 171.67.108.143
12:36:38:WU01:FS00:Upload 100.00%
12:36:38:WU01:FS00:Upload complete
12:36:38:WU01:FS00:Server responded WORK_ACK (400)
12:36:38:WU01:FS00:Final credit estimate, 2387.00 points
12:36:38:WU01:FS00:Cleaning up

I didn't find anything out of the ordinary even in the fahlog of this WU.

HFM Log keeps logging the following whenever this happens

Code: Select all

[20.11.2012-13:34:54] - Running Retrieval Process...
[20.11.2012-13:34:54] - Stopping retrieval timer loop.
[20.11.2012-13:34:54] - (wing-pc Slot 00) Slot Status: Running
[20.11.2012-13:34:54] - (wing-pc Slot 01) Slot Status: Running
[20.11.2012-13:34:54] - (wing-pc Slot 02) Slot Status: Paused
[20.11.2012-13:34:54] - (wing-pc) Retrieval finished in 83 ms
[20.11.2012-13:34:54] - (einstein Slot 00) Slot Status: Running
[20.11.2012-13:34:54] - (einstein) Retrieval finished in 23 ms
[20.11.2012-13:34:54] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-13:34:54] - Total Retrieval Execution Time: 145 ms
[20.11.2012-13:35:28] - (wing-pc Slot 00) Slot Status: Running
[20.11.2012-13:35:28] - (wing-pc Slot 01) Slot Status: Running
[20.11.2012-13:35:28] - (wing-pc Slot 02) Slot Status: Paused
[20.11.2012-13:35:28] - (wing-pc) Retrieval finished in 103 ms
[20.11.2012-13:35:29] - (wing-pc Slot 00) Slot Status: Finishing
[20.11.2012-13:35:29] - (wing-pc Slot 01) Slot Status: Running
[20.11.2012-13:35:29] - (wing-pc Slot 02) Slot Status: Paused
[20.11.2012-13:35:29] - (wing-pc) Retrieval finished in 63 ms
[20.11.2012-13:36:21] - (wing-pc Slot 00) Slot Status: Finishing
[20.11.2012-13:36:22] - (wing-pc Slot 01) Slot Status: Running
[20.11.2012-13:36:22] - (wing-pc Slot 02) Slot Status: Paused
[20.11.2012-13:36:22] - (wing-pc) Retrieval finished in 110 ms
[20.11.2012-13:36:31] - (wing-pc Slot 00) Slot Status: Finishing
[20.11.2012-13:36:31] - (wing-pc Slot 01) Slot Status: Running
[20.11.2012-13:36:31] - (wing-pc Slot 02) Slot Status: Paused
[20.11.2012-13:36:31] - (wing-pc) Retrieval finished in 100 ms
[20.11.2012-13:36:34] - (wing-pc Slot 00) Slot Status: Ready
[20.11.2012-13:36:34] - (wing-pc Slot 01) Slot Status: Running
[20.11.2012-13:36:34] - (wing-pc Slot 02) Slot Status: Paused
[20.11.2012-13:36:34] - (wing-pc) Retrieval finished in 100 ms
[20.11.2012-13:36:40] - (wing-pc Slot 00) Slot Status: Paused
[20.11.2012-13:36:40] - (wing-pc Slot 01) Slot Status: Running
[20.11.2012-13:36:40] - (wing-pc Slot 02) Slot Status: Paused
[20.11.2012-13:36:40] - (wing-pc) Retrieval finished in 100 ms
[20.11.2012-13:36:42] - (wing-pc Slot 00) Slot Status: Ready
[20.11.2012-13:36:42] - (wing-pc Slot 01) Slot Status: Running
[20.11.2012-13:36:42] - (wing-pc Slot 02) Slot Status: Paused
[20.11.2012-13:36:42] - (wing-pc) Retrieval finished in 100 ms
[20.11.2012-13:36:48] - (wing-pc Slot 00) Slot Status: Running
[20.11.2012-13:36:48] - (wing-pc Slot 01) Slot Status: Running
[20.11.2012-13:36:48] - (wing-pc Slot 02) Slot Status: Paused
[20.11.2012-13:36:48] - (wing-pc) Retrieval finished in 100 ms
[20.11.2012-13:37:01] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:37:01] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:37:56] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:37:56] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:39:54] - Running Retrieval Process...
[20.11.2012-13:39:54] - Stopping retrieval timer loop.
[20.11.2012-13:39:54] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:39:54] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:39:54] - (einstein Slot 00) Slot Status: Running
[20.11.2012-13:39:54] - (einstein) Retrieval finished in 27 ms
[20.11.2012-13:39:54] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-13:39:54] - Total Retrieval Execution Time: 126 ms
[20.11.2012-13:40:42] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:40:42] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:42:56] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:42:56] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:44:54] - Running Retrieval Process...
[20.11.2012-13:44:54] - Stopping retrieval timer loop.
[20.11.2012-13:44:54] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:44:54] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:44:54] - (einstein Slot 00) Slot Status: Running
[20.11.2012-13:44:54] - (einstein) Retrieval finished in 23 ms
[20.11.2012-13:44:54] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-13:44:54] - Total Retrieval Execution Time: 120 ms
[20.11.2012-13:47:57] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:47:57] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:49:54] - Running Retrieval Process...
[20.11.2012-13:49:54] - Stopping retrieval timer loop.
[20.11.2012-13:49:54] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:49:54] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:49:54] - (einstein Slot 00) Slot Status: Running
[20.11.2012-13:49:54] - (einstein) Retrieval finished in 21 ms
[20.11.2012-13:49:54] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-13:49:54] - Total Retrieval Execution Time: 127 ms
[20.11.2012-13:51:10] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:51:10] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:53:02] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:53:02] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:54:54] - Running Retrieval Process...
[20.11.2012-13:54:54] - Stopping retrieval timer loop.
[20.11.2012-13:54:54] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:54:54] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:54:54] - (einstein Slot 00) Slot Status: Running
[20.11.2012-13:54:54] - (einstein) Retrieval finished in 23 ms
[20.11.2012-13:54:54] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-13:54:54] - Total Retrieval Execution Time: 118 ms
[20.11.2012-13:58:07] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:58:07] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:59:54] - Running Retrieval Process...
[20.11.2012-13:59:54] - Stopping retrieval timer loop.
[20.11.2012-13:59:54] X (wing-pc) An item with the same key has already been added.
[20.11.2012-13:59:54] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-13:59:54] - (einstein Slot 00) Slot Status: Running
[20.11.2012-13:59:54] - (einstein) Retrieval finished in 23 ms
[20.11.2012-13:59:54] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-13:59:54] - Total Retrieval Execution Time: 115 ms
[20.11.2012-14:01:20] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:01:20] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:03:07] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:03:07] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:04:54] - Running Retrieval Process...
[20.11.2012-14:04:54] - Stopping retrieval timer loop.
[20.11.2012-14:04:54] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:04:54] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:04:54] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:04:54] - (einstein) Retrieval finished in 23 ms
[20.11.2012-14:04:55] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:04:55] - Total Retrieval Execution Time: 117 ms
[20.11.2012-14:08:18] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:08:18] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:09:55] - Running Retrieval Process...
[20.11.2012-14:09:55] - Stopping retrieval timer loop.
[20.11.2012-14:09:55] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:09:55] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:09:55] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:09:55] - (einstein) Retrieval finished in 24 ms
[20.11.2012-14:09:55] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:09:55] - Total Retrieval Execution Time: 119 ms
[20.11.2012-14:11:22] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:11:22] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:13:23] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:13:23] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:14:55] - Running Retrieval Process...
[20.11.2012-14:14:55] - Stopping retrieval timer loop.
[20.11.2012-14:14:55] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:14:55] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:14:55] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:14:55] - (einstein) Retrieval finished in 23 ms
[20.11.2012-14:14:55] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:14:55] - Total Retrieval Execution Time: 117 ms
[20.11.2012-14:15:25] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:15:25] - (einstein) Retrieval finished in 42 ms
[20.11.2012-14:18:41] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:18:41] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:19:55] - Running Retrieval Process...
[20.11.2012-14:19:55] - Stopping retrieval timer loop.
[20.11.2012-14:19:55] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:19:55] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:19:55] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:19:55] - (einstein) Retrieval finished in 23 ms
[20.11.2012-14:19:55] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:19:55] - Total Retrieval Execution Time: 111 ms
[20.11.2012-14:21:25] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:21:25] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:23:58] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:23:58] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:24:55] - Running Retrieval Process...
[20.11.2012-14:24:55] - Stopping retrieval timer loop.
[20.11.2012-14:24:55] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:24:55] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:24:55] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:24:55] - (einstein) Retrieval finished in 23 ms
[20.11.2012-14:24:55] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:24:55] - Total Retrieval Execution Time: 119 ms
[20.11.2012-14:29:01] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:29:01] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:29:55] - Running Retrieval Process...
[20.11.2012-14:29:55] - Stopping retrieval timer loop.
[20.11.2012-14:29:55] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:29:55] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:29:55] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:29:55] - (einstein) Retrieval finished in 24 ms
[20.11.2012-14:29:55] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:29:55] - Total Retrieval Execution Time: 117 ms
[20.11.2012-14:31:29] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:31:29] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:34:20] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:34:20] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:34:55] - Running Retrieval Process...
[20.11.2012-14:34:55] - Stopping retrieval timer loop.
[20.11.2012-14:34:55] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:34:55] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:34:55] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:34:55] - (einstein) Retrieval finished in 23 ms
[20.11.2012-14:34:55] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:34:55] - Total Retrieval Execution Time: 119 ms
[20.11.2012-14:39:35] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:39:35] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:39:55] - Running Retrieval Process...
[20.11.2012-14:39:55] - Stopping retrieval timer loop.
[20.11.2012-14:39:55] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:39:55] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:39:55] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:39:55] - (einstein) Retrieval finished in 22 ms
[20.11.2012-14:39:55] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:39:55] - Total Retrieval Execution Time: 117 ms
[20.11.2012-14:41:45] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:41:45] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:44:52] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:44:52] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:44:55] - Running Retrieval Process...
[20.11.2012-14:44:55] - Stopping retrieval timer loop.
[20.11.2012-14:44:55] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:44:55] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:44:55] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:44:55] - (einstein) Retrieval finished in 22 ms
[20.11.2012-14:44:55] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:44:55] - Total Retrieval Execution Time: 113 ms
[20.11.2012-14:49:55] - Running Retrieval Process...
[20.11.2012-14:49:55] - Stopping retrieval timer loop.
[20.11.2012-14:49:55] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:49:55] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:49:56] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:49:56] - (einstein) Retrieval finished in 20 ms
[20.11.2012-14:49:56] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:49:56] - Total Retrieval Execution Time: 109 ms
[20.11.2012-14:49:58] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:49:58] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:51:50] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:51:50] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:54:51] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:54:51] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:54:56] - Running Retrieval Process...
[20.11.2012-14:54:56] - Stopping retrieval timer loop.
[20.11.2012-14:54:56] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:54:56] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:54:56] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:54:56] - (einstein) Retrieval finished in 22 ms
[20.11.2012-14:54:56] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:54:56] - Total Retrieval Execution Time: 114 ms
[20.11.2012-14:59:44] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:59:44] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:59:56] - Running Retrieval Process...
[20.11.2012-14:59:56] - Stopping retrieval timer loop.
[20.11.2012-14:59:56] X (wing-pc) An item with the same key has already been added.
[20.11.2012-14:59:56] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-14:59:56] - (einstein Slot 00) Slot Status: Running
[20.11.2012-14:59:56] - (einstein) Retrieval finished in 24 ms
[20.11.2012-14:59:56] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-14:59:56] - Total Retrieval Execution Time: 114 ms
[20.11.2012-15:01:37] X (wing-pc) An item with the same key has already been added.
[20.11.2012-15:01:37] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-15:04:16] - (einstein Slot 00) Slot Status: Running
[20.11.2012-15:04:16] - (einstein) Retrieval finished in 40 ms
[20.11.2012-15:04:36] X (wing-pc) An item with the same key has already been added.
[20.11.2012-15:04:36] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-15:04:56] - Running Retrieval Process...
[20.11.2012-15:04:56] - Stopping retrieval timer loop.
[20.11.2012-15:04:56] X (wing-pc) An item with the same key has already been added.
[20.11.2012-15:04:56] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-15:04:56] - (einstein Slot 00) Slot Status: Running
[20.11.2012-15:04:56] - (einstein) Retrieval finished in 22 ms
[20.11.2012-15:04:56] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-15:04:56] - Total Retrieval Execution Time: 113 ms
[20.11.2012-15:09:29] X (wing-pc) An item with the same key has already been added.
[20.11.2012-15:09:29] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-15:09:56] - Running Retrieval Process...
[20.11.2012-15:09:56] - Stopping retrieval timer loop.
[20.11.2012-15:09:56] X (wing-pc) An item with the same key has already been added.
[20.11.2012-15:09:56] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-15:09:56] - (einstein Slot 00) Slot Status: Running
[20.11.2012-15:09:56] - (einstein) Retrieval finished in 22 ms
[20.11.2012-15:09:56] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-15:09:56] - Total Retrieval Execution Time: 113 ms
[20.11.2012-15:11:26] X (wing-pc) An item with the same key has already been added.
[20.11.2012-15:11:26] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-15:14:21] X (wing-pc) An item with the same key has already been added.
[20.11.2012-15:14:21] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-15:14:56] - Running Retrieval Process...
[20.11.2012-15:14:56] - Stopping retrieval timer loop.
[20.11.2012-15:14:56] X (wing-pc) An item with the same key has already been added.
[20.11.2012-15:14:56] X System.ArgumentException: An item with the same key has already been added.
   at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
   at HFM.Core.FahClientDataAggregator.GenerateUnitInfoDataFromQueue(IEnumerable`1 unitCollection, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClientDataAggregator.AggregateData(ICollection`1 logLines, UnitCollection unitCollection, Info info, Options options, SlotOptions slotOptions, UnitInfo currentUnitInfo, Int32 slotId)
   at HFM.Core.FahClient.Process()
   at HFM.Core.FahClient.RetrieveInternal()
[20.11.2012-15:14:56] - (einstein Slot 00) Slot Status: Running
[20.11.2012-15:14:56] - (einstein) Retrieval finished in 22 ms
[20.11.2012-15:14:56] - Starting Retrieval Timer Loop: 5 Minutes
[20.11.2012-15:14:56] - Total Retrieval Execution Time: 114 ms

restarting HFM fixes it.

edit- I just noticed in the fahlog that I set this folding slot to "finish" just before that particular unit reached 100%, could be relevant.

bollix47 · Post by **bollix47** » Sat Nov 24, 2012 7:37 pm

Does the preference "Refresh Client Data" actually work? I have mine set to the default of every 15 minutes but I've also tried 180 and even not checking the preference. As you can see from the log it's updating much more frequently.

Code: Select all

[24/11/2012-2:05:19 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:05:20 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:05:20 PM] - (Discovery) Retrieval finished in 1,825 ms
[24/11/2012-2:05:24 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:05:24 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:05:24 PM] - (Mother) Retrieval finished in 296 ms
[24/11/2012-2:05:33 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:05:33 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:05:33 PM] - (Atlantis) Retrieval finished in 156 ms
[24/11/2012-2:05:34 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:05:34 PM] - (Endeavour) Retrieval finished in 140 ms
[24/11/2012-2:05:44 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:05:45 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:05:45 PM] - (Enterprise) Retrieval finished in 2,075 ms
[24/11/2012-2:06:23 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:06:24 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:06:24 PM] - (Discovery) Retrieval finished in 1,856 ms
[24/11/2012-2:06:37 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:06:37 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:06:37 PM] - (Atlantis) Retrieval finished in 187 ms
[24/11/2012-2:06:38 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:06:39 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:06:39 PM] - (Enterprise) Retrieval finished in 2,090 ms
[24/11/2012-2:06:40 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:06:41 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:06:41 PM] - (Discovery) Retrieval finished in 1,872 ms
[24/11/2012-2:07:00 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:07:00 PM] - (Endeavour) Retrieval finished in 140 ms
[24/11/2012-2:07:11 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:07:12 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:07:12 PM] - (Enterprise) Retrieval finished in 2,075 ms
[24/11/2012-2:07:13 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:07:13 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:07:13 PM] - (Mother) Retrieval finished in 296 ms
[24/11/2012-2:07:27 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:07:27 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:07:27 PM] - (Discovery) Retrieval finished in 1,794 ms
[24/11/2012-2:07:33 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:07:34 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:07:34 PM] - (Enterprise) Retrieval finished in 2,075 ms
[24/11/2012-2:07:41 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:07:41 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:07:41 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:08:25 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:08:25 PM] - (Endeavour) Retrieval finished in 109 ms
[24/11/2012-2:08:30 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:08:30 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:08:31 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:08:31 PM] - (Discovery) Retrieval finished in 1,919 ms
[24/11/2012-2:08:31 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:08:31 PM] - (Enterprise) Retrieval finished in 2,215 ms
[24/11/2012-2:08:38 PM] - Running Retrieval Process...
[24/11/2012-2:08:38 PM] - Stopping retrieval timer loop.
[24/11/2012-2:08:38 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:08:39 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:08:39 PM] - (Discovery) Retrieval finished in 1,794 ms
[24/11/2012-2:08:39 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:08:39 PM] - (Endeavour) Retrieval finished in 125 ms
[24/11/2012-2:08:41 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:08:42 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:08:42 PM] - (Enterprise) Retrieval finished in 1,997 ms
[24/11/2012-2:08:42 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:08:42 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:08:42 PM] - (Atlantis) Retrieval finished in 140 ms
[24/11/2012-2:08:42 PM] - (Apollo13 Slot 00) Slot Status: Running
[24/11/2012-2:08:42 PM] - (Apollo13) Retrieval finished in 78 ms
[24/11/2012-2:08:42 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:08:42 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:08:42 PM] - (Mother) Retrieval finished in 296 ms
[24/11/2012-2:08:42 PM] - (Gemini Slot 00) Slot Status: Running
[24/11/2012-2:08:42 PM] - (Gemini) Retrieval finished in 265 ms
[24/11/2012-2:08:43 PM] - (Challenger Slot 01) Slot Status: Running
[24/11/2012-2:08:43 PM] - (Challenger) Retrieval finished in 62 ms
[24/11/2012-2:08:43 PM] - Starting Retrieval Timer Loop: 30 Minutes
[24/11/2012-2:08:43 PM] - Total Retrieval Execution Time: 5,070 ms
[24/11/2012-2:08:46 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:08:46 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:08:46 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:09:02 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:09:02 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:09:02 PM] - (Mother) Retrieval finished in 296 ms
[24/11/2012-2:09:13 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:09:13 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:09:13 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:09:18 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:09:18 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:09:18 PM] - (Mother) Retrieval finished in 312 ms
[24/11/2012-2:09:28 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:09:29 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:09:29 PM] - (Enterprise) Retrieval finished in 2,028 ms
[24/11/2012-2:09:33 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:09:33 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:09:33 PM] - (Discovery) Retrieval finished in 1,825 ms
[24/11/2012-2:09:50 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:09:50 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:09:50 PM] - (Endeavour) Retrieval finished in 140 ms
[24/11/2012-2:09:50 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:09:50 PM] - (Atlantis) Retrieval finished in 187 ms
[24/11/2012-2:10:24 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:10:25 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:10:25 PM] - (Enterprise) Retrieval finished in 1,997 ms
[24/11/2012-2:10:35 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:10:36 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:10:36 PM] - (Discovery) Retrieval finished in 1,872 ms
[24/11/2012-2:10:52 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:10:52 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:10:52 PM] - (Mother) Retrieval finished in 281 ms
[24/11/2012-2:10:54 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:10:54 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:10:54 PM] - (Atlantis) Retrieval finished in 140 ms
[24/11/2012-2:11:11 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:11:12 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:11:12 PM] - (Discovery) Retrieval finished in 1,794 ms
[24/11/2012-2:11:15 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:11:15 PM] - (Endeavour) Retrieval finished in 125 ms
[24/11/2012-2:11:18 PM] - (Gemini Slot 00) Slot Status: Running
[24/11/2012-2:11:18 PM] - (Gemini) Retrieval finished in 296 ms
[24/11/2012-2:11:21 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:11:22 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:11:22 PM] - (Enterprise) Retrieval finished in 2,059 ms
[24/11/2012-2:11:39 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:11:39 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:11:39 PM] - (Discovery) Retrieval finished in 1,778 ms
[24/11/2012-2:11:48 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:11:49 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:11:49 PM] - (Enterprise) Retrieval finished in 2,044 ms
[24/11/2012-2:11:58 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:11:59 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:11:59 PM] - (Atlantis) Retrieval finished in 140 ms
[24/11/2012-2:12:18 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:12:19 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:12:19 PM] - (Enterprise) Retrieval finished in 1,981 ms
[24/11/2012-2:12:41 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:12:41 PM] - (Endeavour) Retrieval finished in 109 ms
[24/11/2012-2:12:41 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:12:41 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:12:41 PM] - (Mother) Retrieval finished in 296 ms
[24/11/2012-2:12:42 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:12:43 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:12:43 PM] - (Discovery) Retrieval finished in 1,810 ms
[24/11/2012-2:12:59 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:12:59 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:12:59 PM] - (Atlantis) Retrieval finished in 156 ms
[24/11/2012-2:13:14 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:13:14 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:13:14 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:13:14 PM] - (Atlantis) Retrieval finished in 218 ms
[24/11/2012-2:13:15 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:13:15 PM] - (Enterprise) Retrieval finished in 2,090 ms
[24/11/2012-2:13:46 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:13:47 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:13:47 PM] - (Discovery) Retrieval finished in 1,794 ms
[24/11/2012-2:14:06 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:14:06 PM] - (Endeavour) Retrieval finished in 125 ms
[24/11/2012-2:14:08 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:14:08 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:14:08 PM] - (Atlantis) Retrieval finished in 140 ms
[24/11/2012-2:14:12 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:14:12 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:14:12 PM] - (Enterprise) Retrieval finished in 1,981 ms
[24/11/2012-2:14:14 PM] - (Challenger Slot 01) Slot Status: Running
[24/11/2012-2:14:14 PM] - (Challenger) Retrieval finished in 94 ms
[24/11/2012-2:14:30 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:14:30 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:14:30 PM] - (Mother) Retrieval finished in 374 ms
[24/11/2012-2:14:49 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:14:49 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:14:49 PM] - (Mother) Retrieval finished in 312 ms
[24/11/2012-2:14:50 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:14:50 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:14:50 PM] - (Discovery) Retrieval finished in 1,919 ms
[24/11/2012-2:15:10 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:15:11 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:15:11 PM] - (Enterprise) Retrieval finished in 2,028 ms
[24/11/2012-2:15:12 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:15:12 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:15:12 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:15:31 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:15:31 PM] - (Endeavour) Retrieval finished in 125 ms
[24/11/2012-2:15:40 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:15:41 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:15:41 PM] - (Enterprise) Retrieval finished in 2,090 ms
[24/11/2012-2:15:42 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:15:42 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:15:42 PM] - (Discovery) Retrieval finished in 1,856 ms
[24/11/2012-2:15:57 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:15:58 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:15:58 PM] - (Discovery) Retrieval finished in 1,778 ms
[24/11/2012-2:16:08 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:16:09 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:16:09 PM] - (Enterprise) Retrieval finished in 2,075 ms
[24/11/2012-2:16:16 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:16:16 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:16:16 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:16:20 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:16:20 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:16:20 PM] - (Mother) Retrieval finished in 281 ms
[24/11/2012-2:16:53 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:16:53 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:16:53 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:16:56 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:16:57 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:16:57 PM] - (Endeavour) Retrieval finished in 140 ms
[24/11/2012-2:16:57 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:16:57 PM] - (Discovery) Retrieval finished in 1,841 ms
[24/11/2012-2:17:04 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:17:05 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:17:05 PM] - (Enterprise) Retrieval finished in 2,044 ms
[24/11/2012-2:17:21 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:17:21 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:17:21 PM] - (Atlantis) Retrieval finished in 140 ms
[24/11/2012-2:17:43 PM] - (Apollo13 Slot 00) Slot Status: Running
[24/11/2012-2:17:43 PM] - (Apollo13) Retrieval finished in 94 ms
[24/11/2012-2:17:59 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:18:00 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:18:00 PM] - (Discovery) Retrieval finished in 1,856 ms
[24/11/2012-2:18:01 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:18:02 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:18:02 PM] - (Enterprise) Retrieval finished in 2,075 ms
[24/11/2012-2:18:10 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:18:10 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:18:10 PM] - (Mother) Retrieval finished in 281 ms
[24/11/2012-2:18:22 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:18:22 PM] - (Endeavour) Retrieval finished in 140 ms
[24/11/2012-2:18:25 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:18:25 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:18:25 PM] - (Atlantis) Retrieval finished in 156 ms
[24/11/2012-2:18:56 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:18:57 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:18:57 PM] - (Enterprise) Retrieval finished in 2,075 ms
[24/11/2012-2:19:02 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:19:03 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:19:03 PM] - (Discovery) Retrieval finished in 1,810 ms
[24/11/2012-2:19:30 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:19:30 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:19:30 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:19:47 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:19:47 PM] - (Endeavour) Retrieval finished in 125 ms
[24/11/2012-2:19:53 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:19:54 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:19:54 PM] - (Enterprise) Retrieval finished in 2,012 ms
[24/11/2012-2:19:59 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:19:59 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:19:59 PM] - (Mother) Retrieval finished in 312 ms
[24/11/2012-2:20:05 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:20:06 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:20:06 PM] - (Discovery) Retrieval finished in 1,919 ms
[24/11/2012-2:20:19 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:20:20 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:20:20 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:20:20 PM] - (Mother) Retrieval finished in 343 ms
[24/11/2012-2:20:20 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:20:20 PM] - (Enterprise) Retrieval finished in 2,137 ms
[24/11/2012-2:20:28 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:20:29 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:20:29 PM] - (Discovery) Retrieval finished in 1,888 ms
[24/11/2012-2:20:34 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:20:34 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:20:34 PM] - (Atlantis) Retrieval finished in 156 ms
[24/11/2012-2:20:47 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:20:47 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:20:47 PM] - (Atlantis) Retrieval finished in 156 ms
[24/11/2012-2:20:52 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:20:53 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:20:53 PM] - (Enterprise) Retrieval finished in 2,012 ms
[24/11/2012-2:21:09 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:21:10 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:21:10 PM] - (Discovery) Retrieval finished in 1,841 ms
[24/11/2012-2:21:13 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:21:13 PM] - (Endeavour) Retrieval finished in 109 ms
[24/11/2012-2:21:39 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:21:39 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:21:39 PM] - (Atlantis) Retrieval finished in 156 ms
[24/11/2012-2:21:48 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:21:49 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:21:49 PM] - (Enterprise) Retrieval finished in 2,075 ms
[24/11/2012-2:21:49 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:21:49 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:21:49 PM] - (Mother) Retrieval finished in 312 ms
[24/11/2012-2:22:12 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:22:13 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:22:13 PM] - (Discovery) Retrieval finished in 1,903 ms
[24/11/2012-2:22:38 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:22:38 PM] - (Endeavour) Retrieval finished in 140 ms
[24/11/2012-2:22:43 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:22:43 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:22:43 PM] - (Atlantis) Retrieval finished in 187 ms
[24/11/2012-2:22:44 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:22:45 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:22:45 PM] - (Enterprise) Retrieval finished in 2,168 ms
[24/11/2012-2:23:16 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:23:17 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:23:17 PM] - (Discovery) Retrieval finished in 1,810 ms
[24/11/2012-2:23:39 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:23:39 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:23:39 PM] - (Mother) Retrieval finished in 312 ms
[24/11/2012-2:23:40 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:23:41 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:23:41 PM] - (Enterprise) Retrieval finished in 2,090 ms
[24/11/2012-2:23:47 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:23:47 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:23:47 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:24:03 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:24:03 PM] - (Endeavour) Retrieval finished in 125 ms
[24/11/2012-2:24:08 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:24:09 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:24:09 PM] - (Enterprise) Retrieval finished in 2,059 ms
[24/11/2012-2:24:19 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:24:20 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:24:20 PM] - (Discovery) Retrieval finished in 1,778 ms
[24/11/2012-2:24:38 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:24:39 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:24:39 PM] - (Enterprise) Retrieval finished in 2,106 ms
[24/11/2012-2:24:41 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:24:41 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:24:41 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:24:43 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:24:44 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:24:44 PM] - (Discovery) Retrieval finished in 1,794 ms
[24/11/2012-2:24:52 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:24:52 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:24:52 PM] - (Atlantis) Retrieval finished in 187 ms
[24/11/2012-2:25:12 PM] - (Gemini Slot 00) Slot Status: Running
[24/11/2012-2:25:12 PM] - (Gemini) Retrieval finished in 281 ms
[24/11/2012-2:25:22 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:25:23 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:25:23 PM] - (Discovery) Retrieval finished in 1,841 ms
[24/11/2012-2:25:27 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:25:28 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:25:28 PM] - (Mother) Retrieval finished in 328 ms
[24/11/2012-2:25:29 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:25:29 PM] - (Endeavour) Retrieval finished in 140 ms
[24/11/2012-2:25:34 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:25:35 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:25:35 PM] - (Enterprise) Retrieval finished in 2,044 ms
[24/11/2012-2:25:51 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:25:51 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:25:51 PM] - (Mother) Retrieval finished in 281 ms
[24/11/2012-2:25:56 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:25:56 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:25:56 PM] - (Atlantis) Retrieval finished in 140 ms
[24/11/2012-2:26:25 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:26:26 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:26:26 PM] - (Discovery) Retrieval finished in 1,919 ms
[24/11/2012-2:26:30 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:26:31 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:26:31 PM] - (Enterprise) Retrieval finished in 2,044 ms
[24/11/2012-2:26:53 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:26:53 PM] - (Endeavour) Retrieval finished in 109 ms
[24/11/2012-2:27:01 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:27:01 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:27:01 PM] - (Atlantis) Retrieval finished in 156 ms
[24/11/2012-2:27:17 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:27:17 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:27:17 PM] - (Mother) Retrieval finished in 265 ms
[24/11/2012-2:27:28 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:27:29 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:27:29 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:27:29 PM] - (Enterprise) Retrieval finished in 2,122 ms
[24/11/2012-2:27:29 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:27:29 PM] - (Discovery) Retrieval finished in 1,997 ms
[24/11/2012-2:28:05 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:28:05 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:28:05 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:28:19 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:28:19 PM] - (Endeavour) Retrieval finished in 140 ms
[24/11/2012-2:28:22 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:28:23 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:28:23 PM] - (Enterprise) Retrieval finished in 2,044 ms
[24/11/2012-2:28:32 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:28:33 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:28:33 PM] - (Discovery) Retrieval finished in 1,825 ms
[24/11/2012-2:28:35 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:28:35 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:28:35 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:28:50 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:28:51 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:28:51 PM] - (Enterprise) Retrieval finished in 2,012 ms
[24/11/2012-2:29:06 PM] - (Mother Slot 01) Slot Status: Running
[24/11/2012-2:29:07 PM] - (Mother Slot 00) Slot Status: Running
[24/11/2012-2:29:07 PM] - (Mother) Retrieval finished in 312 ms
[24/11/2012-2:29:10 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:29:10 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:29:10 PM] - (Atlantis) Retrieval finished in 172 ms
[24/11/2012-2:29:14 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:29:15 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:29:15 PM] - (Discovery) Retrieval finished in 1,872 ms
[24/11/2012-2:29:18 PM] - Starting Retrieval Timer Loop: 15 Minutes
[24/11/2012-2:29:21 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:29:22 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:29:22 PM] - (Enterprise) Retrieval finished in 2,106 ms
[24/11/2012-2:29:36 PM] - (Discovery Slot 00) Slot Status: Running
[24/11/2012-2:29:36 PM] - (Discovery Slot 01) Slot Status: Running
[24/11/2012-2:29:36 PM] - (Discovery) Retrieval finished in 1,841 ms
[24/11/2012-2:29:44 PM] - (Endeavour Slot 00) Slot Status: Running
[24/11/2012-2:29:44 PM] - (Endeavour) Retrieval finished in 94 ms
[24/11/2012-2:30:14 PM] - (Atlantis Slot 00) Slot Status: Running
[24/11/2012-2:30:14 PM] - (Atlantis Slot 01) Slot Status: Running
[24/11/2012-2:30:14 PM] - (Atlantis) Retrieval finished in 156 ms
[24/11/2012-2:30:21 PM] - (Enterprise Slot 00) Slot Status: Running
[24/11/2012-2:30:22 PM] - (Enterprise Slot 01) Slot Status: Running
[24/11/2012-2:30:22 PM] - (Enterprise) Retrieval finished in 2,059 ms

I did find a 13 month old post:

For instance, v7 clients can notify an application that the state of the client has changed and the UI can update accordingly.

But it appears to update all clients/slots and they are not all changing every few seconds.

DrBB1 · Post by **DrBB1** » Mon Dec 10, 2012 7:30 pm

harlam357 wrote: Hey DrBB1 - I apologize for all your trouble. I didn't see an error in the log you posted previously... but it wasn't a large chunk of time represented. I encourage you to run the logging on Info in lieu of Debug during normal opperation. Running it on Debug will only result in a much larger log file and generally not yield any further useful information for a user.

I suspect the issue you're seeing with date/time has to do with the update to the SQLite library in conjunction with something that changed in the v7.2.9 client. I just started testing the 7.2.9 client and I have a slow moving WU. Gonna take 24 hours before I can verify the same behavior.

Hey harlam357--

I hope this longer excerpt from the HFM.log helps. It's about the maximum size I could post; even on the "Info" setting, it only covers about 10 hours. Unfortunately, I am pretty clueless about how to interpret it. However, you may want to focus on the times I mention below: I am pretty sure that the Completion Date (and time) entry is accurate based on the FAH log. It appears to be the Download Date (or at least the download time) that's off.

The excerpt includes times when two WUs units completed this morning on Main Slot 01, one at 6:30 AM, the other at 10:44 AM (UTC). [Laptop Slot 00 is cranking on a long WU and did not complete any in the excerpt.] I can see something in the log at these times corresponding to the WU completions, but I do not know whether these entries are related to the problem or whether they are normalentries associated with the completion/commencement of WUs. [BTW, for the WU completed at 10:44 AM, the WU History viewer lists the Download Date time as 11:30 AM. The HFM.log shows nothing at 11:30 AM.] Thanks again for your help.

Code: Select all

[12/10/2012-3:09:33 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-3:09:33 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-3:09:33 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-3:09:33 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-3:09:33 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-3:09:33 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-3:10:06 AM] - Stopping web generation timer loop.
[12/10/2012-3:10:06 AM] - Starting Web Generation...
[12/10/2012-3:10:07 AM] - Total Web Generation Execution Time: 499 ms
[12/10/2012-3:10:07 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-3:20:17 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-3:20:17 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-3:24:33 AM] - Running Retrieval Process...
[12/10/2012-3:24:33 AM] - Stopping retrieval timer loop.
[12/10/2012-3:24:33 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-3:24:33 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-3:24:33 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-3:24:33 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-3:24:33 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-3:24:33 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-3:25:07 AM] - Stopping web generation timer loop.
[12/10/2012-3:25:07 AM] - Starting Web Generation...
[12/10/2012-3:25:07 AM] - Total Web Generation Execution Time: 515 ms
[12/10/2012-3:25:07 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-3:35:31 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-3:35:31 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-3:39:33 AM] - Running Retrieval Process...
[12/10/2012-3:39:33 AM] - Stopping retrieval timer loop.
[12/10/2012-3:39:33 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-3:39:33 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-3:39:33 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-3:39:33 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-3:39:33 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-3:39:33 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-3:40:07 AM] - Stopping web generation timer loop.
[12/10/2012-3:40:07 AM] - Starting Web Generation...
[12/10/2012-3:40:08 AM] - Total Web Generation Execution Time: 515 ms
[12/10/2012-3:40:08 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-3:50:47 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-3:50:47 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-3:54:33 AM] - Running Retrieval Process...
[12/10/2012-3:54:33 AM] - Stopping retrieval timer loop.
[12/10/2012-3:54:33 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-3:54:33 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-3:54:33 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-3:54:33 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-3:54:33 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-3:54:33 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-3:55:08 AM] - Stopping web generation timer loop.
[12/10/2012-3:55:08 AM] - Starting Web Generation...
[12/10/2012-3:55:09 AM] - Total Web Generation Execution Time: 608 ms
[12/10/2012-3:55:09 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-4:06:01 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-4:06:01 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-4:09:33 AM] - Running Retrieval Process...
[12/10/2012-4:09:33 AM] - Stopping retrieval timer loop.
[12/10/2012-4:09:33 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-4:09:33 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-4:09:33 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-4:09:33 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-4:09:33 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-4:09:33 AM] - Total Retrieval Execution Time: 140 ms
[12/10/2012-4:10:09 AM] - Stopping web generation timer loop.
[12/10/2012-4:10:09 AM] - Starting Web Generation...
[12/10/2012-4:10:09 AM] - Total Web Generation Execution Time: 499 ms
[12/10/2012-4:10:09 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-4:20:37 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-4:20:37 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-4:21:21 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-4:21:21 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-4:24:33 AM] - Running Retrieval Process...
[12/10/2012-4:24:33 AM] - Stopping retrieval timer loop.
[12/10/2012-4:24:33 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-4:24:33 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-4:24:33 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-4:24:33 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-4:24:33 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-4:24:33 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-4:25:09 AM] - Stopping web generation timer loop.
[12/10/2012-4:25:09 AM] - Starting Web Generation...
[12/10/2012-4:25:10 AM] - Total Web Generation Execution Time: 468 ms
[12/10/2012-4:25:10 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-4:26:00 AM] - Stopping EOC Stats Timer Loop
[12/10/2012-4:26:00 AM] - EOC Stats Updated in 109 ms
[12/10/2012-4:26:00 AM] - Last EOC Stats Update: 12/10/2012 9:26:00 AM (UTC)
[12/10/2012-4:26:00 AM] - Starting EOC Stats Update Timer Loop: 179 Minutes
[12/10/2012-4:36:37 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-4:36:37 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-4:39:33 AM] - Running Retrieval Process...
[12/10/2012-4:39:33 AM] - Stopping retrieval timer loop.
[12/10/2012-4:39:33 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-4:39:33 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-4:39:33 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-4:39:33 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-4:39:33 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-4:39:33 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-4:40:10 AM] - Stopping web generation timer loop.
[12/10/2012-4:40:10 AM] - Starting Web Generation...
[12/10/2012-4:40:10 AM] - Total Web Generation Execution Time: 546 ms
[12/10/2012-4:40:10 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-4:40:58 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-4:40:58 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-4:51:51 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-4:51:51 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-4:54:33 AM] - Running Retrieval Process...
[12/10/2012-4:54:33 AM] - Stopping retrieval timer loop.
[12/10/2012-4:54:33 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-4:54:33 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-4:54:34 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-4:54:34 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-4:54:34 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-4:54:34 AM] - Total Retrieval Execution Time: 140 ms
[12/10/2012-4:55:10 AM] - Stopping web generation timer loop.
[12/10/2012-4:55:10 AM] - Starting Web Generation...
[12/10/2012-4:55:11 AM] - Total Web Generation Execution Time: 468 ms
[12/10/2012-4:55:11 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-5:02:22 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-5:02:22 AM] - (Main) Retrieval finished in 78 ms
[12/10/2012-5:04:20 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:04:20 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-5:04:20 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:04:20 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-5:04:55 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:04:55 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-5:05:25 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:05:25 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-5:09:34 AM] - Running Retrieval Process...
[12/10/2012-5:09:34 AM] - Stopping retrieval timer loop.
[12/10/2012-5:09:34 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:09:34 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-5:09:36 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-5:09:36 AM] - Total Retrieval Execution Time: 2,200 ms
[12/10/2012-5:09:43 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-5:09:43 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-5:09:43 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-5:09:43 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-5:09:50 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:09:50 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-5:10:11 AM] - Stopping web generation timer loop.
[12/10/2012-5:10:11 AM] - Starting Web Generation...
[12/10/2012-5:10:11 AM] - Total Web Generation Execution Time: 640 ms
[12/10/2012-5:10:11 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-5:24:22 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-5:24:22 AM] - (Main) Retrieval finished in 125 ms
[12/10/2012-5:24:36 AM] - Running Retrieval Process...
[12/10/2012-5:24:36 AM] - Stopping retrieval timer loop.
[12/10/2012-5:24:36 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:24:36 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-5:24:36 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-5:24:36 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-5:24:36 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-5:24:36 AM] - Total Retrieval Execution Time: 140 ms
[12/10/2012-5:25:11 AM] - Stopping web generation timer loop.
[12/10/2012-5:25:11 AM] - Starting Web Generation...
[12/10/2012-5:25:12 AM] - Total Web Generation Execution Time: 499 ms
[12/10/2012-5:25:12 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-5:27:54 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:27:54 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-5:39:36 AM] - Running Retrieval Process...
[12/10/2012-5:39:36 AM] - Stopping retrieval timer loop.
[12/10/2012-5:39:36 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:39:36 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-5:39:36 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-5:39:36 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-5:39:36 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-5:39:36 AM] - Total Retrieval Execution Time: 156 ms
[12/10/2012-5:40:12 AM] - Stopping web generation timer loop.
[12/10/2012-5:40:12 AM] - Starting Web Generation...
[12/10/2012-5:40:12 AM] - Total Web Generation Execution Time: 499 ms
[12/10/2012-5:40:12 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-5:43:43 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:43:43 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-5:47:37 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-5:47:37 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-5:54:36 AM] - Running Retrieval Process...
[12/10/2012-5:54:36 AM] - Stopping retrieval timer loop.
[12/10/2012-5:54:36 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:54:36 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-5:54:36 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-5:54:36 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-5:54:36 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-5:54:36 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-5:55:12 AM] - Stopping web generation timer loop.
[12/10/2012-5:55:12 AM] - Starting Web Generation...
[12/10/2012-5:55:13 AM] - Total Web Generation Execution Time: 484 ms
[12/10/2012-5:55:13 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-5:59:06 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-5:59:06 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-6:09:20 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:09:20 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:09:36 AM] - Running Retrieval Process...
[12/10/2012-6:09:36 AM] - Stopping retrieval timer loop.
[12/10/2012-6:09:36 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-6:09:36 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-6:09:36 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:09:36 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:09:36 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-6:09:36 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-6:10:13 AM] - Stopping web generation timer loop.
[12/10/2012-6:10:13 AM] - Starting Web Generation...
[12/10/2012-6:10:13 AM] - Total Web Generation Execution Time: 484 ms
[12/10/2012-6:10:13 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-6:14:28 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-6:14:28 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-6:24:36 AM] - Running Retrieval Process...
[12/10/2012-6:24:36 AM] - Stopping retrieval timer loop.
[12/10/2012-6:24:36 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-6:24:36 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-6:24:36 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:24:36 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:24:36 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-6:24:36 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-6:25:13 AM] - Stopping web generation timer loop.
[12/10/2012-6:25:13 AM] - Starting Web Generation...
[12/10/2012-6:25:14 AM] - Total Web Generation Execution Time: 515 ms
[12/10/2012-6:25:14 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-6:29:35 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:29:35 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:29:50 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-6:29:50 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-6:29:56 AM] ! (Main Slot 01) Could not find log section for slot 1. Cannot update frame data for this slot.
[12/10/2012-6:29:56 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:29:56 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-6:29:58 AM] ! (Main Slot 01) Could not find log section for slot 1. Cannot update frame data for this slot.
[12/10/2012-6:29:58 AM] - (Main Slot 01) Slot Status: Ready
[12/10/2012-6:29:58 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-6:30:26 AM] ! (Main Slot 01) Could not find log section for slot 1. Cannot update frame data for this slot.
[12/10/2012-6:30:26 AM] - (Main Slot 01) Writing unit to database: P7039 (R0, C184, G8)
[12/10/2012-6:30:26 AM] - (Main Slot 01) Slot Status: Ready
[12/10/2012-6:30:26 AM] - (Main) Retrieval finished in 203 ms
[12/10/2012-6:30:40 AM] ! (Main Slot 01) Could not find log section for slot 1. Cannot update frame data for this slot.
[12/10/2012-6:30:40 AM] - (Main Slot 01) Slot Status: RunningNoFrameTimes
[12/10/2012-6:30:40 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-6:30:56 AM] - (Main Slot 01) Slot Status: RunningNoFrameTimes
[12/10/2012-6:30:56 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:33:18 AM] - (Main Slot 01) Slot Status: RunningNoFrameTimes
[12/10/2012-6:33:18 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:35:50 AM] - (Main Slot 01) Slot Status: RunningNoFrameTimes
[12/10/2012-6:35:50 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:38:21 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:38:21 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:39:36 AM] - Running Retrieval Process...
[12/10/2012-6:39:36 AM] - Stopping retrieval timer loop.
[12/10/2012-6:39:36 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-6:39:36 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-6:39:37 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:39:37 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:39:37 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-6:39:37 AM] - Total Retrieval Execution Time: 203 ms
[12/10/2012-6:40:14 AM] - Stopping web generation timer loop.
[12/10/2012-6:40:14 AM] - Starting Web Generation...
[12/10/2012-6:40:14 AM] - Total Web Generation Execution Time: 468 ms
[12/10/2012-6:40:14 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-6:41:02 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:41:02 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-6:43:34 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:43:34 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:45:28 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-6:45:28 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-6:46:07 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:46:07 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:48:39 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:48:39 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:51:10 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:51:10 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:53:41 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:53:41 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-6:54:37 AM] - Running Retrieval Process...
[12/10/2012-6:54:37 AM] - Stopping retrieval timer loop.
[12/10/2012-6:54:37 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-6:54:37 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-6:54:37 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:54:37 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-6:54:37 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-6:54:37 AM] - Total Retrieval Execution Time: 140 ms
[12/10/2012-6:55:14 AM] - Stopping web generation timer loop.
[12/10/2012-6:55:14 AM] - Starting Web Generation...
[12/10/2012-6:55:15 AM] - Total Web Generation Execution Time: 546 ms
[12/10/2012-6:55:15 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-6:56:13 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:56:13 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-6:58:47 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-6:58:47 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-7:00:52 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-7:00:52 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-7:01:18 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:01:18 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:03:51 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:03:51 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:06:22 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:06:22 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-7:08:53 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:08:53 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:09:37 AM] - Running Retrieval Process...
[12/10/2012-7:09:37 AM] - Stopping retrieval timer loop.
[12/10/2012-7:09:37 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-7:09:37 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-7:09:37 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:09:37 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:09:37 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-7:09:37 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-7:10:15 AM] - Stopping web generation timer loop.
[12/10/2012-7:10:15 AM] - Starting Web Generation...
[12/10/2012-7:10:15 AM] - Total Web Generation Execution Time: 499 ms
[12/10/2012-7:10:15 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-7:11:24 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:11:24 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:13:58 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:13:58 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:16:13 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-7:16:13 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-7:16:29 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:16:29 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:19:01 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:19:01 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:21:32 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:21:32 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-7:24:05 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:24:05 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-7:24:37 AM] - Running Retrieval Process...
[12/10/2012-7:24:37 AM] - Stopping retrieval timer loop.
[12/10/2012-7:24:37 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-7:24:37 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-7:24:37 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:24:37 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-7:24:37 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-7:24:37 AM] - Total Retrieval Execution Time: 140 ms
[12/10/2012-7:25:00 AM] - Stopping EOC Stats Timer Loop
[12/10/2012-7:25:00 AM] - EOC Stats Updated in 281 ms
[12/10/2012-7:25:00 AM] - Last EOC Stats Update: 12/10/2012 12:25:00 PM (UTC)
[12/10/2012-7:25:00 AM] - Starting EOC Stats Update Timer Loop: 180 Minutes
[12/10/2012-7:25:15 AM] - Stopping web generation timer loop.
[12/10/2012-7:25:15 AM] - Starting Web Generation...
[12/10/2012-7:25:16 AM] - Total Web Generation Execution Time: 499 ms
[12/10/2012-7:25:16 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-7:26:36 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:26:36 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-7:29:07 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:29:07 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-7:31:37 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-7:31:37 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-7:31:39 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:31:39 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:34:11 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:34:11 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:36:42 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:36:42 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-7:39:13 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:39:13 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:39:37 AM] - Running Retrieval Process...
[12/10/2012-7:39:37 AM] - Stopping retrieval timer loop.
[12/10/2012-7:39:37 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-7:39:37 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-7:39:37 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:39:37 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:39:37 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-7:39:37 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-7:40:16 AM] - Stopping web generation timer loop.
[12/10/2012-7:40:16 AM] - Starting Web Generation...
[12/10/2012-7:40:16 AM] - Total Web Generation Execution Time: 515 ms
[12/10/2012-7:40:16 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-7:41:44 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:41:44 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-7:44:16 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:44:16 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-7:46:48 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:46:48 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:47:01 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-7:47:01 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-7:49:19 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:49:19 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-7:51:50 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:51:50 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:54:22 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:54:22 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:54:37 AM] - Running Retrieval Process...
[12/10/2012-7:54:37 AM] - Stopping retrieval timer loop.
[12/10/2012-7:54:37 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-7:54:37 AM] - (Laptop) Retrieval finished in 16 ms
[12/10/2012-7:54:37 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:54:37 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:54:37 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-7:54:37 AM] - Total Retrieval Execution Time: 125 ms
[12/10/2012-7:55:16 AM] - Stopping web generation timer loop.
[12/10/2012-7:55:16 AM] - Starting Web Generation...
[12/10/2012-7:55:17 AM] - Total Web Generation Execution Time: 484 ms
[12/10/2012-7:55:17 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-7:56:53 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:56:53 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-7:59:26 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-7:59:26 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-8:01:58 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:01:58 AM] - (Main) Retrieval finished in 78 ms
[12/10/2012-8:04:30 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:04:30 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-8:05:28 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-8:05:28 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-8:07:14 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:07:14 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-8:09:37 AM] - Running Retrieval Process...
[12/10/2012-8:09:37 AM] - Stopping retrieval timer loop.
[12/10/2012-8:09:37 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-8:09:37 AM] - (Laptop) Retrieval finished in 31 ms
[12/10/2012-8:09:37 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:09:37 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-8:09:38 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-8:09:38 AM] - Total Retrieval Execution Time: 172 ms
[12/10/2012-8:09:45 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:09:45 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-8:10:17 AM] - Stopping web generation timer loop.
[12/10/2012-8:10:17 AM] - Starting Web Generation...
[12/10/2012-8:10:17 AM] - Total Web Generation Execution Time: 577 ms
[12/10/2012-8:10:17 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-8:12:16 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:12:16 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-8:14:49 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:14:49 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-8:17:21 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:17:21 AM] - (Main) Retrieval finished in 47 ms
[12/10/2012-8:19:52 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:19:52 AM] - (Main) Retrieval finished in 62 ms
[12/10/2012-8:22:23 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:22:23 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-8:22:42 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-8:22:42 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-8:24:38 AM] - Running Retrieval Process...
[12/10/2012-8:24:38 AM] - Stopping retrieval timer loop.
[12/10/2012-8:24:38 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-8:24:38 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-8:24:38 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:24:38 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-8:24:38 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-8:24:38 AM] - Total Retrieval Execution Time: 150 ms
[12/10/2012-8:24:57 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:24:57 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-8:25:17 AM] - Stopping web generation timer loop.
[12/10/2012-8:25:17 AM] - Starting Web Generation...
[12/10/2012-8:25:18 AM] - Total Web Generation Execution Time: 540 ms
[12/10/2012-8:25:18 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-8:27:29 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:27:29 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-8:30:01 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:30:01 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-8:32:34 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:32:34 AM] - (Main) Retrieval finished in 1,700 ms
[12/10/2012-8:35:05 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:35:05 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-8:37:36 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:37:36 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-8:39:38 AM] - Running Retrieval Process...
[12/10/2012-8:39:38 AM] - Stopping retrieval timer loop.
[12/10/2012-8:39:38 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-8:39:38 AM] - (Laptop) Retrieval finished in 20 ms
[12/10/2012-8:39:38 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:39:38 AM] - (Main) Retrieval finished in 70 ms
[12/10/2012-8:39:38 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-8:39:38 AM] - Total Retrieval Execution Time: 160 ms
[12/10/2012-8:40:06 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:40:06 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-8:40:18 AM] - Stopping web generation timer loop.
[12/10/2012-8:40:18 AM] - Starting Web Generation...
[12/10/2012-8:40:18 AM] - Total Web Generation Execution Time: 590 ms
[12/10/2012-8:40:18 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-8:41:31 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-8:41:31 AM] - (Laptop) Retrieval finished in 50 ms
[12/10/2012-8:42:38 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:42:38 AM] - (Main) Retrieval finished in 70 ms
[12/10/2012-8:45:10 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:45:10 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-8:47:41 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:47:41 AM] - (Main) Retrieval finished in 90 ms
[12/10/2012-8:50:12 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:50:12 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-8:52:43 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:52:43 AM] - (Main) Retrieval finished in 120 ms
[12/10/2012-8:54:39 AM] - Running Retrieval Process...
[12/10/2012-8:54:39 AM] - Stopping retrieval timer loop.
[12/10/2012-8:54:39 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-8:54:39 AM] - (Laptop) Retrieval finished in 20 ms
[12/10/2012-8:54:39 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:54:39 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-8:54:39 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-8:54:39 AM] - Total Retrieval Execution Time: 140 ms
[12/10/2012-8:55:15 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:55:15 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-8:55:18 AM] - Stopping web generation timer loop.
[12/10/2012-8:55:18 AM] - Starting Web Generation...
[12/10/2012-8:55:19 AM] - Total Web Generation Execution Time: 570 ms
[12/10/2012-8:55:19 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-8:57:46 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-8:57:46 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:00:18 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:00:18 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:00:20 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-9:00:20 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-9:02:50 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:02:50 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:05:22 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:05:22 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-9:07:53 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:07:53 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-9:09:39 AM] - Running Retrieval Process...
[12/10/2012-9:09:39 AM] - Stopping retrieval timer loop.
[12/10/2012-9:09:39 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-9:09:39 AM] - (Laptop) Retrieval finished in 20 ms
[12/10/2012-9:09:39 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:09:39 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-9:09:39 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-9:09:39 AM] - Total Retrieval Execution Time: 150 ms
[12/10/2012-9:10:20 AM] - Stopping web generation timer loop.
[12/10/2012-9:10:20 AM] - Starting Web Generation...
[12/10/2012-9:10:21 AM] - Total Web Generation Execution Time: 590 ms
[12/10/2012-9:10:21 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-9:10:24 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:10:24 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:12:55 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:12:55 AM] - (Main) Retrieval finished in 150 ms
[12/10/2012-9:15:28 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:15:28 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:17:59 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:17:59 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:18:57 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-9:18:57 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-9:20:31 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:20:31 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-9:23:02 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:23:02 AM] - (Main) Retrieval finished in 80 ms
[12/10/2012-9:24:41 AM] - Running Retrieval Process...
[12/10/2012-9:24:41 AM] - Stopping retrieval timer loop.
[12/10/2012-9:24:41 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-9:24:41 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-9:24:41 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:24:41 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:24:41 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-9:24:41 AM] - Total Retrieval Execution Time: 800 ms
[12/10/2012-9:25:21 AM] - Stopping web generation timer loop.
[12/10/2012-9:25:21 AM] - Starting Web Generation...
[12/10/2012-9:25:21 AM] - Total Web Generation Execution Time: 550 ms
[12/10/2012-9:25:21 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-9:25:35 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:25:35 AM] - (Main) Retrieval finished in 90 ms
[12/10/2012-9:28:09 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:28:09 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-9:30:40 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:30:40 AM] - (Main) Retrieval finished in 410 ms
[12/10/2012-9:33:11 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:33:11 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:35:43 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:35:43 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:38:13 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:38:13 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:38:58 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-9:38:58 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-9:39:41 AM] - Running Retrieval Process...
[12/10/2012-9:39:41 AM] - Stopping retrieval timer loop.
[12/10/2012-9:39:41 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-9:39:41 AM] - (Laptop) Retrieval finished in 20 ms
[12/10/2012-9:39:42 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:39:42 AM] - (Main) Retrieval finished in 40 ms
[12/10/2012-9:39:42 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-9:39:42 AM] - Total Retrieval Execution Time: 140 ms
[12/10/2012-9:40:23 AM] - Stopping web generation timer loop.
[12/10/2012-9:40:23 AM] - Starting Web Generation...
[12/10/2012-9:40:24 AM] - Total Web Generation Execution Time: 900 ms
[12/10/2012-9:40:24 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-9:40:44 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:40:44 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:43:15 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:43:15 AM] - (Main) Retrieval finished in 56 ms
[12/10/2012-9:45:47 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:45:47 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:48:18 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:48:18 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:50:49 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:50:49 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-9:53:20 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:53:20 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:54:42 AM] - Running Retrieval Process...
[12/10/2012-9:54:42 AM] - Stopping retrieval timer loop.
[12/10/2012-9:54:42 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-9:54:42 AM] - (Laptop) Retrieval finished in 20 ms
[12/10/2012-9:54:42 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:54:42 AM] - (Main) Retrieval finished in 70 ms
[12/10/2012-9:54:42 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-9:54:42 AM] - Total Retrieval Execution Time: 260 ms
[12/10/2012-9:55:24 AM] - Stopping web generation timer loop.
[12/10/2012-9:55:24 AM] - Starting Web Generation...
[12/10/2012-9:55:25 AM] - Total Web Generation Execution Time: 570 ms
[12/10/2012-9:55:25 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-9:55:51 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:55:51 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:58:23 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-9:58:23 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-9:58:47 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-9:58:47 AM] - (Laptop) Retrieval finished in 40 ms
[12/10/2012-10:00:56 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:00:56 AM] - (Main) Retrieval finished in 70 ms
[12/10/2012-10:03:26 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:03:26 AM] - (Main) Retrieval finished in 70 ms
[12/10/2012-10:05:58 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:05:58 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-10:08:29 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:08:29 AM] - (Main) Retrieval finished in 70 ms
[12/10/2012-10:09:42 AM] - Running Retrieval Process...
[12/10/2012-10:09:42 AM] - Stopping retrieval timer loop.
[12/10/2012-10:09:42 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-10:09:42 AM] - (Laptop) Retrieval finished in 20 ms
[12/10/2012-10:09:42 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:09:42 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-10:09:42 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-10:09:42 AM] - Total Retrieval Execution Time: 130 ms
[12/10/2012-10:10:25 AM] - Stopping web generation timer loop.
[12/10/2012-10:10:25 AM] - Starting Web Generation...
[12/10/2012-10:10:26 AM] - Total Web Generation Execution Time: 760 ms
[12/10/2012-10:10:26 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-10:11:00 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:11:00 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:13:31 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:13:31 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:16:03 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:16:03 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:18:35 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:18:35 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:18:44 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-10:18:44 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-10:21:06 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:21:06 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:23:38 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:23:38 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:24:42 AM] - Running Retrieval Process...
[12/10/2012-10:24:42 AM] - Stopping retrieval timer loop.
[12/10/2012-10:24:42 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-10:24:42 AM] - (Laptop) Retrieval finished in 20 ms
[12/10/2012-10:24:42 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:24:42 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:24:42 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-10:24:42 AM] - Total Retrieval Execution Time: 140 ms
[12/10/2012-10:25:00 AM] - Stopping EOC Stats Timer Loop
[12/10/2012-10:25:00 AM] - EOC Stats Updated in 250 ms
[12/10/2012-10:25:00 AM] - Last EOC Stats Update: 12/10/2012 3:25:00 PM (UTC)
[12/10/2012-10:25:00 AM] - Starting EOC Stats Update Timer Loop: 180 Minutes
[12/10/2012-10:25:26 AM] - Stopping web generation timer loop.
[12/10/2012-10:25:26 AM] - Starting Web Generation...
[12/10/2012-10:25:26 AM] - Total Web Generation Execution Time: 530 ms
[12/10/2012-10:25:26 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-10:26:10 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:26:10 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:28:43 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:28:43 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:31:14 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:31:14 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:33:46 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:33:46 AM] - (Main) Retrieval finished in 610 ms
[12/10/2012-10:36:17 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:36:17 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:36:56 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-10:36:56 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-10:38:48 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:38:48 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:39:42 AM] - Running Retrieval Process...
[12/10/2012-10:39:42 AM] - Stopping retrieval timer loop.
[12/10/2012-10:39:42 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-10:39:42 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-10:39:42 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:39:42 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-10:39:42 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-10:39:42 AM] - Total Retrieval Execution Time: 150 ms
[12/10/2012-10:40:26 AM] - Stopping web generation timer loop.
[12/10/2012-10:40:26 AM] - Starting Web Generation...
[12/10/2012-10:40:27 AM] - Total Web Generation Execution Time: 790 ms
[12/10/2012-10:40:27 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-10:41:19 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:41:19 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:41:35 AM] ! (Main Slot 01) Could not find log section for slot 1. Cannot update frame data for this slot.
[12/10/2012-10:41:35 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:41:35 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:43:53 AM] ! (Main Slot 01) Could not find log section for slot 1. Cannot update frame data for this slot.
[12/10/2012-10:43:53 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:43:53 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:44:06 AM] ! (Main Slot 01) Could not find log section for slot 1. Cannot update frame data for this slot.
[12/10/2012-10:44:06 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-10:44:06 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:44:36 AM] - (Main Slot 01) Writing unit to database: P8027 (R658, C0, G27)
[12/10/2012-10:44:36 AM] - (Main Slot 01) Slot Status: RunningNoFrameTimes
[12/10/2012-10:44:36 AM] - (Main) Retrieval finished in 180 ms
[12/10/2012-10:49:41 AM] - (Main Slot 01) Slot Status: RunningNoFrameTimes
[12/10/2012-10:49:41 AM] - (Main) Retrieval finished in 70 ms
[12/10/2012-10:54:42 AM] - Running Retrieval Process...
[12/10/2012-10:54:42 AM] - Stopping retrieval timer loop.
[12/10/2012-10:54:42 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-10:54:42 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-10:54:42 AM] - (Main Slot 01) Slot Status: RunningNoFrameTimes
[12/10/2012-10:54:42 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-10:54:42 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-10:54:42 AM] - Total Retrieval Execution Time: 150 ms
[12/10/2012-10:55:06 AM] - (Main Slot 01) Slot Status: RunningNoFrameTimes
[12/10/2012-10:55:06 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-10:55:27 AM] - Stopping web generation timer loop.
[12/10/2012-10:55:27 AM] - Starting Web Generation...
[12/10/2012-10:55:28 AM] - Total Web Generation Execution Time: 580 ms
[12/10/2012-10:55:28 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-10:56:09 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-10:56:09 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-11:00:31 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:00:31 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-11:05:57 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:05:57 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-11:09:42 AM] - Running Retrieval Process...
[12/10/2012-11:09:42 AM] - Stopping retrieval timer loop.
[12/10/2012-11:09:42 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-11:09:42 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-11:09:43 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:09:43 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-11:09:43 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-11:09:43 AM] - Total Retrieval Execution Time: 140 ms
[12/10/2012-11:10:28 AM] - Stopping web generation timer loop.
[12/10/2012-11:10:28 AM] - Starting Web Generation...
[12/10/2012-11:10:29 AM] - Total Web Generation Execution Time: 950 ms
[12/10/2012-11:10:29 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-11:11:20 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:11:20 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-11:15:12 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-11:15:12 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-11:16:47 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:16:47 AM] - (Main) Retrieval finished in 790 ms
[12/10/2012-11:22:09 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:22:09 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-11:24:43 AM] - Running Retrieval Process...
[12/10/2012-11:24:43 AM] - Stopping retrieval timer loop.
[12/10/2012-11:24:43 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-11:24:43 AM] - (Laptop) Retrieval finished in 60 ms
[12/10/2012-11:24:43 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:24:43 AM] - (Main) Retrieval finished in 70 ms
[12/10/2012-11:24:43 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-11:24:43 AM] - Total Retrieval Execution Time: 250 ms
[12/10/2012-11:25:29 AM] - Stopping web generation timer loop.
[12/10/2012-11:25:29 AM] - Starting Web Generation...
[12/10/2012-11:25:29 AM] - Total Web Generation Execution Time: 580 ms
[12/10/2012-11:25:29 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-11:27:36 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:27:36 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-11:33:01 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:33:01 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-11:33:40 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-11:33:40 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-11:38:26 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:38:26 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-11:39:43 AM] - Running Retrieval Process...
[12/10/2012-11:39:43 AM] - Stopping retrieval timer loop.
[12/10/2012-11:39:43 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-11:39:43 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-11:39:43 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:39:43 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-11:39:43 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-11:39:43 AM] - Total Retrieval Execution Time: 170 ms
[12/10/2012-11:40:30 AM] - Stopping web generation timer loop.
[12/10/2012-11:40:30 AM] - Starting Web Generation...
[12/10/2012-11:40:31 AM] - Total Web Generation Execution Time: 530 ms
[12/10/2012-11:40:31 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-11:43:50 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:43:50 AM] - (Main) Retrieval finished in 80 ms
[12/10/2012-11:49:16 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:49:16 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-11:53:39 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-11:53:39 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-11:54:40 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:54:40 AM] - (Main) Retrieval finished in 50 ms
[12/10/2012-11:54:43 AM] - Running Retrieval Process...
[12/10/2012-11:54:43 AM] - Stopping retrieval timer loop.
[12/10/2012-11:54:43 AM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-11:54:43 AM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-11:54:43 AM] - (Main Slot 01) Slot Status: Running
[12/10/2012-11:54:43 AM] - (Main) Retrieval finished in 60 ms
[12/10/2012-11:54:43 AM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-11:54:43 AM] - Total Retrieval Execution Time: 160 ms
[12/10/2012-11:55:35 AM] - Stopping web generation timer loop.
[12/10/2012-11:55:35 AM] - Starting Web Generation...
[12/10/2012-11:55:36 AM] - Total Web Generation Execution Time: 680 ms
[12/10/2012-11:55:36 AM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-12:00:14 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:00:14 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-12:05:39 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:05:39 PM] - (Main) Retrieval finished in 70 ms
[12/10/2012-12:09:43 PM] - Running Retrieval Process...
[12/10/2012-12:09:43 PM] - Stopping retrieval timer loop.
[12/10/2012-12:09:43 PM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-12:09:43 PM] - (Laptop) Retrieval finished in 20 ms
[12/10/2012-12:09:43 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:09:43 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-12:09:43 PM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-12:09:43 PM] - Total Retrieval Execution Time: 200 ms
[12/10/2012-12:10:36 PM] - Stopping web generation timer loop.
[12/10/2012-12:10:36 PM] - Starting Web Generation...
[12/10/2012-12:10:37 PM] - Total Web Generation Execution Time: 490 ms
[12/10/2012-12:10:37 PM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-12:11:03 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:11:03 PM] - (Main) Retrieval finished in 70 ms
[12/10/2012-12:14:54 PM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-12:14:54 PM] - (Laptop) Retrieval finished in 40 ms
[12/10/2012-12:16:29 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:16:29 PM] - (Main) Retrieval finished in 50 ms
[12/10/2012-12:21:53 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:21:53 PM] - (Main) Retrieval finished in 70 ms
[12/10/2012-12:24:43 PM] - Running Retrieval Process...
[12/10/2012-12:24:43 PM] - Stopping retrieval timer loop.
[12/10/2012-12:24:43 PM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-12:24:43 PM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-12:24:43 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:24:43 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-12:24:44 PM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-12:24:44 PM] - Total Retrieval Execution Time: 190 ms
[12/10/2012-12:25:37 PM] - Stopping web generation timer loop.
[12/10/2012-12:25:37 PM] - Starting Web Generation...
[12/10/2012-12:25:37 PM] - Total Web Generation Execution Time: 510 ms
[12/10/2012-12:25:37 PM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-12:27:19 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:27:19 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-12:32:06 PM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-12:32:06 PM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-12:32:43 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:32:43 PM] - (Main) Retrieval finished in 50 ms
[12/10/2012-12:38:08 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:38:08 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-12:39:44 PM] - Running Retrieval Process...
[12/10/2012-12:39:44 PM] - Stopping retrieval timer loop.
[12/10/2012-12:39:44 PM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-12:39:44 PM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-12:39:44 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:39:44 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-12:39:44 PM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-12:39:44 PM] - Total Retrieval Execution Time: 200 ms
[12/10/2012-12:40:37 PM] - Stopping web generation timer loop.
[12/10/2012-12:40:37 PM] - Starting Web Generation...
[12/10/2012-12:40:38 PM] - Total Web Generation Execution Time: 550 ms
[12/10/2012-12:40:38 PM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-12:43:32 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:43:32 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-12:48:58 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:48:58 PM] - (Main) Retrieval finished in 50 ms
[12/10/2012-12:49:50 PM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-12:49:50 PM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-12:54:21 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:54:21 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-12:54:45 PM] - Running Retrieval Process...
[12/10/2012-12:54:45 PM] - Stopping retrieval timer loop.
[12/10/2012-12:54:45 PM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-12:54:45 PM] - (Laptop) Retrieval finished in 20 ms
[12/10/2012-12:54:45 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:54:45 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-12:54:45 PM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-12:54:45 PM] - Total Retrieval Execution Time: 230 ms
[12/10/2012-12:55:38 PM] - Stopping web generation timer loop.
[12/10/2012-12:55:38 PM] - Starting Web Generation...
[12/10/2012-12:55:38 PM] - Total Web Generation Execution Time: 580 ms
[12/10/2012-12:55:38 PM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-12:59:50 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-12:59:50 PM] - (Main) Retrieval finished in 70 ms
[12/10/2012-1:05:16 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-1:05:16 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-1:09:47 PM] - Running Retrieval Process...
[12/10/2012-1:09:47 PM] - Stopping retrieval timer loop.
[12/10/2012-1:09:47 PM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-1:09:47 PM] - (Laptop) Retrieval finished in 720 ms
[12/10/2012-1:09:48 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-1:09:48 PM] - (Main) Retrieval finished in 670 ms
[12/10/2012-1:09:49 PM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-1:09:49 PM] - Total Retrieval Execution Time: 1,820 ms
[12/10/2012-1:10:38 PM] - Stopping web generation timer loop.
[12/10/2012-1:10:38 PM] - Starting Web Generation...
[12/10/2012-1:10:39 PM] - Total Web Generation Execution Time: 530 ms
[12/10/2012-1:10:39 PM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-1:10:39 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-1:10:39 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-1:11:03 PM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-1:11:03 PM] - (Laptop) Retrieval finished in 50 ms
[12/10/2012-1:16:08 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-1:16:08 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-1:21:32 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-1:21:32 PM] - (Main) Retrieval finished in 110 ms
[12/10/2012-1:24:49 PM] - Running Retrieval Process...
[12/10/2012-1:24:49 PM] - Stopping retrieval timer loop.
[12/10/2012-1:24:49 PM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-1:24:49 PM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-1:24:49 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-1:24:49 PM] - (Main) Retrieval finished in 60 ms
[12/10/2012-1:24:49 PM] - Starting Retrieval Timer Loop: 15 Minutes
[12/10/2012-1:24:49 PM] - Total Retrieval Execution Time: 200 ms
[12/10/2012-1:25:00 PM] - Stopping EOC Stats Timer Loop
[12/10/2012-1:25:00 PM] - EOC Stats Updated in 660 ms
[12/10/2012-1:25:00 PM] - Last EOC Stats Update: 12/10/2012 6:25:00 PM (UTC)
[12/10/2012-1:25:00 PM] - Starting EOC Stats Update Timer Loop: 180 Minutes
[12/10/2012-1:25:39 PM] - Stopping web generation timer loop.
[12/10/2012-1:25:39 PM] - Starting Web Generation...
[12/10/2012-1:25:40 PM] - Total Web Generation Execution Time: 710 ms
[12/10/2012-1:25:40 PM] - Starting Web Generation Timer Loop: 15 Minutes
[12/10/2012-1:26:58 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-1:26:58 PM] - (Main) Retrieval finished in 150 ms
[12/10/2012-1:32:17 PM] - (Laptop Slot 00) Slot Status: Running
[12/10/2012-1:32:17 PM] - (Laptop) Retrieval finished in 30 ms
[12/10/2012-1:32:22 PM] - (Main Slot 01) Slot Status: Running
[12/10/2012-1:32:22 PM] - (Main) Retrieval finished in 60 ms

PinHead · Post by **PinHead** » Wed Dec 12, 2012 2:51 am

Now that these WU are in advanced, I am seeing several false fails in HFM.NET on the 807x series of GPU WU. The database shows zero for results <> 1 for the 807x series, so I am not sure why the HFM main screen is reporting 4 failed.

What should I look for in the logs, because I am not seeing it in the WuHistory.db3 database?

Post by **bruce** » Wed Dec 12, 2012 3:40 am

I'd look in FAH's logs.

I did find one, but I can't tell if there were others or not. (Our search tools are limited.)

Hi PinHead (team 4),
Your WU (P8074 R45 C5 G8) was added to the stats database on 2012-12-09 21:08:42 for 0 points of credit.

PinHead · Post by **PinHead** » Wed Dec 12, 2012 5:15 am

Hi Bruce,

Thanks for the effort and the info. The FAH logs show no sign of failure and the HFM.NET database shows no sign of failure. But the HFM client reports 4 failed units on 8074 and 1 failed unit on 8073.
This is why I called them false fails. Just not sure what is triggering them in HFM.NET 0.9.1.

Post by **bruce** » Wed Dec 12, 2012 5:33 am

Did you find the specific log that covered a few hours before 2012-12-09 13:08:42 UTC (aka 21:08:42 PST)?

P5-133XL · Post by **P5-133XL** » Wed Dec 12, 2012 6:02 am

Do you pause v7? HFM.net when it examines the folding logs it counts pauses as failures when they obviously are not.

rhavern · Post by **rhavern** » Wed Dec 12, 2012 12:40 pm

HFM also counts core upgrades as failed WU, I've already let the author know some weeks ago.

Folding Forum

HFM.NET - Monitoring Application for Folding@Home v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7

Re: HFM.NET - Monitoring Application for Folding@Home v6/v7