Update server? [stats down - fixed]

[billford]

Not sure if this is the right section, but is there a problem with the update server?

Posting at about 20:22 UTC, my stats page says:

Last updated: Wed Sep 18 09:00:12 PDT 2013
Wed Sep 18 16:00:12 UTC 2013

and my latest uploaded WU (about an hour ago) isn't showing.


edit- and the Donor Stats page says:

Last updated: Thursday September 19, 2013


That's tomorrow!!!!

[7im]

After checking the Donor and Team stats pages, and the Summary files, the dates and times there are all correct. The date on the title page is a cosmetic issue, and PG has been contacted to correct it.

If you are concerned about a particular work unit, make sure you have waited for the work server to process the credit and send it to the status servers. Then an appropriate amount of time for the stats update to run. Waiting about an hour is not waiting long enough. If another hour passes and no credit, then please post the WU PRCG info for a Mod to check.

[billford]

Waiting about an hour is not waiting long enough.

OK… I've always found that provided I get the server ACK before the hour then the results are available less than 15 minutes after… maybe I've just been lucky so far!

If you are concerned about a particular work unit, make sure you have waited for the work server to process the credit and send it to the status servers. Then an appropriate amount of time for the stats update to run. Waiting about an hour is not waiting long enough. If another hour passes and no credit, then please post the WU PRCG info for a Mod to check.

It's not that I'm bothered specifically about one particular WU, just that my stats haven't updated… there should now have been three update runs since the upload (at 20:00, 21:00 and 22:00), still no update and no change in the "Last Update" time.

Log extract:

10:32:27:WU01:FS00:0xa4:Project: 6361 (Run 5, Clone 35, Gen 19)
.
.
19:25:45:WU01:FS00:Upload complete
19:25:45:WU01:FS00:Server responded WORK_ACK (400)

Another machine also uploaded WU 6361(1,73,15) at 21:11, normally I'd have expected that to show shortly after 22:00 but it isn't, though I'll accept your comments about waiting long enough to be sure.

I can infer from what you are saying that the "Last Update" timestamp is only meaningful if the run included one of my WUs, otherwise it's the time of the last run that did. If that makes sense!

Is that how it works?

I'm off to bed now (I'm on UTC+1), I'll report back in the morning.

[7im]

...

OK… I've always found that provided I get the server ACK before the hour then the results are available less than 15 minutes after… maybe I've just been lucky so far!

Until now. While that is typical, one cannot live by it. It's not guaranteed, and one update may slip in to the next if they are doing maintenance or whatever.

I'll follow up to see of that's what happened. Thanks for catching the glitch.

[PantherX]

So far, nothing is in the database for Project: 6361 (Run 5, Clone 35, Gen 19) so I have marked it for a follow-up.

Edit my Mod: WU found. Followup closed.

Hi lbford (team 0),
Your WU (P6361 R5 C35 G19) was added to the stats database on 2013-09-19 13:41:06 for 819.999 points of credit.

[bruce]

As 7im says, the date problem has been reported. Unfortunately I think the problem is bigger than just the date being tomorrow. The old stats page reported a date AND A TIME and if it was older than the top of the previous hour, there was a pretty good chance that one of the stats processes needed to be restarted. (All the stats eventually came through.) Without the time-stamp, I can't tell how old they are.

As a Moderation, I can, however, look up Project: 6361 (Run 1, Clone 73, Gen 15) and see that the credit has not yet been processed, confirming that SOMETHING is wrong with the stats processing cycle.

BTW: it's not 22:00 yet. (It's meaningless unless you specify what timezone you're in, which you did later.) While the logs are timestamped in UTC, Stanford servers run on PST/PDT and Donors are scattered all over the globe.

[billford]

BTW: it's not 22:00 yet. (It's meaningless unless you specify what timezone you're in, which you did later.) While the logs are timestamped in UTC, Stanford servers run on PST/PDT and Donors are scattered all over the globe.

Sorry, I should have said- I'm aware of your timezone problems and always give times in UTC.


(The incoming reply notification caught me just as I was getting out of the chair to go to bed!)

[bollix47]

The past two updates are missing on both EOC and kakao so something is up with the stats system.

Hopefully, 7im's followup will result in the needed 'boot'.

[folding_hoomer]

These updates are also missing in the folding@home server stats.

[bollix47]

PG is aware of the problem and are investigating. As always, there's no ETA until they determine the cause and effect.

[schwancr]

We've identified the problem and are working on the fix. It may take some time though (a few hours).

-Christian

[billford]

It may take some time though (a few hours).

We'll survive

Thanks for the update. I assume there'll be something of a backlog so it may take a while to catch up?

[schwancr]

We are repairing some of the mysql tables, which is taking some time. The stats system should be back up sometime tomorrow morning though.

Sorry for the delay,
Christian

[billford]

These things happen, thanks.

The thought occurred to me that it's going to royally screw up some people's PPD calculations for a while

[-alias-]

It is a fact yes, I am now missing about 2 million points that I hope Stanford has control over. And my stats gets a serious blow downhill, that takes days to straighten up again. The consolation will be that this applies to all donors.