Is it just me or are the Stats not updating?[Nov 12 problem]

Moderators: Site Moderators, FAHC Science Team

Locked
TheWolf
Posts: 288
Joined: Thu Jan 24, 2008 10:34 am

Re: Is it just me or are the Stats not updating?

Post by TheWolf »

I was hoping to see a few more of my lost work units show up today, like yesterday.
Didn't happen.... looks like I got about 15% of what's missing from the down time.
Maybe tomorrow will bring a few more xx%.
Actually I was shown a little short today, norm is 50k to 53K, only 47k the past 24hrs.
Mactin
Posts: 222
Joined: Sun Dec 02, 2007 1:08 pm
Location: Côte-des-Neiges, Montréal, Québec

Re: Is it just me or are the Stats not updating?

Post by Mactin »

It would be nice if PG kept the community better informed.
Image
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Is it just me or are the Stats not updating?

Post by 7im »

What parts of their statements in the News was not clear?

Nov 12 : http://folding.typepad.com/news/2009/11 ... on-it.html

Nov 23: http://folding.typepad.com/news/2009/11 ... gress.html
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
noorman
Posts: 270
Joined: Sun Dec 02, 2007 2:26 pm
Hardware configuration: Folders: Intel C2D E6550 @ 3.150 GHz + GPU XFX 9800GTX+ @ 765 MHZ w. WinXP-GPU
AMD A2X64 3800+ @ stock + GPU XFX 9800GTX+ @ 775 MHZ w. WinXP-GPU
Main rig: an old Athlon Barton 2500+ @2.25 GHz & 2* 512 MB RAM Apacer, Radeon 9800Pro, WinXP SP3+
Location: Belgium, near the International Sea-Port of Antwerp

Re: Is it just me or are the Stats not updating?

Post by noorman »

.

It 's about the fact that the update of 23 Nov. doesn't seem to be the 'whole lot'; many have seen a partial update (as did I).

We 're just wondering when the 'rest' is coming. I saw missing data on 2 following days; I guess that they did a correction for the one day and are working on the second day's data now ...


.
- stopped Linux SMP w. HT on i7-860@3.5 GHz
....................................
Folded since 10-06-04 till 09-2010
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: Is it just me or are the Stats not updating?

Post by Grandpa_01 »

I dont think it was not being clear part at all. The statement was a bit vague would it have been that hard to say we have a certain % done and you can expect to see more by ???. PG has a bit of a problem about being vague with ther statements. I have yet to even seen it mentioned where there still may be a problem with the stats server. Yet several people have mentioned including myself that their daily production WU / Point count seems to be coming up short. So is PG getting all of the WU's that I am completeing (I don't know ) but it does't appear to be. :eo
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Is it just me or are the Stats not updating?

Post by 7im »

The data wasn't lost, it's just a matter of time to run through all the data and recredit the points. Remember, this is a manual process, not a computer process. That means a human sits down at a terminal and does the work. And the bigger the project gets, the longer these things take.

And sometimes it's easier to be vague than to have to craft a politically pleasing statement to the affect that we should be more patient, and that they will work on the problem as time permits. I'd have to guess that a donor's priority level for recrediting is much higher than it for Stanford, no offense, but they have families and holiday plans as well.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
noorman
Posts: 270
Joined: Sun Dec 02, 2007 2:26 pm
Hardware configuration: Folders: Intel C2D E6550 @ 3.150 GHz + GPU XFX 9800GTX+ @ 765 MHZ w. WinXP-GPU
AMD A2X64 3800+ @ stock + GPU XFX 9800GTX+ @ 775 MHZ w. WinXP-GPU
Main rig: an old Athlon Barton 2500+ @2.25 GHz & 2* 512 MB RAM Apacer, Radeon 9800Pro, WinXP SP3+
Location: Belgium, near the International Sea-Port of Antwerp

Re: Is it just me or are the Stats not updating?

Post by noorman »

.

For hours now, I haven't been able to gain access to my personal stats on the Stanford website either (nor those of fellow Folders) ...

So, there seems to still be something wrong with the Stats, unless they are now running another update cycle which entails a blocking of public access to the official Stats. I always get this known message "Stats update in progress" !

EDIT: I 've, just now, gotten access to my stats :D


.
Last edited by noorman on Wed Nov 25, 2009 6:49 pm, edited 2 times in total.
- stopped Linux SMP w. HT on i7-860@3.5 GHz
....................................
Folded since 10-06-04 till 09-2010
noorman
Posts: 270
Joined: Sun Dec 02, 2007 2:26 pm
Hardware configuration: Folders: Intel C2D E6550 @ 3.150 GHz + GPU XFX 9800GTX+ @ 765 MHZ w. WinXP-GPU
AMD A2X64 3800+ @ stock + GPU XFX 9800GTX+ @ 775 MHZ w. WinXP-GPU
Main rig: an old Athlon Barton 2500+ @2.25 GHz & 2* 512 MB RAM Apacer, Radeon 9800Pro, WinXP SP3+
Location: Belgium, near the International Sea-Port of Antwerp

Re: Is it just me or are the Stats not updating?

Post by noorman »

7im wrote:The data wasn't lost, it's just a matter of time to run through all the data and recredit the points. Remember, this is a manual process, not a computer process. That means a human sits down at a terminal and does the work. And the bigger the project gets, the longer these things take.

And sometimes it's easier to be vague than to have to craft a politically pleasing statement to the affect that we should be more patient, and that they will work on the problem as time permits. I'd have to guess that a donor's priority level for recrediting is much higher than it for Stanford, no offense, but they have families and holiday plans as well.
.

I can't imagine though, someone doing the stats of every uploaded Result over at least a 24 hr period ...
I guess there may be manual labour to it, but not as tiresome as that, surely ?


.
- stopped Linux SMP w. HT on i7-860@3.5 GHz
....................................
Folded since 10-06-04 till 09-2010
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Is it just me or are the Stats not updating?

Post by bruce »

Well, I think it probably goes something like this.

Consider how many WUs were submitted during the time that the stats were down. (Be sure to include some time before and some time after, so that you're sure to get all of them.) Now consider how long it takes to collect that information from whatever backup sources are available for each work server. Now take that massive list and compare it against the list of WUs that you've already gotten credit for to eliminate duplicate credits. (Be sure to consider the size of the list of WUs that everybody has gotten credit for, too.)

This is a manual process, so your primary tools are "grep" and SQL queries -- oh, and you have to be VERY VERY careful, because every donor will be complaining if there's a mistake - - oh, and you have to be VERY VERY fast, too, because every donor will be complaining that you're not fast enough.

Yes, it's every bit as tiresome.
noorman
Posts: 270
Joined: Sun Dec 02, 2007 2:26 pm
Hardware configuration: Folders: Intel C2D E6550 @ 3.150 GHz + GPU XFX 9800GTX+ @ 765 MHZ w. WinXP-GPU
AMD A2X64 3800+ @ stock + GPU XFX 9800GTX+ @ 775 MHZ w. WinXP-GPU
Main rig: an old Athlon Barton 2500+ @2.25 GHz & 2* 512 MB RAM Apacer, Radeon 9800Pro, WinXP SP3+
Location: Belgium, near the International Sea-Port of Antwerp

Re: Is it just me or are the Stats not updating?

Post by noorman »

.

OK, I got it; they could have told us that this wouldn't be a one-go update (even immediately after the fact)

That would have negated the need for all these questions and guesses ...


.
- stopped Linux SMP w. HT on i7-860@3.5 GHz
....................................
Folded since 10-06-04 till 09-2010
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Is it just me or are the Stats not updating?

Post by 7im »

Haven't you been folding long enough to know that ALL of these manual updates areN'T a one-go? Nothing has changed since the list time...
Last edited by 7im on Wed Nov 25, 2009 10:20 pm, edited 1 time in total.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
TheWolf
Posts: 288
Joined: Thu Jan 24, 2008 10:34 am

Re: Is it just me or are the Stats not updating?

Post by TheWolf »

7im wrote:Haven't you been folding long enough to know that ALL of these manual updates are a one-go? Nothing has changed since the list time...
Don't you mean "aren't" a one-go thing? :wink:

But yea I've never seen all my credit show up all at once.
Normally around a week to see them all.
Since the folding community has grown "probably doubled" since the last problem,
I'm sure its going to take more time now than ever before.
Looks like up to 3 weeks, since 2 weeks has almost pasted.
noorman
Posts: 270
Joined: Sun Dec 02, 2007 2:26 pm
Hardware configuration: Folders: Intel C2D E6550 @ 3.150 GHz + GPU XFX 9800GTX+ @ 765 MHZ w. WinXP-GPU
AMD A2X64 3800+ @ stock + GPU XFX 9800GTX+ @ 775 MHZ w. WinXP-GPU
Main rig: an old Athlon Barton 2500+ @2.25 GHz & 2* 512 MB RAM Apacer, Radeon 9800Pro, WinXP SP3+
Location: Belgium, near the International Sea-Port of Antwerp

Re: Is it just me or are the Stats not updating?

Post by noorman »

7im wrote:Haven't you been folding long enough to know that ALL of these manual updates are a one-go? Nothing has changed since the list time...
.

I 'm not with you; many thought that the update would be all the backlog restored in one go, but it doesn't seem to be the case.
In the past, I can't remember having seen updates that were done in several slices
:e?:


.
- stopped Linux SMP w. HT on i7-860@3.5 GHz
....................................
Folded since 10-06-04 till 09-2010
road-runner
Posts: 227
Joined: Sun Dec 02, 2007 4:01 am
Location: Willis, Texas

Re: Is it just me or are the Stats not updating?

Post by road-runner »

I dont know if I got all mine or not and really dont care as long as they got they work, life goes on...
Image
Gary480six
Posts: 93
Joined: Mon Jan 21, 2008 6:42 pm

Re: Is it just me or are the Stats not updating?

Post by Gary480six »

J_M wrote:Sill not seeing any missing points on my end (only missing about 21k). I understand that it must be an arduous task and our individual/team points are hardly the focus of the project so please don't take this as a complaint. I'm just wondering if there is any new info.

Edit: I'm also wondering if there are any remaining issues with the stats/credit. I switched a couple of multiple standard CPU client setups over to single SMP clients with an increase of couple thousand PPD (according to FaHmon) and yet my daily credits have been slightly lower since making the changes. I have confirmed no EUE's and all log files are reflecting successful uploads on all clients.
I have to agree with J_M. I also feel that since the crash, the stats/credit server has been missing some current credits. I'm guessing that I've lost about 5000PPD. But since I complete about 80 work units a day, I cannot figure out if I'm being shorted with the SMP or GPU clients - Or if the Passkey (or not) has something to do with it.

Anybody else see an obvious drop in their PPD since the crash was "fixed"?
Locked