Is it just me or are the Stats not updating?[Nov 12 problem]

Moderators: Site Moderators, FAHC Science Team

noorman
Posts: 270
Joined: Sun Dec 02, 2007 2:26 pm
Hardware configuration: Folders: Intel C2D E6550 @ 3.150 GHz + GPU XFX 9800GTX+ @ 765 MHZ w. WinXP-GPU
AMD A2X64 3800+ @ stock + GPU XFX 9800GTX+ @ 775 MHZ w. WinXP-GPU
Main rig: an old Athlon Barton 2500+ @2.25 GHz & 2* 512 MB RAM Apacer, Radeon 9800Pro, WinXP SP3+
Location: Belgium, near the International Sea-Port of Antwerp

Re: Is it just me or are the Stats not updating?

Post by noorman »

.

I 'm only running GPU Clients here and I think I 'm back to the usual average daily production output figures.

So, if you think you are missing out on some WU's, it 'll be on the SMP units (I 'm guessing)


.
- stopped Linux SMP w. HT on i7-860@3.5 GHz
....................................
Folded since 10-06-04 till 09-2010
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Is it just me or are the Stats not updating?

Post by bruce »

Gary480six wrote:I have to agree with J_M. I also feel that since the crash, the stats/credit server has been missing some current credits. I'm guessing that I've lost about 5000PPD. But since I complete about 80 work units a day, I cannot figure out if I'm being shorted with the SMP or GPU clients - Or if the Passkey (or not) has something to do with it.

Anybody else see an obvious drop in their PPD since the crash was "fixed"?
The passkey has nothing to do with it.

Let's make a distinction between the manual re-crediting process of the WUs that were returned November 12 while the server was down and any problems that you might be having with current production. This discussion is only talking about the Nov. 12 issue. If you believe that you're not getting credit for WUs that have been completed more recently, report that with a specific report with a title specifying the PRCG in the Issues with a specific WU forum and showing your log data. If ALL credits for a specific server fail to be credited, then report a problem with a specific server in this forum.

Just saying "I feel ... I've been missing some current credits" is way to nebulous for anybody to do anything about. You need to be much more specific. As far as I can tell, there have been no new stats problems since Nov 11, but I'm open to data that demonstrates the contrary.
noorman
Posts: 270
Joined: Sun Dec 02, 2007 2:26 pm
Hardware configuration: Folders: Intel C2D E6550 @ 3.150 GHz + GPU XFX 9800GTX+ @ 765 MHZ w. WinXP-GPU
AMD A2X64 3800+ @ stock + GPU XFX 9800GTX+ @ 775 MHZ w. WinXP-GPU
Main rig: an old Athlon Barton 2500+ @2.25 GHz & 2* 512 MB RAM Apacer, Radeon 9800Pro, WinXP SP3+
Location: Belgium, near the International Sea-Port of Antwerp

Re: Is it just me or are the Stats not updating?

Post by noorman »

.

Bruce,

what can you tell about the credit backlog (of 11/12 Nov.) ? / Is it officially finished ?
( since I had 2 days (not 1) of clearly lower credit levels; see http://folding.extremeoverclocking.com/ ... =&u=104965 whilst my output didn't change [ 2 rigs running 24/7 as always ] ... )

I seem to have got about half of it 're-credited' at 23 Nov., registered that day at 9pm on the EOC Stats, not the rest :?:

.
- stopped Linux SMP w. HT on i7-860@3.5 GHz
....................................
Folded since 10-06-04 till 09-2010
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Is it just me or are the Stats not updating?

Post by bruce »

There's no official statement about whether it's finished or not.

If anybody can provide a PRCG and/or Date_Time of something that they know they submitted that appears to be missing, I'm sure the Pande Group can use it to check that they are (or have) covered the proper date_time range.
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: Is it just me or are the Stats not updating?

Post by Grandpa_01 »

I am not sure that I agree with you here Bruce this is a problem that came up with the crash actually a day or so before it and has continued since. As you can see by the screenie I am running around 30,000 PPD in the last 2 weeks I have had 2 WU's fail on GPU 0 that is all that have failed. If I get a bunch of 384 point WU's then my production will go up to around 32,000. I have gone through and counted WU's and figured the PPD on a 24hr period and FahMon is correct. All of my clients are configured correctly with the proper user name / team # /machine ID so that is not the problem. I seems I have been coming up consistently missing WU's since the crash I will avg 30,000 ppd this week but that is only because some of the lost WU's were credited to me this week. Now I have no Idea which server or which WU's are not being credited should I post all 38 I complete each day.




Image
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Is it just me or are the Stats not updating?[Nov 12 problem]

Post by bruce »

It's not a matter of whether you agree with me or not, it's a matter of finding something that is missing. Are all of your clients working normally now? If not, show us the error.

There is no way to use your PPD to find missing WUs. If the mix of WUs being distributed changed (and it is constantly changing) your PPD can vary even when everything is working normally.

Unless someone can be specific about something that is missing, there's nothing that anyone can do.
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: Is it just me or are the Stats not updating?[Nov 12 problem]

Post by Grandpa_01 »

Just curious but how does a person know which ones are missing. Is there a page somewhere a person can see which WU's have been received / credited. If I were only running one or two clients that would be a simple task. I have tried going to the official stats page which you can not reach most of the time and even if you do you can only see how many WU's you have been credited not which ones. This system of crediting quite frankly sucks
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Is it just me or are the Stats not updating?[Nov 12 problem]

Post by bruce »

I'm asking for YOUR backup data, if you have any. If you don't have any, then you will have to accept the backup data that Stanford has.

The Pande Group has credited a large number of WUs which were "lost" when the server crashed and many folks seem to be satisfied with the credits they've gotten. In fact, there's a reasonable chance that some people have received duplicate credits for a few of the WUs they completed.

Some people people keep back copies of FAHlog.txt and may be able to reconstruct their complete history over that time-period. (Most of us don't) A list of the past 10 WUs for each client can be obtained using "qd" and for clients that do not finish WUs quickly,that may be enough to show a sequence of WUs that is inconsistent with whatever was re-credited. It may also confirm that your re-credit was correct or even that you were over-credited.

All I'm saying is (A) a server crashed, and (B) The Pande Group is working from their backup data. If you have additional backup data that shows something else is missing, please present it. Otherwise we have to assume that their backup information is complete and has been -- or soon will be -- reprocessed manually. Whenever a server crashes, all sources for backups should be consulted, including anything that you might have.
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: Is it just me or are the Stats not updating?[Nov 12 problem]

Post by Grandpa_01 »

I am not talking about the lost WU's from the crash but I do believe that the servers have been missing some WU's since the crash. I started an additional machine which has been running 4400 PPD linux SMP notfreds client. All of my machines have been running 24/7 steady and I have only had 2 failed WU's both were 384 point GPU WU's . But my averadge PPD has dropped since the crash but FahMon says my PPD production has been more. The points do not matter to me but I would like to know that all of the WU's are making it back to stanford. Before the crash my daily PPD matched FahMon now it does not on most days it is usually off between 1,000 and 10,000 PPD. And unfortunatley I do not save any logs and I reboot daily and clear out the old logs. I will watch it for another week and if I still feel it is missing WU's I will save a weeks wort of logs zip them and send them to you.
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Is it just me or are the Stats not updating?[Nov 12 problem]

Post by bruce »

No, I don't need all of the logs, just the list of WUs.

If all of your machines are not getting credit, you can probably figure out which one is the problem from the list of most recent credits. I could give you that information, but I don't know what your FAH UserName is. Apparently we have no points credited to "Grandpa_01" and although there's no requirement to use the same name here on the forum, it's often a good guess, but not this time.
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: Is it just me or are the Stats not updating?[Nov 12 problem]

Post by Grandpa_01 »

My name was already in use on the forums so I had to pick another one.

But I got you this time it is in my sig :mrgreen:

Garndpa team 51394
Thank you bruce
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Is it just me or are the Stats not updating?[Nov 12 problem]

Post by bruce »

PM sent.
noorman
Posts: 270
Joined: Sun Dec 02, 2007 2:26 pm
Hardware configuration: Folders: Intel C2D E6550 @ 3.150 GHz + GPU XFX 9800GTX+ @ 765 MHZ w. WinXP-GPU
AMD A2X64 3800+ @ stock + GPU XFX 9800GTX+ @ 775 MHZ w. WinXP-GPU
Main rig: an old Athlon Barton 2500+ @2.25 GHz & 2* 512 MB RAM Apacer, Radeon 9800Pro, WinXP SP3+
Location: Belgium, near the International Sea-Port of Antwerp

Re: Is it just me or are the Stats not updating?[Nov 12 problem]

Post by noorman »

.

Bruce,

could you check a few WU's for me, for peace of mind and to know what 's what, please ?

here goes (time GMT+2):
Nov.11 P5771 - R9 C75 G1437
Nov.11 P5906 - R13 C540 G87
Nov.12 P5787 - R0 C688 G12
Nov.12 P5771 - R10 C44 G629

thanks :)


.
- stopped Linux SMP w. HT on i7-860@3.5 GHz
....................................
Folded since 10-06-04 till 09-2010
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Is it just me or are the Stats not updating?[Nov 12 problem]

Post by bruce »

noorman wrote:could you check a few WU's for me, for peace of mind and to know what 's what, please ?

here goes (time GMT+2):
Nov.11 P5771 - R9 C75 G1437
Nov.11 P5906 - R13 C540 G87
Nov.12 P5787 - R0 C688 G12
Nov.12 P5771 - R10 C44 G629
Sorry, but that capability was shut down a long time ago due to the overload on the stats server. All I can tell you is that the last WU from each client is:
5912 (9,628,11)
5913 (5,617,8)

The only way to check those WUs is to search the logs manually, and nobody that has access to the logs has time to do it.

When the new stats server is on-line, some capabilities like that one will probably be restored, but I won't know until it happens.
noorman
Posts: 270
Joined: Sun Dec 02, 2007 2:26 pm
Hardware configuration: Folders: Intel C2D E6550 @ 3.150 GHz + GPU XFX 9800GTX+ @ 765 MHZ w. WinXP-GPU
AMD A2X64 3800+ @ stock + GPU XFX 9800GTX+ @ 775 MHZ w. WinXP-GPU
Main rig: an old Athlon Barton 2500+ @2.25 GHz & 2* 512 MB RAM Apacer, Radeon 9800Pro, WinXP SP3+
Location: Belgium, near the International Sea-Port of Antwerp

Re: Is it just me or are the Stats not updating?[Nov 12 problem]

Post by noorman »

bruce wrote:
noorman wrote:could you check a few WU's for me, for peace of mind and to know what 's what, please ?

here goes (time GMT+2):
Nov.11 P5771 - R9 C75 G1437
Nov.11 P5906 - R13 C540 G87
Nov.12 P5787 - R0 C688 G12
Nov.12 P5771 - R10 C44 G629
Sorry, but that capability was shut down a long time ago due to the overload on the stats server. All I can tell you is that the last WU from each client is:
5912 (9,628,11)
5913 (5,617,8)

The only way to check those WUs is to search the logs manually, and nobody that has access to the logs has time to do it.

When the new stats server is on-line, some capabilities like that one will probably be restored, but I won't know until it happens.
.


Pitty, those were the good ol' days ...

Can you get any confirmation then on the ending (or continuation) of the re-creditation of the 'lost' points of the (for me) Nov. 11-12 period, please ?


.
- stopped Linux SMP w. HT on i7-860@3.5 GHz
....................................
Folded since 10-06-04 till 09-2010
Locked