The flop count dropped down to 0.2 exaFLOP?

Moderators: Site Moderators, FAHC Science Team

Simplex0
Posts: 69
Joined: Sun Oct 06, 2013 10:35 am

The flop count dropped down to 0.2 exaFLOP?

Post by Simplex0 »

If I look at the page here https://stats.foldingathome.org/os it seams that the counting power Folding@home have dropped from more the 1 exaFLOP down to 0.2 exaFLOP. Whay is that?
ajm
Posts: 750
Joined: Sat Mar 21, 2020 5:22 am
Location: Lucerne, Switzerland

Re: The flop count dropped down to 0.2 exaFLOP?

Post by ajm »

Quite probably because of this: https://foldingathome.org/2020/09/27/up ... pu-counts/
Simplex0
Posts: 69
Joined: Sun Oct 06, 2013 10:35 am

Re: The flop count dropped down to 0.2 exaFLOP?

Post by Simplex0 »

Thank you ajm. So the claim that Folding was a exaflop capable cluster was based on a miscalculation on an order of at least 5 times the real value providing that they got it right this time.
ajm
Posts: 750
Joined: Sat Mar 21, 2020 5:22 am
Location: Lucerne, Switzerland

Re: The flop count dropped down to 0.2 exaFLOP?

Post by ajm »

Well, this problem with folding without persistent storage is new. As the name says, Folding@Home is primarily meant for normal folks using their standard PC. But the Covid-19 emergency attracted a new kind of users, whose systems the stats were not meant for analyzing.
Now, I know that some work is been done for setting up a new way to compute those stats. But this is still underway and the stats now published, or rectified, are just a quick fix (as the article above states) - they still don't correspond to some real calculation.
Jonazz
Posts: 353
Joined: Sun Jan 17, 2010 2:08 pm

Re: The flop count dropped down to 0.2 exaFLOP?

Post by Jonazz »

Simplex0 wrote:Thank you ajm. So the claim that Folding was a exaflop capable cluster was based on a miscalculation on an order of at least 5 times the real value providing that they got it right this time.
The way I understand it is that we did have an exaflop in april-may; but the number of folders has reduced since then.
JimboPalmer
Posts: 2522
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: The flop count dropped down to 0.2 exaFLOP?

Post by JimboPalmer »

Should you want a semi-independent source:

https://folding.extremeoverclocking.com ... ary.php?s=

Look at weekly or monthly Points or Work Units. and compare them to weekly or monthly Users.
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
Joe_H
Site Admin
Posts: 7927
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: The flop count dropped down to 0.2 exaFLOP?

Post by Joe_H »

As has been said, they are in the process of updating how they collect this stats information. In the meantime though the OS Stats page still says that it is from active systems over the last 50 days, the actual span is just a day or two at this point. They may also be excluding some results from known users of containers without persistent storage.

As Jonazz has written, the figure from May is from before many of these systems showed up later in the Summer. So while it might not be exact, it would be near the actual figure. The identified sources of most of the recent inflation in the FLOP count started up around the end of June and early July. Essentially they are running non-FAH supplied containers that start up as a new installation each time, run a single WU or so, and next time the container runs it is seen as a new machine.

I do not know when they will have a fully updated method out for collecting this stat, but it is being worked on. I expect when completed it will show something about 2/3 the May level based on the EOC stats linked by JomboPalmer.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: The flop count dropped down to 0.2 exaFLOP?

Post by bruce »

The fundamental issue is that FAH is not notified when you take a system off-line, only when a new system is added. How does FAH determine that a system that just received an assignment is still part of the distributed supercomputer?

When WUs often took a week or two to complete, the longer timeframe made some sense, but a multitude of COVID projects are now much, much shorter. Establishing an assumed WU duration, considering the faster GPUs and shorter projects is still a bit of a challenge (and will continue to be) unless someone figures out an alternate way to know when a client has been permanently taken off-line.
MeeLee
Posts: 1339
Joined: Tue Feb 19, 2019 10:16 pm

Re: The flop count dropped down to 0.2 exaFLOP?

Post by MeeLee »

When looking over the numbers, I found that the user base in the last few months leading up to the exaflop score, actually shrunk, but their output increased.
I think a lot of late comers to the RTX 2000 craze, while seemingly few new users new (gaming) pcs, and some supercomputers (with a registered 1000 CPUs, of which like mentioned, perhaps more than 2/3rd were containers).
I think fewer people contributed more in points, thanks to faster hardware, and focusing away from x86 to GPU.
We'll see that same spike this coming winter, when our Canadian friends will chime in, many of which will have an RTX 3000 series GPU.
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: The flop count dropped down to 0.2 exaFLOP?

Post by PantherX »

Also note that the recent optimizations due to CUDA on Nvidia GPUs would not have been reflected in the current stats system. Thus, whatever the current Nvidia GPU contribution is, one could theoretically increase it by 15% non-Moonshot WUs) all the way to 100% (Moonshot WUs) thus, there's quite a bit of sliding room so to speak. I do look forward to the new stats once it has been refreshed. In the meantime, F@H does maintain 200,000 compute hours per hour for the last few days (https://apps.foldingathome.org/credit-log).
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Simplex0
Posts: 69
Joined: Sun Oct 06, 2013 10:35 am

Re: The flop count dropped down to 0.2 exaFLOP?

Post by Simplex0 »

So I gess the the main reason the flop count have plunged from a top value at 2.6 exaflop down to 0.2 exaflop, a factor of 13, is mainly due to a flawed method to make the calculation and not that the computing power of the cluster have dropped to 1/13 of the power it had recently. imo it is meaningless to present a flop count for the cluster without any estimation of the error in the calculated number.
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: The flop count dropped down to 0.2 exaFLOP?

Post by bruce »

If I run a container on a preemptable cloud server instance and a preempt destroys it, should it have been counted as available FLOPS or not? ... and for how does FAH determine long was it part of the virtual supercomputer? (That's certainly one source of uncertainty.)
Neil-B
Posts: 1996
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon E5-2697v3@2.60GHz, 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon E3-1505Mv5@2.80GHz, 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: i7-960@3.20GHz, 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: The flop count dropped down to 0.2 exaFLOP?

Post by Neil-B »

OK ... slightly off topic ... but retrospectively couldn't one look at the download/upload times, an estimate of the amount of processing needed for the wu - to give a flops rating for each completed wu - then use the download/upload times to identify concurrent wus and sum these for a FaH flops figure ... significant compute to do this and still "estimate" but would be and interesting (if in no way worth the effort) exercise :)
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070

(Green/Bold = Active)
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: The flop count dropped down to 0.2 exaFLOP?

Post by PantherX »

That seems to be the idea:
...Looking ahead, we plan to assess the performance of Folding@home in terms of the amount of simulation data coming into our servers rather than relying on IDs generated by the Folding@home software...
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: The flop count dropped down to 0.2 exaFLOP?

Post by bruce »

GROMACS and OpenMM both count the actual FLOPs internally and report a total. We plan to use their actual figures instead of estimating anything. We'll be reporting actual PRODUCTIVE work completed although the actual details of the project have yet to be finalized.
Post Reply