Number of active folders going down?

Moderators: Site Moderators, FAHC Science Team

bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Number of active folders going down?

Post by bruce »

P5-133XL wrote:PPD's do not accurately the measure of scientific work/value.
I was with you right up to the last statement, but I don't know where you got that idea. I'd phrase it as FLOPS does not measure scientific value.

Suppose I replace 10 machines with a single machine and both produce the same total flops. The 10 machines were producing K WUs per week and maybe each one met the Preferred deadline of, let's say, 7 days. The new machine will complete maybe K WUs per week, but each one is completed in 0.7 days. The total flops completed doesn't change, but the speed at which each WU is completed is 10x faster. In pure baseline points, the PPD is the same, but in QRB terms, the PPD is much higher.

If we were working on a project where every WU could be processed in parallel, then both scenarios complete K WUs in a week -- equal scientific value. FAH has many WUs which must be processed serially, making time an important measurement, hence the QRB formula awards scientific value to speed.

If all K WUs happened to be part of the same trajectory, it would take 10 weeks for the first 10 computers to complete the work because 9 machines wouldn't have a WU to work on, whereas the faster machine can process them one after another and be done in a week.
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: Number of active folders going down?

Post by P5-133XL »

If flops are the measure of work done, then GPU's should be getting 96% of all the points and clearly they are not which is where I was coming from with that statement.

We are not talking even a 10:1 replacement ratio but closer to 25:1 assuming replacing an average GPU slot with an average CPU slot. I do not know what an average GPU is nor an average SMP slot is but I have a hard time imagining that the average GPU is getting 25x the PPD that the average CPU slot using either base points or base+QRB measure.

You can't use the number of WU's done per week or even just how fast they get returned in isolation because those numbers do not tell how much work was done. The size of a WU can change from very small to very large. That's the whole reason in dealing in PPD as opposed to points or WU's done.

If flops are the measure of work done and GPU's do more flops then GPU's should be getting more points. If the issue is to get work done quickly, then obviously what is needed is smaller WU's for GPU's so that they can complete them faster and get more QRB so that the the total number of points given out matches FLOP ratios. Then everything would make sense.
Image
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: Number of active folders going down?

Post by Grandpa_01 »

According to VJ the points values are correct as far as scientific value goes so evidently there is more to it than simply looking at the flops done.
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Number of active folders going down?

Post by 7im »

Gramps is correct in that not all FLOPS are created equally, as noted in the FLOPS FAQ. Good general indicator, but not good enough to use as a rule.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
Haitch
Posts: 34
Joined: Tue Dec 04, 2007 4:34 pm

Re: Number of active folders going down?

Post by Haitch »

I've turned off 100 cores - a drop in the bucket I know. Most of them were BA, some of them were SMP- but if my my BA workers are being given an arbitrary 66% ppd cut, I'm turning them all off - maybe I'll use them to earn money instead of donating money and power.

H.
twizzle
Posts: 25
Joined: Fri Aug 30, 2013 3:55 am

Re: Number of active folders going down?

Post by twizzle »

I was just logging into to have a whine, perfect timing with this thread.

It's a quad-core box, I only run a CPU slot (GPU made it unusable), it's only turned on for ~ 8.5 hours per day, sometimes I have to stop the golfing because it makes the box unresponsive.

The timeout and expiration limits are not sufficient. The current work unit required approximately 32 hours of processing in 6 days before the expiration limit, it's Friday, it's not going to complete. I dumped my previous work unit after a week of processing because it wasn't going to complete before hitting the expiration limit. If it was the occasional WU... that would be O.K., but this is happening far too often.
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: Number of active folders going down?

Post by P5-133XL »

Some people are looking at my earlier post(s) and interpreting it to mean that their contribution is not valued. They could not be more wrong! There have been many very valuable papers written based on the results from CPU's and bigadv. My point is that FLOPS are not the end-all be-all of work/value. If they were, the point system would be different for it doesn't match FLOPS as a measure.
Image
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Number of active folders going down?

Post by PantherX »

twizzle wrote:...The timeout and expiration limits are not sufficient. The current work unit required approximately 32 hours of processing in 6 days before the expiration limit, it's Friday, it's not going to complete. I dumped my previous work unit after a week of processing because it wasn't going to complete before hitting the expiration limit. If it was the occasional WU... that would be O.K., but this is happening far too often.
Sorry to hear that you are having issues. Could you please create a new thread and post details about your system (the initial section of the log file is very useful) so we can help you optimize your F@H contribution to your specific needs.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
twizzle
Posts: 25
Joined: Fri Aug 30, 2013 3:55 am

Re: Number of active folders going down?

Post by twizzle »

PantherX wrote:
twizzle wrote:...The timeout and expiration limits are not sufficient. The current work unit required approximately 32 hours of processing in 6 days before the expiration limit, it's Friday, it's not going to complete. I dumped my previous work unit after a week of processing because it wasn't going to complete before hitting the expiration limit. If it was the occasional WU... that would be O.K., but this is happening far too often.
Sorry to hear that you are having issues. Could you please create a new thread and post details about your system (the initial section of the log file is very useful) so we can help you optimize your F@H contribution to your specific needs.
... and, of course, the next work unit had a long timeout/expiry (many days) but completed within four hours. :?
-alias-
Posts: 121
Joined: Sun Feb 22, 2009 1:20 pm

Re: Number of active folders going down?

Post by -alias- »

Active folders (CPUs) is down 62,606 since january 2, Native TFLOPS down 212, and X86 TFLOPS is down 140. Since early desember 2013 is active folders (CPUs) down almost 90,000. One example of team that almost have been halved in PPD since the year changed to 2014 is [H]ardOCP which for a long time has been the biggest team in the world folding for Folding@Home. More team shows tendencies, albeit not many, and the reason is probably that the team [H]ardOCP has been the team with the most ba-folders, and it seems that many of them are now really pissed if I interpret the signals right. This is how I see it, a rather sad development for us that for a long time has felt for what Folding@Home is accounted for, but PG has only themselves to blame for this negative trend. Though not for long time ahead, I will most likely do the same as BA-folders at the [H]ardOCP done.:(

It was just what I wanted to say, and I guess I will not be surprised if my remark here will be refused in the near future.:?
VijayPande
Pande Group Member
Posts: 2058
Joined: Fri Nov 30, 2007 6:25 am
Location: Stanford

Re: Number of active folders going down?

Post by VijayPande »

It's useful to put your numbers above in perspective. Saying that the "X86 TFLOPS is down 140" sounds like a lot, but not if you consider it's at 15,568, of which 140 is only a very small percentage (less than 1%) of the FLOPs. It's probably much more useful to talk in percentages here.

Also, we're seeing a trend that people are moving away from low-core CPUs to many-core CPUs or GPUs. Many donors are replacing multiple low-core CPU boxes with one GPU box with multiple GPUs. These sorts of changes bring down the CPU count but doesn't really mean we're having less performance, just different (more GPUs, fewer low-core CPUs).
Prof. Vijay Pande, PhD
Departments of Chemistry, Structural Biology, and Computer Science
Chair, Biophysics
Director, Folding@home Distributed Computing Project
Stanford University
Zagen30
Posts: 823
Joined: Tue Mar 25, 2008 12:45 am
Hardware configuration: Core i7 3770K @3.5 GHz (not folding), 8 GB DDR3 @2133 MHz, 2xGTX 780 @1215 MHz, Windows 7 Pro 64-bit running 7.3.6 w/ 1xSMP, 2xGPU

4P E5-4650 @3.1 GHz, 64 GB DDR3 @1333MHz, Ubuntu Desktop 13.10 64-bit

Re: Number of active folders going down?

Post by Zagen30 »

VijayPande wrote:Also, we're seeing a trend that people are moving away from low-core CPUs to many-core CPUs or GPUs. Many donors are replacing multiple low-core CPU boxes with one GPU box with multiple GPUs. These sorts of changes bring down the CPU count but doesn't really mean we're having less performance, just different (more GPUs, fewer low-core CPUs).
Perhaps you all have access to data that we don't, but from the OS stats, there doesn't appear to be that much of a change in the average number of cores per CPU, at least in Windows. If you graph the number of Windows cores vs. CPUs as collated here, you currently get a figure of around 1.8. This figure has never been higher than 2.0 in the past year+, and that high occurred in August. I would think that replacing low-core boxes with either a high-core box and/or a GPU box would raise the average, unless there are just that many uniprocessor clients still running, which seems sort of impossible what with the uniprocessor-only projects ending several months ago. Are there really that many uniprocessor clients/slots still running?

The switch to GPUs is borne out by the data, however, at least on the Nvidia side. AMD GPUs is sitting at a rather paltry 300, vs. 18,000 Nvidia cards. Is it possible that a bunch of AMD cards are being counted as Nvidia? I realize cryptocoin mining greatly favors AMD, and that some people may have switched over to that once some of the non-bitcoin cryptos started becoming profitable, but it seems unlikely to me that 95% of the AMD cards that were around in early November have left since then with almost no one to replace them, especially since Nvidia cards have shot up by close to 30% over that same time span.
Image
VijayPande
Pande Group Member
Posts: 2058
Joined: Fri Nov 30, 2007 6:25 am
Location: Stanford

Re: Number of active folders going down?

Post by VijayPande »

PS The ATI numbers are being under-reported due to a change in the stats system some time ago. We've been working on that issue. You should expect to see a big bump there soon when the system gets updated.
Prof. Vijay Pande, PhD
Departments of Chemistry, Structural Biology, and Computer Science
Chair, Biophysics
Director, Folding@home Distributed Computing Project
Stanford University
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Number of active folders going down?

Post by 7im »

Consider the influence from the V7 Windows client on the Average Core counts when the client installer reserves a CPU core for the GPU. N-1 cores for every V7 installation with a GPU.

All those Core 2 Duos with a GPU (like one I have) now look like single core computers. Not an explanation, just a contributing factor.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
netblazer
Posts: 88
Joined: Sun Dec 22, 2013 8:36 am

Re: Number of active folders going down?

Post by netblazer »

Grandpa_01 wrote:According to VJ the points values are correct as far as scientific value goes so evidently there is more to it than simply looking at the flops done.

I think by far the most significant metric is base points per day (ignoring all bonuses). That way you track the actual work being completed aside from the return speed.

It also stays completely relevant across the years. Maybe there's a way to convert that number into "processing days thided" (maybe it was 10K 10 years ago and now it's 10M).

Then you could dump that into a nice graph.

Tflops is significant but 99% of the population doesn't understand that term.

I'd go with # of people who have contributed n days of work today. Not a final idea but certainly worth exploring from there.
Post Reply