Change in BA requirements

Moderators: Site Moderators, FAHC Science Team

Locked
Adak
Posts: 92
Joined: Fri Dec 07, 2007 10:00 pm

Re: Change in BA requirements

Post by Adak »

k1wi wrote: I'd suggest that the reason a new points system hasn't been implemented is because it suffers the critical flaw in that it will be a change, and leave some folders worse off as a result.
Undoubtedly true. We can't walk on water. The benefit of it, would be a long-lasting one.

Personally, I liked the idea of "more science in less time, equals more points". Then problem with new features, etc., cause no concern. Better features that increase the work done per day, get more points. It doesn't mean older PC's get fewer points, but it does reward those who are upgrading their systems as they do so.

@mdk that was an interesting read about Rotman's BS turn around. Thanks for that. Martin's idea's of integrating to solve problems, was very interesting.
gimpy wrote: Is this TOO simple? X points pre hour of X hardware???? If it takes the "bench machine" x hours to complete the WU...so what? These are hypothetical points to satisfy man's(my, if that makes you feel bettr) greed or estimation of accomplishment for his efforts...See greed. Yes I'm human and envy noones accomplishments but it seems this "donor" program is promoting one up-manship? Read: Free enterprise system (greed).A man will spend a fortune to be seen as the "better man". If F@H wants to progress....need find a way to settle mans vanity equally? or perish? My P.C runs 24/7,uses same power and the cost still same as when I bought it.
It's too complex, actually. There are a CRAZY number of hardware choices out there. The list of various GPU's alone is absolutely stunning. We need something much simpler and able to encompass not only today's hardware and power costs, but those in the coming years, as well.

The power costs are best left up to us the donor, to work out. FAH can't get into the details of our power bills, for sure.

The benchmark machine is just to give a guideline for setting the base points for any new project's work unit. We can't have the same amount of points given to every wu. That would be hugely unfair.

Picture it like this: We have a big load of bricks at the bottom of a hill, and they have to be hand-carried up to the top of the hill (no road there yet). If you are giving $1 for every brick we carry up, that sounds fair. If you are giving $10 per hour, no matter how many bricks are carried up, that sounds quite unfair.

Wouldn't you want to base the pay according to the number of bricks that were carried up by that person? In a nutshell, that's what "points for science" idea is all about. It works well until you set up huge gaps between the projects (bigadv, in this case). Maybe there was a good reason to affix that high number of points to it, but there is a serious downside to it, as we see here with SMP.

All the complexities that Tim mentioned, become no problem, using that simple "more points for more science, quicker", idea.

As folders, we need to stay calm, and understand that older PC's will not be able to make more points, than they do today. From FAH, we need a more even-handed points system that does not include these sharp "push them off the cliff", kind of adjustments. Donors definitely become emotionally attached to their PC's that they've worked hard to buy and sometimes, hand build, expressly for FAH. FAH may not have wanted that kind of emotional attachment or PC's built just for FAH, but that's human nature, and FAH has benefited from it, hugely. Pande Group needs to respect that, and I believe that they do, but these planned adjustments are VERY severe, and very difficult for those affected, to deal with.
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: Change in BA requirements

Post by Grandpa_01 »

There is a reason for the big difference which is cost, to stay at the front end of things it is costly and if there was no reward for doing it, it just would not happen, the downside come when the cost becomes more reasonable to build the rigs and the reward is very big for the cost then you have lots of people building rigs that will meet the deadline and running them. Thus the reason for core / deadline limits. I myself believe 1 way to curb this is more frequent adjustments with a road map that says we will review bigadv requirements on Jan 1,,2014, April 1, 2014 July 1, 2014 and October 1, 2014 at these times it is most likely there will be deadline adjustments. That way we all know that if you are investing in a machine that is at the very bottom end ( by bottom end I mean barley beating the deadline on the slowest bigadv WU) there is a real chance it is only going to be able to do bigadv for a 3 month period. And this should be a sticky and well publicized. Right now you can build a bigadv capable machine for less than smp or GPU rig (it does take slightly more electricity to run them) so yes it does become lopsided and there are allot of them out there and most should have known that they were not going to be doing bigadv forever with them. It does not make what is happening right now any easier but it will help in the future.

The problem is with the lack of reward for smp and without a adjustment of points for them the problem is not going away, perhaps some day GPU's will take over where smp is but that day does not seem to be anytime soon since September there has been around 20 smp WU's released to beta and 1 core 15 GPU no core 17 GPU so that in itself says smp is going to be around for a while. On my 7 - 4P rigs I get between 1.9 Mppd and 2.1Mppd running smp I get between 5.5 Mppd and 6.3 Mppd running bigadv you could doubble the smp ppd output and I would still make 20% more ppd running bigadv. Please give the smp a little bit of love.
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Change in BA requirements

Post by 7im »

Adak wrote:Oh please:
And yet, no one, in many years, has been able to conceive a workable suggestion to improve the points system that didn't bring with it more problems than solutions, or more cost than benefit.
Either you're joking, or you mean a workable suggestion that will immediately be shot down by someone who has no clue how to implement it. Because absolutely, positively, a better point system could be set up. You simply don't have anyone who wants to work on it, who knows how to set up a points system. I understand that. They're researchers, not statisticians or handicappers.
Okay, since you seem so dismissive of my simple example, what is your solution? :lol:
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Change in BA requirements

Post by 7im »

Bill1024 wrote:So Tim what is your solution?
While rereading my post, I may have stumbled across a short term solution to the backlog of SMP projects. I'll write it up after I've had a chance to sleep on it. Instead of changing the rules of the game, one needs to use the existing rules to execute the change.

It may or may not help delay the BA changes coming, but I think the idea may have some impact. :twisted:
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
Adak
Posts: 92
Joined: Fri Dec 07, 2007 10:00 pm

Re: Change in BA requirements

Post by Adak »

Grandpa_01 wrote:There is a reason for the big difference which is cost, to stay at the front end of things it is costly and if there was no reward for doing it, it just would not happen, the downside come when the cost becomes more reasonable to build the rigs and the reward is very big for the cost then you have lots of people building rigs that will meet the deadline and running them. Thus the reason for core / deadline limits. I myself believe 1 way to curb this is more frequent adjustments with a road map that says we will review bigadv requirements on Jan 1,,2014, April 1, 2014 July 1, 2014 and October 1, 2014 at these times it is most likely there will be deadline adjustments. That way we all know that if you are investing in a machine that is at the very bottom end ( by bottom end I mean barley beating the deadline on the slowest bigadv WU) there is a real chance it is only going to be able to do bigadv for a 3 month period. And this should be a sticky and well publicized. Right now you can build a bigadv capable machine for less than smp or GPU rig (it does take slightly more electricity to run them) so yes it does become lopsided and there are allot of them out there and most should have known that they were not going to be doing bigadv forever with them. It does not make what is happening right now any easier but it will help in the future.
I agree with you that everyone buying a system for bigadv, must know that the obsolescence "reaper" is following behind, so you shouldn't buy the least powerful systems capable of bigadv, and then expect it to continue to fold bigadv, for several years. We know that won't happen, and it should be well known, both here, and throughout the folding teams, etc.

But I really disagree with you on the rest of your above statement. Cost, should not be an issue. One example: I have a high end 4P, and my buddy has a low end 4P, but with the same cpu's. Since my 4P cost nearly $1,000 more than his, if you take cost into account, then I should get more points clearly.

No, that doesn't work. And cost is not a necessary factor in a FAH point system. Keep the point system both simple and elegant, and fair as it can be:

"More science, faster, equals more points"

Repeatedly raising the bigadv threshold is unavoidable, however, raising it on short notice, in just two months between raises, is not the way to go. One raise in February, OK, but that second raise in April, with no reason given for yet another increase in the number of cores required? THAT is a real problem, imo.
The problem is with the lack of reward for smp and without a adjustment of points for them the problem is not going away, perhaps some day GPU's will take over where smp is but that day does not seem to be anytime soon since September there has been around 20 smp WU's released to beta and 1 core 15 GPU no core 17 GPU so that in itself says smp is going to be around for a while. On my 7 - 4P rigs I get between 1.9 Mppd and 2.1Mppd running smp I get between 5.5 Mppd and 6.3 Mppd running bigadv you could doubble the smp ppd output and I would still make 20% more ppd running bigadv. Please give the smp a little bit of love.
I agree. We need to increase SMP points.
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: Change in BA requirements

Post by Grandpa_01 »

The example you give is not what I am talking about, so what you buddy got a good deal in that scenario, it happens, but if you are going to get a top end machine you will be paying top dollar for it in most cases. If there is no justification for spending the $$$ are you myself or most anyone else going to build it. We can say cost should not be involved in it all we want, but the reality is it is. It cost many $1000's of dollars to own and operate top end gear my annual electric bill is just over $7500.00 so that is just over $1000.00 per 4P just for the electricity. That does not even include maintenance or build cost if you avg that out for say a 2 year life span of bigadv capable it would be around $2600,00 per machine per year to build maintain and power them and for most there is only 1 use for them (Folding), how many are willing to put that out if there is no justification for it. Cost is and will continue to be a factor when building top end rigs for bigadv if the reward is not there to justify the cost then there will be none to run them.
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
Bill1024
Posts: 75
Joined: Mon Jun 30, 2008 2:45 am

Re: Change in BA requirements

Post by Bill1024 »

174,000 smp units need to be done and are in the server waiting to be sent out.
There are 182 BA wu ready to be sent out. Seems like a bit of a backlog to me.

I am sure most folders would turn their SMP killing 4P machines on those SMP wu if it were not for the loss of half their points.
Plus the fact people have to know that things are backing up. Not everyone hast the time to check server status, or would even think to.
Is this not obvious, common sense?
How many folders do not even know about this forum, I am sure quite a few.
They find out about folding through other web sites, and forums. Maybe when they got their PS3 years ago.

On a 4P if 2 people have the exact same CPUs and one person spent 1000$ more on parts. That person will only get the same PPD, as it should be.
Where in the heck did that 1000 dollars go, better PSU, memory. Why. That's like building a drag car and putting all the money in the paint job, not the engine.

"More science, faster returns, should equal more points"
Sliding K factor to the point SMP is 100% more PPD than it is now so even the most powerful 2P and 4P would not lose out doing them.
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Change in BA requirements

Post by 7im »

Adak wrote:
Snip

Repeatedly raising the bigadv threshold is unavoidable, however, raising it on short notice, in just two months between raises, is not the way to go. One raise in February, OK, but that second raise in April, with no reason given for yet another increase in the number of cores required? THAT is a real problem, imo.
On this we almost completely agree. PG probably thinks the two step change helps make up for the short notice. That a gradual change is not so harsh. BS.

Make ONE change and make it in April. Less hassle, less confusion, less work having to adjust deadlines and K factors, has the affect of giving a longer notice on when the next change will happen, less supposition about actual cut off dates, etc.

Rip the damn bandaid off fast not slow! :roll:
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
ChristianVirtual
Posts: 1576
Joined: Tue May 28, 2013 12:14 pm
Location: Tokyo

Re: Change in BA requirements

Post by ChristianVirtual »

Bill1024 wrote: Where in the heck did that 1000 dollars go, better PSU, memory.
Let say: difference in sourcing ... Some buy retail, some buy ... ElSewhere
ImageImage
Please contribute your logs to http://ppd.fahmm.net
Adak
Posts: 92
Joined: Fri Dec 07, 2007 10:00 pm

Re: Change in BA requirements

Post by Adak »

7im wrote: Okay, since you seem so dismissive of my simple example, what is your solution? :lol:
I know you're joking, but just in case you're not joking -- I'll be glad to! Give me the data on your work projects, and your priorities for the projects on a scale, so appropriate values can be assigned.

I know how to handicap, and a points system is just no problem for me.

You asked the wrong guy if you wanted a no answer, Tim. :lol:


Bill wrote: Is this not obvious, common sense?
Yes, there is a backlog, and yes, there are too many high end rigs focused on bigadv.This is not a bad thing - it's a sign that the points given to bigadv in the first place, were correct - big enough to motivate a lot of folders to invest in bigadv capable PC's. And the reason is POINTS. Lower points for bigadv a little bit (say 5% or so, nothing huge), and increase the points to SMP, by a bit more, and that backlog will disappear. Everybody notices an increase in a project's point values, and every team will be passing that news along. No problem getting the word out, and no moderator asking nicely in the forum, required.

@Grandpa, the problem I see with your suggestion of multiple increases in the bigadv threshold, over a short amount of time, is that it will alienate all the folders who have their bigadv PC's, pushed off and down into a much lower production in SMP projects. It may be an emotional reaction, but it's real, and we need to avoid that kind of antagonizing of the donors. Threshold increases should happen no more than once every year, at the most - never more. And, we need to increase the points for SMP so those donors who are "pushed off the cliff" by the higher threshold, will not have so very far to fall, in their ppd, as they settle back into SMP folding with their rig.

The points for bigadv would still be very attractive. There's nothing better in any DC project, anywhere. Of course it would be VERY attractive. It's a LOT of science.

I know all about the cost of electricity while running a 4P rig, 24/7. That's why I run just one of them, and not half a dozen of them. The build cost is quite manageable, but the expense of running them quickly becomes unreasonable for me. Not only would I have to pay for the electricity to run them, but I'm near the desert, so my air conditioning needs would skyrocket, as my home avoided being turned into an oven, as well. No thanks! 8-)
DocJonz
Posts: 244
Joined: Thu Dec 06, 2007 6:31 pm
Hardware configuration: Folding with: 4x RTX 4070Ti, 1x RTX 4080 Super
Location: United Kingdom
Contact:

Re: Change in BA requirements

Post by DocJonz »

Having read through all the posts in this thread, it is clear that the problem remains with the high points allocated for the bigadv WU's (and of course the communication issues, but these have been covered).
It has been said many times "equal pay for equal work" - but it has also been shown many times that the same 4P machine crunching SMP's or bigadv produces massively differing points - where's the equality? It's not there because the bigadv points were heavily inflated. Yes, I agree with 7im and Adak that obsolescence will come to bigadv machines - it comes to all hardware (we've seen it on old generation GPU's). The solution is not inflation of other WU types to compensate for the existing flaw in the scheme, but would it not be more sensible to gradually ease off the bigadv points over time to bring it back into check?
Folding Stats (HFM.NET): DocJonz Folding Farm Stats
patonb
Posts: 348
Joined: Thu Oct 23, 2008 2:42 am
Hardware configuration: WooHoo= SR-2 -- L5639 @ ?? -- Evga 560ti FPB -- 12Gig Corsair XMS3 -- Corsair 1050hx -- Blackhawk Ultra

Foldie = @3.2Ghz -- Noctua NH-U12 -- BFG GTX 260-216 -- 6Gig OCZ Gold -- x58a-ud3r -- 6Gig OCZ Gold -- hx520

Re: Change in BA requirements

Post by patonb »

So why can bigadv be changed and their systems relegated to less than have their former work, but an intel c2d is still getting the same work now as it did 3 years ago?

I understand making things bigger and better, but these units were meant to be run on corporate and server farms. I'm not an expert, but these huge systems are not upgraded as readily as a home user, so how is it right, for the lack of a better term, that the project use better faster hardware out there, that as reason that they start to exclude stuff. If it wasn't for the extreme f@h'er there wouldn't have been a fraction of the extreme core counts.

Why not have a modifier that is applied to whatever project or wu type that is the most needed? So when smp is needed this factor is changed till the need is gone. Then if gpu wu types are needed it is then increased for the criticalperiod.
WooHoo = L5639 @ 3.3Ghz Evga SR-2 6x2gb Corsair XMS3 CM 212+ Corsair 1050hx Blackhawk Ultra EVGA 560ti

Foldie = i7 950@ 4.0Ghz x58a-ud3r 216-216 @ 850/2000 3x2gb OCZ Gold NH-u12 Heatsink Corsair hx520 Antec 900
Napoleon
Posts: 887
Joined: Wed May 26, 2010 2:31 pm
Hardware configuration: Atom330 (overclocked):
Windows 7 Ultimate 64bit
Intel Atom330 dualcore (4 HyperThreads)
NVidia GT430, core_15 work
2x2GB Kingston KVR1333D3N9K2/4G 1333MHz memory kit
Asus AT3IONT-I Deluxe motherboard
Location: Finland

Re: Change in BA requirements

Post by Napoleon »

DocJonz wrote:It has been said many times "equal pay for equal work" - but it has also been shown many times that the same 4P machine crunching SMP's or bigadv produces massively differing points - where's the equality? It's not there because the bigadv points were heavily inflated. Yes, I agree with 7im and Adak that obsolescence will come to bigadv machines - it comes to all hardware (we've seen it on old generation GPU's). The solution is not inflation of other WU types to compensate for the existing flaw in the scheme, but would it not be more sensible to gradually ease off the bigadv points over time to bring it back into check?
Doc, hopefully you don't mind me highlighting a couple of sentences I consider to be the essential parts of your post. As it happens, I agree with said essentials.

Since management/business analogies have been introduced to the discussion, I'll take a whack at it. Bear with me, I'm no management/business suit, just a poor copycat. :wink:

Anyway, times are harsh and some sort of compromise is called for. So, instead of letting a bunch of BA people go by raising the BA bar, would you as a whole accept a salary cut, say, -25% in PPD? BigAdv wouldn't be quite as "big" as it used to be, but in the light of current events, some action has to be taken. As per a message from our CEO (my highlight from http://folding.stanford.edu/home/change ... -full-fah/ ):
VijayPande wrote:With FAH GPU Core17 taking over the lion share of our calculations...
Seriously, wouldn't it be better to trim the fat from BA a bit, instead of fattening up everything else with it? And doing it less harshly than raising the bar to 24/32 cores on such a short notice? If you could rally behind something like "-25% salary cut", I do think it's something our DAB rep could actually present to PG as an alternative. If other DAB reps supported him, it'd carry even more weight.

Compromises are the sort of thing which makes everybody unhappy. However, all-out conflicts tend to have much more unpleasant consequences than some slight discomfort. On all sides.
Win7 64bit, FAH v7, OC'd
2C/4T Atom330 3x667MHz - GT430 2x832.5MHz - ION iGPU 3x466.7MHz
NaCl - Core_15 - display
orion
Posts: 135
Joined: Sun Dec 02, 2007 12:45 pm
Hardware configuration: 4p/4 MC ES @ 3.0GHz/32GB
4p/4x6128 @ 2.47GHz/32GB
2p/2 IL ES @ 2.7GHz/16GB
1p/8150/8GB
1p/1090T/4GB
Location: neither here nor there

Re: Change in BA requirements

Post by orion »

Napoleon wrote:Anyway, times are harsh and some sort of compromise is called for. So, instead of letting a bunch of BA people go by raising the BA bar, would you as a whole accept a salary cut, say, -25% in PPD?
The problem with that idea is donors who run 2p/4p would be getting less compensation for the cost of running these systems which is not inexpensive.

If more SMP's need to be run then make it worth everybody’s time to run them. 2p/4p, i7's, c2d's etc...etc... Increase their points...that way everyone who runs them wins.
iustus quia...
HaloJones
Posts: 906
Joined: Thu Jul 24, 2008 10:16 am

Re: Change in BA requirements

Post by HaloJones »

The hockey stick aspect of BA is what needs to change. It is ludicrous to me that returning work faster can have such an exponential effect. The way things are, one big rig (and for $7K I could pick up a 40-core Intel box) could be outproducing entire teams of dedicated folders.

It's not about increasing the others (although I do agree SMP has suffered over the last two years) but decreasing the BA QRB.
single 1070

Image
Locked