Points are (or should be) social engineering

Moderators: Site Moderators, FAHC Science Team

Post Reply
rpmouton
Posts: 40
Joined: Mon Jun 23, 2008 1:09 pm
Hardware configuration: 1-MSI 990FXA-GD65V2 AM3+, AMD FX-8120 8-Core Black Edition-3.1 GHz, Mushkin Enhanced Blackline 8GB (2 x 4GB) 1600 MHz and ASUS GeForce GTX 550 Ti. Win 7 64x, 7.1x client with SMP and GPU slots ~14k ppd

2-ASUS M2NE-SLI AM2, AMD Phenom 4 @ 2.3 GHZ, 4 GB @ 800 MHz and ASUS GeForce GTX 550 Ti. Win Vista 64x, 7.1x client with SMP and GPU slots ~10k ppd

3-MSI 785GTM-E45 AM2+, AMD Phenom 4 Propus @ 3 GHZ, 4GB @ 800 MHZ, Win 7 64x, 7.1x client with SMP slots ~4k ppd

4-DELL 2950 Gen III, 2 Xeon E5405 Quad core @ 2GHz, 8 GB @ 669MHz, Ubuntu 12.04, 7.1 client with one SMP slot (bigadv) ~12k ppd
Location: Orlando, Florida

Points are (or should be) social engineering

Post by rpmouton »

Hey people,

Although not quite a noob, I am relatively new to FAH having only been folding since early spring.

I have been exploring the forum and am somewhat perplexed by some of the angst about points per project/platform.

Right now, points say put more nVidia GPU's on-line, run SMP even if you only have two cores, run mono cpu clients only as a last resort to squeeze the last 130ppd out of a rig already running a GPU client.

As for the PS3, at 900 ppd and its 180 watts power requirement, it is becoming increasing irrelevant for those who are running enough FAH to be concerned about paying the electric bill. Add the fact that the PS3 can't even browse the web while running FAH* and it is hard to justify even turning it on (understanding that it is a tool for getting additional machines/people involved in FAH).

*you actually can but try to load a large page like Kakao stats and it crashes

While discussions about the relative processing power of nVidia versus ATI are interesting in their own right, the hard adherence to benchmark-based point determination misses the fact that some science is better performed on different platforms--This is as assumption , as it has been stated here, but the points don't reflect it.

The question "Are you interested in ppd or science?" is (or should be) nonsensical as the points should reflect the science needs of the day and not some arbitrary GFLOP number or WU completion time. Otherwise, we might as well give out points for watts consumed and the cost of hardware to consume them as it would more accurately reflect the actual donations being made by members of the community.

I know that there are some seemingly arbitrary points bonuses for Beta clients and quick turn WU's and that is as it should be. Those point bonuses should probably be extended to the Beta WU's and cores as well.

I guess my main point is that the Pande group should not be bound by previous point determinations or benchmark hardware performance when it stops being the right thing to do and the community should encourage such flexibility.

Anyway, enough spouting off, it has been a pleasure reading many of your posts and using the forum to get my new multi GPU client and core affinity settings correct as well as stretching my Windows knowledge and getting my computer hardware knowledge more up to date.

Best regards,
Roger
EvilAlchemist
Posts: 53
Joined: Fri Feb 08, 2008 4:24 pm
Hardware configuration: 2 x X5550 Xeons - SuperMicro MBD-X8DAi-O
Server 2008 R2 x64 - 12GB Crucial DDR3 ECC Ram
PCP&C 910 Silencer - 1 x HIS 4850 ICEQ Turbo Edition

6 x E5530 Xeons (3 Systems) - SUPERMICRO MBD-X8DTL-i-O
Server 2008 RS x64 - 8GB DDR3 GSkill Non-ECC Ram
Seasonic 80+ Bronze 380w PSU

2 x E5504 - SUPERMICRO MBD-X8DTL-i-O
Server 2008 R2 x64 - 6GB DDR3 GSkill Non-ECC Ram
2.3 TB Raid 5 Array - Corsair 520 Power Supply

E5504 - EVGA X58 ATX Motherboard
Windows 7 x64 - 6GB DDR3 GSkill Non-ECC Ram
Seasonic 300 Power Supply

Intel X5550 CPU - EVGA X58 Micro ATX Motherboard
Windows 7 x64 - 3GB Corsair DDR3-1600
Corsair 550 Power Supply - ATI 4350

Dell Vostro 1500 Laptop - Intel T9300 C2D CPU
Windows 7 x64 - 4 GB DDR2-6400 - nVidia 8400m GS

Xeon 3075 C2D - Intel P35 Motherboard - 4GB DDR2 Non-ECC Ram
Server 2008 R2 x64- Seasonic 300 Power Supply
Location: Columbia, Tennessee
Contact:

Re: Points are (or should be) social engineering

Post by EvilAlchemist »

IF you have a chance, go read this posts.

viewtopic.php?f=47&t=4812

We had some good ideas there, and Vijay is aware of the last thread and reviewing it with his team.

It is a very complex problem & it is actually being looked into.
rpmouton
Posts: 40
Joined: Mon Jun 23, 2008 1:09 pm
Hardware configuration: 1-MSI 990FXA-GD65V2 AM3+, AMD FX-8120 8-Core Black Edition-3.1 GHz, Mushkin Enhanced Blackline 8GB (2 x 4GB) 1600 MHz and ASUS GeForce GTX 550 Ti. Win 7 64x, 7.1x client with SMP and GPU slots ~14k ppd

2-ASUS M2NE-SLI AM2, AMD Phenom 4 @ 2.3 GHZ, 4 GB @ 800 MHz and ASUS GeForce GTX 550 Ti. Win Vista 64x, 7.1x client with SMP and GPU slots ~10k ppd

3-MSI 785GTM-E45 AM2+, AMD Phenom 4 Propus @ 3 GHZ, 4GB @ 800 MHZ, Win 7 64x, 7.1x client with SMP slots ~4k ppd

4-DELL 2950 Gen III, 2 Xeon E5405 Quad core @ 2GHz, 8 GB @ 669MHz, Ubuntu 12.04, 7.1 client with one SMP slot (bigadv) ~12k ppd
Location: Orlando, Florida

Re: Points are (or should be) social engineering

Post by rpmouton »

Thanks EvilAlchemist for the link, that thread happened while I was out of town and I had missed it.

Excellent thread and shows some of the social engineering challenges that the Pande group has to deal with. It is clear that they feel pressured by the community to resolve perceived point imbalances and it is up to us to allow them the scope to make changes without staging a revolt.

later,
Roger
Edboard
Posts: 8
Joined: Sat Jun 21, 2008 11:02 am
Hardware configuration: a
Location: Barcelona, Spain

Re: Points are (or should be) social engineering

Post by Edboard »

I would like to know if there is any two WUs that do the same scientific work (folding the same molecule, etc.), the first in mono CPU client and the second in GP2 client, so we can compare directly the speed difference related to clients.
Image
Mitsimonsta
Posts: 30
Joined: Tue Feb 12, 2008 1:53 am

Re: Points are (or should be) social engineering

Post by Mitsimonsta »

I am still wondering why there is no measure of simulation time provided for by the stats.

Obviously there is a MASSIVE db there with all the user results in it. Now the average simulation time in ns is known for each unit (and possible more granular than that, obviously we know that some units mysteriously became more complex half way through), so these values could be assigned into the stats as a total ns simulation time donated.

Yes, I know that this is not a fair measure of the scientific value of the work, but could be helpful to see how adding new clients adds to the amount of simulation going on.
Image
SKeptical_Thinker
Posts: 76
Joined: Tue Apr 29, 2008 11:02 pm
Hardware configuration: XP-32 Pro SP-3
Antec NSK-2480 with two Thermaltake 120mm Smart Fans
Gigabyte ga-ma78gm-s2h 780G IGP
BE-2350 with 10.5 x multiplier, 1.250V in BIOS, clock at 272 (2.856GHz)
EVGA 8800 GS
Ninja Mini CPU HS
GeIL 4GB (2 x 2GB) 240-Pin DDR2 SDRAM DDR2 800
Seagate 500GB SATA hard drive
ASUS 18X DVD±R DVD Burner PATA Model DRW-1814BL

Re: Points are (or should be) social engineering

Post by SKeptical_Thinker »

Mitsimonsta wrote:I am still wondering why there is no measure of simulation time provided for by the stats.

Obviously there is a MASSIVE db there with all the user results in it. Now the average simulation time in ns is known for each unit (and possible more granular than that, obviously we know that some units mysteriously became more complex half way through), so these values could be assigned into the stats as a total ns simulation time donated.

Yes, I know that this is not a fair measure of the scientific value of the work, but could be helpful to see how adding new clients adds to the amount of simulation going on.
Points are awarded (correctly, in my view) based on the scientific value of the task. It appears that many folders think the points should reflect the computational difficulty of the task. That seems like a reasonable viewpoint for folders because they provide the resources required to complete the tasks.

I don't see that the scientific value of a simulation is only related to the computational difficulty of performing it. Timing in relation to other simulations being run in parallel, velocity impact on simulations that depend on the current task etc, also have an impact on the "scientific value" of a task, but have little to do with computational difficulty. Dealing with those factors would greatly increase the complexity of, and therefore, arguments about, the point system

I don't envy Standford as they try to sort this out.
Last edited by SKeptical_Thinker on Wed Aug 27, 2008 4:11 pm, edited 1 time in total.
Image
Foxery
Posts: 118
Joined: Mon Mar 03, 2008 3:11 am
Hardware configuration: Intel Core2 Quad Q9300 (Intel P35 chipset)
Radeon 3850, 512MB model (Catalyst 8.10)
Windows XP, SP2
Location: Syracuse, NY

Re: Points are (or should be) social engineering

Post by Foxery »

This thread again? We just went through this last week. And the week before that. Go to your local soup kitchen or rescue mission, and tell them they're doing it wrong, too.
Core2 Quad/Q9300, Radeon 3850/512MB (WinXP SP2)
Ren02
Posts: 98
Joined: Tue Dec 11, 2007 1:16 am
Location: Estonia

Re: Points are (or should be) social engineering

Post by Ren02 »

Maybe Stanford could separate the points based on client? The whole idea of using a single metric here is like comparing apples to oranges.
I mean I currently have 1.2 million points which might seem a lot.
But it could be separated as:
900,000 SMP points, which is decent but nothing special compared to other long-time SMP folders.
270,000 GPU2 points, which is quite meager compared to other GPU2 folders.
30,000 CPU points, which is a joke compared to long-time CPU folders
0 GPU points..
0 PS3 points..

That way it would still be a challenge to catch a team-mate who's got 100,000 CPU points. You wouldn't be able to "cheat" by buying a 8800GS and letting it run for 3 weeks. No. You'd need a Core 2 Quad to run 4 CPU clients for half a year! :D

Edit: fixed the point values for various clients..
Image
imabluesman2
Posts: 7
Joined: Sat Aug 16, 2008 5:07 pm
Location: Curacao NA

Re: Points are (or should be) social engineering

Post by imabluesman2 »

Foxery wrote:This thread again? We just went through this last week. And the week before that. Go to your local soup kitchen or rescue mission, and tell them they're doing it wrong, too.
I agree.

But on the other hand, I think I read somewhere the points are awarded as an extra stimulus to start/keep people folding.
Apparently, people are more inclined to participate if there's some kind of competition going on.
So if people start to get disappointed for not being able to compete against the newer/faster processors, the system of awarding points might become contraproductive.
It would be missing the point, so to speak.
Mitsimonsta
Posts: 30
Joined: Tue Feb 12, 2008 1:53 am

Re: Points are (or should be) social engineering

Post by Mitsimonsta »

Why are we arguing over points? I think there is a worthwhile discussion here for us to calmly put forward ideas to make the points system better for all concerned.

I do like the idea of splitting each contributor's points by client - it gives a much nicer picture of what you have actually achieved. Anyone with millions of standard client points should have everyone's respect as they did heaps of science to gain those sort of points. You could even break the standard client down into the various cores (Tinkers, Gromacs, Amber, QMD, Gro33, DGromacs etc).
Image
Mattus
Posts: 8
Joined: Sat Mar 29, 2008 3:18 am
Hardware configuration: Intel Q6600 @ 3.1Ghz, GeForce 8800GT, 4GB DDR2 RAM, ASUS P5Q Pro
Windows 7 64-bit
Location: Leighton Buzzard / Oxford, UK
Contact:

Re: Points are (or should be) social engineering

Post by Mattus »

I agree that it would be nice for the stats to break down a user's points into CPU, SMP, GPU, PS3 etc. However, the user's total points should remain the most important figure. My points score is the only way I can compare the work I've done to that of another member. A few of us in my team are doing a 'race to one million', and this kind of thing would be impossible if there were many different kinds of points. The current system may not always be fair but at least it's a common foundation that everybody can relate to.
Mitsimonsta wrote:Anyone with millions of standard client points should have everyone's respect as they did heaps of science to gain those sort of points.
On the other hand, the SMP client requires a much greater time commitment (systems have to be on most of the time, and the client quite often needs prodding.) IMO this justifies the points boost over the standard 'set it and forget it' client.
folding proudly for team 10, OcUK ¦ what am I folding?
Flathead74
Posts: 266
Joined: Sun Dec 02, 2007 6:08 pm
Location: Central New York
Contact:

Re: Points are (or should be) social engineering

Post by Flathead74 »

Mattus wrote:I agree that it would be nice for the stats to break down a user's points into CPU, SMP, GPU, PS3 etc. However, the user's total points should remain the most important figure. My points score is the only way I can compare the work I've done to that of another member. A few of us in my team are doing a 'race to one million', and this kind of thing would be impossible if there were many different kinds of points. The current system may not always be fair but at least it's a common foundation that everybody can relate to.
Mitsimonsta wrote:Anyone with millions of standard client points should have everyone's respect as they did heaps of science to gain those sort of points.
On the other hand, the SMP client requires a much greater time commitment (systems have to be on most of the time, and the client quite often needs prodding.) IMO this justifies the points boost over the standard 'set it and forget it' client.
Not quite so in the earlier days.
There were some tough times then, also, and making more than a few points per hour was huge.
Post Reply