Large folding farm

Moderators: Site Moderators, FAHC Science Team

Post Reply
martynbez
Posts: 10
Joined: Sat Nov 15, 2008 9:05 pm

Large folding farm

Post by martynbez »

hi all,

I know this is my first post but keep with me here!

I work at a school and we have just had over 500 brand new dell dual core 3ghz pc installed! so we have been folding for a while now but we are looking and making the process more streamlined. At the moment we have to install the folding smp client by hand on each pc (to get it to install as a service) and config each one to go out via our firewall.

Now what we want to do or hope is possible is to have a central folding collection and sending server! so that we can point each client to look at the server to collect it's work and then send it back to the server to send it off!

so any ideas????
toTOW
Site Moderator
Posts: 6349
Joined: Sun Dec 02, 2007 10:38 am
Location: Bordeaux, France
Contact:

Re: Large folding farm

Post by toTOW »

First point to clarify : do you have authorization (written is better) to install the client on those machines ?
Image

Folding@Home beta tester since 2002. Folding Forum moderator since July 2008.
batman113
Posts: 44
Joined: Fri Nov 07, 2008 9:46 pm
Hardware configuration: WILKINS00:Intel Core2 Quad Q6600 2.4GHz 8GB PC6400/800MHz RAM Asus P5N32 Mobo Western Digital 160GB HD PNY GeForce 8800GT 256MB GDDR3
WILKINS02-Celeron D 2.8 GHz 2GB Corsair Value Select 80GB WD HD ATI RADEON HD 3450 Foxconn Mobo
WILKINS03(laptop)-Intel Core 2 Duo T7500 2.2GHz 2GB DDR2 RAM 160GB HD
RADIOSERVER-Pentium 4 3.2GHz 512mb DDR RAM 120GB HD
Contact:

Re: Large folding farm

Post by batman113 »

On this matter i attend a school where we are looking into running fah as a service on a few computers and see how it goes. I s there any way of "pushing" it out on to multiple machines woth the correct configuration settings?
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: Large folding farm

Post by P5-133XL »

Private distribution and collection servers are not supported. I suspect that the main reason is the potential for cheating. At one time (When there were deadlineness projects, one could collect up to 8 WU's at a time, but that went away when those projects disappeared. With convential projects, what happened was that people would filter out any projects that didn't have optimum PPD causing severe delays and thereby slowing down the science.
Image
shatteredsilicon
Posts: 87
Joined: Tue Jul 08, 2008 2:27 pm
Hardware configuration: 1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers

Re: Large folding farm

Post by shatteredsilicon »

I'm not sure I understand what would having a local proxy cache for WUs achieve. Can you explain why you think this would be useful?

If you are installing the machines you may be able to slipstream the SMP client in with the custom install disc.

If you are creating the machines from an image, then provided you have the SMP client already configured in the image, it should "just work". This is probably the easiest option.
Image
1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers
Drugless
Posts: 58
Joined: Wed Jan 09, 2008 7:55 pm
Location: Durban, South Africa

Re: Large folding farm

Post by Drugless »

shatteredsilicon wrote: If you are creating the machines from an image, then provided you have the SMP client already configured in the image, it should "just work". This is probably the easiest option.
As you say will save heaps of time!
Does the SMP client store the UserID in Windows Registry like the other clients or does Deino/Mpich handle it differently through the user login? I messed up initially with my GPU machine images. Science was done but I didn't get the credit since UserID was same across the 6 machines. :oops:
If so do what someone else suggested. Search for 'Folding' and 'UserID' in registry and delete it before the client runs the first time. Maybe a little more complex if running as a service though. :?:
Image
Folding Tools:8 X PS3's, 5 x GTX280,1 x 8800GS, 8 x 9800GX2 GPU's
shatteredsilicon
Posts: 87
Joined: Tue Jul 08, 2008 2:27 pm
Hardware configuration: 1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers

Re: Large folding farm

Post by shatteredsilicon »

AFAIK Windows client also stores settings in client.cfg, same as the Linux versions, so this shouldn't be a problem, provided you configure the correct client.cfg in the source image.
Image
1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers
martynbez
Posts: 10
Joined: Sat Nov 15, 2008 9:05 pm

Re: Large folding farm

Post by martynbez »

toTOW wrote:First point to clarify : do you have authorization (written is better) to install the client on those machines ?
yeah we have all this all ready and the school are keen to support it!

one of the problems is folding never went on the original image so does need to have the service added (bit of a pain).

i can understand the point about cheating with local server's though!
HaloJones
Posts: 906
Joined: Thu Jul 24, 2008 10:16 am

Re: Large folding farm

Post by HaloJones »

Not wishing to prevent lots of valuable computing time but does your school understand the power costs of 500 24/7 folding machines?
single 1070

Image
martynbez
Posts: 10
Joined: Sat Nov 15, 2008 9:05 pm

Re: Large folding farm

Post by martynbez »

yeah they are all new efficient dell's! we have been folding for sometime just want to stream line the process's!
Tigerbiten
Posts: 62
Joined: Sun Dec 02, 2007 6:02 am

Re: Large folding farm

Post by Tigerbiten »

shatteredsilicon wrote:AFAIK Windows client also stores settings in client.cfg, same as the Linux versions, so this shouldn't be a problem, provided you configure the correct client.cfg in the source image.
The main difference between Linux and Windoze clients is that Linux stores the UserID in the machinedependent.dat file and Windoze stores the User ID in the registry.
The client.cfg file is the same between OS's and it stores the Machine ID.

If you are going to make a ghost image in Windoze, you must remove the User ID from the registry before you make the image.
Otherwise Stanford cannot tell the computers apart, so you end up folding duplicate work for zero points.

Luck ........... :D
shatteredsilicon
Posts: 87
Joined: Tue Jul 08, 2008 2:27 pm
Hardware configuration: 1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers

Re: Large folding farm

Post by shatteredsilicon »

Tigerbiten wrote:If you are going to make a ghost image in Windoze, you must remove the User ID from the registry before you make the image.
Otherwise Stanford cannot tell the computers apart, so you end up folding duplicate work for zero points.
Fascinating. How is this handled with the Linux client? What's the UserID actually for?
Image
1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers
uncle_fungus
Site Admin
Posts: 1288
Joined: Fri Nov 30, 2007 9:37 am
Location: Oxfordshire, UK

Re: Large folding farm

Post by uncle_fungus »

On Linux it's simple. Don't copy the machineindependant.dat and you'll be fine.
The UserID itself is used to uniquely identify your client(s) to the servers. The UserID and MachineID are combined to produce the "CPUID" that gets recorded by the servers.
anandhanju
Posts: 522
Joined: Mon Dec 03, 2007 4:33 am
Location: Australia

Re: Large folding farm

Post by anandhanju »

martynbez, the SMP client does not support restricting the CPU usage. It runs at full throttle all the time which may not be suitable for a school environment. Were you running the CPU (single core client) earlier? If so, I'd go for 2 copies of the same on each machine, with max CPU set to 90%.
shatteredsilicon
Posts: 87
Joined: Tue Jul 08, 2008 2:27 pm
Hardware configuration: 1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers

Re: Large folding farm

Post by shatteredsilicon »

It doesn't matter that it doesn't support CPU throttling. You can still set it to run at lowest possible priority, which does the job even better.
Image
1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers
Post Reply