Large folding farm
Moderators: Site Moderators, FAHC Science Team
Large folding farm
hi all,
I know this is my first post but keep with me here!
I work at a school and we have just had over 500 brand new dell dual core 3ghz pc installed! so we have been folding for a while now but we are looking and making the process more streamlined. At the moment we have to install the folding smp client by hand on each pc (to get it to install as a service) and config each one to go out via our firewall.
Now what we want to do or hope is possible is to have a central folding collection and sending server! so that we can point each client to look at the server to collect it's work and then send it back to the server to send it off!
so any ideas????
I know this is my first post but keep with me here!
I work at a school and we have just had over 500 brand new dell dual core 3ghz pc installed! so we have been folding for a while now but we are looking and making the process more streamlined. At the moment we have to install the folding smp client by hand on each pc (to get it to install as a service) and config each one to go out via our firewall.
Now what we want to do or hope is possible is to have a central folding collection and sending server! so that we can point each client to look at the server to collect it's work and then send it back to the server to send it off!
so any ideas????
-
- Site Moderator
- Posts: 6349
- Joined: Sun Dec 02, 2007 10:38 am
- Location: Bordeaux, France
- Contact:
Re: Large folding farm
First point to clarify : do you have authorization (written is better) to install the client on those machines ?
-
- Posts: 44
- Joined: Fri Nov 07, 2008 9:46 pm
- Hardware configuration: WILKINS00:Intel Core2 Quad Q6600 2.4GHz 8GB PC6400/800MHz RAM Asus P5N32 Mobo Western Digital 160GB HD PNY GeForce 8800GT 256MB GDDR3
WILKINS02-Celeron D 2.8 GHz 2GB Corsair Value Select 80GB WD HD ATI RADEON HD 3450 Foxconn Mobo
WILKINS03(laptop)-Intel Core 2 Duo T7500 2.2GHz 2GB DDR2 RAM 160GB HD
RADIOSERVER-Pentium 4 3.2GHz 512mb DDR RAM 120GB HD - Contact:
Re: Large folding farm
On this matter i attend a school where we are looking into running fah as a service on a few computers and see how it goes. I s there any way of "pushing" it out on to multiple machines woth the correct configuration settings?
-
- Posts: 2948
- Joined: Sun Dec 02, 2007 4:36 am
- Hardware configuration: Machine #1:
Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).
Machine #2:
Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.
Machine 3:
Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32
I am currently folding just on the 5x GTX 460's for aprox. 70K PPD - Location: Salem. OR USA
Re: Large folding farm
Private distribution and collection servers are not supported. I suspect that the main reason is the potential for cheating. At one time (When there were deadlineness projects, one could collect up to 8 WU's at a time, but that went away when those projects disappeared. With convential projects, what happened was that people would filter out any projects that didn't have optimum PPD causing severe delays and thereby slowing down the science.
-
- Posts: 87
- Joined: Tue Jul 08, 2008 2:27 pm
- Hardware configuration: 1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers
Re: Large folding farm
I'm not sure I understand what would having a local proxy cache for WUs achieve. Can you explain why you think this would be useful?
If you are installing the machines you may be able to slipstream the SMP client in with the custom install disc.
If you are creating the machines from an image, then provided you have the SMP client already configured in the image, it should "just work". This is probably the easiest option.
If you are installing the machines you may be able to slipstream the SMP client in with the custom install disc.
If you are creating the machines from an image, then provided you have the SMP client already configured in the image, it should "just work". This is probably the easiest option.
Re: Large folding farm
As you say will save heaps of time!shatteredsilicon wrote: If you are creating the machines from an image, then provided you have the SMP client already configured in the image, it should "just work". This is probably the easiest option.
Does the SMP client store the UserID in Windows Registry like the other clients or does Deino/Mpich handle it differently through the user login? I messed up initially with my GPU machine images. Science was done but I didn't get the credit since UserID was same across the 6 machines.
If so do what someone else suggested. Search for 'Folding' and 'UserID' in registry and delete it before the client runs the first time. Maybe a little more complex if running as a service though.
Folding Tools:8 X PS3's, 5 x GTX280,1 x 8800GS, 8 x 9800GX2 GPU's
-
- Posts: 87
- Joined: Tue Jul 08, 2008 2:27 pm
- Hardware configuration: 1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers
Re: Large folding farm
AFAIK Windows client also stores settings in client.cfg, same as the Linux versions, so this shouldn't be a problem, provided you configure the correct client.cfg in the source image.
Re: Large folding farm
yeah we have all this all ready and the school are keen to support it!toTOW wrote:First point to clarify : do you have authorization (written is better) to install the client on those machines ?
one of the problems is folding never went on the original image so does need to have the service added (bit of a pain).
i can understand the point about cheating with local server's though!
Re: Large folding farm
Not wishing to prevent lots of valuable computing time but does your school understand the power costs of 500 24/7 folding machines?
single 1070
Re: Large folding farm
yeah they are all new efficient dell's! we have been folding for sometime just want to stream line the process's!
-
- Posts: 62
- Joined: Sun Dec 02, 2007 6:02 am
Re: Large folding farm
The main difference between Linux and Windoze clients is that Linux stores the UserID in the machinedependent.dat file and Windoze stores the User ID in the registry.shatteredsilicon wrote:AFAIK Windows client also stores settings in client.cfg, same as the Linux versions, so this shouldn't be a problem, provided you configure the correct client.cfg in the source image.
The client.cfg file is the same between OS's and it stores the Machine ID.
If you are going to make a ghost image in Windoze, you must remove the User ID from the registry before you make the image.
Otherwise Stanford cannot tell the computers apart, so you end up folding duplicate work for zero points.
Luck ...........
-
- Posts: 87
- Joined: Tue Jul 08, 2008 2:27 pm
- Hardware configuration: 1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers
Re: Large folding farm
Fascinating. How is this handled with the Linux client? What's the UserID actually for?Tigerbiten wrote:If you are going to make a ghost image in Windoze, you must remove the User ID from the registry before you make the image.
Otherwise Stanford cannot tell the computers apart, so you end up folding duplicate work for zero points.
-
- Site Admin
- Posts: 1288
- Joined: Fri Nov 30, 2007 9:37 am
- Location: Oxfordshire, UK
Re: Large folding farm
On Linux it's simple. Don't copy the machineindependant.dat and you'll be fine.
The UserID itself is used to uniquely identify your client(s) to the servers. The UserID and MachineID are combined to produce the "CPUID" that gets recorded by the servers.
The UserID itself is used to uniquely identify your client(s) to the servers. The UserID and MachineID are combined to produce the "CPUID" that gets recorded by the servers.
-
- Posts: 522
- Joined: Mon Dec 03, 2007 4:33 am
- Location: Australia
Re: Large folding farm
martynbez, the SMP client does not support restricting the CPU usage. It runs at full throttle all the time which may not be suitable for a school environment. Were you running the CPU (single core client) earlier? If so, I'd go for 2 copies of the same on each machine, with max CPU set to 90%.
-
- Posts: 87
- Joined: Tue Jul 08, 2008 2:27 pm
- Hardware configuration: 1x Q6600 @ 3.2GHz, 4GB DDR3-1333
1x Phenom X4 9950 @ 2.6GHz, 4GB DDR2-1066
3x GeForce 9800GX2
1x GeForce 8800GT
CentOS 5 x86-64, WINE 1.x with CUDA wrappers
Re: Large folding farm
It doesn't matter that it doesn't support CPU throttling. You can still set it to run at lowest possible priority, which does the job even better.