Need advise for server farm

If you're new to FAH and need help getting started or you have very basic questions, start here.

Moderators: Site Moderators, FAHC Science Team

mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

Ok the Server is up and running !! :) Im interested in bigadv, i think this proliant should work great for that. Here are the spec's:
Hp Poliant DL858 G6
CPU : 4 x 6core AMD Opterton 8431
CPUID : Family 16 Model 8 Stepping 0
RAM : 32gb (not sure speed)
Os : Win Server 2012 Standard

Right now the client is telling me that PPD is 29848 and slowly rising. I feel like this is still very low, my personal pc will run 40k+PPD... What do you guys think im doing wrong?
mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

Another Question that comes to mind; Can i link all 4 servers to the same project to complete them faster?
Joe_H
Site Admin
Posts: 7937
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Need advise for server farm

Post by Joe_H »

mark5365 wrote:Another Question that comes to mind; Can i link all 4 servers to the same project to complete them faster?
No, the F@H client and folding cores do not support clusters. Nor do the assignment servers support just assigning WU's from a single Project to a group of systems. Attempts to do so on your own would be a violation of the license and the Best Practices quide.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Zagen30
Posts: 823
Joined: Tue Mar 25, 2008 12:45 am
Hardware configuration: Core i7 3770K @3.5 GHz (not folding), 8 GB DDR3 @2133 MHz, 2xGTX 780 @1215 MHz, Windows 7 Pro 64-bit running 7.3.6 w/ 1xSMP, 2xGPU

4P E5-4650 @3.1 GHz, 64 GB DDR3 @1333MHz, Ubuntu Desktop 13.10 64-bit

Re: Need advise for server farm

Post by Zagen30 »

mark5365 wrote:Right now the client is telling me that PPD is 29848 and slowly rising. I feel like this is still very low, my personal pc will run 40k+PPD... What do you guys think im doing wrong?
Can you go over to the logs and post a large chunk of it here, one that includes both the project number and several percent of its progress? The PPD estimate that the client provides isn't always accurate. Actually, you could double-check it yourself by going here and inputting the project number and average frame time.

Also check Task Manager to see if there are any other processes consistently using CPU time. Multi-core folding only progresses as fast as the slowest thread; another task continually taking up even a few percent of one core can drastically increase frame times.
Image
TheWolf
Posts: 288
Joined: Thu Jan 24, 2008 10:34 am

Re: Need advise for server farm

Post by TheWolf »

You'll have to setup and use the -bigadv flag to get bigadv work units if you haven't already.
As stated you either have something using CPU cycles other than folding or a standard
smp work unit working some of which can have some low PPD. Best to post the Project number
its running and some of the time data from that project. Then they can tell you more.
Grandpa_01
Posts: 1122
Joined: Wed Mar 04, 2009 7:36 am
Hardware configuration: 3 - Supermicro H8QGi-F AMD MC 6174=144 cores 2.5Ghz, 96GB G.Skill DDR3 1333Mhz Ubuntu 10.10
2 - Asus P6X58D-E i7 980X 4.4Ghz 6GB DDR3 2000 A-Data 64GB SSD Ubuntu 10.10
1 - Asus Rampage Gene III 17 970 4.3Ghz DDR3 2000 2-500GB Segate 7200.11 0-Raid Ubuntu 10.10
1 - Asus G73JH Laptop i7 740QM 1.86Ghz ATI 5870M

Re: Need advise for server farm

Post by Grandpa_01 »

mark5365 wrote:Ok the Server is up and running !! :) Im interested in bigadv, i think this proliant should work great for that. Here are the spec's:
Hp Poliant DL858 G6
CPU : 4 x 6core AMD Opterton 8431
CPUID : Family 16 Model 8 Stepping 0
RAM : 32gb (not sure speed)
Os : Win Server 2012 Standard

Right now the client is telling me that PPD is 29848 and slowly rising. I feel like this is still very low, my personal pc will run 40k+PPD... What do you guys think im doing wrong?
There is no Windows bigadv WU's, bigadv is LInux only so you will not be able to run Bigadv unless you chang to a Linux OS. As far as your current PPD goes are your running -smp 24 have you checked to see if the cpu's are 100% loaded.
Image
2 - SM H8QGi-F AMD 6xxx=112 cores @ 3.2 & 3.9Ghz
5 - SM X9QRI-f+ Intel 4650 = 320 cores @ 3.15Ghz
2 - I7 980X 4.4Ghz 2-GTX680
1 - 2700k 4.4Ghz GTX680
Total = 464 cores folding
mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

The proliant client is at 35463 PPD now and all cores are maxed out @ 100%. i still feel like running a linux VM box would make this faster. I will look around today and see what i can find.
Amaruk
Posts: 254
Joined: Fri Jun 20, 2008 3:57 am
Location: Watching from the Woods

Re: Need advise for server farm

Post by Amaruk »

mark5365 wrote:...i still feel like running a linux VM box would make this faster...
Yes.

Linux VM > Windows, native Linux > VM.
Image
Quisarious
Posts: 54
Joined: Thu Dec 13, 2012 6:16 pm

Re: Need advise for server farm

Post by Quisarious »

Amaruk wrote:
mark5365 wrote:...i still feel like running a linux VM box would make this faster...
Yes.

Linux VM > Windows, native Linux > VM.
Getting a linux VM to efficiently use a lot of cores is not trivial though. Unless you need bare metal access in windows, running native linux with a windows VM is a better option from a folding perspective.
mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

The reason im running windows server 2012 is so that i can learn and get used to all the changes. I own decent sized computer, tablet, smartphone repair shop so i need to learn as much as i can without stepping in a classroom. Bad part is most all medium sized businesses are only running windows servers or have only heard of windows so learning linux outside of a VM is not good for me.

Another Update
So i picked up 2 more ProLiant DL585 G5 (only 4x 4core Opertrons) and shut down the dell PowerEdges. So now i have 24/16/16/8/4 core machines in this farm Folding@home :)

I will start working on The VMware tonight and hope to have everything working by the end of the weekend.

Dose anyone have a save for linux with F@H already installed that i can use for the VMware? Long time ago i have one that was super simple to setup but i dont remember what the name of it was. Any help here would be greatly appreciated to speed this process up. Time is hard to come by and i have already put about 50hrs this week into get the servers, installing them, and loading them. On top of working 50hrs....

Thank again,
Mark
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Need advise for server farm

Post by PantherX »

I am not sure if that VM could be distributed since the EULA states that the Client can only be downloaded from Stanford's site (and it's partners). Thus, having the F@H Client installed in the VM being distributed would be a violation of the EULA.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

Image

what am i doing wrong here? 80% for a total of 44k DDP... still seems very low for 24 cores...
mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

Image
Here is fahmon... this is not going to make the deadline... im really feeling lost...
here are the other 2 16 core servers. they have the same specs not sure why they are not doing the same PPD...
Image
Image
Zagen30
Posts: 823
Joined: Tue Mar 25, 2008 12:45 am
Hardware configuration: Core i7 3770K @3.5 GHz (not folding), 8 GB DDR3 @2133 MHz, 2xGTX 780 @1215 MHz, Windows 7 Pro 64-bit running 7.3.6 w/ 1xSMP, 2xGPU

4P E5-4650 @3.1 GHz, 64 GB DDR3 @1333MHz, Ubuntu Desktop 13.10 64-bit

Re: Need advise for server farm

Post by Zagen30 »

In the first screenshot you posted, it's not starting up three copies of the client, is it? The text after "Manual Startup" shows three Start commands, but I can't tell if it's running them all or if it's just echoing different options. If it is that, figure out how to only run the bigadv instance and not the other two. If it's not that, then check to see if there are any other tasks using up a lot of CPU time.

Is the machine in the first screenshot the 24-core server? If so you might try changing the "-smp" flag to "-smp 24". I'm not sure if the v6 client by default will attempt to handle that many threads.

As to the 16-core servers, I would look at the log files to see what the actual TPF's are. v7's PPD estimates are known to be off sometimes. I would have said "different projects have different PPD" but it looks like they're both running 7808's. It's not unknown for different WUs from the same project to run with different TPFs on the same hardware, though, and I can't make out how different they are from that screenshot.
Image
mark5365
Posts: 14
Joined: Wed May 01, 2013 12:27 am

Re: Need advise for server farm

Post by mark5365 »

Image
Image
Post Reply