Client Setup Optimization Questions

Moderators: Site Moderators, FAHC Science Team

dawhippersnapper
Posts: 17
Joined: Wed Nov 21, 2012 5:51 pm
Hardware configuration: i7 3770, 2 x i7 2600k, gtx 680 SC+, 2x E7-4830, 4 x Xeon L5520, other random hardware
Location: Oklahoma

Client Setup Optimization Questions

Post by dawhippersnapper »

I am running a few clients that I'm wondering how to setup to get the most out of them.
I'm running the 7.2.9 client on everything, most of my clients are on windows. I tried to setup bigadv options on a 32 thread (16 core) E7 (2 x e7-4830)xeon server, and I get fairly low 16k to 40k PPD on SMP, and have never picked up any bigadv units that I can tell. Do bigadv units go to windows clients? I also have a few 16 thread (8 core) xeon servers that I'd like to do bigadv on.

I have 2 Intel i7 2600k dev servers on centos that I get between 14 and 26k ppd on. Does that seem optimal?

I have another Intel i7 3770 desktop with a gtx 680 gpu on windows, I don't have any special options setup on it, and get about 50k to 60k ppd from it when idle.

Do memory speeds or timings change ppd much? I have most of my motherboards maxed out on memory, and keep the timings at the highest are said to be allowed from intel, even thought the sticks are rated much faster.

I saw one place via google search that some people ran a linux virtual machine to run the client on to get better performance (or bigadv), is there evidence to suggest this would be a benefit?

I have many more servers I could put clients on, but I'm worried about the power draw possibly tripping a breaker. I'm also thinking about writing a script for scheduling the clients running so that during peak hours I can pause the clients.
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Client Setup Optimization Questions

Post by 7im »

Hello dawhippersnapper, welcome to the forum.

No BA on Windows.
Yes, linux gets slightly better PPD than Windows.
Faster memory speed helps, only slightly. GHz and core counts are the biggest factors.
Yes for Linux VMs, see first answer and second answer.
If scripting, look at using the command line only client described in the Linux Install Guide.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
Joe_H
Site Admin
Posts: 7901
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Client Setup Optimization Questions

Post by Joe_H »

First, some answers to your bigadv questions. One year ago PG announced that requirements for bigadv were moving to requiring 16 actual cores. Deadlines were also shortened. Those requirements were put into place earlier this year. So your 8 core Xeons probably can not complete current bigadv WU's within the deadlines. Your 16 core server is probably below the speed threshold to complete WU's for bigadv within the preferred deadline based on reports from other folders. But, currently the only bigadv WU's available are being assigned to Linux based folding clients. I don't know if that will change in the future.

Assuming you have a passkey entered, others can comment on whether the points yield is within the normal range for your systems. For the time being, SMP is pretty much what your servers can contribute.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
dawhippersnapper
Posts: 17
Joined: Wed Nov 21, 2012 5:51 pm
Hardware configuration: i7 3770, 2 x i7 2600k, gtx 680 SC+, 2x E7-4830, 4 x Xeon L5520, other random hardware
Location: Oklahoma

Re: Client Setup Optimization Questions

Post by dawhippersnapper »

Thanks for all of the info. I may attempt to setup a linux vm on the 16 core server and see if it does any good for a trial. I just did a little looking around and saw that the AMD server CPUs were doing way more PPD than comparably priced intel servers. I might have to make the next few server purchases AMD based for to be able to contribute a little more.

Most of my servers sit idle for a huge part of the day, and then based on cron job or user traffic have spikes. Before last month, I hadn't installed a folding client on any of my hardware since 2006, and magically went from 120,000 points to 2 million+. Seeing the jump in points has me motivated to try to contribute a lot more. http://kakaostats.com/dm.php?u=859159

Unfortunately the vast majority of my servers haven't required me to need to buy powerful CPUs, it's been more about storage and ram. I see what I can manage and possibly custom build some future servers to try to make them more powerful while meeting the other demands. I do have access to a huge amount of desktop workstations, but I'm going to guarantee that they'll trip breakers if I push them all to 100% cpu, plus that'd make for a huge electric bill. In two of my datacenter racks, electric usage is part of the "rent", but I only have 2 x 30 amp 240v drops on battery backup, so I have to worry about breakers tripping there too.
jrweiss
Posts: 704
Joined: Tue Dec 04, 2007 6:56 am
Hardware configuration: Ryzen 7 5700G, 22.40.46 VGA driver; 32GB G-Skill Trident DDR4-3200; Samsung 860EVO 1TB Boot SSD; VelociRaptor 1TB; MSI GTX 1050ti, 551.23 studio driver; BeQuiet FM 550 PSU; Lian Li PC-9F; Win11Pro-64, F@H 8.3.5.

[Suspended] Ryzen 7 3700X, MSI X570MPG, 32GB G-Skill Trident Z DDR4-3600; Corsair MP600 M.2 PCIe Gen4 Boot, Samsung 840EVO-250 SSDs; VelociRaptor 1TB, Raptor 150; MSI GTX 1050ti, 526.98 driver; Kingwin Stryker 500 PSU; Lian Li PC-K7B. Win10Pro-64, F@H 8.3.5.
Location: @Home
Contact:

Re: Client Setup Optimization Questions

Post by jrweiss »

The "pause on battery" feature should work with the battery backups, if you can connect the UPS to the machine via USB.
Ryzen 7 5700G, 22.40.46 VGA driver; MSI GTX 1050ti, 551.23 studio driver
Ryzen 7 3700X; MSI GTX 1050ti, 551.23 studio driver [Suspended]
dawhippersnapper
Posts: 17
Joined: Wed Nov 21, 2012 5:51 pm
Hardware configuration: i7 3770, 2 x i7 2600k, gtx 680 SC+, 2x E7-4830, 4 x Xeon L5520, other random hardware
Location: Oklahoma

Re: Client Setup Optimization Questions

Post by dawhippersnapper »

jrweiss wrote:The "pause on battery" feature should work with the battery backups, if you can connect the UPS to the machine via USB.
I didn't mean for that purpose. We have two huge battery backups that are in line with a diesel generator and commercial power from two different substations, no usb connections. Right now I have the 240v lines coming into the racks into PDUs that I think will trip the breaker at 20amp draw per section. We sometimes come a little close (15 amps) per section, and I think putting the client onto some of the older servers that wouldn't amount to much more PPD would be a bad idea.

I do use the pause on battery feature for my desktop and main laptop. The desktop battery backup with USB works remarkably well. I have the APC Back-UPS XS 1000, it shows I draw about 280w with the intel 3770 at 3.9ghz on 4 cores, and the nvidia 680 superclocked+ with a gold rated 1000w PSU. I have a 17" Macbook Pro laptop with i7 CPU, but it gets about 4k PPD so I don't really ever run it, as it makes it too hot and drains the battery even while plugged in.
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Client Setup Optimization Questions

Post by bruce »

Be sure you get WRITTEN permission to run FAH from the owner of the servers (since it seems likely that you don't own them). It's for your own protection as much as FAH's.

FAH runs at an extremely low priority so if during those bursts of activitiy, there's enough foreground work to keep all/most of your CPUs busy, FAH will yield processor resources rapidly and resume work rapidly when there are idle periods -- as long as there's RAM enough to hold inactive FAH pages, and it doesn't sound like that's evern going to be a problem. I believe that running FAH on all of the CPUs will have almost zero impact on "essential work."

FAH GPUs, whether AMD or NVidia, is in transition. A new points plan has been proposed which will generally increase the points over what GPUs have been getting. (The plan is being tested but not formally in place yet so it might still undergo some changes.) Equal-points-for-equal-work GPUs do not support task priority or preemptive task switching and we know of some reports of perceptible screen lag when FAH is sharing the GPU with the screen drivers. I'd worry about that a lot more than CPU sharing during production hours, but you have to be the judge of that.
dawhippersnapper
Posts: 17
Joined: Wed Nov 21, 2012 5:51 pm
Hardware configuration: i7 3770, 2 x i7 2600k, gtx 680 SC+, 2x E7-4830, 4 x Xeon L5520, other random hardware
Location: Oklahoma

Re: Client Setup Optimization Questions

Post by dawhippersnapper »

I have gotten permission a long time ago (my boss is the owner), and I own some of them myself.

I tested out one of the beta units, the scoring was pretty crazy (183,000 ppd on one gtx 680 sc+). The priority of the FAH works remarkably well on CPU, I haven't noticed any difference at all on request times from servers that run FAH, but when doing some tasks like media encoding using all available cores, I'd rather pause CPU folding programmatically.

I do have to pause the GPU client on my desktop though when I want to use it. It may be a good feature to detect mouse movement as an option for GPU folding pausing that pops up a box that allows you to resume folding when you are ready, or resume after a certain amount of idle time.
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Client Setup Optimization Questions

Post by bruce »

dawhippersnapper wrote:I do have to pause the GPU client on my desktop though when I want to use it. It may be a good feature to detect mouse movement as an option for GPU folding pausing that pops up a box that allows you to resume folding when you are ready, or resume after a certain amount of idle time.
There has been talk of a new FAH screensaver. No details nor any anticipated date, but that's fundamentally what you're talking about.
dawhippersnapper
Posts: 17
Joined: Wed Nov 21, 2012 5:51 pm
Hardware configuration: i7 3770, 2 x i7 2600k, gtx 680 SC+, 2x E7-4830, 4 x Xeon L5520, other random hardware
Location: Oklahoma

Re: Client Setup Optimization Questions

Post by dawhippersnapper »

That makes more sense, I was over thinking it.
Nathan_P
Posts: 1164
Joined: Wed Apr 01, 2009 9:22 pm
Hardware configuration: Asus Z8NA D6C, 2 x5670@3.2 Ghz, , 12gb Ram, GTX 980ti, AX650 PSU, win 10 (daily use)

Asus Z87 WS, Xeon E3-1230L v3, 8gb ram, KFA GTX 1080, EVGA 750ti , AX760 PSU, Mint 18.2 OS

Not currently folding
Asus Z9PE- D8 WS, 2 E5-2665@2.3 Ghz, 16Gb 1.35v Ram, Ubuntu (Fold only)
Asus Z9PA, 2 Ivy 12 core, 16gb Ram, H folding appliance (fold only)
Location: Jersey, Channel islands

Re: Client Setup Optimization Questions

Post by Nathan_P »

Your E7 machine is running slow - my dual L5640 machine can get 45k even in windows and clocks are the same, with more cores you should be nearer 50-55k. However there have been some results posted on a couple of the team forums that have proven that for folding LGA1567 is not the best and can easily get beaten by much less powerful hardware. These are dedicated though and i'm guessing that your machine isn't. Would be interesting to see some frame times from when the machine is idle to see what you are getting
Image
dawhippersnapper
Posts: 17
Joined: Wed Nov 21, 2012 5:51 pm
Hardware configuration: i7 3770, 2 x i7 2600k, gtx 680 SC+, 2x E7-4830, 4 x Xeon L5520, other random hardware
Location: Oklahoma

Re: Client Setup Optimization Questions

Post by dawhippersnapper »

Nathan_P wrote:Your E7 machine is running slow - my dual L5640 machine can get 45k even in windows and clocks are the same, with more cores you should be nearer 50-55k. However there have been some results posted on a couple of the team forums that have proven that for folding LGA1567 is not the best and can easily get beaten by much less powerful hardware. These are dedicated though and i'm guessing that your machine isn't. Would be interesting to see some frame times from when the machine is idle to see what you are getting
For this holiday slow down it's been doing a little better. Right now on a 6098 unit it's running at 5 minutes and 14 seconds TPF, and ~45k ppd. I've seen it get up to 60k on another WU wednesday evening. The normal total cpu load that it gets up to when FAH isn't running is ~10%, but that seems to drastically affect the PPD (mid 20s and sometimes lower).
Joe_H
Site Admin
Posts: 7901
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Client Setup Optimization Questions

Post by Joe_H »

dawhippersnapper wrote:The normal total cpu load that it gets up to when FAH isn't running is ~10%, but that seems to drastically affect the PPD (mid 20s and sometimes lower).
Yes, a low load can greatly impact the processing of SMP WU's as some threads get slowed down. The other threads spend time waiting on those slowed threads. Reducing the total threads assigned to folding in these cases can actually improve throughput, especially when some are being done on virtual cores from HT.
PinHead
Posts: 285
Joined: Tue Jan 24, 2012 3:43 am
Hardware configuration: Quad Q9550 2.83 contains the GPU 57xx - running SMP and GPU
Quad Q6700 2.66 running just SMP
2P 32core Interlagos SMP on linux

Re: Client Setup Optimization Questions

Post by PinHead »

dawhippersnapper wrote:I am running a few clients that I'm wondering how to setup to get the most out of them.
I'm running the 7.2.9 client on everything, most of my clients are on windows. I tried to setup bigadv options on a 32 thread (16 core) E7 (2 x e7-4830)xeon server, and I get fairly low 16k to 40k PPD on SMP
These values look incorrect ( even though windows will not receive BA ), does the slot on the 7.2.9 client for smp show as "smp:32" ? Unless that server is heavily loaded 24/7, then it might make sense.
Napoleon
Posts: 887
Joined: Wed May 26, 2010 2:31 pm
Hardware configuration: Atom330 (overclocked):
Windows 7 Ultimate 64bit
Intel Atom330 dualcore (4 HyperThreads)
NVidia GT430, core_15 work
2x2GB Kingston KVR1333D3N9K2/4G 1333MHz memory kit
Asus AT3IONT-I Deluxe motherboard
Location: Finland

Re: Client Setup Optimization Questions

Post by Napoleon »

If you're into tweaking, you might want to try smp:16 and check your logical CPU to physical core/CPU mapping using CoreInfo. Then you can use some app like Process Lasso to automatically enforce the affinity of the FahCore_??.exe process approriately. I do so to funnel floating point work and integer work on my 2C/4T machine, and I've found it's surprisingly effective, viewtopic.php?f=15&t=20543#p205366.

Of course, the scale is quite different in your case, but I believe the idea remains valid nevertheless. FAH will keep the 16 physical FPUs busy at all times, yet leaves you 16 free threads. If the normal workload happens to be integer intensive, you just might be lucky enough to wring good FPU/ALU concurrency out of your server.
Win7 64bit, FAH v7, OC'd
2C/4T Atom330 3x667MHz - GT430 2x832.5MHz - ION iGPU 3x466.7MHz
NaCl - Core_15 - display
Post Reply