Windows: use more than 32 cores?

Moderators: Site Moderators, FAHC Science Team

Post Reply
Spurkey
Posts: 2
Joined: Fri Mar 13, 2020 7:01 am

Windows: use more than 32 cores?

Post by Spurkey »

I have 2 Windows machines that FAH is limiting to 32 cores. Machine 1 is a Xeon W-2195 (18 physical, 36 logical cores), machine 2 is a Threadripper 2990WX (32 physical, 64 logical cores). Both machines are running Win10 Enterprise 64-bit. FAH limits the work it does on both machines to 32 cores, and no adding a second slot doesn't fix it - that just makes 2 CPU slots with 16 cores.

My suspicion is that this happens because the client wrapper is 32-bit. The worker core apps are 64-bit, they're separate entirely from the client, but the bit that partitions out the work appears to be 32-bit - 32-bit apps cannot use more than 32 cores. In the System Info tab under the Build heading the Platform entry is listed as "win32 10" and the Bits entry is "32".

Might it be possible to get a version with a 64-bit Windows client?
foldy
Posts: 2040
Joined: Sat Dec 01, 2012 3:43 pm
Hardware configuration: Folding@Home Client 7.6.13 (1 GPU slots)
Windows 7 64bit
Intel Core i5 2500k@4Ghz
Nvidia gtx 1080ti driver 441

Re: Windows: use more than 32 cores?

Post by foldy »

Yes you can add a second CPU slot and configure both CPU slots to use 32 threads each.
Spurkey
Posts: 2
Joined: Fri Mar 13, 2020 7:01 am

Re: Windows: use more than 32 cores?

Post by Spurkey »

Well poo. If a second slot is added and the CPU count left at -1 (for the Threadripper the thinking was that this would still allocate 32 each) for both it doesn't work; if the cores are explicitly specified for each slot then yes it does work.

The question still remains: why is there no 64-bit client for Windows? The workers are 64-bit. A 64-bit client would remove the need to do this.
JimboPalmer
Posts: 2522
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: Windows: use more than 32 cores?

Post by JimboPalmer »

Spurkey wrote:The question still remains: why is there no 64-bit client for Windows? The workers are 64-bit. A 64-bit client would remove the need to do this.
Because a 64 bit client would not solve this proble., (and the F@H programmer would have to coordinate 4 clients instead of 3, slowing down all development)

There are Windows issues using more than 32 cores in a single application, but that is not solved with a new client. It is solved by Enterprise Windows
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Windows: use more than 32 cores?

Post by bruce »

Have you purchased an Enterprise Windows license or a Home Windows license?
Joe_H
Site Admin
Posts: 7937
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Windows: use more than 32 cores?

Post by Joe_H »

Besides what has been mentioned so far about the client being 32-bit, that is the FAHClient portion which does not do the actual calculations. It handles downloading and uploading WU's, and communication for starting and stopping them.

The actual calculations are done in separate processes that will show as FAHCore_nn. Those are already 64-bit. A7 is the CPU folding core, 21 and 22 are the current GPU folding cores.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Weisskeinen
Posts: 1
Joined: Tue Mar 17, 2020 4:36 pm

Re: Windows: use more than 32 cores?

Post by Weisskeinen »

And how to use more than 64 cores? My Epyc server running on Windows Server has 96 cores, which are divided equally into two processor groups. I tried four CPU slots with 24 cores each, which runs fine, IF I assign the work manually to the processor groups. If windows does it, everything is put into the processor group of the calling task and half of the server is doing nothing while the other half drowns in work.
Do you have any solution for these cases?
JTorset
Posts: 9
Joined: Fri May 01, 2020 10:40 am

Re: Windows: use more than 32 cores?

Post by JTorset »

Joe_H
Site Admin
Posts: 7937
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Windows: use more than 32 cores?

Post by Joe_H »

Weisskeinen wrote:And how to use more than 64 cores?
Under Windows, not possible on a single CPU slot. The limit is 32 cores assigned to each CPU folding slot, 3 separate slots of 32 would use 96 CPU core threads.

Under Linux you would not run into these limits.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
lafrad
Posts: 27
Joined: Sat Mar 14, 2020 4:05 pm

Re: Windows: use more than 32 cores?

Post by lafrad »

Huge slots are fun... is there any project that is actually better served by that?

Just create 24 CPU slots until you use up all of your processors.... at least it'll get moving for now, and you'll get around that limitation.
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: Windows: use more than 32 cores?

Post by PantherX »

I have seen some CPU Projects running successfully on 32, and 54/56 CPUs. Generally speaking, there are fewer CPU projects for high CPU counts (24 or higher) than for lower CPU counts (less than 24). Occasionally, you may be assigned a WU that can't run on a high thread count as you will see this error in your log file:
There is no domain decomposition for ## ranks that is compatible with the given box and a minimum cell size of ## nm
You can report it in the Forum so that the researcher can prevent it from being assigned to that CPU number and you can reduce the CPUs assigned to it to ensure that you can successfully fold it.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Post Reply