Windows: use more than 32 cores?
Moderators: Site Moderators, FAHC Science Team
Windows: use more than 32 cores?
I have 2 Windows machines that FAH is limiting to 32 cores. Machine 1 is a Xeon W-2195 (18 physical, 36 logical cores), machine 2 is a Threadripper 2990WX (32 physical, 64 logical cores). Both machines are running Win10 Enterprise 64-bit. FAH limits the work it does on both machines to 32 cores, and no adding a second slot doesn't fix it - that just makes 2 CPU slots with 16 cores.
My suspicion is that this happens because the client wrapper is 32-bit. The worker core apps are 64-bit, they're separate entirely from the client, but the bit that partitions out the work appears to be 32-bit - 32-bit apps cannot use more than 32 cores. In the System Info tab under the Build heading the Platform entry is listed as "win32 10" and the Bits entry is "32".
Might it be possible to get a version with a 64-bit Windows client?
My suspicion is that this happens because the client wrapper is 32-bit. The worker core apps are 64-bit, they're separate entirely from the client, but the bit that partitions out the work appears to be 32-bit - 32-bit apps cannot use more than 32 cores. In the System Info tab under the Build heading the Platform entry is listed as "win32 10" and the Bits entry is "32".
Might it be possible to get a version with a 64-bit Windows client?
-
- Posts: 2040
- Joined: Sat Dec 01, 2012 3:43 pm
- Hardware configuration: Folding@Home Client 7.6.13 (1 GPU slots)
Windows 7 64bit
Intel Core i5 2500k@4Ghz
Nvidia gtx 1080ti driver 441
Re: Windows: use more than 32 cores?
Yes you can add a second CPU slot and configure both CPU slots to use 32 threads each.
Re: Windows: use more than 32 cores?
Well poo. If a second slot is added and the CPU count left at -1 (for the Threadripper the thinking was that this would still allocate 32 each) for both it doesn't work; if the cores are explicitly specified for each slot then yes it does work.
The question still remains: why is there no 64-bit client for Windows? The workers are 64-bit. A 64-bit client would remove the need to do this.
The question still remains: why is there no 64-bit client for Windows? The workers are 64-bit. A 64-bit client would remove the need to do this.
-
- Posts: 2522
- Joined: Mon Feb 16, 2009 4:12 am
- Location: Greenwood MS USA
Re: Windows: use more than 32 cores?
Because a 64 bit client would not solve this proble., (and the F@H programmer would have to coordinate 4 clients instead of 3, slowing down all development)Spurkey wrote:The question still remains: why is there no 64-bit client for Windows? The workers are 64-bit. A 64-bit client would remove the need to do this.
There are Windows issues using more than 32 cores in a single application, but that is not solved with a new client. It is solved by Enterprise Windows
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
Re: Windows: use more than 32 cores?
Have you purchased an Enterprise Windows license or a Home Windows license?
Posting FAH's log:
How to provide enough info to get helpful support.
How to provide enough info to get helpful support.
-
- Site Admin
- Posts: 7936
- Joined: Tue Apr 21, 2009 4:41 pm
- Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2 - Location: W. MA
Re: Windows: use more than 32 cores?
Besides what has been mentioned so far about the client being 32-bit, that is the FAHClient portion which does not do the actual calculations. It handles downloading and uploading WU's, and communication for starting and stopping them.
The actual calculations are done in separate processes that will show as FAHCore_nn. Those are already 64-bit. A7 is the CPU folding core, 21 and 22 are the current GPU folding cores.
The actual calculations are done in separate processes that will show as FAHCore_nn. Those are already 64-bit. A7 is the CPU folding core, 21 and 22 are the current GPU folding cores.
iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
-
- Posts: 1
- Joined: Tue Mar 17, 2020 4:36 pm
Re: Windows: use more than 32 cores?
And how to use more than 64 cores? My Epyc server running on Windows Server has 96 cores, which are divided equally into two processor groups. I tried four CPU slots with 24 cores each, which runs fine, IF I assign the work manually to the processor groups. If windows does it, everything is put into the processor group of the calling task and half of the server is doing nothing while the other half drowns in work.
Do you have any solution for these cases?
Do you have any solution for these cases?
-
- Site Admin
- Posts: 7936
- Joined: Tue Apr 21, 2009 4:41 pm
- Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2 - Location: W. MA
Re: Windows: use more than 32 cores?
Under Windows, not possible on a single CPU slot. The limit is 32 cores assigned to each CPU folding slot, 3 separate slots of 32 would use 96 CPU core threads.Weisskeinen wrote:And how to use more than 64 cores?
Under Linux you would not run into these limits.
iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Re: Windows: use more than 32 cores?
Huge slots are fun... is there any project that is actually better served by that?
Just create 24 CPU slots until you use up all of your processors.... at least it'll get moving for now, and you'll get around that limitation.
Just create 24 CPU slots until you use up all of your processors.... at least it'll get moving for now, and you'll get around that limitation.
-
- Site Moderator
- Posts: 6986
- Joined: Wed Dec 23, 2009 9:33 am
- Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB
Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400 - Location: Land Of The Long White Cloud
- Contact:
Re: Windows: use more than 32 cores?
I have seen some CPU Projects running successfully on 32, and 54/56 CPUs. Generally speaking, there are fewer CPU projects for high CPU counts (24 or higher) than for lower CPU counts (less than 24). Occasionally, you may be assigned a WU that can't run on a high thread count as you will see this error in your log file:
There is no domain decomposition for ## ranks that is compatible with the given box and a minimum cell size of ## nm
You can report it in the Forum so that the researcher can prevent it from being assigned to that CPU number and you can reduce the CPUs assigned to it to ensure that you can successfully fold it.
There is no domain decomposition for ## ranks that is compatible with the given box and a minimum cell size of ## nm
You can report it in the Forum so that the researcher can prevent it from being assigned to that CPU number and you can reduce the CPUs assigned to it to ensure that you can successfully fold it.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time
Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time
Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues