Multiple projects on one GPU with MPS

[arisu]

Has anyone tried to use Nvidia MPS (https://docs.nvidia.com/deploy/mps/index.html) to make better use of high-capacity GPUs?

If two WUs are run on the same GPU then even if they are small, there will be no net speed-up. Imagine the WU is too small to fully utilize the GPU and only makes use of 40% of the CUDA cores. Running two WUs at once would cause WU A to use 40%, then it would schedule B which would use 40%, then back to A which would use 40% etc and at no times would they both run at once (it would appear to the user that they're both running at once, but each at only half-speed). But when MPS is turned on, they are truly scheduled in parallel, now it will use 80% of the CUDA cores.

OpenMM, the software behind the GPU cores, has an open feature request for simultaneous simulations but using MPS to do that was rejected for FAH because it only supports Linux (https://github.com/openmm/openmm/issues ... -713723978). But Linux users should be able to use this easily, without modifying the core or making any changes to the client. Unlike vGPU that splits one GPU into several virtual ones, MPS is available for consumer cards.

If no one has tried this with FAH before, I will try it out and write a guide for it.

[muziqaz]

Nvidia does not support 2 workloads on a single consumer GPU.
Developer resources are scarce as is, especially for corner cases like this

[arisu]

Nvidia does not support 2 workloads on a single consumer GPU.
Developer resources are scarce as is, especially for corner cases like this

Anything with a CUDA Compute Capability above 3.5 supports it. Please see here: https://developer.nvidia.com/cuda-gpus

[arisu]

I've tested it with non-FAH CUDA utilities but I'd like to test with FAH now. Could someone give me two very small GPU WUs' wudata_01.dat files, ones small enough that they won't even utilize half of a 3090 or 4090 Mobile's CUDA cores?

[muziqaz]

Try to choose correct subforum when posting new threads
this thread would have been perfect for "Problems with nVidia drivers", since technically this is nVidia driver issue.

Anyways: https://send.vis.ee/download/6cbd410b62 ... RPckoyuMJA
This contains wu, as well as windows fahcore_23. But you might be on Linux, so ignore that. If you need more guidance on how to run this, let me know.
Download link expires in 3 days and 10 downloads

[arisu]

Thank you!

I thought this would be a better subforum because I'm testing out MPS but not having any problems (yet). It's going smoothly so far.