Using MPS to dramatically increase PPD on big GPUs (Linux guide)

[toTOW]

Use your own hardware if you want to try exotic things.

[foldinghomealone]

Parallel computing shouldn't be considered "exotic" on a cloud computing marketplace that rents out GPU and compute resources for AI workloads, machine learning training, rendering, and other high-performance computing tasks

[toTOW]

Docker instances will always have limitations to protect the host and other users on the same host. If you need total control of the hardware, you'll need dedicated hardware.

[muziqaz]

Try one layer of exotic only.
MPS is one layer
Docker is second layer
Vast.ai instance is 3rd layer

[foldinghomealone]

Sorry guys, even considered that you're most helpful here on the board, you're answers are not really useful in this case because that they don't give any actionable information.

Useful answeres would be:
- no reply at all, if there is no meaningful information to add.
- "In my experience, docker template XYZ allowes EXCLUSIVE_PROCESS."
- "I haven't found any docker template allowing EXCLUSIVE_PROCESS."
- "Pls contact our team member USER - he's a vast.ai pro."

[muziqaz]

Sorry guys, even considered that you're most helpful here on the board, you're answers are not really useful in this case because that they don't give any actionable information.

Useful answeres would be:
- no reply at all, if there is no meaningful information to add.
- "In my experience, docker template XYZ allowes EXCLUSIVE_PROCESS."
- "I haven't found any docker template allowing EXCLUSIVE_PROCESS."
- "Pls contact our team member USER - he's a vast.ai pro."

No,
You are asking us to debug (for you, remotely) two items which are not included in the OP's post. This thread assumes you own the hardware, and it is at your house, you are not using docker or some other form of environment.

[foldinghomealone]

No,
You are asking us to debug (for you, remotely) two items which are not included in the OP's post. This thread assumes you own the hardware, and it is at your house, you are not using docker or some other form of environment.

So you're suggesting that if I open a new thread asking the same question I will get a more helpful answer from you?

[muziqaz]

No,
You are asking us to debug (for you, remotely) two items which are not included in the OP's post. This thread assumes you own the hardware, and it is at your house, you are not using docker or some other form of environment.

So you're suggesting that if I open a new thread asking the same question I will get a more helpful answer from you?

No, you are free to use this one, but don't dismiss our suggestions, as they are valid suggestions. Whenever you do exotic stuff try to limit the variables. This is the same with troubleshooting of hardware

[toTOW]

- "Pls contact our team member USER - he's a vast.ai pro."

Officiel Vast.ai Discord : https://discord.gg/vast

You're welcome.