setting up NVidia vGPU is driving me mad

I am trying to set up an Nvidia vGPU for AI workloads and I am following this guide: https://pve.proxmox.com/wiki/NVIDIA_vGPU_on_Proxmox_VE_7.x#

My card is an RTX A5000. I obtained the NVidia grid host driver (535.129) and installed it on the PVE host. I activated SR-IOV and now have several virtual devices that I can pass through to a VM.

I created a Debian 12 VM and installed the NVidia grid guest driver (535.129) in the VM. nvidia-smi is showing me the virtual card (with Cuda...

Read more