Hello, I'm new to Proxmox. I'm trying to run a Ubuntu 22.04 VM under proxmox8.1.2 with RTX 3090 GPU passthrough to do some experiments in AI. But Ollama is not able to find the GPU. Below is the output of the Ollama log.
Read more
Code:
Aug 25 04:36:02 aiserver ollama[42354]: time=2024-08-25T04:36:02.121Z level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11 rocm_v60102]"
Aug 25 04:36:02 aiserver ollama[42354]: time=2024-08-25T04:36:02.121Z level=INFO source=gpu.go:204...Read more