Big performance difference between baremetal and VM.

Hello,
I have issue with performance on VM. I tried messing with config, args and stuff, but nothing seems to work.
I tried lowering cores in hardware section of VM, lowering memory, setting args to stock, changing CPU type, reinstalling OS, creating different VM, disabling migitations etc.
As you can see from the passmark results that I provided, the difference in performance is big.

Proxmox host spec:
Xeon E5-2630v4
DDR4 4x8GB (2666MHz CL19)
XFX RX 6600 (passthrough to VM)
PVE 8.1.4...

Read more