Proxmox VM console disconnecting every 30 seconds or so

Video of the Issue: https://streamable.com/2ovmsr

This started only recently after I got the latest updates.

PVE Manager 8.2.4 Linux 6.8.12-1-pve

I have three nodes l, updated all of them, having the same issue on all of them.

Any help in resolving this. Network ping from my machine are fine, everything running on proxmox is only impacted. Ping is just for easy visual, same thing happens if you are just the console.