Proxmox with ceph network setup

I've been playing with a 4 node cluster using some server nodes that used to be in a hyperconverged setup. I had everything running on the main network and the performance was pretty slow. I then added a 1g switch for ceph_cluster and things improved maybe 2 times. After that I added 4 port sfp+ nics to all four nodes with one cable connected from each of the nodes to a 10g switch. This improved the performance more than 10 times.

After this I decided to try moving the ceph_public to the...

Read more