Bottleneck at 200 MiB/s?! 7 Node Ceph NVME & SSD Cluster

Hey friends,

Observing strange performance limitation.

EDIT: ALL SSD & NVME are Enterprise Level! No consumer stuff built in

Backups PBS & Veeam topping out at around 200 MiB/s..

Esp. Veeam is telling, the bottleneck is actually the "source", which is the ceph cluster.

Backup Vault is capable of much more than this (24 x 14 TBs ZFS Z2 volume)

Each node is utilizing MLAG with 2x 25Gbit/s.
VMs using 10Gbit/s NIC virtio.

None of the OSD is showing high latencies or commit/apply...

Read more