Concern with Ceph IOPS despite having enterprise NVMe drives

Hi,

We have a 3 node cluster, where we have configured Proxmox with Ceph. Following are the specifications of the each node:

Memory (RAM): 384GB
vCPU: 80 (Total)
NIC card: 2 x25G (Dedicated to ceph traffic only) - However the DAC cables are of 10G
Other NIC cards: are for management network, cluster etc.
OSD: 4 xMicron 7450Max participating as OSD.

We tested each drive with the following command and got around 55K to 60K IOPS for block size 4k.

fio --ioengine=libaio...

Read more