Hi,
I use an 4-node ceph-cluster with pve and I'm not really happy with the performance yet.
I have do some benchmark with rados bench and the same (or similiar) with fio inside an VM.
Especialy the latency are much more worse with multible threads.
is this only on my config, or have other peoples the same effect?
used commands for benchmarking:
The results are showing here: ceph_performance.png
Any comments, or comparable values?
Udo
I use an 4-node ceph-cluster with pve and I'm not really happy with the performance yet.
I have do some benchmark with rados bench and the same (or similiar) with fio inside an VM.
Especialy the latency are much more worse with multible threads.
is this only on my config, or have other peoples the same effect?
used commands for benchmarking:
Code:
rados bench -p test 60 write --no-cleanup -t N # N=1-16
# clear all buffers with "echo 3 > /proc/sys/vm/drop_caches" on the pve-node, and all ceph-nodes
rados bench -p test 60 seq --no-cleanup -t N # N=1-16
# inside VM from
fio --max-jobs=1 --numjobs=1 --readwrite=write --blocksize=4M --size=5G --direct=1 --name=fiojob
# also clearing all buffers (VM, PVE, all ceph-nodes)
# reading with
fio --max-jobs=1 --numjobs=1 --readwrite=read --blocksize=4M --size=5G --direct=1 --name=fiojob
# up to
fio --max-jobs=16 --numjobs=16 --readwrite=write --blocksize=4M --size=512M --direct=1 --name=fiojobAny comments, or comparable values?
Udo