Solution Failed! I rebalanced all osd's to 0.0 and then back to their original weight, and started getting back to my original ~269 IOPS. It has been about 5 days since I completed the re-balance and performance is degrading again! There is a bit of improvement but not to where it was in Mimic. ceph tell osd.* bench -f plain osd.0: bench: wrote 1 GiB in blocks of 4 MiB in 2.92178 sec at 350 MiB/sec 87 IOPS osd.1: bench: wrote 1 GiB in blocks of 4 MiB in 2.46215 sec at 416 MiB/sec 103 IOPS osd.2: bench: wrote 1 GiB in blocks of 4 MiB in 1.6428 sec at 623 MiB/sec 155 IOPS osd.3: bench: wrote 1 GiB in blocks of 4 MiB in 1.78536 sec at 574 MiB/sec 143 IOPS osd.4: bench: wrote 1 GiB in blocks of 4 MiB in 2.49857 sec at 410 MiB/sec 102 IOPS osd.5: bench: wrote 1 GiB in blocks of 4 MiB in 2.68055 sec at 382 MiB/sec 95 IOPS Ceph version is 14.2.10 I realize that ceph tell osd bench is not the only metric, but it is confusing. It should be giving me an idea of which hardware is performing better. My second cluster on version 14.2.2 does have the IOPs fluctuate a little but the results of this test on cluster #2 are consistently twice the speed that I am getting on cluster #1. Still looking for an answer. _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |