Re: Nautilus slow using "ceph tell osd.* bench"

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




Hi,

I echo Jim's findings. Going from lower Nautilus versions up to .10 on 4 installations suddenly gave a huge drop in read performance, probably by about 3/4, so that my users were complaining that VMs were taking ages to boot up. Strangely, write performance was not affected so much.

Kind regards,

Dave
------ Original Message ------
From: "rainning" <tweetypie@xxxxxx>
To: "Jim Forde" <jimf@xxxxxxxxx>; "ceph-users" <ceph-users@xxxxxxx>
Sent: Thursday, 6 Aug, 2020 At 02:02
Subject:  Re: Nautilus slow using "ceph tell osd.* bench"
Hi Jim, did you check system stat (e.g. iostat, top, etc.) on both osds when you ran osd bench? Those might be able to give you some clues. Moreover, did you compare both osds' configurations?


------------------&nbsp;Original&nbsp;------------------
From: "Jim Forde" <jimf@xxxxxxxxx&gt;;
Date:&nbsp;Thu, Aug 6, 2020 06:51 AM
To:&nbsp;"ceph-users"<ceph-users@xxxxxxx&gt;;
Subject:&nbsp; Nautilus slow using "ceph tell osd.* bench"

I have 2 clusters. Cluster 1 started at Hammer and has upgraded through the versions all the way to Nautilus 14.2.10 (Luminous to Nautilus in July 2020) . Cluster 2 started as Luminous and is now Nautilus 14.2.2 (Upgraded in September 2019) The clusters are basically identical 5 OSD Nodes with 6 osd's per node. They are both using disk drives. No SSD's. Prior to upgrading Cluster 1 running "ceph tell osd.0 bench -f plain"
produced similar results across both clusters.
ceph tell osd.0 bench -f plain
bench: wrote 1 GiB in blocks of 4 MiB in 0.954819 sec at 1.0 GiB/sec 268 IOPS
Now cluster 1 results are terrible, about 25% from before the upgrade.
ceph tell osd.0 bench -f plain
bench: wrote 1 GiB in blocks of 4 MiB in 4.03434 sec at 254 MiB/sec 63 IOPS
Ceph -s shows HEALTH_OK. Dashboard looks good. 2 pools
MON Dump
min_mon_release 14 (nautilus)
OSD Dump
require_min_compat_client luminous
min_compat_client jewel
require_osd_release nautilus
Not sure what is causing the slow performance. Ideas?
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux