Re: Performance issues with deep-scrub since upgrading from v12.2.2 to v12.2.5

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Awesome, thanks for the quick replies and insights.


Seems like this is the issue you're talking about:

http://tracker.ceph.com/issues/22769 which is set to be released in v12.2.6.


We'll focus on investigating the issue regarding the resharding of buckets, hopefully this will solve the issue for us.


Sander




From: Gregory Farnum <gfarnum@xxxxxxxxxx>
Sent: Thursday, June 14, 2018 22:45
To: Sander van Schie / True
Cc: ceph-users@xxxxxxxxxxxxxx
Subject: Re: Performance issues with deep-scrub since upgrading from v12.2.2 to v12.2.5
 
Yes. Deep scrub of a bucket index pool requires reading all the omap keys, and the rgw bucket indices can get quite large. The OSD will limit the number of keys it reads at a time to try and avoid overwhelming things.

We backported to luminous (but after the 12.2.5 release, it looks like) a commit that would let client requests preempt the scrubbing reads, which would make it restart several times if the bucket index keeps getting written to. I think there may also have been a bug fix where the OSD had been able to issue client access during some scrubs that could result in issues, but I'm not sure when that backport would have happened.

I'd try and figure out why the RGW resharding wasn't working properly though, as preventing resharding when it wants to is inviting issues with the underlying RADOS objects.
-Greg
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux