Re: Adventures with large RGW buckets [EXT]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



A few interleaved responses below....

On 8/1/19 10:20 AM, Matthew Vernon wrote:
> Hi,
> 
> On 31/07/2019 19:02, Paul Emmerich wrote:
> 
> Some interesting points here, thanks for raising them :)


> We've had some problems with large buckets (from around the 70Mobject
> mark).
> 
> One you don't mention is that multipart uploads break during resharding
> - so if our users are filling up a bucket with many writers uploading
> multipart objects, some of these will fail (rather than blocking) when
> the bucket is resharded.

Is there a tracker for that already? If not, would you mind adding one?

> We've also seen bucket deletion via radosgw-admin failing because of
> oddities in the bucket itself (e.g. missing shadow objects, omap objects
> that still exist when the related object is gone); sorting that was a
> bit fiddly (with some help from Canonical, who I think are working on
> patches).
> 

There was a recently merged PR that addressed bucket deletion with
missing shadow objects:

    https://tracker.ceph.com/issues/40590

Thank you for reporting your experience w/ rgw,

Eric

-- 
J. Eric Ivancich
he/him/his
Red Hat Storage
Ann Arbor, Michigan, USA
_______________________________________________
Dev mailing list -- dev@xxxxxxx
To unsubscribe send an email to dev-leave@xxxxxxx



[Index of Archives]     [CEPH Users]     [Ceph Devel]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]

  Powered by Linux