Re: Radosgw bucket listing limited to 10001 object ?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello,

> On 20 Jul 2021, at 17:48, Daniel Gryniewicz <dang@xxxxxxxxxx> wrote:
> That's probably this one: https://tracker.ceph.com/issues/49892  Looks like we forgot to mark it for backport.  I've done that now, so it should be in the next Pacific.

I’m not sure it is related, as it seems the fix is about listing objects inside buckets not about the bucket list itself (but I started reading Ceph code quite recently, so I’m not sure I understand it well for now ;-)).

Do you have an ETA for next Pacific release ?

Thank you.
— 
Guillaume

> On 7/20/21 11:28 AM, [AR] Guillaume CephML wrote:
>> Hi all,
>> Context :
>> 	We are moving a customer users/buckets/objects from another Object storage to Ceph.
>> 	Thiis customer has 2 users : “test” and “prod”, the “test” user has 53069 buckets, the “prod” user has 285291 buckets.
>> 	Ceph is in 16.2.5 (installed in 16.2.4 and upgraded via cephadm to 16.2.5).
>> We copied all buckets/objects for the “test" user.
>> I want to list buckets for this user to check if there is no missing bucket.
>> I tried many thing :
>> - S3 API (via awscli or boto3 lib): returns only 1000 buckets
>> - Ceph dashboard: show only 10001 buckets
>> - radosgw-admin --rgw-realm=THE_REALM bucket list: returns 10001 buckets
>> I did not find an option to allow pagination for this or anything about this limit in the documentation (I may have missed it).
>> Do you know how can I get the full bucket list ?
>> Thank you,
>> —
>> Guillaume

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux