Radosgw bucket listing limited to 10001 object ?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi all,

Context :
	We are moving a customer users/buckets/objects from another Object storage to Ceph.
	Thiis customer has 2 users : “test” and “prod”, the “test” user has 53069 buckets, the “prod” user has 285291 buckets.
	Ceph is in 16.2.5 (installed in 16.2.4 and upgraded via cephadm to 16.2.5).

We copied all buckets/objects for the “test" user. 
I want to list buckets for this user to check if there is no missing bucket. 
I tried many thing : 
- S3 API (via awscli or boto3 lib): returns only 1000 buckets
- Ceph dashboard: show only 10001 buckets
- radosgw-admin --rgw-realm=THE_REALM bucket list: returns 10001 buckets

I did not find an option to allow pagination for this or anything about this limit in the documentation (I may have missed it).

Do you know how can I get the full bucket list ?

Thank you,
— 
Guillaume


_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux