On Fri, Jan 29, 2016 at 3:10 AM, Wido den Hollander <wido@xxxxxxxx> wrote: > > > On 29-01-16 11:31, Micha Krause wrote: >> Hi, >> >> I'm having problems listing the contents of an s3 bucket with ~2M objects. >> >> I already found the new bucket index sharding feature, but I'm >> interested how these Indexes are stored. >> >> My index pool shows no space used, and all objects have 0B. >> >> root@mon01:~ # rados df -p .rgw.buckets.index >> pool name KB objects clones degraded >> unfound rd rd KB wr wr KB >> .rgw.buckets.index 0 62 0 >> 0 0 28177514 336051356 22897231 0 >> >> Why would sharing a 0B object make any difference? >> > The index is stored in the omap of the object which you can list with > the 'rados' command. > > So it's not data inside the RADOS object, but in the omap key/value store. ...and this is an unfortunate accounting problem in terms of RADOS pools, but a solution is very difficult technically so nobody's come up with a good one. :( _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |