Hi Bryan, On Fri, Jun 9, 2017 at 1:55 AM, Bryan Stillwell <bstillwell@xxxxxxxxxxx> wrote: > This has come up quite a few times before, but since I was only working with > RBD before I didn't pay too close attention to the conversation. I'm > looking > for the best way to handle existing clusters that have buckets with a large > number of objects (>20 million) in them. The cluster I'm doing test on is > currently running hammer (0.94.10), so if things got better in jewel I would > love to hear about it! > ... > Has anyone found a good solution for this for existing large buckets? I > know sharding is the solution going forward, but afaik it can't be done > on existing buckets yet (although the dynamic resharding work mentioned > on today's performance call sounds promising). I haven't tried it myself, but 0.94.10 should have the (offline) resharding feature. From the release notes: > * In RADOS Gateway, it is now possible to reshard an existing bucket's index > using an off-line tool. > > Usage: > > $ radosgw-admin bucket reshard --bucket=<bucket_name> --num_shards=<num_shards> > > This will create a new linked bucket instance that points to the newly created > index objects. The old bucket instance still exists and currently it's up to > the user to manually remove the old bucket index objects. (Note that bucket > resharding currently requires that all IO (especially writes) to the specific > bucket is quiesced.) -- Dan _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |