On Mon, Jun 17, 2019 at 5:02 PM Harald Staub <harald.staub@xxxxxxxxx> wrote:
There are customers asking for 500 million objects in a single object
storage bucket (i.e. 5000 shards), but also more. But we found some
places that say that there is a limit in the number of shards per
bucket, e.g.
We've got a cluster with a ~450M objects in a bucket with 4096 shards that's working mostly fine.
Resharding caused a few timeout issues but that's mostly due to poor SSDs in the index pool.
Not sure about listing performance, but it's probably horrible.
Paul
https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/2/html/object_gateway_guide_for_ubuntu/administration_cli
It says that the maximum number of shards is 7877. But I could not find
this magic number (or any other limit) on http://docs.ceph.com.
Maybe this hard limit no longer applies to Nautilus? Maybe there is a
recommended soft limit?
Background about the application: Veeam (veeam.com) is a backup solution
for VMWare that can embed a cloud storage tier with object storage (only
with a single bucket). Just thinking loud: Maybe this could work with
an indexless bucket. Not sure how manageable this would be, e.g. to
monitor how much space is used. Maybe separate pools would be needed.
Harry
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
