Is there a practical limit to the number of objects I can store in a pool?
Nope!
I'm planning to use RADOS Gateway, and I'm planning to start by adding about 1M objects to the gateway. Once that initial migration is done and burns in, I want to migrate in another 20M objects. I was planning to use a single S3 bucket, but I can work with many buckets if necessary.
This might cause you trouble -- each bucket maintains an index which is located (for now) on a single OSD. You'll probably want one form or another of sharing across buckets.
I see that the RADOS Gateway stores the objects in the .rgw.buckets pool. So I did a quick test with the rados bench tool. I see object creation slowing down as more objects are added to the pool, and latency increases.
That's fairly odd. Can you share more details of the results? My guess is that you were measuring something else, like the impact of filling up the OSD journals. :)
-Greg
--
Software Engineer #42 @ http://inktank.com | http://ceph.com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
