Hi all,
I am trying to use Ceph with RGW to store lots (>300M) of small files (80% 2-15kB, 20% up to 500kB).
After some testing, I wonder if Ceph is the right tool for that.
Does anybody of you have experience with this use case?
Things I came across:
- EC pools: default stripe-width is 4kB. Does it make sense to lower the stripe width for small objects or is EC a bad idea for this use case?
- Bluestore: bluestore min alloc size is per default 64kB. Would it be better to lower it to say 2kB or am I better off with Filestore (probably not if I want to store a huge amount of small files)?
- Bluestore / RocksDB: RocksDB seems to consume a lot of disk space when storing lots of files.
For example: I have OSDs with about 500k onodes (which should translate to 500k stored objects, right?) and the DB size is about 30GB. That's about 63kB per onode - which is a lot, considering the original object is about 5kB.
Thanks,
Christian
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
