Hi, I incorrectly wrote that EOS[0] was using Ceph and RDB. I edited the object storage design[1] to remove that and avoid any confusion. Now I'll try to figure out what led me to make this significant mistake. My apologies for misrepresenting EOS. Cheers [0] https://eos-web.web.cern.ch/eos-web/ [1] https://wiki.softwareheritage.org/index.php?title=A_practical_approach_to_efficiently_store_100_billions_small_objects_in_Ceph&type=revision&diff=1607&oldid=1590 On 10/03/2021 15:53, Loïc Dachary wrote: > Bonjour, > > In the past weeks a few mailing list threads[0][1][2] explored the problem of storing billions of small objects in Ceph. There was great feedback (I learned at lot) and it turns out the solution is a rather simple aggregation of the ideas that were suggested during these discussions. It is described in detail here: > > https://wiki.softwareheritage.org/wiki/A_practical_approach_to_efficiently_store_100_billions_small_objects_in_Ceph > > The next step will be to write and run benchmarks[3]. Although I'm convinced it is a good solution, I've been wrong before and confirmation is required :-) Many thanks to all the participants in the discussions on behalf of the Software Heritage project[4]. > > Cheers > > [0] Storing 20 billions of immutable objects in Ceph, 75% <16KB https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/thread/JSG2TXKNXPXEKZOJZGYF2ZPTQHOB4LHJ/ > [1] Small RGW objects and RADOS 64KB minimun size https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/thread/AEMW6O7WVJFMUIX7QGI2KM7HKDSTNIYT/ > [2] Using RBD to pack billions of small files https://lists.ceph.io/hyperkitty/list/ceph-users@xxxxxxx/thread/RHQ5ZCHJISXIXOJSH3TU7DLYVYHRGTAT/ > [3] https://forge.softwareheritage.org/T3054 > [4] https://www.softwareheritage.org/ > -- Loïc Dachary, Artisan Logiciel Libre _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |