Never got answer when I asked in the maillist any downside if I follow the rules. Istvan Szabo Senior Infrastructure Engineer --------------------------------------------------- Agoda Services Co., Ltd. e: istvan.szabo@xxxxxxxxx<mailto:istvan.szabo@xxxxxxxxx> --------------------------------------------------- From: Boris Behrens <bb@xxxxxxxxx> Sent: Friday, November 5, 2021 4:35 PM To: Szabo, Istvan (Agoda) <Istvan.Szabo@xxxxxxxxx> Subject: Re: large bucket index in multisite environement (how to deal with large omap objects warning)? Email received from the internet. If in doubt, don't click any link nor open any attachment ! ________________________________ Do you know if it have downsides to just preshard everything? Am Fr., 5. Nov. 2021 um 10:29 Uhr schrieb Szabo, Istvan (Agoda) <Istvan.Szabo@xxxxxxxxx<mailto:Istvan.Szabo@xxxxxxxxx>>: You mean prepare or reshard? Prepare: I collect as much information for the users before onboarding so I can prepare for their use case in the future and set things up. Preshard: After created the bucket: radosgw-admin bucket reshard --bucket=ex-bucket --num-shards=101 Also when you shard the buckets, you need to use prime numbers. Istvan Szabo Senior Infrastructure Engineer --------------------------------------------------- Agoda Services Co., Ltd. e: istvan.szabo@xxxxxxxxx<mailto:istvan.szabo@xxxxxxxxx> --------------------------------------------------- From: Boris Behrens <bb@xxxxxxxxx<mailto:bb@xxxxxxxxx>> Sent: Friday, November 5, 2021 4:22 PM To: Szabo, Istvan (Agoda) <Istvan.Szabo@xxxxxxxxx<mailto:Istvan.Szabo@xxxxxxxxx>>; ceph-users@xxxxxxx<mailto:ceph-users@xxxxxxx> Subject: Re: large bucket index in multisite environement (how to deal with large omap objects warning)? Email received from the internet. If in doubt, don't click any link nor open any attachment ! ________________________________ Cheers Istvan, how do you do this? Am Do., 4. Nov. 2021 um 19:45 Uhr schrieb Szabo, Istvan (Agoda) <Istvan.Szabo@xxxxxxxxx<mailto:Istvan.Szabo@xxxxxxxxx>>: This one you need to prepare, you beed to preshard the bucket which you know that will hold more than millions of objects. I have a bucket where we store 1.2 billions of objects with 24xxx shard. No omap issue. Istvan Szabo Senior Infrastructure Engineer --------------------------------------------------- Agoda Services Co., Ltd. e: istvan.szabo@xxxxxxxxx<mailto:istvan.szabo@xxxxxxxxx> --------------------------------------------------- -- Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend im groüen Saal. -- Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend im groüen Saal. _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |