Re: large bucket index in multisite environement (how to deal with large omap objects warning)?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



You mean prepare or reshard?
Prepare:
I collect as much information for the users before onboarding so I can prepare for their use case in the future and set things up.

Preshard:
After created the bucket:
radosgw-admin bucket reshard --bucket=ex-bucket --num-shards=101

Also when you shard the buckets, you need to use prime numbers.

Istvan Szabo
Senior Infrastructure Engineer
---------------------------------------------------
Agoda Services Co., Ltd.
e: istvan.szabo@xxxxxxxxx<mailto:istvan.szabo@xxxxxxxxx>
---------------------------------------------------

From: Boris Behrens <bb@xxxxxxxxx>
Sent: Friday, November 5, 2021 4:22 PM
To: Szabo, Istvan (Agoda) <Istvan.Szabo@xxxxxxxxx>; ceph-users@xxxxxxx
Subject: Re:  large bucket index in multisite environement (how to deal with large omap objects warning)?

Email received from the internet. If in doubt, don't click any link nor open any attachment !
________________________________
Cheers Istvan,

how do you do this?

Am Do., 4. Nov. 2021 um 19:45 Uhr schrieb Szabo, Istvan (Agoda) <Istvan.Szabo@xxxxxxxxx<mailto:Istvan.Szabo@xxxxxxxxx>>:
This one you need to prepare, you beed to preshard the bucket which you know that will hold more than millions of objects.

I have a bucket where we store 1.2 billions of objects with 24xxx shard. No omap issue.
Istvan Szabo
Senior Infrastructure Engineer
---------------------------------------------------
Agoda Services Co., Ltd.
e: istvan.szabo@xxxxxxxxx<mailto:istvan.szabo@xxxxxxxxx>
---------------------------------------------------



--
Die Selbsthilfegruppe "UTF-8-Probleme" trifft sich diesmal abweichend im groüen Saal.
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux