Thanks for taking the time out to respond - it is greatly appreciated. I am starting to grok how this all works. I going to have to play around with the inheritance/subset scenario from zonegroup level definitions to bucket level definitions. I will repost if I have any more questions -- Mark Selby Sr Linux Administrator, The Voleon Group mselby@xxxxxxxxxx This email is subject to important conditions and disclosures that are listed on this web page: https://voleon.com/disclaimer/. On 7/28/22, 12:01 PM, "Soumya Koduri" <skoduri@xxxxxxxxxx> wrote: CAUTION: This email originated from outside of the organization. Use caution when opening attachments or links. On 7/28/22 22:41, Mark Selby wrote: > We use Ceph RBD/FS extensively and are starting down our RGW journey. We > > have 3 sites and want to replicate buckets from a single "primary" to > > multiple "backup" sites. Each site has a Ceph cluster and they are all > > configured as part of a Multisite setup. > > > > I am using the examples at > > https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.ceph.com%2Fen%2Fquincy%2Fradosgw%2Fmultisite-sync-policy&data=05%7C01%7Cmselby%40voleon.com%7C6ea00db3de5c428fac6108da70cb9dad%7C45212fd85f544a19a6ba493ff6e072b1%7C0%7C0%7C637946317086459679%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=cwHCkOAnyfl%2B23eCPBtYLLYTn3aK0glomI2L1nT8Kgo%3D&reserved=0 and have > > gotten a directional sync to work using the below commands. > > > > The question I have is about the scalability of what I am doing. How > > groups/flows/pipe all fit together is not very clear in the docs. > > > > My group 'us' has two flows, 'dev1-to-dev2' and 'dev1-to-dev3'. > > > > The pipe that I create specifies the group 'us' but does not specify the > > flows to us. I have to assume in this case it uses all of the flows at > > the zonegroup level. This is fine as long as these are the only flows > > that I will ever need. yes, in your setup, it uses the flows created for the group "us" (zone-group level). > > > > What I am try having difficulty understanding is the linkage between > > pipes and flows. If any one can explain this more than the docs do, it > > would be greatly appreciated. > > A data-flow defines the flow of data between the different zones (either symmetrical or directional) where as a pipe defines actual buckets that can use these data flows [1] FWIU, pipes use the data-flows associated with their group policy or inherits the ones configured at zone-group level. i.e., * if the group policy is created at zonegroup level (like in your setup 'us'), pipes of that group use the flows associated with that <group-id> ('us'). If no flows are configured, the sync is not allowed. * In case if the group (say, 'us-bucket') is created at bucket-level, the data-flows (if any) created for that group ('us-bucket') should be subset of what zonegroup level policy ('us') allows. And that group policy ('us-bucket') pipes use the flows in the following order (a) the data-flows created for that bucket-level group policy ('us-bucket') (b) if no flows are created, it then inherits the data flow allowed at zonegroup level ('us'). Hope this helps! -Soumya [1] https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.ceph.com%2Fen%2Fquincy%2Fradosgw%2Fmultisite-sync-policy%2F&data=05%7C01%7Cmselby%40voleon.com%7C6ea00db3de5c428fac6108da70cb9dad%7C45212fd85f544a19a6ba493ff6e072b1%7C0%7C0%7C637946317086459679%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=LcAIlyWD1r5laFsCnyLncPALXlZuhydGEWwIFcSmL4c%3D&reserved=0
_______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
