Re: Understanding RGW multi zonegroup replication topology

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



It has taken me too long to reply to you. I just wanted to say thanks - this was very helpful and answered my question. Thanks for taking the time to provide this information.

-- 


Mark Selby
Sr Linux Administrator, The Voleon Group
mselby@xxxxxxxxxx 
 
 This email is subject to important conditions and disclosures that are listed on this web page: https://voleon.com/disclaimer/.
 

On 3/1/22, 1:35 AM, "Ulrich Klein" <Ulrich.Klein@xxxxxxxxxxxxxxx> wrote:

    Hi,

    Disclaimer: I'm in no way a Ceph expert. Have just been tinkering with Ceph/RGW for a larger installation for a while.

    My understanding is that the data between zones in a zonegroup is synced by default. And that works well, most of the time.
    If you, as I had to, want to restrict what data is synced, because e.g. some users' data should not be copied to a second site/zone, then there are a couple of ways to achieve that. Sync policies I discarded because I couldn't get them to work without "sync status" reporting all non-synced data as "not yet" synced, and there wasn't any per-user setting anyway.
    The sync settings on zones and buckets work fine. But the setting "sync_from..." on a zone is all or nothing and the setting on buckets can only be applied once the bucket exists. No setting on a per user basis.

    As an alternative I used two zonegroups A and B. On the primary cluster both had a zone A1 and B1, on the secondary cluster only one of them had zone A2.
    That way what's written to to A1 is replicated to A2. What's written to B1 is not replicated/synced.
    The good and bad part is that metadata (?) is synced across the zonegroups. That's good (for me) because the same user credentials work in both zonegroups, i.e. user selects the "replication" by using different S3 URLs. On the other hand it's annoying because also bucket names - if I remember correctly - are considered metadata and thus synced across all zones in the realm, which can create "interesting" effects.

    As I said, I'm not the expert. Just my experience so far.

    Ciao, Uli

    > On 01. 03 2022, at 01:54, Mark Selby <mselby@xxxxxxxxxx> wrote:
    > 
    > I am designing a Ceph RGW multisite configuration. I have done a fair bit if reading but still am having trouble groking the utility of having multiple zonegroups within a realm. I know that all meta data is replicated between zonegroups and that replication can be setup between zones across zonegroups. I am having trouble understanding the benefits that a multi zonegroup topology would provide. I really want to understand this as I want to make sure that I design a topology that best meets the company’s needs.
    > 
    > 
    > 
    > Any and all help is greatly appreciated. Thanks!
    > 
    > 
    > 
    > -- 
    > 
    > Mark Selby
    > 
    > mselby@xxxxxxxxxx 
    > 
    > 
    > 
    > This email is subject to important conditions and disclosures that are listed on this web page: https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fvoleon.com%2Fdisclaimer%2F&amp;data=04%7C01%7Cmselby%40voleon.com%7Cf392921fdaa8413c8aa808d9fb66b366%7C45212fd85f544a19a6ba493ff6e072b1%7C0%7C0%7C637817241253082114%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0&amp;sdata=JIAo7awu5X3N9h3wcZrzUssBztAE9CvWUD5B1BZRlpo%3D&amp;reserved=0.
    > 
    > 
    > 
    > _______________________________________________
    > ceph-users mailing list -- ceph-users@xxxxxxx
    > To unsubscribe send an email to ceph-users-leave@xxxxxxx

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux