Re: Ceph Multisite Cloud Sync Module

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thanks very much for responding - my problem was not realizing that you need a separate ragdosgw daemon for the zone that hosts the cloud tier. Once I got past this concept your example worked great for a simple setup.



-- 


Mark Selby
Sr Linux Administrator, The Voleon Group
mselby@xxxxxxxxxx 
 
 This email is subject to important conditions and disclosures that are listed on this web page: https://voleon.com/disclaimer/.
 

On 4/19/22, 1:26 AM, "Soumya Koduri" <skoduri@xxxxxxxxxx> wrote:

    Hi,

    On 4/19/22 09:47, Mark Selby wrote:
    > I am trying to get the Ceph Multisite Clous Sync module working with Amazon S3. The docs are not clear on how the sync module is actually configured. I just want a POC of the most simple config. Can anyone share the config and radosgw-admin commands that were invoked to create a simple sync setup. The closest docs that I have seen are https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcroit.io%2Fblog%2Fsetting-up-ceph-cloud-sync-module&amp;data=04%7C01%7Cmselby%40voleon.com%7C7eeea0b9c0564670c7b008da21de423e%7C45212fd85f544a19a6ba493ff6e072b1%7C0%7C0%7C637859535743326124%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&amp;sdata=ne0jVeBwpij1xC1LjM9JsPpX2ASXvoJPU7GmS%2BNraUM%3D&amp;reserved=0 and to be honest they do not make a lot of sense.
    >
    >
    I presume (from your last email) that you are familiar with setting up 
    multisite between zones in a single zonegroup [1] . Cloud sync zone is 
    similar to creating any other zone [2] but with additional option 
    '--tier-type=cloud' specified. Below are the minimal steps you may need 
    to get started with it -

    1) To create cloud sync zone-
    # radosgw-admin zone create --tier-type=cloud --rgw-zone=<zone-name> 
    --rgw-zonegroup=<zonegroup-name> --rgw-realm=<realm> 
    --access-key=<system-user-access-key> --secret=<system-user-secret> 
    --endpoints=http://{fqdn}:80

    eg., radosgw-admin zone create --rgw-zone=cloud-zone 
    --rgw-zonegroup=default --rgw-realm=realm_default --tier-type=cloud 
    --access-key=<system-user-access-key> --secret=<system-user-secret> 
    --endpoints=http://localhost:8002

    2) Update cloud zone with the remote endpoint connection details -
    # radosgw-admin zone modify --rgw-zone=<zone-name> 
    --rgw-zonegroup=<zonegroup-name>  --rgw-realm=<realm> \
      --tier-config=connection.access_key=<remote-endpoint-access-key>,connection.secret=<remote-endpoint-secret>,connection.endpoint=<http://remote-fqdn:port>,connection.host_style=path,acls.source_id=<rgw-user>,acls.dest_id=<remote-endpoint-user>,target-path=<remote-target-path>

    note: host_style, acls and target-path are optional. If not specified, 
    the zone will create a default bucket on the cloud endpoint to sync 
    entries to and maps the same rgw user to remote endpoint.

    eg.,   radosgw-admin zone modify --rgw-zone=cloud-zone 
    --rgw-zonegroup=default --rgw-realm=realm_default 
    --tier-config=connection.access_key=L#############R,connection.secret=Y##########t,connection.endpoint=https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2F10.xx.xx.xx%3A80%2F&amp;data=04%7C01%7Cmselby%40voleon.com%7C7eeea0b9c0564670c7b008da21de423e%7C45212fd85f544a19a6ba493ff6e072b1%7C0%7C0%7C637859535743326124%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&amp;sdata=Zz46bUMcoOP8%2F%2F1Gt%2BlaFOAj39l8TCrYDv7XNXqRs3I%3D&amp;reserved=0,acls.source_id=testid,acls.dest_id=aws-user,target_path=cloud-sync


    3) radosgw-admin period update --commit

    4) radosgw-admin sync status  // to fetch sync status across zones 
    including cloud sync zone.


    Hope this helps!

    -Soumya

    [1] https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.ceph.com%2Fen%2Flatest%2Fradosgw%2Fmultisite%2F%23multisite&amp;data=04%7C01%7Cmselby%40voleon.com%7C7eeea0b9c0564670c7b008da21de423e%7C45212fd85f544a19a6ba493ff6e072b1%7C0%7C0%7C637859535743326124%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&amp;sdata=biHFzyoJ8y2YnODV9c9ZBKBbUqTBkC%2FO2O3kOAOjtMk%3D&amp;reserved=0
    [2] https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.ceph.com%2Fen%2Flatest%2Fradosgw%2Fcloud-sync-module%2F&amp;data=04%7C01%7Cmselby%40voleon.com%7C7eeea0b9c0564670c7b008da21de423e%7C45212fd85f544a19a6ba493ff6e072b1%7C0%7C0%7C637859535743326124%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&amp;sdata=gURadkbDu%2BRhxNJSEEl6Tdu88J6xgpUMvubp3unR%2Bl0%3D&amp;reserved=0


    >
    >
    > _______________________________________________
    > ceph-users mailing list -- ceph-users@xxxxxxx
    > To unsubscribe send an email to ceph-users-leave@xxxxxxx


_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux