Hello, I'm trying to create a RGW Zonegroup with two zones, and to have data replicated between the zones. Each zone is separate Ceph cluster. There is a possibility to use list of endpoints in zone definitions (not just single endpoint) which will be then used for the replication between zones. so I tried to use it instead of using LB in front of clusters for the replication . Here is how I create the zones: radosgw-admin zone create --rgw-zone=sg-ba-pri --master --rgw-zonegroup=sg-ba --endpoints=http://192.168.121.157:80, http://192.168.121.5:80,http://192.168.121.93:80 --access-key=1234567 --secret=098765 --default When I configure it on both sides, replication is working, but when one of source rgw nodes is unavailable, replication stops working with error message Input output error: [ceph: root@ceph2-node0 /]# radosgw-admin sync status realm b131aff4-2e6f-4fb2-8b61-c895bf6be9f3 (sg) zonegroup 9a2956bc-2ea3-4943-81c9-6350c7abd6d1 (sg-ba) zone baa3b15c-36ce-4a74-9ca1-afb2e21fd809 (sg-ba-sec) 2022-11-14T08:32:50.069+0000 7fa201d37500 0 ERROR: failed to fetch mdlog info metadata sync syncing full sync: 0/64 shards failed to fetch master sync status: (5) Input/output error 2022-11-14T08:32:53.140+0000 7fa201d37500 0 ERROR: failed to fetch datalog info data sync source: 457539c6-995c-4116-8189-50490c126903 (sg-ba-pri) failed to retrieve sync info: (5) Input/output error When node is back again, replication continue to work. What is the reason to have possibility to have multiple endpoints in the zone configuration when outage of one of them makes replication not working? Thank you. Kamil Madac _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |