I’ve been struggling mightily with getting a realm/zonegroup/zone configuration that works for me, and I find it difficult to imagine this isn’t a very common issue. So I might assume I’m thinking about this
incorrectly. We have several clusters, geographically dispersed. I want them all to share a namespace, so I assume that means one realm. But I want to give users the ability to create buckets that replicate among these
clusters at their discretion, with a default bucket creation of “no replication.” Last time I asked, I was told to disable bucket sync for those buckets I didn’t want replicating. But that requires radosgw-admin access, and I want this to be totally self-serve
at the user level. Can anyone tell me what elements of a configuration I need to enable this? It seems more complicated than a single realm, 3-zone zonegroup. I’m just not getting that “more complexity” right. I need to know
in general if what I’m trying to do is possible, and find out about the caveats/best-practices. --Christian What I’ve tried: latest luminous releases; realm=earth, (replicating setup: zonegroup=us, zones=us-west-1-rep, us-west-2-rep, us-east-1-rep) + (non-replicating setup: each cluster having another zonegroup/zone
= us-west-1-local/us-west-1-localzone, us-west-2-local/us-west-2-localzone, us-east-1-local/us-east-1-localzone). I have two radosgw per cluster, one aligned with the replicating zone and one aligned with the local zone (this is a requirement?) This seems
to be barely working, and test users get a lot of errors when doing bucket or object ops. We can see all the buckets and objects from any of the radosgw that are clients of a cluster, but s3 commands using the “wrong” radosgw often fail. I’d like to be able
to load balance across both our radosgw hosts to access a particular cluster, to maintain HA access. That doesn’t work well if a radosgw is “assigned” to a particular zone… |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com