On Mon, Oct 9, 2017 at 6:45 PM, Two Spirit <twospirit6905@xxxxxxxxx> wrote: > Thanks for the clarifications. one comment below. > >>> If this is supported, what happens if zone1 data is modified, while at >>> the same time a zone2 modifies the same data but the data was not yet >>> copied from the zone1 to zone2. How is this conflict handled? Does >>> last write win? >>> >>Yes the last write will win (in the end) > > (feature request)I know this is a very popular solution, but I wanted > to shine in on this. I think it is a very bad solution. We have run > into catastrophic loss of data due to this algorithm and has happened > many times, just because someone eventually close out files not > realizing there were other instances. Usually the lost data is very > recently modified. The analogy for developers is if there was source > code conflict, the last write wins. It would be more helpful if both > versions were preserved for manual merge. > Radosgw is object storage (S3 compatible), this means object are immutable and when you write on an object you completely overwrite it. If you want to be able to revert to a different version, you can enable versioning on the bucket. This means every write of the object will create a new version of the object and keep the old one. The replication will replicate all the versions. You can delete automatically very old versions using the life cycle feature to free space. Cheers, Orit > On Tue, Oct 3, 2017 at 5:52 AM, Orit Wasserman <owasserm@xxxxxxxxxx> wrote: >> On Mon, Oct 2, 2017 at 11:41 PM, Two Spirit <twospirit6905@xxxxxxxxx> wrote: >>> The documenation I saw talked about multi-zones, but seems to stop in >>> the details at 2 zones whereas, before, Jewel's Master zone(RW) wrote >>> to Slave Zone(RO), and now after Jewel, writing to the Slave is doable >>> (implying RW) to either zone. and didn't address the case of 3 or more >>> zones. I thought the Master/Slave architecture implied it was limited >>> to 2 zones. >>> >> In the new multisite (from Jewel) the default is RW but it is possible to set a >> zone to be read only (slave). >> >>> Is RW to any zone supported in 3+ zone configurations? The whole >>> master/slave idea doesn't seem to make sense when talking about 3+ >>> zones. I'm taking a guess that this must be fully meshed, and RW to >>> any modifications in one zone replicates to *all* other zones >>> (independent on the number of replicas specified in any cluster) >>> >> >> Yes, we support 3+ zones configuration. All the zones in the zonegroup >> replicated to each other , so yes it is a mesh. the Read Only zones only >> read from the other zones. >> >>> If this is supported, what happens if zone1 data is modified, while at >>> the same time a zone2 modifies the same data but the data was not yet >>> copied from the zone1 to zone2. How is this conflict handled? Does >>> last write win? >>> >> Yes the last write will win (in the end) >> >>> Is the RADOS "primary copy", "Chain", and "Splay" replication strategy >>> also used in multisite traffic? >> don't think those are related to multisite traffic which is based on REST API >> >> Regards, >> Orit -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html