Re: bi-directional cloud sync

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, Feb 20, 2018 at 2:49 PM, Yehuda Sadeh-Weinraub
<yehuda@xxxxxxxxxx> wrote:
> On Tue, Feb 20, 2018 at 2:32 PM, Kyle Bader <kyle.bader@xxxxxxxxx> wrote:
>> The current unidirectional sync is:
>>
>> many buckets -> single bucket
>
> Not necessarily, depending on how it is configured.

Oh, cool!

>> What does that look like if we throw it in reverse?
>
> Depending how the configuration is going to look like. Generally there
> are a few params that deal with mutating the destination bucket/object
> name, and I think we can do some kind of reverse mapping too.
> Currently with the cloud sync you can specify different mappings for
> different buckets (or bucket prefixes). The mapping is defined by a
> configurable field that uses multiple variables to generate the remote
> bucket/object pair. These variables include the sync instance id,
> source zonegroup, source zone, source bucket name, and the bucket
> owner. The default destination name configuration is currently:
> "rgw-${zonegroup}-${sid}/${bucket}", but it can be set to anything
> (that is valid). A bucket named foo in zonegroup named zg with object
> named bar with sync instance id 100 will end up as: rgw-zg-100/foo/bar
> (that is bucket named rgw-zg-100, and object named foo/bar). But you
> could define a different mapping for any bucket, potentially have a
> 1:1 mapping between source buckets and destination buckets. One major
> problem is that in general you're very limited in the number of
> buckets you can create at the destination.

Yeah, AWS is a stickler on this. Generally speaking I don't think they
allow you to go beyond 1k buckets, even if you write in to their
support.

If you have a 1:1 mapping, can you provide different credentials for each map?
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux