On Thu, Mar 24, 2016 at 8:50 AM, Victor Denisov <vdenisov@xxxxxxxxxxxx> wrote: > Hi Ceph developers, > > With this email I would like to start a discussion about the design of > the consistency groups feature. > > I created a wiki page for this blueprint: > http://tracker.ceph.com/projects/ceph/wiki/consistency_groups > > So far it's only filled with what I know for sure about the > consistency groups feature. > > First of all this feature is going to require a new entity in rbd - > consistency group. > > This entity will be represented in the object storage in the way > similar to how it's done for images. > > cg_id.<group name> object has the id of the consistency group. > > cg_header.<group id> object has the list of all images in the > consistency group. > > Snapshot information will be stored in the omap attributes of > cg_header. > > Every description of a snapshot will contain the list of snapshot ids > of the images that comprise the cg's snapshot. > > Potentially, I assume, we want to allow images to be members of > several consistency groups. However it can add complexity to the > implementation, see the explanation down the text. I think your design is going to be driven more by the needs and choices of the rbd journaling, but given that, there's very little reason you can't allow an image to be in more than one CG. Presumably clients need to set a watch on each CG their image is part of, and to apply every new snap to the image header. That's about it and not terribly complicated? <snip> > The biggest question regarding the implementation comes from the live > snapshot feature. We believe constistent snapshot is not possible > without cooperation with rbd client (VM, application), because only > application knows if it is in constistent state for snapshotting. In > the first iteration we would like to make it simple, so CG snapshot > operation just creates snapshots for all images and stores the > snapshot list in its metadata. Just to be clear, you know that you can use the same snapid for all the images, right? (...although not if you're trying to allow CGs across pools. Those will be a little harder.) -Greg -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
