On Friday, July 8, 2016, Brendan Moloney <moloney@xxxxxxxx> wrote:
Hi,
We have a smallish Ceph cluster for RBD images. We use snapshotting for local incremental backups. I would like to start sending some of these snapshots to an external cloud service (likely Amazon) for disaster recovery purposes.
Does anyone have advice on how to do this? I suppose I could just use the rbd export/diff commands but some of our RBD images are quite large (multiple terabytes) so I can imagine this becoming quite inefficient. We would either need to keep all snapshots indefinitely and retrieve every single snapshot to recover or we would have to occasionally send a new full disk image.
I guess doing the backups on the object level could potentially avoid these issues, but I am not sure how to go about that.
We are currently rolling out a solution that utilizes merge-diff command to continuously create synthetic fulls at the remote site. The remote site needs to be more than just storage, e.g. a Linux VM or such, but as long as the continuity of snapshots is maintained, you should be able to recover from just the one image.
Detecting start and end snapshot of a diff export file is not hard, I asked details earlier on this list, and would be happy to send you code stubs in Perl if you are interested.
Another option, which we have not yet tried with RBD exports is the borgbackup project, which offers excellent deduplication.
HTH,
Alex
Any advice is greatly appreciated.
Thanks,
Brendan
--
--
Alex Gorbachev
Storcium
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
