Hi Marc,
Whilst I agree CephFS would probably help compared to your present solution, what I'm looking for something that can talk to a the RadosGW restful object storage APIs, so that the backing storage can be durable and low-cost, i.e., on an erasure coded pool. In this case we're looking to backup a Lustre filesystem.
Cheers,
On 3 March 2017 at 21:29, Marc Roos <M.Roos@xxxxxxxxxxxxxxxxx> wrote:
Hi Blair,
We are also thinking of using ceph for 'backup'. At the moment we are
using rsync and hardlinks on a drbd setup. But I think when using cephfs
things could speed up, because file information is gotten from the mds
daemon, so this should save on one rsync file lookup, and we expect that
we can run more tasks in parallel.
-----Original Message-----
From: Blair Bethwaite [mailto:blair.bethwaite@gmail.com ]
Sent: vrijdag 3 maart 2017 0:55
To: ceph-users@xxxxxxxxxxxxxx
Subject: object store backup tool recommendations
Hi all,
Does anyone have any recommendations for good tools to perform
file-system/tree backups and restores to/from a RGW object store (Swift
or S3 APIs)? Happy to hear about both FOSS and commercial options
please.
I'm interested in:
1) tools known to work or not work at all for a basic file-based data
backup
Plus these extras:
2) preserves/restores correct file metadata (e.g. owner, group, acls
etc)
3) preserves/restores xattrs
4) backs up empty directories and files
5) supports some sort of snapshot/versioning/differential functionality,
i.e., will keep a copy or diff or last N versions of a file or whole
backup set, e.g., so that one can restore yesterday's file/s or last
week's but not have to keep two full copies to achieve it
6) is readily able to restore individual files
7) can encrypt/decrypt client side
8) anything else I should be considering
--
Cheers,
~Blairo
Cheers,
~Blairo
~Blairo
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
