I suppose the other option here, which I initially dismissed because Red Hat are not supporting it, is to have a CephFS dir/tree bound to a cache-tier fronted EC pool. Is anyone having luck with such a setup? On 3 March 2017 at 21:40, Blair Bethwaite <blair.bethwaite@xxxxxxxxx> wrote: > Hi Marc, > > Whilst I agree CephFS would probably help compared to your present solution, > what I'm looking for something that can talk to a the RadosGW restful object > storage APIs, so that the backing storage can be durable and low-cost, i.e., > on an erasure coded pool. In this case we're looking to backup a Lustre > filesystem. > > Cheers, > > On 3 March 2017 at 21:29, Marc Roos <M.Roos@xxxxxxxxxxxxxxxxx> wrote: >> >> >> Hi Blair, >> >> We are also thinking of using ceph for 'backup'. At the moment we are >> using rsync and hardlinks on a drbd setup. But I think when using cephfs >> things could speed up, because file information is gotten from the mds >> daemon, so this should save on one rsync file lookup, and we expect that >> we can run more tasks in parallel. >> >> >> >> >> >> -----Original Message----- >> From: Blair Bethwaite [mailto:blair.bethwaite@xxxxxxxxx] >> Sent: vrijdag 3 maart 2017 0:55 >> To: ceph-users@xxxxxxxxxxxxxx >> Subject: object store backup tool recommendations >> >> Hi all, >> >> Does anyone have any recommendations for good tools to perform >> file-system/tree backups and restores to/from a RGW object store (Swift >> or S3 APIs)? Happy to hear about both FOSS and commercial options >> please. >> >> I'm interested in: >> 1) tools known to work or not work at all for a basic file-based data >> backup >> >> Plus these extras: >> 2) preserves/restores correct file metadata (e.g. owner, group, acls >> etc) >> 3) preserves/restores xattrs >> 4) backs up empty directories and files >> 5) supports some sort of snapshot/versioning/differential functionality, >> i.e., will keep a copy or diff or last N versions of a file or whole >> backup set, e.g., so that one can restore yesterday's file/s or last >> week's but not have to keep two full copies to achieve it >> 6) is readily able to restore individual files >> 7) can encrypt/decrypt client side >> >> 8) anything else I should be considering >> >> -- >> >> Cheers, >> ~Blairo >> >> > > > > -- > Cheers, > ~Blairo -- Cheers, ~Blairo _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |