Re: CEPH Cluster Backup - Options on my solution

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi together,

Am 17.08.19 um 13:31 schrieb Mike O'Connor:
> 
>> [SNIP script]
>>
>> Hi mike
>>
>> When looking for backup solutions, did you come across benji [1][2]
>> and the orginal backy2 [3][4] solutions ?
>> I have been running benji for a while now, and it seems solid. I use a
>> second cluster as storage, but it does support S3 and encryption as well.
>>
>> just wondering if you had any experience you could share that excluded
>> these options, and make you aware of them if you did not. 
> Hi Ronny
> 
> Installed backy2 but it uses local storage, at least for a period of time.
> 
> When I found it was taking up all my root disk space I had to stop it.

there is a significant difference between Benji and Backy2, which may save several factors of space (it does for us):
Benji can compress using zstd. This is usually very much worth it, if your CPU can handle it. It is especially useful if not much changes on the filesystems on those RBD volumes apart from superblocks. 
Backy has to backup the full changed blocks at the block size used by RBD, while benji of course does the same - but compresses all those zeroes around the superblocks away. 

Another extremely helpful factor to conserve space is using file system trimming. If you run VMs on those RBD volumes, virtio-scsi allows to use trim, so you could trim e.g. via qemu-guest-agent
if it is installed in all VMs (CentOS 7 installs it by default for example if installed in a qemu VM). 
It also allows to issue fsfreeze, so you get consistent snapshots. For databases, you can also use fsfreeze hooks. 

Cheers,
Oliver

> 
> I have not tried benji, as I assumed it used the same methods.
> 
> Cheers
> 
> Mike
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
> 

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux