Re: Raid vs rsync -

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, Mar 10, 2015 at 2:38 PM, Steven Rosenberg
<stevenhrosenberg@xxxxxxxxx> wrote:

> What usually happens is that a file is corrupted, by either man or
> machine, and then that corrupted data goes to your backup, and you are
> screwed.

SDC and propagation of corruption is a big problem actually especially
rotated media backups, or even the restore process, causes
derivatives. Each derivative inherits and creates its own SDC over
time. A file gets corrupt, and then backed up to one or more backups,
eventually replacing all good copies. And there's no notification of
this.

This even affects Btrfs and ZFS if it isn't exclusively used in the
chain. If corruption has already happened, of course Btrfs and ZFS
simply maintain and propagate that corruption. Granted it should stop
additional corruptions (or at least notify of them). But we need e.g.
/home to be on Btrfs to significant reduce this.

The network is a source of SDC also. It's conceivable to have a Btrfs
source and destination, using rsync between them, and for SDC to get
introduced without notice by the network. The BER for networks is
highly variable, it's not a static thing, it can change just by
pinching a wire. If you follow the specs exactly then you get a BER
that probably isn't being exceeded value, but that's it, no guarantee.

The best guarantee? Btrfs /home, Btrfs backups, and rsync with
checksumming enabled to confirm what's on the source is actually
what's on the destination. That's slow. There is a feature idea to get
rsync some Btrfs awareness so that this can be optimized, taking
advantage of work Btrfs has already done, rather than separately
compute additional checksums.


-- 
Chris Murphy
-- 
users mailing list
users@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Fedora Code of Conduct: http://fedoraproject.org/code-of-conduct
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Have a question? Ask away: http://ask.fedoraproject.org




[Index of Archives]     [Older Fedora Users]     [Fedora Announce]     [Fedora Package Announce]     [EPEL Announce]     [EPEL Devel]     [Fedora Magazine]     [Fedora Summer Coding]     [Fedora Laptop]     [Fedora Cloud]     [Fedora Advisory Board]     [Fedora Education]     [Fedora Security]     [Fedora Scitech]     [Fedora Robotics]     [Fedora Infrastructure]     [Fedora Websites]     [Anaconda Devel]     [Fedora Devel Java]     [Fedora Desktop]     [Fedora Fonts]     [Fedora Marketing]     [Fedora Management Tools]     [Fedora Mentors]     [Fedora Package Review]     [Fedora R Devel]     [Fedora PHP Devel]     [Kickstart]     [Fedora Music]     [Fedora Packaging]     [Fedora SELinux]     [Fedora Legal]     [Fedora Kernel]     [Fedora OCaml]     [Coolkey]     [Virtualization Tools]     [ET Management Tools]     [Yum Users]     [Yosemite News]     [Gnome Users]     [KDE Users]     [Fedora Art]     [Fedora Docs]     [Fedora Sparc]     [Libvirt Users]     [Fedora ARM]

  Powered by Linux