On Tue, Nov 30, 2010 at 11:56 PM, Phil Turmel <philip@xxxxxxxxxx> wrote: > (Actually, rsync and tar are both hardlink-aware, at least the versions I use.) My backup filesystems contain so many hardlinks (millions, constantly growing) that file-level tools choke - this really must be done at the block device level - see my previous post for more detail. It's also now clear to me that rsync is the tool to use for this for all the other LVs without such problematic filesystems, as I know the tool and trust its error-checking routines. >> So adapting your suggestion to fit (my perception of) my needs: >> >> - create an LV snapshot >> - mount a plain partition on a physical hard disk (preferably on a >> separate controller?) >> - dd the data from the LV snapshot over to the partition >> - delete the snapshot > > Yep, this is basically what I recommended. >> So I guess my question becomes: >> >> What is the best tool to block-level clone an LV snapshot to a regular >> disk partition? >> >> - "best" = as close to 100% reliably as possible, speed isn't nearly >> as important > > I would use dd. OK, that's clear, thanks. >> Would a COT cloning package (something like Acronis TrueImage) have >> data reliability advantages (like mdm's) over dd? > > Not really. But they may offer various forms of compression/sparsification/error detection if you wish to store the final backups as files. Of course, if you do that, you might as well use tar+gzip+md5sum. No, I'm talking about partition-to-partition cloning operations, which some of these do support. The error detection is critical, and why I was looking at mdraid in the first place. > You want your dismountable disks to be accessible stand-alone, but I don't see why that would preclude setting them up so each is a unique LVM VG. It doesn't preclude it, but it's a layer of complexity during the data recovery process I'm trying to avoid. The ultimate goal is a plain partition on a plain disk that can be directly mounted on a SATA2 host via a normal recovery/LiveCD by a user that's never heard of RAID or LVM. To summarize your feedback: - mdraid's sync error-checking routines don't add value over dd to ensure accurate cloning of a static partition; its metadata is just useless overhead in this case. - dd is reliable enough One last question (and I do realize it's now OT for here, so I won't be hurt if it's ignored :) Does dd already do some sort of "verify after copy"? I will likely investigate the available COTS partition cloning tools as well. Thanks for all your help, not least in helping me to clarify my own goals -- To unsubscribe from this list: send the line "unsubscribe linux-raid" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
