Re: Data deduplication in LVM?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Roy Sigurd Karlsbakk wrote:
On 11. juni. 2009, at 00.30, Stuart D. Gathman wrote:

One OSS backup product that does
deduplication is BackupPC (written in Perl). In the backup server, every file gets hard linked to a name in a special directory that is its md5 checksum
(plus some fiddly logic to handle metadata)


This sounds like file-level deduplication. Most storage systems sing dedup, uses block-level dedup. NetApp is one example; they dedup everything with 4k blocks, doing the actual deduplication at night.

Yes, it is a different concept. However it does work very well when you are storing your backups on a filesystem without block-level dedup. And that is probably the place where you have the most redundancy - or if you don't already, you'll be able to store a much longer history.

--
  Les Mikesell
   lesmikesell@gmail.com

_______________________________________________
linux-lvm mailing list
linux-lvm@redhat.com
https://www.redhat.com/mailman/listinfo/linux-lvm
read the LVM HOW-TO at http://tldp.org/HOWTO/LVM-HOWTO/

[Index of Archives]     [Gluster Users]     [Kernel Development]     [Linux Clusters]     [Device Mapper]     [Security]     [Bugtraq]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]

  Powered by Linux