RE: Inline dedup/compression

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



> -----Original Message-----
> From: ceph-devel-owner@xxxxxxxxxxxxxxx [mailto:ceph-devel-
> owner@xxxxxxxxxxxxxxx] On Behalf Of James (Fei) Liu-SSI
> Sent: Friday, June 26, 2015 12:01 AM
> 
> Hi Cephers,
>     It is not easy to ask when Ceph is going to support inline
> dedup/compression across OSDs in RADOS because it is not easy task and
> answered. Ceph is providing replication and EC for performance and failure
> recovery. But we also lose the efficiency  of storage store and cost associate
> with it. It is kind of contradicted with each other. But I am curious how other
> Cephers think about this question.
>    Any plan for Cephers to do anything regarding to inline
> dedupe/compression except the features brought by local node itself like
> BRTFS?

Actually, I was considering some kind of simple compression (think RLE or some fast variant of Huffman/LZW), but for data payloads in messenger. That would help in inter-datacenter configurations (where fast, low-latency links are prohibitively expensive or even not an option at all, so any extra MB/s counts and latency is already high), and with slow internal networks (1gbit Ethernet, and so on), but never had time to do some proper research on that matter.


With best regards / Pozdrawiam
Piotr Dałek
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux