Re: Pluggable interface for erasure coding?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

The Openstack Swift community has gone through the same problem
(allowing pluggable backends) when it implemented EC in Swift.

They came up with this generic EC library:
https://github.com/openstack/liberasurecode

It currently supports 6 EC backends.
Hope this helps.

 -Prashanth Pai

----- Original Message -----
> From: "Niels de Vos" <ndevos@xxxxxxxxxx>
> To: "Pranith Kumar Karampuri" <pkarampu@xxxxxxxxxx>, "Ashish Pandey" <aspandey@xxxxxxxxxx>, "Xavier Hernandez"
> <xhernandez@xxxxxxxxxx>
> Cc: "Per Simonsen" <per.simonsen@xxxxxxxxxxxxx>, gluster-devel@xxxxxxxxxxx
> Sent: Thursday, 2 March, 2017 12:28:46 PM
> Subject:  Pluggable interface for erasure coding?
> 
> Hi guys,
> 
> I think this is a topic/question that has come up before, but I can not
> find any references or feature requests related to it. Because there are
> different libraries for Erasure Coding, it would be interesting to be
> able to select alternatives to the bundled implementation that Gluster
> has. Are there any plans to make the current Erasure Coding
> implementation more pluggable? Would this be a possible feature request,
> or would it require a major rewrite of the current interface?
> 
> Here at FAST [0] I have briefly spoken to Per Simonsen from MemoScale
> [1]. This company offers a (proprietary) library for Erasure Coding,
> optimized for different architectures, and  with some unique(?) features
> for recovering a failed fragment/disk. If Gluster allows alternative
> implementations for the encoding, it would help organisations and
> researchers to get results of their work in a distributed filesystem.
> And with that, spread the word about how easy to adapt and extend
> Gluster is :-)
> 
> Thanks,
> Niels
> 
> 
> 0. https://www.usenix.org/conference/fast17
> 1. https://memoscale.com/
> 
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel@xxxxxxxxxxx
> http://lists.gluster.org/mailman/listinfo/gluster-devel
_______________________________________________
Gluster-devel mailing list
Gluster-devel@xxxxxxxxxxx
http://lists.gluster.org/mailman/listinfo/gluster-devel



[Index of Archives]     [Gluster Users]     [Ceph Users]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Security]     [Bugtraq]     [Linux]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux