Re: Mojette based Erasure Code is more performant than ISA-L or Jerasure

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



>>We compared to CephFS (in replication mode) and outperform it. 
>>Particularly, in random I/Os where the 4KB (or 8KB) blocks structure is 
>>well suited for Rozo. 

I have found your paper here

https://departements.telecom-bretagne.eu/data/elec/SITES/PublicElec/BenoitParrein_interGDR.pdf

100k 4k randread, an 80k 4k iops randwrite, not too bad with 4 nodes ! 

What was the bottleneck ? cpu ?




----- Mail original -----
De: "Benoît Parrein" <benoit.parrein@xxxxxxxxxxxxxxxxxxxxxxx>
À: "Chandan Kumar Singh" <chandan.kr.singh@xxxxxxxxx>, "ceph-devel" <ceph-devel@xxxxxxxxxxxxxxx>
Envoyé: Vendredi 3 Juin 2016 15:25:37
Objet: Re: Mojette based Erasure Code is more performant than ISA-L or Jerasure

Hi Chandan, 

thanks you for your post 

indeed we observe in our experiment that Mojette erasure coding has 
better performance than ISA-L (thanks to the discrete geometry and 
Mojette transform). A systematic/standard version exists. It is a patent 
(as couples of erasure coding). We are few cycles above memcopy 
instructions. 
A paper is currently under revision and will appear soon on this. 

Moreover RozoFS is alive! see on github https://github.com/rozofs/rozofs 
(last commit 6 days ago). 
8 peoples are working daily to improve this fully posix DFS which is 
today the only one on the earth erasure coding based (at our best 
knowledge). 
We compared to CephFS (in replication mode) and outperform it. 
Particularly, in random I/Os where the 4KB (or 8KB) blocks structure is 
well suited for Rozo. 
Same. A paper will appear soon on this point. 

Best regards 
bparrein, University of Nantes 



Le 20/04/2016 10:52, Chandan Kumar Singh a écrit : 
> Hi 
> 
> The authors of Mojette Erasure Encoding claim that this EC has higher 
> performance than ISA-L and Jerasure and can be used for hot storage 
> use cases. Their EC is used in open source RozoFS. What is your 
> evaluation of it? It will be nice if it is available as another EC 
> plugin. 
> 
> Regards 
> Chandan 
> -- 
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in 
> the body of a message to majordomo@xxxxxxxxxxxxxxx 
> More majordomo info at http://vger.kernel.org/majordomo-info.html 
> 

-- 
---------------- 
Benoît Parrein 
Maître de Conférences (HDR) 
Université de Nantes (Polytech Nantes), laboratoire IRCCyN 
web: http://www.irccyn.ec-nantes.fr/~parrein/ 
tel: +33(0)240683050 

-- 
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in 
the body of a message to majordomo@xxxxxxxxxxxxxxx 
More majordomo info at http://vger.kernel.org/majordomo-info.html 
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux