Re: Ceph as an Alternative to HDFS for Hadoop

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 





On Wed, Dec 27, 2017 at 1:52 AM, Aristeu Gil Alves Jr <aristeu.jr@xxxxxxxxx> wrote:
In a recent thread on the list, I received various important answers to my questions on hadoop plugin. Maybe this thread will help you.

One of the most important answers is about data locality. The last message lead me to this article.


Thanks, this was informative!


 


Regards,
--
Aristeu

2017-12-22 2:04 GMT-02:00 Serkan Çoban <cobanserkan@xxxxxxxxx>:
>Also, are there any benchmark comparisons between hdfs and ceph specifically around performance of apps benefiting from data locality ?
There will be no data locality in ceph, because all the data is
accessed through network.

On Fri, Dec 22, 2017 at 4:52 AM, Traiano Welcome <traiano@xxxxxxxxx> wrote:
> Hi List
>
> I'm researching the possibility os using ceph as a drop in replacement for
> hdfs for applications using spark and hadoop.
>
> I note that the jewel documentation states that it requires hadoop 1.1.x,
> which seems a little dated and would be of concern for peopel:
>
> http://docs.ceph.com/docs/jewel/cephfs/hadoop/
>
> What about the 2.x series?
>
> Also, are there any benchmark comparisons between hdfs and ceph specifically
> around performance of apps benefiting from data locality ?
>
> Many thanks in advance for any feedback!
>
> Regards,
> Traiano
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux