Re: Ceph as an Alternative to HDFS for Hadoop

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Serkan

On Fri, Dec 22, 2017 at 12:04 PM, Serkan Çoban <cobanserkan@xxxxxxxxx> wrote:
>Also, are there any benchmark comparisons between hdfs and ceph specifically around performance of apps benefiting from data locality ?
There will be no data locality in ceph, because all the data is
accessed through network.


Ok, so in "slow" networks this will be an issue.


 

On Fri, Dec 22, 2017 at 4:52 AM, Traiano Welcome <traiano@xxxxxxxxx> wrote:
> Hi List
>
> I'm researching the possibility os using ceph as a drop in replacement for
> hdfs for applications using spark and hadoop.
>
> I note that the jewel documentation states that it requires hadoop 1.1.x,
> which seems a little dated and would be of concern for peopel:
>
> http://docs.ceph.com/docs/jewel/cephfs/hadoop/
>
> What about the 2.x series?
>


Is there any information on whether Ceph will support 2.X series Hadoop ?



 
> Also, are there any benchmark comparisons between hdfs and ceph specifically
> around performance of apps benefiting from data locality ?
>
> Many thanks in advance for any feedback!
>
> Regards,
> Traiano
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux