Re: Using cephfs with hadoop

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Thu, Sep 17, 2015 at 7:48 PM, Fulin Sun <sunfl@xxxxxxxxxxxxxxxx> wrote:
> Hi, guys
>
> I am wondering if I am able to deploy ceph and hadoop into different cluster
> nodes and I can
>
> still use cephfs as the backend for hadoop access.
>
> For example, ceph in cluster 1 and hadoop in cluster 2, while cluster 1 and
> cluster 2 can be mutally accessed.
>
> If so, what would be done for the hadoop cluster ? Do I need to setup cephfs
> client in every hadoop node ?
>
> Or I just need to configure core-site.xml and put ceph-hadoop.jar into
> hadoop classpath ?

It should be basically this. We're still working on nice docs for
Hadoop-on-Ceph but the ceph-hadoop jar handles configuring libcephfs
and connecting to the Ceph cluster on its own, so having a separate
mount on the machines is totally pointless.
-Greg

>
> Really need your kind advice and experience.
>
> Best,
> Sun.
>
> ________________________________
> ________________________________
>
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux