how to using hadoop with ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



 hi all,
       i follow the http://ceph.com/docs/master/cephfs/hadoop/ to use hadoop with ceph. I bulid a ceph cluster at 192.168.58.129 , which include 1 mon ,1 mds and 2 osds. and then I insall a hadoop at 192.168.58.132。 both ceph cluster and hadoop cluster works well.

      First of all ,I  install ceph at 192.168.58.132 , tar -zxvf ceph-0.6.2.tar.gz   ./configure make make install ; does this mean "The native Ceph file system client must be installed on each participating node in the Hadoop cluster"   .Should i put 192.168.58.132 into the ceph cluster?
      Second,   i run   # cp hadoop-cephfs.jar  /usr/hadoop/lib and
      # vim 
conf/core-site.xml.
        <property>
                <name>hadoop.tmp.dir</name>
                <value>/usr/hadoop/tmp</value>
        </property>
        <property>
                <name>fs.default.name</name>
                <value> ceph://192.168.58.129:6789/</value>
        </property>
        <property>
                <name>ceph.mon.address</name>
                <value> 192.168.58.129:6789/</value>
        </property>
        <property>
               <name>ceph.data.pools</name>
               <value>hadoop1</value>
        </property>

Finally, run #/usr/hadoop/bin/start-all.sh, there is nothing changes. what is the detial steps to using hadoop with cephFS.




_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux