hi all,
i follow the http://ceph.com/docs/master/cephfs/hadoop/ to use hadoop with ceph. I bulid a ceph cluster at 192.168.58.129 , which include 1 mon ,1 mds and 2 osds. and then I insall a hadoop at 192.168.58.132。 both ceph cluster and hadoop cluster works well.
First of all ,I install ceph at 192.168.58.132 , tar -zxvf ceph-0.6.2.tar.gz ./configure make make install ; does this mean "The native Ceph file system client must be installed on each participating node in the Hadoop cluster" .Should i put 192.168.58.132 into the ceph cluster?
Second, i run # cp hadoop-cephfs.jar /usr/hadoop/lib and
# vim conf/core-site.xml.
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/hadoop/tmp</value>
</property>
<property>
<name>fs.default.name</name>
<value> ceph://192.168.58.129:6789/</value>
</property>
<property>
<name>ceph.mon.address</name>
<value> 192.168.58.129:6789/</value>
</property>
i follow the http://ceph.com/docs/master/cephfs/hadoop/ to use hadoop with ceph. I bulid a ceph cluster at 192.168.58.129 , which include 1 mon ,1 mds and 2 osds. and then I insall a hadoop at 192.168.58.132。 both ceph cluster and hadoop cluster works well.
First of all ,I install ceph at 192.168.58.132 , tar -zxvf ceph-0.6.2.tar.gz ./configure make make install ; does this mean "The native Ceph file system client must be installed on each participating node in the Hadoop cluster" .Should i put 192.168.58.132 into the ceph cluster?
Second, i run # cp hadoop-cephfs.jar /usr/hadoop/lib and
# vim conf/core-site.xml.
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/hadoop/tmp</value>
</property>
<property>
<name>fs.default.name</name>
<value> ceph://192.168.58.129:6789/</value>
</property>
<property>
<name>ceph.mon.address</name>
<value> 192.168.58.129:6789/</value>
</property>
<property> <name>ceph.data.pools</name> <value>hadoop1</value> </property>
Finally, run #/usr/hadoop/bin/start-all.sh, there is nothing changes. what is the detial steps to using hadoop with cephFS.
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com