Re: hadoop on ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



In hadoop 2.6 the namenode must be on , but hadoop 1.1.2 the namenode is down is ok.
below is the configuration.
<property>
        <name>fs.default.name</name>
        <value>ceph://ceph0:6789/</value>
   </property>
 in hadoop2.6 the raise exceptions like this:
15/07/28 11:26:55 INFO mapreduce.Cluster: Failed to use org.apache.hadoop.mapred.YarnClientProtocolProvider due to error: Error in instantiating YarnClient
java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.

How can i use it in hadoop2.6?


jingxia.sun@xxxxxxxxxxxxxx
 
From: Patrick McGarry
Date: 2015-07-28 01:34
To: jingxia.sun@xxxxxxxxxxxxxx; Ceph-User
CC: community
Subject: Re: hadoop on ceph
Moving this to the ceph-user list where it has a better chance of
being answered.
 
 
 
On Mon, Jul 27, 2015 at 5:35 AM, jingxia.sun@xxxxxxxxxxxxxx
<jingxia.sun@xxxxxxxxxxxxxx> wrote:
> Dear ,
> I have questions to ask.
> The doc says hadoop on ceph but requires Hadoop 1.1.X stable series
> I want to know if CephFS Hadoop plugin can be used by Hadoop 2.6.0  now or
> it is not support Hadoop2.6.0 and still being developed?
> If Ceph can not be used by Hadoop2.6.0,then i want to know when it will can
> be used and is there a team to developing it?
> I use Hadoop 1.1.2 on ceph is ok, but when hadoop 2.6.0 use ceph,there is
> something wrong and hdfs is still on.
>
> Hope your request!
> BW.
>
>  tCurently req Hadoop 1.1.X stable series
>
>
> ________________________________
> jingxia.sun@xxxxxxxxxxxxxx
 
 
 
--
 
Best Regards,
 
Patrick McGarry
Director Ceph Community || Red Hat
http://ceph.com  ||  http://community.redhat.com
@scuttlemonkey || @ceph
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux