Re: ceph hadoop mapred history server issue

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Since `hadoop -fs ls /` seems to work on your local node, can you
verify that (1) it is in fact listing the contents of CephFS, and (2)
that on your worker nodes where the error is occuring that the
relevant dependencies (naming the Ceph hadoop bindings) are installed
and in the classpath?

The error itself looks like a missing dependency, but that exception
being thrown might also be tirggered by other problems while loading
the bindings.

On Wed, Mar 19, 2014 at 8:43 AM, Gurvinder Singh
<gurvindersinghdahiya@xxxxxxxxx> wrote:
> On 03/19/2014 03:51 PM, Noah Watkins wrote:
>> On Wed, Mar 19, 2014 at 4:28 AM, Gurvinder Singh
>> <gurvindersinghdahiya@xxxxxxxxx> wrote:
>>> Hi,
>>>
>>> I have ceph 0.72.2 running on debian wheezy with cloudera 5.0 beta 2
>>> hadoop. I have installed the ceph hadoop binding with hadoop 2.x
>>> support. I am able to run the command such as
>>
>> From github.com/noahdesu/cephfs-hadoop patched with the pull request PR#1?
>>
> Yes.
>> Can you paste your core-site.xml?
>
> Below is the relevant part for ceph conf
>
>  <property>
>     <name>fs.defaultFS</name>
>     <value>ceph://xxxxxxxxxxxx:6789/</value>
>   </property>
>
>   <property>
>     <name>ceph.conf.file</name>
>     <value>/etc/ceph/ceph.conf</value>
>   </property>
>
>   <property>
>     <name>ceph.auth.id</name>
>     <value>admin</value>
>   </property>
>
>   <property>
>     <name>ceph.auth.keyfile</name>
>     <value>/etc/hadoop/conf/admin.secret</value>
>   </property>
>
>   <property>
>     <name>fs.ceph.impl</name>
>     <value>org.apache.hadoop.fs.ceph.CephFileSystem</value>
>   </property>
>
>
>>
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux