Re: Current state of the Ceph-Hadoop integration

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



You need to specify the ceph implementation in core-site.xml:
  <property>
    <name>fs.ceph.impl</name>
    <value>org.apache.hadoop.fs.ceph.CephFileSystem</value>
    <description>
    </description>
  </property>

Mike

On 5 June 2013 16:19, Ilja Maslov <Ilja.Maslov@xxxxxxxxx> wrote:
> Hmm, no joy so far :(
>
> Still getting:
>
> hduser@dfs01:~$ hadoop fs -ls
> Bad connection to FS. command aborted. exception: No FileSystem for scheme: ceph
>
> hadoop-cephfs.jar from http://ceph.com/download/hadoop-cephfs.jar is in the classpath
> libcephfs.jar from libcephfs-java (0.61.2-1precise) package is also in the classpath
>
> hduser@dfs01:~$ hadoop classpath
> /home/hduser/hadoop-1.1.2/libexec/../conf:/home/hduser/hadoop-1.1.2/lib/hadoop-cephfs.jar:/usr/share/java/libcephfs.jar:/usr/lib/jvm/j2sdk1.6-oracle/lib/tools.jar:/home/hduser/hadoop-1.1.2/libexec/..:
> <snip>
>
> I have also tried copying both jars to hadoop/lib, but got the same result
>
> Hadoop distro is hadoop-1.1.2 from stable hadoop-1.1.2.tar.gz
>
> core-site.xml only has hadoop.tmp.dir=/hadoop/tmp and fs.default.name=ceph:/// defined
>
> Is there anything else I can try?
>
> Thank you,
> Ilja
>
>
>>
>> We do have a plugin available! There is a link to it here on this in-
>> progress documentation page.
>>
>>   http://ceph.com/docs/wip-hadoop-doc/cephfs/hadoop/
>>
>> Alternatively, you can download the Git tree you referred to above and
>> run:
>>
>>   "ant cephfs"
>>
>> to build the same plugin. Let us know if you have any trouble!
>>
>> -Noah
>
> This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended recipient, please note that any review, dissemination, disclosure, alteration, printing, circulation, retention or transmission of this e-mail and/or any file or attachment transmitted with it, is prohibited and may be unlawful. If you have received this e-mail or any file or attachment transmitted with it in error please notify postmaster@xxxxxxxxxx. Although Openet has taken reasonable precautions to ensure no viruses are present in this email, we cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



-- 
Mike Bryant | Systems Administrator | Ocado Technology
mike.bryant@xxxxxxxxx | 01707 382148 | www.ocadotechnology.com

-- 
Notice:  This email is confidential and may contain copyright material of 
Ocado Limited (the "Company"). Opinions and views expressed in this message 
may not necessarily reflect the opinions and views of the Company.

If you are not the intended recipient, please notify us immediately and 
delete all copies of this message. Please note that it is your 
responsibility to scan this message for viruses.

Company reg. no. 3875000.

Ocado Limited
Titan Court
3 Bishops Square
Hatfield Business Park
Hatfield
Herts
AL10 9NE
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux