Re: guidance with hadoop on ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Varun,

The main Ceph/Hadoop development is being done in a new location now.

  http://github.com/ceph/hadopo-common cephfs/branch-1.0

The Java bindings for Ceph are contained in the main Ceph tree. They are also included in the Debian PPA releases, but in the short term the dependency for Hadoop is on the master branch.

So, in summary:

1. Grab the Hadoop branch above
2. Get the Ceph Java bindings
    - Build ceph with --eanble-cephfs-java
    - Or use the master PPA
3. Build Hadoop

This is a listing of configuration options that the Hadoop bindings recognize

  http://ceph.com/docs/master/cephfs/hadoop/

And there is a lot more documentation in the pipe. I'll ping the mailing list once it gets posted.

Let us know if you have any issues getting started.

Thanks,
Noah


On Feb 13, 2013, at 1:35 AM, Varun Chandramouli <varun.c37@xxxxxxxxx> wrote:

> Hi all,
> 
> I am new to ceph (installed latest version of ceph via the 5-minute installation guide). I am facing a problem while trying to run hadoop on ceph instead of hdfs. According to the steps given here: http://static.usenix.org/publications/login/2010-08/openpdfs/maltzahn.pdf , I installed the hadoop patch given here: https://issues.apache.org/jira/browse/HADOOP-6253 on hadoop-1.0.3. 
> 
> However, I am not able to find libhadoopceph on my system, and so, am not able to give a path for fs.ceph.libDir. Can anyone tell me where I am wrong? 
> 
> Thank You
> Varun
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux