Thanks, Noah. I'll definitely check it out. -Tatsuya On 12/20/2010, at 5:45 AM, Noah Watkins wrote: >> There are also a couple FileSystem implementations that replace HDFS with >> Ceph. One uses the libceph userspace client, and one relies on the >> kernel's support and uses a few ioctls to control/expose file placement. >> I wonder if that would also meet your needs? > > The version that uses the native kernel Ceph client is available for > Hadoop 0.21 in the following Git branch: > > git://github.com/noahdesu/hadoop-common.git haceph/0.21-mimic-rawlocal > > The JNI code that interfaces to the Ceph IOCTLs is integrated with > the Hadoop native-code feature. To compile simply use: > > ant -Dcompile.native=true -Dnative.ceph.srcdir=/path/to/ceph <targets> > > Note that by default Hadoop native code builds some compression libraries, > thus you'll need to make sure that zlib development files are installed on the > system (zlib1g-dev on Debian). > > Finally, the file system URI scheme to use is: > > "ceph:/path/to/mount". > > - Noah -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
