Hi Jose, I believe what you are referring to is using Hadoop over Ceph via the VFS implementation of the Ceph client vs the user-space libcephfs client library. The current Hadoop plugin for Ceph uses the client library. You could run Hadoop over Ceph using a local Ceph mount point, but it would take some configuration (I believe this is how Gluster Hadoop works). To take advantage of data locality, you'd also want to invoke an ioctl (if locality is currently expose), or also integrate with libcephfs for that functionality. -Noah On Tue, Feb 2, 2016 at 7:50 AM, John Spray <jspray@xxxxxxxxxx> wrote: > On Tue, Feb 2, 2016 at 3:42 PM, Jose M <soloninguno@xxxxxxxxxxx> wrote: >> Hi, >> >> >> One simple question, in the ceph docs says that to use Ceph as an HDFS >> replacement, I can use the CephFs Hadoop plugin >> (http://docs.ceph.com/docs/master/cephfs/hadoop/). >> >> >> What I would like to know if instead of using the plugin, I can mount ceph >> in fstab and then point hdfs dirs (namenode, datanode, etc) to this mounted >> "ceph" dirs, instead of native local dirs. >> >> I understand that maybe will involve more configuration steps (configuring >> fstab in each node), but will this work? Is there any problem with this type >> of configuration? > > Without being a big HDFS expert, it seems like you would be > essentially putting one distributed filesystem on top of another > distributed filesystem. I don't know if you're going to find anything > that breaks as such, but it's probably not a good idea. > > John > >> >> Thanks in advance, >> >> >> >> _______________________________________________ >> ceph-users mailing list >> ceph-users@xxxxxxxxxxxxxx >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |