Re: Ceph object mining

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thanks Gregory. I find intel introduced a technology for running hadoop on rgw direclty(http://www.slideshare.net/zhouyuan/hadoop-over-rgw), but I think it is complex for my usage.  There is another technology storlet(http://ibmresearchnews.blogspot.co.uk/2014/05/storlets-turning-object-storage-into.html) developed by IBM research lab, I think that is my expectation, but looks not open source.  So maybe I need develop something similar like storlet with rgw interface.  Thanks


2015-11-14 1:53 GMT+08:00 Gregory Farnum <gfarnum@xxxxxxxxxx>:
I think I saw somebody working on a RADOS interface to Apache Hadoop once, maybe search for that?
Your other option is to try and make use of object classes directly, but that's a bit orimitive to build full map-reduce on top of without a lot of effort.
-Greg


On Friday, November 13, 2015, min fang <louisfang2013@xxxxxxxxx> wrote:
Hi, I setup ceph cluster for storing pictures. I want to introduce a data mining program in ceph osd nodes to dig objects with concrete properties.

I hope some kind of map-reduce framework can use ceph object interface directly,while not using posix file system interface.

Can somebody help give some suggestion?

Thanks.

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux