Thanks Gregory. I find intel introduced a technology for running hadoop on rgw direclty(http://www.slideshare.net/zhouyuan/hadoop-over-rgw), but I think it is complex for my usage. There is another technology storlet(http://ibmresearchnews.blogspot.co.uk/2014/05/storlets-turning-object-storage-into.html) developed by IBM research lab, I think that is my expectation, but looks not open source. So maybe I need develop something similar like storlet with rgw interface. Thanks
2015-11-14 1:53 GMT+08:00 Gregory Farnum <gfarnum@xxxxxxxxxx>:
I think I saw somebody working on a RADOS interface to Apache Hadoop once, maybe search for that?Your other option is to try and make use of object classes directly, but that's a bit orimitive to build full map-reduce on top of without a lot of effort.-Greg
On Friday, November 13, 2015, min fang <louisfang2013@xxxxxxxxx> wrote:Thanks.Can somebody help give some suggestion?Hi, I setup ceph cluster for storing pictures. I want to introduce a data mining program in ceph osd nodes to dig objects with concrete properties.I hope some kind of map-reduce framework can use ceph object interface directly,while not using posix file system interface.
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
