Re: Accessing Ceph from Spark

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Milan,

We've done some tests here and our hadoop can talk to RGW successfully
with this SwiftFS plugin. But we haven't tried Spark yet. One thing is
the data locality feature, it actually requires some special
configuration of Swift proxy-server, so RGW is not able to archive the
data locality there.

Could you please kindly share some deployment consideration of running
Spark on Swift/Ceph? Tachyon seems more promising...


Sincerely, Yuan


On Wed, Jun 17, 2015 at 9:58 PM, Milan Sladky <milan.sladky@xxxxxxxxxxx> wrote:
> Is it possible to access Ceph from Spark as it is mentioned here for
> Openstack Swift?
>
> https://spark.apache.org/docs/latest/storage-openstack-swift.html
>
> Thanks for help.
>
> Milan Sladky
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux