On Wed, Aug 28, 2013 at 04:24:59PM +0200, Gandalf Corvotempesta wrote: > 2013/6/20 Matthew Anderson <manderson8787@xxxxxxxxx>: > > Hi All, > > > > I've had a few conversations on IRC about getting RDMA support into Ceph and > > thought I would give it a quick attempt to hopefully spur some interest. > > What I would like to accomplish is an RSockets only implementation so I'm > > able to use Ceph, RBD and QEMU at full speed over an Infiniband fabric. > > On which OS/Kernel are you trying ceph over IB ? CentOS-6.4 with a vanilla kernel-3.8.13 > Cuttlefish needs a 3.8 kernel and OFED is not supported on this version. OFED is not needed. all IB drivers are included: # lsmod | egrep 'mlx4_|qib' mlx4_ib 125469 1 ib_sa 23329 5 ib_ipoib,rdma_ucm,rdma_cm,ib_cm,mlx4_ib mlx4_en 65140 0 mlx4_core 191314 2 mlx4_ib,mlx4_en ib_qib 374565 1 ib_mad 40015 5 ib_umad,ib_cm,mlx4_ib,ib_sa,ib_qib ib_core 71659 12 ib_ipoib,rdma_ucm,ib_ucm,ib_uverbs,ib_umad,rdma_cm,ib_cm,iw_cm,mlx4_ib,ib_sa,ib_qib,ib_mad rsockets is Userland: rpm -ql librdmacm | grep libr /usr/lib64/librdmacm.so.1 /usr/lib64/librdmacm.so.1.0.0 /usr/lib64/rsocket/librspreload.so.1 /usr/lib64/rsocket/librspreload.so.1.0.0 /usr/share/doc/librdmacm-1.0.17 /usr/share/doc/librdmacm-1.0.17/AUTHORS /usr/share/doc/librdmacm-1.0.17/COPYING /usr/share/doc/librdmacm-1.0.17/README Mit freundlichen Grüßen / Best regards Dieter Kasper > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com