Ceph with RDMA

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

I am trying to use ceph with RDMA. I have a few questions.

1. Is there a prebuilt package that has rdma support or the only way to try ceph+rdma is to checkout from github and compile from scratch?

2. Looks like there are two ways of using rdma - xio and async+rdma. Which is the recommended approach? Also, any insights on the differences will be useful as well.

3. async+rdma seems to have lot of recent changes. Is 11.2.0 expected to work for async+rdma? As when I compiled 11.2.0 it fails with following error

[ 81%] Built target rbd
/mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to `ibv_free_device_list'
/mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to `ibv_get_cq_event'
/mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to `ibv_alloc_pd'
/mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to `ibv_close_device'
/mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to `ibv_destroy_qp'
/mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to `ibv_modify_qp'
/mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to `ibv_get_async_event' 
***snipped***
Link Error: Ceph FS library not found
src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/build.make:57: recipe for target 'src/pybind/cephfs/CMakeFiles/cython_cephfs' failed
make[2]: *** [src/pybind/cephfs/CMakeFiles/cython_cephfs] Error 1
CMakeFiles/Makefile2:4015: recipe for target 'src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/all' failed
make[1]: *** [src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[ 85%] Built target rgw_a

Thanks,
PR
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux