On Wed, Jun 27, 2018 at 1:21 AM Kamble, Nitin A <Nitin.Kamble@xxxxxxxxxxxx> wrote: > > I tried enabling the RDMA support in Ceph Luminous release following this [1] guide. > > I used the released Luminous bits, and not the Mellanox branches mentioned in the guide. > > > > I could see some RDMA traffic in the perf counters, but the ceph daemons were still > > complaining that they are not able to talk with each other. > > > > AFAIK the RDMA support in Ceph is experimental. > > > > I would like to know… > > What is the state of the RDMA code in the Ceph Luminous and later releases? in Ceph, the RDMA support has been constantly worked on. xio messenger support was added 4 years ago, but i don't think it's maintained anymore. and async messenger was IB protocol support. i think that's what you wanted to try out. recently, we added the iWARP support to the async messenger, see https://github.com/ceph/ceph/pull/20297. that change also brought better connection management by using rdma-cm to Ceph. and i believe to get RDMA support we should have https://github.com/ceph/ceph/pull/14681, which is still pending on review. > > When will it be production ready? the RDMA support in Ceph is completely driven by our community. and we don't have the hardware (NIC) for testing RoCEv2/iWARP, not to mention IB. so i can hardly tell from the maintainer's perspective. > > > > Thanks, > > Nitin > > > > > > [1]: https://community.mellanox.com/docs/DOC-2721 > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Regards Kefu Chai _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |