you can decrease "ms_async_rdma_send_buffers" and "ms_async_rdma_receive_buffers" to see whether help if the reason is system limitation On Wed, Jun 28, 2017 at 6:09 PM, Haomai Wang <haomai@xxxxxxxx> wrote: > On Wed, Jun 28, 2017 at 6:02 PM, 한승진 <yongiman@xxxxxxxxx> wrote: >> Hello Cephers! >> >> I am testing CEPH over RDMA now. >> >> I cloned the latest source code of ceph. >> >> I added below configs in ceph.conf >> >> ms_type = async+rdma >> ms_cluster_type = async+rdma >> ms_async_rdma_device_name = mlx4_0 >> >> However, I got same error message when I start ceph-mon and ceph-osd >> service. >> >> The message is below >> >> 0> 2017-06-28 18:51:28.908531 7fef15ff6700 -1 >> /root/ceph/src/msg/async/rdma/Infiniband.cc: In function 'int >> Infiniband::MemoryManager::Cluster::fill(uint32_t)' thread 7fef15ff6700 time >> 2017-06-28 18:51:28.906043 >> /root/ceph/src/msg/async/rdma/Infiniband.cc: 600: FAILED assert(m) > > hmm, we haven't met this problem before. > > I guess the errno should be ENOMEM, it means "Not enough resources > (either in operating system or in RDMA device) to complete this > operation". > > do you have any log in /var/log/messages? > >> >> Is ceph with rdma is not ready yet? >> >> Thanks >> John H >> >> _______________________________________________ >> ceph-users mailing list >> ceph-users@xxxxxxxxxxxxxx >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |