Hello, I am trying to get NVMe-oF working with soft-RoCE. Ibv_rc_pingpong works between 2 systems via Soft-RoCE. NVMe discover works and show the target subsystems. But NVMe connect fails. I would like to know if anyone got this working successfully? Following are the errors I see bash: echo: write error: Cannot allocate memory [12223.111127] nvme nvme2: creating 32 I/O queues. [12223.123079] nvme nvme2: failed to initialize MR pool sized 128 for QID 16 [12223.123137] nvme nvme2: rdma connection establishment failed (-12) When I reduced nr_io_queues=8 system crashes. nvme nvme2: creating 8 I/O queues. [12535.522136] nvme nvme2: new ctrl: NQN "sky12subsys1", addr 192.168.11.12:4420 [12535.658280] rdma_rxe: qp#40 moved to error state [12535.658572] BUG: unable to handle kernel NULL pointer dereference at 0000000000000014 [12535.658582] IP: __nvme_rdma_recv_done.isra.46+0x1d9/0x330 [nvme_rdma] [12535.658583] PGD 0 P4D 0 5.658660] Call Trace: [12535.658677] __ib_process_cq+0x78/0xd0 [ib_core] [12535.658683] ib_poll_handler+0x1e/0x60 [ib_core] [12535.658692] irq_poll_softirq+0xa8/0x100 [12535.658698] __do_softirq+0xc8/0x26c [12535.658703] run_ksoftirqd+0x24/0x40 [12535.658707] smpboot_thread_fn+0xfe/0x150 [12535.658709] kthread+0xf5/0x130 [12535.658712] ? sort_range+0x20/0x20 [12535.658713] ? kthread_associate_blkcg+0x90/0x90 Any inputs will be really helpful. Thanks Rajlaxmi -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
