Hi Jason, Sagi- As we discussed a few weeks ago, this patch series implements the following: - Send SGEs are now managed via lock-less, wait-free circular queues - Send SGEs referring to page cache pages are DMA unmapped during Send completion - Send completions are batched to reduce interrupts, but still provide a periodic heartbeat signal for SQ housekeeping - The circular queue prevents Send Queue overflow The purpose of this change is to address the issue Sagi reported where the HCA continues to retry a delayed Send request _after_ RPC completion, resulting in a DMA error. Also available as the first five commits in this topic branch: http://git.linux-nfs.org/?p=cel/cel-2.6.git;a=shortlog;h=refs/heads/nfs-rdma-for-4.15 --- Chuck Lever (5): xprtrdma: Clean up SGE accounting in rpcrdma_prepare_msg_sges() xprtrdma: Change return value of rpcrdma_prepare_send_sges() xprtrdma: Add data structure to manage RDMA Send arguments xprtrdma: Manage RDMA Send arguments via lock-free circular queue xprtrdma: Remove atomic send completion counting net/sunrpc/xprtrdma/backchannel.c | 6 + net/sunrpc/xprtrdma/frwr_ops.c | 8 - net/sunrpc/xprtrdma/rpc_rdma.c | 104 +++++++++++------- net/sunrpc/xprtrdma/transport.c | 6 + net/sunrpc/xprtrdma/verbs.c | 210 +++++++++++++++++++++++++++++++++++-- net/sunrpc/xprtrdma/xprt_rdma.h | 66 +++++++----- 6 files changed, 308 insertions(+), 92 deletions(-) -- Chuck Lever -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html