Hi,
Recently, I am trying to run rnbd/rtrs on top of rxe, and get several
calltraces with 5.17-rc3 kernel (CONFIG_PROVE_LOCKING is enabled).
However, seems rnbd/rtrs over rxe still can't work with 5.17-rc3 kernel,
dmesg reports below.
1. server side
[ 440.723182] rdma_rxe: qp#17 moved to error state
[ 440.725300] rtrs_server L1205: <bla>: remote access error (wr_cqe: 000000003b14397c, type: 0, vendor_err: 0x0, len: 0)
[ 440.845926] rnbd_server L256: RTRS Session bla disconnected
2. client side
[ 997.817536] rnbd_client L596: Mapping device /dev/loop1 on session bla, (access_mode: rw, nr_poll_queues: 0)
[ 998.968810] rnbd_client L1213: [session=bla] mapped 8/8 default/read queues.
[ 999.017988] rtrs_client L610: <bla>: RDMA failed: remote access error
[ 1029.836943] rtrs_client L353: <bla>: Failed IB_WR_LOCAL_INV: WR flushe
Then I tried 5.16 and 5.15 version, seems 5.15 does work as follows.
1. server side
[ 333.076482] rnbd_server L800: </dev/loop1@bla>: Opened device 'loop1'
2. client side
[ 1584.325825] rnbd_client L596: Mapping device /dev/loop1 on session bla, (access_mode: rw, nr_poll_queues: 0)
[ 1585.268291] rnbd_client L1213: [session=bla] mapped 8/8 default/read queues.
[ 1585.349300] rnbd_client L1607: </dev/loop1@bla> map_device: Device mapped as rnbd0 (nsectors: 0, logical_block_size: 512, physical_block_size: 512, max_write_same_sectors: 0, max_discard_sectors: 0, discard_granularity: 0, discard_alignment: 0, secure_discard: 0, max_segments: 128, max_hw_sectors: 248, rotational: 1, wc: 0, fua: 0)
I would appreciate if someone shed light on why it doesn't work after 5.15,
And I am happy to test potential patch for it.
Guoqing Jiang (3):
RDMA/rxe: Replace write_{lock,unlock}_bh with
write_lock_irq{save,restore} in __rxe_add_index
RDMA/rxe: Replace write_{lock,unlock}_bh with
write_lock_irq{save,restore} in __rxe_drop_index
RDMA/rxe: Replace write_{lock,unlock}_bh with
write_lock_irq{save,restore} in post_one_send
drivers/infiniband/sw/rxe/rxe_pool.c | 10 ++++++----
drivers/infiniband/sw/rxe/rxe_verbs.c | 5 +++--
2 files changed, 9 insertions(+), 6 deletions(-)
--
2.26.2
