Hi,
"I use the kernel 4.18.0-240.10.1.el8_3.x86_64 to make tests." was the
line that solved this problem.
I never thought I would be stuck with a problem for a week caused by the
kernel...
That said, updating the kernel to "4.18.0-277.el8.x86_64" solved the
problem.
Thanks for answering this fast and sorry for taking your time
considering the trivial solution.
Best regards
Filip
On 2/23/21 10:50 AM, Zhu Yanjun wrote:
On Tue, Feb 23, 2021 at 4:56 PM Leon Romanovsky <leon@xxxxxxxxxx> wrote:
On Tue, Feb 23, 2021 at 11:08:18AM +0800, Zhu Yanjun wrote:
On Tue, Feb 23, 2021 at 12:21 AM Filip Krakowski <krakowski@xxxxxx> wrote:
Hi,
whenever I try to test a reliable connection using "ibv_rc_pingpong -d
mlx5_0"
ibv_rc_pingpong -d rxe0 -g 1 > /dev/null &
ibv_rc_pingpong -d rxe0 -g 1 192.168.1.2
I made tests with the above. It can work well.
Normally "-g" is needed.
"-g" is needed because you are running RoCE, while Filip is running IB.
Before directly using mlx5, please make tests with softroce firstly.
Are you sure that RXE works in 4.18.0-151.el8.x86_64 kernel?
I have no 4.18.0-151.el8.x86_64 kernel at hand.
I use the kernel 4.18.0-240.10.1.el8_3.x86_64 to make tests.
SoftRoCE can work well.
Zhu Yanjun
Zhu Yanjun
to start the server side the test immediately stops with
"Couldn't create CQ". Since I couldn't find a solution for this problem
in one week I would like to ask if someone has encountered this error
before or knows a way of troubleshooting it. Just to be sure I updated
the controller to its latest firmware (16.29.2002) today, but the error
remained the same.
System Information
====
* CentOS Linux release 8.1.1911 (Core)
* Linux 4.18.0-151.el8.x86_64
* ConnectX-5 (MCX555A-ECA)
Installed Packages
====
* rdma-core-32.0-4.el8.x86_64
* libibverbs-32.0-4.el8.x86_64
Loaded Kernel Modules (lsmod | grep -E 'rdma|mlx')
====
rpcrdma 274432 0
sunrpc 454656 22
rpcrdma,nfsv4,auth_rpcgss,lockd,nfsv3,rpcsec_gss_krb5,nfs_acl,nfs
rdma_ucm 32768 0
rdma_cm 69632 5
rpcrdma,ib_srpt,ib_iser,ib_isert,rdma_ucm
iw_cm 53248 1 rdma_cm
ib_cm 57344 3 rdma_cm,ib_ipoib,ib_srpt
mlx5_ib 327680 0
ib_uverbs 147456 3 i40iw,rdma_ucm,mlx5_ib
ib_core 356352 14
rdma_cm,ib_ipoib,rpcrdma,ib_srpt,iw_cm,ib_iser,ib_umad,ib_isert,i40iw,rdma_ucm,ib_uverbs,mlx5_ib,ib_cm
mlx5_core 798720 1 mlx5_ib
mlxfw 24576 1 mlx5_core
Infiniband Device Info (ibv_devinfo)
====
hca_id: i40iw0
transport: iWARP (1)
fw_ver: 0.2
node_guid: 3cec:ef0d:51c3:0000
sys_image_guid: 3cec:ef0d:51c3:0000
vendor_id: 0x8086
vendor_part_id: 14290
hw_ver: 0x0
board_id: I40IW Board ID
phys_port_cnt: 1
port: 1
state: PORT_DOWN (1)
max_mtu: 4096 (5)
active_mtu: 1024 (3)
sm_lid: 0
port_lid: 1
port_lmc: 0x00
link_layer: Ethernet
hca_id: i40iw1
transport: iWARP (1)
fw_ver: 0.2
node_guid: 3cec:ef0d:51c2:0000
sys_image_guid: 3cec:ef0d:51c2:0000
vendor_id: 0x8086
vendor_part_id: 14290
hw_ver: 0x0
board_id: I40IW Board ID
phys_port_cnt: 1
port: 1
state: PORT_ACTIVE (4)
max_mtu: 4096 (5)
active_mtu: 1024 (3)
sm_lid: 0
port_lid: 1
port_lmc: 0x00
link_layer: Ethernet
hca_id: mlx5_0
transport: InfiniBand (0)
fw_ver: 16.29.2002
node_guid: 0c42:a103:0054:74ca
sys_image_guid: 0c42:a103:0054:74ca
vendor_id: 0x02c9
vendor_part_id: 4119
hw_ver: 0x0
board_id: MT_0000000010
phys_port_cnt: 1
port: 1
state: PORT_ACTIVE (4)
max_mtu: 4096 (5)
active_mtu: 4096 (5)
sm_lid: 8
port_lid: 196
port_lmc: 0x00
link_layer: InfiniBand
Best regards
Filip
