On Tue, Feb 23, 2021 at 11:08:18AM +0800, Zhu Yanjun wrote: > On Tue, Feb 23, 2021 at 12:21 AM Filip Krakowski <krakowski@xxxxxx> wrote: > > > > Hi, > > > > whenever I try to test a reliable connection using "ibv_rc_pingpong -d > > mlx5_0" > > ibv_rc_pingpong -d rxe0 -g 1 > /dev/null & > > ibv_rc_pingpong -d rxe0 -g 1 192.168.1.2 > > I made tests with the above. It can work well. > > Normally "-g" is needed. "-g" is needed because you are running RoCE, while Filip is running IB. > > Before directly using mlx5, please make tests with softroce firstly. Are you sure that RXE works in 4.18.0-151.el8.x86_64 kernel? > > Zhu Yanjun > > to start the server side the test immediately stops with > > "Couldn't create CQ". Since I couldn't find a solution for this problem > > in one week I would like to ask if someone has encountered this error > > before or knows a way of troubleshooting it. Just to be sure I updated > > the controller to its latest firmware (16.29.2002) today, but the error > > remained the same. > > > > System Information > > ==== > > > > * CentOS Linux release 8.1.1911 (Core) > > * Linux 4.18.0-151.el8.x86_64 > > * ConnectX-5 (MCX555A-ECA) > > > > > > Installed Packages > > ==== > > > > * rdma-core-32.0-4.el8.x86_64 > > * libibverbs-32.0-4.el8.x86_64 > > > > > > Loaded Kernel Modules (lsmod | grep -E 'rdma|mlx') > > ==== > > > > rpcrdma 274432 0 > > sunrpc 454656 22 > > rpcrdma,nfsv4,auth_rpcgss,lockd,nfsv3,rpcsec_gss_krb5,nfs_acl,nfs > > rdma_ucm 32768 0 > > rdma_cm 69632 5 > > rpcrdma,ib_srpt,ib_iser,ib_isert,rdma_ucm > > iw_cm 53248 1 rdma_cm > > ib_cm 57344 3 rdma_cm,ib_ipoib,ib_srpt > > mlx5_ib 327680 0 > > ib_uverbs 147456 3 i40iw,rdma_ucm,mlx5_ib > > ib_core 356352 14 > > rdma_cm,ib_ipoib,rpcrdma,ib_srpt,iw_cm,ib_iser,ib_umad,ib_isert,i40iw,rdma_ucm,ib_uverbs,mlx5_ib,ib_cm > > mlx5_core 798720 1 mlx5_ib > > mlxfw 24576 1 mlx5_core > > > > > > > > Infiniband Device Info (ibv_devinfo) > > ==== > > > > hca_id: i40iw0 > > transport: iWARP (1) > > fw_ver: 0.2 > > node_guid: 3cec:ef0d:51c3:0000 > > sys_image_guid: 3cec:ef0d:51c3:0000 > > vendor_id: 0x8086 > > vendor_part_id: 14290 > > hw_ver: 0x0 > > board_id: I40IW Board ID > > phys_port_cnt: 1 > > port: 1 > > state: PORT_DOWN (1) > > max_mtu: 4096 (5) > > active_mtu: 1024 (3) > > sm_lid: 0 > > port_lid: 1 > > port_lmc: 0x00 > > link_layer: Ethernet > > > > hca_id: i40iw1 > > transport: iWARP (1) > > fw_ver: 0.2 > > node_guid: 3cec:ef0d:51c2:0000 > > sys_image_guid: 3cec:ef0d:51c2:0000 > > vendor_id: 0x8086 > > vendor_part_id: 14290 > > hw_ver: 0x0 > > board_id: I40IW Board ID > > phys_port_cnt: 1 > > port: 1 > > state: PORT_ACTIVE (4) > > max_mtu: 4096 (5) > > active_mtu: 1024 (3) > > sm_lid: 0 > > port_lid: 1 > > port_lmc: 0x00 > > link_layer: Ethernet > > > > hca_id: mlx5_0 > > transport: InfiniBand (0) > > fw_ver: 16.29.2002 > > node_guid: 0c42:a103:0054:74ca > > sys_image_guid: 0c42:a103:0054:74ca > > vendor_id: 0x02c9 > > vendor_part_id: 4119 > > hw_ver: 0x0 > > board_id: MT_0000000010 > > phys_port_cnt: 1 > > port: 1 > > state: PORT_ACTIVE (4) > > max_mtu: 4096 (5) > > active_mtu: 4096 (5) > > sm_lid: 8 > > port_lid: 196 > > port_lmc: 0x00 > > link_layer: InfiniBand > > > > > > Best regards > > Filip
