https://bugzilla.redhat.com/show_bug.cgi?id=1826439 --- Comment #8 from Honggang LI <honli@xxxxxxxxxx> --- Functional smoke test verified libvma works as expected. Performance significantly improved. +------------------+---------------+ |Socket over IPoIB |6.97 Gb/s | +------------------+---------------+ |libvma |24.4 Gb/s | +------------------+---------------+ [root@rdma-dev-21 ~]$ ibstat CA 'ibp130s0f1' CA type: MT4115 Number of ports: 1 Firmware version: 12.23.1020 Hardware version: 0 Node GUID: 0x248a07030049d4f1 System image GUID: 0x248a07030049d4f0 Port 1: State: Active Physical state: LinkUp Rate: 56 Base lid: 32 LMC: 0 SM lid: 1 Capability mask: 0x2659e848 Port GUID: 0x248a07030049d4f1 Link layer: InfiniBand CA 'rocep4s0' CA type: MT4115 Number of ports: 1 Firmware version: 12.23.1020 Hardware version: 0 Node GUID: 0x248a0703004bf094 System image GUID: 0x248a0703004bf094 Port 1: State: Active Physical state: LinkUp Rate: 100 Base lid: 0 LMC: 0 SM lid: 0 Capability mask: 0x00010000 Port GUID: 0x268a07fffe4bf094 Link layer: Ethernet CA 'ibp130s0f0' CA type: MT4115 Number of ports: 1 Firmware version: 12.23.1020 Hardware version: 0 Node GUID: 0x248a07030049d4f0 System image GUID: 0x248a07030049d4f0 Port 1: State: Active Physical state: LinkUp Rate: 56 Base lid: 15 LMC: 0 SM lid: 13 Capability mask: 0x2659e848 Port GUID: 0x248a07030049d4f0 Link layer: InfiniBand [root@rdma-dev-21 ~]$ ip addr show mlx5_ib0 7: mlx5_ib0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 2044 qdisc mq state UP group default qlen 256 link/infiniband 00:00:0e:27:fe:80:00:00:00:00:00:00:24:8a:07:03:00:49:d4:f0 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff inet 172.31.0.121/24 brd 172.31.0.255 scope global dynamic noprefixroute mlx5_ib0 valid_lft 2861sec preferred_lft 2861sec inet6 fe80::268a:703:49:d4f0/64 scope link noprefixroute valid_lft forever preferred_lft forever [root@rdma-dev-21 ~]$ iperf -s ------------------------------------------------------------ Server listening on TCP port 5001 TCP window size: 128 KByte (default) ------------------------------------------------------------ [ 4] local 172.31.0.121 port 5001 connected with 172.31.0.122 port 58464 [ ID] Interval Transfer Bandwidth [ 4] 0.0-10.0 sec 8.12 GBytes 6.97 Gbits/sec [root@rdma-dev-22 ~]$ iperf -c 172.31.0.121 ------------------------------------------------------------ Client connecting to 172.31.0.121, TCP port 5001 TCP window size: 612 KByte (default) ------------------------------------------------------------ [ 3] local 172.31.0.122 port 58464 connected with 172.31.0.121 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-10.0 sec 8.12 GBytes 6.98 Gbits/sec [root@rdma-dev-21 ~]$ VMA_SPEC=latency LD_PRELOAD=libvma.so iperf -s VMA INFO: --------------------------------------------------------------------------- VMA INFO: VMA_VERSION: 9.0.2-0 Release built on Apr 17 2020 00:00:00 VMA INFO: Cmd Line: iperf -s VMA INFO: --------------------------------------------------------------------------- VMA INFO: VMA Spec Latency [VMA_SPEC] VMA INFO: Log Level INFO [VMA_TRACELEVEL] VMA INFO: Ring On Device Memory TX 16384 [VMA_RING_DEV_MEM_TX] VMA INFO: Tx QP WRE 256 [VMA_TX_WRE] VMA INFO: Tx QP WRE Batching 4 [VMA_TX_WRE_BATCHING] VMA INFO: Rx QP WRE 256 [VMA_RX_WRE] VMA INFO: Rx QP WRE Batching 4 [VMA_RX_WRE_BATCHING] VMA INFO: Rx Poll Loops -1 [VMA_RX_POLL] VMA INFO: Rx Prefetch Bytes Before Poll 256 [VMA_RX_PREFETCH_BYTES_BEFORE_POLL] VMA INFO: GRO max streams 0 [VMA_GRO_STREAMS_MAX] VMA INFO: Select Poll (usec) -1 [VMA_SELECT_POLL] VMA INFO: Select Poll OS Force Enabled [VMA_SELECT_POLL_OS_FORCE] VMA INFO: Select Poll OS Ratio 1 [VMA_SELECT_POLL_OS_RATIO] VMA INFO: Select Skip OS 1 [VMA_SELECT_SKIP_OS] VMA INFO: CQ Drain Interval (msec) 100 [VMA_PROGRESS_ENGINE_INTERVAL] VMA INFO: CQ Interrupts Moderation Disabled [VMA_CQ_MODERATION_ENABLE] VMA INFO: CQ AIM Max Count 128 [VMA_CQ_AIM_MAX_COUNT] VMA INFO: CQ Adaptive Moderation Disabled [VMA_CQ_AIM_INTERVAL_MSEC] VMA INFO: CQ Keeps QP Full Disabled [VMA_CQ_KEEP_QP_FULL] VMA INFO: TCP nodelay 1 [VMA_TCP_NODELAY] VMA INFO: Avoid sys-calls on tcp fd Enabled [VMA_AVOID_SYS_CALLS_ON_TCP_FD] VMA INFO: Internal Thread Affinity 0 [VMA_INTERNAL_THREAD_AFFINITY] VMA INFO: Thread mode Single [VMA_THREAD_MODE] VMA INFO: --------------------------------------------------------------------------- ------------------------------------------------------------ Server listening on TCP port 5001 TCP window size: 128 KByte (default) ------------------------------------------------------------ [ 53] local 172.31.0.121 port 5001 connected with 172.31.0.122 port 59351 [ ID] Interval Transfer Bandwidth [ 53] 0.0- 9.7 sec 28.4 GBytes 25.1 Gbits/sec [root@rdma-dev-22 ~]$ iperf -c 172.31.0.121 ------------------------------------------------------------ Client connecting to 172.31.0.121, TCP port 5001 TCP window size: 612 KByte (default) ------------------------------------------------------------ [ 3] local 172.31.0.122 port 58464 connected with 172.31.0.121 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-10.0 sec 8.12 GBytes 6.98 Gbits/sec [root@rdma-dev-22 ~]$ VMA_SPEC=latency LD_PRELOAD=libvma.so iperf -c 172.31.0.121 VMA INFO: --------------------------------------------------------------------------- VMA INFO: VMA_VERSION: 9.0.2-0 Release built on Apr 17 2020 00:00:00 VMA INFO: Cmd Line: iperf -c 172.31.0.121 VMA INFO: --------------------------------------------------------------------------- VMA INFO: VMA Spec Latency [VMA_SPEC] VMA INFO: Log Level INFO [VMA_TRACELEVEL] VMA INFO: Ring On Device Memory TX 16384 [VMA_RING_DEV_MEM_TX] VMA INFO: Tx QP WRE 256 [VMA_TX_WRE] VMA INFO: Tx QP WRE Batching 4 [VMA_TX_WRE_BATCHING] VMA INFO: Rx QP WRE 256 [VMA_RX_WRE] VMA INFO: Rx QP WRE Batching 4 [VMA_RX_WRE_BATCHING] VMA INFO: Rx Poll Loops -1 [VMA_RX_POLL] VMA INFO: Rx Prefetch Bytes Before Poll 256 [VMA_RX_PREFETCH_BYTES_BEFORE_POLL] VMA INFO: GRO max streams 0 [VMA_GRO_STREAMS_MAX] VMA INFO: Select Poll (usec) -1 [VMA_SELECT_POLL] VMA INFO: Select Poll OS Force Enabled [VMA_SELECT_POLL_OS_FORCE] VMA INFO: Select Poll OS Ratio 1 [VMA_SELECT_POLL_OS_RATIO] VMA INFO: Select Skip OS 1 [VMA_SELECT_SKIP_OS] VMA INFO: CQ Drain Interval (msec) 100 [VMA_PROGRESS_ENGINE_INTERVAL] VMA INFO: CQ Interrupts Moderation Disabled [VMA_CQ_MODERATION_ENABLE] VMA INFO: CQ AIM Max Count 128 [VMA_CQ_AIM_MAX_COUNT] VMA INFO: CQ Adaptive Moderation Disabled [VMA_CQ_AIM_INTERVAL_MSEC] VMA INFO: CQ Keeps QP Full Disabled [VMA_CQ_KEEP_QP_FULL] VMA INFO: TCP nodelay 1 [VMA_TCP_NODELAY] VMA INFO: Avoid sys-calls on tcp fd Enabled [VMA_AVOID_SYS_CALLS_ON_TCP_FD] VMA INFO: Internal Thread Affinity 0 [VMA_INTERNAL_THREAD_AFFINITY] VMA INFO: Thread mode Single [VMA_THREAD_MODE] VMA INFO: --------------------------------------------------------------------------- ------------------------------------------------------------ Client connecting to 172.31.0.121, TCP port 5001 TCP window size: 0.00 Byte (default) ------------------------------------------------------------ [ 25] local 172.31.0.122 port 59351 connected with 172.31.0.121 port 5001 [ ID] Interval Transfer Bandwidth [ 25] 0.0-10.0 sec 28.4 GBytes 24.4 Gbits/sec -- You are receiving this mail because: You are on the CC list for the bug. You are always notified about changes to this product and component _______________________________________________ package-review mailing list -- package-review@xxxxxxxxxxxxxxxxxxxxxxx To unsubscribe send an email to package-review-leave@xxxxxxxxxxxxxxxxxxxxxxx Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/package-review@xxxxxxxxxxxxxxxxxxxxxxx
