07.11.2018 15:01, Mike Lykov пишет:
RDMA on its own seems working:
[root@ovirtnode5 log]# ib_write_bw -D 30 --cpu_util ovirtstor1
---------------------------------------------------------------------------------------
RDMA_Write BW Test
Dual-port : OFF Device : hfi1_0
Number of qps : 1 Transport type : IB
Connection type : RC Using SRQ : OFF
TX depth : 128
CQ Moderation : 100
Mtu : 4096[B]
Link type : IB
Max inline data : 0[B]
rdma_cm QPs : OFF
Data ex. method : Ethernet
---------------------------------------------------------------------------------------
local address: LID 0x04 QPN 0x00ae PSN 0x15933a RKey 0x60181900 VAddr 0x007fde76ee6000
remote address: LID 0x03 QPN 0x0056 PSN 0x7758e RKey 0x40101100 VAddr 0x007fde37488000
---------------------------------------------------------------------------------------
#bytes #iterations BW peak[MB/sec] BW average[MB/sec] MsgRate[Mpps] CPU_Util[%]
Conflicting CPU frequency values detected: 3692.431000 != 3109.112000. CPU Frequency is not max.
65536 1646300 0.00 6430.36 0.102886 1.40
---------------------------------------------------------------------------------------
This is right test using "RDMA_cm QPs" (server-side output)
[root@ovirtnode1 glusterfs]# ib_write_bw -R -D 30 --cpu_util
************************************
* Waiting for client to connect... *
************************************
---------------------------------------------------------------------------------------
RDMA_Write BW Test
Dual-port : OFF Device : hfi1_0
Number of qps : 1 Transport type : IB
Connection type : RC Using SRQ : OFF
CQ Moderation : 100
Mtu : 4096[B]
Link type : IB
Max inline data : 0[B]
rdma_cm QPs : ON
Data ex. method : rdma_cm
---------------------------------------------------------------------------------------
Waiting for client rdma_cm QP to connect
Please run the same command with the IB/RoCE interface IP
---------------------------------------------------------------------------------------
local address: LID 0x03 QPN 0x005a PSN 0x69e89
remote address: LID 0x04 QPN 0x00b2 PSN 0xe70887
---------------------------------------------------------------------------------------
#bytes #iterations BW peak[MB/sec] BW average[MB/sec]
MsgRate[Mpps] CPU_Util[%]
65536 2982900 0.00 11651.03 0.186417
0.00
---------------------------------------------------------------------------------------
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
https://lists.gluster.org/mailman/listinfo/gluster-users
