Re: [PATCH v5 00/25] RTRS (former IBTRS) rdma transport library and the corresponding RNBD (former IBNBD) rdma network block device

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 1/7/20 2:56 AM, Jinpu Wang wrote:
On Mon, Jan 6, 2020 at 6:07 PM Jinpu Wang <jinpu.wang@xxxxxxxxxxxxxxx> wrote:

On Fri, Jan 3, 2020 at 5:29 PM Bart Van Assche <bvanassche@xxxxxxx> wrote:

On 1/3/20 4:39 AM, Jinpu Wang wrote:
Performance results for the v5.5-rc1 kernel are here:
    link: https://github.com/ionos-enterprise/ibnbd/tree/develop/performance/v5-v5.5-rc1

Some workloads RNBD are faster, some workloads NVMeoF are faster.

Thank you for having shared these graphs.

Do the graphs in RNBD-SinglePath.pdf show that NVMeOF achieves similar
or higher IOPS, higher bandwidth and lower latency than RNBD for
workloads with a block size of 4 KB and also for mixed workloads with
less than 20 disks, whether or not invalidation is enabled for RNBD?
Hi Bart,

Yes, that's the result on one pair of Server with Connect X4 HCA, I
did another test on another
2 servers with Connect X5 HCA, results are quite different, we will
double-check the
performance results also on old machines, will share new results later.

here are the results with ConnectX5 HCA MT4119 + Intel(R) Xeon(R) Gold
6130 CPU @ 2.10GHz, sorry no graph for now,
will prepare the next round.

  disks   4k nvme dual  4k nvme single    4k rnbd dual  4k rnbd single
4k rnbd-inv dual  4k rnbd-inv single
    x1  251637.436256   254312.068793   270886.311369   260934.306569
   218632.336766       190800.519948
    x2  460894.610539   463925.907409   496318.068193   466374.862514
    418960.30397       372848.815118
    x3  603263.673633    605004.49955   675073.892611   614552.144786
   586223.077692       524221.977802
    x4  731648.935106   733174.482552   850245.575442   743062.493751
   744380.361964       656861.813819
    x5  827732.326767   827444.855514  1026939.306069   840515.548445
   897801.719828       762707.329267
    x6  876705.329467     873963.0037  1142399.960004    876974.70253
  1037773.522648       834073.892611
    x7  893808.719128   893268.073193  1239282.471753   892728.027197
  1135570.742926       871336.966303
    x8  906589.741026   905938.006199  1287178.964207   906189.381062
    1225040.9959       895292.070793
    x9   912048.09519   912400.259974  1386211.878812   913885.311469
  1302472.964884       910176.282372
   x10  915566.243376   915602.739726   1442959.70403   916288.871113
  1350296.325879        914966.40336
   x11  917116.188381   916905.809419  1418574.942506   916264.373563
  1370438.698083       915255.874413
   x12  915852.814719   917710.128987  1423534.546545   916348.386452
  1352357.364264       914966.656684
   x13   919042.69573   918819.536093  1429697.830217   917631.036896
  1378083.824558       916519.161677
   x14   920000.49995    920031.59684  1443317.268273   917562.843716
   1395023.56936       918935.706429
   x15  920160.883912   920367.363264  1445306.425863   918278.472153
  1440776.944611       916352.265921
   x16  920652.869426   920673.832617  1454705.229477   917902.948526
    1455708.2501       918198.001998
   x17  916892.310769   916883.623275  1491071.841948   918936.706329
  1436507.428457       917182.934132
   x18  917247.775222   917762.523748  1612129.058036   918546.835949
  1488716.583417       919521.095781
   x19  920084.791521   920349.930014   1615690.87821   915371.496958
   1406747.32954       918347.248577
   x20  922339.232154   922208.058388  1591415.958404   917922.631526
  1343806.744488       918903.393214
   x21  923141.771646   923297.040592  1581547.169811   919371.025795
  1342568.406347       919157.752944
   x22  923063.787243   924072.385523  1574972.846162   919173.713143
  1340318.639673       920577.995403
   x23  923549.490102   924643.471306  1573597.440256   918705.060385
  1333047.771337       917469.027431
   x24  925584.483103   925224.955009  1578143.485651    921744.15117
  1321494.708466       920001.498352
   x25  926165.366927   926842.031594  1579288.271173   921845.392764
  1319902.568202       920448.830702
   x26  926852.729454   927382.123575  1585351.318945    922669.59912
  1325670.791338       919137.796847
   x27  928196.260748   928093.981204  1581427.557244   921379.155436
  1325009.972078       919017.550858
   x28  929330.433913   929606.778644  1581726.527347   924325.834833
  1331721.074174       919557.761373
   x29  929885.522895   929876.924615  1578317.436513   922977.240966
   1333612.86783       921094.386736
   x30  930635.972805   930599.520144  1583537.946205   922746.107784
  1333446.651362       922821.171531

Hi Jack,

What does "dual" mean? What explains the big difference between the NVMe and RNBD results for the "dual" columns?

Thanks,

Bart.





[Index of Archives]     [Linux RAID]     [Linux SCSI]     [Linux ATA RAID]     [IDE]     [Linux Wireless]     [Linux Kernel]     [ATH6KL]     [Linux Bluetooth]     [Linux Netdev]     [Kernel Newbies]     [Security]     [Git]     [Netfilter]     [Bugtraq]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Device Mapper]

  Powered by Linux