write performance with NIC bonding

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

I'm using gluster 3.7.5 and I'm trying to get port bonding working properly with the gluster protocol. I've bonded the NICs using round robin because I also bond it at the switch level with link aggregation. I've used this type of bonding without a problem with my other applications but for some reason gluster does not want to utilize all 3 NICs for writes but it does for reads... any of you come across this or know why? Here's the output of the traffic on the NICs you can see that RX is unbalanced but TX is completely balanced across the 3 NICs. I've tried both mounting via glusterfs or nfs, both result in the same imbalance. Am I missing some configuration?


root@e-gluster-01:~# ifconfig
bond0     Link encap:Ethernet
          inet addr:xxxxxxxxxxxx  Bcast:128.33.23.255 Mask:255.255.248.0
          inet6 addr: fe80::46a8:42ff:fe43:8817/64 Scope:Link
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500 Metric:1
          RX packets:160972852 errors:0 dropped:0 overruns:0 frame:0
          TX packets:122295229 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
RX bytes:152800624950 (142.3 GiB) TX bytes:138720356365 (129.1 GiB)

em1       Link encap:Ethernet
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:160793725 errors:0 dropped:0 overruns:0 frame:0
          TX packets:40763142 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
RX bytes:152688146880 (142.2 GiB) TX bytes:46239971255 (43.0 GiB)
          Interrupt:41

em2       Link encap:Ethernet
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:92451 errors:0 dropped:0 overruns:0 frame:0
          TX packets:40750031 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:9001370 (8.5 MiB)  TX bytes:46216513162 (43.0 GiB)
          Interrupt:45

em3       Link encap:Ethernet
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:86676 errors:0 dropped:0 overruns:0 frame:0
          TX packets:40782056 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:103476700 (98.6 MiB)  TX bytes:46263871948 (43.0 GiB)
          Interrupt:40


_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users



[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux