I'm using 40G Infiniband with IPoIB for gluster. Here are some ping times (from host 172.16.1.10): [root at node0.cloud ~]# ping -c 10 172.16.1.11 PING 172.16.1.11 (172.16.1.11) 56(84) bytes of data. 64 bytes from 172.16.1.11: icmp_seq=1 ttl=64 time=0.093 ms 64 bytes from 172.16.1.11: icmp_seq=2 ttl=64 time=0.113 ms 64 bytes from 172.16.1.11: icmp_seq=3 ttl=64 time=0.163 ms 64 bytes from 172.16.1.11: icmp_seq=4 ttl=64 time=0.125 ms 64 bytes from 172.16.1.11: icmp_seq=5 ttl=64 time=0.125 ms 64 bytes from 172.16.1.11: icmp_seq=6 ttl=64 time=0.125 ms 64 bytes from 172.16.1.11: icmp_seq=7 ttl=64 time=0.198 ms 64 bytes from 172.16.1.11: icmp_seq=8 ttl=64 time=0.171 ms 64 bytes from 172.16.1.11: icmp_seq=9 ttl=64 time=0.194 ms 64 bytes from 172.16.1.11: icmp_seq=10 ttl=64 time=0.115 ms --- 172.16.1.11 ping statistics --- 10 packets transmitted, 10 received, 0% packet loss, time 8999ms rtt min/avg/max/mdev = 0.093/0.142/0.198/0.035 ms On Fri, Jun 14, 2013 at 7:03 AM, Nathan Stratton <nathan at robotics.net> wrote: > I have been playing around with Gluster on and off for the last 6 years or > so. Most of the things that have been keeping me from using it have been > related to latency. > > In the past I have been using 10 gig infiniband or 10 gig ethernet, recently > the price of 40 gig ethernet has fallen quite a bit with guys like Arista. > > My question is, is this worth it at all for something like Gluster? The port > to port latency looks impressive at under 4 microseconds, but I don't yet > know what total system to system latency would look like assuming QSPF+ > copper cables and linux stack. > > -- >><> > Nathan Stratton Founder, CTO > Exario Networks, Inc. > nathan at robotics.net nathan at > exarionetworks.com > http://www.robotics.net > http://www.exarionetworks.com/ > > Building the WebRTC solutions today that your customers will demand > tomorrow. > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://supercolony.gluster.org/mailman/listinfo/gluster-users
