Just wondering if you had the chance of testing the network speed with iperf from host to host yet? This is like the first thing to do while doing a full debug upside-down. No matter what disks you have but note that each and one of them has a maximum IOps limit which sometimes you can hit in a way. as already suggested by others in the past you can use a binary search dividing the issue one part at a time network.. disk.. controller.. driver.. software(since the software is proven to work). Eliezer On 06/12/2014 11:40 PM, Aronesty, Erik wrote: > I suspect I'm having performance issues because of network speeds. > > /Supposedly/ I have 10gbit connections on all my NAS devices, however, > it seems to me that the fastest I can write is 1Gbit. When I'm copying > very large files, etc, I see 'D' as the cp waits to I/O, but when I go > the gluster servers, I don't see glusterfsd waiting (D) to write to the > bricks themselves. I have 4 nodes, each with 10Gbit connection, each > has 2 Areca RAID controllers with 12 disk raid5, and the 2 controllers > stripped into 1 large volume. Pretty sure there's plenty of i/o left > on the bricks themselves. > > Is it possible that "one big file" isn't the right test… should I try 20 > big files, and see how saturated my network can get? > > Erik Aronesty > Senior Bioinformatics Architect > > *EA | Quintiles > **/Genomic Services/**//* > > 4820 Emperor Boulevard > > Durham, NC 27703 USA > > > Office: + 919.287.4011 > erik.aronesty@xxxxxxxxxxxxx <mailto:kmichailo@xxxxxxxxxxxxxxxxxxxxxx> > > www.quintiles.com <http://www.quintiles.com/> > www.expressionanalysis.com <http://www.expressionanalysis.com/> > cid:image001.jpg@01CDEF4B.84C3E9F0 > <https://www.twitter.com/simulx>cid:image002.jpg@01CDEF4B.84C3E9F0 > <http://www.facebook.com/aronesty>cid:image003.jpg@01CDEF4B.84C3E9F0 > <http://www.linkedin.com/in/earonesty> > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users@xxxxxxxxxxx > http://supercolony.gluster.org/mailman/listinfo/gluster-users > _______________________________________________ CentOS mailing list CentOS@xxxxxxxxxx http://lists.centos.org/mailman/listinfo/centos