Hello,
we are aware of this, as you can find in mail list archives.
You can get things better, but not completely remove this issue for now. It mostly depend on number of files in folder when doing ls.
Small files provide much lower performance than big one during copy & co.
Replicate option slow down read, as your client contact both servers to get metada.
Things I did to get things better in this setup:
fstab option (on client) : defaults,direct-io-mode=disable,_netdev,backupvolfile-server=mysecondservername
fstab option (on gluster server volumes): defaults,noatime,nodiratime,logbufs=8,logbsize=256k,largeio,inode64,swalloc,allocsize=131072k,nobarrier
sysctl (clients and servers):
vm.swappiness=0
net.core.rmem_max=67108864
net.core.wmem_max=67108864
# increase Linux autotuning TCP buffer limit to 32MB
net.ipv4.tcp_rmem=4096 87380 33554432
net.ipv4.tcp_wmem=4096 65536 33554432
# increase the length of the processor input queue
net.core.netdev_max_backlog=30000
# recommended default congestion control is htcp
net.ipv4.tcp_congestion_control=htcp
Gluster volume options:
performance.cache-size: 1GB
performance.io-thread-count: 16
performance.readdir-ahead: enable
performance.read-ahead: disable
performance.client-io-threads: on
performance.write-behind-window-size: 1MB
cluster.lookup-optimize: on
client.event-threads: 4
server.event-threads: 4
cluster.readdir-optimize: on
2016-01-13 7:39 GMT+01:00 Arash Shams <ara4sh@xxxxxxxxxxx>:
Hello
Im using 2 standalone servers as share storage servers with glusterfs 3.7 when i change directory and run command inside a mounted volume for each operation i have to wait at least 5 seconds for result and prompt
Im using replicate option and delay maybe for write but not for reading
im using gluster as my /var/www/ share along all of my instance and servers but for a simple ls or cd command to this directory i have to wait 5 seconds any suggestion for me ?
here is some information about the servers and glusterfs :
OS : Ubuntu 14.04.3 LTS
Version info : glusterfs 3.7.6 built on Nov 9 2015 15:17:05
Ping between 2 nodes result :
4 packets transmitted, 4 received, 0% packet loss, time 2998ms
rtt min/avg/max/mdev = 0.042/0.056/0.071/0.014 ms
iperf :
Interval Transfer Bandwidth
0.0-10.0 sec 10.5 GBytes 9.03 Gbits/sec
dd test :
1573468160 bytes (1.6 GB) copied, 70.8977 s, 22.2 MB/s
_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users
_______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-users
