On 12/2/14, 12:48 AM, Krishnan Parthasarathi wrote: > Scott, > > Could you check if there a process is listening on the unix domain socket > /var/run/3714f2b1aabf9be7087fc323824b74dd.socket? > > ss -x | grep /var/run/3714f2b1aabf9be7087fc323824b74dd.socket The socket file exists, but nothing appears to be using it: root@gluster1:PRODUCTION:~> tail -2 /var/log/glusterfs/etc-glusterfs-glusterd.vol.log [2014-12-02 11:43:34.600536] W [socket.c:611:__socket_rwv] 0-management: readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed (Invalid argument) [2014-12-02 11:43:37.600822] W [socket.c:611:__socket_rwv] 0-management: readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed (Invalid argument) root@gluster1:PRODUCTION:~> ls -lh /var/run/3714f2b1aabf9be7087fc323824b74dd.socket srwxr-xr-x 1 root root 0 Dec 1 15:18 /var/run/3714f2b1aabf9be7087fc323824b74dd.socket root@gluster1:PRODUCTION:~> file /var/run/3714f2b1aabf9be7087fc323824b74dd.socket /var/run/3714f2b1aabf9be7087fc323824b74dd.socket: socket root@gluster1:PRODUCTION:~> ss -x | grep /var/run/3714f2b1aabf9be7087fc323824b74dd.socket root@gluster1:PRODUCTION:~> root@gluster1:PRODUCTION:~> grep /var/run/3714f2b1aabf9be7087fc323824b74dd.socket /var/log/glusterfs/etc-glusterfs-glusterd.vol.log | wc -l 61906 The same is true on the other server in this replica pair: root@gluster2:PRODUCTION:~> tail -2 /var/log/glusterfs/etc-glusterfs-glusterd.vol.log [2014-12-02 11:44:15.421357] W [socket.c:611:__socket_rwv] 0-management: readv on /var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket failed (Invalid argument) [2014-12-02 11:44:18.421720] W [socket.c:611:__socket_rwv] 0-management: readv on /var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket failed (Invalid argument) root@gluster2:PRODUCTION:~> ls -lh /var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket srwxr-xr-x 1 root root 0 Dec 1 15:19 /var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket root@gluster2:PRODUCTION:~> file /var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket /var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket: socket root@gluster2:PRODUCTION:~> ss -x | grep /var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket root@gluster2:PRODUCTION:~> root@gluster2:PRODUCTION:~> grep /var/run/9bdd01b8b5f546ce04b25ce7d68e3ace.socket /var/log/glusterfs/etc-glusterfs-glusterd.vol.log | wc -l 61774 Thanks, Scott > ----- Original Message ----- >> What causes these errors? >> >> [2014-12-01 20:22:04.661974] W [socket.c:611:__socket_rwv] 0-management: >> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed >> (Invalid argument) >> [2014-12-01 20:22:07.662292] W [socket.c:611:__socket_rwv] 0-management: >> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed >> (Invalid argument) >> [2014-12-01 20:22:10.662612] W [socket.c:611:__socket_rwv] 0-management: >> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed >> (Invalid argument) >> [2014-12-01 20:22:13.662965] W [socket.c:611:__socket_rwv] 0-management: >> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed >> (Invalid argument) >> [2014-12-01 20:22:16.663287] W [socket.c:611:__socket_rwv] 0-management: >> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed >> (Invalid argument) >> [2014-12-01 20:22:19.663602] W [socket.c:611:__socket_rwv] 0-management: >> readv on /var/run/3714f2b1aabf9be7087fc323824b74dd.socket failed >> (Invalid argument) >> [2014-12-01 20:22:22.663946] W [socket.c:611:__socket_rwv] 0-management: >> readv on /var/run/ >> >> We're getting a lot of these in our logs ever since upgrading to 3.6.1. >> >> Is it related to my previous report of stale locks? >> http://supercolony.gluster.org/pipermail/gluster-users/2014-November/019621.html >> >> Or are these two independent problems? >> >> Thanks, >> Scott >> >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users@xxxxxxxxxxx >> http://supercolony.gluster.org/mailman/listinfo/gluster-users >> _______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://supercolony.gluster.org/mailman/listinfo/gluster-users