Hi, I am seeing a large number of connections from ceph-mgr are stuck in CLOSE_WAIT state with data stuck in the receive queue. Looks like ceph-mgr process is not reading the data completely off the socket buffers and terminating the connections properly. I also notice that the access to dashboard plugin stops working after couple of days and I need to restart ceph-mgr for it to start working again. I haven't noticed any impact of volume I/O operations though. We are running nautilus version (14.2.4-1xenial) Is this a known issue? $ sudo netstat -anp|grep CLOSE_WAIT | wc -l 906 $ sudo netstat -anp|grep CLOSE_WAIT tcp6 77 0 x.x.x.x:8443 x.x.12.195:48624 CLOSE_WAIT 161716/ceph-mgr tcp6 210 0 x.x.x.x:8443 x.x.12.209:59220 CLOSE_WAIT 161716/ceph-mgr tcp6 2443 0 x.x.x.x:8443 x.x.0.103:65276 CLOSE_WAIT 161716/ceph-mgr tcp6 159 0 x.x.x.x:8443 x.x.12.202:60150 CLOSE_WAIT 161716/ceph-mgr tcp6 1 0 x.x.x.x:8443 x.x.12.161:51472 CLOSE_WAIT 161716/ceph-mgr tcp6 283 0 x.x.x.x:8443 x.x.12.202:44900 CLOSE_WAIT 161716/ceph-mgr tcp6 32 0 x.x.x.x:8443 x.x.12.207:58202 CLOSE_WAIT 161716/ceph-mgr tcp6 32 0 x.x.x.x:8443 x.x.12.200:52162 CLOSE_WAIT 161716/ceph-mgr tcp6 32 0 x.x.x.x:8443 x.x.12.167:43148 CLOSE_WAIT 161716/ceph-mgr tcp6 305 0 x.x.x.x:8443 x.x.12.167:60102 CLOSE_WAIT 161716/ceph-mgr tcp6 79 0 x.x.x.x:8443 x.x.12.195:48504 CLOSE_WAIT 161716/ceph-mgr tcp6 69 0 x.x.x.x:8443 x.x.12.167:50362 CLOSE_WAIT 161716/ceph-mgr tcp6 38 0 x.x.x.x:8443 x.x.12.167:36840 CLOSE_WAIT 161716/ceph-mgr tcp6 76 0 x.x.x.x:8443 x.x.12.209:54166 CLOSE_WAIT 161716/ceph-mgr tcp6 68 0 x.x.x.x:8443 x.x.12.207:34312 CLOSE_WAIT 161716/ceph-mgr tcp6 209 0 x.x.x.x:8443 x.x.12.209:52642 CLOSE_WAIT 161716/ceph-mgr tcp6 220 0 x.x.x.x:8443 x.x.12.202:41156 CLOSE_WAIT 161716/ceph-mgr tcp6 202 0 x.x.x.x:8443 x.x.12.209:55448 CLOSE_WAIT 161716/ceph-mgr tcp6 193 0 x.x.x.x:8443 x.x.12.207:56296 CLOSE_WAIT 161716/ceph-mgr tcp6 672 0 x.x.x.x:8443 x.x.12.207:35516 CLOSE_WAIT 161716/ceph-mgr tcp6 1186 0 x.x.x.x:8443 x.x.28.4:54074 CLOSE_WAIT 161716/ceph-mgr tcp6 163 0 x.x.x.x:8443 x.x.12.209:54458 CLOSE_WAIT 161716/ceph-mgr tcp6 214 0 x.x.x.x:8443 x.x.12.167:54912 CLOSE_WAIT 161716/ceph-mgr tcp6 129 0 x.x.x.x:8443 x.x.12.200:42494 CLOSE_WAIT 161716/ceph-mgr tcp6 86 0 x.x.x.x:8443 x.x.12.195:58618 CLOSE_WAIT 161716/ceph-mgr tcp6 103 0 x.x.x.x:8443 x.x.12.209:45408 CLOSE_WAIT 161716/ceph-mgr tcp6 77 0 x.x.x.x:8443 x.x.12.202:60792 CLOSE_WAIT 161716/ceph-mgr tcp6 189 0 x.x.x.x:8443 x.x.12.161:58640 CLOSE_WAIT 161716/ceph-mgr tcp6 68 0 x.x.x.x:8443 x.x.12.167:42004 CLOSE_WAIT 161716/ceph-mgr tcp6 1 0 x.x.x.x:8443 x.x.12.195:36348 CLOSE_WAIT 161716/ceph-mgr Thanks, Shridhar _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |