Hi, Any thoughts on this? Regards Shridhar On Thu, Apr 9, 2020 at 5:17 PM Void Star Nill <void.star.nill@xxxxxxxxx> wrote: > Hi, > > I am seeing a large number of connections from ceph-mgr are stuck in > CLOSE_WAIT state with data stuck in the receive queue. Looks like ceph-mgr > process is not reading the data completely off the socket buffers and > terminating the connections properly. > > I also notice that the access to dashboard plugin stops working after > couple of days and I need to restart ceph-mgr for it to start working again. > > I haven't noticed any impact of volume I/O operations though. > > We are running nautilus version (14.2.4-1xenial) > > Is this a known issue? > > $ sudo netstat -anp|grep CLOSE_WAIT | wc -l > 906 > > $ sudo netstat -anp|grep CLOSE_WAIT > tcp6 77 0 x.x.x.x:8443 x.x.12.195:48624 CLOSE_WAIT > 161716/ceph-mgr > tcp6 210 0 x.x.x.x:8443 x.x.12.209:59220 CLOSE_WAIT > 161716/ceph-mgr > tcp6 2443 0 x.x.x.x:8443 x.x.0.103:65276 CLOSE_WAIT > 161716/ceph-mgr > tcp6 159 0 x.x.x.x:8443 x.x.12.202:60150 CLOSE_WAIT > 161716/ceph-mgr > tcp6 1 0 x.x.x.x:8443 x.x.12.161:51472 CLOSE_WAIT > 161716/ceph-mgr > tcp6 283 0 x.x.x.x:8443 x.x.12.202:44900 CLOSE_WAIT > 161716/ceph-mgr > tcp6 32 0 x.x.x.x:8443 x.x.12.207:58202 CLOSE_WAIT > 161716/ceph-mgr > tcp6 32 0 x.x.x.x:8443 x.x.12.200:52162 CLOSE_WAIT > 161716/ceph-mgr > tcp6 32 0 x.x.x.x:8443 x.x.12.167:43148 CLOSE_WAIT > 161716/ceph-mgr > tcp6 305 0 x.x.x.x:8443 x.x.12.167:60102 CLOSE_WAIT > 161716/ceph-mgr > tcp6 79 0 x.x.x.x:8443 x.x.12.195:48504 CLOSE_WAIT > 161716/ceph-mgr > tcp6 69 0 x.x.x.x:8443 x.x.12.167:50362 CLOSE_WAIT > 161716/ceph-mgr > tcp6 38 0 x.x.x.x:8443 x.x.12.167:36840 CLOSE_WAIT > 161716/ceph-mgr > tcp6 76 0 x.x.x.x:8443 x.x.12.209:54166 CLOSE_WAIT > 161716/ceph-mgr > tcp6 68 0 x.x.x.x:8443 x.x.12.207:34312 CLOSE_WAIT > 161716/ceph-mgr > tcp6 209 0 x.x.x.x:8443 x.x.12.209:52642 CLOSE_WAIT > 161716/ceph-mgr > tcp6 220 0 x.x.x.x:8443 x.x.12.202:41156 CLOSE_WAIT > 161716/ceph-mgr > tcp6 202 0 x.x.x.x:8443 x.x.12.209:55448 CLOSE_WAIT > 161716/ceph-mgr > tcp6 193 0 x.x.x.x:8443 x.x.12.207:56296 CLOSE_WAIT > 161716/ceph-mgr > tcp6 672 0 x.x.x.x:8443 x.x.12.207:35516 CLOSE_WAIT > 161716/ceph-mgr > tcp6 1186 0 x.x.x.x:8443 x.x.28.4:54074 CLOSE_WAIT > 161716/ceph-mgr > tcp6 163 0 x.x.x.x:8443 x.x.12.209:54458 CLOSE_WAIT > 161716/ceph-mgr > tcp6 214 0 x.x.x.x:8443 x.x.12.167:54912 CLOSE_WAIT > 161716/ceph-mgr > tcp6 129 0 x.x.x.x:8443 x.x.12.200:42494 CLOSE_WAIT > 161716/ceph-mgr > tcp6 86 0 x.x.x.x:8443 x.x.12.195:58618 CLOSE_WAIT > 161716/ceph-mgr > tcp6 103 0 x.x.x.x:8443 x.x.12.209:45408 CLOSE_WAIT > 161716/ceph-mgr > tcp6 77 0 x.x.x.x:8443 x.x.12.202:60792 CLOSE_WAIT > 161716/ceph-mgr > tcp6 189 0 x.x.x.x:8443 x.x.12.161:58640 CLOSE_WAIT > 161716/ceph-mgr > tcp6 68 0 x.x.x.x:8443 x.x.12.167:42004 CLOSE_WAIT > 161716/ceph-mgr > tcp6 1 0 x.x.x.x:8443 x.x.12.195:36348 CLOSE_WAIT > 161716/ceph-mgr > > Thanks, > Shridhar > > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |