denied reconnect attempt for ceph fs client

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi all,

I'm not 100% sure, but I believe that since the update from mimic-13.2.8 to mimic-13.2.10 I have a strange issue. If a ceph fs client becomes unresponsive, it is evicted, but it cannot reconnect; see ceph.log extract below. In the past, clients would retry after the blacklist period and everything continued fine. I'm wondering why the clients cannot reconnect any more. I see this now every time a client gets thrown out and didn't have this problem before.

Any hints to what I might want to change are welcome, and also information what might have changed during the update (eg. is this expected or not).

2021-01-11 19:45:53.839721 [INF]  denied reconnect attempt (mds is up:active) from client.30770997 192.168.56.121:0/2325067585 after 1.82224e+06 (allowed interval 45)
2021-01-11 19:45:46.713822 [INF]  Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests)
2021-01-11 19:45:45.937126 [INF]  MDS health message cleared (mds.0): 1 slow requests are blocked > 30 secs
2021-01-11 19:45:39.527180 [INF]  Evicting (and blacklisting) client session 30770997 (192.168.56.121:0/2325067585)
2021-01-11 19:45:39.527168 [WRN]  evicting unresponsive client HOSTNAME:CLIENT_NAME (30770997), after 62.735 seconds
2021-01-11 19:45:39.522141 [WRN]  1 slow requests, 0 included below; oldest blocked for > 50.371751 secs
2021-01-11 19:45:34.522085 [WRN]  1 slow requests, 0 included below; oldest blocked for > 45.371685 secs
2021-01-11 19:45:29.521991 [WRN]  1 slow requests, 0 included below; oldest blocked for > 40.371604 secs
2021-01-11 19:45:24.521907 [WRN]  1 slow requests, 0 included below; oldest blocked for > 35.371520 secs
2021-01-11 19:45:19.521895 [WRN]  slow request 30.371469 seconds old, received at 2021-01-11 19:44:49.150361: client_request(client.30771333:10419033 getattr pAsLsXsFs #0x10014446b0f 2021-01-11 19:44:49.145012 caller_uid=257062, caller_gid=257062{}) currently failed to rdlock, waiting

Best regards,
=================
Frank Schilder
AIT Risø Campus
Bygning 109, rum S14
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux