Yes, we restarted the primary mon and mgr services. Still no luck. ________________________________ From: Dhairya Parmar <dparmar@xxxxxxxxxx> Sent: Monday, September 26, 2022 3:44 PM To: Wyll Ingersoll <wyllys.ingersoll@xxxxxxxxxxxxxx> Cc: ceph-users@xxxxxxx <ceph-users@xxxxxxx> Subject: Re: osds not bootstrapping: monclient: wait_auth_rotating timed out Looking at the shared tracker, I can see people talking about restarting primary mon/mgr and getting this fixed at note-4<https://tracker.ceph.com/issues/17170#note-4> and note-8<https://tracker.ceph.com/issues/17170#note-8>. Did you try that out? On Tue, Sep 27, 2022 at 12:44 AM Wyll Ingersoll <wyllys.ingersoll@xxxxxxxxxxxxxx<mailto:wyllys.ingersoll@xxxxxxxxxxxxxx>> wrote: Ceph Pacific (16.2.9) on a large cluster. Approximately 60 (out of 700) osds fail to start and show an error: monclient: wait_auth_rotating timed out after 300 We modified the "rotating_keys_bootstrap_timeout" from 30 to 300, but they still fail. All nodes are time-synced with NTP and the skew has been verified to be < 1.0 seconds. It looks a lot like this bug: https://tracker.ceph.com/issues/17170 which does not appear to be resolved yet. Any other suggestions on how to get these OSDs to sync up with the cluster? thanks! _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx<mailto:ceph-users@xxxxxxx> To unsubscribe send an email to ceph-users-leave@xxxxxxx<mailto:ceph-users-leave@xxxxxxx> -- Dhairya Parmar He/Him/His Associate Software Engineer, CephFS Red Hat Inc.<https://www.redhat.com/> dparmar@xxxxxxxxxx<mailto:dparmar@xxxxxxxxxx> [https://static.redhat.com/libs/redhat/brand-assets/2/corp/logo--200.png]<https://www.redhat.com/> _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |