Hi Amudhan, Have you checked the time sync? This could be an issue: https://tracker.ceph.com/issues/17170 -- Alex Gorbachev Intelligent Systems Services Inc. http://www.iss-integration.com https://www.linkedin.com/in/alex-gorbachev-iss/ On Sat, Nov 4, 2023 at 11:22 AM Amudhan P <amudhan83@xxxxxxxxx> wrote: > Hi, > > One of the server in Ceph cluster accidentally shutdown abruptly due to > power failure. After restarting OSD's not coming up and in Ceph health > check it shows osd down. > When checking OSD status "osd.26 18865 unable to obtain rotating service > keys; retrying" > For every 30 seconds it's just putting a message and it's all the same in > all OSD in the system. > > Nov 04 20:03:05 strg-node-03 bash[34287]: debug > 2023-11-04T14:33:05.089+0000 7f1f5693c080 -1 osd.26 18865 unable to obtain > rotating service keys; retrying > Nov 04 20:03:35 strg-node-03 bash[34287]: debug > 2023-11-04T14:33:35.090+0000 7f1f5693c080 -1 osd.26 18865 unable to obtain > rotating service keys; retrying > > ceph version 16.2.7 (dd0603118f56ab514f133c8d2e3adfc983942503) pacific > (stable) on Debian 11 bullseye and cephadm based installation. > > Tried to search for errors and msg couldn't find anything useful. > > How do I fix this issue ? > > regards, > Amudhan > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx