Hi Alex, Thank you very much, yes it was a time sync issue after fixing time sync OSD service started. regards, Amudhan On Sat, Nov 4, 2023 at 9:07 PM Alex Gorbachev <ag@xxxxxxxxxxxxxxxxxxx> wrote: > Hi Amudhan, > > Have you checked the time sync? This could be an issue: > > https://tracker.ceph.com/issues/17170 > -- > Alex Gorbachev > Intelligent Systems Services Inc. > http://www.iss-integration.com > https://www.linkedin.com/in/alex-gorbachev-iss/ > > > > On Sat, Nov 4, 2023 at 11:22 AM Amudhan P <amudhan83@xxxxxxxxx> wrote: > >> Hi, >> >> One of the server in Ceph cluster accidentally shutdown abruptly due to >> power failure. After restarting OSD's not coming up and in Ceph health >> check it shows osd down. >> When checking OSD status "osd.26 18865 unable to obtain rotating service >> keys; retrying" >> For every 30 seconds it's just putting a message and it's all the same in >> all OSD in the system. >> >> Nov 04 20:03:05 strg-node-03 bash[34287]: debug >> 2023-11-04T14:33:05.089+0000 7f1f5693c080 -1 osd.26 18865 unable to obtain >> rotating service keys; retrying >> Nov 04 20:03:35 strg-node-03 bash[34287]: debug >> 2023-11-04T14:33:35.090+0000 7f1f5693c080 -1 osd.26 18865 unable to obtain >> rotating service keys; retrying >> >> ceph version 16.2.7 (dd0603118f56ab514f133c8d2e3adfc983942503) pacific >> (stable) on Debian 11 bullseye and cephadm based installation. >> >> Tried to search for errors and msg couldn't find anything useful. >> >> How do I fix this issue ? >> >> regards, >> Amudhan >> _______________________________________________ >> ceph-users mailing list -- ceph-users@xxxxxxx >> To unsubscribe send an email to ceph-users-leave@xxxxxxx >> > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |