Hi Mehmet, Hi Josh, thank you so much for your advice! I used the commands mentioned by Mehmed and they all returned the correct data. After that I restarted the OSDs of one storage node, one after the other with “systemctl restart ceph-osd@XX.service<mailto:ceph-osd@XX.service>” which worked very well. Thank you Josh for suggesting thist. Afterwards all restarted OSDs returned the correct data. To be really sure all data is consistent, I will now continue that for the whole cluster and continue the moving of the mon-services afterwards. Still, I am unsure if I am doing to much hassle about it and if it would also have been sufficient to just let the OSDs running with the outdated mon-map, as long, as they have a connection to the mon-cluster? Kind regards, Melanie Melanie Desaive Cloud DevOps Engineer Cloud Management Platform [cid:logo-aktuell-193px_17c55ea4-b743-4459-8492-93a5f153938c.png] Melanie.Desaive@xxxxxxxxxxx NTT DATA Business Solutions Global Managed Services GmbH Bismarckstrasse 105 – 10625 Berlin, Germany www.nttdata-solutions.com<https://nttdata-solutions.com/de/?utm_source=email-footer&utm_medium=email&utm_campaign=footer-tracking> [cid:image002_9a8f5529-347a-4a29-94f2-f6c20d166fc9.png]<https://www.linkedin.com/company/nttdatasolutions-ger/> [cid:image003_9807fcff-df79-41d4-ae52-7e249915dd12.png] <https://www.xing.com/pages/ntt-data-business-solutions-ger> [cid:image007_945ef6da-cf94-4598-8077-367f3309531f.png] <https://www.youtube.com/channel/UCrl5wnvXHQ2MVqQ4mH2Ik2w> [cid:image005_0a7f9378-c955-4bf5-bffd-e42fceb2caa5.png] <https://twitter.com/NDBS_GER> [cid:image004_1c0ea0b8-be9c-40f9-99ed-44853d4d35a9.png] <https://www.facebook.com/NTTDATABusinessSolutionsGER> Bleiben Sie auf dem Laufenden - mit unserem Infoservice! Jetzt kostenlos registrieren!<https://nttdata-solutions.com/de/news-and-insights/itelligence-infoservice/> Geschäftsführung: Mirko Kruse, André Walter Sitz und Amtsgericht: Dresden / HRB 21356 This email and any attachments are sent in strictest confidence for the sole use of the addressee and may contain legally privileged, confidential, and proprietary data. If you are not the intended recipient, then you have received this email in error. If this is the case please advise the sender by replying promptly to this email and then permanently delete this email and any attachments without any use, dissemination, printing, copying or forwarding. Copyright NTT DATA Business Solutions. All rights reserved Von: ceph@xxxxxxxxxx <ceph@xxxxxxxxxx> Gesendet: Montag, 6. September 2021 20:44 An: ceph-users@xxxxxxx; Josh Baergen <jbaergen@xxxxxxxxxxxxxxxx>; Desaive, Melanie <Melanie.Desaive@xxxxxxxxxxx> Cc: ceph-users@xxxxxxx Betreff: Re: Re: Mon-map inconsistency? Hi, what is the output of ceph mon stat Or ceph mon dump and ceph quorum_status When you see there your expectes nodes then i should all be fine... Hth Mehmet Am 6. September 2021 18:23:46 MESZ schrieb Josh Baergen <jbaergen@xxxxxxxxxxxxxxxx<mailto:jbaergen@xxxxxxxxxxxxxxxx>>: Hi Melanie, On Mon, Sep 6, 2021 at 10:06 AM Desaive, Melanie <Melanie.Desaive@xxxxxxxxxxx<mailto:Melanie.Desaive@xxxxxxxxxxx>> wrote: When I execute "ceph mon_status --format json-pretty" from our ceph-management VM, the correct mon nodes are returned. But when I execute "ceph daemon osd.xx config show | grep mon_host" on the respective storage node the old mon node IPs are returned. I am now unsure, that if I change more mon nodes, the information known to the OSDs could become invalid one after the other and we could run into heavy problems? "config show" is showing you the mon IPs read from the OSDs' ceph.conf, and is what is used to initially connect to the mons. After that, my understanding is that those IPs don't matter as the OSDs will use the IPs from the mons for further connections/communication. However, I'm not certain what happens if, for example, all of your mons were to go down for a period of time; do the OSDs use the last monmap for reconnecting to the mons or do they revert to using the configured mon IPs? At the very least, you should be fine to replace all of your mons and update each ceph.conf with the new info without needing to restart the OSDs. After that it may be wise to restart the OSDs to both update the configured mon IPs as well as test to make sure that they can reconnect to the new mons without issue in case of a future outage. Josh ________________________________ ceph-users mailing list -- ceph-users@xxxxxxx<mailto:ceph-users@xxxxxxx> To unsubscribe send an email to ceph-users-leave@xxxxxxx<mailto:ceph-users-leave@xxxxxxx> _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |