Dear ceph users, one of our cluster is complaining about plenty of stray hosts and daemons. Pretty much all of them. [WRN] CEPHADM_STRAY_HOST: 6 stray host(s) with 280 daemon(s) not managed by cephadm stray host osd-mirror-1 has 47 stray daemons: ['mgr.osd-mirror-1.ltmyyh', 'mon.osd-mirror-1', 'osd.1', ...] stray host osd-mirror-2 has 46 stray daemons: ['mon.osd-mirror-2', 'osd.0', ...] stray host osd-mirror-3 has 48 stray daemons: ['cephfs-mirror.osd-mirror-3.qzcuvv', 'mgr.osd-mirror-3', 'mon.osd-mirror-3', 'osd.101', ...] stray host osd-mirror-4 has 47 stray daemons: ['mds.cephfs.osd-mirror-4.omjlxu', 'mgr.osd-mirror-4', 'osd.103', ...] stray host osd-mirror-5 has 46 stray daemons: ['mgr.osd-mirror-5', 'osd.139', ...] stray host osd-mirror-6 has 46 stray daemons: ['mds.cephfs.osd-mirror-6.hobjsy', 'osd.141', ...] It all seems to boil down to host names from `ceph orch host ls` not matching with other configurations. ceph orch host ls HOST ADDR LABELS STATUS osd-mirror-1.our.domain.org 172.16.62.22 rgw osd osd-mirror-2.our.domain.org 172.16.62.23 rgw osd osd-mirror-3.our.domain.org 172.16.62.24 rgw osd osd-mirror-4.our.domain.org 172.16.62.25 rgw mds osd osd-mirror-5.our.domain.org 172.16.62.32 rgw osd osd-mirror-6.our.domain.org 172.16.62.33 rgw mds osd hostname osd-mirror-6 hostname -f osd-mirror-6.our.domain.org 0|0[root@osd-mirror-6 ~]# ceph mon metadata | grep "\"hostname\"" "hostname": "osd-mirror-1", "hostname": "osd-mirror-3", "hostname": "osd-mirror-2", 0|1[root@osd-mirror-6 ~]# ceph mgr metadata | grep "\"hostname\"" "hostname": "osd-mirror-1", "hostname": "osd-mirror-3", "hostname": "osd-mirror-4", "hostname": "osd-mirror-5", The documentation states, that "cephadm demands that the name of host given via `ceph orch host add` equals the output of `hostname` on remote hosts.". https://docs.ceph.com/en/latest/cephadm/host-management/#fully-qualified-domain-names-vs-bare-host-names https://docs.ceph.com/en/octopus/cephadm/concepts/?#fully-qualified-domain-names-vs-bare-host-names But it seems our cluster wasn't setup like this. How can I now change the host names which were assigend when adding the hosts with `ceph orch host add HOSTNAME`? I can't seem to find any documentation on changing the host names which are listed by `ceph orch host ls`. All I can find is related to changing the actual name of the host in the system. The crush map also just contains the bare host names. So, where are these FQDN names actually registered? Thank you for help. Best regards, Mathias _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |