Re: ceph orch host drain daemon type

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



If you are using cephadm, couldn't the host be removed from placing osds? On my cluster, I labeled the hosts for each service (OSD/MON/MGR/...) and have the services deployed by label.   I believe that if you had that, then when a label is removed from the host the services eventually drain.



-----Original Message-----
From: Frédéric Nass <frederic.nass@xxxxxxxxxxxxxxxx> 
Sent: Thursday, August 29, 2024 11:30 AM
To: Eugen Block <eblock@xxxxxx>
Cc: ceph-users <ceph-users@xxxxxxx>; dev <dev@xxxxxxx>
Subject:  Re: ceph orch host drain daemon type

Hello Eugen,

A month back, while playing with a lab cluster, I drained a multi-service host (OSDs, MGR, MON, etc.) in order to recreate all of its OSDs. During this operation, all cephadm containers were removed as expected, including the MGR. As a result, I got into a situation where the orchestrator backend 'cephadm' was missing and wouldn't load anymore. I didn't have much time to investigate this, so I decided to recreate the lab cluster. But I think this is due to a bug.

I would probably have avoided this situation if I had been able to ask the orchestrator to only drain services of type 'osd'. Makes sense.

Cheers,
Frédéric.

----- Le 27 Aoû 24, à 15:19, Eugen Block eblock@xxxxxx a écrit :

> Hi,
> 
> is there anything on the road map to be able to choose a specific 
> daemon type to be entirely removed from a host instead of all cephadm 
> managed daemons? I just did a quick search in tracker and github, but 
> it may be "hidden" somewhere else.
> 
> I was thinking about colocated daemons on a host, for example MON, 
> MGR, OSDs, node-exporter, crash. That's quite common, but if I just 
> wanted to drain all OSDs (maybe mark them as "destroyed" in order to 
> replace the drives), the usual 'ceph orch host drain <host>' command 
> would remove all daemons. That seems unnecessary if I'm going to add 
> the OSDs back.
> 
> Since there are a couple of other daemon types which can be deployed 
> multiple times per host, e. g. MDS, RGW, it doesn't only make sense 
> for OSDs but for other daemons as well. And those other daemons 
> usually have some cryptic suffix, we wouldn't need that in order to 
> get rid of them, it doesn't save that much time, but it could be a 
> nice enhancement.
> 
> Should I create a tracker issue in the enhancement section for that?
> 
> Thanks!
> Eugen
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an 
> email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux