Re: Error When Replacing OSD - Please Help

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

is your cluster managed by cephadm? Because you refer to the manual procedure in the docs, but they are probably referring to pre-cephadm times when you had to use ceph-volume directly. If your cluster is managed by cephadm I wouldn't intervene manually when the orchestrator can help with these tasks. See [2] for more details.

[2] https://docs.ceph.com/en/reef/cephadm/services/osd/#remove-an-osd

Zitat von duluxoz <duluxoz@xxxxxxxxx>:

Hi All,

I'm trying to replace an OSD in our cluster.

This is on Reef 18.2.2 on Rocky 9.4.

I performed the following steps (from this page of the Ceph Doco: https://docs.ceph.com/en/reef/rados/operations/add-or-rm-osds/):

1. Make sure that it is safe to destroy the OSD:
   `while!cephosdsafe-to-destroyosd.{id};dosleep10;done`
2. Destroy the OSD: `cephosddestroy0--yes-i-really-mean-it`
3. Replaced the HDD
4. Prepare the disk for replacement by using the ID of the OSD that was
   destroyed in previous steps:
   `ceph-volumelvmprepare--osd-id0--data/dev/sd3`

However, at this point I get the following errors:

~~~

Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring osd tree -f json  stderr: 2024-08-02T13:52:58.812+1000 7ff26e904640 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin: (2) No such file or directory  stderr: 2024-08-02T13:52:58.812+1000 7ff26e904640 -1 AuthRegistry(0x7ff268063e88) no keyring found at /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx  stderr: 2024-08-02T13:52:58.817+1000 7ff26e904640 -1 auth: unable to find a keyring on /var/lib/ceph/bootstrap-osd/ceph.keyring: (2) No such file or directory  stderr: 2024-08-02T13:52:58.817+1000 7ff26e904640 -1 AuthRegistry(0x7ff268063e88) no keyring found at /var/lib/ceph/bootstrap-osd/ceph.keyring, disabling cephx  stderr: 2024-08-02T13:52:58.819+1000 7ff26e904640 -1 auth: unable to find a keyring on /var/lib/ceph/bootstrap-osd/ceph.keyring: (2) No such file or directory  stderr: 2024-08-02T13:52:58.819+1000 7ff26e904640 -1 AuthRegistry(0x7ff268065b00) no keyring found at /var/lib/ceph/bootstrap-osd/ceph.keyring, disabling cephx  stderr: 2024-08-02T13:52:58.821+1000 7ff26e904640 -1 auth: unable to find a keyring on /var/lib/ceph/bootstrap-osd/ceph.keyring: (2) No such file or directory  stderr: 2024-08-02T13:52:58.821+1000 7ff26e904640 -1 AuthRegistry(0x7ff26e9030c0) no keyring found at /var/lib/ceph/bootstrap-osd/ceph.keyring, disabling cephx
 stderr: [errno 2] RADOS object not found (error connecting to the cluster)
-->  RuntimeError: Unable check if OSD id exists: 0

~~~

I can see a `client.bootstap-osd` user in the Ceph Dashboard Ceph User List, so I'm not sure what's going on.

Any help is greatly appreciated - thanks.
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx


_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux