Issue with osds not starting after reboot

[Seth Duncan <Seth.Duncan2@xxxxxx>]

I have a 3 host storage cluster with 10 osd on each host. the other day 5 drives on a single host went down and the other 5 failed to come up after reboot.

In my attempts to understand the cause of the issue I realize that I need some guidance to diagnose the problem.

I have tried ceph-disk activate-all and get the following errors:

[root@faraday ~]# ceph-disk activate-all

mount_activate: Failed to activate

ceph-disk: Error: No cluster conf found in /etc/ceph with fsid e1d7b4ae-2dcd-40ee-bea5-d103fe1fa9c9

mount_activate: Failed to activate

ceph-disk: Error: No cluster conf found in /etc/ceph with fsid e1d7b4ae-2dcd-40ee-bea5-d103fe1fa9c9

mount_activate: Failed to activate

ceph-disk: Error: No cluster conf found in /etc/ceph with fsid e1d7b4ae-2dcd-40ee-bea5-d103fe1fa9c9

mount_activate: Failed to activate

ceph-disk: Error: No cluster conf found in /etc/ceph with fsid e1d7b4ae-2dcd-40ee-bea5-d103fe1fa9c9

mount_activate: Failed to activate

ceph-disk: Error: No cluster conf found in /etc/ceph with fsid e1d7b4ae-2dcd-40ee-bea5-d103fe1fa9c9

mount_activate: Failed to activate

ceph-disk: Error: No cluster conf found in /etc/ceph with fsid e1d7b4ae-2dcd-40ee-bea5-d103fe1fa9c9

mount_activate: Failed to activate

ceph-disk: Error: No cluster conf found in /etc/ceph with fsid e1d7b4ae-2dcd-40ee-bea5-d103fe1fa9c9

mount_activate: Failed to activate

ceph-disk: Error: No cluster conf found in /etc/ceph with fsid e1d7b4ae-2dcd-40ee-bea5-d103fe1fa9c9

mount_activate: Failed to activate

ceph-disk: Error: No cluster conf found in /etc/ceph with fsid e1d7b4ae-2dcd-40ee-bea5-d103fe1fa9c9

mount_activate: Failed to activate

ceph-disk: Error: No cluster conf found in /etc/ceph with fsid e1d7b4ae-2dcd-40ee-bea5-d103fe1fa9c9

ceph-disk: Error: One or more partitions failed to activate

any ideas what would cause this?

*******************************************************************
IMPORTANT MESSAGE FOR RECIPIENTS IN THE U.S.A.:
This message may constitute an advertisement of a BD group's products or services or a solicitation of interest in them. If this is such a message and you would like to opt out of receiving future advertisements or solicitations from this BD group, please forward this e-mail to optoutbygroup@xxxxxx. [BD.v1.0]
*******************************************************************
This message (which includes any attachments) is intended only for the designated recipient(s). It may contain confidential or proprietary information and may be subject to the attorney-client privilege or other confidentiality protections. If you are not a designated recipient, you may not review, use, copy or distribute this message. If you received this in error, please notify the sender by reply e-mail and delete this message. Thank you.
*******************************************************************
Corporate Headquarters Mailing Address: BD (Becton, Dickinson and Company) 1 Becton Drive Franklin Lakes, NJ 07417 U.S.A.

_______________________________________________
Dev mailing list -- dev@xxxxxxx
To unsubscribe send an email to dev-leave@xxxxxxx