We have a three-node ceph cluster.
Node#1 MDS#1 - primary MON#1 3 OSDs OS running from a USB stick Node#2 MDS#2 - standby MON#2 2 OSDs OS running from a hard drive Node#3 MDS#3 - standby MON#3 2 OSDs OS running from a hard drive The USB stick of Node1 failed i.e. it became read-only probably due to wear and tear from the OS. We have some files stored in cephfs and several VMs in RBD. Node#1 was powered down and brought back up. We are now unable to access the cephfs and some RBD images are listed (but unreadble The cephfs error says MDS cluster is degraded, node1 is laggy or crashed. As for the RBD images. Other are still accessible but while other have the following error: # rbd info -p one -i one-5 rbd: error opening image one-5: 2014-03-05 13:50:59.519163 7f5d22649780 -1 librbd::ImageCtx: error finding header: (2) No such file or directory(2) No such file or directory But when I issue rbd ls -p one, the image one-5 is showing. How do we proceed to recover full cluster functionality? --
Thanks, Kenneth |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com