Re: mds cluster degraded (some RBD lost)

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 03/05/2014 06:52 AM, kenneth wrote:
We have a three-node ceph cluster.

Node#1
MDS#1 - primary
MON#1
3 OSDs
OS running from a USB stick

Node#2
MDS#2 - standby
MON#2
2 OSDs
OS running from a hard drive

Node#3
MDS#3 - standby
MON#3
2 OSDs
OS running from a hard drive

The USB stick of Node1 failed i.e. it became read-only probably due to
wear and tear from the OS.
We have some files stored in cephfs and several VMs in RBD.

Node#1 was powered down and brought back up.

We are now unable to access the cephfs and some RBD images are listed
(but unreadble

The cephfs error says MDS cluster is degraded, node1 is laggy or crashed.
As for the RBD images. Other are still accessible but while other have
the following error:
# rbd info -p one -i one-5
rbd: error opening image one-5: 2014-03-05 13:50:59.519163 7f5d22649780
-1 librbd::ImageCtx: error finding header: (2) No such file or
directory(2) No such file or directory
But when I issue rbd ls -p one, the image one-5 is showing.

How do we proceed to recover full cluster functionality?
--

Did the cluster recover? Are all pgs active+clean? I don't think so.

What does 'ceph -s' say?

Thanks
Thanks,

Kenneth



_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



--
Wido den Hollander
42on B.V.

Phone: +31 (0)20 700 9902
Skype: contact42on
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux