|
Dear Ceph Users,
I have the following situation in my small 3-node cluster: --snip root@ceph2:~# ceph status cluster d1af2097-8535-42f2-ba8c-0667f90cab61 health HEALTH_WARN 1 mons down, quorum 0,1 ceph0,ceph1 monmap e1: 3 mons at {ceph0=10.0.0.30:6789/0,ceph1=10.0.0.31:6789/0,ceph2=10.0.0.32:6789/0} election epoch 538, quorum 0,1 ceph0,ceph1 osdmap e2574: 9 osds: 9 up, 9 in pgmap v4397840: 768 pgs, 3 pools, 112 GB data, 28339 objects 347 GB used, 8018 GB / 8365 GB avail 768 active+clean client io 0 B/s rd, 3283 B/s wr, 2 op/s --snip Seems a monitor couldn’t start, so I tried to start it on console: --snip root@ceph2:~# /usr/bin/ceph-mon --cluster=ceph -i ceph2 -f Corruption: 12 missing files; e.g.: /var/lib/ceph/mon/ceph-ceph2/store.db/811920.ldb 2016-04-20 13:16:49.019857 7f39a9cbe800 -1 error opening mon data directory at '/var/lib/ceph/mon/ceph-ceph2': (22) Invalid argument --snip
Seems there are indeed some files missing in the monitor directory: --snip root@ceph2:~# find /var/lib/ceph/mon/ceph-ceph2/store.db
/var/lib/ceph/mon/ceph-ceph2/store.db /var/lib/ceph/mon/ceph-ceph2/store.db/LOG /var/lib/ceph/mon/ceph-ceph2/store.db/811944.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/811943.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/811945.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/811939.log /var/lib/ceph/mon/ceph-ceph2/store.db/811936.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/811952.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/811947.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/811946.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/MANIFEST-753605 /var/lib/ceph/mon/ceph-ceph2/store.db/811935.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/811942.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/811951.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/811949.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/811948.ldb /var/lib/ceph/mon/ceph-ceph2/store.db/CURRENT /var/lib/ceph/mon/ceph-ceph2/store.db/LOCK /var/lib/ceph/mon/ceph-ceph2/store.db/LOG.old /var/lib/ceph/mon/ceph-ceph2/store.db/811950.ldb --snip
What I should/have to do to get that monitor up and working again ? Thanks in advance any help is appreciated. Kind Regards, Daniel |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
