mons die with mon/OSDMonitor.cc: 125: FAILED assert(version >= osdmap.epoch)...

[Eric Hall <eric.hall@xxxxxxxxxxxxxx>]

Power failure in data center has left 3 mons unable to start with 
mon/OSDMonitor.cc: 125: FAILED assert(version >= osdmap.epoch)

Have found simliar problem discussed at 
http://irclogs.ceph.widodh.nl/index.php?date=2015-05-29, but am unsure 
how to proceed.

If I read
ceph-kvstore-tool /var/lib/ceph/mon/ceph-cephsecurestore1/store.db list
correctly, they believe osdmap is 1, but they also have 
osdmap:full_38456 and osdmap:38630 in the store.

Working from http://irclogs info, something like
ceph-kvstore-tool /var/lib/ceph/mon/ceph-foo/store.db set osdmap NNNNN 
in /tmp/osdmap
might help, but I am unsure of value for NNNN.  Seems like too delicate 
an operation for experimentation.


OS: Ubuntu 14.04.4
kernel: 3.13.0-83-generic
ceph: Firefly 0.80.11-1trusty

Any assistance appreciated,
--
Eric Hall
Institute for Software Integrated Systems
Vanderbilt University

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com