> Op 17 augustus 2016 om 17:44 schreef Dan Jakubiec <dan.jakubiec@xxxxxxxxx>: > > > Hello, we have a Ceph cluster with 8 OSD that recently lost power to all 8 machines. We've managed to recover the XFS filesystems on 7 of the machines, but the OSD service is only starting on 1 of them. > > The other 5 machines all have complaints similar to the following: > > 2016-08-17 09:32:15.549588 7fa2f4666800 -1 filestore(/var/lib/ceph/osd/ceph-1) Error initializing leveldb : Corruption: 6 missing files; e.g.: /var/lib/ceph/osd/ceph-1/current/omap/042421.ldb > > How can we repair the leveldb to allow the OSDs to startup? > My first question would be: How did this happen? What hardware are you using underneath? Is there a RAID controller which is not flushing properly? Since this should not happen during a power failure. I don't know the answer to your question, but lost files are not good. You might find them in a lost+found directory if XFS repair worked? Wido > Thanks, > > -- Dan J_______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |