Hello
We had an issue with OSDs and RAID Cards. I have recovered all but 1 pg
by allowing ceph to recover on its own.
But I have 1 PG which wasn't replicated, so I exported it before I took
the OSD totally out.
I have tried to import it using the objectstore tool, but no matter
where I import it into, that OSD crashes with:
0> 2016-10-10 09:51:19.356865 7f468626d780 -1 osd/OSDMap.h: In
function 'const epoch_t& OSDMap::get_up_from(int) const' thread
7f468626d780 time 2016-10-10 09:51:19.356011
osd/OSDMap.h: 484: FAILED assert(exists(osd))
I have a few ideas on what might cause this, but I wanted to get your
opinion. I've tried to create an OSD and import it-- and I have also
removed the incomplete pgs from the other OSDs and imported it. Both
result in the same crash.
This is ceph firefly .8.11 Any advice or direction would be greatly
appreciated. Below are my export and import strings. I think this might
have to do with the epoch range.
Thanks!
john
Log: http://pastebin.com/1b15ShTe
3.4cc is the affected PG
Export from affected OS (was successful, no errors)
ceph-objectstore-tool --op export --pgid 3.4cc --data-path
/var/lib/ceph/osd/ceph-74/ --journal-path
/var/lib/ceph/osd/ceph-74/journal --file 3.4cc.osd74.export
Import into temp osd with a 0 weight:
ceph-objectstore-tool --op import --data-path /var/lib/ceph/osd/ceph-92
--journal-path /var/lib/ceph/osd/ceph-92/journal --file 3.4cc.osd74.export
Import into an existing OSD (the PG was removed from this osd prior to
import)
ceph-objectstore-tool --op import --data-path /var/lib/ceph/osd/ceph-80
--journal-path /var/lib/ceph/osd/ceph-80/journal --file 3.4cc.export
Points of interest (before/after noted only to show sequence of events):
Line 818: unlock of the affected PG (3.4cc) (before: 3.4c6, after: 3.4d0)
Line 2156: last pg referenced in load_pgs
Line 2166: assertion failure
Repeats for 3 times, then stays down.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
