Hi, I have problem with starting two of my OSD’s with error: osd.19 pg_epoch: 8887 pg[1.2b5(unlocked)] enter Initial 0> 2019-03-01 09:41:30.259485 7f303486be00 -1 /build/ceph-12.2.11/src/osd/PGLog.h: In function 'static void PGLog::read_log_and_missing(ObjectStore*, coll_t, coll_t, ghobject_t, const pg_info_t&, PGLog::IndexedLog&, missing_type&, bool, std::ostringstream&, bool, bool*, const DoutPrefixProvider*, std::set<std::__cxx11::basic_string<char> >*, bool) [with missing_type = pg_missing_set<true>; std::ostringstream = std::__cxx11::basic_ostringstream<char>]' thread 7f303486be00 time 2019-03-01 09:41:30.257055 /build/ceph-12.2.11/src/osd/PGLog.h: 1355: FAILED assert(last_e.version.version < e.version.version) I’m trying to recover 3 RBD images from this cluster using rbd_recovery_tool but this tool not working for my Luminous cluster. After reading code of rbd_recovery_tool I found that in my version of ceph-kvstore-tool I need to specify database type. I think that also output of this command is changed. After running command manual I get this output: ceph-kvstore-tool rocksdb /var/lib/ceph/osd/ceph-19/current/omap get _HOBJTOSEQ_ ...head.1.000002B5 (_HOBJTOSEQ_, ...head.1.000002B5) 00000000 02 01 81 00 00 00 a9 00 00 00 00 00 00 00 00 00 |................| 00000010 00 00 00 00 00 00 01 00 00 00 00 00 00 00 02 00 |................| 00000020 01 01 12 00 00 00 01 00 00 00 00 00 00 00 00 00 |................| 00000030 00 00 00 ff ff ff ff ff fe ff ff ff ff ff ff ff |................| 00000040 06 03 2b 00 00 00 00 00 00 00 00 00 00 00 fe ff |..+.............| 00000050 ff ff ff ff ff ff b5 02 00 00 00 00 00 00 00 01 |................| 00000060 00 00 00 00 00 00 00 ff ff ff ff ff ff ff ff ff |................| 00000070 00 01 01 10 00 00 00 00 00 00 00 00 00 00 00 00 |................| 00000080 00 00 00 00 00 00 00 |.......| 00000087 In src of rbd_recovery_tool I found this comment: # ceph-kvstore-tool get result like this: # 02 01 7e 00 00 00 12 44 00 00 00 00 00 00 00 00 # get header seq bytes: # 12 44 00 00 00 00 00 00 # -> 00 00 00 00 00 00 44 12 # echo $((16#0000000000004412)) -> 17426 == header_seq Output is different so rbd_recovery_tool can’t parse it. How can I fix this code? Where I can find my „header_seq” for this pg? Regards Mateusz _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |