On Tue, Aug 9, 2016 at 5:35 AM, Victor Payno <vpayno@xxxxxxxxxx> wrote: > We got this error while we had mapped rbds, and creating and deleting > snapshots on unmapped rbds. We have more logs, just wasn't sure how > far back you need to go. > > > -3> 2016-08-07 20:34:23.034180 7ff7a3d53700 1 -- > 172.20.3.100:0/25852 <== osd.45 172.20.3.101:6801/61384 235931 ==== > osd_ping(ping_reply e47657 stamp 2016-08-07 20:34:23.013702) v2 ==== > 47+0+0 (1835738769 0 0) 0x55e757031e00 con 0x55e7597bef20 > -2> 2016-08-07 20:34:23.034188 7ff7a3d53700 1 -- > 172.20.3.100:0/25852 <== osd.48 172.20.3.101:6807/61495 235931 ==== > osd_ping(ping_reply e47657 stamp 2016-08-07 20:34:23.013702) v2 ==== > 47+0+0 (1835738769 0 0) 0x55e757161800 con 0x55e7595f26e0 > -1> 2016-08-07 20:34:23.034207 7ff7a154e700 1 -- > 172.20.3.100:6807/25852 --> 192.168.225.100:0/59480 -- > osd_ping(ping_reply e47657 stamp 2016-08-07 20:34:23.060394) v2 -- ?+0 > 0x55e7bdd78400 con 0x55e75660b340 > 0> 2016-08-07 20:34:23.034428 7ff79953e700 -1 > osd/ReplicatedPG.cc: In function 'ReplicatedPG::RepGather* > ReplicatedPG::trim_object(const hobject_t&)' thread 7ff79953e700 time > 2016-08-07 20:34:23.024037 > osd/ReplicatedPG.cc: 3101: FAILED assert(0) > > ceph version 9.2.0 (bb2ecea240f3a1d525bcb35670cb07bd1f0ca299) > 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char > const*)+0x8b) [0x55e751fba09b] > 2: (ReplicatedPG::trim_object(hobject_t const&)+0x2fb) [0x55e751cd10db] > 3: (ReplicatedPG::TrimmingObjects::react(ReplicatedPG::SnapTrim > const&)+0x424) [0x55e751d04694] > 4: (boost::statechart::simple_state<ReplicatedPG::TrimmingObjects, > ReplicatedPG::SnapTrimmer, boost::mpl::list<mpl_::na, mpl_::na, > mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, > mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, > mpl_::na, mpl_::na, mpl_::na, mpl_::na>, > (boost::statechart::history_mode)0>::react_impl(boost::statechart::event_base > const&, void const*)+0xb4) [0x55e751d2e1c4] > 5: (boost::statechart::state_machine<ReplicatedPG::SnapTrimmer, > ReplicatedPG::NotTrimming, std::allocator<void>, > boost::statechart::null_exception_translator>::process_queued_events()+0x12b) > [0x55e751d1c31b] > 6: (boost::statechart::state_machine<ReplicatedPG::SnapTrimmer, > ReplicatedPG::NotTrimming, std::allocator<void>, > boost::statechart::null_exception_translator>::process_event(boost::statechart::event_base > const&)+0x84) [0x55e751d1c4e4] > 7: (ReplicatedPG::snap_trimmer(unsigned int)+0x4bc) [0x55e751ca87dc] > 8: (OSD::ShardedOpWQ::_process(unsigned int, > ceph::heartbeat_handle_d*)+0x691) [0x55e751b350b1] > 9: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x872) > [0x55e751faab42] > 10: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55e751faca20] > 11: (()+0x84b4) [0x7ff7b7cd24b4] > 12: (clone()+0x6d) [0x7ff7b60274cd] > NOTE: a copy of the executable, or `objdump -rdS <executable>` is > needed to interpret this. Looks like an OSD bug - adding Sam. Thanks, Ilya -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html