Hi, i am trying to use fio_ceph_objectstore as an external engine used by fio to directly generate IO to objectstore backend without running a ceph cluster. The purpose is to understand the performance of objectstore backend. i was able to run kstore relatively stable, however with bluestore, it frequently crash during the test. here's the crash log: *** Caught signal (Segmentation fault) ** in thread 7f6bc67f4700 thread_name:bstore_kv_sync ceph version ccd5a2 (4ccd5a2aafa15ccb6830fa0e339d57be67a50e24) 1: (()+0x4f309e) [0x7f6bff71509e] 2: (()+0x11390) [0x7f6bed0a8390] 3: (malloc_usable_size()+0x28) [0x7f6becb4e4e8] 4: (rocksdb::Arena::AllocateNewBlock(unsigned long)+0x7c) [0x7f6bff80072c] 5: (rocksdb::Arena::AllocateFallback(unsigned long, bool)+0x45) [0x7f6bff8008a5] 6: (rocksdb::ConcurrentArena::AllocateAligned(unsigned long, unsigned long, rocksdb::Logger*)+0x16e) [0x7f6bff78a46e] 7: (()+0x5a3c0b) [0x7f6bff7c5c0b] 8: (rocksdb::MemTable::Add(unsigned long, rocksdb::ValueType, rocksdb::Slice const&, rocksdb::Slice const&, bool, rocksdb::MemTablePostProcessInfo*)+0x8d9) [0x7f6bff7871d9] 9: (rocksdb::MemTableInserter::PutCF(unsigned int, rocksdb::Slice const&, rocksdb::Slice const&)+0x30f) [0x7f6bff7c215f] 10: (rocksdb::WriteBatch::Iterate(rocksdb::WriteBatch::Handler*) const+0x53d) [0x7f6bff7bd3cd] 11: (rocksdb::WriteBatchInternal::InsertInto(rocksdb::autovector<rocksdb::WriteThread::Writer*, 8ul> const&, unsigned long, rocksdb::ColumnFamilyMemTables*, rocksdb::FlushScheduler*, bool, unsigned long, rocksdb::DB*, bool)+0x140) [0x7f6bff7bfd50] 12: (rocksdb::DBImpl::WriteImpl(rocksdb::WriteOptions const&, rocksdb::WriteBatch*, rocksdb::WriteCallback*, unsigned long*, unsigned long, bool)+0x1617) [0x7f6bff73e3c7] 13: (rocksdb::DBImpl::Write(rocksdb::WriteOptions const&, rocksdb::WriteBatch*)+0x2a) [0x7f6bff73ec5a] 14: (RocksDBStore::submit_transaction(std::shared_ptr<KeyValueDB::TransactionImpl>)+0x249) [0x7f6bff644469] 15: (BlueStore::_kv_sync_thread()+0x12a7) [0x7f6bff5e5037] 16: (BlueStore::KVSyncThread::entry()+0xd) [0x7f6bff6299ed] 17: (Thread::entry_wrapper()+0x75) [0x7f6bff923335] 18: (()+0x76ba) [0x7f6bed09e6ba] 19: (clone()+0x6d) [0x7f6becbd082d] is there any clue how to fix it? any help would be appreciated. Thanks, Sheng -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
