> On 9 Jul 2018, at 15.49, John Spray <jspray@xxxxxxxxxx> wrote:
>
> On Mon, Jul 9, 2018 at 2:37 PM Steffen Winther Sørensen
> <stefws@xxxxxxxxx> wrote:
>>
>> Dunno if this has been seen before so just for info, 1 in 24 OSD just did this:
>>
>> Jul 9 15:13:35 n4 ceph-osd: *** Caught signal (Segmentation fault) **
>> Jul 9 15:13:35 n4 ceph-osd: in thread 7ff209282700 thread_name:msgr-worker-2
>> Jul 9 15:13:35 n4 kernel: msgr-worker-2[4697]: segfault at 0 ip 00007ff21002f42b sp 00007ff20927b9c0 error 4 in libtcmalloc.so.4.4.5[7ff210008000+46000]
>> Jul 9 15:13:36 n4 systemd: ceph-osd@2.service: main process exited, code=killed, status=11/SEGV
>> Jul 9 15:13:36 n4 systemd: Unit ceph-osd@2.service entered failed state.
>> Jul 9 15:13:36 n4 systemd: ceph-osd@2.service failed.
>
> Hopefully there's a stack trace above those lines in your OSD log?
Nope just what looks like relaunch events:
...
2018-07-09 14:45:17.158 7ff1ef75f700 0 log_channel(cluster) log [DBG] : 3.a0 scrub starts
2018-07-09 14:45:17.185 7ff1ef75f700 0 log_channel(cluster) log [DBG] : 3.a0 scrub ok
2018-07-09 15:07:04.398 7ff1eef5e700 0 log_channel(cluster) log [DBG] : 4.b0 scrub starts
2018-07-09 15:07:04.412 7ff1eef5e700 0 log_channel(cluster) log [DBG] : 4.b0 scrub ok
2018-07-09 15:13:56.365 7f31359411c0 0 set uid:gid to 167:167 (ceph:ceph)
2018-07-09 15:13:56.365 7f31359411c0 0 ceph version 13.2.0 (79a10589f1f80dfe21e8f9794365ed98143071c4) mimic (stable), process (unknown), pid 604987
2018-07-09 15:13:56.365 7f31359411c0 0 pidfile_write: ignore empty --pid-file
2018-07-09 15:13:56.442 7f31359411c0 0 load: jerasure load: lrc load: isa
2018-07-09 15:13:56.442 7f31359411c0 1 bdev create path /var/lib/ceph/osd/ceph-2/block type kernel
2018-07-09 15:13:56.442 7f31359411c0 1 bdev(0x559559628000 /var/lib/ceph/osd/ceph-2/block) open path /var/lib/ceph/osd/ceph-2/block
2018-07-09 15:13:56.443 7f31359411c0 1 bdev(0x559559628000 /var/lib/ceph/osd/ceph-2/block) open size 146775474176 (0x222c800000, 137 GiB) block_size 4096 (4 KiB) rotational
2018-07-09 15:13:56.444 7f31359411c0 1 bluestore(/var/lib/ceph/osd/ceph-2) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0
2018-07-09 15:13:56.444 7f31359411c0 1 bdev(0x559559628000 /var/lib/ceph/osd/ceph-2/block) close
2018-07-09 15:13:56.700 7f31359411c0 1 bluestore(/var/lib/ceph/osd/ceph-2) _mount path /var/lib/ceph/osd/ceph-2
2018-07-09 15:13:56.700 7f31359411c0 1 bdev create path /var/lib/ceph/osd/ceph-2/block type kernel
2018-07-09 15:13:56.700 7f31359411c0 1 bdev(0x559559628000 /var/lib/ceph/osd/ceph-2/block) open path /var/lib/ceph/osd/ceph-2/block
2018-07-09 15:13:56.700 7f31359411c0 1 bdev(0x559559628000 /var/lib/ceph/osd/ceph-2/block) open size 146775474176 (0x222c800000, 137 GiB) block_size 4096 (4 KiB) rotational
2018-07-09 15:13:56.701 7f31359411c0 1 bluestore(/var/lib/ceph/osd/ceph-2) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0
2018-07-09 15:13:56.701 7f31359411c0 1 bdev create path /var/lib/ceph/osd/ceph-2/block type kernel
2018-07-09 15:13:56.701 7f31359411c0 1 bdev(0x559559628a80 /var/lib/ceph/osd/ceph-2/block) open path /var/lib/ceph/osd/ceph-2/block
2018-07-09 15:13:56.701 7f31359411c0 1 bdev(0x559559628a80 /var/lib/ceph/osd/ceph-2/block) open size 146775474176 (0x222c800000, 137 GiB) block_size 4096 (4 KiB) rotational
2018-07-09 15:13:56.701 7f31359411c0 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-2/block size 137 GiB
2018-07-09 15:13:56.701 7f31359411c0 1 bluefs mount
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option compaction_readahead_size = 2097152
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option compression = kNoCompression
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option max_write_buffer_number = 4
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option min_write_buffer_number_to_merge = 1
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option recycle_log_file_num = 4
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option writable_file_max_buffer_size = 0
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option write_buffer_size = 268435456
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option compaction_readahead_size = 2097152
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option compression = kNoCompression
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option max_write_buffer_number = 4
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option min_write_buffer_number_to_merge = 1
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option recycle_log_file_num = 4
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option writable_file_max_buffer_size = 0
2018-07-09 15:13:56.757 7f31359411c0 0 set rocksdb option write_buffer_size = 268435456
2018-07-09 15:13:56.764 7f31359411c0 1 rocksdb: do_open column families: [default]
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: RocksDB version: 5.13.0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Compile date May 29 2018
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: DB SUMMARY
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: CURRENT file: CURRENT
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: IDENTITY file: IDENTITY
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: MANIFEST file: MANIFEST-000223 size: 2449 Bytes
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: SST files in db dir, Total Num: 5, files: 000259.sst 000260.sst 000262.sst 000264.sst 000266.sst
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Write Ahead Log file in db: 000263.log size: 257627633 ; 000265.log size: 257520026 ;
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.error_if_exists: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.create_if_missing: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.paranoid_checks: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.env: 0x5595592fa480
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.info_log: 0x5595592fa840
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_file_opening_threads: 16
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.statistics: (nil)
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.use_fsync: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_log_file_size: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.log_file_time_to_roll: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.keep_log_file_num: 1000
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.recycle_log_file_num: 4
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.allow_fallocate: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.allow_mmap_reads: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.allow_mmap_writes: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.use_direct_reads: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.create_missing_column_families: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.db_log_dir:
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.wal_dir: db
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.table_cache_numshardbits: 6
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_subcompactions: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_background_flushes: -1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.WAL_ttl_seconds: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.WAL_size_limit_MB: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.manifest_preallocation_size: 4194304
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.is_fd_close_on_exec: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.advise_random_on_open: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.db_write_buffer_size: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.write_buffer_manager: 0x5595597a4d20
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.access_hint_on_compaction_start: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.use_adaptive_mutex: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.rate_limiter: (nil)
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.wal_recovery_mode: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.enable_thread_tracking: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.enable_pipelined_write: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.write_thread_max_yield_usec: 100
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.row_cache: None
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.wal_filter: None
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.avoid_flush_during_recovery: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.allow_ingest_behind: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.preserve_deletes: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.two_write_queues: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.manual_wal_flush: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_background_jobs: 2
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_background_compactions: -1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.writable_file_max_buffer_size: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.delayed_write_rate : 16777216
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_total_wal_size: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.stats_dump_period_sec: 600
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_open_files: -1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.bytes_per_sync: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.wal_bytes_per_sync: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_readahead_size: 2097152
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Compression algorithms supported:
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: kZSTDNotFinalCompression supported: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: kZSTD supported: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: kXpressCompression supported: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: kLZ4HCCompression supported: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: kLZ4Compression supported: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: kBZip2Compression supported: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: kZlibCompression supported: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: kSnappyCompression supported: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Fast CRC32 supported: Not supported on x86
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.0/rpm/el7/BUILD/ceph-13.2.0/src/rocksdb/db/version_set.cc:3088] Recovering from manifest file: MANIFEST-000223
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.0/rpm/el7/BUILD/ceph-13.2.0/src/rocksdb/db/column_family.cc:474] --------------- Options for column family [default]:
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_filter: None
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_filter_factory: None
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.memtable_factory: SkipListFactory
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.table_factory: BlockBasedTable
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559559299428)
cache_index_and_filter_blocks: 1
cache_index_and_filter_blocks_with_high_priority: 1
pin_l0_filter_and_index_blocks_in_cache: 1
index_type: 0
hash_index_allow_collision: 1
checksum: 1
no_block_cache: 0
block_cache: 0x5595596cd200
block_cache_name: LRUCache
block_cache_options:
capacity : 536870912
num_shard_bits : 4
strict_capacity_limit : 0
high_pri_pool_ratio: 0.000
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 4096
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: rocksdb.BuiltinBloomFilter
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 2
enable_index_compression: 1
block_align: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.write_buffer_size: 268435456
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_write_buffer_number: 4
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compression: NoCompression
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.bottommost_compression: Disabled
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.prefix_extractor: nullptr
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.num_levels: 7
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compression_opts.window_bits: -14
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compression_opts.level: -1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compression_opts.strategy: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.level0_stop_writes_trigger: 36
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.target_file_size_base: 67108864
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.target_file_size_multiplier: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_compaction_bytes: 1677721600
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.arena_block_size: 33554432
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.disable_auto_compactions: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_pri: kByCompensatedSize
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.compaction_options_fifo.ttl: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.table_properties_collectors:
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.inplace_update_support: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.inplace_update_num_locks: 10000
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.memtable_huge_page_size: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.bloom_locality: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.max_successive_merges: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.optimize_filters_for_hits: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.paranoid_file_checks: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.force_consistency_checks: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.report_bg_io_stats: 0
2018-07-09 15:13:56.764 7f31359411c0 4 rocksdb: Options.ttl: 0
2018-07-09 15:13:56.808 7f31359411c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.0/rpm/el7/BUILD/ceph-13.2.0/src/rocksdb/db/version_set.cc:3362] Recovered from manifest file:db/MANIFEST-000223 succeeded,manifest_file_number is 223, next_file_number is 268, last_sequence is 12268664, log_number is 0,prev_log_number is 0,max_column_family is 0,deleted_log_number is 220
2018-07-09 15:13:56.808 7f31359411c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.0/rpm/el7/BUILD/ceph-13.2.0/src/rocksdb/db/version_set.cc:3370] Column family [default] (ID 0), log number is 265
2018-07-09 15:13:56.808 7f31359411c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1531142036809871, "job": 1, "event": "recovery_started", "log_files": [263, 265]}
2018-07-09 15:13:56.808 7f31359411c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.0/rpm/el7/BUILD/ceph-13.2.0/src/rocksdb/db/db_impl_open.cc:551] Recovering log #263 mode 0
2018-07-09 15:13:59.024 7f31359411c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.0/rpm/el7/BUILD/ceph-13.2.0/src/rocksdb/db/db_impl_open.cc:551] Recovering log #265 mode 0
2018-07-09 15:13:59.929 7f31359411c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1531142039931324, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 268, "file_size": 2663914, "table_properties": {"data_size": 2596249, "index_size": 27196, "filter_size": 39420, "raw_key_size": 672861, "raw_average_key_size": 50, "raw_value_size": 2365224, "raw_average_value_size": 176, "num_data_blocks": 465, "num_entries": 13406, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "6482", "kMergeOperands": "71"}}
2018-07-09 15:13:59.929 7f31359411c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.0/rpm/el7/BUILD/ceph-13.2.0/src/rocksdb/db/version_set.cc:2863] Creating manifest 269
2018-07-09 15:13:59.930 7f31359411c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1531142039932239, "job": 1, "event": "recovery_finished"}
2018-07-09 15:13:59.933 7f31359411c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.0/rpm/el7/BUILD/ceph-13.2.0/src/rocksdb/db/db_impl_open.cc:1218] DB pointer 0x5595598c4000
2018-07-09 15:13:59.933 7f31359411c0 1 bluestore(/var/lib/ceph/osd/ceph-2) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152
2018-07-09 15:13:59.933 7f311cf87700 3 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.0/rpm/el7/BUILD/ceph-13.2.0/src/rocksdb/db/db_impl.cc:490] ------- DUMPING STATS -------
2018-07-09 15:13:59.933 7f311cf87700 3 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.0/rpm/el7/BUILD/ceph-13.2.0/src/rocksdb/db/db_impl.cc:491]
** DB Stats **
Uptime(secs): 3.2 total, 3.2 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
...
>
> John
>
>> # ceph --version
>> ceph version 13.2.0 (79a10589f1f80dfe21e8f9794365ed98143071c4) mimic (stable)
>> # cat /etc/centos-release
>> CentOS Linux release 7.5.1804 (Core)
>> # uname -r
>> 3.10.0-862.3.3.el7.x86_64
>>
>> /Steffen
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@xxxxxxxxxxxxxx
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
