Hi,
I have no problem with my cluster before but when upgraded from 15.2.11 to
16.2.0 one of my ceph monitor service does not work. I have looked at the
service log but cant figure it out.
Can someone have any idea what could be wrong with that monitor service?
Here is the service attached log.
Regards
root@ceph100:~# ceph orch ps
NAME HOST STATUS REFRESHED AGE PORTS
VERSION IMAGE ID CONTAINER ID
alertmanager.ceph100 ceph100 running (102m) 7m ago 3d -
0.20.0 0881eb8f169f b62ac302b319
crash.ceph100 ceph100 running (102m) 7m ago 3d -
16.2.0 24ecd6d5f14c e786dc48b429
crash.ceph101 ceph101 running (99m) 5m ago 3d -
16.2.0 24ecd6d5f14c a2cefd673a5f
crash.ceph102 ceph102 running (101m) 7m ago 3d -
16.2.0 24ecd6d5f14c f9f8a337ba43
grafana.ceph100 ceph100 running (102m) 7m ago 3d -
6.7.4 80728b29ad3f 60381a67b6a2
mgr.ceph100.abnyjw ceph100 running (102m) 7m ago 3d *:8443
*:9283 16.2.1 c757e4a3636b 67f98b3ad44d
mgr.ceph102.qqcrik ceph102 running (101m) 7m ago 8h *:8443
*:9283 16.2.1 c757e4a3636b 00a6eeb2a9eb
mon.ceph100 ceph100 running (102m) 7m ago 3d -
16.2.0 24ecd6d5f14c 6bce0a137567
mon.ceph101 ceph101 stopped 5m ago 3d -
<unknown> <unknown> <unknown>
mon.ceph102 ceph102 running (101m) 7m ago 3d -
16.2.0 24ecd6d5f14c 9ca0e1c7ecd9
node-exporter.ceph100 ceph100 running (102m) 7m ago 3d -
0.18.1 e5a616e4b9cf b8ae7aa0fae1
node-exporter.ceph101 ceph101 running (99m) 5m ago 3d -
0.18.1 e5a616e4b9cf 945cdd081979
node-exporter.ceph102 ceph102 running (101m) 7m ago 3d -
0.18.1 e5a616e4b9cf d9a967358fbe
osd.0 ceph100 running (101m) 7m ago 3d -
16.2.0 24ecd6d5f14c 8f74ba97c27e
osd.1 ceph100 running (101m) 7m ago 3d -
16.2.0 24ecd6d5f14c fe0eed6a2cf4
osd.2 ceph101 running (99m) 5m ago 3d -
16.2.0 24ecd6d5f14c 1fd53036a139
osd.3 ceph101 running (99m) 5m ago 3d -
16.2.0 24ecd6d5f14c 329496f3a03e
osd.4 ceph102 running (101m) 7m ago 3d -
16.2.0 24ecd6d5f14c cb16b76f0fc4
osd.5 ceph102 running (101m) 7m ago 3d -
16.2.0 24ecd6d5f14c c5d4e56812af
prometheus.ceph100 ceph100 running (102m) 7m ago 3d -
2.18.1 de242295e225 b3f1c51d7136
Apr 24 15:56:55 ceph101 systemd[1]: Started Ceph mon.ceph101 for 8432e37e-a22a-11eb-8d4f-c907e64b5aa7.
Apr 24 15:56:55 ceph101 bash[5664]: WARNING: Error loading config file: .dockercfg: $HOME is not defined
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.266+0000 7fab02f78700 0 set uid:gid to 167:167 (ceph:ceph)
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.266+0000 7fab02f78700 0 ceph version 16.2.0 (0c2054e95bcd9b30fdd908a79ac1d8bbc3394442) pacific (stable), process ceph-mon, pid 7
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.266+0000 7fab02f78700 0 pidfile_write: ignore empty --pid-file
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 0 load: jerasure load: lrc load: isa
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: RocksDB version: 6.8.1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Compile date Mar 30 2021
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: DB SUMMARY
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: CURRENT file: CURRENT
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: IDENTITY file: IDENTITY
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: MANIFEST file: MANIFEST-002525 size: 221 Bytes
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-ceph101/store.db dir, Total Num: 2, files: 002462.sst 002464.sst
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-ceph101/store.db: 002526.log size: 0 ;
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.error_if_exists: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.create_if_missing: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.paranoid_checks: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.env: 0x559c241171c0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.fs: Posix File System
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.info_log: 0x559c253c7220
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_file_opening_threads: 16
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.statistics: (nil)
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.use_fsync: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_log_file_size: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_manifest_file_size: 1073741824
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.log_file_time_to_roll: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.keep_log_file_num: 1000
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.recycle_log_file_num: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.allow_fallocate: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.allow_mmap_reads: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.allow_mmap_writes: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.use_direct_reads: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.create_missing_column_families: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.db_log_dir:
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-ceph101/store.db
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.table_cache_numshardbits: 6
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_subcompactions: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_background_flushes: -1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.WAL_ttl_seconds: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.WAL_size_limit_MB: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.manifest_preallocation_size: 4194304
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.is_fd_close_on_exec: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.advise_random_on_open: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.db_write_buffer_size: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.write_buffer_manager: 0x559c2545de90
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.access_hint_on_compaction_start: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.random_access_max_buffer_size: 1048576
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.use_adaptive_mutex: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.rate_limiter: (nil)
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.wal_recovery_mode: 2
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.enable_thread_tracking: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.enable_pipelined_write: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.unordered_write: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.allow_concurrent_memtable_write: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.write_thread_max_yield_usec: 100
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.write_thread_slow_yield_usec: 3
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.row_cache: None
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.wal_filter: None
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.avoid_flush_during_recovery: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.allow_ingest_behind: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.preserve_deletes: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.two_write_queues: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.manual_wal_flush: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.atomic_flush: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.persist_stats_to_disk: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.write_dbid_to_manifest: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.log_readahead_size: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.sst_file_checksum_func: Unknown
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_background_jobs: 2
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_background_compactions: -1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.avoid_flush_during_shutdown: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.delayed_write_rate : 16777216
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_total_wal_size: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.stats_dump_period_sec: 600
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.stats_persist_period_sec: 600
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.stats_history_buffer_size: 1048576
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_open_files: -1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.bytes_per_sync: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.wal_bytes_per_sync: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.strict_bytes_per_sync: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_readahead_size: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Compression algorithms supported:
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: kZSTDNotFinalCompression supported: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: kZSTD supported: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: kXpressCompression supported: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: kLZ4HCCompression supported: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: kLZ4Compression supported: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: kBZip2Compression supported: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: kZlibCompression supported: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: kSnappyCompression supported: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Fast CRC32 supported: Not supported on x86
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-ceph101/store.db/MANIFEST-002525
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]:
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.merge_operator:
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_filter: None
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_filter_factory: None
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.memtable_factory: SkipListFactory
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.table_factory: BlockBasedTable
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559c2536a0d8)
Apr 24 15:56:57 ceph101 bash[5664]: cache_index_and_filter_blocks: 1
Apr 24 15:56:57 ceph101 bash[5664]: cache_index_and_filter_blocks_with_high_priority: 0
Apr 24 15:56:57 ceph101 bash[5664]: pin_l0_filter_and_index_blocks_in_cache: 0
Apr 24 15:56:57 ceph101 bash[5664]: pin_top_level_index_and_filter: 1
Apr 24 15:56:57 ceph101 bash[5664]: index_type: 0
Apr 24 15:56:57 ceph101 bash[5664]: data_block_index_type: 0
Apr 24 15:56:57 ceph101 bash[5664]: index_shortening: 1
Apr 24 15:56:57 ceph101 bash[5664]: data_block_hash_table_util_ratio: 0.750000
Apr 24 15:56:57 ceph101 bash[5664]: hash_index_allow_collision: 1
Apr 24 15:56:57 ceph101 bash[5664]: checksum: 1
Apr 24 15:56:57 ceph101 bash[5664]: no_block_cache: 0
Apr 24 15:56:57 ceph101 bash[5664]: block_cache: 0x559c253a2f10
Apr 24 15:56:57 ceph101 bash[5664]: block_cache_name: BinnedLRUCache
Apr 24 15:56:57 ceph101 bash[5664]: block_cache_options:
Apr 24 15:56:57 ceph101 bash[5664]: capacity : 536870912
Apr 24 15:56:57 ceph101 bash[5664]: num_shard_bits : 4
Apr 24 15:56:57 ceph101 bash[5664]: strict_capacity_limit : 0
Apr 24 15:56:57 ceph101 bash[5664]: high_pri_pool_ratio: 0.000
Apr 24 15:56:57 ceph101 bash[5664]: block_cache_compressed: (nil)
Apr 24 15:56:57 ceph101 bash[5664]: persistent_cache: (nil)
Apr 24 15:56:57 ceph101 bash[5664]: block_size: 4096
Apr 24 15:56:57 ceph101 bash[5664]: block_size_deviation: 10
Apr 24 15:56:57 ceph101 bash[5664]: block_restart_interval: 16
Apr 24 15:56:57 ceph101 bash[5664]: index_block_restart_interval: 1
Apr 24 15:56:57 ceph101 bash[5664]: metadata_block_size: 4096
Apr 24 15:56:57 ceph101 bash[5664]: partition_filters: 0
Apr 24 15:56:57 ceph101 bash[5664]: use_delta_encoding: 1
Apr 24 15:56:57 ceph101 bash[5664]: filter_policy: rocksdb.BuiltinBloomFilter
Apr 24 15:56:57 ceph101 bash[5664]: whole_key_filtering: 1
Apr 24 15:56:57 ceph101 bash[5664]: verify_compression: 0
Apr 24 15:56:57 ceph101 bash[5664]: read_amp_bytes_per_bit: 0
Apr 24 15:56:57 ceph101 bash[5664]: format_version: 2
Apr 24 15:56:57 ceph101 bash[5664]: enable_index_compression: 1
Apr 24 15:56:57 ceph101 bash[5664]: block_align: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.write_buffer_size: 33554432
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_write_buffer_number: 2
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compression: NoCompression
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.bottommost_compression: Disabled
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.prefix_extractor: nullptr
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.num_levels: 7
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.bottommost_compression_opts.level: 32767
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.bottommost_compression_opts.enabled: false
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compression_opts.window_bits: -14
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compression_opts.level: 32767
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compression_opts.strategy: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compression_opts.enabled: false
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.level0_stop_writes_trigger: 36
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.target_file_size_base: 67108864
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.target_file_size_multiplier: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_bytes_for_level_base: 268435456
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_compaction_bytes: 1677721600
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.arena_block_size: 4194304
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.disable_auto_compactions: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.table_properties_collectors:
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.inplace_update_support: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.inplace_update_num_locks: 10000
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.memtable_whole_key_filtering: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.memtable_huge_page_size: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.bloom_locality: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.max_successive_merges: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.optimize_filters_for_hits: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.paranoid_file_checks: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.force_consistency_checks: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.report_bg_io_stats: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.ttl: 2592000
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.274+0000 7fab02f78700 4 rocksdb: Options.periodic_compaction_seconds: 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.278+0000 7fab02f78700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-ceph101/store.db/MANIFEST-002525 succeeded,manifest_file_number is 2525, next_file_number is 2527, last_sequence is 1217434, log_number is 2524,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.278+0000 7fab02f78700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 2524
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.278+0000 7fab02f78700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1619269017281199, "job": 1, "event": "recovery_started", "log_files": [2526]}
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.278+0000 7fab02f78700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #2526 mode 2
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.278+0000 7fab02f78700 4 rocksdb: [version_set.cc:3826] Creating manifest 2528
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.386+0000 7fab02f78700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1619269017389964, "job": 1, "event": "recovery_finished"}
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.438+0000 7fab02f78700 4 rocksdb: DB pointer 0x559c25467800
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.438+0000 7faae9d92700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS -------
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.438+0000 7faae9d92700 4 rocksdb: [db_impl/db_impl.cc:851]
Apr 24 15:56:57 ceph101 bash[5664]: ** DB Stats **
Apr 24 15:56:57 ceph101 bash[5664]: Uptime(secs): 0.2 total, 0.2 interval
Apr 24 15:56:57 ceph101 bash[5664]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Apr 24 15:56:57 ceph101 bash[5664]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Apr 24 15:56:57 ceph101 bash[5664]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Apr 24 15:56:57 ceph101 bash[5664]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Apr 24 15:56:57 ceph101 bash[5664]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
Apr 24 15:56:57 ceph101 bash[5664]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent
Apr 24 15:56:57 ceph101 bash[5664]: ** Compaction Stats [default] **
Apr 24 15:56:57 ceph101 bash[5664]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
Apr 24 15:56:57 ceph101 bash[5664]: ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Apr 24 15:56:57 ceph101 bash[5664]: L0 1/0 6.01 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
Apr 24 15:56:57 ceph101 bash[5664]: L6 1/0 34.30 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
Apr 24 15:56:57 ceph101 bash[5664]: Sum 2/0 40.31 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
Apr 24 15:56:57 ceph101 bash[5664]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
Apr 24 15:56:57 ceph101 bash[5664]: ** Compaction Stats [default] **
Apr 24 15:56:57 ceph101 bash[5664]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
Apr 24 15:56:57 ceph101 bash[5664]: -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Apr 24 15:56:57 ceph101 bash[5664]: Uptime(secs): 0.2 total, 0.2 interval
Apr 24 15:56:57 ceph101 bash[5664]: Flush(GB): cumulative 0.000, interval 0.000
Apr 24 15:56:57 ceph101 bash[5664]: AddFile(GB): cumulative 0.000, interval 0.000
Apr 24 15:56:57 ceph101 bash[5664]: AddFile(Total Files): cumulative 0, interval 0
Apr 24 15:56:57 ceph101 bash[5664]: AddFile(L0 Files): cumulative 0, interval 0
Apr 24 15:56:57 ceph101 bash[5664]: AddFile(Keys): cumulative 0, interval 0
Apr 24 15:56:57 ceph101 bash[5664]: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Apr 24 15:56:57 ceph101 bash[5664]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Apr 24 15:56:57 ceph101 bash[5664]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Apr 24 15:56:57 ceph101 bash[5664]: ** File Read Latency Histogram By Level [default] **
Apr 24 15:56:57 ceph101 bash[5664]: ** Compaction Stats [default] **
Apr 24 15:56:57 ceph101 bash[5664]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
Apr 24 15:56:57 ceph101 bash[5664]: ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Apr 24 15:56:57 ceph101 bash[5664]: L0 1/0 6.01 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
Apr 24 15:56:57 ceph101 bash[5664]: L6 1/0 34.30 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
Apr 24 15:56:57 ceph101 bash[5664]: Sum 2/0 40.31 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
Apr 24 15:56:57 ceph101 bash[5664]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
Apr 24 15:56:57 ceph101 bash[5664]: ** Compaction Stats [default] **
Apr 24 15:56:57 ceph101 bash[5664]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
Apr 24 15:56:57 ceph101 bash[5664]: -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Apr 24 15:56:57 ceph101 bash[5664]: Uptime(secs): 0.2 total, 0.0 interval
Apr 24 15:56:57 ceph101 bash[5664]: Flush(GB): cumulative 0.000, interval 0.000
Apr 24 15:56:57 ceph101 bash[5664]: AddFile(GB): cumulative 0.000, interval 0.000
Apr 24 15:56:57 ceph101 bash[5664]: AddFile(Total Files): cumulative 0, interval 0
Apr 24 15:56:57 ceph101 bash[5664]: AddFile(L0 Files): cumulative 0, interval 0
Apr 24 15:56:57 ceph101 bash[5664]: AddFile(Keys): cumulative 0, interval 0
Apr 24 15:56:57 ceph101 bash[5664]: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Apr 24 15:56:57 ceph101 bash[5664]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Apr 24 15:56:57 ceph101 bash[5664]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Apr 24 15:56:57 ceph101 bash[5664]: ** File Read Latency Histogram By Level [default] **
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.442+0000 7fab02f78700 0 starting mon.ceph101 rank 1 at public addrs [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] at bind addrs [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] mon_data /var/lib/ceph/mon/ceph-ceph101 fsid 8432e37e-a22a-11eb-8d4f-c907e64b5aa7
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.442+0000 7fab02f78700 1 mon.ceph101@-1(???) e4 preinit fsid 8432e37e-a22a-11eb-8d4f-c907e64b5aa7
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.442+0000 7fab02f78700 0 mon.ceph101@-1(???).mds e1 new map
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.442+0000 7fab02f78700 0 mon.ceph101@-1(???).mds e1 print_map
Apr 24 15:56:57 ceph101 bash[5664]: e1
Apr 24 15:56:57 ceph101 bash[5664]: enable_multiple, ever_enabled_multiple: 0,0
Apr 24 15:56:57 ceph101 bash[5664]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
Apr 24 15:56:57 ceph101 bash[5664]: legacy client fscid: -1
Apr 24 15:56:57 ceph101 bash[5664]:
Apr 24 15:56:57 ceph101 bash[5664]: No filesystems configured
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.442+0000 7fab02f78700 0 mon.ceph101@-1(???).osd e242 crush map has features 3314933000852226048, adjusting msgr requires
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.442+0000 7fab02f78700 0 mon.ceph101@-1(???).osd e242 crush map has features 288514051259236352, adjusting msgr requires
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.442+0000 7fab02f78700 0 mon.ceph101@-1(???).osd e242 crush map has features 288514051259236352, adjusting msgr requires
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.442+0000 7fab02f78700 0 mon.ceph101@-1(???).osd e242 crush map has features 288514051259236352, adjusting msgr requires
Apr 24 15:56:57 ceph101 bash[5664]: audit 2021-04-23T05:13:35.679681+0000 mon.ceph100 (mon.0) 591 : audit [INF] from='mgr.344102 192.168.1.10:0/1824815913' entity='mgr.ceph100.abnyjw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1", "id": [3, 2]}]: dispatch
Apr 24 15:56:57 ceph101 bash[5664]: audit 2021-04-23T05:13:35.680734+0000 mon.ceph100 (mon.0) 592 : audit [INF] from='mgr.344102 192.168.1.10:0/1824815913' entity='mgr.ceph100.abnyjw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [1, 0]}]: dispatch
Apr 24 15:56:57 ceph101 bash[5664]: audit 2021-04-23T05:13:35.681445+0000 mon.ceph100 (mon.0) 593 : audit [INF] from='mgr.344102 192.168.1.10:0/1824815913' entity='mgr.ceph100.abnyjw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [3, 2]}]: dispatch
Apr 24 15:56:57 ceph101 bash[5664]: audit 2021-04-23T05:13:35.681965+0000 mon.ceph100 (mon.0) 594 : audit [INF] from='mgr.344102 192.168.1.10:0/1824815913' entity='mgr.ceph100.abnyjw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.17", "id": [1, 0]}]: dispatch
Apr 24 15:56:57 ceph101 bash[5664]: audit 2021-04-23T05:13:35.682453+0000 mon.ceph100 (mon.0) 595 : audit [INF] from='mgr.344102 192.168.1.10:0/1824815913' entity='mgr.ceph100.abnyjw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [1, 0]}]: dispatch
Apr 24 15:56:57 ceph101 bash[5664]: audit 2021-04-23T05:13:35.683087+0000 mon.ceph100 (mon.0) 596 : audit [INF] from='mgr.344102 192.168.1.10:0/1824815913' entity='mgr.ceph100.abnyjw' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1e", "id": [3, 2]}]: dispatch
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.442+0000 7fab02f78700 1 mon.ceph101@-1(???).paxosservice(auth 1..87) refresh upgraded, format 0 -> 3
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.450+0000 7fab02f78700 0 mon.ceph101@-1(probing) e4 my rank is now 1 (was -1)
Apr 24 15:56:57 ceph101 bash[5664]: debug 2021-04-24T12:56:57.454+0000 7faaec597700 0 mon.ceph101@1(probing) e5 removed from monmap, suicide.
Apr 24 15:56:59 ceph101 docker[5801]: WARNING: Error loading config file: .dockercfg: $HOME is not defined
Apr 24 15:56:59 ceph101 docker[5801]: Error response from daemon: No such container: ceph-8432e37e-a22a-11eb-8d4f-c907e64b5aa7-mon.ceph101
Apr 24 15:56:59 ceph101 systemd[1]: ceph-8432e37e-a22a-11eb-8d4f-c907e64b5aa7@mon.ceph101.service: Succeeded.
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
