> Is this useful for someone? Yes! See http://tracker.ceph.com/issues/21259 The latest luminous branch (which you can get from https://shaman.ceph.com/builds/ceph/luminous/) has some additional debugging on OSD shutdown that should help me figure out what is causing this. If this is something you can reproduce on your cluster, please install the latest luminous and set 'osd debug shutdown = true' in the [osd] section of your config, and then ceph-post-file the log after a Don't know fix backported or not to 12.2.2, but today one of osd: Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: *** Caught signal (Segmentation fault) ** Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: in thread 7f8f44b72700 thread_name:bstore_mempool Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable) Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 1: (()+0xa339e1) [0x5629c08799e1] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 2: (()+0xf5e0) [0x7f8f4f63a5e0] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 3: (BlueStore::TwoQCache::_trim(unsigned long, unsigned long)+0x2df) [0x5629c074665f] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 4: (BlueStore::Cache::trim(unsigned long, float, float, float)+0x1d1) [0x5629c0718d71] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 5: (BlueStore::MempoolThread::entry()+0x14d) [0x5629c071f4ad] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 6: (()+0x7e25) [0x7f8f4f632e25] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 7: (clone()+0x6d) [0x7f8f4e72634d] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 2017-12-15 06:23:57.714362 7f8f44b72700 -1 *** Caught signal (Segmentation fault) ** Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: in thread 7f8f44b72700 thread_name:bstore_mempool Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable) Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 1: (()+0xa339e1) [0x5629c08799e1] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 2: (()+0xf5e0) [0x7f8f4f63a5e0] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 3: (BlueStore::TwoQCache::_trim(unsigned long, unsigned long)+0x2df) [0x5629c074665f] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 4: (BlueStore::Cache::trim(unsigned long, float, float, float)+0x1d1) [0x5629c0718d71] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 5: (BlueStore::MempoolThread::entry()+0x14d) [0x5629c071f4ad] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 6: (()+0x7e25) [0x7f8f4f632e25] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 7: (clone()+0x6d) [0x7f8f4e72634d] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 0> 2017-12-15 06:23:57.714362 7f8f44b72700 -1 *** Caught signal (Segmentation fault) ** Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: in thread 7f8f44b72700 thread_name:bstore_mempool Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: ceph version 12.2.2 (cf0baeeeeba3b47f9427c6c97e2144b094b7e5ba) luminous (stable) Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 1: (()+0xa339e1) [0x5629c08799e1] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 2: (()+0xf5e0) [0x7f8f4f63a5e0] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 3: (BlueStore::TwoQCache::_trim(unsigned long, unsigned long)+0x2df) [0x5629c074665f] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 4: (BlueStore::Cache::trim(unsigned long, float, float, float)+0x1d1) [0x5629c0718d71] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 5: (BlueStore::MempoolThread::entry()+0x14d) [0x5629c071f4ad] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 6: (()+0x7e25) [0x7f8f4f632e25] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: 7: (clone()+0x6d) [0x7f8f4e72634d] Dec 15 06:23:57 ceph-osd0 ceph-osd[89499]: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. k |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com