Found some bad stuff in the messages file about SCSI block device fails… I think I found my smoking gun…
-B From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx]
On Behalf Of Bryan Banister Note: External Email Hi all, Not sure what to do with this down OSD: -2> 2017-08-29 16:55:34.588339 7ffff2d58700 1 -- 7.128.13.57:6979/18818 --> 7.128.13.55:0/52877 -- osd_ping(ping_reply e935 stamp 2017-08-29 16:55:34.587991) v4 -- 0x555567397000
con 0 -1> 2017-08-29 16:55:34.588351 7ffff2557700 1 -- 7.128.13.57:6978/18818 --> 7.128.13.55:0/52877 -- osd_ping(ping_reply e935 stamp 2017-08-29 16:55:34.587991) v4 -- 0x555567395000
con 0 0> 2017-08-29 16:55:34.650061 7fffecd93700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.1.4/rpm/el7/BUILD/ceph-12.1.4/src/os/bluestore/KernelDevice.cc:
In function 'void KernelDevice::_aio_thread()' thread 7fffecd93700 time 2017-08-29 16:55:34.648642 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.1.4/rpm/el7/BUILD/ceph-12.1.4/src/os/bluestore/KernelDevice.cc:
372: FAILED assert(r >= 0) ceph version 12.1.4 (a5f84b37668fc8e03165aaf5cbb380c78e4deba4) luminous (rc) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x555555fb4420] 2: (KernelDevice::_aio_thread()+0x4b5) [0x555555f59ce5] 3: (KernelDevice::AioCompletionThread::entry()+0xd) [0x555555f5e3cd] 4: (()+0x7dc5) [0x7ffff5635dc5] 5: (clone()+0x6d) [0x7ffff472a73d] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context [snip] Any help with recovery would be greatly appreciated, thanks! -Bryan
Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you are hereby notified that any review, dissemination or copying of this email is strictly prohibited, and to please notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request or solicitation of any kind to buy, sell, subscribe, redeem or perform any type of transaction of a financial product. |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com