Multiple OSDs crashing constantly

[Scott Laird <scott@xxxxxxxxxxx>]

I'm having a problem with 0.87 on Ubuntu.  I created a cephfs filesystem on top of a 2,2 EC pool with a cache tier and copied a bunch of data (non-critical) onto it, and now 4 of my OSDs (on 3 physical servers) are crash-looping on startup.  If I stop one of the crashing OSDs, then a different OSD starts crashing.

I don't see anything useful in the OSD logs with debug osd = 20/20 and debug ms=20/20.  It stops logging and exits.

Here are the logs (500M before gzip): https://dl.dropboxusercontent.com/u/104949139/ceph-osd-22-v0.87-crashloop2.log.gz

Rebooting the cephfs client system seems to temporarily fix the problem, but attempting to remount cephfs causes OSDs to crash again.

Any suggestions on how to debug this?

Scott

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com