Hi,
On 11/10/2015 09:20 PM, Gregory Farnum wrote:
Can you dump the metadata ops in flight on each ceph-fuse when it hangs?
ceph daemon </var/run/ceph/client.whatever.asok> mds_requests
Current state: host A and host B blocked, both running ceph-fuse 0.94.5
(trusty package)
hostA mds_requests (client id 1265369):
{
"request": {
"tid": 20,
"op": "getattr",
"path": "#10002c4e840",
"path2": "",
"ino": "10002c4e840",
"hint_ino": "0",
"sent_stamp": "2015-11-11 15:15:40.109818",
"mds": 0,
"resend_mds": -1,
"send_to_auth": 0,
"sent_on_mseq": 0,
"retry_attempt": 1,
"got_unsafe": 0,
"uid": 0,
"gid": 0,
"oldest_client_tid": 20,
"mdsmap_epoch": 0,
"flags": 0,
"num_retry": 0,
"num_fwd": 0,
"num_releases": 0
}
}
hostB mds_requests (client id 1348375, also marked as failing to respond
to capability release):
{}
Excerpt of ceph log (ceph -w):
...
2015-11-11 15:16:10.293337 mds.0 [WRN] slow request 30.181451 seconds
old, received at 2015-11-11 15:15:40.111736:
client_request(client.1265369:20 getattr pAsLsXsFs #10002c4e840
2015-11-11 15:15:40.109816) currently failed to rdlock, waiting
...
2015-11-11 15:16:40.310519 mds.0 [WRN] client.1348375 isn't responding
to mclientcaps(revoke), ino 10002c4e840 pending pAsLsXsFr issued
pAsLsXsFscr, sent 60.200778 seconds ago
...
Regards,
Burkhard
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com