Hi, I’m fairly new to cephfs, on my new job there is a cephfs-cluster that I have to administer. The problem is, I can’t write from some clients to the cephfs-mount. When I try from the specific clients I get in the Logfile: >Apr 24 13:14:00 cuda002 kernel: ceph: mds0 hung >Apr 24 13:14:00 cuda002 kernel: ceph: mds0 caps stale >Apr 24 13:14:00 cuda002 kernel: ceph: mds0 came back >Apr 24 13:14:00 cuda002 kernel: ceph: mds0 caps still stale Restarting the mds doesn’t make any difference. >ceph –s Says: [root@cuda001:/var/log/ceph]# ceph -s cluster cde1487e-f930-417a-9403-28e9ebf406b8 health HEALTH_OK monmap e6: 1 mons at {cephcontrol=172.22.12.241:6789/0} election epoch 1, quorum 0 cephcontrol mdsmap e1574: 1/1/1 up {0=A1214-2950-01=up:active} osdmap e9571: 6 osds: 6 up, 6 in pgmap v11438317: 320 pgs, 3 pools, 20427 GB data, 7102 kobjects 62100 GB used, 52968 GB / 112 TB avail 319 active+clean 1 active+clean+scrubbing+deep So everything should be right, but it is not working. The only thing I found that is different to the other hosts is when I do:
> ceph daemon mds.A1214-2950-01 session ls On the working clients I get: { "id": 670317, "num_leases": 0, "num_caps": 35386, "state": "open", "replay_requests": 0, "reconnecting": false, "inst": "client.670317 172.22.7.52:0\/4290071627", "client_metadata": { "ceph_sha1": "mySHA1-ID", "ceph_version": "ceph version 0.94.9 (mySHA1-ID)", "entity_id": "admin", "hostname": "PE8", "mount_point": "\/cephfs01" } On the non-working clients it looks like: { "id": 670648, "num_leases": 0, "num_caps": 60, "state": "open", "replay_requests": 0, "reconnecting": false, "inst": "client.670648 172.22.20.5:0\/2770536198", "client_metadata": { "entity_id": "cephfs", "hostname": "slurmgate", "kernel_version": "3.10.0-514.16.1.el7.x86_64" } The biggest difference is, There are no ‘ceph_sha1’-Entrys, no ‘ceph_version’-Entrys also no ‘mount_point’ and the entity-id is also different. Could someone please shed some light upon me what I did wrong? The Guy who installed it, is no longer here and there is also no documentation. I just try to mount it per automount/autofs. If you need more info, just let me know. Thanks in Advance, Steininger Herbert |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com