Re: failing to respond to cache pressure

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Wido,
The server and client use the same version, 12.2.5. And the command shows:
# ceph versions
{
    "mon": {
        "ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable)": 3
    },
    "mgr": {
        "ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable)": 3
    },
    "osd": {
        "ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable)": 16
    },
    "mds": {
        "ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable)": 2
    },
    "overall": {
        "ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable)": 24
    }
}

# ceph features
{
    "mon": {
        "group": {
            "features": "0x1ffddff8eea4fffb",
            "release": "luminous",
            "num": 3
        }
    },
    "mds": {
        "group": {
            "features": "0x1ffddff8eea4fffb",
            "release": "luminous",
            "num": 2
        }
    },
    "osd": {
        "group": {
            "features": "0x1ffddff8eea4fffb",
            "release": "luminous",
            "num": 16
        }
    },
    "client": {
        "group": {
            "features": "0x107b84a842aca",
            "release": "hammer",
            "num": 2
        },
        "group": {
            "features": "0x40107b86a842ada",
            "release": "jewel",
            "num": 17
        },
        "group": {
            "features": "0x7010fb86aa42ada",
            "release": "jewel",
            "num": 3
        },
        "group": {
            "features": "0x7018fb86aa42ada",
            "release": "jewel",
            "num": 1
        },
        "group": {
            "features": "0x1ffddff8eea4fffb",
            "release": "luminous",
            "num": 4
        }
    }
}

# ceph fs status
cephfs - 19 clients
======
+------+--------+-----------+---------------+-------+-------+
| Rank | State  |    MDS    |    Activity   |  dns  |  inos |
+------+--------+-----------+---------------+-------+-------+
|  0   | active | ceph-mon1 | Reqs:    0 /s |  383k |  380k |
+------+--------+-----------+---------------+-------+-------+
+-------------+----------+-------+-------+
|     Pool    |   type   |  used | avail |
+-------------+----------+-------+-------+
| cephfs_meta | metadata |  213M | 2526G |
| cephfs_data |   data   | 1845G | 2526G |
+-------------+----------+-------+-------+

+-------------+
| Standby MDS |
+-------------+
|   ceph-mds  |
+-------------+
MDS version: ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable)



Wido den Hollander <wido@xxxxxxxx> 于2018年8月13日周一 下午10:14写道:


On 08/13/2018 01:22 PM, Zhenshi Zhou wrote:
> Hi,
> Recently, the cluster runs healthy, but I get warning messages everyday:
>

Which version of Ceph? Which version of clients?

Can you post:

$ ceph versions
$ ceph features
$ ceph fs status

Wido

> 2018-08-13 17:39:23.682213 [INF]  Cluster is now healthy
> 2018-08-13 17:39:23.682144 [INF]  Health check cleared:
> MDS_CLIENT_RECALL (was: 6 clients failing to respond to cache pressure)
> 2018-08-13 17:39:23.052022 [INF]  MDS health message cleared (mds.0):
> Client docker38:docker failing to respond to cache pressure
> 2018-08-13 17:39:23.051979 [INF]  MDS health message cleared (mds.0):
> Client docker73:docker failing to respond to cache pressure
> 2018-08-13 17:39:23.051934 [INF]  MDS health message cleared (mds.0):
> Client docker74:docker failing to respond to cache pressure
> 2018-08-13 17:39:23.051853 [INF]  MDS health message cleared (mds.0):
> Client docker75:docker failing to respond to cache pressure
> 2018-08-13 17:39:23.051815 [INF]  MDS health message cleared (mds.0):
> Client docker27:docker failing to respond to cache pressure
> 2018-08-13 17:39:23.051753 [INF]  MDS health message cleared (mds.0):
> Client docker27 failing to respond to cache pressure
> 2018-08-13 17:38:11.100331 [WRN]  Health check update: 6 clients failing
> to respond to cache pressure (MDS_CLIENT_RECALL)
> 2018-08-13 17:37:39.570014 [WRN]  Health check update: 5 clients failing
> to respond to cache pressure (MDS_CLIENT_RECALL)
> 2018-08-13 17:37:31.099418 [WRN]  Health check update: 3 clients failing
> to respond to cache pressure (MDS_CLIENT_RECALL)
> 2018-08-13 17:36:34.564345 [WRN]  Health check update: 1 clients failing
> to respond to cache pressure (MDS_CLIENT_RECALL)
> 2018-08-13 17:36:27.121891 [WRN]  Health check update: 3 clients failing
> to respond to cache pressure (MDS_CLIENT_RECALL)
> 2018-08-13 17:36:11.967531 [WRN]  Health check update: 5 clients failing
> to respond to cache pressure (MDS_CLIENT_RECALL)
> 2018-08-13 17:35:59.870055 [WRN]  Health check update: 6 clients failing
> to respond to cache pressure (MDS_CLIENT_RECALL)
> 2018-08-13 17:35:47.787323 [WRN]  Health check update: 3 clients failing
> to respond to cache pressure (MDS_CLIENT_RECALL)
> 2018-08-13 17:34:59.435933 [WRN]  Health check failed: 1 clients failing
> to respond to cache pressure (MDS_CLIENT_RECALL)
> 2018-08-13 17:34:59.045510 [WRN]  MDS health message (mds.0): Client
> docker75:docker failing to respond to cache pressure  
>
> How can I fix it?
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux