答复: Can't delete file in cephfs with "No space left on device"

周威 <choury@xxxxxx> · Tue, 26 Dec 2017 03:42:47 +0000

The out put of ceph osd df

ID WEIGHT  REWEIGHT SIZE   USE    AVAIL  %USE  VAR  PGS
0 1.62650  1.00000  1665G  1279G   386G 76.82 1.05 343
1 1.62650  1.00000  1665G  1148G   516G 68.97 0.94 336
2 1.62650  1.00000  1665G  1253G   411G 75.27 1.03 325
3 1.62650  1.00000  1665G  1192G   472G 71.60 0.98 325
4 1.62650  1.00000  1665G  1205G   460G 72.35 0.99 341
5 1.62650  1.00000  1665G  1381G   283G 82.95 1.13 364
6 1.62650  1.00000  1665G  1069G   595G 64.22 0.88 322
7 1.62650  1.00000  1665G  1222G   443G 73.38 1.00 337
8 1.62650  1.00000  1665G  1120G   544G 67.29 0.92 312
9 1.62650  1.00000  1665G  1166G   498G 70.04 0.96 336
10 1.62650  1.00000  1665G  1254G   411G 75.31 1.03 348
11 1.62650  1.00000  1665G  1352G   313G 81.19 1.11 341
12 1.62650  1.00000  1665G  1174G   490G 70.52 0.96 328
13 1.62650  1.00000  1665G  1281G   383G 76.95 1.05 345
14 1.62650  1.00000  1665G  1147G   518G 68.88 0.94 339
15 1.62650  1.00000  1665G  1236G   429G 74.24 1.01 334
20 1.62650  1.00000  1665G  1166G   499G 70.03 0.96 325
21 1.62650  1.00000  1665G  1371G   293G 82.35 1.13 377
22 1.62650  1.00000  1665G  1110G   555G 66.67 0.91 341
23 1.62650  1.00000  1665G  1221G   443G 73.36 1.00 327
16 1.62650  1.00000  1665G  1354G   310G 81.34 1.11 352
17 1.62650  1.00000  1665G  1250G   415G 75.06 1.03 341
18 1.62650  1.00000  1665G  1179G   486G 70.80 0.97 316
19 1.62650  1.00000  1665G  1236G   428G 74.26 1.01 333
24 1.62650  1.00000  1665G  1146G   518G 68.86 0.94 325
25 1.62650  1.00000  1665G  1033G   632G 62.02 0.85 309
26 1.62650  1.00000  1665G  1234G   431G 74.11 1.01 334
27 1.62650  1.00000  1665G  1342G   322G 80.62 1.10 352
              TOTAL 46635G 34135G 12500G 73.20
MIN/MAX VAR: 0.85/1.13  STDDEV: 5.28

发件人: Cary [mailto:dynamic.cary@xxxxxxxxx]

发送时间: 2017年12月26日 11:40

收件人: ? ? <choury@xxxxxx>

抄送: ceph-users@xxxxxxxxxxxxxx

主题: Re: [ceph-users] Can't delete file in cephfs with "No space left on device"

Could you post the output of “ceph osd df”?

On Dec 25, 2017, at 19:46, ? ? <choury@xxxxxx> wrote:

Hi all:

Ceph version:

ceph version 10.2.9 (2ee413f77150c0f375ff6f10edd6c8f9c7d060d0)

Ceph df:
GLOBAL:
    SIZE       AVAIL      RAW USED     %RAW USED
46635G     12500G       34135G         73.19

rm ddddd
rm: cannot remove `ddddd': No space left on device

and mds_cache:
{
    "mds_cache": {
        "num_strays": 999713,
        "num_strays_purging": 0,
        "num_strays_delayed": 0,
        "num_purge_ops": 0,
        "strays_created": 999723,
        "strays_purged": 10,
        "strays_reintegrated": 0,
        "strays_migrated": 0,
        "num_recovering_processing": 0,
        "num_recovering_enqueued": 0,
        "num_recovering_prioritized": 0,
        "recovery_started": 107,
        "recovery_completed": 107
    }
}

It seems starys num are stuck, what should I do?
Thanks all.

_______________________________________________

ceph-users mailing list

ceph-users@xxxxxxxxxxxxxx

http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com