It is actually not part of ceph. For some files under the folder, they are only access during OSD booting up, so removal would not cause a problem there. For some other files, OSD would keep a open handle, in which case, even you remove those files from within filesystem, they are not erased as there is still a handle point to it (like hard link). ________________________________ > From: kane.isturm@xxxxxxxxx > Date: Mon, 7 Dec 2015 14:01:26 -0800 > To: ceph-users@xxxxxxxxxxxxxx > Subject: osd wasn't marked as down/out when it's storage > folder was deleted > > I've deleted: > rm -rf /var/lib/ceph/osd/ceph-0/current > > folder but looks like ceph never noticed that: > ceph osd df > ID WEIGHT REWEIGHT SIZE USE AVAIL %USE VAR PGS > 4 0.09270 1.00000 97231M 54661M 42570M 56.22 1.34 95 > 0 0.09270 1.00000 97231M 139M 97091M 0.14 0.00 69 > 5 0.09270 1.00000 97231M 42603M 54627M 43.82 1.05 73 > 1 0.09270 1.00000 97231M 51950M 45280M 53.43 1.28 91 > 6 0.09270 1.00000 97231M 50656M 46575M 52.10 1.25 88 > 2 0.09270 1.00000 97231M 43896M 53334M 45.15 1.08 76 > TOTAL 569G 238G 331G 41.81 > MIN/MAX VAR: 0.00/1.34 STDDEV: 19.15 > > ceph -w: > health HEALTH_OK > > Waited approximately an hour and it never reported warning, nor copied > data back. > OSD log constantly filled with: > 2015-12-07 15:31:06.096017 7f007505d700 -1 > filestore(/var/lib/ceph/osd/ceph-0) could not find > 1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head in index: (2) No > such file or directory > 2015-12-07 15:31:06.096023 7f007505d700 0 > filestore(/var/lib/ceph/osd/ceph-0) write couldn't open > 1.4f_head/1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head: (2) > No such file or directory > 2015-12-07 15:31:06.096044 7f007505d700 -1 > filestore(/var/lib/ceph/osd/ceph-0) could not find > 1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head in index: (2) No > such file or directory > 2015-12-07 15:31:06.249584 7f007585e700 -1 > filestore(/var/lib/ceph/osd/ceph-0) could not find > 1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head in index: (2) No > such file or directory > 2015-12-07 15:31:06.249641 7f007585e700 -1 > filestore(/var/lib/ceph/osd/ceph-0) could not find > 1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head in index: (2) No > such file or directory > 2015-12-07 15:31:06.249653 7f007585e700 0 > filestore(/var/lib/ceph/osd/ceph-0) write couldn't open > 1.4f_head/1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head: (2) > No such file or directory > 2015-12-07 15:31:06.249692 7f007585e700 -1 > filestore(/var/lib/ceph/osd/ceph-0) could not find > 1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head in index: (2) No > such file or directory > > Is it a bug or intended behavior? > > _______________________________________________ ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |