Re: osd wasn't marked as down/out when it's storage folder was deleted

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



It is actually not part of ceph.

For some files under the folder, they are only access during OSD booting up, so removal would not cause a problem there. For some other files, OSD would keep a open handle, in which case, even you remove those files from within filesystem, they are not erased as there is still a handle point to it (like hard link).

________________________________
> From: kane.isturm@xxxxxxxxx 
> Date: Mon, 7 Dec 2015 14:01:26 -0800 
> To: ceph-users@xxxxxxxxxxxxxx 
> Subject:  osd wasn't marked as down/out when it's storage 
> folder was deleted 
> 
> I've deleted: 
> rm -rf /var/lib/ceph/osd/ceph-0/current 
> 
> folder but looks like ceph never noticed that: 
> ceph osd df 
> ID WEIGHT REWEIGHT SIZE USE AVAIL %USE VAR PGS 
> 4 0.09270 1.00000 97231M 54661M 42570M 56.22 1.34 95 
> 0 0.09270 1.00000 97231M 139M 97091M 0.14 0.00 69 
> 5 0.09270 1.00000 97231M 42603M 54627M 43.82 1.05 73 
> 1 0.09270 1.00000 97231M 51950M 45280M 53.43 1.28 91 
> 6 0.09270 1.00000 97231M 50656M 46575M 52.10 1.25 88 
> 2 0.09270 1.00000 97231M 43896M 53334M 45.15 1.08 76 
> TOTAL 569G 238G 331G 41.81 
> MIN/MAX VAR: 0.00/1.34 STDDEV: 19.15 
> 
> ceph -w: 
> health HEALTH_OK 
> 
> Waited approximately an hour and it never reported warning, nor copied 
> data back. 
> OSD log constantly filled with: 
> 2015-12-07 15:31:06.096017 7f007505d700 -1 
> filestore(/var/lib/ceph/osd/ceph-0) could not find 
> 1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head in index: (2) No 
> such file or directory 
> 2015-12-07 15:31:06.096023 7f007505d700 0 
> filestore(/var/lib/ceph/osd/ceph-0) write couldn't open 
> 1.4f_head/1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head: (2) 
> No such file or directory 
> 2015-12-07 15:31:06.096044 7f007505d700 -1 
> filestore(/var/lib/ceph/osd/ceph-0) could not find 
> 1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head in index: (2) No 
> such file or directory 
> 2015-12-07 15:31:06.249584 7f007585e700 -1 
> filestore(/var/lib/ceph/osd/ceph-0) could not find 
> 1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head in index: (2) No 
> such file or directory 
> 2015-12-07 15:31:06.249641 7f007585e700 -1 
> filestore(/var/lib/ceph/osd/ceph-0) could not find 
> 1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head in index: (2) No 
> such file or directory 
> 2015-12-07 15:31:06.249653 7f007585e700 0 
> filestore(/var/lib/ceph/osd/ceph-0) write couldn't open 
> 1.4f_head/1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head: (2) 
> No such file or directory 
> 2015-12-07 15:31:06.249692 7f007585e700 -1 
> filestore(/var/lib/ceph/osd/ceph-0) could not find 
> 1/08ce93cf/rbd_data.853f1f358346.00000000000013ca/head in index: (2) No 
> such file or directory 
> 
> Is it a bug or intended behavior? 
> 
> _______________________________________________ ceph-users mailing list 
> ceph-users@xxxxxxxxxxxxxx 
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com 
 		 	   		  
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux