Hello, >>> I am using 0.94.5. When I try to umount partition and fsck it I have issue: >>> root@storage003:~# stop ceph-osd id=13 >>> ceph-osd stop/waiting >>> root@storage003:~# umount /var/lib/ceph/osd/ceph-13 >>> root@storage003:~# fsck -yf /dev/sdf >>> fsck from util-linux 2.20.1 >>> e2fsck 1.42.9 (4-Feb-2014) >>> /dev/sdf is in use. >>> e2fsck: Cannot continue, aborting. >>> >>> There is no /var/lib/ceph/osd/ceph-13 in /proc mounts. But no ability to check >>> fs. >>> I can mount -o remount,rw, but I would like to umount device for maintenance >>> and, maybe, replace it. >>> >>> Why I can't umount? > >> is "lsof -n | grep /dev/sdf" give something ? > > Nothing. > >> and are you sure /dev/sdf is the disk for osd 13 ? > > Absolutelly. I have even tried fsck -yf /dev/disk/by-label/osd-13. No luck. > > Disk is mounted using LABEL in fstab, journal is symlink to > /dev/disk/by-partlabel/j-13. I think it's more linux related. could you try to look with lsof if something hold the device by the label or uuid instead of /dev/sdf ? you can try to delete the device from the scsi bus with something like : echo 1 > /sys/block/<dev>/device/delete be careful, it is like removing the disk physically, if a process holds the device, you might expect that process gonna switch into kernel status "D+" . You won't be able to kill that process even by kill -9. To stop it, you will have to reboot the server. you can give a look here how to manipulate scsi bus: http://fibrevillage.com/storage/279-hot-add-remove-rescan-of-scsi-devices-on-linux you can install the package "scsitools" that provide rescan-scsi-bus.sh to rescan you scsi bus to get back your disk removed. http://manpages.ubuntu.com/manpages/precise/man8/rescan-scsi-bus.8.html hope that can help you -- Yoann Moulin EPFL IC-IT _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com