On 11/6/18 6:03 AM, Hayashida, Mami wrote: > WOW. With you two guiding me through every step, the 10 OSDs in > question are now added back to the cluster as Bluestore disks!!! Here > are my responses to the last email from Hector: > > 1. I first checked the permissions and they looked like this > > root@osd1:/var/lib/ceph/osd/ceph-60# ls -l > total 56 > -rw-r--r-- 1 ceph ceph 384 Nov 2 16:20 activate.monmap > -rw-r--r-- 1 ceph ceph 10737418240 Nov 2 16:20 block > lrwxrwxrwx 1 ceph ceph 14 Nov 2 16:20 block.db -> /dev/ssd0/db60 Wait. That's not right, is it? That's a 10GB raw file being used as a BlueStore block device. It should be a symlink to an LVM volume, not a file. Can you check the `block` files/symlinks again for all the OSDs and also what is mounted on the OSD directories? It should be tmpfs directories with symlinks to block devices. I'm not sure what happened there. -- Hector Martin (hector@xxxxxxxxxxxxxx) Public Key: https://mrcn.st/pub _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |