All other OSDs that I converted (#60-69) look basically identical while the Filestore OSDs (/var/lib/ceph/osd/ceph-70 etc.) look different obviously. When I run "df" it does NOT list those converted osds (only the Filestore ones). In other words, /dev/sdh1 where osd.60 should be is not listed. (Should it be?) Neither does mount lists that drive. ("df | grep sdh" and "mount | grep sdh" both return nothing)
On Tue, Nov 6, 2018 at 10:42 AM, Hector Martin <hector@xxxxxxxxxxxxxx> wrote:
On 11/7/18 12:30 AM, Hayashida, Mami wrote:
> So, currently this is what /var/lib/ceph/osd/ceph-60 shows. Is it not
> correct? I don't know what I should expect to see.
>
> root@osd1:~# ls -l /var/lib/ceph/osd/ceph-60
> total 86252
> -rw-r--r-- 1 ceph ceph 384 Nov 2 16:20 activate.monmap
> -rw-r--r-- 1 ceph ceph 10737418240 Nov 5 16:32 block
> lrwxrwxrwx 1 ceph ceph 14 Nov 2 16:20 block.db -> /dev/ssd0/db60
> -rw-r--r-- 1 ceph ceph 2 Nov 2 16:20 bluefs
> -rw-r--r-- 1 ceph ceph 37 Nov 2 16:20 ceph_fsid
> -rw-r--r-- 1 ceph ceph 37 Nov 2 16:20 fsid
> -rw------- 1 ceph ceph 57 Nov 2 16:20 keyring
> -rw-r--r-- 1 ceph ceph 8 Nov 2 16:20 kv_backend
> -rw-r--r-- 1 ceph ceph 21 Nov 2 16:20 magic
> -rw-r--r-- 1 ceph ceph 4 Nov 2 16:20 mkfs_done
> -rw-r--r-- 1 ceph ceph 41 Nov 2 16:20 osd_key
> -rw-r--r-- 1 ceph ceph 6 Nov 2 16:20 ready
> -rw-r--r-- 1 ceph ceph 10 Nov 2 16:20 type
> -rw-r--r-- 1 ceph ceph 3 Nov 2 16:20 whoami
Are all the other OSDs like this? What is mounted on those directories
(i.e. what do "df" and "mount" show)?
All those files are dated Nov 2, yet it should be a tmpfs and you
rebooted after that date, so I think something's wrong here.
> The disk I am using for this osd (osd.60) is a 3.7TB hdd.
>
> lsblk shows
>
> sdh 8:112 0 3.7T 0 disk
> └─hdd60-data60 252:1 0 3.7T 0 lvm
>
> and "ceph osd tree" shows
> 60 hdd 3.63689 osd.60 up 1.00000 1.00000
That looks correct as far as the weight goes, but I'm really confused as
to why you have a 10GB "block" file. That should be a symlink to the
hdd60/data60 device as far as I know.
Mami Hayashida
Research Computing Associate
Research Computing Infrastructure
University of Kentucky Information Technology Services
301 Rose Street | 102 James F. Hardymon Building
Lexington, KY 40506-0495
mami.hayashida@xxxxxxx
(859)323-7521
University of Kentucky Information Technology Services
301 Rose Street | 102 James F. Hardymon Building
Lexington, KY 40506-0495
mami.hayashida@xxxxxxx
(859)323-7521
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
