Re: block.db linking to 2 disks

[Ashley Merrick <singapore@xxxxxxxxxxxxxx>]

So I was able to change the perms using :  chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block.db

However now I get the following when starting the OSD which then causes it to crash

 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-8/block size 8.9 TiB

    -1> 2019-02-25 15:03:51.990 7f26d4777240  1 bluefs mount

     0> 2019-02-25 15:03:52.006 7f26d4777240 -1 *** Caught signal (Segmentation fault) **

 in thread 7f26d4777240 thread_name:ceph-osd

 ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable)

 1: (()+0x9414c0) [0x55a8fc0b54c0]

 2: (()+0x12dd0) [0x7f26d5da8dd0]

 3: (BlueFS::_replay(bool, bool)+0x11ce) [0x55a8fc079e6e]

 4: (BlueFS::mount()+0xff) [0x55a8fc07d16f]

 5: (BlueStore::_open_db(bool, bool)+0x81c) [0x55a8fbfa9c3c]

 6: (BlueStore::_mount(bool, bool)+0x1a3) [0x55a8fbfd04a3]

 7: (OSD::init()+0x27d) [0x55a8fbbc250d]

 8: (main()+0x30a2) [0x55a8fba9ceb2]

 9: (__libc_start_main()+0xeb) [0x7f26d567a09b]

 10: (_start()+0x2a) [0x55a8fbb685aa]

 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

Not sure if this just means the bluefs is corrupt or something I can try and repair.

On Mon, Feb 25, 2019 at 10:15 AM Ashley Merrick <singapore@xxxxxxxxxxxxxx> wrote:

After a reboot of a node I have one particular OSD that won't boot. (Latest Mimic)

When I "/var/lib/ceph/osd/ceph-8 # ls -lsh"

I get "   0 lrwxrwxrwx 1 root root 19 Feb 25 02:09 block.db -> '/dev/sda5 /dev/sdc5'"

For some reasons it is trying to link block.db to two disks, if I remove the block.db link and manually create the correct link the OSD still fails to start due to the perms on block.db file being root:root.

If I run a chmod it just goes back to root:root and the following shows in the OSD logs

2019-02-25 02:03:21.738 7f574b2a1240 -1 bluestore(/var/lib/ceph/osd/ceph-8) _open_db /var/lib/ceph/osd/ceph-8/block.db symlink exists but target unusable: (13) Permission denied

2019-02-25 02:03:21.738 7f574b2a1240  1 bdev(0x55dbf0a56700 /var/lib/ceph/osd/ceph-8/block) close

2019-02-25 02:03:22.034 7f574b2a1240 -1 osd.8 0 OSD:init: unable to mount object store

2019-02-25 02:03:22.034 7f574b2a1240 -1  ** ERROR: osd init failed: (13) Permission denied

Thanks

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com