Re: Ceph OSD stuck in booting state

[George Shuklin <george.shuklin@xxxxxxxxx>]

Mount OSD data to temp. directory (e.g. /mnt) and check where journal pointing (ls -la /mnt/journal). It can lead to a different location from your "--osd-journal=" instruction to --mkjournal.

On 07/11/2016 05:46 PM, William Josefsson wrote:

Hi All,

Initially, I used /dev/disk/by-partuuid/xxxxxxx-xxxx-xxxx when make the journal for the OSD, i.e.

sudo ceph-osd -i 30 --mkjournal --osd-journal=/dev/disk/by-partuuid/2fe31ba2-1ac6-4729-9fdc-63432f50357

Then, I try to use /dev/sdx5 format and it works, i.e.
sudo ceph-osd -i 30 --mkjournal --osd-journal=/dev/sdc5

Does anyone knows why it doesn't work if I map the journal using /dev/disk/by-partuuid/xxx-xxx ?

Thanks.

On Mon, Jul 11, 2016 at 9:09 PM, William Josefsson <william.josefson@xxxxxxxxx> wrote:

Hi Everyone,

I have a problem with OSD stuck in booting state.

sudo ceph daemon osd.7 status
{
    "cluster_fsid": "724e501f-f4a3-4731-a832-c73685aabd21",
    "osd_fsid": "058cac6e-6c66-4eeb-865b-3d22f0e91a99",
    "whoami": 7,
    "state": "booting",
    "oldest_map": 1255,
    "newest_map": 2498,
    "num_pgs": 0
}

This is what I get in the log file /var/log/ceph/ceph.osd.7.log

2016-07-11 20:38:19.166607 7fb258077880  0 ceph version 0.94.7 (d56bdf93ced6b80b07397d57e3fa68fe68304432), process ceph-osd, pid 74882
2016-07-11 20:38:19.194663 7fb258077880  0 filestore(/var/lib/ceph/osd/ceph-7) backend xfs (magic 0x58465342)
2016-07-11 20:38:19.196561 7fb258077880  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-7) detect_features: FIEMAP ioctl is supported and appears to work
2016-07-11 20:38:19.196567 7fb258077880  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-7) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
2016-07-11 20:38:19.197649 7fb258077880  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-7) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
2016-07-11 20:38:19.197680 7fb258077880  0 xfsfilestorebackend(/var/lib/ceph/osd/ceph-7) detect_feature: extsize is disabled by conf
2016-07-11 20:38:19.199632 7fb258077880  0 filestore(/var/lib/ceph/osd/ceph-7) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
2016-07-11 20:38:19.202743 7fb258077880  1 journal _open /var/lib/ceph/osd/ceph-7/journal fd 20: 40010514432 bytes, block size 4096 bytes, directio = 1, aio = 1
2016-07-11 20:38:19.209391 7fb258077880  1 journal _open /var/lib/ceph/osd/ceph-7/journal fd 20: 40010514432 bytes, block size 4096 bytes, directio = 1, aio = 1
2016-07-11 20:38:19.210134 7fb258077880  0 <cls> cls/hello/cls_hello.cc:271: loading cls_hello
2016-07-11 20:38:19.218632 7fb258077880  0 osd.7 2498 crush map has features 1107558400, adjusting msgr requires for clients
2016-07-11 20:38:19.218644 7fb258077880  0 osd.7 2498 crush map has features 1107558400 was 8705, adjusting msgr requires for mons
2016-07-11 20:38:19.218652 7fb258077880  0 osd.7 2498 crush map has features 1107558400, adjusting msgr requires for osds
2016-07-11 20:38:19.218671 7fb258077880  0 osd.7 2498 load_pgs
2016-07-11 20:38:19.218706 7fb258077880  0 osd.7 2498 load_pgs opened 0 pgs
2016-07-11 20:38:19.219596 7fb258077880 -1 osd.7 2498 log_to_monitors {default=true}
2016-07-11 20:38:19.223879 7fb2466ea700  0 osd.7 2498 ignoring osdmap until we have initialized
2016-07-11 20:38:19.223959 7fb2466ea700  0 osd.7 2498 ignoring osdmap until we have initialized
2016-07-11 20:38:19.224145 7fb258077880  0 osd.7 2498 done with init, starting boot process

OSD never get connected to the monitor.

I'm running Hammer/Centos 7.2.

Any hint for me?

Thanks.

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com