Re: Luminous : All OSDs not starting when ceph.target is started

[nokia ceph <nokiacephusers@xxxxxxxxx>]

Hi,

For the above issue we found a work-around.

1)we created a directory 'ceph-osd.target.wants'
2)Created simlinks to OSD service for all OSDs. Sample below:
cn7.chn6us1c1.cdn /etc/systemd/system/ceph-osd.target.wants# ll
total 0
lrwxrwxrwx 1 root root 41 Jan 23 09:36 ceph-osd@102.service -> /usr/lib/systemd/system/ceph-osd@.service
lrwxrwxrwx 1 root root 41 Jan 23 09:36 ceph-osd@107.service -> /usr/lib/systemd/system/ceph-osd@.service
lrwxrwxrwx 1 root root 41 Jan 23 09:36 ceph-osd@112.service -> /usr/lib/systemd/system/ceph-osd@.service
lrwxrwxrwx 1 root root 41 Jan 23 09:36 ceph-osd@117.service -> /usr/lib/systemd/system/ceph-osd@.service
lrwxrwxrwx 1 root root 41 Jan 23 09:36 ceph-osd@122.service -> /usr/lib/systemd/system/ceph-osd@.service
lrwxrwxrwx 1 root root 41 Jan 23 09:36 ceph-osd@127.service -> /usr/lib/systemd/system/ceph-osd@.service
lrwxrwxrwx 1 root root 41 Jan 23 09:36 ceph-osd@12.service -> /usr/lib/systemd/system/ceph-osd@.service

.

.

.

On Mon, Jan 8, 2018 at 3:49 PM, nokia ceph <nokiacephusers@xxxxxxxxx> wrote:

Hello, 

i have installed Luminous 12.2.2 on a 5 node cluster with logical volume OSDs. 

I am trying to stop and start ceph on one of the nodes using systemctl commands. 

systemctl stop ceph.target; systemctl start ceph.target

When i stop ceph, all OSDs are stopped on the node properly. 

But when i start ceph, i see only 14 OSDs(out of 68) being started. Remaining OSDs are not starting automatically. When i check the OSD service status, i see it is still inactive and not starting.

When i reboot the same node, i do not see the above problem. All OSDs come up automatically.

ENV: 

Luminous 12.2.2 , 5 node, 5 mon and 5 mgr

CentOS7.4 

EC 4+1 , 68 disks per node, bluestore

Has anyone faced the same or have any suggestions?

Thanks in advance

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com