Re: - permission denied on journal after reboot

Craig Chi <craigchi@xxxxxxxxxxxx> · Mon, 13 Feb 2017 19:45:39 +0800

Hi,

What is your OS? The permission of journal partition should be changed by udev rules: /lib/udev/rules.d/95-ceph-osd.rules
In this file, it is described as:
# JOURNAL_UUID

ACTION="" SUBSYSTEM=="block", \

  ENV{DEVTYPE}=="partition", \

  ENV{ID_PART_ENTRY_TYPE}=="45b0969e-9b03-4f30-b4c6-b4b80ceff106", \

  OWNER:="ceph", GROUP:="ceph", MODE:="660", \

  RUN+="/usr/sbin/ceph-disk --log-stdout -v trigger /dev/$name"

You can also use udevadm command to test whether the partition has been processed by the correct udev rule. Like following:

#> udevadm test /sys/block/sdb/sdb2

...
starting 'probe-bcache -o udev /dev/sdb2'

Process 'probe-bcache -o udev /dev/sdb2' succeeded.

OWNER 64045 /lib/udev/rules.d/95-ceph-osd.rules:16

GROUP 64045 /lib/udev/rules.d/95-ceph-osd.rules:16

MODE 0660 /lib/udev/rules.d/95-ceph-osd.rules:16

RUN '/usr/sbin/ceph-disk --log-stdout -v trigger /dev/$name' /lib/udev/rules.d/95-ceph-osd.rules:16
...

Then /dev/sdb2 will have ceph:ceph permission automatically.

#> ls -l /dev/sdb2
brw-rw---- 1 ceph ceph 8, 18 Feb 13 19:43 /dev/sdb2

Sincerely,

Craig Chi

On 2017-02-13 19:06, Piotr Dzionek <piotr.dzionek@xxxxxxxx> wrote:

Hi,
I am running ceph Jewel 10.2.5 with separate journals - ssd disks. It runs pretty smooth, however I stumble upon an issue after system reboot. Journal disks become owned by root and ceph failed to start.
starting osd.4 at :/0 osd_data /var/lib/ceph/osd/ceph-4 /var/lib/ceph/osd/ceph-4/journal
 2017-02-10 16:24:29.924126 7fd07ab40800 -1 filestore(/var/lib/ceph/osd/ceph-4) mount failed to open journal /var/lib/ceph/osd/ceph-4/journal: (13) Permission denied
 2017-02-10 16:24:29.924210 7fd07ab40800 -1 osd.4 0 OSD:init: unable to mount object store
 2017-02-10 16:24:29.924217 7fd07ab40800 -1 #033[0;31m ** ERROR: osd init failed: (13) Permission denied#033[0m
I fixed this issue by finding journal disks in /dev dir and chown to ceph:ceph. I remember that I had a similar issue after I installed it for a first time. Is it a bug ? or do I have to set some kind of udev rules for this disks?
FYI, I have this issue after every restart now.
Kind regards,

Piotr Dzionek

_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com