Re: ERROR: unable to open OSD superblock on /var/lib/ceph/osd/ceph-1: (13) Permission denied

[George Shuklin <george.shuklin@xxxxxxxxx>]

Check if keyring is belong to OSD.

One more thing I saw in the lab: number of allowed opened files is not enough. After I raised it via ulimit, this type of bug disappear.


On 07/06/2016 06:28 PM, RJ Nowling wrote:

Assuming I did this correctly :) :

[root@et32 ceph-1]# cat keyring

[osd.1]

key = AQBm03tXlowFIhAA5CjVax00bNhFyhvUcOkchA==

[root@et32 ceph-1]# ceph auth list

installed auth entries:

osd.0

key: AQBl03tXFG9oHxAAG5FmlDCcoGgVp3ewCgRVSQ==

caps: [mon] allow profile osd

caps: [osd] allow *

osd.1

key: AQBm03tXlowFIhAA5CjVax00bNhFyhvUcOkchA==

caps: [mon] allow profile osd

caps: [osd] allow *

On Wed, Jul 6, 2016 at 10:22 AM, George Shuklin <george.shuklin@xxxxxxxxx> wrote:

In my expirience, 50% of 'permission denied' for OSD were coming not from filesystem, but from monitors:

check if key in ceph auth list matches to osd_dir/keyring.

On 07/06/2016 06:08 PM, Samuel Just wrote:

Try strace.
-Sam

On Wed, Jul 6, 2016 at 7:53 AM, RJ Nowling <rnowling@xxxxxxxxxx> wrote:

Hi all,

I'm trying to use the ceph-ansible playbooks to deploy onto baremetal.  I'm
currently testing with the approach that uses an existing filesystem rather
than giving raw access to the disks.

The OSDs are failing to start:

2016-07-06 10:48:50.249976 7fa410aef800  0 set uid:gid to 167:167
(ceph:ceph)
2016-07-06 10:48:50.250021 7fa410aef800  0 ceph version 10.2.2
(45107e21c568dd033c2f0a3107dec8f0b0e58374), process ceph-osd, pid 19104
2016-07-06 10:48:50.250221 7fa410aef800 -1  ** ERROR: unable to open OSD
superblock on /var/lib/ceph/osd/ceph-1: (13) Permission denied

The directories seem to be owned by the ceph user and group.  That said, I'm
putting my data under /home/ceph-data (owned by ceph:ceph) which is on a
different filesystem with /var/lib/ceph/osd/ceph-1 being a symlink (owned by
ceph:ceph) .

Any suggestions as to where the permission denied might be coming from?

Thanks!
RJ

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com