Interesting, I feel silly having not checked ownership of the dev device. Will chown before next deploy and report back for sake of possibly helping someone else down the line. Thanks, Reed > On Jan 11, 2017, at 3:07 PM, Stillwell, Bryan J <Bryan.Stillwell@xxxxxxxxxxx> wrote: > > On 1/11/17, 10:31 AM, "ceph-users on behalf of Reed Dier" > <ceph-users-bounces@xxxxxxxxxxxxxx on behalf of reed.dier@xxxxxxxxxxx> > wrote: > >>> 2017-01-03 12:10:23.514577 7f1d821f2800 0 ceph version 10.2.5 >>> (c461ee19ecbc0c5c330aca20f7392c9a00730367), process ceph-osd, pid 19754 >>> 2017-01-03 12:10:23.517465 7f1d821f2800 1 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) mkfs in >>> /var/lib/ceph/tmp/mnt.WaQmjK >>> 2017-01-03 12:10:23.517494 7f1d821f2800 1 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) mkfs fsid is already set to >>> 644058d7-e1b0-4abe-92e2-43b17d75148e >>> 2017-01-03 12:10:23.517499 7f1d821f2800 1 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) write_version_stamp 4 >>> 2017-01-03 12:10:23.517678 7f1d821f2800 0 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) backend xfs (magic 0x58465342) >>> 2017-01-03 12:10:23.519898 7f1d821f2800 1 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) leveldb db exists/created >>> 2017-01-03 12:10:23.520035 7f1d821f2800 -1 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) mkjournal error creating journal >>> on /var/lib/ceph/tmp/mnt.WaQmjK/journal: (13) Permission denied >>> 2017-01-03 12:10:23.520049 7f1d821f2800 -1 OSD::mkfs: ObjectStore::mkfs >>> failed with error -13 >>> 2017-01-03 12:10:23.520100 7f1d821f2800 -1 ESC[0;31m ** ERROR: error >>> creating empty object store in /var/lib/ceph/tmp/mnt.WaQmjK: (13) >>> Permission deniedESC[0m >> >> I needed up creating the OSD¹s with on-disk journals, then going back and >> moving the journals to the NVMe partition as intended, but hoping to do >> this all in one fell swoop, so hoping there may be some pointers on >> something I may be doing incorrectly with ceph-deploy for the external >> journal location. Adding a handful of OSD¹s soon, and would like to do it >> correctly from the start. > > What's the ownership of the journal device (/dev/nvme0n1p5)? > > It should be owned by ceph:ceph or you'll get the permission denied errors > message. > > Bryan > > E-MAIL CONFIDENTIALITY NOTICE: > The contents of this e-mail message and any attachments are intended solely for the addressee(s) and may contain confidential and/or legally privileged information. If you are not the intended recipient of this message or if this message has been addressed to you in error, please immediately alert the sender by reply e-mail and then delete this message and any attachments. If you are not the intended recipient, you are notified that any use, dissemination, distribution, copying, or storage of this message or any attachment is strictly prohibited. > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |