We are going to setup a test cluster with kraken using CentOS7. And obviously like to stay as close as possible to using their repositories. If we need to install the 4.1.4 kernel or later, is there a ceph recommended repository to choose? Like for instance use the elrepo 4.9ml/4.4lt? http://docs.ceph.com/docs/kraken/start/os-recommendations/ -----Original Message----- From: Reed Dier [mailto:reed.dier@xxxxxxxxxxx] Sent: woensdag 11 januari 2017 22:27 To: Stillwell, Bryan J Cc: ceph-users Subject: Re: OSD create with SSD journal Interesting, I feel silly having not checked ownership of the dev device. Will chown before next deploy and report back for sake of possibly helping someone else down the line. Thanks, Reed > On Jan 11, 2017, at 3:07 PM, Stillwell, Bryan J <Bryan.Stillwell@xxxxxxxxxxx> wrote: > > On 1/11/17, 10:31 AM, "ceph-users on behalf of Reed Dier" > <ceph-users-bounces@xxxxxxxxxxxxxx on behalf of reed.dier@xxxxxxxxxxx> > wrote: > >>> 2017-01-03 12:10:23.514577 7f1d821f2800 0 ceph version 10.2.5 >>> (c461ee19ecbc0c5c330aca20f7392c9a00730367), process ceph-osd, pid >>> 19754 >>> 2017-01-03 12:10:23.517465 7f1d821f2800 1 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) mkfs in >>> /var/lib/ceph/tmp/mnt.WaQmjK >>> 2017-01-03 12:10:23.517494 7f1d821f2800 1 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) mkfs fsid is already set to >>> 644058d7-e1b0-4abe-92e2-43b17d75148e >>> 2017-01-03 12:10:23.517499 7f1d821f2800 1 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) write_version_stamp 4 >>> 2017-01-03 12:10:23.517678 7f1d821f2800 0 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) backend xfs (magic >>> 0x58465342) >>> 2017-01-03 12:10:23.519898 7f1d821f2800 1 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) leveldb db exists/created >>> 2017-01-03 12:10:23.520035 7f1d821f2800 -1 >>> filestore(/var/lib/ceph/tmp/mnt.WaQmjK) mkjournal error creating >>> journal on /var/lib/ceph/tmp/mnt.WaQmjK/journal: (13) Permission >>> denied >>> 2017-01-03 12:10:23.520049 7f1d821f2800 -1 OSD::mkfs: >>> ObjectStore::mkfs failed with error -13 >>> 2017-01-03 12:10:23.520100 7f1d821f2800 -1 ESC[0;31m ** ERROR: error >>> creating empty object store in /var/lib/ceph/tmp/mnt.WaQmjK: (13) >>> Permission deniedESC[0m >> >> I needed up creating the OSD¹s with on-disk journals, then going back >> and moving the journals to the NVMe partition as intended, but hoping >> to do this all in one fell swoop, so hoping there may be some >> pointers on something I may be doing incorrectly with ceph-deploy for >> the external journal location. Adding a handful of OSD¹s soon, and >> would like to do it correctly from the start. > > What's the ownership of the journal device (/dev/nvme0n1p5)? > > It should be owned by ceph:ceph or you'll get the permission denied > errors message. > > Bryan > > E-MAIL CONFIDENTIALITY NOTICE: > The contents of this e-mail message and any attachments are intended solely for the addressee(s) and may contain confidential and/or legally privileged information. If you are not the intended recipient of this message or if this message has been addressed to you in error, please immediately alert the sender by reply e-mail and then delete this message and any attachments. If you are not the intended recipient, you are notified that any use, dissemination, distribution, copying, or storage of this message or any attachment is strictly prohibited. > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com