On Fri, Jun 8, 2018 at 3:59 PM, Rares Vernica <rvernica@xxxxxxxxx> wrote:
Thanks, I will try that.Just to verify I don't need to create a file system or any partition table on the volume, right? Ceph seems to be trying to create the file system.
Right, no need to do anything here for filesystems.
On Fri, Jun 8, 2018 at 12:56 PM, Alfredo Deza <adeza@xxxxxxxxxx> wrote:On Fri, Jun 8, 2018 at 3:17 PM, Rares Vernica <rvernica@xxxxxxxxx> wrote:Yes, it exists:# ls -ld /var/lib/ceph/osd/ceph-0drwxr-xr-x. 2 ceph ceph 6 Jun 7 15:06 /var/lib/ceph/osd/ceph-0
# ls -ld /var/lib/ceph/osddrwxr-x---. 4 ceph ceph 34 Jun 7 15:59 /var/lib/ceph/osdAfter I ran the ceph-volume command, I see the directory is mounted:# mount...tmpfs on /var/lib/ceph/osd/ceph-0 type tmpfs (rw,relatime,seclabel)
# ls -ld /var/lib/ceph/osd/ceph-0
drwxrwxrwt. 2 ceph ceph 160 Jun 8 12:15 /var/lib/ceph/osd/ceph-0I don't know what to say. The only other thing that jumps at me is that this is a 1GB device. Have you tried with other sizes? You could also try with a whole raw device and letceph-volume create the vg/lv for you: ceph-volume lvm create --data /dev/<mydevice>Thanks,RaresOn Fri, Jun 8, 2018 at 12:09 PM, Alfredo Deza <adeza@xxxxxxxxxx> wrote:On Fri, Jun 8, 2018 at 2:47 PM, Rares Vernica <rvernica@xxxxxxxxx> wrote:Hi,I'm following the Manual Deployment guide at http://docs.ceph.com/docs/master/install/manual-deployment/ I'm not able to move past the ceph-volume lvm create part. Here is what I do:# lvcreate -L 1G -n ceph cah_foo
Logical volume "ceph" created.# ceph-volume lvm create --data cah_foo/ceph
Running command: /bin/ceph-authtool --gen-print-key
Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new b8016385-e46c-4e93-a334-be4fc9 2bea85
Running command: /bin/ceph-authtool --gen-print-key
Running command: mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0
Running command: chown -R ceph:ceph /dev/dm-2
Running command: ln -s /dev/cah_foo/ceph /var/lib/ceph/osd/ceph-0/block
Running command: ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o /var/lib/ceph/osd/ceph-0/activ ate.monmap
stderr: got monmap epoch 2
Running command: ceph-authtool /var/lib/ceph/osd/ceph-0/keyring --create-keyring --name osd.0 --add-key AQCxuhlbAVylMRAAXsKQpKbau3T1rI 66z651ng==
stdout: creating /var/lib/ceph/osd/ceph-0/keyring
added entity osd.0 auth auth(auid = 18446744073709551615 key=AQCxuhlbAVylMRAAXsKQpKbau3T1rI66z651ng== with 0 caps)
Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/keyring
Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/
Running command: /bin/ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 0 --monmap /var/lib/ceph/osd/ceph-0/activate.monmap --keyfile - --osd-data /var/lib/ceph/osd/ceph-0/ --osd-uuid b8016385-e46c-4e93-a334-be4fc9 2bea85 --setuser ceph --setgroup ceph
stderr: 2018-06-07 16:07:32.804440 7f237709dd80 -1 bluestore(/var/lib/ceph/osd/ceph-0/) _read_fsid unparsable uuid
stderr: 2018-06-07 16:07:33.822761 7f237709dd80 -1 OSD::mkfs: ObjectStore::mkfs failed with error (2) No such file or directory
stderr: 2018-06-07 16:07:33.822934 7f237709dd80 -1 ** ERROR: error creating empty object store in /var/lib/ceph/osd/ceph-0/: (2) No such file or directory
--> ceph-volume lvm prepare successful for: cah_foo/ceph
Running command: ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/cah_foo/ceph --path /var/lib/ceph/osd/ceph-0
stderr: failed to read label for /dev/cah_foo/ceph: (2) No such file or directory
--> Was unable to complete a new OSD, will rollback changes
--> OSD will be fully purged from the cluster, because the ID was generated
Running command: ceph osd purge osd.0 --yes-i-really-mean-it
stderr: purged osd.0
--> RuntimeError: command returned non-zero exit status: 1# ceph --version
ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable) This looks really odd. Do you have a /var/lib/ceph/osd/ceph-0 directory? if yes, what are the permissions inside of it? The output shows that it is mounting this correctly:Running command: mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0So that should existI wonder what am I missing and what else I can try.Thanks!Rares
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph. com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
