Thanks, I will try that.
Just to verify I don't need to create a file system or any partition table on the volume, right? Ceph seems to be trying to create the file system.
On Fri, Jun 8, 2018 at 12:56 PM, Alfredo Deza <adeza@xxxxxxxxxx> wrote:
On Fri, Jun 8, 2018 at 3:17 PM, Rares Vernica <rvernica@xxxxxxxxx> wrote:Yes, it exists:# ls -ld /var/lib/ceph/osd/ceph-0drwxr-xr-x. 2 ceph ceph 6 Jun 7 15:06 /var/lib/ceph/osd/ceph-0
# ls -ld /var/lib/ceph/osddrwxr-x---. 4 ceph ceph 34 Jun 7 15:59 /var/lib/ceph/osdAfter I ran the ceph-volume command, I see the directory is mounted:# mount...tmpfs on /var/lib/ceph/osd/ceph-0 type tmpfs (rw,relatime,seclabel)
# ls -ld /var/lib/ceph/osd/ceph-0
drwxrwxrwt. 2 ceph ceph 160 Jun 8 12:15 /var/lib/ceph/osd/ceph-0I don't know what to say. The only other thing that jumps at me is that this is a 1GB device. Have you tried with other sizes? You could also try with a whole raw device and letceph-volume create the vg/lv for you: ceph-volume lvm create --data /dev/<mydevice>Thanks,RaresOn Fri, Jun 8, 2018 at 12:09 PM, Alfredo Deza <adeza@xxxxxxxxxx> wrote:On Fri, Jun 8, 2018 at 2:47 PM, Rares Vernica <rvernica@xxxxxxxxx> wrote:Hi,I'm following the Manual Deployment guide at http://docs.ceph.com/docs/master/install/manual-deployment/ I'm not able to move past the ceph-volume lvm create part. Here is what I do:# lvcreate -L 1G -n ceph cah_foo
Logical volume "ceph" created.# ceph-volume lvm create --data cah_foo/ceph
Running command: /bin/ceph-authtool --gen-print-key
Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new b8016385-e46c-4e93-a334-be4fc9 2bea85
Running command: /bin/ceph-authtool --gen-print-key
Running command: mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0
Running command: chown -R ceph:ceph /dev/dm-2
Running command: ln -s /dev/cah_foo/ceph /var/lib/ceph/osd/ceph-0/block
Running command: ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o /var/lib/ceph/osd/ceph-0/activ ate.monmap
stderr: got monmap epoch 2
Running command: ceph-authtool /var/lib/ceph/osd/ceph-0/keyring --create-keyring --name osd.0 --add-key AQCxuhlbAVylMRAAXsKQpKbau3T1rI 66z651ng==
stdout: creating /var/lib/ceph/osd/ceph-0/keyring
added entity osd.0 auth auth(auid = 18446744073709551615 key=AQCxuhlbAVylMRAAXsKQpKbau3T1rI66z651ng== with 0 caps)
Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/keyring
Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/
Running command: /bin/ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 0 --monmap /var/lib/ceph/osd/ceph-0/activate.monmap --keyfile - --osd-data /var/lib/ceph/osd/ceph-0/ --osd-uuid b8016385-e46c-4e93-a334-be4fc9 2bea85 --setuser ceph --setgroup ceph
stderr: 2018-06-07 16:07:32.804440 7f237709dd80 -1 bluestore(/var/lib/ceph/osd/ceph-0/) _read_fsid unparsable uuid
stderr: 2018-06-07 16:07:33.822761 7f237709dd80 -1 OSD::mkfs: ObjectStore::mkfs failed with error (2) No such file or directory
stderr: 2018-06-07 16:07:33.822934 7f237709dd80 -1 ** ERROR: error creating empty object store in /var/lib/ceph/osd/ceph-0/: (2) No such file or directory
--> ceph-volume lvm prepare successful for: cah_foo/ceph
Running command: ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/cah_foo/ceph --path /var/lib/ceph/osd/ceph-0
stderr: failed to read label for /dev/cah_foo/ceph: (2) No such file or directory
--> Was unable to complete a new OSD, will rollback changes
--> OSD will be fully purged from the cluster, because the ID was generated
Running command: ceph osd purge osd.0 --yes-i-really-mean-it
stderr: purged osd.0
--> RuntimeError: command returned non-zero exit status: 1# ceph --version
ceph version 12.2.5 (cad919881333ac92274171586c827e01f554a70a) luminous (stable) This looks really odd. Do you have a /var/lib/ceph/osd/ceph-0 directory? if yes, what are the permissions inside of it? The output shows that it is mounting this correctly:Running command: mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0So that should existI wonder what am I missing and what else I can try.Thanks!Rares
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
