Re: ceph-deploy osd creation failed with multipath and dmcrypt

[Kevin Olbrich <ko@xxxxxxx>]

I met the same problem. I had to create GPT table for each disk, create first partition over full space and then fed these to ceph-volume (should be similar for ceph-deploy).

Also I am not sure if you can combine fs-type btrfs with bluestore (afaik this is for filestore).

Kevin

Am Di., 6. Nov. 2018 um 14:41 Uhr schrieb Pavan, Krish <Krish.Pavan@xxxxxxxxxx>:

Trying to created OSD with multipath with dmcrypt and it failed . Any suggestion please?.

ceph-deploy --overwrite-conf osd create ceph-store1:/dev/mapper/mpathr --bluestore --dmcrypt  -- failed

ceph-deploy --overwrite-conf osd create ceph-store1:/dev/mapper/mpathr --bluestore – worked

 

the logs for fail

[ceph-store12][WARNIN] command: Running command: /usr/sbin/restorecon -R /var/lib/ceph/osd-lockbox/e15f1adc-feff-4890-a617-adc473e7331e/magic.68428.tmp

[ceph-store12][WARNIN] command: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd-lockbox/e15f1adc-feff-4890-a617-adc473e7331e/magic.68428.tmp

[ceph-store12][WARNIN] Traceback (most recent call last):

[ceph-store12][WARNIN]   File "/usr/sbin/ceph-disk", line 9, in <module>

[ceph-store12][WARNIN]     load_entry_point('ceph-disk==1.0.0', 'console_scripts', 'ceph-disk')()

[ceph-store12][WARNIN]   File "/usr/lib/python2.7/site-packages/ceph_disk/main.py", line 5736, in run

[ceph-store12][WARNIN]     main(sys.argv[1:])

[ceph-store12][WARNIN]   File "/usr/lib/python2.7/site-packages/ceph_disk/main.py", line 5687, in main

[ceph-store12][WARNIN]     args.func(args)

[ceph-store12][WARNIN]   File "/usr/lib/python2.7/site-packages/ceph_disk/main.py", line 2108, in main

[ceph-store12][WARNIN]     Prepare.factory(args).prepare()

[ceph-store12][WARNIN]   File "/usr/lib/python2.7/site-packages/ceph_disk/main.py", line 2097, in prepare

[ceph-store12][WARNIN]     self._prepare()

[ceph-store12][WARNIN]   File "/usr/lib/python2.7/site-packages/ceph_disk/main.py", line 2171, in _prepare

[ceph-store12][WARNIN]     self.lockbox.prepare()

[ceph-store12][WARNIN]   File "/usr/lib/python2.7/site-packages/ceph_disk/main.py", line 2861, in prepare

[ceph-store12][WARNIN]     self.populate()

[ceph-store12][WARNIN]   File "/usr/lib/python2.7/site-packages/ceph_disk/main.py", line 2818, in populate

[ceph-store12][WARNIN]     get_partition_base(self.partition.get_dev()),

[ceph-store12][WARNIN]   File "/usr/lib/python2.7/site-packages/ceph_disk/main.py", line 844, in get_partition_base

[ceph-store12][WARNIN]     raise Error('not a partition', dev)

[ceph-store12][WARNIN] ceph_disk.main.Error: Error: not a partition: /dev/dm-215

[ceph-store12][ERROR ] RuntimeError: command returned non-zero exit status: 1

[ceph_deploy.osd][ERROR ] Failed to execute command: /usr/sbin/ceph-disk -v prepare --dmcrypt --dmcrypt-key-dir /etc/ceph/dmcrypt-keys --bluestore --cluster ceph --fs-type btrfs -- /dev/mapper/mpathr

[ceph_deploy][ERROR ] GenericError: Failed to create 1 OSDs

 

 

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com