I wasn't using multipath, but the same findings may possibly apply. When
deploying a cluster recently with jewel I was trying various permutations.
ceph-deploy does accept the full /dev/sdX path without issue.
However I really wanted to use more deterministic hardware-related
paths, so as to be completely certain of which device was a particular
type - ie paths along the line of
"/dev/disk/by-path/pci-0000:05:00.0-scsi-0:1:0:${disk}"
ceph-deploy was *not* happy with these (presumably because of the
colons; I didn't find any way to escape them successfully). However,
sshing to each storage node and using "ceph-disk prepare" did work fine
with this pattern... would end up something like:
ssh $host 'for disk in {0..11}; do ceph-disk prepare --dmcrypt
/dev/disk/by-path/pci-0000:03:00.0-scsi-0:1:0:${disk} /dev/nvme0n1; done'
At the end of all that, given my problem was probably related to
characters in the path, I don't see why ceph-deploy wouldn't be ok with
the /dev/mapper path.
Graham
On 07/11/2017 09:48 AM, bruno.canning@xxxxxxxxxx wrote:
Hi All,
And further to my last email, does anyone have any experience of using
ceph-deploy with storage configured via multipath, please?
Currently, we deploy new OSDs with:
ceph-deploy disk zap ceph-sn1.example.com:sdb
ceph-deploy --overwrite-conf config pull ceph-sn1.example.com
ceph-deploy osd prepare ceph-sn1.example.com:sdb
I note that these are not the full path to the device node on the
storage host, e.g.:
ceph-deploy disk zap ceph-sn1.example.com:/dev/sdb
Does ceph-deploy accept the full path, and if so, should providing a
path via the device mapper also work? e.g.:
ceph-deploy disk zap ceph-sn1.example.com:/dev/mapper/disk1
Best wishes,
Bruno
Bruno Canning
LHC Data Store System Administrator
Scientific Computing Department
STFC Rutherford Appleton Laboratory
Harwell Oxford
Didcot
OX11 0QX
Tel. +44 ((0)1235) 446621
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
--
Graham Allan
Minnesota Supercomputing Institute - gta@xxxxxxx
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
