My cluster on 15.2.1 versions. I use ceph-volume raw to add new osd but it has error : ceph-volume raw prepare --bluestore --data /dev/vdb Running command: /usr/bin/ceph-authtool --gen-print-key Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new b3b79678-c40d-4a84-9c47-84c4d7234407 Running command: /usr/bin/ceph-authtool --gen-print-key Running command: /usr/bin/mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0 Running command: /usr/bin/chown -R ceph:ceph /dev/vdb Running command: /usr/bin/ln -s /dev/vdb /var/lib/ceph/osd/ceph-0/block Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o /var/lib/ceph/osd/ceph-0/activate.monmap stderr: 2020-04-14T09:36:40.234+0700 7ff302248700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bi n,: (2) No such file or directory 2020-04-14T09:36:40.234+0700 7ff302248700 -1 AuthRegistry(0x7ff2fc058388) no keyring found at /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyr ing.bin,, disabling cephx stderr: got monmap epoch 1 Running command: /usr/bin/ceph-authtool /var/lib/ceph/osd/ceph-0/keyring --create-keyring --name osd.0 --add-key AQC3IZVe+ZSrChAAhGUXJ5Nkg8K6UB9tiNaFxQ== stdout: creating /var/lib/ceph/osd/ceph-0/keyring added entity osd.0 auth(key=AQC3IZVe+ZSrChAAhGUXJ5Nkg8K6UB9tiNaFxQ==) Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/keyring Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/ Running command: /usr/bin/ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 0 --monmap /var/lib/ceph/osd/ceph-0/activate.monmap --keyfile - --osd-data /var/lib/ceph/osd/ceph-0/ --os d-uuid b3b79678-c40d-4a84-9c47-84c4d7234407 --setuser ceph --setgroup ceph stderr: 2020-04-14T09:36:40.742+0700 7f83483c4bc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/) _read_fsid unparsable uuid stderr: 2020-04-14T09:36:40.742+0700 7f83483c4bc0 -1 bdev(0x556ebee86c00 /var/lib/ceph/osd/ceph-0//block) _lock flock failed on /var/lib/ceph/osd/ceph-0//block stderr: 2020-04-14T09:36:40.742+0700 7f83483c4bc0 -1 bdev(0x556ebee86c00 /var/lib/ceph/osd/ceph-0//block) open failed to lock /var/lib/ceph/osd/ceph-0//block: (11) Resource temporarily unavail able stderr: 2020-04-14T09:36:40.743+0700 7f83483c4bc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/) mkfs failed, (11) Resource temporarily unavailable stderr: 2020-04-14T09:36:40.743+0700 7f83483c4bc0 -1 OSD::mkfs: ObjectStore::mkfs failed with error (11) Resource temporarily unavailable stderr: 2020-04-14T09:36:40.744+0700 7f83483c4bc0 -1 ** ERROR: error creating empty object store in /var/lib/ceph/osd/ceph-0/: (11) Resource temporarily unavailable --> Was unable to complete a new OSD, will rollback changes Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring osd purge-new osd.0 --yes-i-really-mean-it stderr: 2020-04-14T09:36:40.959+0700 7f0b569c3700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bi n,: (2) No such file or directory 2020-04-14T09:36:40.959+0700 7f0b569c3700 -1 AuthRegistry(0x7f0b50058388) no keyring found at /etc/ceph/ceph.client.bootstrap-osd.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyr ing.bin,, disabling cephx stderr: purged osd.0 --> RuntimeError: Command failed with exit code 250: /usr/bin/ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 0 --monmap /var/lib/ceph/osd/ceph-0/activate.monmap --keyfile - --os d-data /var/lib/ceph/osd/ceph-0/ --osd-uuid b3b79678-c40d-4a84-9c47-84c4d7234407 --setuser ceph --setgroup ceph After that i create new parition of /dev/vdb it create osd successfully. then ceph-volume raw activate --device /dev/sdb1 --> systemd support not yet implemented _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx