Hi Nathan, this indeed appears to be a Gentoo-specific issue. They install the file at: /usr/libexec/ceph/ceph-osd-prestart.sh instead of /usr/lib/ceph/ceph-osd-prestart.sh It depends on how you strongly you follow FHS ( http://refspecs.linuxfoundation.org/FHS_3.0/fhs/ch04s07.html ) which is the actual correct place to be used. It seems Gentoo packagers took FHS 3.0 seriously to decide where to install things, but did not patch the code accordingly, so this surely warrants a Gentoo bug. Distro packagers should then decide whether they want to change install location (and rather follow Ceph upstream than FHS 3.0), or patch the code to enforce FHS 3.0. https://bugs.gentoo.org/632028 is also related to that. Cheers, Oliver Am 11.03.2018 um 00:34 schrieb Nathan Dehnel: > Trying to create an OSD: > > gentooserver ~ # ceph-volume lvm create --data /dev/sdb > Running command: ceph-authtool --gen-print-key > Running command: ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new e70500fe-0d51-48c3-a607-414957886726 > Running command: vgcreate --force --yes ceph-a736559a-92d1-483e-9289-d2c7feed510f /dev/sdb > stdout: Volume group "ceph-a736559a-92d1-483e-9289-d2c7feed510f" successfully created > Running command: lvcreate --yes -l 100%FREE -n osd-block-e70500fe-0d51-48c3-a607-414957886726 ceph-a736559a-92d1-483e-9289-d2c7feed510f > stdout: Logical volume "osd-block-e70500fe-0d51-48c3-a607-414957886726" created. > Running command: ceph-authtool --gen-print-key > Running command: mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0 > Running command: chown -R ceph:ceph /dev/dm-0 > Running command: ln -s /dev/ceph-a736559a-92d1-483e-9289-d2c7feed510f/osd-block-e70500fe-0d51-48c3-a607-414957886726 /var/lib/ceph/osd/ceph-0/block > Running command: ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o /var/lib/ceph/osd/ceph-0/activate.monmap > stderr: got monmap epoch 1 > Running command: ceph-authtool /var/lib/ceph/osd/ceph-0/keyring --create-keyring --name osd.0 --add-key AQBEZqRalRoRCBAA03R6VshykLcZjMgQnFKDtg== > stdout: creating /var/lib/ceph/osd/ceph-0/keyring > stdout: added entity osd.0 auth auth(auid = 18446744073709551615 key=AQBEZqRalRoRCBAA03R6VshykLcZjMgQnFKDtg== with 0 caps) > Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/keyring > Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/ > Running command: ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 0 --monmap /var/lib/ceph/osd/ceph-0/activate.monmap --keyfile - --osd-data /var/lib/ceph/osd/ceph-0/ --osd-uuid e70500fe-0d51-48c3-a607-414957886726 --setuser ceph --setgroup ceph > --> ceph-volume lvm prepare successful for: /dev/sdb > Running command: ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/ceph-a736559a-92d1-483e-9289-d2c7feed510f/osd-block-e70500fe-0d51-48c3-a607-414957886726 --path /var/lib/ceph/osd/ceph-0 > Running command: ln -snf /dev/ceph-a736559a-92d1-483e-9289-d2c7feed510f/osd-block-e70500fe-0d51-48c3-a607-414957886726 /var/lib/ceph/osd/ceph-0/block > Running command: chown -R ceph:ceph /dev/dm-0 > Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 > Running command: systemctl enable ceph-volume@lvm-0-e70500fe-0d51-48c3-a607-414957886726 > stderr: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-volume@lvm-0-e70500fe-0d51-48c3-a607-414957886726.service → /lib/systemd/system/ceph-volume@.service. > Running command: systemctl start ceph-osd@0 > stderr: Job for ceph-osd@0.service failed because the control process exited with error code. > See "systemctl status ceph-osd@0.service" and "journalctl -xe" for details. > --> Was unable to complete a new OSD, will rollback changes > --> OSD will be fully purged from the cluster, because the ID was generated > Running command: ceph osd purge osd.0 --yes-i-really-mean-it > stderr: purged osd.0 > --> RuntimeError: command returned non-zero exit status: 1 > > journalctl -xe > -- Unit ceph-osd@0.service has begun starting up. > Mar 10 17:14:34 gentooserver systemd[3977]: ceph-osd@0.service: Failed to execute command: No such file or directory > Mar 10 17:14:34 gentooserver systemd[3977]: ceph-osd@0.service: Failed at step EXEC spawning /usr/lib/ceph/ceph-osd-prestart.sh: No such file or directory > -- Subject: Process /usr/lib/ceph/ceph-osd-prestart.sh could not be executed > -- Defined-By: systemd > -- Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel > -- > -- The process /usr/lib/ceph/ceph-osd-prestart.sh could not be executed and failed. > -- > -- The error number returned by this process is 2. > Mar 10 17:14:34 gentooserver systemd[1]: ceph-osd@0.service: Control process exited, code=exited status=203 > Mar 10 17:14:34 gentooserver systemd[1]: ceph-osd@0.service: Failed with result 'exit-code'. > Mar 10 17:14:34 gentooserver systemd[1]: Failed to start Ceph object storage daemon osd.0. > -- Subject: Unit ceph-osd@0.service has failed > -- Defined-By: systemd > -- Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel > -- > -- Unit ceph-osd@0.service has failed. > -- > -- The result is RESULT. > > Why is this file missing? Should I file a bug with my distro's packager? > > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >
Attachment:
smime.p7s
Description: S/MIME Cryptographic Signature
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
