On Mon, Dec 17, 2018 at 9:20 AM Igor Fedotov <ifedotov@xxxxxxx> wrote: > > Hi All, > > Got a question while playing with ceph-volume > > Are --block.db and --block.wal options mandatory for 'ceph-volume lvm > prepare --bluestore' command? These are not mandatory (per the bluestore spec). Bluestore has 4 ways of deploying an OSD: 1) with a data (block) device only 2) with a data device and a block.db 3) with a data device and a wal.db 4) with a data device, block.db, and wal.db There is no enforcement for a specific one, any of the above is valid. > > No formal syntax error is provided if omitted but OSD isn't prepared > with the following output: Would help here to see what the actual ceph-volume call was (can't tell by looking at ceph-osd output) > > Running command: /usr/local/bin/ceph-osd --cluster ceph > --osd-objectstore bluestore --mkfs -i 7 --monmap > /var/lib/ceph/osd/ceph-7/activate.monmap --keyfile - --osd-data > /var/lib/ceph/osd/ceph-7/ --osd-uuid > 432e9108-6429-4da0-aed9-b0382e821c83 --setuser ceph --setgroup ceph > stderr: 2018-12-17 17:18:22.554 7f61a6bed680 -1 WARNING: all dangerous > and experimental features are enabled. > stderr: 2018-12-17 17:18:22.570 7f61a6bed680 -1 WARNING: all dangerous > and experimental features are enabled. > stderr: 2018-12-17 17:18:22.578 7f61a6bed680 -1 WARNING: all dangerous > and experimental features are enabled. > stderr: 2018-12-17 17:18:22.582 7f61a6bed680 -1 asok(0x5637b309a000) > AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed > to bind the UNIX domain socket to '/tmp/ceph-asok.nmQtXX/osd.7.asok': > (13) Permission denied > stderr: 2018-12-17 16:46:33.381 7f4b0d3fb680 -1 > bluestore(/var/lib/ceph/osd/ceph-5/) _open_bluefs > /var/lib/ceph/osd/ceph-5//block.db symlink exists but target unusable: > (2) No such file or directory > stderr: 2018-12-17 16:46:33.689 7f4b0d3fb680 -1 > bluestore(/var/lib/ceph/osd/ceph-5/) mkfs failed, (2) No such file or > directory > stderr: 2018-12-17 16:46:33.689 7f4b0d3fb680 -1 OSD::mkfs: > ObjectStore::mkfs failed with error (2) No such file or directory > stderr: 2018-12-17 16:46:33.689 7f4b0d3fb680 -1 ** ERROR: error > creating empty object store in /var/lib/ceph/osd/ceph-5/: (2) No such > file or directory > --> RuntimeError: Command failed with exit code 250: > /usr/local/bin/ceph-osd --cluster ceph --osd-objectstore bluestore > --mkfs -i 5 --monmap /var/lib/ceph/osd/ceph-5/activate.monmap --keyfile > - --osd-data /var/lib/ceph/osd/ceph-5/ --osd-uuid > b7babded-c170-4b89-95a1-4ecab21c82de --setuser ceph --setgroup ceph > > Symlinks are created but point to non-existent files: > > lrwxrwxrwx 1 ceph ceph 42 Dec 17 16:46 block.db -> > /home/if/ceph/build/dev/osd5/block.db.file > lrwxrwxrwx 1 ceph ceph 43 Dec 17 16:46 block.wal -> > /home/if/ceph/build/dev/osd5/block.wal.file > > > Everything works fine when both parameters are provided though. Looks like you tried several times to deploy for the same OSD? Do you think you can provide a way to replicate how you got here? > > Wondering if this is a bug or I missed something? > > > Thanks, > > Igor >
