I don’t use ansible or deploy. I had to create it, because it was also not in the auth list. ceph auth add client.bootstrap-osd mon 'allow profile bootstrap-osd' ceph auth get client.bootstrap-osd 2>/dev/null | head -2 | sudo -u ceph tee -a /var/lib/ceph/bootstrap-osd/ceph.keyring But since adding this file it start the osd, creates multiple DNE entries in the osd tree I am getting this: wipefs: error: /dev/sdg5: probing initialization failed: Device or resource busy ceph-disk: Error: Command '['/usr/sbin/wipefs', '--all', '/dev/sdg5']' returned non-zero exit status 1 Ceph-disk destroy is not working. Normally I create one manually without any issues, like this: sudo -u ceph mkdir /var/lib/ceph/osd/ceph-15 ceph-disk prepare --fs-type xfs --zap-disk /dev/sdb (xfs) ceph-disk prepare --bluestore --zap-disk /dev/sdc (bluestore) blkid /dev/sdb1 echo "UUID=a300d511-8874-4655-b296-acf489d5cbc8 /var/lib/ceph/osd/ceph-15 xfs defaults 0 0" >> /etc/fstab mount /var/lib/ceph/osd/ceph-15 chown ceph.ceph -R /var/lib/ceph/osd/ceph-15 sudo -u ceph ceph-osd -i 15 --mkfs --mkkey --osd-uuid sudo -u ceph ceph auth add osd.15 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' -i /var/lib/ceph/osd/ceph-15/keyring sudo -u ceph ceph osd crush add osd.15 0.4 host=c04 systemctl start ceph-osd@15 systemctl enable ceph-osd@15 How can I manually add disk encryption? -----Original Message----- From: Gregory Farnum [mailto:gfarnum@xxxxxxxxxx] Sent: donderdag 31 mei 2018 20:28 To: Marc Roos Cc: ceph-users Subject: Re: Testing with ceph-disk and dmcrypt That key should have been created when the cluster was. The orchestration software (ceph-deploy, ceph-ansible, or whatever you're using) is responsible for putting it in place on the local machine if needed, but in your case you should just need to fetch it. ("get-or-create" rather than "new", maybe? Not certain of the syntax but you want to fetch what exists rather than forcing a new creation that doesn't match the existing one.) -Greg On Thu, May 31, 2018 at 10:41 AM Marc Roos <M.Roos@xxxxxxxxxxxxxxxxx> wrote: I don’t have the /var/lib/ceph/bootstrap-osd/ceph.keyring, how should I create this file? [@ ~]# ceph-disk prepare --bluestore --zap-disk --dmcrypt /dev/sdg Creating new GPT entries. The operation has completed successfully. mke2fs 1.42.9 (28-Dec-2013) Filesystem label= OS type: Linux Block size=1024 (log=0) Fragment size=1024 (log=0) Stride=4 blocks, Stripe width=4 blocks 2560 inodes, 10240 blocks 512 blocks (5.00%) reserved for the super user First data block=1 Maximum filesystem blocks=10485760 2 block groups 8192 blocks per group, 8192 fragments per group 1280 inodes per group Superblock backups stored on blocks: 8193 Allocating group tables: done Writing inode tables: done Creating journal (1024 blocks): done Writing superblocks and filesystem accounting information: done command_with_stdin: 2018-05-31 19:14:01.018049 7f60281cc700 -1 auth: unable to find a keyring on /var/lib/ceph/bootstrap-osd/ceph.keyring: (2 ) No such file or directory 2018-05-31 19:14:01.018401 7f60281cc700 -1 monclient: ERROR: missing keyring, cannot use cephx for authentication 2018-05-31 19:14:01.018404 7f60281cc700 0 librados: client.bootstrap-osd initialization error (2) No such file or directory [errno 2] error connecting to the cluster '['ceph', '--cluster', 'ceph', '--name', 'client.bootstrap-osd', '--keyring', '/var/lib/ceph/bootstrap-osd/ceph.keyring', '-i', '-', 'osd', 'new', 'e590f7e2-9892-4c2f-bf5b-6ce7d1b3d488']' failed with status code 1 _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |