On Mon, Jul 9, 2018 at 10:10 AM, Thomas Roth <t.roth@xxxxxx> wrote: > Thanks, but doesn't work. > > It is always the subcommand > /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring > /var/lib/ceph/bootstrap-osd/ceph.keyring osd tree -f json > > (also 'ceph ... osd tree -i - osd new NEWID') > > which fails with client.bootstrap-osd authentication error > > Of course, 'ceph osd tree' works just fine. > > > Must be something I have missed when upgrading from Jewel. In fact, there where no > boostrap-xxx/keyrings anywhere, I just have my /etc/ceph/ceph.mon.keyring which seems to have managed > the magic before. Provisioning tools like ceph-deploy will add the bootstrap keyring if not present. Please not that /etc/ceph/*.keyring is not sufficient here. The bootstrap key must exist. > > Cheers, > Thommas > > On 07/06/2018 09:36 PM, Paul Emmerich wrote: >> Hi, >> >> both ceph-disk and ceph-volume need a keyring in the file >> >> /var/lib/ceph/bootstrap-osd/ceph.keyring >> >> The key should look like this: >> >> [client.bootstrap-osd] >> key = XXXX >> caps mon = "allow profile bootstrap-osd" >> >> >> Paul >> >> >> 2018-07-06 16:47 GMT+02:00 Thomas Roth <t.roth@xxxxxx>: >> >>> Hi all, >>> >>> I wonder which is the correct key to create/recreate an additional OSD >>> with 12.2.5. >>> >>> Following >>> http://docs.ceph.com/docs/master/rados/operations/ >>> bluestore-migration/#convert-existing-osds, I took >>> one of my old OSD out of the cluster, but failed subsequently recreating >>> it as a BlueStor OSD. >>> >>> I tried "ceph-volume" at first, now got one step further using "ceph-disk" >>> with >>> "ceph-disk prepare --bluestore /dev/sdh", which completed, I assume >>> successfully. >>> >>> However, "ceph-disk activate" fails with basically the same error as >>> "ceph-volume" before, >>> >>> >>> ~# ceph-disk activate /dev/sdh1 >>> command_with_stdin: 2018-07-06 16:23:18.677429 7f905de45700 0 librados: >>> client.bootstrap-osd >>> authentication error (1) Operation not permitted >>> [errno 1] error connecting to the cluster >>> >>> >>> >>> Now this test cluster was created under Jewel, where I created OSDs by >>> "ceph-osd -i $ID --mkfs --mkkey --osd-uuid $UUID" >>> and >>> "ceph auth add osd.#{ID} osd 'allow *' mon 'allow profile osd' -i >>> /var/lib/ceph/osd/ceph-#{ID}/keyring" >>> >>> This did not produce any "/var/lib/ceph/bootstrap-osd/ceph.keyring", but >>> I found them on my mon hosts. >>> "ceph-volume" and "ceph-disk" go looking for that file, so I put it there, >>> to no avail. >>> >>> >>> >>> Btw, the target server has still several "up" and "in" OSDs running, so >>> this is not a question of >>> network or general authentication issues. >>> >>> Cheers, >>> Thomas >>> _______________________________________________ >>> ceph-users mailing list >>> ceph-users@xxxxxxxxxxxxxx >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>> >> >> >> > > -- > -------------------------------------------------------------------- > Thomas Roth > Department: Informationstechnologie > Location: SB3 2.291 > Phone: +49-6159-71 1453 Fax: +49-6159-71 2986 > > GSI Helmholtzzentrum für Schwerionenforschung GmbH > Planckstraße 1 > 64291 Darmstadt > www.gsi.de > > Gesellschaft mit beschränkter Haftung > Sitz der Gesellschaft: Darmstadt > Handelsregister: Amtsgericht Darmstadt, HRB 1528 > > Geschäftsführung: Ursula Weyrich > Professor Dr. Paolo Giubellino > Jörg Blaurock > > Vorsitzende des Aufsichtsrates: St Dr. Georg Schütte > Stellvertreter: Ministerialdirigent Dr. Rolf Bernhardt > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |