Re: client.bootstrap-osd authentication error - which keyrin

[Paul Emmerich <paul.emmerich@xxxxxxxx>]

2018-07-09 16:10 GMT+02:00 Thomas Roth <t.roth@xxxxxx>:

Thanks, but doesn't work.

It is always the subcommand
/usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring
/var/lib/ceph/bootstrap-osd/ceph.keyring osd tree -f json

(also 'ceph ... osd tree -i - osd new NEWID')

which fails with client.bootstrap-osd authentication error

Of course, 'ceph osd tree' works just fine.


Must be something I have missed when upgrading from Jewel. In fact, there where no
boostrap-xxx/keyrings anywhere, I just have my /etc/ceph/ceph.mon.keyring which seems to have managed
the magic before.

You have to put it there manually if you don't use any deployment tool like ceph-deploy.

If you have a normal admin keyring on that server anyways, then you can just run

ceph auth get client.bootstrap-osd > /var/lib/ceph/bootstrap-osd/ceph.keyring

Paul

 

Cheers,
Thommas

On 07/06/2018 09:36 PM, Paul Emmerich wrote:
> Hi,
>
> both ceph-disk and ceph-volume need a keyring in the file
>
> /var/lib/ceph/bootstrap-osd/ceph.keyring
>
> The key should look like this:
>
> [client.bootstrap-osd]
>     key = XXXX
>     caps mon = "allow profile bootstrap-osd"
>
>
> Paul
>
>
> 2018-07-06 16:47 GMT+02:00 Thomas Roth <t.roth@xxxxxx>:
>
>> Hi all,
>>
>> I wonder which is the correct key to create/recreate an additional OSD
>> with 12.2.5.
>>
>> Following
>> http://docs.ceph.com/docs/master/rados/operations/
>> bluestore-migration/#convert-existing-osds, I took
>> one of my old OSD out of the cluster, but failed subsequently recreating
>> it as a BlueStor OSD.
>>
>> I tried "ceph-volume" at first, now got one step further using "ceph-disk"
>> with
>> "ceph-disk prepare --bluestore /dev/sdh", which completed, I assume
>> successfully.
>>
>> However, "ceph-disk activate" fails with basically the same error as
>> "ceph-volume" before,
>>
>>
>> ~# ceph-disk activate /dev/sdh1
>> command_with_stdin: 2018-07-06 16:23:18.677429 7f905de45700  0 librados:
>> client.bootstrap-osd
>> authentication error (1) Operation not permitted
>> [errno 1] error connecting to the cluster
>>
>>
>>
>> Now this test cluster was created under Jewel, where I created OSDs by
>> "ceph-osd -i $ID --mkfs --mkkey --osd-uuid $UUID"
>> and
>> "ceph auth add osd.#{ID} osd 'allow *' mon 'allow profile osd' -i
>> /var/lib/ceph/osd/ceph-#{ID}/keyring"
>>
>> This did not produce any "/var/lib/ceph/bootstrap-osd/ceph.keyring", but
>> I found them on my mon hosts.
>> "ceph-volume" and "ceph-disk" go looking for that file, so I put it there,
>> to no avail.
>>
>>
>>
>> Btw, the target server has still several "up" and "in" OSDs running, so
>> this is not a question of
>> network or general authentication issues.
>>
>> Cheers,
>> Thomas
>> _______________________________________________
>> ceph-users mailing list
>> ceph-users@xxxxxxxxxxxxxx
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
>
>

--

--------------------------------------------------------------------
Thomas Roth
Department: Informationstechnologie
Location: SB3 2.291
Phone: +49-6159-71 1453  Fax: +49-6159-71 2986

GSI Helmholtzzentrum für Schwerionenforschung GmbH
Planckstraße 1
64291 Darmstadt
www.gsi.de

Gesellschaft mit beschränkter Haftung
Sitz der Gesellschaft: Darmstadt
Handelsregister: Amtsgericht Darmstadt, HRB 1528

Geschäftsführung: Ursula Weyrich
Professor Dr. Paolo Giubellino
Jörg Blaurock

Vorsitzende des Aufsichtsrates: St Dr. Georg Schütte
Stellvertreter: Ministerialdirigent Dr. Rolf Bernhardt

--

Paul Emmerich

Looking for help with your Ceph cluster? Contact us at https://croit.io

croit GmbH
Freseniusstr. 31h
81247 München
www.croit.io
Tel: +49 89 1896585 90

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com