Thanks, but doesn't work. It is always the subcommand /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring osd tree -f json (also 'ceph ... osd tree -i - osd new NEWID') which fails with client.bootstrap-osd authentication error Of course, 'ceph osd tree' works just fine. Must be something I have missed when upgrading from Jewel. In fact, there where no boostrap-xxx/keyrings anywhere, I just have my /etc/ceph/ceph.mon.keyring which seems to have managed the magic before. Cheers, Thommas On 07/06/2018 09:36 PM, Paul Emmerich wrote: > Hi, > > both ceph-disk and ceph-volume need a keyring in the file > > /var/lib/ceph/bootstrap-osd/ceph.keyring > > The key should look like this: > > [client.bootstrap-osd] > key = XXXX > caps mon = "allow profile bootstrap-osd" > > > Paul > > > 2018-07-06 16:47 GMT+02:00 Thomas Roth <t.roth@xxxxxx>: > >> Hi all, >> >> I wonder which is the correct key to create/recreate an additional OSD >> with 12.2.5. >> >> Following >> http://docs.ceph.com/docs/master/rados/operations/ >> bluestore-migration/#convert-existing-osds, I took >> one of my old OSD out of the cluster, but failed subsequently recreating >> it as a BlueStor OSD. >> >> I tried "ceph-volume" at first, now got one step further using "ceph-disk" >> with >> "ceph-disk prepare --bluestore /dev/sdh", which completed, I assume >> successfully. >> >> However, "ceph-disk activate" fails with basically the same error as >> "ceph-volume" before, >> >> >> ~# ceph-disk activate /dev/sdh1 >> command_with_stdin: 2018-07-06 16:23:18.677429 7f905de45700 0 librados: >> client.bootstrap-osd >> authentication error (1) Operation not permitted >> [errno 1] error connecting to the cluster >> >> >> >> Now this test cluster was created under Jewel, where I created OSDs by >> "ceph-osd -i $ID --mkfs --mkkey --osd-uuid $UUID" >> and >> "ceph auth add osd.#{ID} osd 'allow *' mon 'allow profile osd' -i >> /var/lib/ceph/osd/ceph-#{ID}/keyring" >> >> This did not produce any "/var/lib/ceph/bootstrap-osd/ceph.keyring", but >> I found them on my mon hosts. >> "ceph-volume" and "ceph-disk" go looking for that file, so I put it there, >> to no avail. >> >> >> >> Btw, the target server has still several "up" and "in" OSDs running, so >> this is not a question of >> network or general authentication issues. >> >> Cheers, >> Thomas >> _______________________________________________ >> ceph-users mailing list >> ceph-users@xxxxxxxxxxxxxx >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > > > -- -------------------------------------------------------------------- Thomas Roth Department: Informationstechnologie Location: SB3 2.291 Phone: +49-6159-71 1453 Fax: +49-6159-71 2986 GSI Helmholtzzentrum für Schwerionenforschung GmbH Planckstraße 1 64291 Darmstadt www.gsi.de Gesellschaft mit beschränkter Haftung Sitz der Gesellschaft: Darmstadt Handelsregister: Amtsgericht Darmstadt, HRB 1528 Geschäftsführung: Ursula Weyrich Professor Dr. Paolo Giubellino Jörg Blaurock Vorsitzende des Aufsichtsrates: St Dr. Georg Schütte Stellvertreter: Ministerialdirigent Dr. Rolf Bernhardt _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com