Re: replace OSD disk without removing the osd from crush

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 07/09/2015 09:15 AM, Stefan Priebe - Profihost AG wrote:
> 
> Am 08.07.2015 um 23:33 schrieb Somnath Roy:
>> Yes, I am able to reproduce that too..Not sure if this is a bug or change.
> 
> That's odd. Can someone from inktank comment?
> 
> 

Not from Inktank, but here we go.

When you add a OSD again it has to match the OSDs UUID as in the OSDMap.

So when running mkfs for the OSD run it like this:

$ ceph-osd -i <id> --mkfs --mkjournal --keyring /path/to/keyring
--osd-uuid <uuid>

You can find the UUID in the OSDMap:

$ ceph osd dump|grep osd\.<id>

At the end you'll find the UUID of that OSD.

Without a matching UUID the OSD will refuse to start.

The OSD stores it's UUID in the datadir in the 'fsid' file.

Wido

>> Thanks & Regards
>> Somnath
>>
>> -----Original Message-----
>> From: Stefan Priebe [mailto:s.priebe@xxxxxxxxxxxx] 
>> Sent: Wednesday, July 08, 2015 1:09 PM
>> To: Somnath Roy; ceph-users
>> Subject: Re:  replace OSD disk without removing the osd from crush
>>
>> Hi,
>> Am 08.07.2015 um 22:03 schrieb Somnath Roy:
>>> Run 'ceph osd set noout' before replacing....
>>
>> sure but that didn't worked since firefly for me.
>>
>> I did:
>> # set noout
>> # ceph stop osd.5
>> # removed disk
>> # inserted new disk
>> # format disk and mount disk
>> # start mkjournal mkkey mkkfs
>> # remove old osd auth key add new key
>>
>> I can start the osd but i never comes up.
>>
>> It only works for me if i completely remove the osd and create a new one:
>> ceph osd crush remove osd.5
>> ceph auth del osd.5
>> ceph osd rm osd.5
>>
>> ceph osd create
>> ...
>>
>> Stefan
>>
>>> -----Original Message-----
>>> From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Stefan Priebe
>>> Sent: Wednesday, July 08, 2015 12:58 PM
>>> To: ceph-users
>>> Subject:  replace OSD disk without removing the osd from crush
>>>
>>> Hi,
>>>
>>> is there any way to replace an osd disk without removing the osd from crush, auth, ...
>>>
>>> Just recreate the same OSD?
>>>
>>> Stefan
>>> _______________________________________________
>>> ceph-users mailing list
>>> ceph-users@xxxxxxxxxxxxxx
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>> ________________________________
>>>
>>> PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies).
>>>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 


-- 
Wido den Hollander
42on B.V.
Ceph trainer and consultant

Phone: +31 (0)20 700 9902
Skype: contact42on
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux