Yes, I followed the procedure. Also, I'm not able to create new OSD's at all in mimic, even on a newly deployed osd server. Same error. Even if I pass the --id {1d} parameter to the ceph-volume command, it still uses the first available ID and not the one I specify. Mike Kuriger Sr. Unix Systems Engineer T: 818-649-7235 M: 818-434-6195 -----Original Message----- From: Vasu Kulkarni [mailto:vakulkar@xxxxxxxxxx] Sent: Thursday, June 07, 2018 1:53 PM To: Michael Kuriger Cc: ceph-users Subject: Re: cannot add new OSDs in mimic It is actually documented in replacing osd case, https://urldefense.proofpoint.com/v2/url?u=http-3A__docs.ceph.com_docs_master_rados_operations_add-2Dor-2Drm-2Dosds_-23replacing-2Dan-2Dosd&d=DwIFaQ&c=5m9CfXHY6NXqkS7nN5n23w&r=5r9bhr1JAPRaUcJcU-FfGg&m=aq6X3Wv3kt3ORFoya83IqZqUQY0UzkWP_E09S0RuOk8&s=8qLqOnvmldGsBQFSfdTyP9q4tPrD5oViYvgvybXJDm8&e=, I hope you followed that procedure? On Thu, Jun 7, 2018 at 1:11 PM, Michael Kuriger <mk7193@xxxxxxxxx> wrote: > Do you mean: > ceph osd destroy {ID} --yes-i-really-mean-it > > Mike Kuriger > > > > -----Original Message----- > From: Vasu Kulkarni [mailto:vakulkar@xxxxxxxxxx] > Sent: Thursday, June 07, 2018 12:28 PM > To: Michael Kuriger > Cc: ceph-users > Subject: Re: cannot add new OSDs in mimic > > There is a osd destroy command but not documented, did you run that as well? > > On Thu, Jun 7, 2018 at 12:21 PM, Michael Kuriger <mk7193@xxxxxxxxx> wrote: >> CEPH team, >> Is there a solution yet for adding OSDs in mimic - specifically re-using old IDs? I was looking over this BUG report - https://urldefense.proofpoint.com/v2/url?u=https-3A__tracker.ceph.com_issues_24423&d=DwIFaQ&c=5m9CfXHY6NXqkS7nN5n23w&r=5r9bhr1JAPRaUcJcU-FfGg&m=0PCKiecm216R95S_krqboYMskCBoolGysrvgHZo8LEM&s=hfI2uudTfY0lGtBI6iIXvZWvNpme4xwBJe2SWx0_N3I&e= and my issue is similar. I removed a bunch of OSD's after upgrading to mimic and I'm not able to re-add them using the new volume format. I haven't tried manually adding them using 'never used' IDs. I'll try that now but was hoping there would be a fix. >> >> Thanks! >> >> Mike Kuriger >> >> _______________________________________________ >> ceph-users mailing list >> ceph-users@xxxxxxxxxxxxxx >> https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.ceph.com_listinfo.cgi_ceph-2Dusers-2Dceph.com&d=DwIFaQ&c=5m9CfXHY6NXqkS7nN5n23w&r=5r9bhr1JAPRaUcJcU-FfGg&m=0PCKiecm216R95S_krqboYMskCBoolGysrvgHZo8LEM&s=2aoWc5hTz041_26Stz6zPtLiB5zGFw2GbX3TPjsvieI&e= _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com