On 2014.05.02 16:01, Andrey Korolyov wrote: > On 05/02/2014 03:27 PM, Indra Pramana wrote: >> Hi, >> >> May I know if it's possible to replace an OSD drive without removing / >> re-adding back the OSD? I want to avoid the time and the excessive I/O >> load which will happen during the recovery process at the time when: >> >> - the OSD is removed; and >> - the OSD is being put back into the cluster. >> >> I read David Zafman's comment on this thread, that we can set "noout", >> take OSD "down", replace the drive, and then bring the OSD back "up" and >> unset "noout". >> >> http://www.spinics.net/lists/ceph-users/msg05959.html >> >> May I know if it's possible to do this? >> >> - ceph osd set noout >> - sudo stop ceph-osd id=12 >> - Replace the drive, and once done: >> - sudo start ceph-osd id=12 >> - ceph osd unset noout >> >> The cluster was built using ceph-deploy, can we just replace a drive >> like that without zapping and preparing the disk using ceph-deploy? >> > There will be absolutely no quirks except continuous remapping with > peering along entire recovery process. If your cluster may meet this > well, there is absolutely no problem to go through this flow. Otherwise, > in longer out+in flow, there are only two short intensive recalculations > which can be done at the scheduled time, comparing with peering during > remap, which can introduce unnecessary I/O spikes. I am interested in such replacements too. What about preparing new disk? I think that ceph-deploy osd prepare does not suit in this case, because only disk needs to be prepared, not OSD (or is there an option to prepare disk for specific OSD?)