On Tue, 26 Feb 2013, Stefan Priebe wrote: > Hi Sage, > > Am 26.02.2013 18:24, schrieb Sage Weil: > > On Tue, 26 Feb 2013, Stefan Priebe - Profihost AG wrote: > > > But that redults in a 1-3s hickup for all KVM vms. This is not what I > > > want. > > > > You can do > > > > kill $pid > > ceph osd down $osdid > > > > (or even reverse the order, if the sequence is quick enough) to avoid > > waiting for the failure detection delay. But if the OSDs are going down, > > then the peering has to happen one way or another. > > But exaclty this results in starting backfill immediatly. My idea was to first > mark the osd down so the mon knows about this fact. So no I/O is stalled. And > then reboot the whole host but exactly this does not work like expected as > backfilling is starting immediatly after setting the osd to down ;-( Backfilling should not happen on down, unless you have reconfigured 'mon osd down out interval = 0' or something along those lines. Setting the 'noout' flag will also prevent the osds from marking out. As for limiting the IO stall: you could also do 'ceph osd set noup', then mark them down, then kill the daemon, and you won't have to worry about racing with the daemon marking itself back up (as it normally does). sage -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html