I've found that it helps to shut down the osds before shutting down the host. Especially if the node is also a monitor. It seems that some OSD shutdown messages get lost while monitors are holding elections.
On Tue, Dec 2, 2014 at 10:10 AM, Christoph Adomeit <Christoph.Adomeit@xxxxxxxxxxx> wrote:
Hi there,
I have a giant cluster with 60 OSDs on 6 OSD Hosts.
Now I want to do maintenance on one of the OSD Hosts.
The documented Procedure is to "ceph osd set noout" and then shutdown
the OSD Node for maintenance.
However, as soon as I even shut down 1 OSD I get around 200 slow requests
and the number of slow requests is growing for minutes.
The test was done at night with low IOPS and I was expecting the cluster
to handle this condition much better.
Is there some way of a more graceful shutdown of OSDs so that I can prevent
those slow requests ? I suppose it takes some time until monitor gets
notified that an OSD was shutdown.
Thanks
Christoph
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com