Re: deep scrubbing causes osd down

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Mon, 13 Apr 2015 13:42:39 +0800 池信泽 wrote:

I knew the scheduler was in the pipeline, good to see it made it in.

However the vast majority of people with production clusters will be
running something "stable", mostly Firefly at this moment.

> Sorry, 0.87 is giant.
> 
> BTW, you could also set osd_scrub_sleep to your cluster. ceph would
> sleep some time as you defined when it has scrub some objects.
> But I am not sure whether is could works good to you.
> 
Yeah, that bit is backported to Firefly and can definitely help, however
the suggested initial value is too small for most people who have scrub
issues, starting with 0.5 seconds and see how it goes seems to work better.

Christian

> Thanks.
> 
> 2015-04-13 13:30 GMT+08:00 池信泽 <xmdxcxz@xxxxxxxxx>:
> > hi, you could restrict scrub to certain times of day based on
> > https://github.com/ceph/ceph/pull/3318.
> >
> > You could set osd_scrub_begin_hour and osd_scrub_begin_hour which are
> > suitable for you. This feature is available since 0.93.
> >
> > But it has not been backport to 0.87 (hammer).
> >
> > 2015-04-13 12:55 GMT+08:00 Lindsay Mathieson
> > <lindsay.mathieson@xxxxxxxxx>:
> >>
> >> On 13 April 2015 at 11:02, Christian Balzer <chibi@xxxxxxx> wrote:
> >>>
> >>> Yeah, that's a request/question that comes up frequently.
> >>> And so far there's no option in Ceph to do that (AFAIK), it would be
> >>> really nice along with scheduling options (don't scrub during peak
> >>> hours), which have also been talked about.
> >>
> >>
> >>
> >>
> >> I was just about to post a question on that ... :)
> >>
> >> Just had devs and support bitching to me that all their VM's were
> >> running like dogs (they were). Ceph decided to run a deep scrub
> >> Monday afternoon.
> >>
> >> It boggles me that there are no options for controlling the schedule,
> >> considering how critically important the timing is. I'd be happy to
> >> run a deep scrub ever night at 1am. Anytime during the day is a
> >> disaster.
> >>
> >> So currently I have noscrub and nodeep-scrub set which is really less
> >> than ideal.
> >>
> >>
> >> --
> >> Lindsay
> >>
> >> _______________________________________________
> >> ceph-users mailing list
> >> ceph-users@xxxxxxxxxxxxxx
> >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >>
> >
> >
> >
> > --
> > Regards,
> > xinze
> 
> 
> 


-- 
Christian Balzer        Network/Systems Engineer                
chibi@xxxxxxx   	Global OnLine Japan/Fusion Communications
http://www.gol.com/
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com





[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux