Re: Master and mirror crawling

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Sat, Sep 12, 2015 at 12:52:55PM -0600, Kevin Fenzi wrote:
> > On Fri, Sep 11, 2015 at 04:56:41PM +0200, Adrian Reber wrote:
> > [...]
> > > So my main question is if we should insert a delay between umdl and
> > > the crawl of the mirrors? This would require a fedmsg emitted at
> > > the end of an umdl run and something on the crawler which waits
> > > some time before starting the crawls.
> > 
> > Thinking more about it, it actually does not make much sense to base
> > the mirror crawls on fedmsg. The mirrors are updated at (from our
> > point of view) random times. So with category based crawling we have
> > the possibility to increase the crawl frequency for Fedora Linux and
> > Fedora EPEL and decrease it for Fedora Archive. Which should
> > hopefully give MirrorManager a better view of the status of the
> > mirrors.
> 
> Well, mirrors that are using your script to trigger syncs after a
> fedmsg would be syncing right after that as well, but might depend on
> how long it takes them to sync. 

Yes, my mirror syncs from ::fedora-buffet0/ and that takes a few hours.

		Adrian

Attachment: pgpl252AaaLPL.pgp
Description: PGP signature

_______________________________________________
infrastructure mailing list
infrastructure@xxxxxxxxxxxxxxxxxxxxxxx
http://lists.fedoraproject.org/postorius/infrastructure@xxxxxxxxxxxxxxxxxxxxxxx

[Index of Archives]     [Fedora Development]     [Fedora Users]     [Fedora Desktop]     [Fedora SELinux]     [Yosemite News]     [KDE Users]

  Powered by Linux