break freeze request: increase MM crawler timeout

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



The mirrormanager crawler has a 60 minute timeout - if it can't crawl
the mirror in 60 minutes, it assumes it's running slow enough not to
be able to serve traffic reasonably, and marks it as not up-to-date,
dropping it from the mirror lists.

With the new alphabetical Packages/[0-9a-z]/*.rpm directory structure,
the crawler now as an additional ~36 directories to search in each of
24 (currently) directory trees, at 10 RPMs each being searched, at ~6
RPMs/second being checked, is another 24 minutes more than was
previously needed.  This is pushing mirrors that were previously
completing in just over 30 minutes, over the timeout.

I'd like to increase the timeout from 60 to 90 minutes.  I would like
to change the number of RPMs being looked at in each directory from 10
to 3 (it's the most recent 10 vs most recent 3; if you have the most
recent 3, you will have the next most recent 7 I would think...)

Thanks,
Matt

-- 
Matt Domsch
Technology Strategist
Dell | Office of the CTO
_______________________________________________
infrastructure mailing list
infrastructure@xxxxxxxxxxxxxxxxxxxxxxx
https://admin.fedoraproject.org/mailman/listinfo/infrastructure



[Index of Archives]     [Fedora Development]     [Fedora Users]     [Fedora Desktop]     [Fedora SELinux]     [Yosemite News]     [KDE Users]

  Powered by Linux