On Thu, Apr 05, 2007 at 12:56:15PM -0500, Matt Domsch wrote: > On Thu, Apr 05, 2007 at 07:51:12PM +0200, Axel Thimm wrote: > > BTW is there a special User-Agent: you use for crawling? > > I don't think so, I'm using httplib directly. I'll look into adding one. It will start using: mirrormanager-crawler/0.1 (+http://hosted.fedoraproject.org/projects/mirrormanager) shortly. Thanks, Matt -- Matt Domsch Software Architect Dell Linux Solutions linux.dell.com & www.dell.com/linux Linux on Dell mailing lists @ http://lists.us.dell.com
