[Hotplug_sig] PLM patch spider

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Thu, 2005-06-23 at 12:39 -0700, Dave Hansen wrote:
> On Mon, 2005-05-02 at 13:41 -0700, Judith Lebzelter wrote:
> > We have a cron job that will hit the patch directory once every three 
> > hours to check for new patches.  It also pulls a patch if it finds one.  
> > This is the same schedule we use for other kernel patches.
> 
> Is there a chance that you guys could update your PLM fetcher a little
> bit?  It likes to go looking for files that aren't actually present on
> my web server, which generates a fair amount of log output that I
> usually like to keep an eye on.  That isn't a big problem in and of
> itself, it just bloats the logs.
> 
> The user agent strings are now something like: "PLM/0.1" and
> "lwp-trivial/1.41".  Could they, perhaps, get a little bit more
> informative, like:
> 
> 	"PLM/0.1 patch spider http://developer.osdl.org/dev/stp/";
> 
> Also, it would be kind if they obeyed robots.txt, or at least fetched
> it.  My log analyzer will detect robots based just on fetching
> "robots.txt" when beginning a crawl.
> 
> -- Dave

Hi Dave,

Bryce is out of the office this week (I believe he's the one that wrote
the PLM fetcher). But I'll put your request for changes in the SIG TODO
list and it will be addressed shortly.

Regards,
Martine
> 
> _______________________________________________
> Hotplug_sig mailing list
> Hotplug_sig@xxxxxxxxxxxxxx
> http://lists.osdl.org/mailman/listinfo/hotplug_sig


[Index of Archives]     [Linux Kernel]     [Linux DVB]     [Asterisk Internet PBX]     [DCCP]     [Netdev]     [X.org]     [Util Linux NG]     [Fedora Women]     [ALSA Devel]     [Linux USB]

  Powered by Linux