Re: Weird log message

Tom Evans <tevans.uk@xxxxxxxxxxxxxx> · Wed, 24 Sep 2008 14:17:19 +0100

On Wed, 2008-09-24 at 13:55 +0200, Marcin 'Rambo' Roguski wrote:
> > Close, but no cigar. This is a multi-process apache waking up one of its
> > children.
> >
> > http://wiki.apache.org/httpd/InternalDummyConnection
> 
> OK, a variation to the question: I'm getting that annoying
> 
> williams - - [24/Sep/2008:14:46:03 +0200] "GET //gfx/arrow.gif HTTP/1.0"
> 200 62 "-"
> williams - - [24/Sep/2008:14:46:03 +0200] "GET //gfx/arrow.gif HTTP/1.0"
> 200 62 "-"
> crawl-66-249-71-16.googlebot.com - - [24/Sep/2008:14:46:03 +0200] "GET
> /?img=38&path=/Places/Warszawa/Okecie/Aircraft/Boeing%20737-300 HTTP/1.1"
> 200 4832 "-"
> 
> How to stop that? And not stop as ignore, but stop as have the server not
> do that (running 2.2.3 for the moment)?
> 

Stop google from indexing your site? 

http://www.robotstxt.org/faq/prevent.html

Cheers

Tom