Re: 404's to robots.txt?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Evan Platt wrote:
...

65.55.106.173 - - [21/Jul/2009:09:44:43 -0700] "GET /robots.txt HTTP/1.1" 404 208 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)" 65.55.106.112 - - [21/Jul/2009:10:11:43 -0700] "GET /robots.txt HTTP/1.1" 404 208 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)" 65.55.106.166 - - [21/Jul/2009:11:03:35 -0700] "GET /robots.txt HTTP/1.1" 404 208 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)" 65.55.106.160 - - [21/Jul/2009:11:09:07 -0700] "GET /robots.txt HTTP/1.1" 200 28 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"

I missed the above one on the first reading. This is a 200, in the middle of the 404's.. ?

65.55.106.180 - - [21/Jul/2009:11:35:34 -0700] "GET /robots.txt HTTP/1.1" 404 208 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"



---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
  "   from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx
For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx


[Index of Archives]     [Open SSH Users]     [Linux ACPI]     [Linux Kernel]     [Linux Laptop]     [Kernel Newbies]     [Security]     [Netfilter]     [Bugtraq]     [Squid]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Samba]     [Video 4 Linux]     [Device Mapper]

  Powered by Linux