Sure. I would like to know who, what, how on this one. Scott On Mon 2 January 2006 14:44, Gerry Danen wrote: > When it crawls the site, if you get always a hit on a specific page, you > could capture more info than you would get in the log. Sometimes the > "browser" field has the name of the bot in it. > > You want to pursue this off-list? > > Gerry > > On 1/2/06, Scott Grayban <sgrayban@xxxxxxxxxx> wrote: > > > > Looks like only bots. I have a few hits of robots.txt getting hit first > > then > > it crawls the site but thats but I have more hits to the robots.txtwithout a > > crawl. > > > > It almost feels virus like but I have no windows computer here in my > > network. > > > > Scott > > > > On Mon 2 January 2006 13:28, Gerry Danen wrote: > > > Does it happen with real visitors also, or just bots? > > > > > > On 1/2/06, Scott Grayban <sgrayban@xxxxxxxxxx> wrote: > > > > > > > > The missing IP/Host of course. I have never seen this before and I > > > > know it didn't come from anything I do here. This just started to > > happen. > > > > > > > > Scott > > > > > > > > On Mon 2 January 2006 12:59, Gerry Danen wrote: > > > > > Scott, what's the mystery, the missing IP or the GET robots.txt? > > > > > > > > > > > > > > > --------------------------------------------------------------------- > > The official User-To-User support forum of the Apache HTTP Server Project. > > See <URL:http://httpd.apache.org/userslist.html> for more info. > > To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx > > " from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx > > For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx > > > > > > > -- > Gerry > http://portal.danen.org/ > --------------------------------------------------------------------- The official User-To-User support forum of the Apache HTTP Server Project. See <URL:http://httpd.apache.org/userslist.html> for more info. To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx " from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx
|