Sure. I would like to know who, what, how on this one.
Scott
On Mon 2 January 2006 14:44, Gerry Danen wrote:
> When it crawls the site, if you get always a hit on a specific page, you
> could capture more info than you would get in the log. Sometimes the
> "browser" field has the name of the bot in it.
>
> You want to pursue this off-list?
>
> Gerry
>
> On 1/2/06, Scott Grayban <sgrayban@xxxxxxxxxx> wrote:
> >
> > Looks like only bots. I have a few hits of robots.txt getting hit first
> > then
> > it crawls the site but thats but I have more hits to the robots.txtwithout
a
> > crawl.
> >
> > It almost feels virus like but I have no windows computer here in my
> > network.
> >
> > Scott
> >
> > On Mon 2 January 2006 13:28, Gerry Danen wrote:
> > > Does it happen with real visitors also, or just bots?
> > >
> > > On 1/2/06, Scott Grayban <sgrayban@xxxxxxxxxx> wrote:
> > > >
> > > > The missing IP/Host of course. I have never seen this before and I
> > > > know it didn't come from anything I do here. This just started to
> > happen.
> > > >
> > > > Scott
> > > >
> > > > On Mon 2 January 2006 12:59, Gerry Danen wrote:
> > > > > Scott, what's the mystery, the missing IP or the GET robots.txt?
> > > >
> > > >
> > >
> >
> > ---------------------------------------------------------------------
> > The official User-To-User support forum of the Apache HTTP Server Project.
> > See <URL:http://httpd.apache.org/userslist.html> for more info.
> > To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
> > " from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx
> > For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx
> >
> >
>
>
> --
> Gerry
> http://portal.danen.org/
>
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
" from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx
For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx
|