Mark H. Wood wrote: > Your chance to tell me where to go :-) > > I'm looking for a good place to discuss non-server-specific issues > relating to spidering. Such as: "I have this great new proposal that > would help us to segregate spider and real-user access in our > statistics...." > do you mean something like this? Robots/Spiders visitors (Top 25) 13 different robots* Hits Bandwidth Last visit Yahoo Slurp 136+94 3.50 MB 08 Jun 2007 - 13:49 MSNBot 27+26 8.12 MB 08 Jun 2007 - 11:17 Googlebot 18+12 70.28 KB 08 Jun 2007 - 08:41 Unknown robot crawl 19+9 79.12 KB 08 Jun 2007 - 10:49 Unknown robot spider 6+3 44.45 KB 06 Jun 2007 - 02:02 Unknown robot robots 0+8 4.10 KB 08 Jun 2007 - 12:20 Voila 3+4 15.44 KB 06 Jun 2007 - 09:17 Ask 3+3 20.39 KB 08 Jun 2007 - 10:07 Unknown robot bot/ 2+2 7.37 KB 06 Jun 2007 - 10:43 Netcraft 2 0 03 Jun 2007 - 06:21 MSNBot-media 1+1 3.45 KB 06 Jun 2007 - 08:12 Unknown robot 0+1 525 Bytes 05 Jun 2007 - 21:06 echo 1 2.23 KB 05 Jun 2007 - 05:37 * Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files This is AWStats breakdown. --------------------------------------------------------------------- The official User-To-User support forum of the Apache HTTP Server Project. See <URL:http://httpd.apache.org/userslist.html> for more info. To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx " from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx
|