On Wed, 23 Mar 2005 12:27:25 -0600, Jack Stone <antennex@xxxxxxxxxxx> wrote:
> Hello:
>
> For quite a while, I have been doing almost hand-to-hand combat with people
> using those mass downloaders like HTTRACK. Since the site in question is an
> online Tech Mag and meant to be read online, most sessions seen are where
> intent is to ignore the robots.text and download the entire website which is
> a huge amount of content. Of course, this hogs bandwidth and slows down
> things for all the other readers.
>
> When alerted to a session via one of those utilities, they are stopped via a
> deny of IP from the website.
>
> My Question:
> Is there a way to set a redirect to send any requests specifically from
> HTTRACK and others to a dead end so they suck air so I don't have to do this
> manually?
RewriteEngine On
RewriteCond %{HTTP_REFERER} HTTRACK
RewriteRule .* /path/to/nodownloadersallowed.html
Many people use something similar to block all those
email-address-harvesting robots.
Joshua.
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
" from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx
For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx
|