Re: [users@httpd] Is it possible to redirect mass downloaders?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



From: Joshua Slive <jslive@xxxxxxxxx>
Reply-To: Joshua Slive <jslive@xxxxxxxxx>
To: users@xxxxxxxxxxxxxxxx
Subject: Re: [users@httpd] Is it possible to redirect mass downloaders?
Date: Wed, 23 Mar 2005 13:49:45 -0500

On Wed, 23 Mar 2005 12:27:25 -0600, Jack Stone <antennex@xxxxxxxxxxx> wrote:
> Hello:
>
> For quite a while, I have been doing almost hand-to-hand combat with people > using those mass downloaders like HTTRACK. Since the site in question is an > online Tech Mag and meant to be read online, most sessions seen are where > intent is to ignore the robots.text and download the entire website which is
> a huge amount of content. Of course, this hogs bandwidth and slows down
> things for all the other readers.
>
> When alerted to a session via one of those utilities, they are stopped via a
> deny of IP from the website.
>
> My Question:
> Is there a way to set a redirect to send any requests specifically from
> HTTRACK and others to a dead end so they suck air so I don't have to do this
> manually?

RewriteEngine On
RewriteCond %{HTTP_REFERER} HTTRACK
RewriteRule .* /path/to/nodownloadersallowed.html

Many people use something similar to block all those
email-address-harvesting robots.

Joshua.


Joshua, thank you so much from the tip and syntax.

You are right about several more of them, webreaper is another.

Would this work to combine more than one offender?
RewriteEngine On
RewriteCond %{HTTP_REFERER} HTTRACK WebReaper
RewriteRule .* /path/to/nodownloadersallowed.html

Again, many thanks. This will be a very large help!

_________________________________________________________________
Express yourself instantly with MSN Messenger! Download today - it's FREE! http://messenger.msn.click-url.com/go/onm00200471ave/direct/01/


---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
  "   from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx
For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx



[Index of Archives]     [Open SSH Users]     [Linux ACPI]     [Linux Kernel]     [Linux Laptop]     [Kernel Newbies]     [Security]     [Netfilter]     [Bugtraq]     [Squid]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Samba]     [Video 4 Linux]     [Device Mapper]

  Powered by Linux