robots.txt and rewrite rule

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello,
I have the following http.conf entry:

<VirtualHost *:80>
   ServerName domain.com
   ServerAlias www.domain.com
  <IfModule mod_rewrite.c>
     RewriteEngine On
     #DenyHosts Rules
     RewriteMap    hosts-deny      txt:/home/user/txt/hosts.deny
     RewriteCond   ${hosts-deny:%{REMOTE_HOST}|NOT-FOUND} !=NOT-FOUND [OR]
     RewriteCond   ${hosts-deny:%{REMOTE_ADDR}|NOT-FOUND} !=NOT-FOUND [OR]
     RewriteCond   ${hosts-deny:%{HTTP:true-client-ip}|NOT-FOUND} !=NOT-FOUND
     RewriteRule   ^/.*  -  [F]
     RewriteRule ^/(.*) http://localhost:12080/companies/$1 [P]
     RequestHeader set X-Base-Path companies/
  </IfModule>
   RewriteLogLevel 9
   RewriteLog /var/log/apache2/uk_rewrite.log
   ErrorLog       /var/log/apache2/uk_error.log
        <Directory "/var/www/localhost/htdocs">
                Options Indexes FollowSymLinks
                AllowOverride None
                Order allow,deny
                Allow from all
        </Directory>
</VirtualHost>

Is there a way I can put a robots.txt file to reside outside of the
rewrite, so that if a the bots look for http://domain.com/robots.txt
the rewrite does not push it to the
localhost:12080/companies/robots.txt

Cheers

Norman

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
   "   from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx
For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx


[Index of Archives]     [Open SSH Users]     [Linux ACPI]     [Linux Kernel]     [Linux Laptop]     [Kernel Newbies]     [Security]     [Netfilter]     [Bugtraq]     [Squid]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Samba]     [Video 4 Linux]     [Device Mapper]

  Powered by Linux