Re: robots.txt and rewrite rule

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi, sorry, but this did not work.
As now when I type the http://domain.com/robots.txt the page returned
is from within my cms application and not from the default

I am using the python framework itools (http://www.hforge.org) and
this has in its URI a semi-column i.e. http://www.hforge.org/;view

Can I call my robots.txt file anything?

Cheers

Norman

On Thu, Jan 22, 2009 at 6:40 PM, Bob Ionescu <bobsiegen@xxxxxxxxxxxxxx> wrote:
> 2009/1/22 Norman Khine <norman@xxxxxxxxx>:
>> Is there a way I can put a robots.txt file to reside outside of the
>> rewrite, so that if a the bots look for http://domain.com/robots.txt
>> the rewrite does not push it to the
>> localhost:12080/companies/robots.txt
>
> Just exclude the specific path:
>
> RewriteCond $1 !=robots.txt
> RewriteRule ^/(.*) http://localhost:12080/companies/$1 [P]
>
> Bob
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
>   "   from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx
> For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx
>
>

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
   "   from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx
For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx


[Index of Archives]     [Open SSH Users]     [Linux ACPI]     [Linux Kernel]     [Linux Laptop]     [Kernel Newbies]     [Security]     [Netfilter]     [Bugtraq]     [Squid]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Samba]     [Video 4 Linux]     [Device Mapper]

  Powered by Linux