Re: Reverse Proxy robots.txt

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

To: users@xxxxxxxxxxxxxxxx, 56independent <56independent@xxxxxxxxxxxxxx>
Subject: Re: Reverse Proxy robots.txt
From: David Jentes <daviddgtntpersonal@xxxxxxxxx>
Date: Thu, 9 Sep 2021 18:50:14 -0500
In-reply-to: <2w9VsHypRtmMudnSrrF_jwXHC4ibJkYQHdikDWOZWXGpbViKz3IsZKH_IcSfHHnqwNIZfcA20s7PUnSBAJ0UoU8ueS43vapm8xyuV3Mxzis=@protonmail.com>
Reply-to: users@xxxxxxxxxxxxxxxx

Yes, I am using it in /robots.txt. It's also what I'm testing it with. It's not super urgent, but we'd like to finish it ASAP.

On Thu, Sep 9, 2021 at 1:44 PM 56independent <56independent@xxxxxxxxxxxxxx.invalid> wrote:

> I've tried it, but it's not working

Is robots.txt in the root directory of your website? having example.com/robots/robots.txt won't work. It *has* to be in example.com/robots.txt

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx

Follow-Ups:
- Re: Reverse Proxy robots.txt
  - From: Will Fatherley

References:
- Reverse Proxy robots.txt
  - From: David Jentes
- Re: Reverse Proxy robots.txt
  - From: Frank Gingras
- Re: Reverse Proxy robots.txt
  - From: David Jentes
- Re: Reverse Proxy robots.txt
  - From: 56independent

Prev by Date: Re: Reverse Proxy robots.txt
Next by Date: Re: X-Frame-Options and security
Previous by thread: Re: Reverse Proxy robots.txt
Next by thread: Re: Reverse Proxy robots.txt
Index(es):
- Date
- Thread

[Index of Archives] [Open SSH Users] [Linux ACPI] [Linux Kernel] [Linux Laptop] [Kernel Newbies] [Security] [Netfilter] [Bugtraq] [Squid] [Yosemite News] [MIPS Linux] [ARM Linux] [Linux Security] [Linux RAID] [Samba] [Video 4 Linux] [Device Mapper]