On Mon, Feb 28, 2022 at 5:56 PM Michael Richardson <mcr+ietf@xxxxxxxxxxxx> wrote:
It's good to see robots.txt coming to the IETF.
I think that this is coming via AD sponsorship. Was there a dispatch
discussion/action that I missed?
It came to the ART list for discussion in 2019, if you're looking for some of the previous background.
regards,
Ted
I see that the document is Informational.
I'm unclear if this document is identical to the 1996 description, or if
there are changes against the 1996 version.
Are there plans to revise the protocol further, and this is the first step?
I wonder if 2.3.1.2. Redirects should suggest the file be moved to
/.well-known/robots.txt with a redirect, that perhaps shouldn't be counted.
That would be a change which may be more than desired.
(I was thinking on the weekend about some extensions that would fit nicely
into robots.txt)
--
Michael Richardson <mcr+IETF@xxxxxxxxxxxx> . o O ( IPv6 IøT consulting )
Sandelman Software Works Inc, Ottawa and Worldwide
-- last-call mailing list last-call@xxxxxxxx https://www.ietf.org/mailman/listinfo/last-call
