On 2 Jul 2019, at 14:16, James Moe <jimoe@xxxxxxxxxxxxxx.INVALID> wrote: > /condalia1398.xml.gz > /heling348628-h1819-746-be2dochmiacal-97a2-/6a465d7hll78i1/ … > Is there a way to write a filter that blocks the above URL patterns > without generating a 404 response? Have you looked into robots.txt? And a sitemap? -- "Patience has its limits. Take it too far, and it's cowardice." - George Jackson --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx
|