Hi, I use some search engines, which work so far fine, but step into unwanted crawling behaviour when they encounter certain http response header information from the responding web servers. For instance: the http response header expires is fine for browser, but aks the search enginge to revisit as soon as possible after expiration date/time. Questions: 1. is it possible to unset http response headers depending on the name of the user agent or ip-address? 2. is it possible to strip or set http response headers by proxy like tools? regards Harald --------------------------------------------------------------------- The official User-To-User support forum of the Apache HTTP Server Project. See <URL:http://httpd.apache.org/userslist.html> for more info. To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx " from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx
|