You should be able to use a rewrite rule that redirects to another server / port / worker. https://www.google.com/search?q=apache+redirect+based+on+useragent ~ john On Jul 2, 2013, at 2:39 AM, Pete Jones wrote: > Hello > > We have a small cluster of machines serving a wiki website. Search engine robots are allowed in to index the website and these create a lot of traffic that can affect the service. I would like to redirect all http requests from these robots to one of the machines in the cluster. > Any ideas for how to do this ? > > Many thanks in advance for any advice --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx