Brian Dunning wrote:
On Aug 11, 2005, at 3:44 PM, Evert | Collab wrote:
Use robots.txt
'evil' searchengines will spoof the user-agent string anyway
Can you be more specific about what you mean by "use robots.txt"?
I just want to cloak for Google, MSN, and Yahoo. I couldn't care less
about what any other search engine (evil or not) does or sees.
robots.txt will not do what you want it to.
Just sniff for those robots' User-Agents (Google, MSN and Yahoo all
publish their UA strings on their websites, AFAIK) and send different
content if it's one of those.
Jasper
--
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php
