The Lurker

Google now indexes Teoma search results

David Watson can't imagine why you would want Google to index and cache Teoma search result pages.

I was amazed that a search engine, of all things, wouldn't have a robots.txt to prevent other search engines from doing this — after all, the robots exclusion protocol was specifically created to warn off the spiders that search engines use.

(Of course, it's just a little bit worse than that. They compound their stupidity by doing something I have ranted about colourfully before: they redirect you to their home page.)

Related topics: Rants Web