09-02-2006, 01:39 PM
Quote:All savvy search engine marketers know how to create a search-friendly site that can be easily read by a search engine spider, or bot. But what happens when those bots go bad?...
Many site owners tell horror stories of lost uptime, wasted bandwidth and stolen content that have resulted from rogue spiders invading their virtual domains. Several experts, including representative from search engines Google, Yahoo and Become.com, sat on a panel to discuss the issues of "bot obedience."...
Glick went on to highlight how to create bot friendly sites using tactics such as hyper link navigation, or navigation that uses "pure" links with no javascript or Flash elements. Glick also suggested that web authors avoid excessive parameters in dynamic URLs when building bot friendly sites...
full article: http://searchenginewatch.com/showPage.html?page=3623312