## robots.txt -- for more info see: ## http://info.webcrawler.com/mak/projects/robots/norobots.html User-agent: * Disallow: /archive/