# Robots.txt file from http://www.searchengineworld.com # # Built from text file # # This restricts access to only known and registered robots. # # if you need to restrict the crawl speed use ' Crawl-delay: 120' (in sec) User-agent: * Sitemap: http://blog.ttnet.net/sitemap.xml