# Robots.txt file for http://www.xday.info # # Based on file from http://www.searchengineworld.com # # Disallows mainly directories where most files are temporary. User-agent: * Disallow: /cgi-bin/ Disallow: /cgi/ Disallow: /archives/ Disallow: /testbed/