# Disallow all crawlers access to certain pages. sitemap: http://www.shinyorb.com/sitemap.xml.gz User-agent: * Disallow: /dev/ Disallow: /admin/ Disallow: /testzone/ Disallow: /old/