# robots.txt for www.jdclark.org # Browsershots.org User-agent: Browsershots Disallow: # W3C Link Checker User-agent: W3C-checklink Disallow: # WDG HTML Validator User-agent: WDG_SiteValidator Disallow: # All other user-agents User-agent: * Disallow: /? Disallow: /assets/ Sitemap: http://www.jdclark.org/sitemap.xml