# robots.txt to restrict search engine (and other) crawlers User-agent: * Disallow: /URLScanLogs/ Disallow: /ScriptResource.axd Disallow: /WebResource.axd Disallow: /*.axd$ Disallow: /CMSHelp/ Disallow: /CMSDesk/ Disallow: /CMSSiteManager/ Disallow: /App_Themes/ Disallow: /Errors/