# ROBOTS.TXT # Information for webcrawlers. # # First tell normal spiders where no suitable information is found. # Note that there is no information being served in these directories anyway # User-agent: * Disallow: /MasterPage/ Disallow: /UserControl/ Disallow: /App_Data/ Disallow: /App_Code/ # # The following directory contains no information that should be cached # Disallow: /CSS/ Disallow: /pdf/ Disallow: /Interface/ # # We prefer no visit from the Googlebot-Image crawler, most of our images are # protected by copyright, so they should not be used outside this website anyway. # User-Agent: Googlebot-Image Disallow: /Images/