# Robots.txt file for Gloucester County, Virginia # Excludes the following folders or directories from # external search engines # User-agent: * means this applies to all external search engines # Disallow: /gcintranet is used to specify what directories to exclude #Slurp is a spider for Yahoo! User-agent: Slurp Crawl-delay: 300 Disallow: /gcintranet Disallow: /images Disallow: /graphics Disallow: /navigation%20buttons Disallow: /bannergraphics Disallow: /javascripts Disallow: /temp Disallow: /testwebapplications Disallow: /accessdenied Disallow: /adminscripts Disallow: /applets Disallow: /cgi-bin Disallow: /gcsecure Disallow: /_private Disallow: /InternetHotSpot User-agent: * Disallow: /gcintranet Disallow: /images Disallow: /graphics Disallow: /navigation%20buttons Disallow: /bannergraphics Disallow: /javascripts Disallow: /temp Disallow: /testwebapplications Disallow: /accessdenied Disallow: /adminscripts Disallow: /applets Disallow: /cgi-bin Disallow: /gcsecure Disallow: /_private Disallow: /InternetHotSpot