# For domain at http://www.compassie.net/ # All robots will spider the domain User-agent: * Disallow: # Show the way to the sitemaps # Exclude some folders User-agent: * Disallow: /afbeeldingen/ Disallow: /doc/ Disallow: /errors/ Disallow: /fotos/ Disallow: /geluiden/ Disallow: /scripts/ Disallow: /stijlbladen/ Disallow: /videos/ Disallow: /xls/ Disallow: /werk_voor_Rients/ #Restrict Unwanted bots User-agent: psbot User-agent: wget Disallow: /