# robots.txt file for http://www.notariskantoordijkstra.nl/ # MSNBot is crawling a site too often then use crawl-delay # User-agent: msnbot # Crawl-delay: 120 User-agent: * Disallow: /Management