# if you want to add own robot rules, do it BEFORE the final rule matching * User-agent: * Crawl-delay: 20 Disallow: /doa/ #Sitemap: http://localhost:8080/?action=sitemap