# This robots.txt file controls crawling of URLs under https://www.dbz.de User-agent: * Crawl-delay: 5 User-agent: * Allow: / User-agent: * Crawl-delay: 5 User-agent: SiteAuditBot Crawl-delay: 1 Allow: / User-agent: * Crawl-delay: 5 User-agent: Semrushbot-SI Allow: / # Sitemap file Sitemap: https://www.dbz.de/sitemap.xml