#Default robots.txt file (which asks all bots to crawl slowly but still index everything). User-agent: * Crawl-delay: 1 Disallow: Sitemap: https://www.craftbrewingbusiness.com/sitemap_index.xml