# robots.txt for https://dollysdream.org.au/ sitemap: https://dollysdream.org.au/sitemaps-1-sitemap.xml # live - don't allow web crawlers to index cpresources/ or vendor/ User-agent: * Disallow: /cpresources/ Disallow: /search #crawl the search will result in endless combination of url Disallow: /vendor/ Disallow: /.env Disallow: /cache/