User-agent: * Allow: / # AI training crawlers — we participate (visibility in AI Overviews / Perplexity / Claude is part of the strategy) User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / User-agent: PerplexityBot Allow: / # Block obvious scrapers / spam bots User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10 User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / # Drafts and admin paths — never index User-agent: * Disallow: /draft/ Disallow: /admin/ Disallow: /api/ Disallow: /*?preview= Sitemap: https://accidentlawyerreview.com/sitemap.xml Sitemap: https://accidentlawyerreview.com/sitemap-firms.xml Sitemap: https://accidentlawyerreview.com/sitemap-cities.xml Sitemap: https://accidentlawyerreview.com/sitemap-states.xml Sitemap: https://accidentlawyerreview.com/sitemap-guides.xml Sitemap: https://accidentlawyerreview.com/sitemap-research.xml