User-agent: * Allow: / # Allow AI crawlers for perfect GEO check visibility User-agent: GPTBot Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: Cohere-ai Allow: / # Reference XML Sitemap Sitemap: http://localhost:8001/sitemap.xml # AI Content Usage Preferences (robots.txt Content Signals) Content-Signal: ai-train=no, search=yes, ai-input=no