# AI training crawlers — block at the policy layer. Cloudflare also blocks # these at the edge; this is belt-and-suspenders for bots not yet on CF's list. User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Claude-Web Disallow: / User-agent: anthropic-ai Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Perplexity-User Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: cohere-ai Disallow: / User-agent: Diffbot Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Omgilibot Disallow: / User-agent: Omgili Disallow: / User-agent: FacebookBot Disallow: / User-agent: * Allow: / # Application + auth surfaces — not useful in search results. Disallow: /dashboard Disallow: /accounts Disallow: /customers Disallow: /users Disallow: /admin/ Disallow: /api/ Disallow: /login Disallow: /verify-email Disallow: /reset-password Disallow: /forgot-password Disallow: /checkout/ Sitemap: https://kickchatters.com/sitemap.xml