AI BOTS · ANTHROPIC
ClaudeBot
Collects content that may train Anthropic's models. Anthropic also honours Crawl-delay.
- Follows robots.txt
- Can be verified
- Docs checked 28 Oct 2026
- VerifiableIdentityIP ranges, Cloudflare
- Obeysrobots.txtFollows robots.txt
- PurposeAI trainingFor an AI product
- TokenClaudeBot, anthropic-aiUse it in a User-agent line
robots.txt
The operator documents that this bot follows robots.txt rules.
Block ClaudeBot
User-agent: ClaudeBot
User-agent: anthropic-ai
Disallow: /Allow ClaudeBot
User-agent: ClaudeBot
User-agent: anthropic-ai
Allow: /Quick facts
- robots.txt token
ClaudeBotanthropic-ai- User agent contains
- ClaudeBot, anthropic-ai
- Operator
- Anthropic
- Category
- AI bots
- Purpose
- AI training
- robots.txt
- Follows robots.txt
- Verification
- Can be verified
- Also known as
- anthropic-ai
- Documentation
- support.claude.com · checked 28 Oct 2026
If you block it
Stops this crawler collecting your pages for model training from now on. It does not change your search rankings.
Check a visit is real
- Published IP ranges: claude.com/crawling/bots.json
- Listed by Cloudflare as a verified bot
Where this comes from
The same registry NdovuSEOLabs uses to classify crawler traffic in your server and CDN logs, built from the operator’s own documentation.
Registry version 2026-10-29.1
More from Anthropic
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.