AI BOTS · ANTHROPIC
Claude-SearchBot
Crawlers and fetchers behind AI products: model training, AI search and assistants that fetch a page for a user.
- Follows robots.txt
- Can be verified
- Docs checked 28 Oct 2026
- VerifiableIdentityIP ranges, Cloudflare
- Obeysrobots.txtFollows robots.txt
- PurposeAI search retrievalFor an AI product
- TokenClaude-SearchBotUse it in a User-agent line
robots.txt
The operator documents that this bot follows robots.txt rules.
Block Claude-SearchBot
User-agent: Claude-SearchBot
Disallow: /Allow Claude-SearchBot
User-agent: Claude-SearchBot
Allow: /Quick facts
- robots.txt token
Claude-SearchBot- User agent contains
- Claude-SearchBot
- Operator
- Anthropic
- Category
- AI bots
- Purpose
- AI search retrieval
- robots.txt
- Follows robots.txt
- Verification
- Can be verified
- Documentation
- support.claude.com · checked 28 Oct 2026
If you block it
Your pages can stop appearing, or being cited, in this product’s AI answers.
Check a visit is real
- Published IP ranges: claude.com/crawling/bots.json
- Listed by Cloudflare as a verified bot
Where this comes from
The same registry NdovuSEOLabs uses to classify crawler traffic in your server and CDN logs, built from the operator’s own documentation.
Registry version 2026-10-29.1
More from Anthropic
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.