CRAWLER OPERATOR
Anthropic crawlers.
Anthropic runs 3 bots in this directory: ClaudeBot, Claude-SearchBot, Claude-User. Each can be allowed or blocked on its own.
- 3 bots
- 3 can be verified
- 3 for AI products
- VerifiableClaudeBotAI training
- VerifiableClaude-SearchBotAI search retrieval
- VerifiableClaude-UserUser-directed fetch
ANTHROPIC
Every Anthropic bot.
Open a bot for its robots.txt rule, verification and documentation.
3 bots
AnthropicVerifiable
Claude-SearchBot
Claude-SearchBot
Follows robots.txt
AnthropicVerifiable
Claude-User
Claude-User Claude-Web
Follows robots.txt
AnthropicVerifiable
ClaudeBot
ClaudeBot anthropic-ai
Follows robots.txt
No bots match these filters.
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.