Skip to main content

AI BOTS · ANTHROPIC

Claude-User

Crawlers and fetchers behind AI products: model training, AI search and assistants that fetch a page for a user.

  • Follows robots.txt
  • Can be verified
  • Docs checked 28 Oct 2026
At a glanceAnthropic
  • VerifiableIdentityIP ranges, Cloudflare
  • Obeysrobots.txtFollows robots.txt
  • PurposeUser-directed fetchFor an AI product
  • TokenClaude-User, Claude-WebUse it in a User-agent line

robots.txt

The operator documents that this bot follows robots.txt rules.

Block Claude-User
User-agent: Claude-User
User-agent: Claude-Web
Disallow: /
Allow Claude-User
User-agent: Claude-User
User-agent: Claude-Web
Allow: /

Quick facts

robots.txt token
Claude-User Claude-Web
User agent contains
Claude-User, Claude-Web
Operator
Anthropic
Category
AI bots
Purpose
User-directed fetch
robots.txt
Follows robots.txt
Verification
Can be verified
Also known as
Claude-Web
Documentation
support.claude.com · checked 28 Oct 2026

If you block it

The assistant cannot read your page when a person asks it to.

Check a visit is real

Where this comes from

The same registry NdovuSEOLabs uses to classify crawler traffic in your server and CDN logs, built from the operator’s own documentation.

Registry version 2026-10-29.1

More from Anthropic

See which of these crawlers visit your site.

Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.