AI BOTS · META
Meta-WebIndexer
Crawls to improve Meta AI's search answers and the links it cites. Meta publishes no IP list or DNS check for it.
- Follows robots.txt
- Cannot be verified
- Docs checked 28 Oct 2026
- UnverifiedIdentityNo published check
- Obeysrobots.txtFollows robots.txt
- PurposeAI search retrievalFor an AI product
- Tokenmeta-webindexerUse it in a User-agent line
robots.txt
The operator documents that this bot follows robots.txt rules.
Block Meta-WebIndexer
User-agent: meta-webindexer
Disallow: /Allow Meta-WebIndexer
User-agent: meta-webindexer
Allow: /Quick facts
- robots.txt token
meta-webindexer- User agent contains
- meta-webindexer
- Operator
- Meta
- Category
- AI bots
- Purpose
- AI search retrieval
- robots.txt
- Follows robots.txt
- Verification
- Cannot be verified
- Documentation
- developers.facebook.com · checked 28 Oct 2026
If you block it
Your pages can stop appearing, or being cited, in this product’s AI answers.
Check a visit is real
- No published way to check it. A request using this name is only a claim.
Where this comes from
The same registry NdovuSEOLabs uses to classify crawler traffic in your server and CDN logs, built from the operator’s own documentation.
Registry version 2026-10-29.1
More from Meta
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.