AI BOTS · META
Meta-ExternalFetcher
Crawlers and fetchers behind AI products: model training, AI search and assistants that fetch a page for a user.
- Fetches when a person asks
- Can be verified
- Docs checked 28 Oct 2026
- VerifiableIdentityCloudflare
- User-ledrobots.txtFetches when a person asks
- PurposeUser-directed fetchFor an AI product
- Tokenmeta-externalfetcherUse it in a User-agent line
robots.txt
It fetches a page because a person asked. The operator says robots.txt may not apply, so block it at the server or CDN if you need to.
Block Meta-ExternalFetcher
User-agent: meta-externalfetcher
Disallow: /Allow Meta-ExternalFetcher
User-agent: meta-externalfetcher
Allow: /Quick facts
- robots.txt token
meta-externalfetcher- User agent contains
- meta-externalfetcher
- Operator
- Meta
- Category
- AI bots
- Purpose
- User-directed fetch
- robots.txt
- User-triggered
- Verification
- Can be verified
- Documentation
- developers.facebook.com · checked 28 Oct 2026
If you block it
The assistant cannot read your page when a person asks it to.
Check a visit is real
- Listed by Cloudflare as a verified bot
Where this comes from
The same registry NdovuSEOLabs uses to classify crawler traffic in your server and CDN logs, built from the operator’s own documentation.
Registry version 2026-10-29.1
More from Meta
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.