AI BOTS · ALLEN INSTITUTE FOR AI
AI2Bot
Collects pages to train Ai2's open language models. Ai2 does not say whether it follows robots.txt.
- robots.txt behaviour not documented
- Cannot be verified
- Docs checked 28 Oct 2026
- UnverifiedIdentityNo published check
- Unknownrobots.txtrobots.txt behaviour not documented
- PurposeAI trainingFor an AI product
- TokenAI2BotUse it in a User-agent line
robots.txt
The operator does not say whether this bot follows robots.txt.
Block AI2Bot
User-agent: AI2Bot
Disallow: /Allow AI2Bot
User-agent: AI2Bot
Allow: /Quick facts
- robots.txt token
AI2Bot- User agent contains
- AI2Bot
- Operator
- Allen Institute for AI
- Category
- AI bots
- Purpose
- AI training
- robots.txt
- Not documented
- Verification
- Cannot be verified
- Documentation
- allenai.org · checked 28 Oct 2026
If you block it
Stops this crawler collecting your pages for model training from now on. It does not change your search rankings.
Check a visit is real
- No published way to check it. A request using this name is only a claim.
Where this comes from
The same registry NdovuSEOLabs uses to classify crawler traffic in your server and CDN logs, built from the operator’s own documentation.
Registry version 2026-10-29.1
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.