CRAWLER OPERATOR
OpenAI crawlers.
OpenAI runs 5 bots in this directory: GPTBot, OAI-SearchBot, ChatGPT-User, OAI-AdsBot, ChatGPT agent. Each can be allowed or blocked on its own.
- 5 bots
- 5 can be verified
- 5 for AI products
- VerifiableGPTBotAI training
- VerifiableOAI-SearchBotAI search retrieval
- VerifiableChatGPT-UserUser-directed fetch
- VerifiableOAI-AdsBotAdvertising
- VerifiableChatGPT agentTransactional agent, User-directed fetch
OPENAI
Every OpenAI bot.
Open a bot for its robots.txt rule, verification and documentation.
5 bots
OpenAIVerifiable
ChatGPT agent
No robots.txt token
User-triggered
OpenAIVerifiable
ChatGPT-User
ChatGPT-User
User-triggered
OpenAIVerifiable
GPTBot
GPTBot
Follows robots.txt
OpenAIVerifiable
OAI-AdsBot
OAI-AdsBot
Not documented
OpenAIVerifiable
OAI-SearchBot
OAI-SearchBot
Follows robots.txt
No bots match these filters.
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.