CRAWLER OPERATOR
Google crawlers.
Google runs 16 bots in this directory: Googlebot-Image, Googlebot-Video, Google-InspectionTool, Storebot-Google, GoogleOther-Image, GoogleOther-Video, GoogleOther, Google-CloudVertexBot, AdsBot-Google, Mediapartners-Google, Google-Agent, Google-Safety, Google user-triggered fetchers, Googlebot, Googlebot-News, Google-Extended. Each can be allowed or blocked on its own.
- 16 bots
- 14 can be verified
- 3 for AI products
- VerifiableGooglebot-ImageSearch indexing
- VerifiableGooglebot-VideoSearch indexing
- VerifiableGoogle-InspectionToolSearch indexing
- VerifiableStorebot-GoogleSearch indexing
- VerifiableGoogleOther-ImageData collection
Every Google bot.
Open a bot for its robots.txt rule, verification and documentation.
16 bots
AdsBot-Google
AdsBot-Google AdsBot-Google-Mobile
Follows robots.txt
Google user-triggered fetchers
No robots.txt token
User-triggered
Google-Agent
No robots.txt token
User-triggered
Google-CloudVertexBot
Google-CloudVertexBot
Follows robots.txt
Google-Extended
Google-Extended
Follows robots.txt
Google-InspectionTool
Google-InspectionTool Googlebot
Follows robots.txt
Google-Safety
No robots.txt token
Ignores robots.txt
Googlebot
Googlebot
Follows robots.txt
Googlebot-Image
Googlebot-Image Googlebot
Follows robots.txt
Googlebot-News
Googlebot-News
Follows robots.txt
Googlebot-Video
Googlebot-Video Googlebot
Follows robots.txt
GoogleOther
GoogleOther
Follows robots.txt
GoogleOther-Image
GoogleOther-Image GoogleOther
Follows robots.txt
GoogleOther-Video
GoogleOther-Video GoogleOther
Follows robots.txt
Mediapartners-Google
Mediapartners-Google
Follows robots.txt
Storebot-Google
Storebot-Google
Follows robots.txt
No bots match these filters.
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.