SEARCH ENGINES · GOOGLE

Googlebot

Crawls for Google Search. A Googlebot visit does not show whether AI Overviews used the page.

Copy the robots.txt rule

All search engines

Follows robots.txt
Can be verified
Docs checked 28 Oct 2026

At a glanceGoogle

VerifiableIdentityIP ranges, reverse DNS, Cloudflare
Obeysrobots.txtFollows robots.txt
PurposeSearch indexingNot an AI product
TokenGooglebotUse it in a User-agent line

robots.txt

The operator documents that this bot follows robots.txt rules.

Block Googlebot

User-agent: Googlebot
Disallow: /

Allow Googlebot

User-agent: Googlebot
Allow: /

Quick facts

robots.txt token: Googlebot
User agent contains: Googlebot
Operator: Google
Category: Search engines
Purpose: Search indexing
robots.txt: Follows robots.txt
Verification: Can be verified
Documentation: developers.google.com · checked 28 Oct 2026

If you block it

Your pages drop out of this search engine’s results over time. Block it only with a clear reason.

Check a visit is real

Published IP ranges: developers.google.com/static/crawling/ipranges/common-crawlers.json
Published IP ranges: developers.google.com/static/crawling/ipranges/special-crawlers.json
Published IP ranges: developers.google.com/static/crawling/ipranges/user-triggered-fetchers-google.json
Reverse DNS ending in googlebot.com or google.com, confirmed by forward DNS
Listed by Cloudflare as a verified bot

Where this comes from

The same registry NdovuSEOLabs uses to classify crawler traffic in your server and CDN logs, built from the operator’s own documentation.

Registry version 2026-10-29.1

More from Google

See which of these crawlers visit your site.

Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.

Explore Crawl Analytics