Skip to main content
Request access

CRAWLING, RENDERING & INDEXING

Indexing: what it means and how it works

When a search engine stores a page so it can be shown in results; crawling does not guarantee it.

Check it on your site
All glossary terms
  • Beginner level
  • 3 primary sources
  • Reviewed 29 October 2026
At a glanceSEO glossary
  • TopicCrawling, rendering & indexingAlso in SEO fundamentals
  • LevelBeginnerNo background needed
  • Also calledindexation
  • Sources3 primary sourcesGoogle Search Central, Search Console Help
  • Reviewed29 October 2026Re-checked every 6 months
On this page
  1. Quick definition
  2. Why it matters
  3. How it works
  4. Example
  5. How to check it
  6. Common mistakes
  7. Related concepts
  8. Check it on your site
  9. Keep learning
  10. Sources and review

Quick definition

Indexing is the step where a search engine analyses a fetched page and decides whether to store it in its index, the database it retrieves results from. Only indexed pages can appear in search results, and a search engine can crawl a page and still choose not to index it.

Why it matters

Indexing is the gate between a page existing and a page being findable. Ranking, snippets and clicks all happen after it. When an important page is missing from the index, no amount of on-page work helps until the indexing problem is understood.

How it works

Discovery, crawling, rendering, canonicalization and indexing are separate steps. During indexing, the search engine reads the page’s text, title, links, structured data and media, groups duplicates, picks a canonical URL for each group and decides whether the canonical is worth storing.

Search Console statusWhat it usually means
Discovered – currently not indexedGoogle knows the URL but has not crawled it yet, often because of crawl scheduling or site capacity
Crawled – currently not indexedGoogle fetched the page and chose not to index it for now, often a quality or duplication judgement
Duplicate, Google chose different canonical than userYour canonical signal was overruled by other signals
Excluded by ‘noindex‘ tagThe page asked not to be indexed
Blocked by robots.txtGoogle was not allowed to fetch it

Not every URL should be indexed. Filtered listings, internal search results, login pages and thin tag archives are often better left out.

Example

A WooCommerce store has 1,200 products. Search Console reports 700 indexed and 500 "Crawled – currently not indexed". Grouping the 500 by URL pattern shows 420 are colour variants with near-identical text and the rest are products with a one-line description. The fix is consolidation and better product content, not resubmitting the URLs.

How to check it

  1. Use the Page indexing report in Search Console for counts and reasons, then group affected URLs by template or folder.
  2. Inspect a sample of URLs with URL Inspection. The indexed result shows what Google stored; the live test shows what it would see now.
  3. Confirm each important page returns 200, is not noindexed, is not blocked by robots.txt and names itself (or the intended page) as canonical.
  4. Compare your sitemap URLs with indexed URLs to find important pages that are missing.

A site: search gives a rough sample, not a count. Use Search Console for indexing data.

Common mistakes and misconceptions

  • Myth Submitting a URL guarantees it will be indexed.

    In fact Requesting indexing or submitting a sitemap asks for a crawl. Google still decides whether the page is worth indexing.

  • Myth Every page on a site should be indexed.

    In fact Indexing low-value duplicates can dilute a site. A smaller set of strong, distinct pages is usually the goal.

Check it on your site

Free tools, no sign-up

In the NdovuSEOLabs platform

Run the same checks on every page of your site, with your own data.

Keep learning

GuideHow indexing really worksDiscovery, crawling, inspection and indexing are separate steps, with separate evidence.Read the guide

Sources and review

Written and maintained by Ndovu SEO Labs. First published 29 October 2026. Facts last checked against the sources above on 29 October 2026. How we write and review the glossary.