Skip to main content
Request access

CRAWLER DIRECTORY · SOCIAL PREVIEWS

Social previews.

Fetchers that build the preview card when someone shares your page in a social or chat app.

Browse the list
All categories
  • 3 bots
  • 2 can be verified
  • 1 follow robots.txt
Social previewsA–Z
  • VerifiablefacebookexternalhitMeta · Social preview
  • VerifiablePinterestbotPinterest · Social preview
  • UnverifiedSocial and chat link previewsVarious · Social preview

3

bots

2

can be verified

1

follow robots.txt

3

operators

SOCIAL PREVIEWS

All 3 bots.

Search by name or token, or filter by purpose, verification and operator.

3 bots

PinterestVerifiable

Pinterestbot

Pinterestbot

  • Social preview

Follows robots.txt

FAQ

Social previews: common questions.

Before you change your robots.txt.

Should I block social previews?

Usually not. Without them, links to your pages lose their preview card when people share them.

How do I block one?

Open its profile and copy the robots.txt rule. Bots that ignore robots.txt, or fetch only when a person asks, need a server, firewall or CDN rule instead.

See which of these crawlers visit your site.

Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.

Explore Crawl Analytics