CRAWLER OPERATOR
Semrush crawlers.
Semrush runs 1 bot in this directory: SemrushBot. Each can be allowed or blocked on its own.
- 1 bot
- 1 can be verified
- 0 for AI products
- VerifiableSemrushBotSEO tool
SEMRUSH
Every Semrush bot.
Open a bot for its robots.txt rule, verification and documentation.
1 bot
SemrushVerifiable
SemrushBot
SemrushBot SiteAuditBot
Follows robots.txt
No bots match these filters.
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.