SEO for publishers who need to know who reads their articles.
See which search and AI crawlers fetch your stories and how much bandwidth they use, block the ones that only take, and hear about it when a Google update moves your traffic.
- Verified crawlers from your logs
- Bandwidth by bot
- Google update alerts
Crawl Analytics
Which search and AI bots crawl your site, and what goes wrong.
Your logs, your crawlers, your call.
Know who reads your journalism before you decide who may.
See which AI bots read your stories
Crawl Analytics separates search crawlers from AI crawlers and verifies each one, so a fake “Googlebot” is never counted as Google.
- Search vs AI crawlers
- Verified, unverified and spoofed
- Alert on new crawlers
Crawl Analytics
Know what each bot costs you
Bot insights show requests and bandwidth per crawler, so you can see which bots take the most and decide on robots.txt with numbers.
- Bandwidth per bot
- Volume spike alerts
- robots.txt changes alerted
Crawl Analytics
| Crawler | Requests | Bandwidth |
|---|---|---|
| Googlebot | 612K | 41 GB |
| Bytespider | 388K | 26 GB |
| GPTBot | 182K | 12 GB |
Know when an update hits you
Search Performance marks Google’s confirmed updates on your traffic, and an alert tells you when one moves your clicks.
- Updates on your chart
- Alert on impact
- Site sections compared
Search Performance
See which sections win and lose
Site sections are grouped automatically by path, so /politics/, /sports/ and /business/ each get their own clicks and trend.
- Automatic site sections
- Your own content groups
- Branded vs non-branded
Search Performance
Fix speed on the article template
Core Web Vitals and site audit issues are grouped by template, so one fix to the article layout reaches every story.
- Article template
- Real-user Core Web Vitals
- Issues by template
Site Audit
| Template | URLs | Avg response |
|---|---|---|
| Article | 9,420 | 1.4 s |
| Tag archive | 3,110 | 2.2 s |
| Author archive | 240 | 1.9 s |
What publishers should know.
From logs to decisions.
- 01
Connect your logs
Install the WordPress plugin or send Cloudflare logs.
- 02
Read the crawlers
See verified search and AI bots, bandwidth and spoofed traffic.
- 03
Decide and watch
Change robots.txt, then watch requests and alerts.
Ask what an AI bot is worth to you.
Your agent reads bot activity and GA4 through MCP.
- Bot activity
- Request detail
- GA4 acquisition
YouWhich AI crawlers take the most bandwidth but send us no visits?
get_bot_activityget_request_intelligenceget_google_analytics_traffic_acquisitionAgentBytespider used 26 GB this week and no ByteDance product sent a measurable visit. GPTBot used 12 GB; ChatGPT sent 1,940 sessions. Blocking Bytespider saves the most for the least.
Built for publishers.
Fresh stories, fast
Check Googlebot reaches new articles and errors don’t pile up.
Evergreen that lasts
See which sections hold traffic after each Google update.
Keep exploring
Can I see which AI bots crawl my site?
Yes. Crawl Analytics reads your logs and verifies each search and AI crawler against its operator’s published addresses.
Can I see bandwidth per bot?
Yes. Bot insights show requests and bandwidth for each crawler.
Does it cover Google Discover or Top Stories?
No. Search data comes from Search Console’s web search reports.
Will I know if a Google update hits?
Yes. Updates are marked on your Search Performance chart and an alert fires when one moves your clicks.
How do I get started?
Create an account at app.ndovuseolabs.com, add your website and connect Search Console. Every new account starts with a 14-day free trial of Base, with no card or M-Pesa needed; then choose the plan that fits.
See who reads your stories.
Try Base free for 14 days. No card or M-Pesa needed.