Skip to main content

Try Base free for 14 days, no card or M-Pesa needed See pricing

CRAWLER OPERATOR

WEBSPARK crawlers.

WEBSPARK runs one bot in this directory, WARDBot. It can be allowed or blocked on its own.

See its botsAll operators

  • 1 bot
  • 1 can be verified
  • 1 follow robots.txt
WEBSPARK1 bot
VerifiableWARDBotMonitoring

WEBSPARK

Every WEBSPARK bot.

Open a bot for its robots.txt rule, verification and documentation.

1 bot

WEBSPARKVerifiable

WARDBot

WARDBot

  • Monitoring

Follows robots.txt

FAQ

WEBSPARK crawlers: common questions.

All questions

What does blocking WEBSPARK’s crawlers cost?

None of WEBSPARK’s bots build a search index, so blocking them does not change your search rankings.

How do I check a request really comes from WEBSPARK?

A request is really from WEBSPARK when a reverse DNS lookup gives a name ending in robot.ward.host that resolves back to the same IP. The user agent alone can be copied by anyone.

Where does this come from?

From WEBSPARK’s own documentation, checked for each bot and linked on its profile, through the registry Ndovu uses to classify crawler traffic in Crawl Analytics.

See which of these crawlers visit your site.

Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.

Explore Crawl Analytics