Skip to main content

CRAWLER OPERATOR

Webz.io crawlers.

Webz.io runs 2 bots in this directory: Webzio, Webzio-Extended. Each can be allowed or blocked on its own.

  • 2 bots
  • 0 can be verified
  • 1 for AI products
Webz.io2 bots
  • UnverifiedWebzioData collection
  • Control tokenWebzio-ExtendedAI training

WEBZ.IO

Every Webz.io bot.

Open a bot for its robots.txt rule, verification and documentation.

2 bots

Webz.ioUnverified

Webzio

Webzio Omgilibot

  • Data collection

Follows robots.txt

Webz.ioControl token

Webzio-Extended

Webzio-Extended

  • AI training

Follows robots.txt

See which of these crawlers visit your site.

Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.