AI BOTS · WEBZ.IO
Webzio-Extended
A robots.txt control token: blocking it marks your content as off-limits for AI use in Webz.io's data.
- Follows robots.txt
- A robots.txt control token
- Docs checked 28 Oct 2026
- Control tokenIdentityNothing to check: robots.txt only
- Obeysrobots.txtFollows robots.txt
- PurposeAI trainingFor an AI product
- TokenWebzio-ExtendedA control token, not a crawler
robots.txt
The operator documents that this bot follows robots.txt rules.
Block Webzio-Extended
User-agent: Webzio-Extended
Disallow: /Allow Webzio-Extended
User-agent: Webzio-Extended
Allow: /Quick facts
If you block it
Tells Webz.io not to use your pages for this purpose. It is a control token, so crawling by its other bots carries on.
Check a visit is real
- Nothing to check: no request ever carries this name. It only appears in robots.txt.
Where this comes from
The same registry NdovuSEOLabs uses to classify crawler traffic in your server and CDN logs, built from the operator’s own documentation.
Registry version 2026-10-29.1
More from Webz.io
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.