OTHER AGENTS · VARIOUS
Security scanners
Advertising checks, monitors, security scanners and scripts that identify themselves loosely or not at all.
- Ignores robots.txt
- Cannot be verified
- No public documentation
- UnverifiedIdentityNo published check
- Ignoresrobots.txtIgnores robots.txt
- PurposeSecurity scannerNot an AI product
- TokenNo robots.txt tokenUse it in a User-agent line
robots.txt
robots.txt has no effect on it. Block it at the server, firewall or CDN instead.
It has no robots.txt token of its own. Control it at the server, firewall or CDN.
Quick facts
- User agent contains
- CensysInspect, Expanse, zgrab, Nuclei, masscan, Nmap Scripting Engine, Nikto, sqlmap, WPScan, InternetMeasurement, Palo Alto Networks, ModatScanner, LeakIX
- Operator
- Various
- Category
- Other agents
- Purpose
- Security scanner
- robots.txt
- Ignores robots.txt
- Verification
- Cannot be verified
If you block it
Usually little, unless the check is one you or a platform you rely on runs, such as a search engine’s malware scan.
Check a visit is real
- No published way to check it. A request using this name is only a claim.
Where this comes from
The same registry NdovuSEOLabs uses to classify crawler traffic in your server and CDN logs.
Registry version 2026-10-29.1
See which of these crawlers visit your site.
Crawl Analytics reads your own server and CDN logs and checks each claim against the operator’s published IP ranges and DNS.