FREE SEO TOOLS
Free AI Search & Bots tools
See how AI crawlers and assistants interact with your site: robots.txt rules for AI bots, llms.txt files and crawler logs. A crawler visit does not show that an AI answer used the page.
- Free, no sign-up
- Browser tools upload nothing
- Live checks fetch public pages only
- FreeAI Crawler Access CheckerSee which AI crawlers a site's robots.txt allows or blocks, from GPTBot and ClaudeBot to Google-Extended and PerplexityBot, with the deciding rule.
- FreeAI Content Readability CheckerCheck whether AI crawlers may fetch a page and can read it: robots.txt access, content in the HTML, structure, structured data, freshness and llms.txt.
- FreeAI Robots.txt Policy GeneratorChoose whether to allow AI training crawlers, AI search crawlers and user-initiated agents, and get robots.txt rules for every documented AI bot.
- Freellms.txt ValidatorCheck an llms.txt file against the proposed format: H1 title, summary, H2 sections and "- [name](url): notes" links.
- Freellms.txt GeneratorWrite an llms.txt for your site from a short form: name, summary and the sections and pages that matter.
TOOLS
AI Search & Bots tools
Free AI search tools: check AI crawler access, generate AI robots policies and analyse bot logs.
AI Crawler Access Checker
See which AI crawlers a site’s robots.txt allows or blocks, from GPTBot and ClaudeBot to Google-Extended and PerplexityBot, with the deciding rule.
AI Content Readability Checker
Check whether AI crawlers may fetch a page and can read it: robots.txt access, content in the HTML, structure, structured data, freshness and llms.txt.
AI Robots.txt Policy Generator
Choose whether to allow AI training crawlers, AI search crawlers and user-initiated agents, and get robots.txt rules for every documented AI bot.
llms.txt Validator
Check an llms.txt file against the proposed format: H1 title, summary, H2 sections and "- [name](url): notes" links.
llms.txt Generator
Write an llms.txt for your site from a short form: name, summary and the sections and pages that matter.
AI Crawler Log Analyzer
Paste server access log lines and see which AI crawlers visited, which were real (verified by IP) and which only borrowed the name.
Answer Passage Analyzer
Find the paragraphs in an article that work as stand-alone answers, and what would make the others quotable.
Content Source & Citation Audit
Find the statistics, dates and research claims in an article and check which ones link to or name a source.
AI Visibility Data Analyzer
Analyse an AI visibility tracking export: brand mention rate by AI engine, your domain’s citations, cited domains, and prompts where only competitors appear.
Need this for a whole website, over time?
The NdovuSEOLabs platform connects your own Search Console, analytics and server logs, and audits every page on a schedule.