What this checks, and why
AI answer tools can only quote pages their crawlers are allowed to read. Each company names its crawlers, and your robots.txt file decides which ones get in. Blocking a training crawler (GPTBot, ClaudeBot, Google-Extended) is a fair choice and does not remove you from their search answers; blocking a search crawler (OAI-SearchBot, PerplexityBot, Claude-SearchBot) does. We wrote a plain guide to letting the right ones in.
The rest are the basics every search engine relies on: a sitemap with dates (why the dates matter), no accidental noindex, a title and description, structured data that names your business, and enough real text to answer a question.
This tool reads your public pages only, like a search engine would. It makes no changes and stores only the domain and the score.
