Check whether AI bots can read your site
Access for each bot, robots.txt, structured data, content without JavaScript and llms.txt. By category and severity, with no overall score hiding what matters.
- GPTBotBlocked
- OAI-SearchBotAllowed
- ClaudeBotAllowed
- PerplexityBotAllowed
- Google-ExtendedAllowed
- robots.txtCritical
- Structured dataWarning
- Content without JavaScriptOK
- llms.txtMissing
Which bots can get in
Bot by bot
GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended and more.
Training and search
Tells apart bots that train models from bots that search in order to answer.
With the exact rule
See which robots.txt line blocks each one.
User-agent: *
Allow: /
User-agent: GPTBot
Disallow: /
# This rule stops ChatGPT from reading your site
What AI understands about your site
Schema.org
Which types you have (Organization, Product, LocalBusiness…) and which are missing.
Errors and warnings
JSON-LD that cannot be read, misspelt or non-existent types and entities without a name.
Against the official vocabulary
Each type is checked against schema.org, and if it is misspelt you get the exact form.
| Type | Present |
|---|---|
| Organization | Yes |
| LocalBusiness | No |
| Product | Yes |
| FAQPage | No |
| BreadcrumbList | Yes |
What a bot that does not run JavaScript sees
Text visible without JS
Many AI bots do not run JavaScript: if your content depends on it, they cannot read it.
On your main pages
Looks at the HTML a bot receives on your first pages: whether the app arrives empty or the text is missing.
- / (home)OK
- /shopNo text
- /originsOK
An index for the models
Does your site have llms.txt?
Checks whether your site has llms.txt (and llms-full.txt) and whether it starts with the title its format requires.
A fact, not a task
It is reported as a fact, not as something to fix: according to Ahrefs, 97% of published llms.txt files never receive a single request.
- /llms.txtMissing
- /llms-full.txtMissing
How it is calculated
Calculations follow fixed rules: same data, same conclusion.
- AI bot
- A crawler from an AI company, identified by its user-agent.
- Severity
- Critical, warning, info or OK in each finding, each one marked as measured or heuristic.
- No overall score
- We do not add categories up into one score: one blocked bot matters more than ten minor warnings.
- Frequency
- Weekly or monthly, per brand; weekly by default. Never daily: a site does not change every day and we do not hammer your server.
Questions about the audit
Because it hides what matters. A single blocked bot can leave you out of a model, even if everything else is fine.
It depends on your policy. The audit shows the effect of each rule so you can decide.
For some fixes, yes. Each item says what to change.
A text file that summarises your site for language models. It is not yet a settled standard.
Start measuring what AI says about you
7-day trial · From €29/month, VAT included · Cancel anytime