Site audit

• Access: the homepage answers, https, one host (with or without www), response time.
• robots.txt, crawler by crawler: AI search crawlers (OAI-SearchBot, PerplexityBot, Claude-SearchBot…), the ones that open pages when a user asks (ChatGPT-User, Claude-User…) and, for information only, AI training crawlers.
• Indexing: noindex or nosnippet on the homepage and important pages.
• Content visible without JavaScript: most AI crawlers don’t run it.
• Structure: sitemap, structured data (Organization, WebSite, Article on posts), title, description, H1, canonical, language and hreflang.
• Signals: llms.txt (informational), brand entity, content freshness.

Besides the homepage, it reviews your important pages one by one, up to a number set by your plan: Starter: 25 · Growth: 50 · Business: 100.

Problems are grouped by what they do to your AI visibility: Blocks AI (fix these first), Lowers your chances and Housekeeping. A problem that affects only a few minor pages drops one group.

The score goes from 0 to 100: each applicable check weighs 3, 2 or 1 by impact; an error subtracts its full weight and a warning half. If robots.txt closes the whole site or the homepage has noindex, the score can’t go above 40. Informational checks and service pages (log in, cart, internal search) don’t count.

Each problem comes with numbered steps for your platform when we recognise it (Framer, Webflow, WordPress, Shopify, Wix, Squarespace, Next.js), ready-to-paste text when there is one (a corrected robots.txt, JSON-LD, a title) and a prompt you can copy into your AI assistant.

When it’s published, click Check again now.

Platform by platform: Framer, Webflow, WordPress, Shopify, Wix, Next.js.

Firewall or CDN rules that block bots by IP or user agent (for example, Cloudflare’s AI bot blocking) and pages that need a login aren’t visible from outside. If AI tools never cite you despite a clean audit, check those with your host.

Want a quick check without an account? Try the free AI crawler checker.