Crawlers allowed — or blocked
Catch a robots.txt or CDN rule that shuts out GPTBot, Claude, or Perplexity — often left on from an old plugin.
Product · Technical readiness
See if AI can even reach your site
Before a page can be recommended, crawlers have to fetch it. We check robots, rendering, and the blocks that keep ChatGPT and others out.
Technical readiness
site-wide · crawl access
Why you lose
GPTBot is blocked — ChatGPT never reads the site
robots.txt
GPTBot · Disallow: /
CDN
PerplexityBot gets 403
- Old bot-block plugin still live
- Homepage is a JS shell without raw text
Next change
Allow GPTBot and lift bot protection for AI crawlers.
Readable without the browser
See whether key pages return real text to a bot, or only a JavaScript shell that AI never sees.
Ready to be cited
Snippets, sitemap, and structured signals that let answer engines find and quote you — not GEO theater.
Unblock the crawlers that matter
Start free with your site. See what’s stopping AI from reading you — then leave with the next fix.