Tool Gate · How it works
How the AI Crawler Access & Render Audit gate works
How the AI Crawler Access & Render Audit Kit grades a site: each AI engine is scored and banded, and the site verdict is the worst engine, never the average — a robots.txt or WAF block makes an engine INVISIBLE, which walls off the whole site.
How the gate works
This tool grades whether AI engines can reach and render your site. It reads 5 AI engines and rolls them into one verdict — the worst, never the average — and then a gate that can only make it worse.
The 5 AI engines
| Engine | Verdict |
|---|---|
| ChatGPT Search · OAI-SearchBotfix first | INVISIBLE TO AIscore 67 |
| Microsoft Copilot · Bingbot | PARTIALLY BLOCKEDscore 66 |
| Claude · ClaudeBot | PARTIALLY BLOCKEDscore 72.5 |
| Perplexity · PerplexityBot | CRAWLABLEscore 86 |
| Google AI · Googlebot + Google-Extended | CRAWLABLEscore 100 |
The verdict bands
A robots.txt disallow or a WAF/CDN block means the crawler never fetches the page — content that's never fetched can't be cited, so that engine is INVISIBLE whatever its score. One invisible engine walls off the site, regardless of the score.
In the worked sample it reads WALLED OFF — Two engines can crawl the site and two are only partially blocked — but ChatGPT Search is walled off entirely: robots.txt disallows OAI-SearchBot, so it never fetches the page. Content that's never fetched can't be cited. The site verdict is the worst engine, never the average. The one thing to fix first: ChatGPT Search — lift the robots.txt disallow on OAI-SearchBot; content that's never fetched can't be cited..
Common questions
Can every engine look survivable on the How the AI Crawler Access Audit gate works and the company still read WALLED OFF?
Yes. The roll-up takes the worst of 5 AI engines — never the average — then a worsen-only gate, the Access gate, escalates when trouble clusters. In the worked sample it reads WALLED OFF because two engines can crawl the site and two are only partially blocked — but ChatGPT Search is walled off entirely: robots.txt disallows OAI-SearchBot, so it never fetches the page. Content that's never fetched can't be cited. The site verdict is the worst engine, never the average.
What is a worsen-only gate?
A dispositive rule that can only lower a verdict, never raise it. One fatal flaw overrides an otherwise-set of survivable lines, because a single disqualifying gap shouldn't hide behind an average of the healthy ones. The tool also names the one thing to fix first — here, "ChatGPT Search — lift the robots.txt disallow on OAI-SearchBot; content that's never fetched can't be cited.".
Grades the marks you record; fetches nothing. No citation outcome is guaranteed.
Embed this diagram
Free to share and embed with attribution (CC BY 4.0) — keep the link to redhub.ai.
Interactive — renders the live diagram
<iframe src="https://redhub.ai/visuals/tool/ai-crawler-access-render-audit-kit.html" title="How the AI Crawler Access & Render Audit gate works — RedHub AI" width="760" height="1575" loading="lazy" style="border:0;width:100%;max-width:760px"></iframe>
<p style="font:14px/1.5 system-ui,sans-serif"><a href="https://redhub.ai/visuals/tool/ai-crawler-access-render-audit-kit">How the AI Crawler Access & Render Audit gate works</a> — by <a href="https://redhub.ai">RedHub AI</a>, the AI that tells you when to doubt it.</p>Image + link — a static picture for any blog
<a href="https://redhub.ai/visuals/tool/ai-crawler-access-render-audit-kit"><img src="https://redhub.ai/visuals/tool/ai-crawler-access-render-audit-kit-share.png" alt="Diagram of the AI Crawler Access & Render Audit Kit: five AI engines rolled up worst-not-average, an access gate, and a site reading WALLED OFF with two of five engines reachable." width="760" loading="lazy" style="max-width:100%;height:auto;border-radius:16px"></a>
<p style="font:14px/1.5 system-ui,sans-serif"><a href="https://redhub.ai">RedHub AI</a> — the AI that tells you when to doubt it.</p>
This is how AI Crawler Access & Render Audit Kit works. More diagrams in the Visual Field Guide.