29/08/2026
Have you ever given ChatGPT, Gemini or Grok a link to your website—only to be told that it cannot read the page?
The obvious conclusion is that your website must be blocking AI. But that conclusion may be completely wrong.
We experienced this on our own Cloudflare-protected website. A live AI assistant failed to retrieve the page, yet our AI Observatory showed recognised search and AI crawlers successfully accessing and retrieving business information from the site.
At the time of the test, Cloudflare recorded an anonymous AWS-hosted request targeting the exact article. It used the generic user-agent `axios/1.19.0`, provided no verifiable AI identity and was blocked before reaching WordPress.
That did not mean AI crawlers could not crawl our website. It meant one live retrieval request failed.
It also did not mean we should turn off Cloudflare or weaken our security. The correct response is to inspect the evidence, establish what was blocked and make only the narrowest change that can be technically justified.
Our new Technical Problem 16 explains what happened, what the evidence proves and what website owners should do when an AI says it cannot read their website:
https://sydneybusinessweb.com.au/why-ai-cannot-read-your-website/