All checks / AI Access

Error gptbot-blocked

GPTBot can reach your site

What this check means

Checks whether your robots.txt denies GPTBot, the crawler operated by OpenAI, access to your site.

Why it matters

Your pages are left out of the data OpenAI uses to train its models. ChatGPT search and live browsing use different crawlers (OAI-SearchBot and ChatGPT-User), so blocking GPTBot alone does not take you out of ChatGPT answers.

How we detect it

We parse robots.txt per RFC 9309 and ask whether GPTBot is permitted to fetch "/". The most specific matching user-agent group wins, so a named GPTBot group replaces any wildcard rules rather than combining with them. A bare "Disallow:" permits everything and is not a block.

How to fix it

Remove the blanket "Disallow: /" from the group covering GPTBot, or add an explicit group permitting it: User-agent: GPTBot Allow: /

Example

User-agent: GPTBot
Allow: /

Check whether this applies to your site.

Run an AI audit

Other AI Access checks