GPTBot can reach your site

What this check means

Checks whether your robots.txt denies GPTBot, the crawler operated by OpenAI, access to your site.

Why it matters

OpenAI cannot index your content, so ChatGPT has nothing of yours to draw on when answering questions in your category.

How we detect it

We parse robots.txt per RFC 9309 and ask whether GPTBot is permitted to fetch "/". The most specific matching user-agent group wins, so a named GPTBot group replaces any wildcard rules rather than combining with them. A bare "Disallow:" permits everything and is not a block.

How to fix it

Remove the blanket "Disallow: /" from the group covering GPTBot, or add an explicit group permitting it: User-agent: GPTBot Allow: /

Example

User-agent: GPTBot
Allow: /