Google-Extended can reach your site

What this check means

Checks whether your robots.txt denies Google-Extended, the crawler operated by Google (Gemini), access to your site.

Why it matters

Gemini cannot use your content for grounding. Note this token does not affect ordinary Google Search ranking — it governs AI use only.

How we detect it

We parse robots.txt per RFC 9309 and ask whether Google-Extended is permitted to fetch "/". The most specific matching user-agent group wins, so a named Google-Extended group replaces any wildcard rules rather than combining with them. A bare "Disallow:" permits everything and is not a block.

How to fix it

Remove the blanket "Disallow: /" from the group covering Google-Extended, or add an explicit group permitting it: User-agent: Google-Extended Allow: /

Example

User-agent: Google-Extended
Allow: /