Google-Extended can reach your site

What this check means

Checks whether your robots.txt denies Google-Extended, the crawler operated by Google (Gemini), access to your site.

Why it matters

Gemini cannot use your content in its answers. This token controls AI use only. It does not change your Google Search rank.

How we detect it

We parse robots.txt per RFC 9309 and ask whether Google-Extended is permitted to fetch "/". The most specific matching user-agent group wins, so a named Google-Extended group replaces any wildcard rules rather than combining with them. A bare "Disallow:" permits everything and is not a block.

How to fix it

Remove the blanket "Disallow: /" from the group covering Google-Extended, or add an explicit group permitting it: User-agent: Google-Extended Allow: /

Example

User-agent: Google-Extended
Allow: /