Google-Extended

Google · robots.txt token only

A robots.txt product token that controls whether content Google crawls may be used to train Gemini models and for grounding. Google says it has no separate HTTP user agent: crawling uses existing Google user agents.

Any request whose User-Agent says “Google-Extended” is fake by definition.

User-agent contains

— (no HTTP user agent)

robots.txt token

Google-Extended

Respects robots.txt

Yes, per operator docs

Official IP ranges

n/a

How to verify Google-Extended

You can't, and you don't need to: Google crawls with its normal user agents and uses Google-Extended only as a robots.txt control. A request that names Google-Extended in its User-Agent was not sent by Google.

Block or allow Google-Extended in robots.txt

User-agent: Google-Extended
Disallow: /

Use Allow: / instead to explicitly permit it, or build a full file with the AI robots.txt generator. robots.txt is a request, not a lock: it only works for bots that honor it, and only real Google-Extended traffic would.

Source: Google documentation