Google-CloudVertexBot

Google · AI / data crawler

Crawls sites at the site owner's request for building Vertex AI Agents.

User-agent contains

Google-CloudVertexBot

robots.txt token

Google-CloudVertexBot

Respects robots.txt

Yes, per operator docs

Official IP ranges

2,161 prefixes

How to verify Google-CloudVertexBot

Matching the user agent isn't enough, because any client can send it. A real Google-CloudVertexBot request comes from an IP address inside Google's published list:

• https://developers.google.com/static/search/apis/ipranges/googlebot.json
  317 prefixes · list dated 2026-10-21 · fetched 2026-10-22
• https://developers.google.com/static/search/apis/ipranges/special-crawlers.json
  272 prefixes · list dated 2026-10-21 · fetched 2026-10-22
• https://developers.google.com/static/search/apis/ipranges/user-triggered-fetchers.json
  1068 prefixes · list dated 2026-10-21 · fetched 2026-10-22
• https://developers.google.com/static/search/apis/ipranges/user-triggered-fetchers-google.json
  504 prefixes · list dated 2026-10-21 · fetched 2026-10-22

The quickest way to check a whole log is our free log checker. It runs in your browser and splits Google-CloudVertexBot requests into real and fake.

2001:4860:4801:10::/64
2001:4860:4801:11::/64
2001:4860:4801:12::/64
2001:4860:4801:13::/64
2001:4860:4801:14::/64
2001:4860:4801:15::/64
2001:4860:4801:16::/64
2001:4860:4801:17::/64
2001:4860:4801:18::/64
2001:4860:4801:19::/64
2001:4860:4801:1a::/64
2001:4860:4801:1b::/64
2001:4860:4801:1c::/64
2001:4860:4801:1d::/64
2001:4860:4801:1e::/64
2001:4860:4801:1f::/64
2001:4860:4801:20::/64
2001:4860:4801:21::/64
2001:4860:4801:22::/64
2001:4860:4801:23::/64

Block or allow Google-CloudVertexBot in robots.txt

User-agent: Google-CloudVertexBot
Disallow: /

Use Allow: / instead to explicitly permit it, or build a full file with the AI robots.txt generator. robots.txt is a request, not a lock: it only works for bots that honor it, and only real Google-CloudVertexBot traffic would.

Source: Google documentation