GPTBot

OpenAI · Model training crawler

Crawls content that may be used in training OpenAI's generative AI foundation models.

User-agent contains

GPTBot

robots.txt token

GPTBot

Respects robots.txt

Yes, per operator docs

Official IP ranges

18 prefixes

How to verify GPTBot

Matching the user agent isn't enough, because any client can send it. A real GPTBot request comes from an IP address inside OpenAI's published list:

• https://openai.com/gptbot.json
  18 prefixes · list dated 2026-09-22 · fetched 2026-10-21

The quickest way to check a whole log is our free log checker. It runs in your browser and splits GPTBot requests into real and fake.

132.196.86.0/24
172.182.202.0/25
172.182.207.0/25
20.125.66.80/28
20.171.206.0/24
20.171.207.0/24
4.227.36.0/25
52.230.152.0/24
74.7.175.128/25
74.7.227.0/25
74.7.227.128/25
74.7.228.0/25
74.7.230.0/25
74.7.241.0/25
74.7.241.128/25
74.7.242.0/25
74.7.243.128/25
74.7.244.0/25

Block or allow GPTBot in robots.txt

User-agent: GPTBot
Disallow: /

Use Allow: / instead to explicitly permit it, or build a full file with the AI robots.txt generator. robots.txt is a request, not a lock: it only works for bots that honor it, and only real GPTBot traffic would.

Source: OpenAI documentation