meta-externalagent

Meta · Model training crawler

Crawls the web for use cases such as training foundation AI models or improving products by indexing content directly.

User-agent contains

meta-externalagent

robots.txt token

meta-externalagent

Respects robots.txt

Yes, per operator docs

Official IP ranges

None published

How to verify meta-externalagent

Meta publishes no official IP list for meta-externalagent, so a request can't be verified by address. Treat the user agent as a claim, not proof.

Block or allow meta-externalagent in robots.txt

User-agent: meta-externalagent
Disallow: /

Use Allow: / instead to explicitly permit it, or build a full file with the AI robots.txt generator. robots.txt is a request, not a lock: it only works for bots that honor it, and only real meta-externalagent traffic would.

Source: Meta documentation