Bytespider

ByteDance · AI / data crawler

ByteDance's crawler. ByteDance publishes no IP list, so requests can't be verified by IP.

User-agent contains
Bytespider
robots.txt token
Bytespider
Respects robots.txt
Operator docs don't say / may not apply
Official IP ranges
None published

How to verify Bytespider

ByteDance publishes no official IP list for Bytespider, so a request can't be verified by address. Treat the user agent as a claim, not proof.

Block or allow Bytespider in robots.txt

User-agent: Bytespider
Disallow: /

Use Allow: / instead to explicitly permit it, or build a full file with the AI robots.txt generator. robots.txt is a request, not a lock: it only works for bots that honor it, and only real Bytespider traffic would.

Verify Bytespider automatically

Our API recognizes Bytespider and 20+ other AI crawlers in one call, and flags the ones that can't be verified.

Get a free API key10,000 checks/month free · Pro $19/month for 1M