Bytespider
ByteDance · AI / data crawler
ByteDance's crawler. ByteDance publishes no IP list, so requests can't be verified by IP.
- User-agent contains
Bytespider- robots.txt token
Bytespider- Respects robots.txt
- Operator docs don't say / may not apply
- Official IP ranges
- None published
How to verify Bytespider
ByteDance publishes no official IP list for Bytespider, so a request can't be verified by address. Treat the user agent as a claim, not proof.
Block or allow Bytespider in robots.txt
User-agent: Bytespider Disallow: /
Use Allow: / instead to explicitly permit it, or build a full file with the AI robots.txt generator. robots.txt is a request, not a lock: it only works for bots that honor it, and only real Bytespider traffic would.
Verify Bytespider automatically
Our API recognizes Bytespider and 20+ other AI crawlers in one call, and flags the ones that can't be verified.
Get a free API key10,000 checks/month free · Pro $19/month for 1M