Unverified. We found no operator documentation that confirms what Bytespider does or how it handles robots.txt. Fields below say "not stated" where the operator says nothing. What we checked: ByteDance developer docs (attempted; HTTP 404), read October 29, 2026.
What is Bytespider?
Bytespider is ByteDance's crawler whose purpose the operator does not state. The operator publishes nothing we could verify about its purpose.
| Operator | ByteDance |
|---|---|
| Purpose (operator wording) | not stated by operator |
| robots.txt token | Bytespider |
| User agent string | Not stated by the operator |
| Respects robots.txt | Unverified |
| IP ranges | Not stated by the operator |
| Last verified |
What else should I know about Bytespider?
What is the Bytespider user agent string?
ByteDance does not publish a full user agent string for Bytespider. The robots.txt token to use is Bytespider.
How do I block Bytespider in robots.txt?
Add this group to the robots.txt file at the root of your site. It asks Bytespider to stay out of every page.
User-agent: Bytespider
Disallow: /Note: standard syntax; token seen in third-party sources, not operator docs.
Does blocking Bytespider affect AI answers?
ByteDance does not say what blocking Bytespider changes. That is not stated.
Does Bytespider follow robots.txt?
Unverified. No ByteDance documentation found. The developer.bytedance.com/docs/en/spider URL returned 404 and bytedance.us/bytespider returned an empty page. We make no claim about whether it follows robots.txt.
Robots.txt is a request, not a lock (RFC 9309).
What IP addresses does Bytespider use?
Not stated by the operator. Without a published list you cannot verify Bytespider by address, so a rule at your server cannot rely on one.
What should I read next?
Next: give AI tools something to quote
Paperboy writes articles that answer the questions your buyers ask, with every fact linked to its source, FAQ and Article structured data, and publishes them to your site every week. Your first article is free.