ByteDance · Training

Bytespider

Bytespider is ByteDance's crawler. This crawler collects page content used to train models.

Crawler facts

Operator	ByteDance
User agent token	`bytespider`
Traffic type	Training
Verification	User agent only
IP source	ByteDance publishes no IP list.

What "verified" means for Bytespider

ByteDance publishes no IP list for Bytespider, so a request claiming this user agent can never be proven genuine. DataSaaS always records it as unverified.

Track it

Bytespider fetches raw HTML and never runs JavaScript, so no browser tag can see it. Install the DataSaaS server-side package to record every request and verify the ones that publish IP ranges.

Read the bot-traffic setup guide

More from ByteDance

TikTokSpider Doubaobot

See which crawlers hit your site

DataSaaS records every AI crawler and search bot, then verifies the ones that publish IP ranges. Browse the full crawler directory.

Start free trial