ClaudeBot

ClaudeBot is Anthropic's crawler that collects web data to help train Claude.

Like other training crawlers it can be allowed or disallowed in robots.txt, and it's separate from Anthropic's search-index crawler (Claude-SearchBot).

Why it matters: Its crawl volume rose sharply through 2025–26, so it may account for a noticeable share of your bot traffic — useful to recognise in server logs.