ClaudeBot
ClaudeBot is Anthropic's crawler that collects web data to help train Claude.
Why it matters: its crawl volume rose sharply through 2025–26, so it may account for a noticeable share of your bot traffic — useful to recognise in server logs.
Like other training crawlers it can be allowed or disallowed in robots.txt, and it’s separate from Anthropic’s search-index crawler (Claude-SearchBot).