Verified Bots Directory

Directory / AI crawlers

ClaudeBot

Fully verifiable

Anthropic's web crawler collecting publicly available web data for training Claude models. Anthropic publishes its crawler source IPs as a machine-readable feed.

Operated by Anthropic · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexClaudeBot/\d
  • observedMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)

How to verify

Fetch the official IP range feed

curl -s https://claude.com/crawling/bots.json

IP ranges (14)

Refreshed daily from the operator's feed. Also available as /data/ips/claudebot.ips and /data/bots/claudebot.json.

136.79.143.251/32
136.83.20.215/32
216.73.216.0/22
34.152.124.140/32
34.153.21.190/32
34.162.111.78/32
34.162.153.71/32
34.162.191.81/32
34.162.230.222/32
34.162.244.71/32
34.162.27.34/32
34.162.86.102/32
34.162.90.102/32
34.186.252.4/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Fully verifiable

  • Respects robots.txt

    Honors robots.txt (token: ClaudeBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.