Directory / AI crawlers

Context7-Crawler

Listed only

Context7's documentation crawler, an Upstash project. It reads public documentation pages so that AI coding agents can retrieve and cite them, and the operator stated the content is used for AI search with links back to the source rather than for model training. Context7 has since withdrawn the crawler page that documented it and the key directory its requests were signed against, so the user agent is all that remains attributable: the entry is kept for identity and carries no verification recipe.

Operated by Upstash · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexContext7-Crawler/\d
  • observedContext7-Crawler/1.0 (+https://context7.com/crawler)

How to verify

No verification recipe published by the operator.

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Operator publishes no verification path

  • Respects robots.txt

    Honors robots.txt (token: Context7-Crawler)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.