Verified Bots Directory

Directory / Search engines

cl0q crawlers

Fully verifiable

The three crawlers behind cl0q, an independent search engine that runs its own crawler and index rather than reselling another engine's results. cl0q-crawler reads a site's robots.txt and home page for the search index, cl0q-discovery follows a capped number of ordinary public links purely to learn which other sites exist, and cl0q-favicon fetches the site icon shown beside results. All three identify themselves, link back to one bot page, answer to the shared robots.txt token cl0q as well as their individual names, and run from a single published address. The crawler node is open source.

Operated by cl0q · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexcl0q-(?:crawler|discovery|favicon)/\d
  • observedMozilla/5.0 (compatible; cl0q-crawler/1.0; +https://cl0q.com/bot)
  • observedMozilla/5.0 (compatible; cl0q-discovery/1.0; +https://cl0q.com/bot)
  • observedMozilla/5.0 (compatible; cl0q-favicon/1.0; +https://cl0q.com/bot)

How to verify

Fetch the official IP range feed

curl -s https://cl0q.com/bot/ips.json

IP ranges (1)

Refreshed daily from the operator's feed. Also available as /data/ips/cl0q-crawler.ips and /data/bots/cl0q-crawler.json.

143.110.230.182/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Fully verifiable

  • Respects robots.txt

    Honors robots.txt (token: cl0q)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.