Directory / Search engines

YioopBot

Fully verifiable

The crawler for Yioop, an open-source PHP search engine written and run by Chris Pollett, whose crawls feed the live search engine at yioop.com. The bot page names the operator, the small block of addresses the crawl runs from, and an unusually detailed account of how the crawler reads robots.txt, robots meta tags, X-Robots-Tag headers, rel=nofollow, rel=canonical, Crawl-delay and Sitemap directives. The crawler and search engine source are published under the GPLv3, so the documented behaviour can be checked against the code. The bot page also documents Web Bot Auth request signing and names the key directory that verifies it.

Operated by Seekquarry LLC (Chris Pollett) · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexYioopBot
  • observedMozilla/5.0 (compatible; YioopBot; +https://www.yioop.com/bot.php)

How to verify

Fetch the Web Bot Auth key directory

curl -s https://www.yioop.com/.well-known/http-message-signatures-directory

Documented static ranges: 173.13.143.73/32, 173.13.143.74/32, 173.13.143.75/32, 173.13.143.76/32, 173.13.143.77/32, 173.13.143.78/32

IP ranges (6)

Refreshed daily from the operator's feed. Also available as /data/ips/yioop-bot.ips and /data/bots/yioop-bot.json.

173.13.143.73/32
173.13.143.74/32
173.13.143.75/32
173.13.143.76/32
173.13.143.77/32
173.13.143.78/32

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Fully verifiable

  • Respects robots.txt

    Honors robots.txt (token: YioopBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.