Directory / AI crawlers

LinerBot

Fully verifiable

Web crawler operated by Liner, an AI search and research assistant. It builds and refreshes the index behind Liner's search and reference features — paper metadata, citations and DOI resolution — so Liner's agents can retrieve and cite pages. Liner's crawler page documents the user agent and robots.txt token, gives worked examples for a full disallow and for path-scoped rules, and states that rules naming LinerBot do not apply to its on-demand sibling Liner-User. Both agents sign their requests with HTTP Message Signatures under separate keys; Liner publishes no address ranges for either.

Operated by Liner · Official documentation

User agents

Patterns this directory matches, with real observed strings.

  • regexLinerBot/\d
  • observedMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; LinerBot/1.0; +https://liner-bot.liner.com/docs/liner-bot)

How to verify

Fetch the Web Bot Auth key directory

curl -s https://liner-bot.liner.com/.well-known/http-message-signatures-directory

Good Bot Practices scorecard

  • Identifies honestly

    Stable UA token documented (1 pattern)

  • Verifiable

    Fully verifiable

  • Respects robots.txt

    Honors robots.txt (token: LinerBot)

  • Behaves

    Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset

  • Reachable operator

    Operator and documentation published

Measured against the Good Bot Practices.