MotoMinerBot
VerifiableMotoMiner's vehicle-listing crawler. It primarily crawls automotive dealership websites and adds their vehicle detail pages to the MotoMiner index. The operator documents robots.txt and crawl-delay support, honours bot-specific noindex meta directives, throttles outbound requests against defined traffic thresholds, and publishes the address the crawler currently requests from.
Operated by MotoMiner · Official documentation
User agents
Patterns this directory matches, with real observed strings.
- regexMotoMinerBot/\d
- observedMozilla/5.0 (compatible; MotoMinerBot/1.0; +https://motominer.com/Bot)
How to verify
Documented static ranges: 23.101.129.27/32
IP ranges (1)
Refreshed daily from the operator's feed. Also available as /data/ips/motominerbot.ips and /data/bots/motominerbot.json.
23.101.129.27/32
Good Bot Practices scorecard
- Identifies honestly
Stable UA token documented (1 pattern)
- Verifiable
Verifiable
- Respects robots.txt
Honors robots.txt (token: MotoMinerBot)
- Behaves
Crawl-rate behavior is operator-declared; not machine-verifiable from this dataset
- Reachable operator
Operator and documentation published
Measured against the Good Bot Practices.