ConquestBot

About our web crawler

Last updated: June 6, 2026

Identity

ConquestBot is a web crawler operated by Conquest Cars Canada Inc., a Canadian company that connects vehicle shoppers with Ontario dealers. We aggregate publicly available inventory listings from OMVIC-registered dealers to generate qualified consumer leads for dealers and to provide shoppers with the market context they need to buy with confidence. Aggregated insights from our crawl also help participating dealers benchmark their inventory and pricing against regional norms.

What ConquestBot does

Reads publicly available inventory pages on Ontario-licensed (OMVIC-registered) automotive dealer websites within 500km of Toronto.
Identifies itself in every request with the User-Agent string ConquestBot/1.0 (+https://bot.conquestcars.ca).
Operates from a fixed range of identifiable IP addresses, reverse-DNS verifiable to *.bot.conquestcars.ca.
Honors robots.txt directives, including User-agent: ConquestBot blocks.
Sends conditional If-Modified-Since / If-None-Match requests so most crawls cost the originating site nothing.
Sustains a maximum of one request every 2 seconds per origin by default, and honors any Crawl-delay directive set higher.
Crawls only publicly accessible pages — never anything behind authentication, paywall, or CAPTCHA challenge.

How to control ConquestBot

ConquestBot honors the Robots Exclusion Protocol (RFC 9309). Any of the controls below take effect within 24 hours of our next scheduled crawl of your origin.

Slow us down

User-agent: ConquestBot
Crawl-delay: 10

Restrict to specific paths

User-agent: ConquestBot
Disallow: /private-section/

Opt out entirely

User-agent: ConquestBot
Disallow: /

You can also email nick@conquestcars.ca with the domain you want excluded and the change will be applied manually within 24 hours.

Verifying ConquestBot

Concerned a User-Agent claiming to be ConquestBot is genuine? You can verify it in two ways:

Reverse-DNS lookup on the requesting IP. Genuine ConquestBot traffic resolves to *.bot.conquestcars.ca; anyone spoofing our User-Agent from a different IP range is not us.
Email us at nick@conquestcars.ca with the IP, timestamp, and a sample request — we'll confirm within one business day whether it was ConquestBot.

Contact

Operator: Conquest Cars Canada Inc.
Email: nick@conquestcars.ca
This page: https://bot.conquestcars.ca