OmnisBot

The web fetcher used by Omnis.

If you found OmnisBot in your server logs, this page explains who runs it, what it reads, and how to stop it. Omnis is a tool for product marketing teams. Its customers choose which competitors to keep an eye on, and OmnisBot reads a few of those competitors' public marketing pages so the customer can see what changed.

What it reads

• Only public pages that anyone can open in a browser, with no login.
• For each site: the page a customer entered (usually the home page), plus /pricing, /about and /blog on the same site.
• It does not follow other links, crawl your site, submit forms or run scripts.
• It sends no cookies and no credentials, and it does not try to get around logins, paywalls or bot protection.

How it behaves

• It identifies itself in every request: User-Agent: OmnisBot/1.0 (+https://veromnis.com/bot).
• It reads your robots.txt first and follows it. The file is remembered for up to 24 hours. If robots.txt cannot be reached because of a server error, OmnisBot does not fetch your pages until it can read it.
• It makes one request at a time to your site, at least 2 seconds apart.
• It asks whether a page has changed (If-None-Match and If-Modified-Since), so an unchanged page is not downloaded again.
• It reads at most 2 MB per page and gives up after 20 seconds.
• Scans happen when a customer adds a competitor or asks for one, and on a regular schedule. We keep this light: a few pages, spaced out, not continuous crawling.
• It does not publish your pages. Saved copies are used only to show the customer who tracks you what changed.

How to block it

Add this to your robots.txt and OmnisBot will stop fetching your pages:

User-agent: OmnisBot
Disallow: /

You can also block only part of your site, for example:

User-agent: OmnisBot
Disallow: /pricing

The product token is OmnisBot. Rules for User-agent: * apply too, unless you have a group for OmnisBot, which then takes priority.

Contact us

Questions, a request to stop, or a problem with how OmnisBot is behaving: write to bot@veromnis.com. Please include your site's address and, if you can, a few lines from your logs. We read these messages and reply.

OmnisBot does not use a fixed set of IP addresses, so the User-Agent and robots.txt are the reliable ways to recognise and control it.