What is omgili?
omgili is Webz.io's crawler for another purpose. The operator describes a purpose that is neither AI training nor search. From the operator's wording: web data feed sold via the Webz.io API; the page does not mention AI training.
| Operator | Webz.io |
|---|---|
| Purpose (operator wording) | other (web data feed sold via the Webz.io API; the page does not mention AI training) |
| robots.txt tokens | omgili, omgilibot |
| User agent string | omgili/0.5 +https://omgili.com (as quoted by Webz.io) |
| Respects robots.txt | Yes (operator claim) |
| IP ranges | Not stated by the operator |
| Last verified |
What else should I know about omgili?
What is the omgili user agent string?
This is the user agent string Webz.io documents for omgili, as of October 29, 2026. Version numbers and details can change, so match on the token in robots.txt, not on the whole string.
omgili/0.5 +https://omgili.com (as quoted by Webz.io)How do I block omgili in robots.txt?
Add this group to the robots.txt file at the root of your site. It asks omgili to stay out of every page.
User-agent: omgili
Disallow: /Note: standard syntax; Webz.io does not publish exact robots lines.
To allow it explicitly, for example while a broader rule blocks other bots:
User-agent: omgili
Allow: /Note: standard syntax.
Does blocking omgili affect AI answers?
Webz.io does not say what blocking omgili changes. That is not stated.
Does omgili follow robots.txt?
Yes. Operator claim. Webz.io: 'If you don't like our bot hanging around your site, you can tell us directly or through your robots.txt file.' No per-token syntax is given.
Robots.txt is a request, not a lock (RFC 9309).
What IP addresses does omgili use?
Not stated by the operator. Without a published list you cannot verify omgili by address, so a rule at your server cannot rely on one.
What should I read next?
Next: give AI tools something to quote
Paperboy writes articles that answer the questions your buyers ask, with every fact linked to its source, FAQ and Article structured data, and publishes them to your site every week. Your first article is free.