About SeouchBot
SeouchBot is the crawler that fetches pages for the Seouch SEO audit and free tools. If you have found it in your server logs, this page explains what it was doing, how much it fetches and how to stop it.
How to recognize it
SeouchBot identifies itself with this user agent string:
Mozilla/5.0 (compatible; SeouchBot/1.0; +https://seouch.com/bot)Requests come from our hosting provider's serverless infrastructure, so the IP addresses vary and we do not publish a fixed list.
When it runs
SeouchBot only runs when a person submits a URL to one of our tools. It does not crawl the web on its own, keep a schedule of sites to revisit or follow links to other sites. If the same page was audited in the previous 24 hours, we usually show the stored result instead of fetching the page again.
What it fetches
For a single-page audit, SeouchBot makes the requests below. Most run in parallel, so the whole check takes seconds rather than minutes.
| What | How | Limits |
|---|---|---|
| The page that was submitted | GET, following up to 5 redirects | 15 seconds; reads at most 5 MB |
| /robots.txt | GET | 7 seconds; at most 512 KB |
| The XML sitemap | GET for the sitemaps listed in robots.txt, or /sitemap.xml and common variants; for a sitemap index, up to 4 child sitemaps | 7 seconds each; at most 3 MB |
| /llms.txt | GET | 6 seconds; at most 256 KB |
| The http:// and www (or non-www) versions of the page | HEAD, to check redirects to HTTPS and the preferred host | 7 seconds each |
| The TLS certificate | One TLS handshake on port 443 | 7 seconds |
| Up to 20 internal links found on the page | HEAD, or a GET of at most 16 KB when HEAD is not supported; at most 5 at a time | 6 seconds each |
| The same page again, as AI and search crawlers | GET with the Googlebot, OAI-SearchBot, PerplexityBot, GPTBot and ClaudeBot user agent strings | 9 seconds each; at most 64 KB |
A typical audit makes about 30 to 40 requests to your site. Every connection has a 10-second connection timeout, and SeouchBot only connects to public IP addresses on the standard web ports.
Requests with AI crawler user agents
Part of the audit tests whether your site lets AI and search crawlers in. To do that, we request the page again using the published user agent strings of Googlebot, OAI-SearchBot, PerplexityBot, GPTBot and ClaudeBot, and compare the responses with our normal request. These few requests come from our servers, not from Google, OpenAI, Perplexity or Anthropic, and they will appear in your logs under those names. You can tell them apart from the real crawlers because their IP addresses do not match the ranges those companies publish.
What it does not fetch
Performance data comes from Google PageSpeed Insights, which loads your page from Google's own infrastructure, not from SeouchBot. SeouchBot does not submit forms, log in, run JavaScript or download images, scripts and stylesheets.
Request volume
Each person can start a limited number of audits in a short period, and the service as a whole has an hourly cap, so a burst of audits against one site is unlikely. If you see SeouchBot traffic that looks excessive, please tell us with the time range and your domain, and we will look into it.
How to block it
Add a group for SeouchBot to your robots.txt:
User-agent: SeouchBot
Disallow: /We honor this for site crawls, where SeouchBot visits several pages of a site. A single-page check is different: it runs because a person asked about one specific page, much like a visit from a browser, so SeouchBot still fetches that page and the supporting files listed above. If you also block SeouchBot at your firewall or CDN, audits of your site will fail or report that the site blocked us.
Contact
Questions or problems with SeouchBot: email hello@seouch.com with "SeouchBot" in the subject, or use the contact form. Include your domain and the approximate time of the requests. The privacy policy explains what we store from the pages we fetch.