Last updated: November 16, 2026
If you found StaticStudio in your server logs, this page explains who we are, what our crawler does on your site, and how to stop it.
The crawler is run by The InSite (theinsite.dev). It identifies itself on every request with this User-Agent:
StaticStudio/1.0 (+https://theinsite.dev/crawler)
Its product token, the name to use in robots.txt, is StaticStudio.
We rebuild existing websites as fast, static sites. To do that, the crawler copies a site's public pages and pictures so the new site can carry over the owner's own content. It visits a site when:
We do not sell or share what we collect, and we do not use it to train AI models.
It does not log in, fill in or submit forms, run your pages' scripts, or visit anything behind a password. Each file it downloads is checked, and anything that is not a plain picture or document is discarded.
robots.txt before its first request to your site, and never requests a URL that robots.txt disallows for StaticStudio (or, if no group names it, for *).Crawl-delay.429 or 503, and waits as long as a Retry-After header asks.robots.txt is read and honoured too.Add these lines to your robots.txt. The crawler reads them before its next request and stops:
User-agent: StaticStudio
Disallow: /
To keep it out of only part of your site, disallow just that path, for example Disallow: /private/.
Submit your domain below to add it to our opt-out list right away. The crawler checks the list before every visit and every request. A domain on the list (including its subdomains) is never fetched again, whatever its robots.txt says, until you ask us to remove it.
Prefer email? Write to crawler@theinsite.dev with your site's address.
If the crawler caused trouble on your site, or you have a question about it, write to us. Please include your site's address and, if you can, the time and the IP address from your logs.
Email: crawler@theinsite.dev
Website: theinsite.dev