About the Stageify crawler
Stageify operates a small, well-behaved crawler that indexes publicly available information about theatre productions, companies, and shows so that visitors can find them in one place. This page explains what it does and how to control it.
What we crawl and why
The crawler reads publicly accessible web pages that an administrator or a community member has explicitly pointed us at — for example, a theatre company's website or a production page. We use the content to keep our community directory accurate and up to date. We do not crawl the open web at large, and we do not collect personal data beyond what is already published on the page.
Robots.txt compliance
We respect robots.txt. To allow or disallow our crawler, target the agent name "Stageify Indexer" in your robots.txt User-agent directive. We honour Disallow rules and the Crawl-Delay directive for that agent.
How to identify our crawler
Our crawler sends a User-Agent that identifies Stageify, its version, and a link back to this page, with a browser-compatible suffix. A typical value looks like: Stageify Indexer/0.0.0 (+https://stageify.net/about-crawler) Mozilla/5.0 (compatible).
Caching and limits
We honour the Crawl-Delay directive in robots.txt to keep request rates polite, and we cap each page download at 5 MB. We cache fetched content so we do not re-request the same page unnecessarily.
Expected request rates
Requests are driven by administrator and community actions rather than continuous automated crawling, so volumes are low — typically a handful of requests per host per day. We never run high-frequency or parallel sweeps against a single host.
Contact and opt-out
If you would like your content excluded, corrected, or removed from our directory, email us at info@stageify.net and we will action your request. You can also block the "Stageify Indexer" agent in your robots.txt.