About this utility
How to use robots.txt Analyzer
Parse crawler groups, Allow/Disallow precedence, sitemap lines, and test a path without contacting a website.
What to provide
Paste a robots.txt file. Choose a user agent and path to evaluate locally.
- Paste, type, or drag and drop a supported text file into the input area.
- Choose the options that match your intended result.
- Select “Run tool” or press Ctrl/Command + Enter, then copy, download, or move the result back into the first input for another pass.
What the result means
Parsed groups, matching rule, decision, sitemaps, and syntax findings.
Privacy and safety
This utility is loaded as browser code and processes your input only in this tab. OmniCastConverter has no upload endpoint and never stores your content, filenames, tokens, or secrets. Generated markup and code are shown as inert text and are never executed.
Limitations
- Crawler support for wildcards, end anchors, crawl-delay, and nonstandard directives varies; the report follows common longest-match behavior.
Try the included example
Select “Load example” at any time to restore this tested sample.
User-agent: *
Disallow: /private/
Allow: /private/public-summary
Sitemap: https://example.com/sitemap.xml