Your files stay on your device

# robots.txt tester

Paste-in rules with RFC 9309 longest-match verdicts per path.
Clearrobots.txt contentUser agent

Exact match first, then * groups (RFC 9309).
Paths (one per line)

Longest matching rule wins; allow wins ties.

Paste a robots.txt and a path list: the tester implements longest-match with wildcards and $ anchors.
Paste, drop, or type to begin. Everything stays on this device.

## More web & auth tools

- [Open graph preview](/web/og-preview)
- [HTTP header parser](/web/headers)
[All web & auth tools](/web)

---

Canonical HTML: https://nutter.tools/web/robots/
Markdown version: https://nutter.tools/web/robots/index.md
Plain-text version: https://nutter.tools/web/robots/index.txt
Agent index: https://nutter.tools/llms.txt