Your files stay on your device robots.txt tester Paste-in rules with RFC 9309 longest-match verdicts per path. Clearrobots.txt contentUser agent Exact match first, then * groups (RFC 9309). Paths (one per line) Longest matching rule wins; allow wins ties. Paste a robots.txt and a path list: the tester implements longest-match with wildcards and $ anchors. Paste, drop, or type to begin. Everything stays on this device. More web & auth tools - Open graph preview (/web/og-preview) - HTTP header parser (/web/headers) All web & auth tools (/web) Canonical HTML: https://nutter.tools/web/robots/ Markdown version: https://nutter.tools/web/robots/index.md Plain-text version: https://nutter.tools/web/robots/index.txt Agent index: https://nutter.tools/llms.txt