Robots path prefix checker
Find the longest literal Allow or Disallow prefix matching a path in a selected robots group.
The example value has been entered. Check it immediately or change the value.
Input is processed in the browser. Refreshing returns a sample value.
Instructions and example
No. Empty rules are not matching candidates in this checker. A path with no matching rule is allowed.
With /private/ disallowed and /private/public/ allowed, /private/public/readme is allowed because the longer prefix wins.
Allow wins equal-length ties. Group selection, wildcards, queries, end anchors and encoding normalization are unsupported.
Frequently asked questions
Does an empty Disallow block every path?
No. Empty rules are not matching candidates in this checker. A path with no matching rule is allowed.
Can I paste an entire robots.txt file?
Allow wins equal-length ties. Group selection, wildcards, queries, end anchors and encoding normalization are unsupported.
Calculation criteria and reference materials
- RFC 9309 — Robots Exclusion Protocol
Allow wins equal-length ties. Group selection, wildcards, queries, end anchors and encoding normalization are unsupported.
Verification of calculation criteria: · Calculation·verification principles · Report errors