Robots.txt Tools
Robots.txt Validator
Paste a robots.txt file to find syntax errors, whole-site blocking rules, invalid Sitemap directives, and compatibility warnings.
Paste robots.txt
Validation runs locally in the browser as you edit.
File size
74 bytes
Lines
5
User-agent groups
1
Sitemaps
1
RFC 9309
Pass
Pass
Bing
Pass
No issues detected
No diagnostics in the selected scope were triggered by the current file.
Compatibility checks are practical diagnostics, not a guarantee that every crawler implements every non-standard directive the same way.
Annotated source
Problem lines are highlighted below. Click a line to select the same line in the editor above.
What this validator checks
The validator checks directive formatting, User-agent grouping, Sitemap URLs, dangerous Disallow rules, and non-standard directives. It also highlights Crawl-delay because Googlebot does not support it.
Need to create a file first?
Start with the generator, then return here for a focused validation view.
Open Robots.txt Generator →RFC 9309
Compatibility checks are practical diagnostics, not a guarantee that every crawler implements every non-standard directive the same way.
Annotated source
Problem lines are highlighted below. Click a line to select the same line in the editor above.
No issues detected
No diagnostics in the selected scope were triggered by the current file.
Technical references
Rules and crawler-specific guidance are checked against primary standards and provider documentation rather than copied from other SEO tools.
- RFC 9309
Robots Exclusion Protocol syntax, matching, grouping, and percent-encoding behavior.
- Google robots.txt specification
Google-specific robots.txt behavior and supported fields.