SEO Tools

Robots.txt Checker

Validate and analyze robots.txt files to check crawling rules and directives

Lookup input
Ready

Check Robots.txt

Enter a clear value to return validity, reason, next check. Try https://www.google.com/robots.txt as a baseline.

Robots.txt input

Validate and analyze robots.txt files to check crawling rules and directives. Use a specific robots.txt value so the result matches the right SEO Tools task.

Robots.txt result

Read validity, reason, next check first, then open the extra fields only when they change your next action.

Developer & Webmaster Tools check

For SEO Tools tasks, verify with an official or primary source before relying on the result for money, travel, health, legal, or customer-facing decisions.

Next SEO Tools step

Continue with HTTP Header Checker or HTTP Status Checker when this answer needs a second reference point.