About this tool

Create and validate robots.txt files for your website. Use the editor to add directives or start from a CMS template. Errors highlight common mistakes as you type.

FAQs

What does robots.txt do?

It tells search engines which parts of your site they can or cannot crawl.

Is it required for SEO?

No, but a well configured file can improve crawl efficiency and protect private areas.