Free tool

robots.txt generator

Create a valid robots.txt file in seconds: pick a preset or customize the rules. Copy or download it and place it in your site root.

User-agent

Disallow (one path per line)

Allow (one path per line)

Crawl-delay (seconds, optional)

Sitemap URL (optional)

Generated robots.txt

# robots.txt

Get practical SEO tips by email

No spam: just useful tips and tool updates. Unsubscribe anytime.

Full picture

Want to know if your robots.txt blocks important pages?

Free audit Free tools →