Skip to main content
Free SEO tools

A valid robots.txt, in seconds.

Tell search engines what to crawl. Pick a starting point, add any paths you want to allow or block, point to your sitemap, then copy or download the file.

Runs entirely in your browser. No account, nothing uploaded.

Starting point

Use * for all crawlers, or a name like Googlebot.

robots.txt

User-agent: *
Disallow:

Save this as robots.txt in the root of your site (e.g. example.com/robots.txt). It guides crawlers but doesn’t enforce access. Use proper auth for anything private.