Robots.txt Builder
Create a simple robots.txt file for a website.
Your result will appear here…
How to use this tool
Enter or paste the information requested by the tool.
Adjust the available options if necessary.
Run the tool, then review, copy or download the result.
For example, use information from one of your pages to check or prepare its search optimisation.
Robots.txt Builder
Enter a domain and, if needed, a path that crawlers should not access. The tool generates a basic robots.txt structure that you can review before placing it on your site.