Robots.txt Generator
Open a robots.txt file from your computer or fetch it from a website, edit the rules, and build the final file.
Learn more about robots.txt and how search engines use it
Import an existing file
From your PC, use the file picker. From the web, enter only the site address (e.g. https://yoursite.com)—we fetch /robots.txt automatically.
Or site URL
Quick presets
Pick a template to fill User-agent, Disallow, and Allow in one click—you can edit everything afterward.
Not the site homepage—only the sitemap.xml URL to add as a Sitemap: line in the generated file.