Gadly

Mobile and tablet view is currently being improved. We are updating the layout and it will be fully optimized soon.

Robots.txt Generator

Open a robots.txt file from your computer or fetch it from a website, edit the rules, and build the final file.

Learn more about robots.txt and how search engines use it

Import an existing file

From your PC, use the file picker. From the web, enter only the site address (e.g. https://yoursite.com)—we fetch /robots.txt automatically.

Or site URL

Quick presets

Pick a template to fill User-agent, Disallow, and Allow in one click—you can edit everything afterward.

Not the site homepage—only the sitemap.xml URL to add as a Sitemap: line in the generated file.