Back to Home
Tool workspace
Utility
Robots.txt Generator
Generate robots.txt rules for crawlers and sitemaps.
Rules
robots.txt
Output
User-agent: * Allow: / Disallow: /admin Disallow: /private Sitemap: https://example.com/sitemap.xml
Generate robots.txt rules for crawlers and sitemaps.
User-agent: * Allow: / Disallow: /admin Disallow: /private Sitemap: https://example.com/sitemap.xml