Utility

Tạo Robots.txt

Tạo robots.txt cho crawler và sitemap.

Rules

robots.txt

Output
User-agent: *
Allow: /
Disallow: /admin
Disallow: /private
Sitemap: https://example.com/sitemap.xml