Skip to content
Back
Robots.txt Generator
Generate robots.txt rules to control crawling and include sitemap directives.
Back
Developer tools
Robots.txt Generator
en
pt
Generate robots.txt rules to control crawling and include sitemap directives.
Robots Rules
Site URL
User-agent
Disallow rules (one per line)
/admin /private
Allow rules (one per line)
Crawl-delay (optional)
Include sitemap line
Open Site Preset
Block Staging Preset
Reset
Generated robots.txt
Copy
User-agent: * Disallow: /admin Disallow: /private Sitemap: https://example.com/sitemap.xml