Skip to content
Back
Developer tools
Robots.txt Generator
en
pt
Generate robots.txt rules to control crawling and include sitemap directives.
Robots Rules
Site URL
User-agent
Disallow rules (one per line)
/admin /private
Allow rules (one per line)
Crawl-delay (optional)
Include sitemap line
Open Site Preset
Block Staging Preset
Reset
Generated robots.txt
Copy
User-agent: * Disallow: /admin Disallow: /private Sitemap: https://example.com/sitemap.xml