A
r
i
e
l
t
o
n
O
b
e
r
e
k
.
Skip to content
Back
Robots.txt Generator
Generate robots.txt rules to control crawling and include sitemap directives.
Share this tool
Back
Developer tools
Robots.txt Generator
en
pt
Generate robots.txt rules to control crawling and include sitemap directives.
Robots Rules
Site URL
User-agent
Disallow rules (one per line)
/admin /private
Allow rules (one per line)
Crawl-delay (optional)
Include sitemap line
Open Site Preset
Block Staging Preset
Reset
Generated robots.txt
Copy
User-agent: * Disallow: /admin Disallow: /private Sitemap: https://example.com/sitemap.xml
Related tools
Meta Tag Generator
Hreflang Generator
JWT Encoder
Canonical URL Checker
FAQ Schema Generator
Schema Markup Generator