Robots.txt Generator
Build a robots.txt with allow/disallow rules, sitemap & crawl-delay.
See how it works
Watch a quick simulation of this tool in action — no file needed.
How to use Robots.txt Generator
Follow these steps — everything happens instantly in your browser.
- 1
Step 1. Add rule blocks — one per user-agent (use * for all bots).
- 2
Step 2. For each block, list Allow and Disallow paths (e.g. /, /admin/).
- 3
Step 3. Optionally set a crawl-delay and a Host directive for mirror sites.
- 4
Step 4. Enter your sitemap URL, then copy or download the generated robots.txt.
Why use this tool
Private by design
All processing happens locally in your browser. Open DevTools → Network and you'll see zero file uploads. Ever.
Instant
No upload wait, no queue, no server round-trip. Results appear the moment you drop a file.
Free & unlimited
No accounts, no watermarks, no daily caps. Use it as many times as you like, forever.
Works everywhere
Desktop, tablet or phone — every tool is responsive and installable as a PWA for offline use.
Frequently asked questions
Everything you might want to know about robots.txt generator.
XML Sitemap Generator
Paste URLs and instantly generate a sitemap.xml — copy or download.
Meta Tag Generator
Generate title, description, OG and Twitter meta tags — copy-ready HTML.
Open Graph Preview
Preview your og: card on Facebook, Twitter & LinkedIn before shipping.
SERP Preview
See exactly how your page title & description render in Google.