Quick Start
For many websites, the safest start is:
- Install Better Robots.txt
- Open the setup wizard
- Choose Essential
- Review the final output
- Save changes
Which preset is safest?
- Essential: safest starting point for most sites
- AI-First: best for publishers and content-heavy sites
- Fortress: best for stricter protection-first setups
- Custom: best for advanced users who know why they need it
Free, Pro, and Premium
The free edition is intentionally useful on its own.
Use it when you want:
- a better default robots.txt
- guided setup
- clearer crawl policy
- review before publish
Move to Pro when you want:
- deeper AI and SEO tool controls
- more detailed governance options
llms.txtsupport
Move to Premium when you want:
- the strictest protection-oriented setup
- broader bad bot coverage
- the strongest archive and crawler options
The safest first path
If you are not sure:
- start with Free
- choose Essential
- review the output
- tighten only what you understand