Download Better Robots.txt
Install the plugin and get a clean, governed robots.txt in under 2 minutes. The guided wizard walks you through every step.
10,000+ active installs · 4.5/5 on WordPress.org · Works with WordPress 5.0+
Free edition — start here
The free edition is a real product, not a trial. It includes the guided setup wizard, the Essential preset, search engine controls, bad bot blocking, and the final Review & Save step.
How to install:
- In your WordPress admin, go to Plugins → Add New
- Search for Better Robots.txt
- Click Install Now, then Activate
- Go to Settings → Better Robots.txt and follow the wizard
Pro — for publishers and agencies
Adds AI-First preset, per-crawler rules (GPTBot, ClaudeBot, Google-Extended), llms.txt publishing, and deeper SEO tool controls.
Premium — maximum protection
Adds Fortress preset, advanced archive and anti-scraping controls, and the broadest bad bot coverage available.
What happens after install?
The plugin opens a guided wizard that walks you through:
- Choosing a preset (Essential, AI-First, Fortress, or Custom)
- Reviewing each rule group with plain-language explanations
- Previewing the generated robots.txt before publishing
- Optionally enabling llms.txt and AI usage signals (Pro/Premium)
No manual editing required. You can adjust settings at any time.
Not sure which edition?
- Compare all features — full side-by-side table
- See presets — what each mode configures
- Contact support — we answer in English and French
Next steps after install
- Quick Start — your first 5 minutes with the plugin
- Robots.txt Examples — sample outputs for different site types
- Features — complete feature overview