Pattern Library

This library turns Better Robots.txt from a set of features into a set of reusable policy patterns.

A pattern is not only a preset name. It is a documented combination of:

• site type
• primary risk
• preferred preset
• modules to enable first
• trade-offs to explain before publishing

Available patterns

• Knowledge site with llms.txt

• SaaS public site vs app

• Protection-first crawl governance

• Agency multi-site governance

• WooCommerce crawl hygiene

• Small business on Essential

• Publisher on AI-First

• WooCommerce crawl control

• Fortress for sensitive sites

• Custom rollout for agencies

How to use the library

1. Start with your site type.
2. Identify your main risk.
3. Choose the narrowest preset that solves the real problem.
4. Add only the modules you can justify.
5. Validate trade-offs before publishing.

Decision support

The machine-readable matrix lives here:

• preset-decision-matrix.json
• preset-patterns.json
• site-type-playbooks.json