Skip to content

AI & LLM Governance

Location: Step 2 — AI & LLM Governance

This step controls how AI-related crawlers and usage preferences are handled.

Main controls

  • AI Training Protection — publishes restrictive rules and signals aimed at training-oriented bots when enabled
  • AI Search & Answer Engines — lets you choose whether AI search systems are allowed by published policy or restricted by published rules and signals
  • Content usage signals — clarifies preferences such as search, ai-input, and ai-train
  • llms.txt — available separately when your edition supports it

Why this step matters

This is where Better Robots.txt becomes more than a simple robots.txt editor. It lets you express intent around AI access and usage while staying clear that these are declarative signals.

Hard boundary

Nothing on this step should be described as proof of crawler obedience, legal enforceability, ranking impact, or security enforcement.

From the blog