Skip to content
Glossary

AI Agent Governance Glossary

Clear, citable definitions for the terms that matter when you govern autonomous AI agents — the control plane, the safety kernel, the patterns, and the protocols.

Governance & Control

AI Agent Governance

AI agent governance is the practice of enforcing policy, approvals, and audit over the actions autonomous AI agents take — controlling which tools they call, what data they touch, and which side effects they cause in production systems.

Read definition

Agent Control Plane

An agent control plane is the governance layer that sits between autonomous AI agents and the real systems they act on, evaluating policy before every action, routing high-risk operations to human approval, and recording an audit trail of every decision.

Read definition

Safety Kernel

A safety kernel is the policy decision point of an agent control plane — a dedicated service that evaluates every agent action before dispatch and returns a decision such as ALLOW, DENY, REQUIRE_APPROVAL, or ALLOW_WITH_CONSTRAINTS.

Read definition

Policy-Before-Dispatch

Policy-before-dispatch is the enforcement model where an agent's action is evaluated against policy and approved before it executes, rather than being observed or logged after the fact.

Read definition

Deterministic AI Control

Deterministic AI control means governing agent actions with explicit, rule-based policy that produces the same decision for the same input every time — as opposed to relying on a probabilistic model to judge whether an action is safe.

Read definition

Agent Sprawl

Agent sprawl is the uncontrolled proliferation of AI agents across an organization — many teams deploying agents with overlapping capabilities, inconsistent permissions, and no central inventory or policy — creating governance and security gaps.

Read definition

LLM-as-a-Judge

LLM-as-a-judge is a technique that uses a language model to evaluate outputs — scoring quality, checking criteria, or comparing responses — in place of a human rater or a fixed rule. It is well-suited to grading subjective quality, but its probabilistic nature makes it a poor fit for enforcing safety decisions.

Read definition

Policy as Code

Policy as code is the practice of defining governance rules in versioned, machine-readable files rather than prose or scattered configuration, so policy can be reviewed, tested, signed, and applied consistently and automatically.

Read definition

Architecture & Protocol

Safety & Reliability Patterns

LLM Guardrails

LLM guardrails are controls that constrain a language model's inputs and outputs — filtering prompts, validating responses, and blocking unsafe content — to keep generated text within acceptable bounds.

Read definition

Agentic Security

Agentic security is the discipline of securing autonomous AI agents against the new risks they introduce — unsafe tool use, excessive permissions, prompt injection that triggers actions, and unbounded side effects — by governing what agents can do, not just what they can say.

Read definition

Human-in-the-Loop (HITL)

Human-in-the-loop (HITL) is a control pattern where an autonomous AI agent pauses for explicit human approval before executing a high-risk action, so a person reviews and authorizes the operation before any side effect occurs.

Read definition

Saga Pattern (for AI Agents)

The saga pattern is a way to manage multi-step agent workflows so that if a later step fails, earlier steps are undone through compensating actions — keeping the system consistent without a single distributed transaction.

Read definition

Fail-Open vs Fail-Closed

Fail-open and fail-closed describe what a governance system does when its policy check is unavailable: fail-open lets actions proceed without a decision, while fail-closed blocks actions until policy can be evaluated.

Read definition

Idempotency Keys

An idempotency key is a caller-supplied token that lets a system recognize and de-duplicate retried requests, so submitting the same agent action twice produces one effect instead of two.

Read definition

Audit & Observability