Core concept

Human Intervention Rate

A measure of how often human judgment must interrupt or guide agent execution.

What the metric measures

Human intervention rate asks how often a human must enter an agent-handled workflow. It counts the points where the system cannot proceed safely or usefully without judgment, clarification, approval, exception handling, or accountability.

Why it is diagnostic

A high intervention rate is not automatically bad. It may reveal unclear policy, poor data, missing permissions, weak process design, or a domain where human accountability is genuinely required. The metric helps separate automation failure from necessary governance.

How it should change over time

In a healthy AI organization, recurring interventions should teach the system. Some interventions become clearer rules. Some become escalation paths. Some reveal that a workflow is not ready for agent execution. Some reveal work that should remain human.

What to measure alongside it

Intervention rate should be paired with cycle time, error rate, customer impact, escalation reasons, and the percentage of interventions that lead to process improvements. Otherwise the metric can be misused as a crude automation target rather than a management signal.

Why zero is not the goal

The goal is not to remove humans from every workflow. The goal is to make human participation intentional. Human intervention should happen where judgment, trust, accountability, or ambiguity make it valuable, not where the organization failed to explain its own work.

The operating question

The useful question for managers is: why did the human need to enter here? If the answer is missing data, unclear policy, or a broken handoff, improve the system. If the answer is real judgment, design the workflow to preserve that judgment.

What counts as intervention

Intervention includes more than formal approval. It includes a human clarifying an instruction, correcting an output, choosing between conflicting data sources, resolving an exception, calming a customer, overriding a rule, or taking accountability for a decision. If the agent could not proceed without that human action, the workflow has registered an intervention.

How to classify interventions

The useful classification is not simply good or bad. Some interventions are design failures: the process was unclear, the data was wrong, or the policy was missing. Some are governance requirements: the decision carries risk and should remain human. Some are learning opportunities: the system has encountered a new pattern that should be turned into a better rule. Classifying interventions prevents managers from optimizing the wrong thing.

Why the metric changes management

Traditional management often sees exceptions as interruptions. In an AI organization, exceptions are a primary source of operating intelligence. A manager should want to know where humans enter the workflow, why they enter, and what changes afterward. The metric turns hidden friction into visible design work.

How not to misuse it

A low human intervention rate is not automatically success. It may mean the agent is operating well, or it may mean humans are not reviewing work that should be reviewed. The metric must be paired with quality, risk, customer outcomes, and auditability. The goal is not fewer humans at any cost. The goal is the right humans in the right moments for the right reasons.

The goal is not zero human intervention. The goal is intentional human intervention.

Frequently asked questions

What is human intervention rate?

Human intervention rate measures how often human judgment must enter an agent-handled workflow through clarification, approval, correction, exception handling, or accountability.

Should human intervention rate always go down?

No. The goal is intentional intervention. Some human involvement should be reduced through better design; some should remain because judgment or accountability is genuinely required.

Where does this fit in the book?

This concept is part of The AI Organization's broader argument that firms need a new operating theory when intelligence becomes abundant.