Human Oversight
5 essays tagged with Human Oversight.
AuthorizationBench: Success Does Not Grant Authority
A deep assessment of AuthorizationBench v2: benign pressure, consultation timing, statistical limits, a pinned release audit, and how to evaluate authorized agent work.
The AI Agent Review Tax: When Automation Creates Verification Debt
Measure the review, repair, and integration work behind agent output—and design verification that catches errors without erasing the gain.
The Delegation Contract: How to Let an AI Agent Act Without Losing Control
Replace vague prompts and approval fatigue with a bounded contract for agent goals, data, authority, limits, changes, and receipts.
The Glass Runtime: Keeping Humans Close to the Material in an Agentic World
As AI makes output abundant, the central design challenge shifts to preserving human judgment, understanding, intervention, and agency. The Glass Runtime is an architecture for progressive autonomy, inspectable decisions, material-native interaction, reversibility, governed authority, and accountable learning.
Human Oversight for Agent Fleets: Confidence Is Not an Audit Policy
A new audit-allocation paper shows that self-reported confidence can make limited human review worse than random and that tiny audit budgets can become rubber-stamping. Production oversight needs risk gates, stratified random coverage, correlation-aware learning, and a measured non-vacuity test.