Production Readiness
10 essays tagged with Production Readiness.
Managed Agent Harnesses: The Control Boundaries You Still Own
A research-backed operating guide to managed agent harnesses: durable sessions, caller credentials, authorization, interrupted effects, version drift, migration tests, and application-owned evidence.
A Research and Publishing Roadmap for Harness Engineering
A prioritized roadmap for original harness engineering research and technical publishing, with experiments, baselines, artifacts, decision gates, and falsifiable directions through 2027.
Agent Harness Benchmark: An Experimental Protocol Beyond Model Scores
A proposed benchmark protocol for isolating harness effects, injecting operational faults, measuring repeated reliability, and publishing auditable scorecards.
Agent Evaluation After the Leaderboard: The KDD 2026 Production Assurance Playbook
KDD 2026 shows why agent evaluation must cover protocols, trajectories, external state, evaluator operating profiles, causal rollout, and drift.
Human Oversight for Agent Fleets: Confidence Is Not an Audit Policy
A new audit-allocation paper shows that self-reported confidence can make limited human review worse than random and that tiny audit budgets can become rubber-stamping. Production oversight needs risk gates, stratified random coverage, correlation-aware learning, and a measured non-vacuity test.
Your Agent Benchmark Is Measuring the Harness
Two new evaluation systems separate benchmark, harness, model, and environment. Their results show why one leaderboard score cannot tell you which agent to ship.
The State of AI Agents in 2026: Standards Converged, Models Improved, Production Moved to the Harness
A mid-2026 review of agentic AI: MCP, A2A and AP2 converged as standards and models got more reliable — yet the bottleneck moved to the governed agent harness.
Scorecards Over Vibes: The Five Metrics That Keep Agents Honest
The five metrics that keep agents honest: policy, utility, latency, safety, and economics.
Agentic AI Systems Before and After ContextOS
A concrete before-and-after guide to agentic AI: what context, authority, evidence, replay, and release controls change in a refund run—and what they cannot guarantee.
The Agent Harness Audit: A Production Readiness Checklist for Governed AI Agents
The original 44-control agent harness checklist, with a note on the current release-specific assurance method and evidence requirements.