Skip to content
Back to Blog
Blog series
10 posts · 88 min read

Building the runtime

Compile, gateway, Critic, evaluators, failure handling — the per-request pipeline.

Share:XBSMRedditHNEmail
1
November 6, 2026·9 min read

After Tool Results Leave the Prompt: Designing Safe Artifact References

Offloading tool results saves context. Safe reuse also needs immutable identity, bounded reads, current access, explicit omissions, and evidence recovery.

2
October 26, 2026·14 min read

Inside ContextOS: Shared Business Limits for AI Agents

The first public ContextOS runtime deep dive: a deterministic Rust kernel, atomic business exposure across agent runs, governed tool dispatch, conservative recovery, signed evidence and Tower.

3
October 29, 2026·8 min read

Why Not Just Use a Database Transaction for Agent Refunds?

A row lock wins the race between two agents. It cannot see a refund that applied at the provider after a timeout, or a limit that spans two systems.

4
September 17, 2026·19 min read

Agentic Inference: A Practical Guide to KV Cache, Scheduling, and Throughput

Why tool-using agents turn inference into a stateful memory-scheduling problem, and how to measure, design, benchmark, and roll out a better serving path.

5
Build the Context Pack Compiler: Eight Stages, One Typed Reference illustration
April 21, 2026·6 min read

Build the Context Pack Compiler: Eight Stages, One Typed Reference

A source-backed walkthrough of the eight deterministic Context Pack compiler stages, visible failures, evidence gates and execution boundaries.

6
AI Gateway and LLM Router: Model Choice Is a Runtime Decision illustration
May 14, 2026·8 min read

AI Gateway and LLM Router: Model Choice Is a Runtime Decision

How an AI Gateway and LLM Router make model choice policy-bound, budgeted, observable, and replayable across production agent workflows.

7
MCP Adapters in Production: Enforce the Manifest at Every Boundary illustration
May 14, 2026·7 min read

MCP Adapters in Production: Enforce the Manifest at Every Boundary

How MCP 2026-07-28 fits behind a production adapter manifest with native action risk, auth, idempotency, evidence, and replay.

8
The Critic: Verify, Score, Consolidate with Explicit Evidence illustration
May 2, 2026·5 min read

The Critic: Verify, Score, Consolidate with Explicit Evidence

How to separate Critic judgment from deterministic admission, evidence-scoped scoring and honest final records, using the tested reference.

9
Wiring the Five Evaluators: Policy, Utility, Latency, Safety, Cost illustration
April 5, 2026·7 min read

Wiring the Five Evaluators: Policy, Utility, Latency, Safety, Cost

A design guide to trustworthy policy, utility, latency, safety and cost evidence, independent release assessment and current deployment controls.

10
Failure Playbooks: The Typed Verdict Map illustration
May 7, 2026·5 min read

Failure Playbooks: The Typed Verdict Map

Map provider errors to honest effect states, owned reconciliation, bounded eligible retry and separately governed compensation.