Tag

Production

3 essays tagged with Production.

August 14, 2026·17 min read·Expert

LLM Latency Engineering: TTFT, Caching, Routing, and the Road to Real-Time Agents

A production guide to LLM latency optimization across queueing, prefill, decode, output budgets, prompt caching, request topology, model and service-tier routing, speculative decoding, disaggregated serving, observability, and rollout.

Read essay

May 12, 2026·18 min read·Intermediate

How to Develop an Agent with an Agent Harness, End to End

An end-to-end field guide for building agents as measurable harnesses: context, planning, tools, records, evals, rollout, and learning.

Read essay

February 4, 2026·9 min read·Intermediate

Context Engineering in Production

How owned sources, freshness, evidence admission, context budgets and replay make context failures diagnosable within a governed execution contract.

Read essay