Tag

Production

3 essays tagged with Production.

August 14, 2026·16 min read·Expert

LLM Latency Engineering: TTFT, Caching, Routing, and the Road to Real-Time Agents

A production guide to LLM latency optimization across queueing, prefill, decode, output budgets, prompt caching, request topology, model and service-tier routing, speculative decoding, disaggregated serving, observability, and rollout.

Read essay

May 12, 2026·17 min read·Intermediate

How to Develop an Agent with an Agent Harness, End to End

An end-to-end field guide for building agents as measurable harnesses: context, planning, tools, records, evals, rollout, and learning.

Read essay

February 4, 2026·8 min read·Intermediate

Context Engineering in Production

Why most agent failures are not model failures — they are context failures — and what changes when context becomes a versioned, testable, replayable contract.

Read essay