REPORT · BENCHMARK v0.4 · 2026-06-28
The state of enterprise model performance.
Twelve frontier models scored against 1,400 real enterprise tasks. What holds up in production, what collapses under load, and where the frontier actually is: measured, not claimed.
KEY FINDINGS
41%
of tasks show a different leader in production than on public leaderboards.
3.2×
cost spread between models within two points of each other on quality.
94.2
top composite score on Benchmark v0.4, set by a model half the price of the runner-up.
WHAT'S INSIDE
Six chapters. Start anywhere.
- 01BENCHMARK
How we measure
How business workflows become a fixed, blind-scored test packet, with hard gates on top.
- 02NOTE
The dumb zone
Recency and primacy bias: why the middle of a long context goes dark, and what it costs.
- 03NOTE
How agents remember
Context, a compacted working summary, and the long-term store, and how agents forget.
- 04NOTE
Three kinds of RAG
RAG, Graph RAG, and Agentic RAG: how each retrieves, where each fails, when each wins.
- 05MODELS
The frontier, priced
Every model worth deploying, plotted by measured intelligence against tokens per dollar.
- 06NOTE
Big model, small model
When the cheaper or open model wins your workflow, and how to route between them.