Cheaper tokens didn't shrink the bill — they grew it, because cheap makes you use far more (Jevons).
The fix isn't a better model; it's the one OS component everyone skipped: a scheduler that decides what a request costs before it runs. The essay.
Economists have a name for it: Jevons Paradox — make a resource cheaper and you use so much more that total spend rises.
Coal did it in the 1800s; tokens do it now.
Two things drive the inversion: an agent burns 5–25× the tokens of a chat turn, and the frontier models agents need still cost ~100× commodity ones.
"Falling prices are what's driving spend up, not down." Gartner already expects 40% of agentic projects to be cancelled by 2027 on cost overruns.
The popular picture maps the LLM to a computer. It's a good picture — and it's missing the scheduler, the part that decides who gets the machine when everything wants it at once.
An operating system is not just a pile of resources. It is the layer that decides what runs, where it runs, and when it must stop.
"An OS isn't defined by having a CPU and memory — a calculator has those. It's defined by what it does when many things want the machine at once."
The resource here has a name: the token.
Every token you emit is simultaneously three resources. That's why a monthly cost dashboard can't govern it — the decision has to happen at the instant of generation.
And unlike compute or storage, a token is non-storable — consumed the instant it's made, no reserve, no arbitrage. You can't buy tokens cheap and save them; you can only decide, in the moment, whether to spend one and on which model.
Chatbots were safe to ignore: one turn, one call, bounded cost.
Agents loop — reason, call a tool, read the result, reason again — and each turn re-sends the whole transcript.
Cost is 1 + 2 + 3 + … + N.
Double the steps, quadruple the bill, with no upper bound.
"An agent without a budget gate and a pre-run forecast is a runaway process with a corporate credit card. In classic OS terms, it's a fork bomb — and the thing that stops a fork bomb isn't a better invoice, it's the scheduler."
Dashboards and chargebacks tell you what you spent after you spent it — always too late to change it. Token architecture puts four controls on the hot path, before emission:
The payoff is concrete: published benchmarks show 80/20 routing (80% to a cheaper tier) cuts blended output cost from ~$25 to ~$9 per million tokens — a ~64% reduction — at near-parity quality, because the hard 20% still gets the frontier model.
A ladder for how far an org has moved from reading invoices to scheduling tokens. Almost everyone is on the bottom two rungs.
The gap between the best model and the next closes every quarter.
"Models are commodities. Systems are the moat."
The edge is no longer which model you call — it's how efficiently you schedule tokens across all of them.
Agents went mainstream in 2026, inference passed training as the cost center, and GPUs became the bottleneck — this very week two labs capped each other and ran out of capacity (see Kimi K3). When compute is the scarce resource, the org that schedules tokens well doesn't just save money; it's the only one that can afford to run agents at scale.