The single highest-leverage thing most teams can do this quarter is cut their LLM bill in half without users noticing. The gap between the most expensive and cheapest "good enough" model for a given task is now 20-100x. If you are still routing everything to a flagship model, you are quietly subsidising the wrong vendor.
Here is the exact playbook we use, and the one TokenInsider is built to support.
1. Stop paying flagship prices for non-flagship work
Audit your traffic. In most production systems, 70-90% of calls are short classifications, extractions, rewrites or tool-call routing — tasks where a "nano" or "haiku" tier model lands within a few accuracy points of the flagship. Examples at today's prices:
gpt-5-nanoat $0.05 / Mtok input vsgpt-5at $1.25 — 25x cheaper.claude-haiku-4.5at $1.00 vsclaude-sonnet-4.5at $3.00 — 3x.gemini-2.5-flash-liteat $0.10 vsgemini-2.5-proat $1.25 — 12x.
The cheapest "frontier-class" general model right now is DeepSeek V3.2 at $0.28 / Mtok input ($0.42 output). For internal tooling and async workloads it is hard to beat.
2. Use batch + prompt caching aggressively
Two discounts every major provider offers, that almost no team turns on:
- Batch API: 50% off on OpenAI and Anthropic for anything that can tolerate <24h latency — embeddings, evals, backfills, periodic summarisation. If your job runs nightly, it should be on the batch endpoint.
- Prompt caching: 75-90% off on the cached portion. For agent loops, RAG with stable system prompts, or long-context chat, caching the static prefix cuts cost dramatically. Move the variable part of the prompt to the bottom and let it cache.
3. Route by task, not by vibe
A two-tier router beats every "always use the best model" architecture:
- Cheap tier (nano / flash / haiku) handles the call. Self-grades confidence.
- If confidence < threshold or the schema validation fails, escalate to a mid-tier model.
- Reserve flagship for the <5% of calls that genuinely need it (long-form reasoning, code generation across many files, complex tool use).
In production we typically see this collapse spend by 60-80% with no measurable quality drop on standard evals.
4. Watch the market — prices move every week
The cheapest "good enough" model six months ago is rarely the cheapest today. A few real reference points (see the live demo for the current snapshot across 19 models):
- DeepSeek V3.2 sits at $0.28 / $0.42 per million tokens — meaningfully under every flagship.
- GPT-5 nano at $0.05 / $0.40 is currently OpenAI's cheapest tier, ~25x below GPT-5.
- Gemini 2.5 Flash-Lite at $0.10 / $0.40 with a 1M context window is hard to beat for long-context summarisation.
- Grok 4 Fast exposes 2M context for $0.20 / $0.50 — the cheapest very-long-context option right now.
If your provisioning, budget alerts or model selection logic is not aware of these moves within a day, you are either overpaying or about to get a surprise invoice. This is the gap TokenInsider closes.
5. The 30-minute checklist
- Pull last month's bill. Group by model.
- For the top 3 models by spend, look up the cheapest equivalent tier on the comparison page.
- Pick one workload (the highest-volume, lowest-stakes one) and route it to the cheaper model behind a feature flag.
- Turn on batch for anything async, and prompt caching for anything with a stable prefix.
- Set up monitoring so you know within 24h when prices move — or sign up for TokenInsider and we do it for you in your currency.
That is the entire playbook. Most teams who run through it land between 40% and 80% lower spend within two weeks.