
If you've experienced AI budget and procurement talks in your organization, read about ballooning AI costs online, or simply can't figure out how you hit your Claude or ChatGPT limits every day, this one's for you.
The AI industry spends a lot of time talking about what models can do. We spend less time talking about how efficiently they do it.
That distinction matters.
Token consumption is not a measure of value creation.
Watching an agent burn through hundreds of thousands of tokens, launch a swarm of subagents, inspect 50 files, and generate thousands of lines of intermediate work can look productive. But if the same outcome could have been achieved with one context window, a retrieval call, and a reusable script, you didn't get more intelligence.
You got a bigger inference bill.
Most of the techniques below fall into three categories:
Context management. Deterministic code. Standard workflows.
They aren't silos. They're building blocks for making AI systems reliable and affordable enough to move organizations from token maxxing to value realizing.
Probably not in the way they're being marketed to you.
Agents, and increasingly subagents and multi-agent systems, are some of the most talked-about concepts in AI.
In practical terms, an AI agent is an AI client powered by an underlying model that can reason toward a goal and take actions through tools: search, connectors, MCP servers, code execution, browsers, databases, and so on.
A subagent is another agent instance delegated a portion of that work, often with its own context.
Giving models the ability to actually do things instead of simply generating text is a massive unlock.
But there's an important distinction between agentic tool use and agent proliferation.
Spawning five agents creates a very impressive visualization of five things working simultaneously. It doesn't automatically create five times the value.
Imagine your primary coding agent already understands your repository, requirements, architecture, conversation history, and current task.
It delegates something to a new subagent.
That agent doesn't magically inherit understanding for free. It needs enough context to perform its job.
Repeat that across several agents working on a large repository or document collection and you can end up paying repeatedly to establish variations of context your primary agent already possessed.
There are absolutely cases where parallel agents make sense: independent research paths, isolated workstreams, parallel validation, or situations where wall-clock time matters enough to justify the additional inference.
But "use subagents" shouldn't be the default architecture simply because your harness supports them.
This tradeoff has also changed as context windows have expanded and prompt caching has made repeated context substantially cheaper. The assumption that every complicated job needs to be fragmented across independent contexts deserves another look.
Build Lean takeaway: Before spawning another agent, ask whether the work actually needs independent context and reasoning. If not, keep it in the existing context.
For non-engineers, this one can initially feel less intuitive.
It's also one of the biggest opportunities.
Most modern AI agent environments provide some form of code execution or sandbox. If you've asked an AI tool to manipulate an Excel workbook, process a dataset, generate a PDF, or perform a complex calculation, there's a good chance code was involved somewhere in the workflow.
Here's the problem:
Your AI shouldn't reinvent solved code every time you ask it to perform a repeatable task.
Suppose your organization produces the same monthly Excel report.
It needs your branding, specific formatting, formulas, conditional formatting, charts, a summary tab, and consistent file naming.
One approach is to describe those requirements to an agent every month and have it reason through and regenerate the implementation.
Another is to solve the problem once.
Create a tested script that accepts the changing data as input and deterministically produces the workbook.
Now the AI's job changes from:
Figure out how to build our monthly workbook.
to:
Validate this month's inputs and run our monthly workbook generator.
That's a fundamentally cheaper and more reliable problem.
LLMs are extraordinarily useful because they can deal with ambiguity.
So let them deal with ambiguity.
Once part of a workflow becomes predictable, move it into code.
Calculations, formatting rules, validation, file transformations, schema checks, and repetitive API operations frequently don't require a frontier model to reason through their implementation every time.
This is also where skills and standardized workflows become powerful.
A good skill doesn't need to be a massive markdown file explaining everything your company knows. It can give an agent concise instructions and point it toward tested tools and scripts that already encode the deterministic parts of the workflow.
The model orchestrates.
The code executes.
Build Lean takeaway: If your AI writes substantially the same code twice, ask whether that code should become reusable infrastructure before asking it to write it a third time.
This is often framed as RAG vs. MCP, but that's not quite the right comparison.
MCP and connectors answer an important question:
How can my agent access this system or data?
Retrieval-Augmented Generation answers another:
Which pieces of that information actually need to enter the model's context?
That difference matters enormously at scale.
Imagine your organization has hundreds of policies, contracts, product documents, operating procedures, and historical reports.
An employee asks:
What's our cancellation policy for enterprise customers?
The model probably doesn't need your entire document library to answer that question.
With a typical RAG architecture, documents are processed into chunks and embeddings and stored in a searchable index. At query time, retrieval finds relevant passages and sends those passages, not the entire corpus, to the language model.
That means the expensive reasoning layer gets the information it actually needs.
Now multiply this across an organization.
Without retrieval, 100 employees might repeatedly ask agents to inspect the same large handbook, contract repository, or documentation set.
You're repeatedly turning stored information into model context.
With retrieval, the knowledge is indexed once, searched cheaply, and only the relevant information enters the model's working context.
If your task is:
Compare every clause of these two 200-page agreements and identify semantic differences.
Then retrieval alone may be the wrong optimization.
You genuinely need broad coverage of both documents.
RAG is strongest when the question is "find the information I need." It's less appropriate when the task requires holistic reasoning across substantially all of a document.
The principle isn't "RAG good, context bad."
It's don't pay to load information the model doesn't need.
Build Lean takeaway: Connect broadly. Retrieve narrowly. Load everything only when the task actually requires everything.
Here's another easy way to burn money:
Route every task to the most capable model you have.
It feels logical. If Model A is smarter than Model B, shouldn't Model A produce better results?
Sometimes.
But that's the wrong optimization target.
The goal isn't maximum intelligence per request.
It's enough intelligence to reliably complete the task at the lowest practical cost.
Consider a workflow that classifies a request, extracts some fields, retrieves account information, performs a calculation, checks for an exception, and writes a response.
Which of those steps actually requires your frontier reasoning model?
Probably not all of them.
Classification and extraction might use a smaller model. The calculation belongs in code. Database retrieval belongs in a tool. A complicated exception might justify deeper reasoning.
This is model routing: matching the amount of intelligence to the difficulty of the task.
This is where Tip #2 and Tip #4 reinforce each other.
Remember our document-generation example?
Creating your organization's standardized PDF workflow for the first time might genuinely be a hard problem.
You need a capable model to understand your requirements, translate brand guidelines into code, handle edge cases, build the script, test the output, and iterate until it's reliable.
Great. Use the expensive model.
But once that model solves the problem, you've created something valuable: a repeatable process.
The next time you need the PDF, you shouldn't need to pay your smartest model to rediscover how to make it.
A cheaper model can collect the new data, validate the inputs, and call the script the expensive model already helped build.
The pattern becomes:
Expensive intelligence to solve the problem. Deterministic code to preserve the solution. Cheaper intelligence to reuse it.
That's how AI investment compounds.
Instead of repeatedly renting intelligence you've already paid for, capture the result of that reasoning in code, skills, templates, and workflows that cheaper models can reuse.
A useful escalation ladder becomes:
Code, then a small model, then a frontier model, then a human.
Start with the cheapest mechanism capable of reliably solving the problem. Escalate when complexity, ambiguity, confidence, or risk demands it.
Build Lean takeaway: Use expensive models to solve expensive problems once. Then turn what they learned into infrastructure that cheaper models can execute repeatedly.
Let's finish with the controversial one.
More documentation is not always more context, and more context is not always better context.
Documentation was historically written for humans.
README files explain architecture. Code comments explain intent. Wiki pages document decisions. Markdown files tell developers how systems work.
All of that can be useful.
But the economics change when AI is writing and maintaining an increasing percentage of the code.
Imagine an agent working on a function.
It reads the code.
Then a comment describing what the code is supposed to do.
Then an architecture document describing how that subsystem worked six months ago.
Then an implementation plan written before the latest refactor.
Then an AI-generated summary of all three.
Which one is the source of truth?
You haven't necessarily given the model more knowledge.
You may have given it four competing representations of reality.
And you paid tokens for all four.
Every giant README, agent instruction file, architecture explainer, auto-generated document, and verbose comment that enters the context window consumes space.
But the bigger issue isn't simply cost.
It's context quality.
As AI takes on more implementation work, teams should reconsider documentation strategy.
That does not mean "stop documenting your software."
Keep human-facing documentation where humans can find it. Keep durable architectural decisions. Document why when the reason can't be inferred from the implementation.
But don't automatically inject every historical decision, generated README, verbose comment, and planning document into every coding agent's context.
For an agent actively modifying software, executable code, tests, types, schemas, and current configuration should carry as much of the truth as possible.
Documentation should clarify that truth, not compete with it.
Build Lean takeaway: Optimize agent context for signal, not volume. Documentation is valuable; automatically loading all documentation is not.
The common thread across these five tips isn't really token optimization.
It's systems design.
The expensive version of enterprise AI looks something like this:
Give a massive model massive context, unlimited tools, a swarm of agents, and instructions to figure everything out.
The efficient version looks different.
Retrieve only the context that's needed. Keep work in one context when splitting it provides no advantage. Turn solved problems into deterministic code. Standardize repeatable workflows. Route simple tasks to simple mechanisms. Keep agent context clean.
None of this means using fewer tokens at all costs.
A workflow consuming 50,000 tokens to reliably complete a $500 task can be an incredible investment. A workflow consuming 5,000 tokens but requiring three retries and an hour of human intervention might not be.
Tokens are an input. Value is the output.
The goal isn't minimum token usage.
It's maximum value realized per dollar of AI spend.
Organizations that learn to separate reasoning from retrieval, orchestration from execution, and necessary context from context bloat have a much better chance of turning AI budgets into measurable outcomes.
That's the shift:
Stop token maxxing. Start value realizing.
The biggest opportunities usually come from reducing unnecessary context, replacing repeatable model reasoning with deterministic code, retrieving only the information needed for a task, routing simpler work to cheaper models, and avoiding unnecessary agent calls.
The goal shouldn't simply be fewer tokens. It should be fewer tokens per successful business outcome.
It can, particularly when an AI application works with a large knowledge base but only needs a small amount of that information for each request.
Rather than loading entire documents into context, RAG retrieves relevant passages and provides those to the model. If the task genuinely requires reasoning across the entire document, however, broader context may still be necessary.
They can. Each subagent needs enough context to understand and complete its assigned task. If multiple agents repeatedly receive information already available to the primary agent, total token consumption can increase substantially.
Subagents make the most sense when independent work, parallelism, or separate context creates enough value to justify that additional cost.
No. Use the least expensive model that can reliably complete the task.
Complex reasoning and ambiguous problems may justify a frontier model. Straightforward classification, extraction, transformation, or execution can often use cheaper models, or deterministic code.
Yes. When a task follows predictable rules, traditional code can often execute it more cheaply and consistently than asking a language model to reason through the same process repeatedly.
AI is great at ambiguity. Code is great at repeatability. Use each accordingly.
Not necessarily. A larger context window gives a model the ability to process more information. It doesn't mean every available piece of information should be included.
Irrelevant, redundant, outdated, or contradictory context can increase cost while making it harder for the model to identify what matters. Think of context as a budget, not a storage locker.
Don't optimize solely for tokens per request. A better metric is cost per successful outcome, and, ultimately, the business value generated relative to that cost.
Token optimization matters because inference costs money. But the goal isn't minimizing tokens. It's maximizing value realized per dollar of AI spend.
Share this article
Get a free project scope in minutes with our AI-powered estimator.
Scope Your Project