VPSSpark Blog
← Back to Dev Diary

Why Is AI Coding Getting More Expensive? Context-Mode Claims to Reduce 98% of Tool Output, but Can Token Costs Really Drop That Much?

AI Workflow · 2026.10.17 · ~10 min read

Why Is AI Coding Getting More Expensive? Context-Mode Claims to Reduce 98% of Tool Output, but Can Token Costs Really Drop That Much?

This week, don’t budget for a 98% bill reduction from Context-Mode. Run the same coding task with and without it, then compare the billed input and output tokens, tool calls, and final task result. A reported reduction in tool output can cut costs only to the extent that this output would otherwise be counted in billable model usage.

This guide is for developers investigating rising AI Coding bills, technical leads evaluating Context-Mode, and teams separating model charges from the cost of running an AI Agent.

Decision: Treat “98% less tool output” as a claim about one measured quantity—not as a forecast for your invoice.

Start with the denominator behind Context-Mode’s 98% claim

A reduction percentage is useful only when you know what was measured and what it was compared against. The Context-Mode project repository shows a 98% example. That figure should be read as a claim about tool output in its stated example, not a general result for every task, model, agent, or billing system.

The distinction matters because a coding workflow can produce several different quantities:

  • Tool output: text or other content returned by a tool, such as search results, command output, or file contents.
  • Model input: the content actually sent to the model. This may include the prompt, previous conversation, tool results, and other context.
  • Model output: the tokens generated by the model in its response or tool-call instructions.
  • Billed usage: the usage fields that the selected provider records and charges for under its current rules.

These quantities overlap, but they are not interchangeable. A tool may return a large result, while a context-management layer may summarize or filter it before the next model request. That can reduce later input usage. But a reported reduction in the tool’s raw output does not, by itself, prove that the provider billed fewer tokens by the same percentage.

The project’s benchmark description is the place to inspect the example’s scenario and calculation method. Check what is counted as output, what the baseline does, and whether the comparison measures raw tool results, context sent to the model, or another quantity. If the sample, task conditions, tool versions, and comparison method do not match your workflow, the figure is not a reliable forecast for your account.

Evidence rating: limited for predicting your bill. The 98% figure is a project example; your own measured usage is the evidence that can support a cost estimate.

Read the usage fields before estimating savings

Start with the usage record from the provider you actually pay. The token-counting guide explains that input and output tokens are distinct usage categories. A provider’s record may also expose cached or other usage fields. Those fields matter because different categories can have different billing treatment.

The same caution applies when you use another model service. Its pricing documentation is the authoritative place to check how input, output, and any applicable cache usage are priced. A token is not a universal unit with one price across providers, models, or usage categories.

For each run, capture at least these cost inputs:

  • Input tokens recorded for the model requests.
  • Output tokens recorded for the model responses.
  • Cached input or other separately priced usage, where the provider reports it.
  • Tool-call count and whether the associated results are included in later model requests.
  • The model and rate applicable to each usage category.

For example, the token-counting documentation for another model API describes how to count input tokens. Use the counting method and usage fields for your own service rather than assuming that a local estimate of tool output will match the provider’s bill.

A useful model for the variable portion of the bill is:

Estimated model cost = input tokens × input rate + output tokens × output rate + separately billed usage categories

Use the actual rates and billable categories shown in the provider’s documentation for your model and billing arrangement. Do not insert a single blended rate unless you have calculated it from your own usage mix. If cached input is billed separately, keep it separate. If your platform exposes usage by request, preserve those records instead of replacing them with an aggregate estimate.

This model-cost calculation does not automatically include the cost of running the agent, a development machine, or a hosted environment. Keep those on separate lines.

Identify the task conditions that change the result

Context-Mode can have different effects on different coding tasks because the share of total usage coming from tool results varies.

A task that repeatedly reads long command output, search results, or large file excerpts may give output compression more room to affect later model input. A task dominated by model reasoning and generated code may have a smaller share of usage tied to tool results. In the second case, even a large reduction in tool output can produce a modest change in total billed usage.

Repeated context is another variable. If a tool result is included in several later requests, reducing or summarizing it may reduce repeated input. But the result depends on what the agent actually sends to the model and how the provider accounts for it. The prompt-caching documentation explains why cached prompt usage can be recorded differently from ordinary input. A lower raw context size and a lower bill are not necessarily the same outcome.

Then consider the workflow’s response to compression. If the agent lacks information after a result is shortened, it may ask for more data, make another tool call, or require an extra model turn. Those additional requests can offset some of the initial reduction. Record these effects rather than assuming the compressed result preserved the same task path.

The Agents SDK usage guide is one example of usage tracking for agent runs. Whatever framework you use, capture usage at the level that lets you distinguish model requests and tool activity. A total at the end of a session may hide whether savings came from smaller inputs, fewer turns, or a different task outcome.

Compare the cost drivers before choosing a workflow

Use the table to identify what to measure. It compares the decision conditions, not a promised result for any particular setup.

Option or condition What to compare Cost implication Decision signal
Context-Mode enabled Tool output, input and output usage, tool calls, task completion Compression may reduce later input; extra requests can offset it Keep it only if repeated tests show lower cost at comparable task quality
Context-Mode disabled The same task and usage fields under the baseline workflow Establishes the uncompressed reference Use as the control, not as a different or easier task
High tool-output share Tool results as a portion of total input usage More opportunity for compressed results to affect billed input Test representative repository or command-heavy tasks
Low tool-output share Model-generated output and other input dominate usage Tool-output reduction may have little effect on the total Do not infer meaningful savings from the output percentage alone
More interaction after compression Additional model turns and tool calls Added usage may cancel part of the reduction Compare the entire run through task completion
Separate runtime environment Hosting, compute, storage, or access costs These are not token savings Budget separately from model usage

A compact scorecard helps you decide what the test proves:

  • Tool-output reduction: Did the measured tool result become smaller?
  • Billed-token reduction: Did the provider record lower total usage after all requests?
  • Cost reduction: Did the amount charged fall under the rates that apply to your usage?
  • Task equivalence: Did both runs produce a result that meets the same acceptance criteria?

Mark each item as measured, not measured, or not comparable. If only tool-output reduction is measured, your evidence supports a statement about tool output—not a claim about savings.

Run a controlled comparison on your own coding task

Choose a task you already understand and can evaluate consistently. Keep the task narrow enough that both runs have the same acceptance criteria, but representative of the work that contributes to your bill. Avoid comparing an easy baseline task with a harder Context-Mode run, or the reverse.

Use this sequence:

  • Define the task. Record the prompt, repository state, files in scope, expected output, and a clear completion condition.
  • Fix the variables. Use the same model, agent settings, tool permissions, prompt, task scope, and billing account conditions. Change only whether Context-Mode is active.
  • Run both conditions. Keep the baseline and enabled run as close together as practical. If results vary, repeat both conditions rather than selecting the most favorable run.
  • Capture the full usage record. Save input tokens, output tokens, any separately reported cached usage, number of model requests, tool-call count, and provider-reported charge where available.
  • Check result quality. Apply the same acceptance criteria to both outputs. A cheaper run that misses required work is not an equivalent result.
  • Compare the complete run. Include follow-up requests and tool calls needed to finish the task. Do not stop the accounting when the first compressed response looks smaller.
  • Report variation and exceptions. Keep the range of observed results and note failed runs, retries, rate changes, or task differences. Do not present one unusually favorable run as the typical outcome.

The comparison should use the provider’s billable usage where possible. If you estimate from token counts, show the formula and the rates used, and cite the provider’s current pricing rules in your internal analysis. Avoid mixing different models or pricing periods in one result. When caching or other categories appear in the usage data, calculate them using their applicable rules instead of folding them into ordinary input tokens.

A useful report states the workflow, model, task, usage fields, observed costs, and completion outcome. It does not need to claim a universal saving. Its purpose is to answer a narrower and more actionable question: under your conditions, did Context-Mode reduce the cost of completing the same work?

Separate token savings from AI Agent runtime costs

A model invoice is only one part of an AI Agent budget. Development and runtime environments may add separate costs for compute, storage, networking, access controls, and maintenance. Those expenses can rise or fall for reasons unrelated to how many tokens a tool returns.

Keep the accounting in separate categories:

  • Model usage: provider-recorded input, output, and separately priced token categories.
  • Agent and tool operation: any service or infrastructure charges directly tied to running the workflow.
  • Development environment: the machine or hosted environment used to build, test, or operate the agent.

Do not attribute a change in environment spending to Context-Mode unless you have evidence that the tool caused that change. Likewise, a lower model bill does not prove the total cost of operating an agent fell if another cost category increased.

If you are assessing a temporary Mac environment as part of a deployment or development decision, evaluate it against your actual environment requirements, not as a token-saving measure. A local setup can mean hardware ownership and maintenance; a non-Mac hosted environment may not meet a Mac-specific build or test requirement. Renting a Mac through VPSSpark can be a better fit when you need a temporary Mac environment without treating that rental as evidence of reduced model usage. Review VPSSpark’s service information and contact VPSSpark to confirm environment details for your use case before budgeting. If you need a long-running, stable environment or specific physical interfaces, compare rental with ownership and other hosting options instead of assuming a temporary rental is the right choice.

For this week’s decision, select a representative AI Coding task and keep its task definition fixed. Record the tool output, billed input and output usage, tool calls, outcome, and model charge separately. Then list runtime and environment costs on their own lines. That gives you a defensible answer about Context-Mode in your workflow—and prevents a smaller tool result from being mistaken for a cheaper AI Agent overall.

Run Your Mac Workloads on VPSSpark

Deploy a dedicated Mac mini for your macOS builds, tests, and development workflows.

Choose a region across Singapore, Japan, South Korea, Hong Kong, or the US.

Back to home

Special Offer

More than a Mac — your cloud dev headquarters

Dedicated compute · Global nodes · Monthly sub · No hardware

Back to home
Special Deal View plans