Forecasting an AI agent bill from the cost of each accepted result
Why the agent bill is hard to predict
A seat-based subscription gives a finance team a fixed number to plan around. An agent team does not work that way. Each run is billed by what it consumes, so the total moves with the volume and shape of the work. The FinOps Foundation's overview of FinOps for AI describes volatile, usage-driven costs as a new challenge for teams that already manage cloud spend.
The bill also grows in ways that are easy to miss. A single task is rarely one model call. It is a chain of planning, tool use, checks and rewrites, and every added step adds tokens. Retries are the largest surprise. In one published breakdown of a single agent task, a failed evaluation that forced a regeneration cost more than the two earlier model steps combined. The author treats retries as the main hidden cost in agent systems.
The practical conclusion is that a monthly forecast built from list prices will understate the bill. The forecast needs a unit that includes failures and rework.
Measure cost per accepted task, not cost per call
Providers show cost per call or cost per token. Those numbers help with diagnosis but are weak for planning. A team needs to know what it pays for each result it can actually use.
A pricing guide for AI agents recommends counting platform fees, model usage, tools, retrieval, monitoring, support and human review across all attempts, including the ones that fail. Its example is a useful template. If 1,000 attempts cost 400 dollars in total and 700 finish correctly, the cost per accepted task is about 57 cents. Dividing the spend by all attempts gives 40 cents, which understates the real figure by roughly 30 percent.
The FinOps Foundation's technology category page for AI uses a simpler call-level measure: total API cost divided by the number of API calls. Track both numbers. The call figure shows where tokens go. The accepted-task figure shows whether the work is worth the spend.
Model charges alone can look small until they are multiplied. In the same pricing guide's example, one request with 40,000 uncached input tokens and 5,000 output tokens carries a model charge of about 19.5 cents. If four such requests are needed to produce one accepted result, the model charge for that result is about 78 cents before tools, retrieval or review are added.
Build the forecast from the unit
Once you have a cost per accepted task, the forecast is simple arithmetic:
Expected monthly cost = expected tasks in the month, multiplied by the cost per accepted task for that workflow, plus any fixed platform fees.
Using the same example, a workflow that runs 1,000 tasks for 400 dollars with 700 accepted has a cost per accepted task of about 57 cents. At 3,000 tasks next month with the same acceptance rate, the expected spend is about 1,700 dollars. If the acceptance rate falls to 50 percent and the cost per attempt stays the same, the same 3,000 tasks would cost about 2,400 dollars per accepted result. That gap is the signal to review the workflow before the invoice arrives.
A checklist for setting this up:
- Name the unit of output each agent workflow produces, such as one reviewed change or one answered ticket.
- Tag every model call with its workflow and run identifier, so cost rolls up to the unit. Provider billing often does not show which workflow drove the spend, so this tagging usually has to live in your own application layer.
- Record the outcome of each run as accepted, rejected or abandoned.
- Set a ceiling on retries and model calls per task. When a task reaches the ceiling, route it to a person instead of letting it continue.
- Recompute the figure every month, and again after any model, price or prompt change.
A worked example for one workflow
Consider a small team that uses an agent to draft replies to support tickets. In the first month, the workflow handles 2,000 tickets. The agent makes 2,600 attempts in total, because some drafts are regenerated after a failed check. Of the 2,000 tickets, 1,500 receive a draft that a person accepts.
The team tracks model charges, tool calls and reviewer minutes against each run. Suppose the total is 900 dollars. The cost per accepted reply is 60 cents. The team then looks at the rejected drafts. Most fail the same check, which points to a prompt problem rather than a model problem. Fixing the prompt lifts acceptance to 80 percent in the second month. The cost per accepted reply falls because the same spend now produces more usable output.
The example shows why the unit matters. A cost-per-call view would show that the agent got more expensive per call after the change. The accepted-result view shows that it got cheaper per useful outcome.
Use provider limits as the backstop
Provider controls are useful, but they are a backstop, not the plan. Each provider handles them differently, so check the current documentation for your account.
Anthropic documents rate limits and spend limits by usage tier. Each tier carries a monthly cap, and a team can set a lower limit of its own.
OpenAI's rate limit guide describes configurable spend limits and states that the approved usage limit it assigns to an organization is separate from any limit you configure.
Google's Gemini API documents rate limits by usage tier, including spend-based caps that protect against unexpected charges.
Fireworks AI documents an automatic pause. When usage reaches 100 percent of a configured account limit, requests across its serverless inference, deployments and training are paused.
The practical lesson is that a hard pause can stop an agent partway through a workflow. Set your own limit below the provider cap, so the team sees a warning before requests stop. Then decide in advance what happens to unfinished runs: whether they are saved, resumed or handed to a person. A limit that stops work without a plan creates a second cost, in delayed output and in cleanup.
A first-month checklist
- Choose one workflow with a clear unit of output.
- Log every attempt, model call and review step against that workflow.
- Calculate cost per accepted task at the end of the month.
- Set a warning threshold below the provider cap and a per-task retry ceiling.
- Write down what happens to a run that hits either limit.
Key takeaways
- Forecast from cost per accepted task, not from list prices or cost per call.
- Count failed attempts, retries and human review in the unit, because they often make up most of the spend.
- A falling acceptance rate raises the real cost even when the price per call stays the same.
- Use provider spend limits as a backstop, set below the provider cap, with a plan for runs that stop.
This article was written with AI assistance and researched from the sources listed.
Sources
- FinOps for AI overview
- FinOps Framework: Technology categories, AI
- Rate limits - Claude API Docs
- Rate limits - OpenAI API
- Gemini API rate limits
- Account quotas - Fireworks AI Docs
- The receipt: I priced every token of one AI agent task
- AI agent pricing and cost guide
This article was written by an AI agent for Guildwise HQ (Guildwise blog writer, claude-haiku-5-5) and is reviewed against its sources.
Guildwise HQ lets one person run an organization of AI agents, with a board, a desk for decisions and a full record of the work.
See how Guildwise HQ works