Last month, my AI systems generated 14 million output tokens. At list price, that's roughly $6,000. I paid $200. But the real story isn't the discount. It's what those tokens actually produced, and what they cost beyond the API bill.
The Raw Numbers
Let's start with what 14 million tokens actually means in human terms.
10.5M
~130 books worth of text
40%
The rest is overhead & context
5.5M
~14 working months of human output
$200
vs. $6K at list price
Before You Build the Business Case
A reality check before you run to the CFO with these numbers:
It's first-draft quality. Every output still needs human review, editing, and refinement.
It still requires revision cycles. AI doesn't produce final deliverables. It produces starting points.
The real value is eliminating the blank page problem. Starting from something coherent instead of nothing.
Speed gains are real but uneven. Some tasks see 10x improvement, others barely 2x.
The 94% Problem: Why Context Is Your Biggest Cost
Here's the number that surprised me most: 94% of my token costs go to context management: loading who I am, what I'm working on, project history, coding standards, and preferences. The actual productive generation is a fraction of the total.
Memory is the most expensive part of AI labor. Every time a model starts fresh, you're paying to rebuild context from scratch.
Session Persistence
Maintain conversation threads instead of starting fresh. Each new session wastes tokens rebuilding what the model already knew.
Structured Context
Create reusable context documents (project briefs, style guides, codebase summaries) that load efficiently.
Right-Size Context Windows
Don't dump everything into every prompt. Match context to the task. A code review doesn't need your marketing strategy.
Model Routing: The 60% Cost Reduction
Not every task needs the most powerful model. A three-layer routing strategy (triage, execution, review) cut our costs by 60% without quality loss.
Claude Haiku
Triage & Classification
~$0.25/M tokens
Routing decisions, simple formatting, data extraction
Claude Sonnet
Primary Execution
~$3/M tokens
Writing, coding, analysis, most day-to-day work
Claude Opus
Complex Reasoning & Strategy
~$15/M tokens
Architecture decisions, multi-step strategy, nuanced judgment
The key insight: 70% of tasks can run on Haiku. Only 5% actually need Opus. Route accordingly.
The Real ROI Calculation
Here's how the monthly numbers break down when you include everything:
Monthly Cost
API costs: ~$200
Tool subscriptions: ~$50
Total: ~$250/month
Monthly Value
Hours saved: ~80
At consulting rates: ~CHF 16,000
Effective multiplier: 64x
The Hidden Costs Nobody Talks About
The API bill is the easy part. Here's what the real investment looks like:
Setup Time
200+ hours over 4 months building workflows, prompt libraries, and context systems. This is a serious upfront investment.
Ongoing Maintenance
~5 hours per week updating prompts, fixing edge cases, adapting to model updates. AI systems need maintenance like any other.
Attention Cost
Reviewing AI output requires sustained focus. Context-switching between AI-generated and human work adds cognitive overhead.
Wrong-Task Cost
Not every task benefits from AI. Learning which tasks to automate and which to keep manual has its own learning curve.
What to Do With This Information
If you're evaluating AI labor costs for your organization:
Measure context costs first. Before optimizing generation, understand how much you spend just loading context.
Build a routing layer early. Even a simple rule-based router saves significant money from day one.
Track productive tokens separately. Total tokens generated is a vanity metric. Productive output is what matters.
Budget for the human layer. Review, editing, and refinement time doesn't disappear. It shifts.
Don't compare to hiring. AI labor is a different category. Compare it to productivity tools, not headcount.
How we work · Work · Insights