Skip to content
anythingai.space
Choosing Modelsintermediate13 min · 9 steps

Pricing and Costs

What an LLM request really costs: per-token rates, long-context cliffs, tier multipliers, caching break-even, routing — and when self-hosting actually pays.

ONE RAG REQUEST (TOKENS)system 500retrieved 2,000question 100→answer 300GPT-6 SOL · $2 IN / $10 OUT PER 1M · TOTAL $0.0082input 2,600 tok → $0.0052output 300 tok → $0.0030Price output-heavy workloads on the output column first
request
1 / 9
Key ideaStep 1 of 9

Cost = input tokens × rate + output tokens × rate

LLM APIs bill per million tokens, and output costs more — 5× input on Claude Opus/Sonnet/Haiku 5.5, GPT-6 Sol, GPT-6.1 Terra and Gemini 3.8 Flash. Reasoning tokens bill as output even when you never see them.

A typical RAG request — 500-token system prompt, 2,000 tokens of retrieved context, a 100-token question and a 300-token answer — costs $0.0082 on GPT-6 Sol or Claude Sonnet 5.5 ($2 / $10). The 300 output tokens cost more than half as much as the 2,600 input tokens.

TipAt 10,000 requests a day that’s $82/day, ~$2,460/month on GPT-6 Sol — or $123/month on GPT-6 Luna ($0.10 / $0.50) if quality holds on your evals.

Lesson 3 of 4 in Choosing Models