Module 03
Choosing Models
The model landscape, capability assessment, pricing, and how to pick the right model for the job.
- lessons
- 4
- steps
- 35
- time
- 49 min
01beginner·12 min·8 steps
The Model Landscape
Sort a fast-moving market into tiers, reasoning modes, open-weight options and licenses — using the guide’s November 2026 snapshot.
- Place current models into frontier, workhorse, fast and edge tiers
- Read reasoning effort as the new control dial
- Judge the open-vs-closed gap without mixing index versions
- Check the license before the benchmark
Start →
02intermediate·12 min·9 steps
Capability Assessment
Read benchmark claims like an engineer — version, harness, effort, runner, fallback, metric — then build the eval that actually predicts your system.
- Explain why the same model gets very different scores
- Attach the six labels that make a score comparable
- Compare models at the effort and cost per task you will ship
- Build a custom eval with pairwise Elo
Start →
03intermediate·13 min·9 steps
Pricing and Costs
What an LLM request really costs: per-token rates, long-context cliffs, tier multipliers, caching break-even, routing — and when self-hosting actually pays.
- Compute a request’s cost from input and output tokens
- Spot long-context cliffs that reprice the whole request
- Decide when prompt caching pays for its write premium
- Cut spend with routing, batch tiers and output limits
Start →
04intermediate·12 min·9 steps
Choosing a Model
A practical decision path from constraints to a model — then cascades, cross-vendor fallbacks and an upgrade pipeline so the choice survives monthly releases.
- Name the factors that decide a production model choice
- Walk the November 2026 decision tree
- Compare models by cost per task, not per token
- Design cascades and cross-vendor fallbacks
Start →
Read deeper
Guide chapters · Model Landscape
Next module · 04
Training & Adaptation