Case Studiesadvanced14 min · 8 steps
Customer-Specific Distillation Pipeline
Cut a $50K/month frontier bill to about $9.3K by distilling an 8B student on six months of production traces — with a payback under three months.
run-rate50K$/mo
teacher traffic100%
requestresponsedataerror
metrics are illustrativeProblemStep 1 of 8
A frontier model serving mostly routine work
About 8M requests a month run on a frontier model. The bill crossed $50K/month in early 2026, traffic grows 18% quarter over quarter, and finance wants a plan.
The key observation: roughly 90% of traffic is a handful of recurring patterns — intent classification, structured extraction, summarization and three kinds of triage. A frontier model is overkill for those.
TipQuick screen: distill only if ≥60% of traffic falls into ≤5 task patterns and those tasks cost more than $20K/month.
Lesson 19 of 20 in Case Studies