Retrieval & RAGintermediate11 min · 8 steps
Tracing & Logging for RAG
See inside every RAG request: metrics, logs and traces; structured, PII-safe log records; and one distributed trace per query with a span for each pipeline stage.
requestsignaldataresponse
ProblemStep 1 of 8
A bad answer, and no way to know why
A user reports a wrong answer from yesterday. Which query did the rewriter produce? Which chunks were retrieved, how were they ranked, what exactly did the model see, which model version answered — and why did it take 4 seconds?
Without observability a RAG system is a black box: you can see inputs and outputs, but not the five stages in between where things actually go wrong.
Lesson 36 of 37 in Retrieval & RAG