Retrieval & RAGintermediate12 min · 10 steps
Chunking Mechanics
The details that decide where a chunk starts and stops: sliding windows and overlap, token-accurate sizing, similarity merging, and keeping pages, lists and figures intact.
boundary recall62%
duplicated text0%
data
metrics are illustrativeProblemStep 1 of 10
The answer straddles a chunk boundary
A compliance rule reads: “Refunds are allowed within 14 days — except for annual plans, which require written approval.” A fixed-size splitter cuts right after “14 days”.
Chunk 1 now states a rule without its exception; chunk 2 holds an exception without its rule. Neither retrieves well, and the one that does misleads the model.
Watch outBoundary losses are invisible in aggregate metrics — they show up as confidently incomplete answers.
Lesson 19 of 37 in Retrieval & RAG