Skip to content
anythingai.space
Guide library

The long-form reference.

Every chapter of the open-source AI System Design Guide, from foundations to case studies and interview prep. Read the full text here, then jump to the animated lesson for any concept.

ombharatiya/ai-system-design-guide

Written by Om Bharatiya and contributors, MIT licensed. Included here with attribution; each chapter links back to its source.

141 chapters566k words
Star the repo
00

Interview Prep

Question bank, answer frameworks, whiteboard exercises and the 2026 job market.

01

Foundations

LLM internals, tokenization, attention, transformers, embeddings, inference.

02

Model Landscape

Model taxonomy, capability assessment, pricing and model selection.

03

Training & Adaptation

Pretraining, fine-tuning, PEFT, RLHF/DPO, distillation, quantization, RLVR.

04

Inference Optimization

KV cache, speculative decoding, batching, paged attention, serving, cost.

05

Prompting & Context

Prompt engineering, ICL, CoT/ToT, context engineering, structured output, DSPy, injection defense.

06

Retrieval Systems

RAG end to end: chunking, embeddings, vector DBs, hybrid search, reranking, GraphRAG and more.

07

Agentic Systems

Agent fundamentals, reasoning loops, MCP, multi-agent, planning, HITL, durable execution.

08

Memory & State

Memory architectures, short/long-term memory, semantic caching, state management.

09

Frameworks & Tools

LangChain, LangGraph, LlamaIndex, DSPy, Semantic Kernel, AutoGen/CrewAI, coding agents.

10

Document Processing

OCR and layout analysis.

11

Infrastructure & MLOps

LLM infrastructure, CI/CD, AI gateways, FinOps.

12

Security & Access

LLM security and access control.

13

Reliability & Safety

Guardrails, ensembles, reliability patterns, governance.

14

Evaluation & Observability

LLM evaluation, observability, benchmarks.

15

AI Design Patterns

Design patterns and anti-patterns.

16

Case Studies

Twenty production systems, designed end to end.

17

Tool Use & Computer Agents

Tool-use landscape, architectures, computer-use agents, safety.

18

Voice & Audio Agents

Real-time voice agents.

19

Multimodal Generation

Image, video and audio generation systems.

+

References & Evals

Glossary, patterns catalog, research radar, transition guide and two complete evals study guides.