Prerequisites & Notation

Prerequisites

This chapter assumes familiarity with:

  • How LLMs work (Chapter 35): transformer architecture, pre-training, RLHF
  • Python fundamentals (Chapter 1): async, HTTP requests, JSON We cover the practical side: calling LLM APIs, designing effective prompts, implementing tool use, and building RAG systems.

Definition:

Notation for This Chapter

Symbol Meaning
TinT_\text{in} Input token count
ToutT_\text{out} Output token count
kk Number of retrieved documents in RAG
q\mathbf{q} Query embedding vector
D\mathcal{D} Document corpus for retrieval