Prerequisites & Notation
Before You Begin
This chapter examines coding constructions that approach AWGN capacity. We assume familiarity with the AWGN capacity formula (Chapter 10), the channel coding theorem for DMCs (Chapter 9), and basic concepts of linear algebra over and .
- AWGN channel capacity (Chapter 10)(Review ch10)
Self-check: Can you state the AWGN capacity and explain why Gaussian input is optimal?
- Channel coding theorem: achievability via random coding, converse via Fano's inequality (Chapter 9)(Review ch09)
Self-check: Can you outline the random coding argument for the DMC?
- Binary symmetric channel (BSC) and binary erasure channel (BEC) capacities (Chapter 9)(Review ch09)
Self-check: What is the capacity of a BSC with crossover probability ?
- Linear algebra: lattice, basis, Voronoi region, volume of fundamental region
Self-check: Can you define a lattice in and sketch its Voronoi region in 2D?
- Basic coding theory: linear codes, generator and parity-check matrices
Self-check: Can you define a linear code via its parity-check matrix over ?
Notation for This Chapter
Key symbols for coding constructions over the Gaussian channel.
| Symbol | Meaning | Introduced |
|---|---|---|
| Lattice in | s01 | |
| Voronoi region of lattice | s01 | |
| Volume of the fundamental region of | s01 | |
| Normalized second moment of (measures quantization efficiency) | s01 | |
| Binary-input DMC (for polarization) | s03 | |
| -th bit-channel after polar transform of size | s03 | |
| Symmetric capacity of channel | s03 | |
| Shaping gain (dB) | s04 | |
| Coding gain (dB) | s04 |