← All Books

Information Theory

From Shannon to Network Channels

From entropy and typicality through source and channel coding to multiuser information theory and modern frontiers. 500+ exercises, full proofs, and connections to wireless system design.

30 chapters251 sections102+ hours of content
Start from Chapter 1

Chapter Dependency Map

Click a chapter to see details, click again to open. Drag to rearrange.

Foundations: Entropy, Divergence, and TypicalitySource Coding: Lossless and Lossy CompressionChannel Coding: From DMCs to Gaussian ChannelsMultiuser Information Theory: Single-Hop NetworksMulti-Hop Networks and RelayingModern Extensions and Research FrontiersEmerging Paradigms in Information TheoryFuture topics

All Chapters

Part 1: Foundations: Entropy, Divergence, and Typicality

Chapter 1

Information Measures for Discrete Random Variables

~210 minFoundational
Chapter 2

Information Measures for Continuous Random Variables

~180 minFoundational
Chapter 3

Typicality

~240 minFoundational

Part 2: Source Coding and Combinatorial Methods

Chapter 4

The Method of Types and Error Exponents

~150 minAdvanced
Chapter 5

Lossless Source Coding

~180 minIntermediate
Chapter 6

Rate-Distortion Theory

~210 minAdvanced
Chapter 7

Distributed Source Coding

~180 minAdvanced
Chapter 8

Additional Topics in Source Coding

~150 minAdvanced

Part 3: Channel Coding: From DMCs to Gaussian Channels

Chapter 9

Channel Capacity for Discrete Memoryless Channels

~240 minIntermediate
Chapter 10

The Gaussian Channel

~240 minIntermediate
Chapter 11

Coding for the Gaussian Channel

~210 minIntermediate
Chapter 12

Channels with State

~240 minAdvanced
Chapter 13

Fading Channels

~240 minIntermediate

Part 4: Multiuser Information Theory: Single-Hop Networks

Chapter 14

The Multiple Access Channel

~250 minAdvanced
Chapter 15

The Degraded Broadcast Channel

~220 minAdvanced
Chapter 16

The General Broadcast Channel

~240 minAdvanced
Chapter 17

The Interference Channel

~250 minAdvanced
Chapter 18

The MIMO Broadcast and Interference Channels — Advanced Topics

~200 minResearch
Chapter 19

Distributed Source Coding and Joint Source–Channel Coding

~180 minAdvanced
Chapter 20

Information-Theoretic Secrecy

~200 minAdvanced

Part 5: Multi-Hop Networks and Relaying

Chapter 21

Network Coding over Noiseless Networks

~190 minAdvanced
Chapter 22

The Relay Channel

~240 minAdvanced
Chapter 23

Gaussian Relay Networks

~200 minAdvanced
Chapter 24

Interactive Communication and Feedback

~200 minAdvanced

Part 6: Modern Extensions and Research Frontiers

Chapter 28

Information-Theoretic Approaches to Machine Learning

~150 minResearch
Chapter 29

Semantic and Goal-Oriented Communication

~120 minResearch
Chapter 30

Open Problems and Future Directions

~140 minResearch

Part 7: Emerging Paradigms in Information Theory

Chapter 25

Cooperative Communication and CoMP

~210 minAdvanced
Chapter 26

Finite-Blocklength Information Theory

~240 minAdvanced
Chapter 27

Coded Caching

~240 minAdvanced