Chapter 11: Information Theory for Wireless Channels

Learning Objectives

• Define entropy, conditional entropy, and mutual information and compute them for discrete memoryless channels
• State Shannon's channel coding theorem and explain the operational meaning of channel capacity
• Derive the AWGN channel capacity C = B log2(1 + SNR) and identify the Shannon limit Eb/N0 = -1.59 dB
• Distinguish ergodic capacity from outage capacity and explain when each applies to fading channels
• Apply water-filling power allocation across time (fading) and frequency (frequency-selective channels)
• Compute SIMO and MISO capacities with and without transmitter CSI and relate them to array and beamforming gains
• Explain how practical coding families (turbo, LDPC, polar) and adaptive modulation approach the capacity limit