References

References

1. C. E. Shannon, A Mathematical Theory of Communication, Bell System Technical Journal, vol. 27, pp. 379-423, 623-656, 1948

   The founding paper of information theory. Introduced entropy, mutual information, channel capacity, and the channel coding theorem. Essential reading for anyone studying communications.

2. T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley, 2nd ed., 2006

   The standard graduate textbook on information theory. Chapters 2, 7, 8, and 9 cover entropy, channel capacity, differential entropy, and Gaussian channels with rigorous proofs and excellent problem sets.

3. D. Tse and P. Viswanath, Fundamentals of Wireless Communication, Cambridge University Press, 2005

   Chapter 5 provides a superb treatment of capacity for fading channels, including ergodic and outage capacity, water-filling, and MIMO capacity. The wireless perspective throughout makes this the ideal companion for this chapter.

4. A. Goldsmith, Wireless Communications, Cambridge University Press, 2005

   Chapter 4 covers capacity of wireless channels with detailed derivations of ergodic capacity, outage capacity, and water-filling for both flat and frequency-selective fading. Excellent treatment of the connection between capacity and practical system design.

5. R. G. Gallager, Information Theory and Reliable Communication, Wiley, 1968

   Gallager's classic text provides rigorous proofs of the channel coding theorem with explicit error exponents. Also introduced LDPC codes (Chapter 1 of his 1963 monograph), which were rediscovered 30 years later and are now central to 5G NR.

6. C. Berrou, A. Glavieux, and P. Thitimajshima, Near Shannon Limit Error-Correcting Coding and Decoding: Turbo-Codes, 1993

   The paper that introduced turbo codes — the first practical codes to operate within 0.5 dB of the Shannon limit. Sparked the modern era of iterative decoding.

7. E. Arikan, Channel Polarization: A Method for Constructing Capacity-Achieving Codes for Symmetric Binary-Input Discrete Memoryless Channels, 2009

   Introduces polar codes — the first provably capacity-achieving codes with explicit construction and $O(N \log N)$ complexity. Now used for 5G NR control channels.

8. I. E. Telatar, Capacity of Multi-Antenna Gaussian Channels, 1999

   The foundational paper on MIMO capacity, establishing that capacity scales linearly with $\min(N_t, N_r)$ at high SNR.

9. A. J. Goldsmith and P. P. Varaiya, Capacity of Fading Channels with Channel Side Information, 1997

   Derives fading channel capacity under various CSI assumptions (CSIR only, full CSI, no CSI) with water-filling and channel inversion policies.

10. T. J. Richardson, M. A. Shokrollahi, and R. L. Urbanke, Design of Capacity-Approaching Irregular Low-Density Parity-Check Codes, 2001

    Shows how to design irregular LDPC codes that approach within 0.04 dB of capacity on the AWGN channel using density evolution.

Further Reading

• Capacity of fading channels

  A. J. Goldsmith and P. P. Varaiya, "Capacity of Fading Channels with Channel Side Information," IEEE Trans. Inform. Theory, vol. 43, no. 6, pp. 1986-1992, Nov. 1997

  Derives the capacity of fading channels under various CSI assumptions (CSIR only, full CSI, no CSI) with water-filling and channel inversion policies. The foundational paper for Section 11.3.

• LDPC codes and capacity

  T. J. Richardson, M. A. Shokrollahi, and R. L. Urbanke, "Design of Capacity-Approaching Irregular Low-Density Parity-Check Codes," IEEE Trans. Inform. Theory, vol. 47, no. 2, pp. 619-637, Feb. 2001

  Shows how to design irregular LDPC codes that achieve capacity on the BEC and approach within 0.04 dB of capacity on the AWGN channel. The density evolution technique is central to modern code design.

• Polar codes

  E. Arikan, "Channel Polarization: A Method for Constructing Capacity-Achieving Codes for Symmetric Binary-Input Discrete Memoryless Channels," IEEE Trans. Inform. Theory, vol. 55, no. 7, pp. 3051-3073, Jul. 2009

  Introduces the first provably capacity-achieving codes with explicit construction and $O(N \log N)$ encoding/decoding complexity. Polar codes are now used for 5G NR control channels.

• MIMO capacity

  I. E. Telatar, "Capacity of Multi-Antenna Gaussian Channels," European Trans. Telecomm., vol. 10, no. 6, pp. 585-595, Nov. 1999

  The foundational paper on MIMO capacity, showing the linear scaling of capacity with $\min(N_t, N_r)$. Extends the single-antenna results of this chapter to the full MIMO case.

• Adaptive modulation and coding

  A. J. Goldsmith and S.-G. Chua, "Variable-Rate Variable-Power MQAM for Fading Channels," IEEE Trans. Commun., vol. 45, no. 10, pp. 1218-1230, Oct. 1997

  Develops the theory of adaptive modulation with continuous and discrete rate adaptation. Shows that adaptive MQAM with a small number of modes captures most of the water-filling capacity gain.