References & Further Reading

References

1. D. Slepian and J. K. Wolf, Noiseless coding of correlated information sources, 1973

   The foundational paper establishing that separate encoding with joint decoding achieves the same rate region as joint encoding for correlated sources.

2. T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley-Interscience, 2nd ed., 2006

   The standard textbook for information theory. Chapter 15 covers distributed source coding, including Slepian-Wolf and the rate-distortion perspective.

3. A. El Gamal and Y.-H. Kim, Network Information Theory, Cambridge University Press, 2011

   Comprehensive treatment of network information theory. Chapters 11-13 cover distributed source coding, including Berger-Tung and multiple descriptions.

4. T. Berger, Multiterminal source coding, 1977

   Early formulation of the distributed lossy source coding problem and the achievable rate region that bears Berger's name.

5. S.-Y. Tung, Multiterminal source coding, 1978

   Independent derivation of the distributed lossy source coding achievable region, now known as the Berger-Tung inner bound.

6. A. El Gamal and T. M. Cover, Achievable rates for multiple descriptions, 1982

   Establishes the achievable rate-distortion region for the two-description problem using auxiliary random variables.

7. L. H. Ozarow, On a source-coding problem with two channels and three receivers, 1980

   Complete characterization of the Gaussian multiple descriptions problem with symmetric rates.

8. T. Berger, Z. Zhang, and H. Viswanathan, The CEO problem, 1996

   Formulation of the CEO problem and rate-distortion analysis for distributed indirect source coding.

9. H. Viswanathan and T. Berger, The quadratic Gaussian CEO problem, 1997

   Solution of the CEO problem for Gaussian sources with squared-error distortion.

10. Y. Oohama, The rate-distortion function for the quadratic Gaussian CEO problem, 1998

    Independent proof of the rate-distortion function for the Gaussian CEO problem.

11. S. S. Pradhan and K. Ramchandran, Distributed source coding using syndromes (DISCUS): Design and construction, 2003

    Practical implementation of Slepian-Wolf coding using LDPC syndromes. Bridges theory and practice for distributed source coding.

12. C. E. Shannon, A mathematical theory of communication, 1948

    The foundational paper of information theory, establishing both source coding and channel coding theorems, and the separation principle.

13. T. J. Goblick, Theoretical limitations on the transmission of data from analog sources, 1965

    Shows that uncoded transmission of a Gaussian source over a Gaussian channel achieves optimal distortion when bandwidth ratio is unity.

Further Reading

• Distributed video coding

  R. Puri, A. Majumdar, and K. Ramchandran, 'PRISM: A new robust video coding architecture based on distributed compression principles,' Proc. Allerton Conf., 2002.

  Shows how Slepian-Wolf and Wyner-Ziv principles enable practical distributed video coding with low-complexity encoders.

• Information-theoretic security in distributed source coding

  A. D. Wyner, 'The wire-tap channel,' Bell System Technical Journal, 1975.

  The wire-tap channel introduces secrecy constraints that interact with distributed source coding in surprising ways.

• Network information theory overview

  A. El Gamal and Y.-H. Kim, 'Network Information Theory,' Cambridge University Press, 2011, Chapters 1-5.

  Comprehensive treatment of the proof techniques (random binning, covering, packing) used throughout this chapter and the rest of the book.