Chapter 8: Additional Topics in Source Coding

Learning Objectives

• Formulate the source coding with a helper problem and state the rate region in terms of Wyner's common information
• Explain how LDPC-based Slepian-Wolf codes enable practical distributed video coding via the Wyner-Ziv and DISCUS frameworks
• Describe the information bottleneck method and its connection to rate-distortion theory
• Explain how mutual information serves as a regularizer in representation learning and variational inference
• Recognize the deep connections between lossy source coding, statistical learning, and generative modeling