References & Further Reading

References

  1. F. R. Kschischang, B. J. Frey, and H.-A. Loeliger, Factor graphs and the sum-product algorithm, 2001

    The standard modern reference for factor graphs and message passing.

  2. R. M. Tanner, A recursive approach to low complexity codes, 1981

    Introduces the bipartite graph representation of LDPC codes (Tanner graphs).

  3. N. Wiberg, Codes and decoding on general graphs, Linköping Studies in Science and Technology, PhD thesis, 1996

    Formalizes factor graphs and derives message-passing algorithms in generality.

  4. J. Pearl, Probabilistic Reasoning in Intelligent Systems, Morgan Kaufmann, 1988

    Foundational monograph on belief propagation in Bayesian networks.

  5. M. J. Wainwright and M. I. Jordan, Graphical Models, Exponential Families, and Variational Inference, 2008

    Comprehensive treatment connecting factor graphs, loopy BP, and variational inference.

  6. D. Koller and N. Friedman, Probabilistic Graphical Models: Principles and Techniques, MIT Press, 2009

    Encyclopedic textbook on graphical models for machine learning.

  7. M. Mézard and A. Montanari, Information, Physics, and Computation, Oxford University Press, 2009

    Factor graph perspective linking coding, statistical physics, and inference.

  8. J. S. Yedidia, W. T. Freeman, and Y. Weiss, Constructing free-energy approximations and generalized belief propagation algorithms, 2005

    Bethe-Kikuchi free energy interpretation of loopy BP.

  9. T. Richardson and R. Urbanke, Modern Coding Theory, Cambridge University Press, 2008

    Canonical reference for density evolution and LDPC analysis on Tanner graphs.

  10. R. J. McEliece, D. J. C. MacKay, and J.-F. Cheng, Turbo decoding as an instance of Pearl's belief propagation algorithm, 1998

    Identifies turbo decoding as loopy BP — a pivotal connection.

  11. H.-A. Loeliger, J. Dauwels, J. Hu, S. Korl, L. Ping, and F. R. Kschischang, The factor graph approach to model-based signal processing, 2007

    Survey of factor graphs applied to signal processing problems.

Further Reading

  • Variational inference and mean field

    Wainwright-Jordan (2008), Chapters 5-6

    Alternative approximations that live on factor graphs.

  • Graphical models in machine learning

    Murphy, 'Probabilistic Machine Learning' (2022)

    Modern treatment with software-oriented perspective.

  • Factor graphs in control and estimation

    Dellaert-Kaess (2017) — Factor graphs for robot perception

    How SLAM problems are solved as message passing on factor graphs.