References & Further Reading
References
- F. R. Kschischang, B. J. Frey, and H.-A. Loeliger, Factor graphs and the sum-product algorithm, 2001
The standard modern reference for factor graphs and message passing.
- R. M. Tanner, A recursive approach to low complexity codes, 1981
Introduces the bipartite graph representation of LDPC codes (Tanner graphs).
- N. Wiberg, Codes and decoding on general graphs, Linköping Studies in Science and Technology, PhD thesis, 1996
Formalizes factor graphs and derives message-passing algorithms in generality.
- J. Pearl, Probabilistic Reasoning in Intelligent Systems, Morgan Kaufmann, 1988
Foundational monograph on belief propagation in Bayesian networks.
- M. J. Wainwright and M. I. Jordan, Graphical Models, Exponential Families, and Variational Inference, 2008
Comprehensive treatment connecting factor graphs, loopy BP, and variational inference.
- D. Koller and N. Friedman, Probabilistic Graphical Models: Principles and Techniques, MIT Press, 2009
Encyclopedic textbook on graphical models for machine learning.
- M. Mézard and A. Montanari, Information, Physics, and Computation, Oxford University Press, 2009
Factor graph perspective linking coding, statistical physics, and inference.
- J. S. Yedidia, W. T. Freeman, and Y. Weiss, Constructing free-energy approximations and generalized belief propagation algorithms, 2005
Bethe-Kikuchi free energy interpretation of loopy BP.
- T. Richardson and R. Urbanke, Modern Coding Theory, Cambridge University Press, 2008
Canonical reference for density evolution and LDPC analysis on Tanner graphs.
- R. J. McEliece, D. J. C. MacKay, and J.-F. Cheng, Turbo decoding as an instance of Pearl's belief propagation algorithm, 1998
Identifies turbo decoding as loopy BP — a pivotal connection.
- H.-A. Loeliger, J. Dauwels, J. Hu, S. Korl, L. Ping, and F. R. Kschischang, The factor graph approach to model-based signal processing, 2007
Survey of factor graphs applied to signal processing problems.
Further Reading
Variational inference and mean field
Wainwright-Jordan (2008), Chapters 5-6
Alternative approximations that live on factor graphs.
Graphical models in machine learning
Murphy, 'Probabilistic Machine Learning' (2022)
Modern treatment with software-oriented perspective.
Factor graphs in control and estimation
Dellaert-Kaess (2017) — Factor graphs for robot perception
How SLAM problems are solved as message passing on factor graphs.