References & Further Reading
References
- D. P. Kingma and M. Welling, Auto-Encoding Variational Bayes, ICLR, 2013
The VAE paper introducing the reparameterisation trick.
- I. Goodfellow et al., Generative Adversarial Nets, NeurIPS, 2014
The GAN paper introducing adversarial training for generation.
- J. Ho, A. Jain, and P. Abbeel, Denoising Diffusion Probabilistic Models, NeurIPS, 2020
DDPM: simple denoising objective for high-quality generation.
- Y. Lipman, R. T. Q. Chen, H. Ben-Hamu, M. Nickel, and M. Le, Flow Matching for Generative Modeling, ICLR, 2023
Flow matching: simplified training of continuous normalizing flows.
Further Reading
Understanding diffusion models
Lilian Weng's blog (lilianweng.github.io)
Excellent tutorial on diffusion models with derivations.
Score-based generative models
Yang Song's blog and SDE tutorial
Unifies diffusion and score matching under stochastic differential equations.