CoChat
Sign Up
PreprintCited by 2,507Generative Adversarial Networks and Image SynthesisImage and Signal Denoising MethodsAdversarial Robustness in Machine Learning

Denoising Diffusion Implicit Models

Open access
Song, Jiaming, Meng, Chenlin, Ermon, Stefano·2020·arXiv
DOI 10.48550/arxiv.2010.02502arXiv 2010.02502
Open this paper in CoChat — free accountOpen PDF

Abstract

Denoising diffusion probabilistic models (DDPMs) have achieved high quality image generation without adversarial training, yet they require simulating a Markov chain for many steps to produce a sample. To accelerate sampling, we present denoising diffusion implicit models (DDIMs), a more efficient class of iterative implicit probabilistic models with the same training procedure as DDPMs. In DDPMs, the generative process is defined as the reverse of a Markovian diffusion process. We construct a class of non-Markovian diffusion processes that lead to the same training objective, but whose reverse process can be much faster to sample from. We empirically demonstrate that DDIMs can produce high quality samples $10 \times$ to $50 \times$ faster in terms of wall-clock time compared to DDPMs, allow us to trade off computation for sample quality, and can perform semantically meaningful image interpolation directly in the latent space.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2010.02502

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • DDIM allows for accurate reconstruction of the original input video x0 from the noise at arbitrary time step t.

    “One distinct advantage of DDIM is that it allows for accurate reconstruction of the original input video x 0 from the noise at arbitrary time step t .”

    From Video Diffusion Models: A Survey (2024) · cites this paper as Song et al., 2020

    Section 5.4 (p. 9) reports reconstructing x₀ from an encoded x_T on the CIFAR-10 image test set, with lower reconstruction error when more steps are used. It does not establish accurate reconstruction of a video from noise at an arbitrary time step t; the reported reconstruction starts from x_T. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • Kim et al. proposed DiffusionCLIP, which uses diffusion models to perform text-driven image manipulation, enabling zero-shot image manipulations in both trained and unseen domains.

    “Based on the perfect inversion capability and high-quality image generation of the recent difusion models [64], Kim et al. proposed DifusionCLIP [26].”

    From DEEPFAKER: A Unified Evaluation Platform for Facial Deepfake and Detection Models (2024) · cites this paper as [64]

    The citation [64] attaches to the stated capabilities of diffusion models, not to the statement that Kim et al. proposed DiffusionCLIP. The Abstract (p. 1) reports high-quality generation and reconstruction with very low error; Section 5.4 (p. 9) reports that reconstruction error decreases with more steps. Neither establishes the citing sentence’s stronger claim of perfect inversion. (LLM, conf=0.90)

    Experimental — accuracy not yet measured

  • Advanced sampling strategies and hierarchical approaches can partially address low inference speed, but training on high-resolution image data always requires calculating expensive gradients.

    “While the former can be partially adressed by advanced sampling strategies [47, 75, 84] and hierarchical approaches [31, 93], training on high-resolution image data always requires to calculate expensive gradients.”

    From High-Resolution Image Synthesis with Latent Diffusion Models (2022) · cites this paper as [84]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 31

  1. Martin Arjovsky, Soumith Chintala, and L´ eon Bottou. Wasserstein GAN. arXiv preprint arXiv:1701.07875 , January 2017. · arXiv
  2. David Bau, Jun-Yan Zhu, Jonas Wulff, William Peebles, Hendrik Strobelt, Bolei Zhou, and Antonio Torralba. Seeing what a gan cannot generate. In Proceedings of the IEEE International Conference on Computer Vision , pp. 4502-4511, 2019.
  3. Yoshua Bengio, Eric Laufer, Guillaume Alain, and Jason Yosinski. Deep generative stochastic networks trainable by backprop. In International Conference on Machine Learning , pp. 226-234, January 2014.
  4. John Charles Butcher and Nicolette Goodwin. Numerical methods for ordinary differential equations , volume 2. Wiley Online Library, 2008.
  5. Nanxin Chen, Yu Zhang, Heiga Zen, Ron J Weiss, Mohammad Norouzi, and William Chan. WaveGrad: Estimating gradients for waveform generation. arXiv preprint arXiv:2009.00713 , September 2020. · arXiv
  6. Laurent Dinh, Jascha Sohl-Dickstein, and Samy Bengio. Density estimation using real NVP. arXiv preprint arXiv:1605.08803 , May 2016. · arXiv
  7. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets. In Advances in neural information processing systems , pp. 2672-2680, 2014.
  8. Anirudh Goyal, Nan Rosemary Ke, Surya Ganguli, and Yoshua Bengio. Variational walkback: Learning a transition operator as a stochastic recurrent net. In Advances in Neural Information Processing Systems , pp. 4392-4402, 2017.
  9. Will Grathwohl, Ricky T Q Chen, Jesse Bettencourt, Ilya Sutskever, and David Duvenaud. FFJORD: Free-form continuous dynamics for scalable reversible generative models. arXiv preprint arXiv:1810.01367 , October 2018. · arXiv
  10. Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron C Courville. Improved training of wasserstein gans. In Advances in Neural Information Processing Systems , pp. 5769-5779, 2017.
  11. Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. arXiv preprint arXiv:2006.11239 , June 2020. · arXiv
  12. Aapo Hyv¨ arinen. Estimation of Non-Normalized statistical models by score matching. Journal of Machine Learning Researc h , 6:695-709, 2005.
  13. Richard Jordan, David Kinderlehrer, and Felix Otto. The variational formulation of the fokkerplanck equation. SIAM journal on mathematical analysis , 29(1):1-17, 1998.
  14. Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. Analyzing and improving the image quality of stylegan. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pp. 8110-8119, 2020.
  15. Diederik P Kingma and Max Welling. Auto-Encoding variational bayes. arXiv preprint arXiv:1312.6114v10 , December 2013. · arXiv
  16. Daniel Levy, Matthew D Hoffman, and Jascha Sohl-Dickstein. Generalizing hamiltonian monte carlo with neural networks. arXiv preprint arXiv:1711.09268 , 2017. · arXiv
  17. Shakir Mohamed and Balaji Lakshminarayanan. Learning in implicit generative models. arXiv preprint arXiv:1610.03483 , October 2016. · arXiv
  18. Radford M Neal et al. Mcmc using hamiltonian dynamics. Handbook of markov chain monte carlo , 2(11):2, 2011.
  19. Alejandro F Queiruga, N Benjamin Erichson, Dane Taylor, and Michael W Mahoney. Continuousin-depth neural networks. arXiv preprint arXiv:2008.02389 , 2020. · arXiv
  20. Martin Raphan and Eero P Simoncelli. Least squares estimation without priors or supervision. Neural computation , 23(2):374-420, February 2011. ISSN 0899-7667, 1530-888X.
  21. Danilo Jimenez Rezende and Shakir Mohamed. Variational inference with normalizing flows. arXiv preprint arXiv:1505.05770 , May 2015. · arXiv
  22. Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. Stochastic backpropagation and approximate inference in deep generative models. arXiv preprint arXiv:1401.4082 , 2014. · arXiv
  23. Tim Salimans, Diederik P Kingma, and Max Welling. Markov chain monte carlo and variational inference: Bridging the gap. arXiv preprint arXiv:1410.6460 , October 2014. · arXiv
  24. Ken Shoemake. Animating rotation with quaternion curves. In Proceedings of the 12th annual conference on Computer graphics and interactive techniques , pp. 245-254, 1985.
  25. Jascha Sohl-Dickstein, Eric A Weiss, Niru Maheswaranathan, and Surya Ganguli. Deep unsupervised learning using nonequilibrium thermodynamics. arXiv preprint arXiv:1503.03585 , March 2015. · arXiv
  26. Jiaming Song, Shengjia Zhao, and Stefano Ermon. A-nice-mc: Adversarial training for mcmc. arXiv preprint arXiv:1706.07561 , June 2017. · arXiv
  27. Yang Song and Stefano Ermon. Generative modeling by estimating gradients of the data distribution. arXiv preprint arXiv:1907.05600 , July 2019. · arXiv
  28. Yang Song and Stefano Ermon. Improved techniques for training Score-Based generative models. arXiv preprint arXiv:2006.09011 , June 2020. · arXiv
  29. Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456 , 2020. · arXiv
  30. Aaron van den Oord, Nal Kalchbrenner, and Koray Kavukcuoglu. Pixel recurrent neural networks. arXiv preprint arXiv:1601.06759 , January 2016b. · arXiv
  31. Shengjia Zhao, Hongyu Ren, Arianna Yuan, Jiaming Song, Noah Goodman, and Stefano Ermon. Bias and generalization in deep generative models: An empirical study. In Advances in Neural Information Processing Systems , pp. 10792-10801, 2018.

Cited by

Sorted by citations

Authors
Song, J., Meng, C., & Ermon, S.
Affiliations
Stanford University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2010.02502
arXiv
2010.02502
OpenAlex
W3092442149
Cited by
2,507
References
8
Citations by year
2026: 40 · 2025: 794 · 2024: 1163 · 2023: 453 · 2022: 19 · 2021: 38
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
Keywords
DDIM, denoising diffusion probabilistic models, image generation, sampling acceleration, implicit generative models, latent space interpolation, Markov chain sampling

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review