CoChat
Sign Up
PreprintCited by 79Generative Adversarial Networks and Image SynthesisAdversarial Robustness in Machine LearningMarkov Chains and Monte Carlo Methods

On Fast Sampling of Diffusion Probabilistic Models

Open access
Kong, Zhifeng, Ping, Wei·2021·arXiv
DOI 10.48550/arxiv.2106.00132arXiv 2106.00132
Open this paper in CoChat — free accountOpen PDF

Abstract

In this work, we propose FastDPM, a unified framework for fast sampling in diffusion probabilistic models. FastDPM generalizes previous methods and gives rise to new algorithms with improved sample quality. We systematically investigate the fast sampling methods under this framework across different domains, on different datasets, and with different amount of conditional information provided for generation. We find the performance of a particular method depends on data domains (e.g., image or audio), the trade-off between sampling speed and sample quality, and the amount of conditional information. We further provide insights and recipes on the choice of methods for practitioners.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2106.00132

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Advanced sampling strategies and hierarchical approaches can partially address low inference speed, but training on high-resolution image data always requires calculating expensive gradients.

    “While the former can be partially adressed by advanced sampling strategies [47, 75, 84] and hierarchical approaches [31, 93], training on high-resolution image data always requires to calculate expensive gradients.”

    From High-Resolution Image Synthesis with Latent Diffusion Models (2022) · cites this paper as [47]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 31

  1. N. Chen, Y. Zhang, H. Zen, R. J. Weiss, M. Norouzi, and W. Chan. WaveGrad: Estimating gradients for waveform generation. arXiv preprint arXiv:2009.00713 , 2020. · arXiv
  2. R. Gao, Y. Song, B. Poole, Y. N. Wu, and D. P. Kingma. Learning energy-based models by diffusion recovery likelihood. arXiv preprint arXiv:2012.08125 , 2020. · arXiv
  3. A. Goyal, N. R. Ke, S. Ganguli, and Y. Bengio. Variational walkback: Learning a transition operator as a stochastic recurrent net. arXiv preprint arXiv:1711.02282 , 2017. · arXiv
  4. J. Ho, A. Jain, and P. Abbeel. Denoising diffusion probabilistic models. arXiv preprint arXiv:2006.11239 , 2020. · arXiv
  5. E. Hoogeboom, D. Nielsen, P. Jaini, P. Forré, and M. Welling. Argmax flows and multinomial diffusion: Towards non-autoregressive language models. arXiv preprint arXiv:2102.05379 , 2021. · arXiv
  6. M. Jeong, H. Kim, S. J. Cheon, B. J. Choi, and N. S. Kim. Diff-tts: A denoising diffusion model for text-to-speech. arXiv preprint arXiv:2104.01409 , 2021. · arXiv
  7. T. Karras, S. Laine, M. Aittala, J. Hellsten, J. Lehtinen, and T. Aila. Analyzing and improving the image quality of stylegan. In CVPR , pages 8110-8119, 2020.
  8. D. P. Kingma and P. Dhariwal. Glow: Generative flow with invertible 1x1 convolutions. In NeurIPS , 2018.
  9. J. Kong, J. Kim, and J. Bae. Hifi-gan: Generative adversarial networks for efficient and high fidelity speech synthesis. In NeurIPS , 2020a.
  10. Z. Kong, W. Ping, J. Huang, K. Zhao, and B. Catanzaro. DiffWave: A versatile diffusion model for audio synthesis. arXiv preprint arXiv:2009.09761 , 2020b. · arXiv
  11. J. Lee and S. Han. Nu-wave: A diffusion probabilistic model for neural audio upsampling. arXiv preprint arXiv:2104.02321 , 2021. · arXiv
  12. J. Liu, C. Li, Y . Ren, F. Chen, P. Liu, and Z. Zhao. Diffsinger: Diffusion acoustic model for singing voice synthesis. arXiv preprint arXiv:2105.02446 , 2021. · arXiv
  13. Z. Liu, P. Luo, X. Wang, and X. Tang. Deep learning face attributes in the wild. In Proceedings of International Conference on Computer Vision (ICCV) , December 2015.
  14. S. Luo and W. Hu. Diffusion probabilistic models for 3d point cloud generation. arXiv preprint arXiv:2103.01458 , 2021. · arXiv
  15. C. Meng, J. Song, Y. Song, S. Zhao, and S. Ermon. Improved autoregressive modeling with distribution smoothing. arXiv preprint arXiv:2103.15089 , 2021. · arXiv
  16. G. Mittal, J. Engel, C. Hawthorne, and I. Simon. Symbolic music generation with diffusion models. arXiv preprint arXiv:2103.16091 , 2021. · arXiv
  17. T. Okamoto, T. Toda, Y. Shiga, and H. Kawai. Noise level limited sub-modeling for diffusion probabilistic vocoders. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages 6029-6033. IEEE, 2021.
  18. W. Ping. WaveFlow on SC09 for unconditional generation. https://openreview.net/forum? id=a-xFK8Ymz5J&noteId=P3ORiRE9C3 , 2021.
  19. W. Ping, K. Peng, K. Zhao, and Z. Song. WaveFlow: A compact flow-based model for raw audio. In ICML , 2020.
  20. V. Popov, I. Vovk, V. Gogoryan, T. Sadekova, and M. Kudinov. Grad-tts: A diffusion probabilistic model for text-to-speech. arXiv preprint arXiv:2105.06337 , 2021. · arXiv
  21. F. Ribeiro, D. Florêncio, C. Zhang, and M. Seltzer. CrowdMOS: An approach for crowdsourcing mean opinion score studies. In ICASSP , 2011.
  22. T. Salimans, I. Goodfellow, W. Zaremba, V. Cheung, A. Radford, and X. Chen. Improved techniques for training gans. In Advances in neural information processing systems , pages 2234-2242, 2016.
  23. R. San-Roman, E. Nachmani, and L. Wolf. Noise estimation for generative diffusion models. arXiv preprint arXiv:2104.02600 , 2021. · arXiv
  24. J. Sohl-Dickstein, E. A. Weiss, N. Maheswaranathan, and S. Ganguli. Deep unsupervised learning using nonequilibrium thermodynamics. arXiv preprint arXiv:1503.03585 , 2015. · arXiv
  25. J. Song, C. Meng, and S. Ermon. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502 , 2020a. · arXiv
  26. Y. Song and S. Ermon. Generative modeling by estimating gradients of the data distribution. arXiv preprint arXiv:1907.05600 , 2019. · arXiv
  27. Y. Song and S. Ermon. Improved techniques for training score-based generative models. arXiv preprint arXiv:2006.09011 , 2020. · arXiv
  28. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. Rethinking the inception architecture for computer vision. CoRR , abs/1512.00567, 2015. URL http://arxiv.org/abs/1512.00567 . · arXiv
  29. P. Warden. Speech commands: A dataset for limited-vocabulary speech recognition. arXiv preprint arXiv:1804.03209 , 2018. · arXiv
  30. F. Yu, A. Seff, Y. Zhang, S. Song, T. Funkhouser, and J. Xiao. Lsun: Construction of a large-scale image dataset using deep learning with humans in the loop. arXiv preprint arXiv:1506.03365 , 2015. · arXiv
  31. L. Zhou, Y. Du, and J. Wu. 3d shape generation and completion through point-voxel diffusion. arXiv preprint arXiv:2104.03670 , 2021. · arXiv

Cited by

Sorted by citations

Authors
Kong, Z., & Ping, W.
Affiliations
  • University of California San Diego (US)
  • Nvidia (United Kingdom) (GB)
ORCID
Ping, Wei
Venue
arXiv
Publisher
arXiv
Published
2021
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2106.00132
arXiv
2106.00132
OpenAlex
W3165905282
Cited by
79
References
4
Citations by year
2025: 11 · 2024: 32 · 2023: 25 · 2022: 3 · 2021: 8
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
Keywords
diffusion probabilistic models, high-speed sampling, sampling speed, sample quality, conditional generation, image generation, audio generation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review