Gotta Go Fast When Generating Data with Score-Based Models
Open accessThe DOI matches its OpenAlex record; 20 of the 20 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712 · cited 3×
“Score-based generative models [Song and Ermon, 2019, 2020, Ho et al., 2020, Jolicoeur-Martineau et al., 2020, Song et al., 2020a, Piché-Taillefer, 2021] have been very successful at generating data from various modalities, such as images [Ho et al., 2020, Song et al., 2020a], audio [Chen et al.,…”
MethodGANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
A family of embedded Runge-Kutta formulae
Dormand, J. R., & Prince, P. J. (1980) · Journal of Computational and Applied Mathematics · doi:10.1016/0771-050x(80)90013-3 · Cited by 3,634
Stochastic Differential Equations
Øksendal, B. (2003) · Universitext · doi:10.1007/978-3-642-14394-6_5 · Cited by 3,081
Denoising Diffusion Implicit Models
Song, J., Meng, C., & Ermon, S. (2020) · arXiv · doi:10.48550/arxiv.2010.02502 · Cited by 2,507
Score-Based Generative Modeling through Stochastic Differential Equations
Song, Y., Sohl-Dickstein, J., Kingma, D. P., Kumar, A., Ermon, S., & Poole, B. (2020) · arXiv · doi:10.48550/arxiv.2011.13456 · Cited by 1,953 · cited 10×
“Score-based generative models [Song and Ermon, 2019, 2020, Ho et al., 2020, Jolicoeur-Martineau et al., 2020, Song et al., 2020a, Piché-Taillefer, 2021] have been very successful at generating data from various modalities, such as images [Ho et al., 2020, Song et al., 2020a], audio [Chen et al.,…”
MethodResultInfluentialImage Super-Resolution Via Iterative Refinement
Saharia, C., Ho, J., Chan, W., Salimans, T., Fleet, D. J., & Norouzi, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3204461 · Cited by 1,829 · cited 1×
“They have further been used effectively for super-resolution [Saharia et al., 2021, Kadkhodaie and Simoncelli, 2020], inpainting [Kadkhodaie and Simoncelli, 2020, Song and Ermon, 2020], source separation [Jayaram and Thickstun, 2020], and image-to-image translation [Sasaki et al., 2021].”
MethodImage Super-Resolution via Iterative Refinement
Saharia, C., Ho, J., Chan, W., Salimans, T., Fleet, D. J., & Norouzi, M. (2021) · arXiv · doi:10.48550/arxiv.2104.07636 · Cited by 1,829
Rackauckas, C., & Nie, Q. (2017) · Journal of Open Research Software · doi:10.5334/jors.151 · Cited by 1,636
Improved Denoising Diffusion Probabilistic Models
Nichol, A., & Dhariwal, P. (2021) · arXiv · doi:10.48550/arxiv.2102.09672 · Cited by 1,550 · cited 2×
“Similarly, Nichol and Dhariwal [2021] proposed generating low-resolution images and then upscale them since generating low-resolution images is quicker.”
BackgroundMethodGenerative Modeling by Estimating Gradients of the Data Distribution
Song, Y., & Ermon, S. (2019) · arXiv · doi:10.48550/arxiv.1907.05600 · Cited by 1,453 · cited 1×
“Score-based generative models [Song and Ermon, 2019, 2020, Ho et al., 2020, Jolicoeur-Martineau et al., 2020, Song et al., 2020a, Piché-Taillefer, 2021] have been very successful at generating data from various modalities, such as images [Ho et al., 2020, Song et al., 2020a], audio [Chen et al.,…”
A Connection Between Score Matching and Denoising Autoencoders
Vincent, P. (2011) · Neural Computation · doi:10.1162/neco_a_00142 · Cited by 1,011 · cited 1×
“…objective: where λ ( t ) : R → R is a weighting function generally chosen to be inversely proportional to: One can demonstrate that the minimizer of that objective θ ∗ will be such that s θ ∗ ( x , t ) = ∇ x log p t ( x ) [Vincent, 2011], allowing us to approximate the reverse diffusion process.”
Background(2005) · doi:10.5555/1046920.1088696 · Cited by 756
DiffWave: A Versatile Diffusion Model for Audio Synthesis
Kong, Z., Ping, W., Huang, J., Zhao, K., & Catanzaro, B. (2020) · arXiv · doi:10.48550/arxiv.2009.09761 · Cited by 569
Reverse-time diffusion equation models
Anderson, B. D. O. (1982) · Stochastic Processes and their Applications · doi:10.1016/0304-4149(82)90051-5 · Cited by 565 · cited 1×
“…this diffusion, drawing x (1) from its Gaussian distribution and solving the Reverse Diffusion Process (RDP) equal to: where ∇ x log p t ( x ) is referred to as the score of the distribution at time t [Hyvärinen, 2005] and ¯w ( t ) is the Wiener process in which time flows backward [Anderson, 1982].”
BackgroundImproved Techniques for Training Score-Based Generative Models
Song, Y., & Ermon, S. (2020) · arXiv · doi:10.48550/arxiv.2006.09011 · Cited by 482 · cited 3×
“They have further been used effectively for super-resolution [Saharia et al., 2021, Kadkhodaie and Simoncelli, 2020], inpainting [Kadkhodaie and Simoncelli, 2020, Song and Ermon, 2020], source separation [Jayaram and Thickstun, 2020], and image-to-image translation [Sasaki et al., 2021].”
BackgroundMethodAdversarial score matching and improved sampling for image generation
Jolicoeur-Martineau, A., Piché-Taillefer, R., Combes, R. T. D., & Mitliagkas, I. (2020) · arXiv · doi:10.48550/arxiv.2009.05475 · Cited by 88
Self-citationNoise Estimation for Generative Diffusion Models
San-Roman, R., Nachmani, E., & Wolf, L. (2021) · arXiv · doi:10.48550/arxiv.2104.02600 · Cited by 44
Cited by
Diffusion Models in Vision: A Survey
Croitoru, F.-A., Hondru, V., Ionescu, R. T., & Shah, M. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3261988 · Cited by 1,859
Image Super-Resolution Via Iterative Refinement
Saharia, C., Ho, J., Chan, W., Salimans, T., Fleet, D. J., & Norouzi, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3204461 · Cited by 1,829
Image Super-Resolution via Iterative Refinement
Saharia, C., Ho, J., Chan, W., Salimans, T., Fleet, D. J., & Norouzi, M. (2021) · arXiv · doi:10.48550/arxiv.2104.07636 · Cited by 1,829
Diffusion Models: A Comprehensive Survey of Methods and Applications
Yang, L., Zhang, Z., Song, Y., Hong, S., Xu, R., Zhao, Y., Zhang, W., Cui, B., & Yang, M.-H. (2024) · ACM Computing Surveys · doi:10.1145/3626235 · Cited by 1,704
SRDiff: Single image super-resolution with diffusion probabilistic models
Li, H., Yang, Y., Chang, M., Chen, S., Feng, H., Xu, Z., Li, Q., & Chen, Y. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.01.029 · Cited by 777
Metadata
- Authors
- Jolicoeur‐Martineau, A., Li, K., Piché-Taillefer, R., Kachman, T., & Mitliagkas, I.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2021-05-28
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2105.14080
- OpenAlex
- W3168160162
- Cited by
- 19
- References
- 20
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.