The DOI matches its Crossref record; 133 of the 133 references it cites were found in a registry or an index.
Diffusion Models in Vision: A Survey
Open accessAbstract
Denoising diffusion models represent a recent emerging topic in computer vision, demonstrating remarkable results in the area of generative modeling. A diffusion model is a deep generative model that is based on two stages, a forward diffusion stage and a reverse diffusion stage. In the forward diffusion stage, the input data is gradually perturbed over several steps by adding Gaussian noise. In the reverse stage, a model is tasked at recovering the original input data by learning to gradually reverse the diffusion process, step by step. Diffusion models are widely appreciated for the quality and diversity of the generated samples, despite their known computational burdens, i.e., low speeds due to the high number of steps involved during sampling. In this survey, we provide a comprehensive review of articles on denoising diffusion models applied in vision, comprising both theoretical and practical contributions in the field. First, we identify and present three generic diffusion modeling frameworks, which are based on denoising diffusion probabilistic models, noise conditioned score networks, and stochastic differential equations. We further discuss the relations between diffusion models and other deep generative models, including variational auto-encoders, generative adversarial networks, energy-based models, autoregressive models and normalizing flows. Then, we introduce a multi-perspective categorization of diffusion models applied in computer vision. Finally, we illustrate the current limitations of diffusion models and envision some interesting directions for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
A simple framework for contrastive learning of visual representations
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020) · arXiv · doi:10.48550/arxiv.2002.05709 · Cited by 10,857
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
Representation Learning with Contrastive Predictive Coding
Oord, A. V. D., Li, Y., & Vinyals, O. (2018) · arXiv · doi:10.48550/arxiv.1807.03748 · Cited by 6,242
Tarvainen, A., & Valpola, H. (2017) · arXiv · doi:10.48550/arxiv.1703.01780 · Cited by 4,275
Diffusion Models Beat GANs on Image Synthesis
Dhariwal, P., & Nichol, A. (2021) · arXiv · doi:10.48550/arxiv.2105.05233 · Cited by 3,362
(2017) · International Conference on Learning Representations · Cited by 3,248
Semantic Image Synthesis With Spatially-Adaptive Normalization
Park, T., Liu, M.-Y., Wang, T.-C., & Zhu, J.-Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00244 · Cited by 2,974
Neural Discrete Representation Learning
Oord, A. V. D., Vinyals, O., & Kavukcuoglu, K. (2017) · arXiv · doi:10.48550/arxiv.1711.00937 · Cited by 2,729
Deep Unsupervised Learning using Nonequilibrium Thermodynamics
Sohl-Dickstein, J., Weiss, E. A., Maheswaranathan, N., & Ganguli, S. (2015) · arXiv · doi:10.48550/arxiv.1503.03585 · Cited by 2,637
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
Saharia, C., Chan, W., Saxena, S., Li, L., Whang, J., Denton, E., Ghasemipour, S. K. S., Ayan, B. K., Mahdavi, S. S., Lopes, R. G., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.11487 · Cited by 2,528
Taming Transformers for High-Resolution Image Synthesis
Esser, P., Rombach, R., & Ommer, B. (2020) · arXiv · doi:10.48550/arxiv.2012.09841 · Cited by 2,514
Taming Transformers for High-Resolution Image Synthesis
Esser, P., Rombach, R., & Ommer, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01268 · Cited by 2,514
Hierarchical Text-Conditional Image Generation with CLIP Latents
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06125 · Cited by 2,511
Denoising Diffusion Implicit Models
Song, J., Meng, C., & Ermon, S. (2020) · arXiv · doi:10.48550/arxiv.2010.02502 · Cited by 2,507
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
Caron, M., Misra, I., Mairal, J., Goyal, P., Bojanowski, P., & Joulin, A. (2020) · arXiv · doi:10.48550/arxiv.2006.09882 · Cited by 2,499
Score-Based Generative Modeling through Stochastic Differential Equations
Song, Y., Sohl-Dickstein, J., Kingma, D. P., Kumar, A., Ermon, S., & Poole, B. (2020) · arXiv · doi:10.48550/arxiv.2011.13456 · Cited by 1,953
A Tutorial on Energy-Based Learning
LeCun, Y., Chopra, S., Hadsell, R. T., Ranzato, A., & Huang, F. J. (2006) · Cited by 1,931
Conditional Image Generation with PixelCNN Decoders
van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05328 · Cited by 1,833
Image Super-Resolution Via Iterative Refinement
Saharia, C., Ho, J., Chan, W., Salimans, T., Fleet, D. J., & Norouzi, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3204461 · Cited by 1,829
Image Super-Resolution via Iterative Refinement
Saharia, C., Ho, J., Chan, W., Salimans, T., Fleet, D. J., & Norouzi, M. (2021) · arXiv · doi:10.48550/arxiv.2104.07636 · Cited by 1,829
RePaint: Inpainting using Denoising Diffusion Probabilistic Models
Lugmayr, A., Danelljan, M., Romero, A., Yu, F., Timofte, R., & Van Gool, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01117 · Cited by 1,778
Palette: Image-to-Image Diffusion Models
Saharia, C., Chan, W., Chang, H., Lee, C., Ho, J., Salimans, T., Fleet, D., & Norouzi, M. (2022) · Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings · doi:10.1145/3528233.3530757 · Cited by 1,717
Improved Denoising Diffusion Probabilistic Models
Nichol, A., & Dhariwal, P. (2021) · arXiv · doi:10.48550/arxiv.2102.09672 · Cited by 1,550
NICE: Non-linear Independent Components Estimation
Dinh, L., Krueger, D., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1410.8516 · Cited by 1,493
Generative Modeling by Estimating Gradients of the Data Distribution
Song, Y., & Ermon, S. (2019) · arXiv · doi:10.48550/arxiv.1907.05600 · Cited by 1,453
Temporal Ensembling for Semi-Supervised Learning
Laine, S., & Aila, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02242 · Cited by 1,395
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
Nichol, A., Dhariwal, P., Ramesh, A., Shyam, P., Mishkin, P., McGrew, B., Sutskever, I., & Chen, M. (2021) · arXiv · doi:10.48550/arxiv.2112.10741 · Cited by 1,357
Classifier-Free Diffusion Guidance
Ho, J., & Salimans, T. (2022) · arXiv · doi:10.48550/arxiv.2207.12598 · Cited by 1,126
Interpreting the Latent Space of GANs for Semantic Face Editing
Shen, Y., Gu, J., Tang, X., & Zhou, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00926 · Cited by 1,063
A Connection Between Score Matching and Denoising Autoencoders
Vincent, P. (2011) · Neural Computation · doi:10.1162/neco_a_00142 · Cited by 1,011
Pseudo Numerical Methods for Diffusion Models on ManifoldsPreprint
Liu, L., Ren, Y., Lin, Z., & Zhao, Z. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.09778 · Cited by 892
Diffusion Models for Adversarial PurificationPreprint
Nie, W., Guo, B., Huang, Y., Xiao, C., Vahdat, A., & Anandkumar, A. (2022) · CaltechAUTHORS (California Institute of Technology) · doi:10.48550/arxiv.2205.07460 · Cited by 808
Blended Diffusion for Text-driven Editing of Natural Images
Avrahami, O., Lischinski, D., & Fried, O. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01767 · Cited by 764
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2021) · arXiv · doi:10.48550/arxiv.2112.10752 · Cited by 737
Vector Quantized Diffusion Model for Text-to-Image Synthesis
Gu, S., Chen, D., Bao, J., Wen, F., Zhang, B., Chen, D., Yuan, L., & Guo, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01043 · Cited by 720
An Unsupervised Learning Model for Deformable Medical Image RegistrationPreprint
Balakrishnan, G., Zhao, A. T., Sabuncu, M. R., Guttag, J. V., & Dalca, A. V. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 691
ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models
Choi, J., Kim, S., Jeong, Y., Gwon, Y., & Yoon, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01410 · Cited by 634
Diffusion Probabilistic Models for 3D Point Cloud Generation
Luo, S., & Hu, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00286 · Cited by 628
An Unsupervised Learning Model for Deformable Medical Image Registration
Balakrishnan, G., Zhao, A., Sabuncu, M. R., Dalca, A. V., & Guttag, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00964 · Cited by 599
Tackling the Generative Learning Trilemma with Denoising Diffusion GANsPreprint
Xiao, Z., Kreis, K., & Vahdat, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.07804 · Cited by 598
Salimans, T., Karpathy, A., Chen, X., & Kingma, D. P. (2017) · arXiv · doi:10.48550/arxiv.1701.05517 · Cited by 584
DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation
Kim, G., Kwon, T., & Ye, J. C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00246 · Cited by 570
Reverse-time diffusion equation models
Anderson, B. D. O. (1982) · Stochastic Processes and their Applications · doi:10.1016/0304-4149(82)90051-5 · Cited by 565
Elucidating the Design Space of Diffusion-Based Generative Models
Karras, T., Aittala, M., Aila, T., & Laine, S. (2022) · neural information processing systems · doi:10.52202/068431-1926 · Cited by 538
Unsupervised Medical Image Translation With Adversarial Diffusion Models
Özbey, M., Dalmaz, O., Dar, S. U. H., Bedel, H. A., Özturk, Ş., Güngör, A., & Çukur, T. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3290149 · Cited by 517
Cascaded Diffusion Models for High Fidelity Image Generation
Ho, J., Saharia, C., Chan, W., Fleet, D. J., Norouzi, M., & Salimans, T. (2021) · arXiv · doi:10.48550/arxiv.2106.15282 · Cited by 514
Solving Inverse Problems in Medical Imaging with Score-Based Generative ModelsPreprint
Song, Y. S., Shen, L., Xing, L., & Ermon, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.08005 · Cited by 486
Improved Techniques for Training Score-Based Generative Models
Song, Y., & Ermon, S. (2020) · arXiv · doi:10.48550/arxiv.2006.09011 · Cited by 482
Restoring Vision in Adverse Weather Conditions With Patch-Based Denoising Diffusion Models
Özdenizci, O., & Legenstein, R. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3238179 · Cited by 469
DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps
Lu, C., Zhou, Y., Bao, F., Chen, J., Li, C., & Zhu, J. (2022) · neural information processing systems · doi:10.52202/068431-0418 · Cited by 464
AnoDDPM: Anomaly Detection with Denoising Diffusion Probabilistic Models using Simplex Noise
Wyatt, J., Leach, A., Schmon, S. M., & Willcocks, C. G. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00080 · Cited by 442
Object-Centric Auto-Encoders and Dummy Anomalies for Abnormal Event Detection in Video
Ionescu, R. T., Khan, F. S., Georgescu, M.-I., & Shao, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00803 · Cited by 425
Self-citation3D Shape Generation and Completion through Point-Voxel Diffusion
Zhou, L., Du, Y., & Wu, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00577 · Cited by 421
Score-based diffusion models for accelerated MRI
Chung, H., & Ye, J. C. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102479 · Cited by 421
Fast Sampling of Diffusion Models with Exponential IntegratorPreprint
Zhang, Q., & Chen, Y. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.13902 · Cited by 399
Improving language models by retrieving from trillions of tokens
Borgeaud, S., Mensch, A., Hoffmann, J., Cai, T., Rutherford, E., Millican, K., Driessche, G. V. D., Lespiau, J.-B., Damoc, B., Clark, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.04426 · Cited by 382
Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic ModelsPreprint
Bao, F., Li, C., Zhu, J. J., & Zhang, B. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.06503 · Cited by 379
Kingma, D. P., Salimans, T., Poole, B., & Ho, J. (2021) · arXiv · doi:10.48550/arxiv.2107.00630 · Cited by 374
Denoising Diffusion Restoration Models
Kawar, B., Elad, M., Ermon, S., & Song, J. (2022) · neural information processing systems · doi:10.52202/068431-1714 · Cited by 349
Avrahami, O., Fried, O., & Lischinski, D. (2023) · ACM Transactions on Graphics · doi:10.1145/3592450 · Cited by 345 · cited 1×
“[114] apply latent diffusion models to edit images locally, using text.”
MethodDiffusion-GAN: Training GANs with DiffusionPreprint
Wang, Z., Zheng, H., He, P., Chen, W., & Zhou, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.02262 · Cited by 344
Diffusion Autoencoders: Toward a Meaningful and Decodable Representation
Preechakul, K., Chatthee, N., Wizadwongsa, S., & Suwajanakorn, S. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01036 · Cited by 338
Diffusion Models for Medical Anomaly Detection
Wolleb, J., Bieder, F., Sandkühler, R., & Cattin, P. C. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-16452-1_4 · Cited by 322
EGSDE: Unpaired Image-To-Image Translation Via Energy-Guided Stochastic Differential Equations
Zhao, M., Bao, F., Li, C., & Zhu, J. (2022) · neural information processing systems · doi:10.52202/068431-0261 · Cited by 315
Sampling via Measure Transport: An Introduction
Marzouk, Y., Moselhy, T., Parno, M. D., & Spantini, A. (2016) · Springer eBooks · doi:10.1007/978-3-319-11259-6_23-1 · Cited by 303
Gotta Go Fast When Generating Data with Score-Based ModelsPreprint
Jolicoeur‐Martineau, A., Li, K., Piché-Taillefer, R., Kachman, T., & Mitliagkas, I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.14080 · Cited by 301
Amortised MAP Inference for Image Super-resolution
Sønderby, C. K., Caballero, J., Theis, L., Shi, W., & Huszár, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.04490 · Cited by 300
SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations
Meng, C., He, Y., Song, Y., Song, J., Wu, J., Zhu, J.-Y., & Ermon, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01073 · Cited by 297
Compositional Visual Generation with Composable Diffusion Models
Liu, N., Li, S., Du, Y., Torralba, A., & Tenenbaum, J. B. (2022) · arXiv · doi:10.48550/arxiv.2206.01714 · Cited by 295
Progressive Distillation for Fast Sampling of Diffusion Models
Salimans, T., & Ho, J. (2022) · arXiv · doi:10.48550/arxiv.2202.00512 · Cited by 287
UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic ModelsPreprint
Sasaki, H., Willcocks, C. G., & Breckon, T. P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.05358 · Cited by 287
Compositional Visual Generation with Composable Diffusion Models
Liu, N., Li, S., Du, Y., Torralba, A., & Tenenbaum, J. B. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19790-1_26 · Cited by 282
Chung, H., Sim, B., & Ye, J. C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01209 · Cited by 275
Pretraining is All You Need for Image-to-Image TranslationPreprint
Wang, T., Zhang, T., Zhang, B., Ouyang, H., Chen, D., Chen, Q., & Wen, F. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.12952 · Cited by 260
Text2Human: text-driven controllable human image generation
Jiang, Y., Yang, S., Qiu, H., Wu, W., Loy, C. C., & Liu, Z. (2022) · ACM Transactions on Graphics · doi:10.1145/3528223.3530104 · Cited by 259
More Control for Free! Image Synthesis with Semantic Diffusion Guidance
Liu, X., Park, D. H., Azadi, S., Zhang, G., Chopikyan, A., Hu, Y., Shi, H., Rohrbach, A., & Darrell, T. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00037 · Cited by 216
Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion Models
Pinaya, W. H. L., Graham, M. S., Gray, R., da Costa, P. F., Tudosiu, P.-D., Wright, P., Mah, Y., MacKinnon, A. D., Teo, J., Jäger, H. R., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16452-1_67 · Cited by 205
Ngiam, J., Chen, Z., Koh, P. W., & Ng, A. Y. (2011) · International Conference on Machine Learning · Cited by 204
Learning Fast Samplers for Diffusion Models by Differentiating Through Sample QualityPreprint
Watson, D., Chan, W., Ho, J., & Norouzi, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.05830 · Cited by 202
Stochastic Solutions for Linear Inverse Problems using the Prior Implicit in a Denoiser
Kadkhodaie, Z., & Simoncelli, E. P. (2021) · neural information processing systems · Cited by 199
Perception Prioritized Training of Diffusion Models
Choi, J., Lee, J., Shin, C., Kim, S., Kim, H., & Yoon, S. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01118 · Cited by 198
Flexible Diffusion Modeling of Long Videos
Harvey, W., Naderiparizi, S., Masrani, V., Weilbach, C., & Wood, F. (2022) · neural information processing systems · doi:10.52202/068431-2027 · Cited by 189
ImageBART: Bidirectional Context with Multinomial Diffusion for Autoregressive Image SynthesisPreprint
Esser, P., Rombach, R., Blattmann, A., & Ommer, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.08827 · Cited by 184
SegDiff: Image Segmentation with Diffusion Probabilistic Models
Amit, T., Shaharbany, T., Nachmani, E., & Wolf, L. (2021) · arXiv · doi:10.48550/arxiv.2112.00390 · Cited by 179
Scalable Gradients for Stochastic Differential EquationsPreprint
Li, X., Wong, T. L., Chen, R. T. Q., & Duvenaud, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.01328 · Cited by 175
A Variational Perspective on Diffusion-Based Generative Models and Score MatchingPreprint
Huang, C.-W., Lim, J. H., & Courville, A. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02808 · Cited by 172
Learning to Efficiently Sample from Diffusion Probabilistic ModelsPreprint
Watson, D., Ho, J., Norouzi, M., & Chan, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03802 · Cited by 170
Diffusion Probabilistic Modeling for Video Generation
Yang, R., Srivastava, P., & Mandt, S. (2023) · Entropy · doi:10.3390/e25101469 · Cited by 161
Diffusion Models for Video Prediction and InfillingPreprint
Höppe, T., Mehrjou, A., Bauer, S., Nielsen, D., & Dittadi, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.07696 · Cited by 158
Accelerating Diffusion Models via Early Stop of the Diffusion ProcessPreprint
Lyu, Z., Xudong, X. U., Yang, C., Lin, D., & Dai, B. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.12524 · Cited by 154
Sliced Score Matching: A Scalable Approach to Density and Score EstimationPreprint
Song, Y. S., Garg, S., Shi, J., & Ermon, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.07088 · Cited by 152
D2C: Diffusion-Decoding Models for Few-Shot Conditional Generation
Sinha, A., Song, J., Meng, C., & Ermon, S. (2021) · neural information processing systems · Cited by 131
On Autoencoders and Score Matching for Energy Based Models
Swersky, K., Ranzato, M., Buchman, D., de Freitas, N., & Marlin, B. M. (2011) · International Conference on Machine Learning · Cited by 109
What is Healthy? Generative Counterfactual Diffusion for Lesion Localization
Sanchez, P., Kascenas, A., Liu, X., O’Neil, A. Q., & Tsaftaris, S. A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-18576-2_4 · Cited by 102
Subspace Diffusion Generative Models
Jing, B., Corso, G., Berlinghieri, R., & Jaakkola, T. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20050-2_17 · Cited by 95
Bond-Taylor, S., Hessey, P., Sasaki, H., Breckon, T. P., & Willcocks, C. G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20050-2_11 · Cited by 94
Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion ModelsPreprint
Rombach, R., Blattmann, A., & Ommer, B. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.13038 · Cited by 93
Adversarial score matching and improved sampling for image generation
Jolicoeur-Martineau, A., Piché-Taillefer, R., Combes, R. T. D., & Mitliagkas, I. (2020) · arXiv · doi:10.48550/arxiv.2009.05475 · Cited by 88
On the Theory of Stochastic Processes, with Particular Reference to Applications
Feller, W. (2015) · Springer eBooks · doi:10.1007/978-3-319-16859-3_42 · Cited by 87
Few-Shot Diffusion ModelsPreprint
Giannone, G., Nielsen, D., & Winther, O. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.15463 · Cited by 82
Semantic Image Synthesis via Diffusion ModelsPreprint
Zhou, W., Wang, W., Bao, J., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.00050 · Cited by 82
On Fast Sampling of Diffusion Probabilistic Models
Kong, Z., & Ping, W. (2021) · arXiv · doi:10.48550/arxiv.2106.00132 · Cited by 79
Unsupervised denoising of retinal OCT with diffusion probabilistic model
Hu, D., Tao, Y. K. K., & Oğuz, İ. (2022) · SPIE Medical Imaging: Image Processing · doi:10.1117/12.2612235 · Cited by 78
Non Gaussian Denoising Diffusion ModelsPreprint
Nachmani, E., Roman, R. S., & Wolf, L. (2021) · arXiv.org · doi:10.48550/arxiv.2106.07582 · Cited by 75
Diffusion Causal Models for Counterfactual EstimationPreprint
Sanchez, P. L., & Tsaftaris, S. A. (2022) · Edinburgh Research Explorer (University of Edinburgh) · doi:10.48550/arxiv.2202.10166 · Cited by 68
Diffusion Models as Plug-And-Play Priors
Graikos, A., Malkin, N., Jojić, N., & Samaras, D. (2022) · neural information processing systems · doi:10.52202/068431-1070 · Cited by 66
Diffusion Models for Counterfactual Explanations
Jeanneret, G., Simon, L., & Jurie, F. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26293-7_14 · Cited by 56
Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generation
Hu, M., Wang, Y., Cham, T., Yang, J., & Suganthan, P. N. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01121 · Cited by 54
High Fidelity Visualization of What Your Self-Supervised Representation Knows AboutPreprint
Bordes, F., Balestriero, R., & Vincent, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.09164 · Cited by 53
Denoising Likelihood Score Matching for Conditional Score-based Data GenerationPreprint
Chao, C.-H., Sun, W., Cheng, B.-W., Lo, Y.-C., Chang, C.-C., Liu, Y.-L., Chang, Y.-L., Chen, C.-P., & Lee, C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.14206 · Cited by 52
The Swiss Army Knife for Image-to-Image Translation: Multi-Task Diffusion ModelsPreprint
Wolleb, J., Sandkühler, R., Bieder, F., & Cattin, P. C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.02641 · Cited by 50
Dynamic Dual-Output Diffusion Models
Benny, Y., & Wolf, L. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01119 · Cited by 47
Bilateral Denoising Diffusion ModelsPreprint
Lam, M. W. Y., Wang, J., Huang, R., Su, D., & Yu, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.11514 · Cited by 45
Noise Estimation for Generative Diffusion Models
San-Roman, R., Nachmani, E., & Wolf, L. (2021) · arXiv · doi:10.48550/arxiv.2104.02600 · Cited by 44
Generating High Fidelity Data from Low-density Regions using Diffusion Models
Sehwag, V., Hazirbas, C., Gordo, A., Ozgenel, F., & Ferrer, C. C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01120 · Cited by 41
DiVAE: Photorealistic Images Synthesis with Denoising Diffusion DecoderPreprint
Shi, J., Wu, C., Liang, J., Liu, X., & Duan, N. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.00386 · Cited by 37
Heavy-tailed denoising score matchingPreprint
Deasy, J., Simidjievski, N., & Lió, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.09788 · Cited by 28
Self-fusion for OCT noise reduction
Oğuz, İ., Malone, J. D., Atay, Y., & Tao, Y. K. K. (2020) · SPIE Medical Imaging: Image Processing · doi:10.1117/12.2549472 · Cited by 17
Non-saturating GAN training as divergence minimizationPreprint
Shannon, M., Poole, B., Mariooryad, S., Bagby, T., Battenberg, E., Kao, D., Stanton, D., & Skerry-Ryan, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.08029 · Cited by 12
Accelerating Score-based Generative Models for High-Resolution Image SynthesisPreprint
Ma, H., Zhang, L., Zhu, X., Zhang, J., & Feng, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.04029 · Cited by 12
Discriminability-enforcing loss to improve representation learning
Croitoru, F.-A., Grigore, D.-N., & Ionescu, R. T. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00292 · Cited by 1
Self-citationDiffusion Models for Implicit Image Segmentation Ensembles
Wolleb, J., Sandkühler, R., Bieder, F., Valmaggia, P., & Cattin, P. C. (2021) · arXiv · doi:10.48550/arxiv.2112.03145
Cited by
Diffusion models in medical imaging: A comprehensive survey
Kazerouni, A., Aghdam, E. K., Heidari, M., Azad, R., Fayyaz, M., Hacihaliloglu, I., & Merhof, D. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102846 · Cited by 765
Longo, L., Brcic, M., Cabitza, F., Choi, J., Confalonieri, R., Ser, J. D., Guidotti, R., Hayashi, Y., Herrera, F., Holzinger, A., et al. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102301 · Cited by 626
A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multi-Modal
Liang, K., Meng, L., Liu, M., Liu, Y., Tu, W., Wang, S., Zhou, S., Liu, X., Sun, F., & He, K. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3417451 · Cited by 553
A Survey on Generative Diffusion Models
Cao, H., Tan, C., Gao, Z., Xu, Y., Chen, G., Heng, P.-A., & Li, S. Z. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3361474 · Cited by 538
Unleashing the Power of Edge-Cloud Generative AI in Mobile Networks: A Survey of AIGC Services
Xu, M., Du, H., Niyato, D., Kang, J., Xiong, Z., Mao, S., Han, Z., Jamalipour, A., Kim, D. I., Shen, X., et al. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3353265 · Cited by 449
Metadata
- Authors
- Croitoru, F.-A., Hondru, V., Ionescu, R. T., & Shah, M.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2023-09-01
- Volume
- 45
- Issue
- 9
- Pages
- 10850-10869
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W4360884927
- Cited by
- 1,859
- References
- 133
- FWCI
- 168.93
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.