PreprintCited by 3,985Generative Adversarial Networks and Image SynthesisAdversarial Robustness in Machine LearningImage and Signal Denoising Methods

The DOI matches its DataCite record; 75 of the 75 references it cites were found in a registry or an index; 65 of the 82 sources its claims cite were checked for support.

Diffusion Models Beat GANs on Image Synthesis

Open access

Abstract

We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models. We achieve this on unconditional image synthesis by finding a better architecture through a series of ablations. For conditional image synthesis, we further improve sample quality with classifier guidance: a simple, compute-efficient method for trading off diversity for fidelity using gradients from a classifier. We achieve an FID of 2.97 on ImageNet 128$\times$128, 4.59 on ImageNet 256$\times$256, and 7.72 on ImageNet 512$\times$512, and we match BigGAN-deep even with as few as 25 forward passes per sample, all while maintaining better coverage of the distribution. Finally, we find that classifier guidance combines well with upsampling diffusion models, further improving FID to 3.94 on ImageNet 256$\times$256 and 3.85 on ImageNet 512$\times$512. We release our code at https://github.com/openai/guided-diffusion

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

Diffusion models with improved UNet architectures and classifier guidance surpass state-of-the-art GANs on class-conditional ImageNet synthesis, achieving FID 2.97 at 128×128, 4.59 at 256×256, and 7.72 at 512×512. Combining guidance with upsampling further improves FID to 3.94 at 256×256 and 3.85 at 512×512.

Key findings

  • Improved architecture alone gives state-of-the-art unconditional results: LSUN bedrooms FID 1.90, horses 2.57, cats 5.57; ImageNet 64×64 ADM (dropout) FID 2.07.
  • Classifier guidance improves conditional ImageNet: ADM-G FID 2.97 at 128×128, 4.59 at 256×256, and 7.72 at 512×512; with 25 DDIM steps, FID is 5.98, 5.44, and 8.41 respectively, comparable to BigGAN-deep.
  • Guidance trades diversity for fidelity: increasing gradient scale improves precision/IS but lowers recall. For example, a conditional ImageNet 256×256 model with guidance scale 1.0 has FID 4.59, precision 0.82, recall 0.52; scale 10.0 has FID 9.11, precision 0.88, recall 0.32.
  • Combining guidance with upsampling gives the best FIDs: ADM-G + ADM-U reaches FID 3.94 on ImageNet 256×256 and 3.85 on ImageNet 512×512.

Methods

  • Architecture ablations were run on ImageNet 128×128 with batch size 256 and 250 sampling steps, testing depth vs. width, attention heads/resolutions, BigGAN up/downsampling, residual rescaling, and AdaGN. The final default uses variable width, 2 residual blocks per resolution, 64 channels per head, attention at 32/16/8, BigGAN residual blocks, and AdaGN.
  • Classifier guidance trains a classifier \(p_\phi(y|x_t,t)\) on noisy images and uses gradients \(\nabla_{x_t}\log p_\phi(y|x_t,t)\) to guide diffusion sampling, with a gradient scale \(s\) for stochastic and DDIM samplers. Models are trained on ImageNet 128×128, 256×256, and 512×512, and on LSUN bedroom, horse, and cat.
  • Evaluation uses FID, sFID, Inception Score, and Improved Precision/Recall; comparisons re-compute metrics using public samples or models where possible and use the entire training set as the reference batch.

Limitations

  • Stated: diffusion models are still slower than GANs at sampling time because they use multiple denoising steps/forward passes.
  • Stated: classifier guidance is limited to labeled datasets, and the paper provides no effective strategy for trading off diversity for fidelity on unlabeled datasets.
  • Evident from the text: compute requirements are high, e.g., ImageNet 256×256 ADM-G (1980K) uses 916 generator V100-days plus 46 classifier V100-days (962 total), and ImageNet 512×512 best uses 1878 + 36 = 1914 V100-days; guidance also trades recall for precision, so best FID occurs at an intermediate scale.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2105.05233

Cites

75 of 75 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 3 : Figure 3: Samples from an unconditional diffusion model with classifier guidance to condition on the class "Pembroke Welsh corgi". Using classifier scale 1.0 (left; FID: 33.0) does not produce convincing samples in this class, whereas classifier scale 10.0 (right; FID: 12.0) produces much more class-consistent images.
Figure 3 : Figure 3: Samples from an unconditional diffusion model with classifier guidance to condition on the class "Pembroke Welsh corgi". Using classifier scale 1.0 (left; FID: 33.0) does not produce convincing samples in this class, whereas classifier scale 10.0 (right; FID: 12.0) produces much more class-consistent images.From the PDF
Figure 6 : Figure 6: Samples from BigGAN-deep with truncation 1.0 (FID 6.95, left) vs samples from our diffusion model with guidance (FID 4.59, middle) and samples from the training set (right).
Figure 6 : Figure 6: Samples from BigGAN-deep with truncation 1.0 (FID 6.95, left) vs samples from our diffusion model with guidance (FID 4.59, middle) and samples from the training set (right).From the PDF
Figure 7 : Figure 7: Nearest neighbors for samples from a classifier guided model on ImageNet 256×256. For each image, the top row is a sample, and the remaining rows are the top 3 nearest neighbors from the dataset. The top samples were generated with classifier scale 1 and 250 diffusion sampling steps (FID 4.59). The bottom samples were generated with classifier scale 2.5 and 25 DDIM steps (FID 5.44).
Figure 7 : Figure 7: Nearest neighbors for samples from a classifier guided model on ImageNet 256×256. For each image, the top row is a sample, and the remaining rows are the top 3 nearest neighbors from the dataset. The top samples were generated with classifier scale 1 and 250 diffusion sampling steps (FID 4.59). The bottom samples were generated with classifier scale 2.5 and 25 DDIM steps (FID 5.44).From the PDF
Figure 10a : Figure 10a: DDIM latent reconstructions and interpolations on real images with no classifier guidance.
Figure 10a : Figure 10a: DDIM latent reconstructions and interpolations on real images with no classifier guidance.From the PDF
Figure 10b : Figure 10b: DDIM latent reconstructions and interpolations on real images with classifier scale 1.0.
Figure 10b : Figure 10b: DDIM latent reconstructions and interpolations on real images with classifier scale 1.0.From the PDF
Figure 10c : Figure 10c: DDIM latent reconstructions and interpolations on real images with classifier scale 2.5.
Figure 10c : Figure 10c: DDIM latent reconstructions and interpolations on real images with classifier scale 2.5.From the PDF
Figure 11 : Figure 11: The effect of changing temperature for an ImageNet 128×128 model.
Figure 11 : Figure 11: The effect of changing temperature for an ImageNet 128×128 model.From the PDF
Figure 12 : Figure 12: Samples at temperature 0.98 with epsilon scaling (left) and noise scaling (right).
Figure 12 : Figure 12: Samples at temperature 0.98 with epsilon scaling (left) and noise scaling (right).From the PDF
Figure 13 : Figure13: Samples from our best 512×512 model (FID: 3.85). Classes are 1: goldfish, 279: arctic fox, 323: monarch butterfly, 386: african elephant, 130: flamingo, 852: tennis ball.
Figure 13 : Figure13: Samples from our best 512×512 model (FID: 3.85). Classes are 1: goldfish, 279: arctic fox, 323: monarch butterfly, 386: african elephant, 130: flamingo, 852: tennis ball.From the PDF
Figure 14 : Figure 14: Samples from our best 512×512 model (FID: 3.85). Classes are 933: cheeseburger, 562: fountain, 417: balloon, 281: tabby cat, 90: lorikeet, 992: agaric.
Figure 14 : Figure 14: Samples from our best 512×512 model (FID: 3.85). Classes are 933: cheeseburger, 562: fountain, 417: balloon, 281: tabby cat, 90: lorikeet, 992: agaric.From the PDF
Figure 15 : Figure 15: Difficult class samples from our best 512×512 model (FID: 3.85). Classes are 432: bassoon, 468: cab, 424: barbershop, 444: bicycle-built-for-two, 981: ballplayer, 550: espresso maker.
Figure 15 : Figure 15: Difficult class samples from our best 512×512 model (FID: 3.85). Classes are 432: bassoon, 468: cab, 424: barbershop, 444: bicycle-built-for-two, 981: ballplayer, 550: espresso maker.From the PDF
Figure 16 : Figure16: Samples from our guided 512×512 model using 250 steps with classifier scale 4.0 (FID 7.72). Classes are 1: goldfish, 279: arctic fox, 323: monarch butterfly, 386: african elephant, 130: flamingo, 852: tennis ball.
Figure 16 : Figure16: Samples from our guided 512×512 model using 250 steps with classifier scale 4.0 (FID 7.72). Classes are 1: goldfish, 279: arctic fox, 323: monarch butterfly, 386: african elephant, 130: flamingo, 852: tennis ball.From the PDF
Figure 17 : Figure 17: Samples from our guided 512×512 model using 250 steps with classifier scale 4.0 (FID 7.72). Classes are 933: cheeseburger, 562: fountain, 417: balloon, 281: tabby cat, 90: lorikeet, 992: agaric.
Figure 17 : Figure 17: Samples from our guided 512×512 model using 250 steps with classifier scale 4.0 (FID 7.72). Classes are 933: cheeseburger, 562: fountain, 417: balloon, 281: tabby cat, 90: lorikeet, 992: agaric.From the PDF
Figure 18 : Figure 18: Random samples from our best ImageNet 512×512 model (FID 3.85).
Figure 18 : Figure 18: Random samples from our best ImageNet 512×512 model (FID 3.85).From the PDF
Figure 19 : Figure 19: Random samples from our guided 512×512 model using 250 steps with classifier scale 4.0 (FID 7.72).
Figure 19 : Figure 19: Random samples from our guided 512×512 model using 250 steps with classifier scale 4.0 (FID 7.72).From the PDF
Figure 20 : Figure20: Samples using our best 256×256 model (FID 3.94). Classes are 1: goldfish, 279: arctic fox, 323: monarch butterfly, 386: african elephant, 130: flamingo, 852: tennis ball, 933: cheeseburger, 562: fountain, 417: balloon, 281: tabby cat, 90: lorikeet, 992: agaric
Figure 20 : Figure20: Samples using our best 256×256 model (FID 3.94). Classes are 1: goldfish, 279: arctic fox, 323: monarch butterfly, 386: african elephant, 130: flamingo, 852: tennis ball, 933: cheeseburger, 562: fountain, 417: balloon, 281: tabby cat, 90: lorikeet, 992: agaricFrom the PDF
Figure 21 :Figure 22 :Figure 23 : Figure 21: Samples from our guided 256×256 model using 250 steps with classifier scale 1.0 (FID 4.59). Classes are 1: goldfish, 279: arctic fox, 323: monarch butterfly, 386: african elephant, 130: flamingo, 852: tennis ball, 933: cheeseburger, 562: fountain, 417: balloon, 281: tabby cat, 90: lorikeet, 992: agaric
Figure 21 :Figure 22 :Figure 23 : Figure 21: Samples from our guided 256×256 model using 250 steps with classifier scale 1.0 (FID 4.59). Classes are 1: goldfish, 279: arctic fox, 323: monarch butterfly, 386: african elephant, 130: flamingo, 852: tennis ball, 933: cheeseburger, 562: fountain, 417: balloon, 281: tabby cat, 90: lorikeet, 992: agaricFrom the PDF
Figure 24 : Figure 24: Random samples from our guided 256×256 model using 250 steps with classifier scale 1.0 (FID 4.59).
Figure 24 : Figure 24: Random samples from our guided 256×256 model using 250 steps with classifier scale 1.0 (FID 4.59).From the PDF
Figure 27 : Figure 27: Random samples from our LSUN cat model using 1000 sampling steps. (FID 5.57)
Figure 27 : Figure 27: Random samples from our LSUN cat model using 1000 sampling steps. (FID 5.57)From the PDF
Image 20
From the PDF
Image 21
From the PDF
Image 22
From the PDF
Image 23
From the PDF

Verification

Claims the paper makes

66 Own result · 23 Supported · 19 Own interpretation · 18 Partly supported · 8 Not checked yet · 8 No basis given · 2 Supported so far · 2 Mixed support · 2 Own method · 1 Couldn’t confirm · 1 Sources not found · 1 No full text of the sources · accuracy not yet measured

Verify all 15 references — free account

Show all 82 claims

  • Probably not a substantial claim. 42
  • It may state two separate claims as one. 34
  • The quote only partly states this claim. 1
69 of 69
  • The authors state this as an assumption.

    The noise ε is drawn from a diagonal Gaussian distribution.

    “For the remainder of this paper, we assume that the noise ε is drawn from a diagonal Gaussian distribution”
  • The authors state this as an assumption.

    logφ p(y|xt) has low curvature compared to Σ−1.

    “We can assume that logφ p(y|xt) has low curvature compared to Σ−1.”
  • The authors state this as an assumption.

    The underlying diffusion model is unconditional in the above derivations.

    “In the above derivations, we assumed that the underlying diffusion model was unconditional, modeling p(x).”
  • The paper relies on this without support.

    More compute typically yields better results.

    “Compute is essential to modern machine learning applications, and more compute typically yields better results.”
  • The authors state this as an assumption.

    The label distribution q̂(y|x0) is known and readily available for each sample.

    “we start by defining a conditional Markovian noising process q̂ similar to q, and assume that q̂(y|x0) is a known and readily available label distribution for each sample.”
  • The paper relies on this without support.

    Under reasonable settings for βt and T, the distribution q(xT) is nearly an isotropic Gaussian distribution.

    “Under reasonable settings for βt and T , the distribution q(xT ) is nearly an isotropic Gaussian distribution, so sampling xT is trivial.”
6 of 6

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Part of this paper’s reference list could not be split into single entries.

Show all 60 references

Research works printed but not linked: 1

  1. [12][12] DeepMind. Biggan-deep 128x128 on tensorflow hub. https://tfhub.dev/deepmind/ biggan-deep-128/1, 2018. 13 https://twitter.com/advadnoun/status/1351038053033406468 https://twitter.com/advadnoun/status/1351038053033406468 https://arxiv.org/abs/1801.01973 https://arxiv.org/abs/1609.07093 https://arxiv.org/abs/1809.11096 https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2009.00713 https://arxiv.org/abs/2011.10650 https://arxiv.org/abs/1707.00683 https://tfhub.dev/deepmind/biggan-deep-128/1 https://tfhub.dev/deepmind/biggan-deep-128/1 · arXiv

Cited by

Sorted by citations

Items 2,501–2,600 of 3,985

Metadata

Authors
Dhariwal, P., & Nichol, A.
Affiliations
OpenAI (United States) (US)
Venue
arXiv
Publisher
arXiv
Published
2021
ISSN
2331-8422 (ISSN-L)
OpenAlex
W3162926177
Cited by
3,362
References
60
Citations by year
2026: 43 · 2025: 923 · 2024: 1508 · 2023: 770 · 2022: 79 · 2021: 39
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
Keywords
diffusion models, image generation, unconditional image generation, conditional image generation, classifier guidance, sample quality, ImageNet

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-08, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-08 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review