Cited by 2,284Generative Adversarial Networks and Image SynthesisAdvanced Neural Network ApplicationsImage and Signal Denoising Methods

Scalable Diffusion Models with Transformers

Open access
Peebles, William, Xie, Saining·2023·2023 IEEE/CVF International Conference on Computer Vision (ICCV)

Abstract

We explore a new class of diffusion models based on the transformer architecture. We train latent diffusion models of images, replacing the commonly-used U-Net backbone with a transformer that operates on latent patches. We analyze the scalability of our Diffusion Transformers (DiTs) through the lens of forward pass complexity as measured by Gflops. We find that DiTs with higher Gflops—through increased transformer depth/width or increased number of input tokens—consistently have lower FID. In addition to possessing good scalability properties, our largest DiT-XL/2 models outperform all prior diffusion models on the class-conditional ImageNet 512×512 and 256×256 benchmarks, achieving a state-of-the-art FID of 2.27 on the latter.

Integrity signals

Registry

Crossref · 10.1109/iccv51070.2023.00387

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • MoCha is built on a diffusion transformer and effectively captures both semantics and temporal dynamics by incorporating text and speech conditions sequentially via cross-attention.

    “Unlike prior works that employ text-to-image (T2I) U-Net [10, 33, 35, 40] for talking head generation, MoCha is built on a diffusion transformer (DiT) [26]. By incorporating text and speech conditions sequentially via cross-attention, it effectively captures both semantics and temporal dynamics.”

    From MoCha: Towards Movie-Grade Talking Character Synthesis (2025) · cites this paper as [26]

  • Supervised learning uses labeled datasets to guide models towards accurate predictions and has been integral to applications including image recognition and NLP.

    “Supervised learning, a foundational approach in AI, uses labeled datasets to guide models towards accurate predictions, and it has been integral to various applications, including image recognition and NLP [163], [164], [165].”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Peebles, W., & Xie, S.
Affiliations
  • University of California, Berkeley (US)
  • New York University (US)
Venue
2023 IEEE/CVF International Conference on Computer Vision (ICCV)
Publisher
IEEE
Published
2023-10-01
Pages
4172-4182
OpenAlex
W4390872297
Cited by
2,284
References
59
Citations by year
2026: 1007 · 2025: 925 · 2024: 315 · 2023: 37
FWCI
244.26
Type
conference paper
Language
en
Open access
Locations
  • IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image and Signal Denoising Methods
Keywords
diffusion models, latent diffusion models, diffusion transformer, scalability, image generation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review