Cited by 887Generative Adversarial Networks and Image SynthesisComputer Graphics and Visualization TechniquesAdvanced Neural Network Applications

Photographic Image Synthesis with Cascaded Refinement Networks

Open access
Chen, Qifeng, Koltun, Vladlen·2017·2017 IEEE International Conference on Computer Vision (ICCV)

Abstract

We present an approach to synthesizing photographic images conditioned on semantic layouts. Given a semantic label map, our approach produces an image with photographic appearance that conforms to the input layout. The approach thus functions as a rendering engine that takes a two-dimensional semantic specification of the scene and produces a corresponding photographic image. Unlike recent and contemporaneous work, our approach does not rely on adversarial training. We show that photographic images can be synthesized from semantic layouts by a single feedforward network with appropriate structure, trained end-to-end with a direct regression objective. The presented approach scales seamlessly to high resolutions; we demonstrate this by synthesizing photographic images at 2-megapixel resolution, the full resolution of our training data. Extensive perceptual experiments on datasets of outdoor and indoor scenes demonstrate that images synthesized by the presented approach are considerably more realistic than alternative approaches.

Integrity signals

Registry

Crossref · 10.1109/iccv.2017.168

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • This opens interesting research opportunities for the adaptation of lab-generated simulation to real-world conditions, similar to what has been observed in image synthesis for self driving and robotics.

    “This opens interesting research opportunities for the adaptation of lab-generated simulation to real-world conditions, similar to what has been observed in the field of image synthesis for self driving143 and robotics144 in the last decade.”

    From Perspectives in machine learning for wildlife conservation (2022) · cites this paper as [143]

Cites

Flagged first, then by citations

6 of the 62 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Chen, Q., & Koltun, V.
Affiliations
Intel (United States) (US)
Venue
2017 IEEE International Conference on Computer Vision (ICCV)
Publisher
IEEE
Published
2017-10
Pages
1520-1529
OpenAlex
W2963522749
Cited by
887
References
62
Citations by year
2026: 13 · 2025: 40 · 2024: 51 · 2023: 88 · 2022: 117 · 2021: 170 · 2020: 145 · 2019: 156 · 2018: 94 · 2017: 12
FWCI
32.53
Type
conference paper
Language
en
Open access
Locations
  • IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
semantic segmentation, feedforward neural networks, high-resolution image generation, realistic image synthesis, outdoor scenes, indoor scenes

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review