CoChat

High-quality video view interpolation using a layered representation

The DOI matches its Crossref record; 27 of the 30 references it cites were found in a registry or an index.

Abstract

The ability to interactively control viewpoint while watching a video is an exciting application of image-based rendering. The goal of our work is to render dynamic scenes with interactive viewpoint control using a relatively small number of video cameras. In this paper, we show how high-quality video-based rendering of dynamic scenes can be accomplished using multiple synchronized video streams combined with novel image-based modeling and rendering algorithms. Once these video streams have been processed, we can synthesize any intermediate view between cameras at any time, with the potential for space-time manipulation.In our approach, we first use a novel color segmentation-based stereo algorithm to generate high-quality photoconsistent correspondences across all camera views. Mattes for areas near depth discontinuities are then automatically extracted to reduce artifacts during view synthesis. Finally, a novel temporal two-layer compressed representation that handles matting is developed for rendering at interactive rates.

Overview

Integrity signals

Registry

Crossref · 10.1145/1186562.1015766

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

  • A flexible new technique for camera calibration

    Zhang, Z. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.888718 · Cited by 15,004 · cited 1×

    “The calibration technique of Zhang [2000] is used to recover all the camera parameters necessary for Euclidean stereo recovery.”
    Method
  • Scale-space and edge detection using anisotropic diffusion

    Perona, P., & Malik, J. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.56205 · Cited by 12,119

  • A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms

    Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740 · cited 1×

    “Within the past 20 years, many stereo algorithms have been proposed for static scenes [ Scharstein and Szeliski 2002 ].,The DSD is the set of probabilities over all disparities for segment sij in image Ii. It is a variant of the classic disparity space image (DSI), which associates a cost or likelihood at every dispar…”
    Self-citation
  • Light field rendering

    Levoy, M., & Hanrahan, P. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237199 · Cited by 3,755 · cited 3×

    “Most of the past work on image-based rendering (IBR) involves rendering static scenes, with two of the best-known techniques being Light Field Rendering [Levoy and Hanrahan 1996] and the Lumigraph [Gortler et al.”
    Method
  • The lumigraph

    Gortler, S. J., Grzeszczuk, R., Szeliski, R., & Cohen, M. F. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237200 · Cited by 2,458 · cited 3×

    “Most of the past work on image-based rendering (IBR) involves rendering static scenes, with two of the best-known techniques being Light Field Rendering [Levoy and Hanrahan 1996] and the Lumi-graph [Gortler et al. 1996].”
    BackgroundMethodSelf-citation
  • Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach

    Debevec, P. E., Taylor, C. J., & Malik, J. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237191 · Cited by 1,905 · cited 4×

    “Another possibility is to use per-pixel depth, as in Layered Depth Images [Shade et al. 1998], the offset depth maps in Fac¸ade [Debevec et al. 1996], or sprites with depth [Bakeretal.1998;Shadeetal.1998].”
    BackgroundMethodInfluential
  • Layered depth images

    Shade, J., Gortler, S., He, L.-W., & Szeliski, R. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280882 · Cited by 1,115 · cited 2×

    “We address these problems using a novel two-layer representation inspired by Layered Depth Images and sprites with depth [Shade et al. 1998].”
    MethodSelf-citation
  • Image-based visual hulls

    Matusik, W., Buehler, C., Raskar, R., Gortler, S. J., & McMillan, L. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344951 · Cited by 890 · cited 1×

    “Matusik et al. [2000] use the images from four calibrated FireWire cameras ( 256 × 256 ) to compute and shade visual hulls.”
    Method
  • Unstructured lumigraph rendering

    Buehler, C., Bosse, M., McMillan, L., Gortler, S., & Cohen, M. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383309 · Cited by 881 · cited 2×

    “While this would not be a trivial extension, we believe that the Unstructured Lumigraph [Buehler et al. 2001] provides the right framework for accomplishing this.”
    Background
  • Virtualized reality: constructing virtual worlds from real scenes

    Kanade, T., Rander, P., & Narayanan, P. J. (1997) · IEEE Multimedia · doi:10.1109/93.580394 · Cited by 624 · cited 3×

    “One of the earliest attempts at capturing and rendering dynamic scenes was Kanade et al.’s Virtualized RealityTM system [1997], which involved 51 cameras arranged around a 5-meter geodesic dome.”
    BackgroundInfluential

Show all 27 references

Research works printed but not linked: 13

  1. 10.5555/794191.794727 · doi:10.5555/794191.794727
  2. Chang, C.-L., et al. 2003. Inter-view wavelet compression of light fields with disparity-compensated lifting. In Visual Communication and Image Processing (VCIP 2003), 14--22.
  3. 10.5555/946247.946764 · doi:10.5555/946247.946764
  4. 10.5555/648284.755760 · doi:10.5555/648284.755760
  5. 10.5555/647651.732115 · doi:10.5555/647651.732115
  6. 10.5555/794189.794361 · doi:10.5555/794189.794361
  7. 10.5555/1965841.1965933 · doi:10.5555/1965841.1965933
  8. Vedula, S., Baker, S., Seitz, S., and Kanade, T. 2000. Shape and motion carving in 6D. In Conference on Computer Vision and Pattern Recognition (CVPR), vol. II, 592--598.
  9. Wang, J. Y. A., and Adelson, E. H. 1993. Layered representation for motion analysis. In Conference on Computer Vision and Pattern Recognition (CVPR), 361--366.
  10. 10.5555/645317.649317 · doi:10.5555/645317.649317
  11. 10.5555/581896.581907 · doi:10.5555/581896.581907
  12. 10.5555/826030.826631 · doi:10.5555/826030.826631
  13. Zhang, Y., and Kambhamettu, C. 2001. On 3D scene flow and structure estimation. In Conference on Computer Vision and Pattern Recognition (CVPR), vol. II, 778--785.

Cited by

See all 368

Metadata

Authors
Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R.
Affiliations
Microsoft (United States) (US)
Venue
ACM SIGGRAPH 2004 Papers
Publisher
ACM
Published
2004-08
Pages
600-608
OpenAlex
W4249522571
Cited by
367
References
30
Citations by year
2025: 1 · 2024: 3 · 2023: 2 · 2022: 5 · 2021: 12 · 2020: 10 · 2019: 12 · 2018: 12 · 2017: 15 · 2016: 12 · 2015: 17 · 2014: 22 · 2013: 24 · 2012: 28
FWCI
14.19
Type
conference paper
Language
en
Open access
closed
Locations
ACM SIGGRAPH Conference (SIGGRAPH) (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
  • Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
Keywords
image-based rendering, image-based modeling, depth discontinuities, matting, dynamic scene rendering

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: High-quality video view interpolation using a layered representation. https://app.cochat.ai/papers/10.1145/1186562.1015766
The paper
Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2004). High-quality video view interpolation using a layered representation. ACM SIGGRAPH 2004 Papers. https://doi.org/10.1145/1186562.1015766

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.