High-quality video view interpolation using a layered representation
The DOI matches its Crossref record; 27 of the 30 references it cites were found in a registry or an index.
Abstract
The ability to interactively control viewpoint while watching a video is an exciting application of image-based rendering. The goal of our work is to render dynamic scenes with interactive viewpoint control using a relatively small number of video cameras. In this paper, we show how high-quality video-based rendering of dynamic scenes can be accomplished using multiple synchronized video streams combined with novel image-based modeling and rendering algorithms. Once these video streams have been processed, we can synthesize any intermediate view between cameras at any time, with the potential for space-time manipulation.In our approach, we first use a novel color segmentation-based stereo algorithm to generate high-quality photoconsistent correspondences across all camera views. Mattes for areas near depth discontinuities are then automatically extracted to reduce artifacts during view synthesis. Finally, a novel temporal two-layer compressed representation that handles matting is developed for rendering at interactive rates.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Our algorithm is closely related to previous algorithms for depth-based frame interpolation (Shade et al. 1998; Zitnick et al. 2004):”
From A Database and Evaluation Methodology for Optical Flow (2011) · cites this paper as Zitnick et al. 2004
Citations
Cites
A flexible new technique for camera calibration
Zhang, Z. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.888718 · Cited by 15,004 · cited 1×
“The calibration technique of Zhang [2000] is used to recover all the camera parameters necessary for Euclidean stereo recovery.”
MethodScale-space and edge detection using anisotropic diffusion
Perona, P., & Malik, J. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.56205 · Cited by 12,119
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740 · cited 1×
“Within the past 20 years, many stereo algorithms have been proposed for static scenes [ Scharstein and Szeliski 2002 ].,The DSD is the set of probabilities over all disparities for segment sij in image Ii. It is a variant of the classic disparity space image (DSI), which associates a cost or likelihood at every dispar…”
Self-citationLevoy, M., & Hanrahan, P. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237199 · Cited by 3,755 · cited 3×
“Most of the past work on image-based rendering (IBR) involves rendering static scenes, with two of the best-known techniques being Light Field Rendering [Levoy and Hanrahan 1996] and the Lumigraph [Gortler et al.”
MethodGortler, S. J., Grzeszczuk, R., Szeliski, R., & Cohen, M. F. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237200 · Cited by 2,458 · cited 3×
“Most of the past work on image-based rendering (IBR) involves rendering static scenes, with two of the best-known techniques being Light Field Rendering [Levoy and Hanrahan 1996] and the Lumi-graph [Gortler et al. 1996].”
BackgroundMethodSelf-citationModeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
Debevec, P. E., Taylor, C. J., & Malik, J. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237191 · Cited by 1,905 · cited 4×
“Another possibility is to use per-pixel depth, as in Layered Depth Images [Shade et al. 1998], the offset depth maps in Fac¸ade [Debevec et al. 1996], or sprites with depth [Bakeretal.1998;Shadeetal.1998].”
BackgroundMethodInfluentialShade, J., Gortler, S., He, L.-W., & Szeliski, R. (1998) · Proceedings of the 25th annual conference on Computer graphics and interactive techniques - SIGGRAPH '98 · doi:10.1145/280814.280882 · Cited by 1,115 · cited 2×
“We address these problems using a novel two-layer representation inspired by Layered Depth Images and sprites with depth [Shade et al. 1998].”
MethodSelf-citationMatusik, W., Buehler, C., Raskar, R., Gortler, S. J., & McMillan, L. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344951 · Cited by 890 · cited 1×
“Matusik et al. [2000] use the images from four calibrated FireWire cameras ( 256 × 256 ) to compute and shade visual hulls.”
MethodUnstructured lumigraph rendering
Buehler, C., Bosse, M., McMillan, L., Gortler, S., & Cohen, M. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383309 · Cited by 881 · cited 2×
“While this would not be a trivial extension, we believe that the Unstructured Lumigraph [Buehler et al. 2001] provides the right framework for accomplishing this.”
BackgroundVirtualized reality: constructing virtual worlds from real scenes
Kanade, T., Rander, P., & Narayanan, P. J. (1997) · IEEE Multimedia · doi:10.1109/93.580394 · Cited by 624 · cited 3×
“One of the earliest attempts at capturing and rendering dynamic scenes was Kanade et al.’s Virtualized RealityTM system [1997], which involved 51 cameras arranged around a 5-meter geodesic dome.”
BackgroundInfluential
Research works printed but not linked: 13
- 10.5555/794191.794727 · doi:10.5555/794191.794727
- Chang, C.-L., et al. 2003. Inter-view wavelet compression of light fields with disparity-compensated lifting. In Visual Communication and Image Processing (VCIP 2003), 14--22.
- 10.5555/946247.946764 · doi:10.5555/946247.946764
- 10.5555/648284.755760 · doi:10.5555/648284.755760
- 10.5555/647651.732115 · doi:10.5555/647651.732115
- 10.5555/794189.794361 · doi:10.5555/794189.794361
- 10.5555/1965841.1965933 · doi:10.5555/1965841.1965933
- Vedula, S., Baker, S., Seitz, S., and Kanade, T. 2000. Shape and motion carving in 6D. In Conference on Computer Vision and Pattern Recognition (CVPR), vol. II, 592--598.
- Wang, J. Y. A., and Adelson, E. H. 1993. Layered representation for motion analysis. In Conference on Computer Vision and Pattern Recognition (CVPR), 361--366.
- 10.5555/645317.649317 · doi:10.5555/645317.649317
- 10.5555/581896.581907 · doi:10.5555/581896.581907
- 10.5555/826030.826631 · doi:10.5555/826030.826631
- Zhang, Y., and Kambhamettu, C. 2001. On 3D scene flow and structure estimation. In Conference on Computer Vision and Pattern Recognition (CVPR), vol. II, 778--785.
Cited by
Stereo Processing by Semiglobal Matching and Mutual Information
Hirschmuller, H. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1166 · Cited by 4,195
Unsupervised Learning of Depth and Ego-Motion from Video
Zhou, T., Brown, M., Snavely, N., & Lowe, D. G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.700 · Cited by 2,910
“A classic paradigm for view synthesis is to first either estimate the underlying 3D geometry explicitly or establish pixel correspondence among input views, and then synthesize the novel views by compositing image patches from the input views (e.g., [4, 55, 43, 6, 9]).”
BackgroundPhoto tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141964 · Cited by 2,866
Self-citationA Database and Evaluation Methodology for Optical Flow
Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M. J., & Szeliski, R. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0390-2 · Cited by 2,205
“Our algorithm is closely related to previous algorithms for depth-based frame interpolation (Shade et al. 1998; Zitnick et al. 2004):”
MethodSelf-citationModeling the World from Internet Photo Collections
Snavely, N., Seitz, S. M., & Szeliski, R. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0107-3 · Cited by 2,155
“More recent work in IBR has focused on techniques for new view synthesis, e.g., (Chen and Williams 1993; McMillan and Bishop 1995; Gortler et al. 1996; Levoy and Hanrahan 1996; Seitz and Dyer 1996; Aliaga et al. 2003; Zitnick et al. 2004; Buehler et al. 2001).”
BackgroundMethodSelf-citation
Metadata
- Authors
- Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R.
- Affiliations
- Microsoft (United States) (US)
- Venue
- ACM SIGGRAPH 2004 Papers
- Publisher
- ACM
- Published
- 2004-08
- Pages
- 600-608
- OpenAlex
- W4249522571
- Cited by
- 367
- References
- 30
- Citations by year
- 2025: 1 · 2024: 3 · 2023: 2 · 2022: 5 · 2021: 12 · 2020: 10 · 2019: 12 · 2018: 12 · 2017: 15 · 2016: 12 · 2015: 17 · 2014: 22 · 2013: 24 · 2012: 28
- FWCI
- 14.19
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGGRAPH Conference (SIGGRAPH) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
- Physical Sciences › Computer Science › Signal Processing › Video Coding and Compression Technologies
- Keywords
- image-based rendering, image-based modeling, depth discontinuities, matting, dynamic scene rendering
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: High-quality video view interpolation using a layered representation. https://app.cochat.ai/papers/10.1145/1186562.1015766
- The paper
- Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2004). High-quality video view interpolation using a layered representation. ACM SIGGRAPH 2004 Papers. https://doi.org/10.1145/1186562.1015766
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.