The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Subspace video stabilization
Abstract
We present a robust and efficient approach to video stabilization that achieves high-quality camera motion for a wide range of videos. In this article, we focus on the problem of transforming a set of input 2D motion trajectories so that they are both smooth and resemble visually plausible views of the imaged scene; our key insight is that we can achieve this goal by enforcing subspace constraints on feature trajectories while smoothing them. Our approach assembles tracked features in the video into a trajectory matrix, factors it into two low-rank matrices, and performs filtering or curve fitting in a low-dimensional linear space. In order to process long videos, we propose a moving factorization that is both efficient and streamable. Our experiments confirm that our approach can efficiently provide stabilization results comparable with prior 3D methods in cases where those methods succeed, but also provides smooth camera motions in cases where such approaches often fail, such as videos that lack parallax. The presented approach offers the first method that both achieves high-quality video stabilization and is practical enough for consumer applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724
Golub, G. H., & Loan, C. F. V. (1996) · Johns Hopkins University Press eBooks · Cited by 6,027
MonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959
Shape and motion from image streams under orthography: a factorization method
Tomasi, C., & Kanade, T. (1992) · International Journal of Computer Vision · doi:10.1007/bf00129684 · Cited by 2,878
Nistér, D., Naroditsky, O., & Bergen, J. R. (2004) · Cited by 1,169
Full-frame video stabilization with motion inpainting
Matsushita, Y., Ofek, E., Ge, W., Tang, X., & Shum, H.-Y. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.141 · Cited by 542
Incremental Singular Value Decomposition of Uncertain Data with Missing Values
Brand, M. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47969-4_47 · Cited by 493
Content-preserving warps for 3D video stabilization
Liu, F., Gleicher, M., Jin, H., & Agarwala, A. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531350 · Cited by 467
Self-citationMultiple View Geometry in Computer Vision.
Wrobel, B. P. (2001) · Künstliche Intell. · Cited by 367
GPU-based Video Feature Tracking And Matching
Sinha, S. N., Frahm, J., Pollefeys, M., & Genç, Y. (2006) · Cited by 343
Damped Newton Algorithms for Matrix Factorization with Missing Data
Buchanan, A. M., & Fitzgibbon, A. W. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.118 · Cited by 299
Multiframe Motion Segmentation with Missing Data Using PowerFactorization and GPCA
Vidal, R., Tron, R., & Hartley, R. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0099-z · Cited by 216
Segmenting Motions of Different Types by Unsupervised Manifold Clustering
Goh, A., & Vidal, R. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383235 · Cited by 194
Evaluation of image stabilization algorithms
Morimoto, C., & Chellappa, R. (2002) · Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181) · doi:10.1109/icassp.1998.678102 · Cited by 185
Video stabilization using robust feature trajectories
Lee, K., Chuang, Y., Chen, B., & Ouhyoung, M. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459297 · Cited by 174
Geometric Models of Rolling-Shutter CamerasPreprint
Meingast, M., Geyer, C., & Sastry, S. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0503076 · Cited by 165
The Problem of Degeneracy in Structure and Motion Recovery from Uncalibrated Image Sequences
Torr, P. H. S., Fitzgibbon, A. W., & Zisserman, A. (1999) · International Journal of Computer Vision · doi:10.1023/a:1008140928553 · Cited by 156
Non-metric image-based rendering for video stabilization
Buehler, C., Bosse, M. C., & McMillan, L. (2001) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.991019 · Cited by 155
Removing rolling shutter wobble
Baker, S., Bennett, E., Kang, S. B., & Szeliski, R. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539932 · Cited by 120
Rectifying rolling shutter video from hand-held devices
Forssén, P.-E., & Ringaby, E. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540173 · Cited by 118
Gleicher, M. L., & Liu, F. (2008) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/1404880.1404882 · Cited by 113
Self-citationUsing Photographs to Enhance Videos of a Static Scene
Bhat, P., Zitnick, C. L., Snavely, N., Agarwala, A., Agrawala, M., Cohen, M., Curless, B., & Kang, S. B. (2007) · Eurographics · doi:10.5555/2383847.2383889 · Cited by 105
Self-citationImage-Based Rendering Using Image-Based Priors
Fitzgibbon, A. W., Wexler, Y., & Zisserman, A. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-6643-9 · Cited by 104
General construction of time-domain filters for orientation data
Lee, J., & Shin, S. Y. (2002) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/2945.998665 · Cited by 99
Optimization Algorithms on Subspaces: Revisiting Missing Data Problem in Low-Rank Matrix
Chen, P. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-008-0135-7 · Cited by 77
Video stabilization based on a 3D perspective camera model
Zhang, G., Hua, W., Qin, X., Shao, Y., & Bao, H. (2009) · The Visual Computer · doi:10.1007/s00371-009-0310-z · Cited by 69
Cited by
Real-time computer vision with OpenCV
Pulli, K., Baksheev, A., Kornyakov, K., & Eruhimov, V. (2012) · Communications of the ACM · doi:10.1145/2184319.2184337 · Cited by 440
Talking Face Generation by Adversarially Disentangled Audio-Visual Representation
Zhou, H., Liu, Y., Liu, Z., Luo, P., & Wang, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019299 · Cited by 416
Bundled camera paths for video stabilization
Liu, S., Yuan, L., Tan, P., & Sun, J. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461995 · Cited by 352
Auto-directed video stabilization with robust L1 optimal camera paths
Grundmann, M., Kwatra, V., & Essa, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995525 · Cited by 351
Metadata
- Authors
- Liu, F., Gleicher, M., Wang, J., Jin, H., & Agarwala, A.
- Venue
- ACM Transactions on Graphics
- Published
- 2011-01
- Volume
- 30
- Issue
- 1
- Pages
- 1-10
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2049092359
- Cited by
- 316
- References
- 30
- FWCI
- 30.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.