The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Full-frame video stabilization with motion inpainting
Abstract
Video stabilization is an important video enhancement technology which aims at removing annoying shaky motion from videos. We propose a practical and robust approach of video stabilization that produces full-frame stabilized videos with good visual quality. While most previous methods end up with producing smaller size stabilized videos, our completion method can produce full-frame videos by naturally filling in missing image parts by locally aligning image data of neighboring frames. To achieve this, motion inpainting is proposed to enforce spatial and temporal consistency of the completion in both static and dynamic image areas. In addition, image quality in the stabilized video is enhanced with a new practical deblurring algorithm. Instead of estimating point spread functions, our method transfers and interpolates sharper image pixels of neighboring frames to increase the sharpness of the frame. The proposed video completion and deblurring methods enabled us to develop a complete video stabilizer which can naturally keep the original image quality in the stabilized videos. The effectiveness of our method is confirmed by extensive experiments over a wide variety of videos.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1981) · Cited by 11,963
Bilateral Filtering for Gray and Color Images
Tomasi, C., & Manduchi, R. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710815 · Cited by 8,177 · cited 1×
“This nonlinear operation approximates a temporal bilateral filter [36] which avoids oversmoothing caused by irrelevant image pixels.”
BackgroundGrabCut: Interactive foreground extraction using iterated graph cuts
Rother, C., Kolmogorov, V., & Blake, A. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015720 · Cited by 5,703
Computer graphics: principles and practice
(2014) · Choice Reviews Online · doi:10.5860/choice.51-2713 · Cited by 4,651
Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images
Boykov, Y. Y., & Jolly, M.-P. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937505 · Cited by 3,674
Sethian, J. A. (1999) · Cited by 3,622
Bertalmio, M., Sapiro, G., Caselles, V., & Ballester, C. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344972 · Cited by 3,580
Texture synthesis by non-parametric sampling
Efros, A. A., & Leung, T. K. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790383 · Cited by 3,023
Improving resolution by image registration
Irani, M., & Peleg, S. (1991) · CVGIP: Graphical Models and Image Processing · doi:10.1016/1049-9652(91)90045-l · Cited by 1,929
Image Alignment and Stitching: A Tutorial
Szeliski, R. (2007) · Foundations and Trends in Computer Graphics and Vision · doi:10.1561/0600000009 · Cited by 1,593
Pyramidal implementation of the Lucas Kanade feature tracker description of the algorithm
Bouguet, J.-Y. (1999) · Cited by 1,552
An Image Inpainting Technique Based on the Fast Marching Method
Telea, A. (2004) · Journal of Graphics Tools · doi:10.1080/10867651.2004.10487596 · Cited by 1,421
Graphcut textures: image and video synthesis using graph cuts
Kwatra, V., Schödl, A., Essa, I., Turk, G., & Bobick, A. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882264 · Cited by 1,216
Hierarchical model-based motion estimation
Bergen, J. R., Anandan, P., Hanna, K. J., & Hingorani, R. (1992) · Lecture Notes in Computer Science · doi:10.1007/3-540-55426-2_27 · Cited by 1,154
A computational framework and an algorithm for the measurement of visual motion
Anandan, P. (1989) · International Journal of Computer Vision · doi:10.1007/bf00158167 · Cited by 1,073
Brown, & Lowe (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238630 · Cited by 934
Object removal by exemplar-based inpainting
Criminisi, A., Perez, P., & Toyama, K. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211538 · Cited by 847
Krotkov, E. (2004) · International Journal of Computer Vision · doi:10.1007/bf00127822 · Cited by 847
Computer graphics: Principles and practice
Carter, M. P. (1997) · Color Research & Application · doi:10.1002/(sici)1520-6378(199702)22:1<65::aid-col11>3.0.co;2-7 · Cited by 814
Graphcut textures: image and video synthesis using graph cuts
Kwatra, V., Schödl, A., Essa, I., Turk, G., & Bobick, A. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882264 · Cited by 787
Shum, H.-Y., & Szeliski, R. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008195814169 · Cited by 412
Self-citationImage mosaicing for tele-reality applications
Szeliski, R. (2002) · Proceedings of 1994 IEEE Workshop on Applications of Computer Vision · doi:10.1109/acv.1994.341287 · Cited by 369
Construction of Panoramic Image Mosaics with Global and Local Alignment
Shum, H.-Y., & Szeliski, R. (2001) · Monographs in Computer Science · doi:10.1007/978-1-4757-3482-9_13 · Cited by 356
Self-citationWexler, Y., Shechtman, E., & Irani, M. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315022 · Cited by 347
Automated mosaicing with super-resolution zoom
Capel, D., & Zisserman, A. (2002) · Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231) · doi:10.1109/cvpr.1998.698709 · Cited by 207
Real-time scene stabilization and mosaic construction
Hansen, M., Anandan, P., Dana, K., van der Wal, G., & Burt, P. (2002) · Proceedings of 1994 IEEE Workshop on Applications of Computer Vision · doi:10.1109/acv.1994.341288 · Cited by 203
Hierarchical Model-Based Motion Estimation
Anandan, P., Bergen, J. R., Hanna, K. J., & Hingorani, R. (1993) · Motion Analysis and Image Sequence Processing · doi:10.1007/978-1-4615-3236-1_1 · Cited by 193
Using geometric corners to build a 2D mosaic from a set of images
Zoghlami, I., Faugeras, O. D., & Rachid Deriche, B. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1997.609359 · Cited by 190
Non-metric image-based rendering for video stabilization
Buehler, C., Bosse, M. C., & McMillan, L. (2001) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.991019 · Cited by 155
Cheung, V. C. K., Frey, B. J., & Jojić, N. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.366 · Cited by 101
Real-time motion estimation and visualization on graphics cards
Strzodka, R., & Garbe, C. S. (2005) · Visualization · doi:10.1109/visual.2004.88 · Cited by 66
Cited by
Deep Video Deblurring for Hand-Held Cameras
Su, S., Delbracio, M., Wang, J., Sapiro, G., Heidrich, W., & Wang, O. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.33 · Cited by 577
Real-time computer vision with OpenCV
Pulli, K., Baksheev, A., Kornyakov, K., & Eruhimov, V. (2012) · Communications of the ACM · doi:10.1145/2184319.2184337 · Cited by 440
Auto-directed video stabilization with robust L1 optimal camera paths
Grundmann, M., Kwatra, V., & Essa, I. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995525 · Cited by 351
Learning Joint Spatial-Temporal Transformations for Video Inpainting
Zeng, Y., Fu, J., & Chao, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58517-4_31 · Cited by 281
Light field video stabilization
Smith, B. M., Zhang, L., Jin, H., & Agarwala, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459270 · Cited by 107
Metadata
- Authors
- Matsushita, Y., Ofek, E., Ge, W., Tang, X., & Shum, H.-Y.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2006-07
- Volume
- 28
- Issue
- 7
- Pages
- 1150-1163
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2169574628
- Cited by
- 542
- References
- 31
- FWCI
- 16.86
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.