The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Video Inpainting Under Constrained Camera Motion
Abstract
A framework for inpainting missing parts of a video sequence recorded with a moving or stationary camera is presented in this work. The region to be inpainted is general: it may be still or moving, in the background or in the foreground, it may occlude one object and be occluded by some other object. The algorithm consists of a simple preprocessing stage and two steps of video inpainting. In the preprocessing stage, we roughly segment each frame into foreground and background. We use this segmentation to build three image mosaics that help to produce time consistent results and also improve the performance of the algorithm by reducing the search space. In the first video inpainting step, we reconstruct moving objects in the foreground that are "occluded" by the region to be inpainted. To this end, we fill the gap as much as possible by copying information from the moving foreground in other frames, using a priority-based scheme. In the second step, we inpaint the remaining hole with the background. To accomplish this, we first align the frames and directly copy when possible. The remaining pixels are filled in by extending spatial texture synthesis techniques to the spatiotemporal domain. The proposed framework has several advantages over state-of-the-art algorithms that deal with similar types of data and constraints. It permits some camera motion, is simple to implement, fast, does not require statistical models of background nor foreground, works well in the presence of rich and cluttered backgrounds, and the results show that there is no visible blurring or motion artifacts. A number of real examples taken with a consumer hand-held camera are shown supporting these findings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bertalmio, M., Sapiro, G., Caselles, V., & Ballester, C. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344972 · Cited by 3,580
Self-citationRegion Filling and Object Removal by Exemplar-Based Image Inpainting
Criminisi, A., Perez, P., & Toyama, K. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.833105 · Cited by 3,258 · cited 6×
“A number of algorithms for automatic still image completion have been proposed in the literature [3], [5], [6], [ 11 ].”
MethodInfluentialTexture synthesis by non-parametric sampling
Efros, A. A., & Leung, T. K. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790383 · Cited by 3,023
The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields
Black, M. J., & Anandan, P. (1996) · Computer Vision and Image Understanding · doi:10.1006/cviu.1996.0006 · Cited by 1,570
SCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073207 · Cited by 1,489
Simultaneous structure and texture image inpainting
Bertalmio, M., Vese, L., Sapiro, G., & Osher, S. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.815261 · Cited by 1,079
Self-citationNavier-stokes, fluid dynamics, and image and video inpainting
Bertalmio, M., Bertozzi, A. L., & Sapiro, G. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990497 · Cited by 1,042
Self-citationVideo mosaics for virtual environments
Szeliski, R. (1996) · IEEE Computer Graphics and Applications · doi:10.1109/38.486677 · Cited by 727
Motion-based background subtraction using adaptive kernel density estimation
Mittal, A., & Paragios, N. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315179 · Cited by 590
SCAPE: shape completion and animation of people
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., & Davis, J. (2005) · ACM SIGGRAPH 2005 Papers · doi:10.1145/1186822.1073207 · Cited by 410
Wexler, Y., Shechtman, E., & Irani, M. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315022 · Cited by 347
Layered representation for motion analysis
Wang, J. Y. A., & Adelson, E. H. (2002) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341105 · Cited by 273
Interpolation of missing data in image sequences
Kokaram, A. C., Morris, R. D., Fitzgerald, W. J., & Rayner, P. J. W. (1995) · IEEE Transactions on Image Processing · doi:10.1109/83.469932 · Cited by 215
A layered approach to stereo reconstruction
Baker, S., Szeliski, R., & Anandan, P. (2002) · Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231) · doi:10.1109/cvpr.1998.698642 · Cited by 178
Video inpainting of occluding and occluded objects
Patwardhan, K. A., Sapiro, G., & Bertalmı́o, M. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2005.1529993 · Cited by 159
Self-citationTowards ultimate motion estimation: combining highest accuracy with real-time performance
Bruhn, A., & Weickert, J. (2005) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2005.240 · Cited by 138
Cheung, V. C. K., Frey, B. J., & Jojić, N. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.366 · Cited by 101
Statistical background modeling for non-stationary camera
Ying, R., Chua, C.-S., & Ho, Y.-K. (2002) · Pattern Recognition Letters · doi:10.1016/s0167-8655(02)00210-6 · Cited by 85
Motion Layer Based Object Removal in Videos
Yunjun, Z., Xiao, J., & Shah, M. A. (2005) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/acvmot.2005.75 · Cited by 80
Video completion using tracking and fragment merging
Jia, Y., Hu, S., & Martin, R. R. (2005) · The Visual Computer · doi:10.1007/s00371-005-0313-3 · Cited by 73
Cited by
Learning Multiscale Sparse Representations for Image and Video Restoration
Mairal, J., Sapiro, G., & Elad, M. (2008) · Multiscale Modeling & Simulation · doi:10.1137/070697653 · Cited by 460
Self-citation3-D Video Representation Using Depth Maps
Muller, K., Merkle, P., & Wiegand, T. (2011) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2091090 · Cited by 397
Kronecker-Basis-Representation Based Tensor Sparsity and Its Applications to Tensor Recovery
Xie, Q., Zhao, Q., Meng, D., & Xu, Z. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2734888 · Cited by 318
Learning Joint Spatial-Temporal Transformations for Video Inpainting
Zeng, Y., Fu, J., & Chao, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58517-4_31 · Cited by 281
Video Inpainting of Complex Scenes
Newson, A., Almansa, A., Fradet, M., Gousseau, Y., & Pérez, P. (2014) · SIAM Journal on Imaging Sciences · doi:10.1137/140954933 · Cited by 261
Metadata
- Authors
- Patwardhan, K. A., Sapiro, G., & Bertalmio, M.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2007-02
- Volume
- 16
- Issue
- 2
- Pages
- 545-553
- ISSN
- 1057-7149 (ISSN-L)
- OpenAlex
- W2131565286
- Cited by
- 253
- References
- 20
- FWCI
- 23.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.