The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Learning how to inpaint from global image statistics
Abstract
Inpainting is the problem of filling-in holes in images. Considerable progress has been made by techniques that use the immediate boundary of the hole and some prior information on images to solve this problem. These algorithms successfully solve the local inpainting problem but they must, by definition, give the same completion to any two holes that have the same boundary, even when the rest of the image is vastly different. We address a different, more global inpainting problem. How can we use the rest of the image in order to learn how to inpaint? We approach this problem from the context of statistical learning. Given a training image we build an exponential family distribution over images that is based on the histograms of local features. We then use this image specific distribution to inpaint the hole by finding the most probable image given the boundary and the distribution. The optimization is done using loopy belief propagation. We show that our method can successfully complete holes while taking into account the specific image statistics. In particular it can give vastly different completions even when the local neighborhoods are identical.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
Bertalmio, M., Sapiro, G., Caselles, V., & Ballester, C. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344972 · Cited by 3,580
Texture synthesis by non-parametric sampling
Efros, A. A., & Leung, T. K. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790383 · Cited by 3,023
Image quilting for texture synthesis and transfer
Efros, A. A., & Freeman, W. T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383296 · Cited by 2,347
A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients
Portilla, J., & Simoncelli, E. P. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026553619983 · Cited by 1,806
Mathematical Models for Local Nontexture Inpaintings
Shen, J., & Chan, T. F. (2002) · SIAM Journal on Applied Mathematics · doi:10.1137/s0036139900368844 · Cited by 1,195
Simultaneous structure and texture image inpainting
Bertalmio, M., Vese, L., Sapiro, G., & Osher, S. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.815261 · Cited by 1,079
Inducing features of random fields
Della Pietra, S., Della Pietra, V., & Lafferty, J. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.588021 · Cited by 1,036
Filling-in by joint interpolation of vector fields and gray levels
Ballester, C., Bertalmio, M., Caselles, V., Sapiro, G., & Verdera, J. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.935036 · Cited by 962
Object removal by exemplar-based inpainting
Criminisi, A., Perez, P., & Toyama, K. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211538 · Cited by 847
On the optimality of solutions of the max-product belief-propagation algorithm in arbitrary graphs
Weiss, Y., & Freeman, W. T. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910585 · Cited by 581
Multiresolution sampling procedure for analysis and synthesis of texture images
De Bonet, J. S. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258882 · Cited by 570
Minimax Entropy Principle and Its Application to Texture Modeling
Zhu, S. C., Wu, Y. N., & Mumford, D. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1627 · Cited by 420
Filling-in the gaps: The shape of subjective contours and a model for their generation
Ullman, S. (1976) · Biological Cybernetics · doi:10.1007/bf00337043 · Cited by 270
Statistical models for images: compression, restoration and synthesis
Simoncelli, E. P. (2002) · Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136) · doi:10.1109/acssc.1997.680530 · Cited by 270
Simultaneous structure and texture image inpainting
Bertalmio, M., Vese, L., Sapiro, G., & Osher, S. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211536 · Cited by 245
Combining frequency and spatial domain information for fast interactive image noise removal
Hirani, A. N., & Totsuka, T. (1996) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/237170.237264 · Cited by 119
Learning to Perceive Transparency from the Statistics of Natural Scenes
Levin, A., Zomet, A., & Weiss, Y. (2002) · Cited by 83
Very Loopy Probability Propagation for Unwrapping Phase Images
Frey, B. J., Koetter, R., & Petrović, N. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0099 · Cited by 57
Learning to Estimate Scenes from Images
Freeman, W. T., & Pasztor, E. C. (1998) · Cited by 57
Orientation, Scale, and Discontinuity as Emergent Properties of Illusory Contour Shape
Williams, L. R., & Thornber, K. K. (2001) · Neural Computation · doi:10.1162/08997660152469305 · Cited by 30
Cited by
Globally and locally consistent image completion
Iizuka, S., Simo-Serra, E., & Ishikawa, H. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073659 · Cited by 2,203
Removing camera shake from a single photograph
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., & Freeman, W. T. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141956 · Cited by 1,815
Fields of Experts: A Framework for Learning Image Priors
Roth, S., & Black, M. J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.160 · Cited by 1,039
Image super-resolution using gradient profile prior
Sun, J., Xu, Z., & Shum, H.-Y. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587659 · Cited by 916
Roth, S., & Black, M. J. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0197-6 · Cited by 847
Metadata
- Authors
- Levin, Zomet, & Weiss
- Venue
- Proceedings Ninth IEEE International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2003
- Pages
- 305-312 vol.1
- OpenAlex
- W3144890709
- Cited by
- 324
- References
- 21
- FWCI
- 4.69
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.