The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing
Abstract
This paper presents interactive image editing tools using a new randomized algorithm for quickly finding approximate nearestneighbor matches between image patches. Previous research in graphics and vision has leveraged such nearest-neighbor searches to provide a variety of high-level digital image editing tools. However, the cost of computing a field of such matches for an entire image has eluded previous efforts to provide interactive performance. Our algorithm offers substantial performance improvements over the previous state of the art (20-100x), enabling its use in interactive editing tools. The key insights driving the algorithm are that some good patch matches can be found via random sampling, and that natural coherence in the imagery allows us to propagate such matches quickly to surrounding areas. We offer theoretical analysis of the convergence properties of the algorithm, as well as empirical and practical evidence for its high quality and performance. This one simple algorithm forms the basis for a variety of tools - image retargeting, completion and reshuffling - that can be used together in the context of a high-level image editing application. Finally, we propose additional intuitive constraints on the synthesis process that offer the user a level of control unavailable in previous methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
A Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616
Texture synthesis by non-parametric sampling
Efros, A. A., & Leung, T. K. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790383 · Cited by 3,023
Image quilting for texture synthesis and transfer
Efros, A. A., & Freeman, W. T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383296 · Cited by 2,347
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
Fast texture synthesis using tree-structured vector quantization
Wei, L.-Y., & Levoy, M. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.345009 · Cited by 1,356
Seam carving for content-aware image resizing
Avidan, S., & Shamir, A. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276390 · Cited by 1,092
Szeliski, R., Zabih, R., Scharstein, D., Veksler, O., Kolmogorov, V., Agarwala, A., Tappen, M., & Rother, C. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70844 · Cited by 966
Object removal by exemplar-based inpainting
Criminisi, A., Perez, P., & Toyama, K. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211538 · Cited by 847
Graphcut textures: image and video synthesis using graph cuts
Kwatra, V., Schödl, A., Essa, I., Turk, G., & Bobick, A. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882264 · Cited by 787
Improved seam carving for video retargeting
Rubinstein, M., Shamir, A., & Avidan, S. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360615 · Cited by 742
Space-Time Completion of Video
Wexler, Y., Shechtman, E., & Irani, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.60 · Cited by 682
Self-citationReal-time texture synthesis by patch-based sampling
Liang, L., Liu, C., Xu, Y.-Q., Guo, B., & Shum, H.-Y. (2001) · ACM Transactions on Graphics · doi:10.1145/501786.501787 · Cited by 655
Summarizing visual data using bidirectional similarity
Simakov, D., Caspi, Y., Shechtman, E., & Irani, M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587842 · Cited by 613
Self-citationNon-homogeneous Content-driven Video-retargeting
Wolf, L., Guttmann, M., & Cohen-Or, D. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409010 · Cited by 503
Fragment-based image completion
Drori, I., Cohen-Or, D., & Yeshurun, H. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882267 · Cited by 343
Image Completion Using Efficient Belief Propagation Via Priority Scheduling and Dynamic Pruning
Komodakis, N., & Tziritas, G. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.906269 · Cited by 332
Setlur, V., Takagi, S., Raskar, R., Gleicher, M., & Gooch, B. (2005) · Proceedings of the 4th international conference on Mobile and ubiquitous multimedia - MUM '05 · doi:10.1145/1149488.1149499 · Cited by 220
Automatic image retargeting with fisheye-view warping
Liu, F., & Gleicher, M. (2005) · Proceedings of the 18th annual ACM symposium on User interface software and technology · doi:10.1145/1095034.1095061 · Cited by 179
Synthesis of bidirectional texture functions on arbitrary surfaces
Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., & Shum, H. (2002) · ACM Transactions on Graphics · doi:10.1145/566654.566634 · Cited by 167
Image-based rendering using image-based priors
Fitzgibbon, Wexler, & Zisserman (2003) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2003.1238625 · Cited by 161
Rother, C., Bordeaux, L., Hamadi, Y., & Blake, A. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141965 · Cited by 152
The patch transform and its applications to image editing
Cho, T. S., Butman, M., Avidan, S., et al. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587642 · Cited by 145
Texture optimization for example-based synthesis
Kwatra, V., Essa, I. A., Bobick, A., & Kwatra, N. (2005) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1186822.1073263 · Cited by 143
What Is a Good Nearest Neighbors Algorithm for Finding Similar Patches in Images?
Kumar, N., Zhang, L., & Nayar, S. K. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88688-4_27 · Cited by 136
Interactive image completion with perspective correction
Pavić, D., Schönefeld, V., & Kobbelt, L. P. (2006) · The Visual Computer · doi:10.1007/s00371-006-0050-2 · Cited by 68
Cited by
Globally and locally consistent image completion
Iizuka, S., Simo-Serra, E., & Ishikawa, H. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073659 · Cited by 2,203
Optical flow modeling and computation: A survey
Fortun, D., Bouthemy, P., & Kervrann, C. (2015) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.02.008 · Cited by 431
A Survey on Deep Learning Techniques for Stereo-Based Depth Estimation
Laga, H., Jospin, L. V., Boussaid, F., & Bennamoun, M. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3032602 · Cited by 336
Multimodal Hippocampal Subfield Grading For Alzheimer’s Disease Classification
Hett, K., Ta, V.-T., Catheline, G., Tourdias, T., Manjón, J. V., Coupé, P., Initiative, A. D. N., Weiner, M. W., Aisen, P., Petersen, R., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-49970-9 · Cited by 49
Metadata
- Authors
- Barnes, C., Shechtman, E., Finkelstein, A., & Goldman, D. B.
- Venue
- Seminal Graphics Papers: Pushing the Boundaries, Volume 2
- Publisher
- ACM
- Published
- 2023-08
- Pages
- 619-629
- OpenAlex
- W4385490375
- Cited by
- 276
- References
- 26
- FWCI
- 20.81
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.