The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
A Closed-Form Solution to Natural Image Matting
Abstract
Interactive digital matting, the process of extracting a foreground object from an image based on limited user input, is an important task in image and video editing. From a computer vision perspective, this task is extremely challenging because it is massively ill-posed -- at each pixel we must estimate the foreground and the background colors, as well as the foreground opacity ("alpha matte") from a single color measurement. Current approaches either restrict the estimation to a small part of the image, estimating foreground and background colors based on nearby pixels where they are known, or perform iterative nonlinear estimation by alternating foreground and background color estimation with alpha estimation. In this paper we present a closed-form solution to natural image matting. We derive a cost function from local smoothness assumptions on foreground and background colors, and show that in the resulting expression it is possible to analytically eliminate the foreground and background colors to obtain a quadratic cost function in alpha. This allows us to find the globally optimal alpha matte by solving a sparse linear system of equations. Furthermore, the closed-form formula allows us to predict the properties of the solution by analyzing the eigenvectors of a sparse matrix, closely related to matrices used in spectral image segmentation algorithms. We show that high quality mattes for natural images may be obtained from a small amount of user input.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GrabCut: Interactive foreground extraction using iterated graph cuts
Rother, C., Kolmogorov, V., & Blake, A. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015720 · Cited by 5,703
Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images
Boykov, Y. Y., & Jolly, M.-P. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937505 · Cited by 3,674
Advances in Neural Information Processing Systems 18
Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927
Colorization using optimization
Levin, A., Lischinski, D., & Weiss, Y. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015780 · Cited by 1,411
Self-citationLi, Y., Sun, J., Tang, C.-K., & Shum, H.-Y. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015719 · Cited by 1,097
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609407 · Cited by 849
A Bayesian approach to digital matting
Chuang, Y.-Y., Curless, B., Salesin, D. H., & Szeliski, R. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990970 · Cited by 796
Sun, J., Jia, J., Tang, C.-K., & Shum, H.-Y. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015721 · Cited by 583
Colorization using optimization
Levin, A., Lischinski, D., & Weiss, Y. (2004) · ACM SIGGRAPH 2004 Papers · doi:10.1145/1186562.1015780 · Cited by 478
Self-citationAlpha estimation in natural images
Ruzon, M. A., & Tomasi, C. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855793 · Cited by 348
Cited by
DehazeNet: An End-to-End System for Single Image Haze Removal
Cai, B., Xu, X., Jia, K., Qing, C., & Tao, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2598681 · Cited by 3,367
Random Walks for Image Segmentation
Grady, L. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.233 · Cited by 2,624
A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior
Zhu, Q., Mai, J., & Shao, L. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2446191 · Cited by 2,469
Underwater Image Restoration Based on Image Blurriness and Light Absorption
Peng, Y.-T., & Cosman, P. C. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2663846 · Cited by 1,250
Automatic Red-Channel underwater image restoration
Galdran, A., Pardo, D., Picón, A., & Alvarez-Gila, A. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2014.11.006 · Cited by 995
Generalization of the Dark Channel Prior for Single Image Restoration
Peng, Y.-T., Cao, K., & Cosman, P. C. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2813092 · Cited by 845
Deep bilateral learning for real-time image enhancement
Gharbi, M., Chen, J., Barron, J. T., Hasinoff, S. W., & Durand, F. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073592 · Cited by 800
Single Image Dehazing by Multi-Scale Fusion
Ancuti, C. O., & Ancuti, C. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2262284 · Cited by 726
Luan, F., Paris, S., Shechtman, E., & Bala, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.740 · Cited by 714
Sketch2Photo: internet image montage
Chen, T., Cheng, M.-M., Tan, P., Shamir, A., & Hu, S.-M. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618470 · Cited by 574
Weighted Guided Image Filtering
Li, Z., Zheng, J., Zhu, Z., Yao, W., & Wu, S. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2371234 · Cited by 564
Understanding Deep Learning Techniques for Image Segmentation
Ghosh, S., Das, N., Das, I., & Maulik, U. (2020) · ACM Computing Surveys · doi:10.1145/3329784 · Cited by 476
Xu, N., Price, B., Cohen, S., & Huang, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.41 · Cited by 447
A Closed-Form Solution to Photorealistic Image Stylization
Li, Y., Liu, M.-Y., Li, X., Yang, M.-H., & Kautz, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_28 · Cited by 400
Defocus map estimation from a single image
Zhuo, S., & Sim, T. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.03.009 · Cited by 399
Video SnapCut: robust video object cutout using localized classifiers
Bai, X., Wang, J., Simons, D., & Sapiro, G. (2009) · ACM Transactions on Graphics · doi:10.1145/1531326.1531376 · Cited by 367
Non-local Spatial Propagation Network for Depth Completion
Park, J., Joo, K., Hu, Z., Liu, C.-K., & So Kweon, I. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58601-0_8 · Cited by 354
Gradient Domain Guided Image Filtering
Kou, F., Chen, W., Wen, C., & Li, Z. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2468183 · Cited by 343
Paired Regions for Shadow Detection and Removal
Guo, R., Dai, Q., & Hoiem, D. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.214 · Cited by 339
Pattern-Affinitive Propagation Across Depth, Surface Normal and Semantic Segmentation
Zhang, Z., Cui, Z., Xu, C., Yan, Y., Sebe, N., & Yang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00423 · Cited by 331
Power Watershed: A Unifying Graph-Based Optimization Framework
Couprie, C., Grady, L., Najman, L., & Talbot, H. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.200 · Cited by 305
Single-image shadow detection and removal using paired regions
Guo, R., Dai, Q., & Hoiem, D. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995725 · Cited by 295
Automatic Shadow Detection and Removal from a Single Image
Khan, S. H., Bennamoun, M., Sohel, F., & Togneri, R. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2462355 · Cited by 283
Spectral Unmixing via Data-Guided Sparsity
Zhu, F., Wang, Y., Fan, B., Xiang, S., Meng, G., & Pan, C. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2363423 · Cited by 276
Hyperspectral image reconstruction by deep convolutional neural network for classification
Li, Y., Xie, W., & Li, H. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.10.019 · Cited by 264
Unsupervised Learning of Image Segmentation Based on Differentiable Feature Clustering
Kim, W., Kanezaki, A., & Tanaka, M. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3011269 · Cited by 258
Perinasal Imaging of Physiological Stress and Its Affective Potential
Shastri, D., Papadakis, M., Tsiamyrtzis, P., Bass, B., & Pavlidis, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.13 · Cited by 89
Metadata
- Authors
- Levin, A., Lischinski, D., & Weiss, Y.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2008-02
- Volume
- 30
- Issue
- 2
- Pages
- 228-242
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2035773017
- Cited by
- 1,616
- References
- 17
- FWCI
- 64.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.