The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Nonlocal Image Restoration With Bilateral Variance Estimation: A Low-Rank Approach
Abstract
Simultaneous sparse coding (SSC) or nonlocal image representation has shown great potential in various low-level vision tasks, leading to several state-of-the-art image restoration techniques, including BM3D and LSSC. However, it still lacks a physically plausible explanation about why SSC is a better model than conventional sparse coding for the class of natural images. Meanwhile, the problem of sparsity optimization, especially when tangled with dictionary learning, is computationally difficult to solve. In this paper, we take a low-rank approach toward SSC and provide a conceptually simple interpretation from a bilateral variance estimation perspective, namely that singular-value decomposition of similar packed patches can be viewed as pooling both local and nonlocal information for estimating signal variances. Such perspective inspires us to develop a new class of image restoration algorithms called spatially adaptive iterative singular-value thresholding (SAIST). For noise data, SAIST generalizes the celebrated BayesShrink from local to nonlocal models; for incomplete data, SAIST extends previous deterministic annealing-based solution to sparsity optimization through incorporating the idea of dictionary learning. In addition to conceptual simplicity and computational efficiency, SAIST has achieved highly competent (often better) objective performance compared to several state-of-the-art methods in image denoising and completion experiments. Our subjective quality results compare favorably with those obtained by existing techniques, especially at high noise levels and with a large amount of missing data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Fractal Geometry of Nature
Mandelbrot, B. B., & Wheeler, J. A. (1983) · American Journal of Physics · doi:10.1119/1.13295 · Cited by 21,832
A Wavelet Tour of Signal Processing
(1999) · Elsevier eBooks · doi:10.1016/b978-0-12-466606-1.x5000-4 · Cited by 16,227
Candes, E. J., Romberg, J., & Tao, T. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.862083 · Cited by 15,639
The chemical basis of morphogenesis
Turing, A. M. (1952) · Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences · doi:10.1098/rstb.1952.0012 · Cited by 11,733
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Aharon, M., Elad, M., & Bruckstein, A. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.881199 · Cited by 9,451
Image denoising by sparse 3-D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901238 · Cited by 9,283
Orthonormal bases of compactly supported wavelets
Daubechies, I. (1988) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.3160410705 · Cited by 8,190
A Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616
The Fractal Geometry of Nature
Mandelbrot, B. B., & Longley, P. (1982) · CERN Document Server (European Organization for Nuclear Research) · Cited by 7,293
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
Fundamentals of digital image processing
Jain, A. K. (1988) · Cited by 7,111
Robust principal component analysis?
Candès, E. J., Li, X., Ma, Y., & Wright, J. (2011) · Journal of the ACM · doi:10.1145/1970392.1970395 · Cited by 6,921
Self-citationA Singular Value Thresholding Algorithm for Matrix Completion
Cai, J.-F., Candès, E. J., & Shen, Z. (2010) · SIAM Journal on Optimization · doi:10.1137/080738970 · Cited by 5,809
Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
Exact Matrix Completion via Convex Optimization
Candès, E. J., & Recht, B. (2009) · Foundations of Computational Mathematics · doi:10.1007/s10208-009-9045-5 · Cited by 4,877
Fundamentals of digital image processing
(1989) · Computer Vision, Graphics, and Image Processing · doi:10.1016/0734-189x(89)90041-8 · Cited by 4,677
The renormalization group: Critical phenomena and the Kondo problem
Wilson, K. G. (1975) · Reviews of Modern Physics · doi:10.1103/revmodphys.47.773 · Cited by 4,522
Bertalmio, M., Sapiro, G., Caselles, V., & Ballester, C. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344972 · Cited by 3,580
Region Filling and Object Removal by Exemplar-Based Image Inpainting
Criminisi, A., Perez, P., & Toyama, K. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2004.833105 · Cited by 3,258 · cited 2×
“Inpainting performance comparison among several competing methods: exemplar-based [48], MCA-based [49], DA-based [44], and SAISTbased for six toy-example images (three regular textures and three regular edges).”
Adaptive wavelet thresholding for image denoising and compression
Chang, S. G., Yu, B., & Vetterli, M. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.862633 · Cited by 2,936
Image denoising using scale mixtures of gaussians in the wavelet domain
Portilla, J., Strela, V., Wainwright, M. J., & Simoncelli, E. P. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.818640 · Cited by 2,255
Nìcolis, G., & Prigogine, I. (1977) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,064
New edge-directed interpolation
Li, X., & Orchard, M. T. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.951537 · Cited by 2,023
Self-citationAn Iterative Regularization Method for Total Variation-Based Image Restoration
Osher, S., Burger, M., Goldfarb, D., Xu, J., & Yin, W. (2005) · Multiscale Modeling & Simulation · doi:10.1137/040605412 · Cited by 1,787
Candes, E. J., & Plan, Y. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2009.2035722 · Cited by 1,709
Non-local sparse models for image restoration
Mairal, J., Bach, F., Ponce, J., Sapiro, G., & Zisserman, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459452 · Cited by 1,666
From learning models of natural image patches to whole image restoration
Zoran, D., & Weiss, Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126278 · Cited by 1,522
Nonlocal Operators with Applications to Image Processing
Gilboa, G., & Osher, S. (2009) · Multiscale Modeling & Simulation · doi:10.1137/070698592 · Cited by 1,423
Sparse solutions to linear inverse problems with multiple measurement vectors
Cotter, S. F., Rao, B. D., Engan, K., & Kreutz-Delgado, K. (2005) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2005.849172 · Cited by 1,393
Kernel Regression for Image Processing and Reconstruction
Takeda, H., Farsiu, S., & Milanfar, P. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.888330 · Cited by 1,340
On the Early History of the Singular Value Decomposition
Stewart, G. W. (1993) · SIAM Review · doi:10.1137/1035134 · Cited by 985
Multistable phenomena: changing views in perception
Leopold, D. A., & Logothetis, N. K. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01332-7 · Cited by 962
Statistics of natural images: Scaling in the woods
Ruderman, D. L., & Bialek, W. (1994) · Physical Review Letters · doi:10.1103/physrevlett.73.814 · Cited by 920
Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA)
Elad, M., Starck, J.-L., Querre, P., & Donoho, D. L. (2005) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2005.03.005 · Cited by 904
Rose, K. (1998) · Proceedings of the IEEE · doi:10.1109/5.726788 · Cited by 876
Natural signal statistics and sensory gain control
Schwartz, O., & Simoncelli, E. P. (2001) · Nature Neuroscience · doi:10.1038/90526 · Cited by 835
RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images
Peng, Y., Ganesh, A., Wright, J., Xu, W., & Ma, Y. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.282 · Cited by 817
Noise removal via Bayesian wavelet coring
Simoncelli, E. P., & Adelson, E. H. (2002) · Proceedings of 3rd IEEE International Conference on Image Processing · doi:10.1109/icip.1996.559512 · Cited by 612
Principles of the Self-Organizing System
Ashby, W. R. (1991) · Facets of Systems Science · doi:10.1007/978-1-4899-0718-9_38 · Cited by 605
Robust video denoising using low rank matrix completion
Ji, H., Liu, C., Shen, Z., & Xu, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539849 · Cited by 483
Nonlocal Discrete Regularization on Weighted Graphs: A Framework for Image and Manifold Processing
Elmoataz, A., Lezoray, O., & Bougleux, S. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.924284 · Cited by 466
Sparsity-based image denoising via dictionary learning and structural clustering
Dong, W., Li, X., Zhang, L., & Shi, G. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995478 · Cited by 465
Self-citationRobust principal component analysis for computer vision
De la Torre, F., & Black, M. J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937541 · Cited by 387
A deterministic annealing approach to clustering
Rose, K., Gurewitz, E., & Fox, G. (1990) · Pattern Recognition Letters · doi:10.1016/0167-8655(90)90010-y · Cited by 382
Nonparametric Bayesian Dictionary Learning for Analysis of Noisy and Incomplete Images
Zhou, M., Chen, H., Paisley, J., Ren, L., Li, L., Xing, Z., Dunson, D., Sapiro, G., & Carin, L. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2160072 · Cited by 378
Bayesian Robust Principal Component Analysis
Ding, X., He, L., & Carin, L. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2156801 · Cited by 282
Clustering-Based Denoising With Locally Learned Dictionaries
Chatterjee, P., & Milanfar, P. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2018575 · Cited by 280
RASL: Robust alignment by sparse and low-rank decomposition for linearly correlated images
Peng, Y., Ganesh, A., Wright, J., Xu, W., & Ma, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540138 · Cited by 242
Guleryuz, O. G. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.863057 · Cited by 193
Local Adaptivity to Variable Smoothness for Exemplar-Based Image Regularization and Representation
Kervrann, C., & Boulanger, J. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0096-2 · Cited by 161
Guleryuz, O. G. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.863055 · Cited by 140
Iterative Regularization and Nonlinear Inverse Scale Space Applied to Wavelet-Based Denoising
Xu, J., & Osher, S. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.888335 · Cited by 121
Image Recovery Via Hybrid Sparse Representations: A Deterministic Annealing Approach
Li, X. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2138676 · Cited by 73
Self-citationLearning non-local range Markov Random field for image restoration
Sun, J. Z., & Tappen, M. F. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995520 · Cited by 68
Patch-Based Video Processing: A Variational Bayesian Approach
Li, X., & Zheng, Y. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.2005805 · Cited by 51
Self-citationUnsupervised Patch-Based Image Regularization and Representation
Charles Kervrann, A., & Boulanger, J. (2006) · Lecture notes in computer science · doi:10.1007/11744085_43 · Cited by 37
A General Iterative Regularization Framework For Image Denoising
Charest, M. R., Elad, M., & Milanfar, P. (2006) · Conference on Information Sciences and Systems · doi:10.1109/ciss.2006.286510 · Cited by 32
Non-convex sparse optimization through deterministic annealing and applications
Mancera, L., & Portilla, J. (2008) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2008.4711905 · Cited by 18
Cited by
Weighted Nuclear Norm Minimization with Application to Image Denoising
Gu, S., Zhang, L., Zuo, W., & Feng, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.366 · Cited by 2,316
Learning Enriched Features for Real Image Restoration and Enhancement
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., Yang, M.-H., & Shao, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58595-2_30 · Cited by 946
Hyperspectral Image Restoration Using Low-Rank Matrix Recovery
Zhang, H., He, W., Zhang, L., Shen, H., & Yuan, Q. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2284280 · Cited by 887
Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision
Gu, S., Xie, Q., Meng, D., Zuo, W., Feng, X., & Zhang, L. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0930-5 · Cited by 816
Group-Based Sparse Representation for Image Restoration
Zhang, J., Zhao, D., & Gao, W. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2323127 · Cited by 768
Metadata
- Authors
- Dong, W., Shi, G., & Li, X.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2013-02
- Volume
- 22
- Issue
- 2
- Pages
- 700-711
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2014311222
- Cited by
- 655
- References
- 58
- FWCI
- 23.28
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.