The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Multi-Scale Patch-Based Image Restoration
Abstract
Many image restoration algorithms in recent years are based on patch processing. The core idea is to decompose the target image into fully overlapping patches, restore each of them separately, and then merge the results by a plain averaging. This concept has been demonstrated to be highly effective, leading often times to the state-of-the-art results in denoising, inpainting, deblurring, segmentation, and other applications. While the above is indeed effective, this approach has one major flaw: the prior is imposed on intermediate (patch) results, rather than on the final outcome, and this is typically manifested by visual artifacts. The expected patch log likelihood (EPLL) method by Zoran and Weiss was conceived for addressing this very problem. Their algorithm imposes the prior on the patches of the final image, which in turn leads to an iterative restoration of diminishing effect. In this paper, we propose to further extend and improve the EPLL by considering a multi-scale prior. Our algorithm imposes the very same prior on different scale patches extracted from the target image. While all the treated patches are of the same size, their footprint in the destination image varies due to subsampling. Our scheme comes to alleviate another shortcoming existing in patch-based restoration algorithms--the fact that a local (patch-based) prior is serving as a model for a global stochastic phenomenon. We motivate the use of the multi-scale EPLL by restricting ourselves to the simple Gaussian case, comparing the aforementioned algorithms and showing a clear advantage to the proposed method. We then demonstrate our algorithm in the context of image denoising, deblurring, and super-resolution, showing an improvement in performance both visually and quantitatively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Boyd, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984616 · Cited by 12,677
Image denoising by sparse 3-D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901238 · Cited by 9,283
Martin, D., Fowlkes, C., Tal, D., & Malik, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937655 · Cited by 8,216
A Non-Local Algorithm for Image Denoising
Buades, A., Coll, B., & Morel, J.-M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.38 · Cited by 7,616
Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
Self-citationEstimation of the Mean of a Multivariate Normal Distribution
Stein, C. M. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345632 · Cited by 2,729
Sparse Representation for Color Image Restoration
Mairal, J., Elad, M., & Sapiro, G. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.911828 · Cited by 1,716
Self-citationNon-local sparse models for image restoration
Mairal, J., Bach, F., Ponce, J., Sapiro, G., & Zisserman, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459452 · Cited by 1,666
From learning models of natural image patches to whole image restoration
Zoran, D., & Weiss, Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126278 · Cited by 1,522
Nonlocally Centralized Sparse Representation for Image Restoration
Dong, W., Zhang, L., Shi, G., & Li, X. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2235847 · Cited by 1,505
Nonlocal Operators with Applications to Image Processing
Gilboa, G., & Osher, S. (2009) · Multiscale Modeling & Simulation · doi:10.1137/070698592 · Cited by 1,423
Nonlinear image recovery with half-quadratic regularization
Geman, D., & Yang, C. (1995) · IEEE Transactions on Image Processing · doi:10.1109/83.392335 · Cited by 1,000
Statistics of natural images: Scaling in the woods
Ruderman, D. L., & Bialek, W. (1994) · Physical Review Letters · doi:10.1103/physrevlett.73.814 · Cited by 920
Roth, S., & Black, M. J. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0197-6 · Cited by 847
A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical
Milanfar, P. (2013) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.2179329 · Cited by 605
Yu, G., Sapiro, G., & Mallat, S. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2176743 · Cited by 561
Analysis K-SVD: A Dictionary-Learning Algorithm for the Analysis Sparse Model
Rubinstein, R., Peleg, T., & Elad, M. (2013) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2226445 · Cited by 471
Self-citationImage processing using light-sensitive chemical waves
Kuhnert, L., Agladze, K. I., & Krinsky, V. I. (1989) · Nature · doi:10.1038/337244a0 · Cited by 420
Blind Deblurring Using Internal Patch Recurrence
Michaeli, T., & Irani, M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_51 · Cited by 403
Ramani, S., Blu, T., & Unser, M. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2001404 · Cited by 397
Forward-and-backward diffusion processes for adaptive image enhancement and denoising
Gilboa, G., Sochen, N., & Zeevi, Y. Y. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.800883 · Cited by 346
Nonparametric Blind Super-resolution
Michaeli, T., & Irani, M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.121 · Cited by 332
Patch-Based Near-Optimal Image Denoising
Chatterjee, P., & Milanfar, P. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2172799 · Cited by 296
Fast approximation of Kullback-Leibler distance for dependence trees and hidden Markov models
Do, M. N. (2003) · IEEE Signal Processing Letters · doi:10.1109/lsp.2003.809034 · Cited by 221
Exploiting Self-similarities for Single Frame Super-Resolution
Yang, C.-Y., Huang, J.-B., & Yang, M.-H. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-19318-7_39 · Cited by 190
Multi-Scale Dictionary Learning Using Wavelets
Ophir, B., Lustig, M., & Elad, M. (2011) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2011.2155032 · Cited by 165
Self-citationImage Processing Using Smooth Ordering of its Patches
Ram, I., Elad, M., & Cohen, I. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2257813 · Cited by 161
Self-citationAnalysis Operator Learning and its Application to Image Reconstruction
Hawe, S., Kleinsteuber, M., & Diepold, K. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2246175 · Cited by 143
Image Processing through Reaction Combined with Nonlinear Diffusion
Cottet, G., & Germain, L. (1993) · Mathematics of Computation · doi:10.1090/s0025-5718-1993-1195422-2 · Cited by 140
Analysis operator learning and its application to image reconstructionPreprint
Hawe, S., Kleinsteuber, M., & Diepold, K. (2013) · Cited by 123
Single Image Interpolation Via Adaptive Nonlocal Sparsity-Based Modeling
Romano, Y., Protter, M., & Elad, M. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2325774 · Cited by 118
Self-citationSeparating Signal from Noise Using Patch Recurrence across Scales
Zontak, M., Mosseri, I., & Irani, M. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.158 · Cited by 100
Nonlinear Regularized Reaction-Diffusion Filters for Denoising of Images With Textures
Plonka, G., & Ma, J. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.925305 · Cited by 66
Expected Patch Log Likelihood with a Sparse Prior
Sulam, J., & Elad, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-14612-6_8 · Cited by 57
Self-citationImage denoising through multi-scale learnt dictionaries
Sulam, J., Ophir, B., & Elad, M. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025162 · Cited by 35
Self-citationExact feature probabilities in images with occlusion
Pitkow, X. (2010) · Journal of Vision · doi:10.1167/10.14.42 · Cited by 22
Cited by
Restoring Vision in Adverse Weather Conditions With Patch-Based Denoising Diffusion Models
Özdenizci, O., & Legenstein, R. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3238179 · Cited by 469
Image denoising review: From classical to state-of-the-art approaches
Goyal, B., Dogra, A., Agrawal, S., Sohi, B. S., & Sharma, A. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.09.003 · Cited by 463
Real-world single image super-resolution: A brief review
Chen, H., He, X., Qing, L., Wu, Y., Ren, C., Sheriff, R. E., & Zhu, C. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.09.005 · Cited by 405
RAISR: Rapid and Accurate Image Super Resolution
Romano, Y., Isidoro, J., & Milanfar, P. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2629284 · Cited by 280
Turning a denoiser into a super-resolver using plug and play priors
Brifman, A., Romano, Y., & Elad, M. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532589 · Cited by 91
Self-citation
Metadata
- Authors
- Papyan, V., & Elad, M.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2016-01
- Volume
- 25
- Issue
- 1
- Pages
- 249-261
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2184334976
- Cited by
- 262
- References
- 37
- FWCI
- 19.06
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.