The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Monte-Carlo Sure: A Black-Box Optimization of Regularization Parameters for General Denoising Algorithms
Open accessAbstract
We consider the problem of optimizing the parameters of a given denoising algorithm for restoration of a signal corrupted by white Gaussian noise. To achieve this, we propose to minimize Stein's unbiased risk estimate (SURE) which provides a means of assessing the true mean-squared error (MSE) purely from the measured data without need for any knowledge about the noise-free signal. Specifically, we present a novel Monte-Carlo technique which enables the user to calculate SURE for an arbitrary denoising algorithm characterized by some specific parameter setting. Our method is a black-box approach which solely uses the response of the denoising operator to additional input noise and does not ask for any information about its functional form. This, therefore, permits the use of SURE for optimization of a wide variety of denoising algorithms. We justify our claims by presenting experimental results for SURE-based optimization of a series of popular image-denoising algorithms such as total-variation denoising, wavelet soft-thresholding, and Wiener filtering/smoothing splines. In the process, we also compare the performance of these methods. We demonstrate numerically that SURE computed using the new approach accurately predicts the true MSE for all the considered algorithms. We also show that SURE uncovers the optimal values of the parameters in all cases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
Spline Models for Observational Data.
Muller, H.-G., & Wahba, G. (1991) · Journal of the American Statistical Association · doi:10.2307/2290434 · Cited by 4,928
Adapting to Unknown Smoothness via Wavelet Shrinkage
Donoho, D. L., & Johnstone, I. M. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476626 · Cited by 4,630
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter
Golub, G. H., Heath, M., & Wahba, G. (1979) · Technometrics · doi:10.1080/00401706.1979.10489751 · Cited by 3,934
Analysis of Discrete Ill-Posed Problems by Means of the L-Curve
Hansen, P. C. (1992) · SIAM Review · doi:10.1137/1034115 · Cited by 3,903
Craven, P., & Wahba, G. (1978) · Numerische Mathematik · doi:10.1007/bf01404567 · Cited by 3,388
The Use of the L-Curve in the Regularization of Discrete Ill-Posed Problems
Hansen, P. C., & O’Leary, D. P. (1993) · SIAM Journal on Scientific Computing · doi:10.1137/0914086 · Cited by 3,137
Estimation of the Mean of a Multivariate Normal Distribution
Stein, C. M. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345632 · Cited by 2,729
Computational Methods for Inverse Problems
Vogel, C. R. (2002) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898717570 · Cited by 2,370
Image denoising using scale mixtures of gaussians in the wavelet domain
Portilla, J., Strela, V., Wainwright, M. J., & Simoncelli, E. P. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.818640 · Cited by 2,255
Hunter, D. R., & Lange, K. (2004) · The American Statistician · doi:10.1198/0003130042836 · Cited by 1,783
Smoothing noisy data with spline functions
Wahba, G. (1975) · Numerische Mathematik · doi:10.1007/bf01437407 · Cited by 1,443
Mallows, C. L. (1995) · Technometrics · doi:10.2307/1269729 · Cited by 1,080
Nonlinear image recovery with half-quadratic regularization
Geman, D., & Yang, C. (1995) · IEEE Transactions on Image Processing · doi:10.1109/83.392335 · Cited by 1,000
Chambolle, A., De Vore, R. A., Lee, N.-Y., & Lucier, B. J. (1998) · IEEE Transactions on Image Processing · doi:10.1109/83.661182 · Cited by 751
Empirical Analyses of BOLD fMRI Statistics
Zarahn, E., Aguirre, G. K., & D'Esposito, M. (1997) · NeuroImage · doi:10.1006/nimg.1997.0263 · Cited by 693
A Real-Time Algorithm for Signal Analysis with the Help of the Wavelet Transform
Holschneider, M., Kronland-Martinet, R., Morlet, J., & Tchamitchian, P. (1989) · Inverse Problems and Theoretical Imaging · doi:10.1007/978-3-642-97177-8_28 · Cited by 633
A New SURE Approach to Image Denoising: Interscale Orthonormal Wavelet Thresholding
Luisier, F., Blu, T., & Unser, M. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.891064 · Cited by 623
Self-citationA stochastic estimator of the trace of the influence matrix for laplacian smoothing splines
Hutchinson, M. F. (1990) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610919008812866 · Cited by 610
Bivariate shrinkage with local variance estimation
Sendur, L., & Selesnick, I. W. (2002) · IEEE Signal Processing Letters · doi:10.1109/lsp.2002.806054 · Cited by 579
Galatsanos, N. P., & Katsaggelos, A. K. (1992) · IEEE Transactions on Image Processing · doi:10.1109/83.148606 · Cited by 500
Noise reduction using an undecimated discrete wavelet transform
Lang, M., Guo, H., Odegard, J. E., Burrus, C. S., & Wells, R. O. (1996) · IEEE Signal Processing Letters · doi:10.1109/97.475823 · Cited by 484
Empirical Analyses of BOLD fMRI Statistics
Aguirre, G. K., Zarahn, E., & D'Esposito, M. (1997) · NeuroImage · doi:10.1006/nimg.1997.0264 · Cited by 472
Mallows, C. L. (1973) · Technometrics · doi:10.1080/00401706.1973.10489103 · Cited by 427
Pizurica, A., & Philips, W. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.863698 · Cited by 411
The SURE-LET Approach to Image Denoising
Blu, T., & Luisier, F. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.906002 · Cited by 405
Self-citationA Stochastic Estimator of the Trace of the Influence Matrix for Laplacian Smoothing Splines
Hutchinson, M. F. (1989) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610918908812806 · Cited by 381
A study of methods of choosing the smoothing parameter in image restoration by regularization
Thompson, A. M., Brown, J. C., Kay, J. W., & Titterington, D. M. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.88568 · Cited by 305
Bayesian Confidence Intervals for Smoothing Splines
Nychka, D. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478711 · Cited by 289
A Regularization Parameter in Discrete Ill-Posed Problems
Regińska, T. (1996) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827593252672 · Cited by 262
Adaptive denoising based on SURE risk
Zhang, X.-P., & Desai, M. D. (1998) · IEEE Signal Processing Letters · doi:10.1109/97.720560 · Cited by 233
Li, K.-C. (1986) · The Annals of Statistics · doi:10.1214/aos/1176350052 · Cited by 223
A fast ?Monte-Carlo cross-validation? procedure for large least squares problems with noisy data
Girard, A. (1989) · Numerische Mathematik · doi:10.1007/bf01395775 · Cited by 220
Bayesian and regularization methods for hyperparameter estimation in image restoration
Molina, R., Katsaggelos, A. K., & Mateos, J. (1999) · IEEE Transactions on Image Processing · doi:10.1109/83.743857 · Cited by 206
Some large-scale matrix computation problems
Bai, Z., Fahey, G., & Golub, G. (1996) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(96)00018-0 · Cited by 195
Stochastic estimation with Z2 noise
Dong, S.-J., & Liu, K.-F. (1994) · Physics Letters B · doi:10.1016/0370-2693(94)90440-5 · Cited by 180
Stochastic fractal models for image processing
Pesquet‐Popescu, B., & Véhel, J. L. (2002) · IEEE Signal Processing Magazine · doi:10.1109/msp.2002.1028352 · Cited by 179
Maximum Entropy and Bayesian Methods
Hanson, K. M., & Silver, R. N. (1996) · Springer eBooks · doi:10.1007/978-94-011-5430-7 · Cited by 151
Regularization in Image Restoration and Reconstruction
Karl, W. C. (2005) · Elsevier eBooks · doi:10.1016/b978-012119792-6/50075-9 · Cited by 127
Figueiredo, M. A. T., Bioucas‐Dias, J. M., Oliveira, J., et al. (2006) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2006.313050 · Cited by 127
Building robust wavelet estimators for multicomponent images using Stein's principle
Benazza‐Benyahia, A., & Pesquet, J.-C. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.857247 · Cited by 87
On some Bayesian/regularization methods for image restoration
Archer, G. E., & Titterington, D. M. (1995) · IEEE Transactions on Image Processing · doi:10.1109/83.392339 · Cited by 73
Generalized smoothing splines and the optimal discretization of the Wiener filter
Unser, M. A., & Blu, T. (2005) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2005.847821 · Cited by 62
Self-citationWiener restoration of sampled image data: end-to-end analysis
Fales, C. L., McCormick, J. A., Park, S. K., & Huck, F. O. (1988) · Journal of the Optical Society of America A · doi:10.1364/josaa.5.000300 · Cited by 61
Oraintara, S., Karl, W. C., Castañón, D. A., & Nguyen, T.-T. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2000.900900 · Cited by 48
Hyperparameter estimation in image restoration problems with partially-known blurs
Galatsanos, N. P., Mesarović, V. Z., Molina, R., Katsaggelos, A. K., & Mateos, J. (2002) · Optical Engineering · doi:10.1117/1.1487850 · Cited by 41
A crossvalidatory AIC for hard wavelet thresholding in spatially adaptive function estimation
Hurvich, C. M. (1998) · Biometrika · doi:10.1093/biomet/85.3.701 · Cited by 32
Cited by
Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications
Chan, S. H., Wang, X., & Elgendy, O. A. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2629286 · Cited by 904
Accelerated Dynamic MRI Exploiting Sparsity and Low-Rank Structure: k-t SLR
Lingala, S. G., Hu, Y., DiBella, E., & Jacob, M. (2011) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2100850 · Cited by 664
Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content
Zhu, X., & Milanfar, P. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2052820 · Cited by 383
Optimal Inversion of the Anscombe Transformation in Low-Count Poisson Image Denoising
Makitalo, M., & Foi, A. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2056693 · Cited by 341
Model-Based Image Reconstruction for MRI
Fessler, J. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.936726 · Cited by 335
Metadata
- Authors
- Ramani, S., Blu, T., & Unser, M.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2008-09
- Volume
- 17
- Issue
- 9
- Pages
- 1540-1554
- ISSN
- 1057-7149 (ISSN-L)
- OpenAlex
- W2145568341
- Cited by
- 397
- References
- 48
- FWCI
- 18.14
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.