The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Analysis of multiresolution image denoising schemes using generalized Gaussian and complexity priors
Abstract
Research on universal and minimax wavelet shrinkage and thresholding methods has demonstrated near-ideal estimation performance in various asymptotic frameworks. However, image processing practice has shown that universal thresholding methods are outperformed by simple Bayesian estimators assuming independent wavelet coefficients and heavy-tailed priors such as generalized Gaussian distributions (GGDs). In this paper, we investigate various connections between shrinkage methods and maximum a posteriori (MAP) estimation using such priors. In particular, we state a simple condition under which MAP estimates are sparse. We also introduce a new family of complexity priors based upon Rissanen's universal prior on integers. One particular estimator in this class outperforms conventional estimators based on earlier applications of the minimum description length (MDL) principle. We develop analytical expressions for the shrinkage rules implied by GGD and complexity priors. This allows us to show the equivalence between universal hard thresholding, MAP estimation using a very heavy-tailed GGD, and MDL estimation using one of the new complexity priors. Theoretical analysis supported by numerous practical experiments shows the robustness of some of these estimates against mis-specifications of the prior-a basic concern in image processing applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
A theory for multiresolution signal decomposition: the wavelet representation
Mallat, S. G. (1989) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.192463 · Cited by 21,372
(1972) · Cited by 17,806
Daubechies, I. (1992) · doi:10.1137/1.9781611970104 · Cited by 15,979
Daubechies, I., & Heil, C. (1992) · Computers in Physics · doi:10.1063/1.4823127 · Cited by 15,631
De-noising by soft-thresholding
Donoho, D. L. (1995) · IEEE Transactions on Information Theory · doi:10.1109/18.382009 · Cited by 9,619
Ideal spatial adaptation by wavelet shrinkage
Donoho, D. L., & Johnstone, I. M. (1994) · Biometrika · doi:10.1093/biomet/81.3.425 · Cited by 8,760
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
Advanced Mathematical Methods for Scientists and Engineers I
Bender, C. M., & Orszag, S. A. (1999) · doi:10.1007/978-1-4757-3069-2 · Cited by 4,906
Embedded image coding using zerotrees of wavelet coefficients
Shapiro, J. M. (1993) · IEEE Transactions on Signal Processing · doi:10.1109/78.258085 · Cited by 4,815
(1967) · Project Euclid (Cornell University) · Cited by 4,720
Adapting to Unknown Smoothness via Wavelet Shrinkage
Donoho, D. L., & Johnstone, I. M. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476626 · Cited by 4,630
An Introduction to Signal Detection and Estimation
Poor, H. V. (1994) · Springer Texts in Electrical Engineering · doi:10.1007/978-1-4757-2341-0 · Cited by 2,659
Three approaches to the quantitative definition of information*
Kolmogorov, A. N. (1968) · International Journal of Computer Mathematics · doi:10.1080/00207166808803030 · Cited by 2,031
Better Subset Regression Using the Nonnegative Garrote
Breiman, L. (1995) · Technometrics · doi:10.1080/00401706.1995.10484371 · Cited by 1,043
Image compression through wavelet transform coding
DeVore, R. A., Jawerth, B., & Lucier, B. J. (1992) · IEEE Transactions on Information Theory · doi:10.1109/18.119733 · Cited by 910
Universal coding, information, prediction, and estimation
Rissanen, J. (1984) · IEEE Transactions on Information Theory · doi:10.1109/tit.1984.1056936 · Cited by 898
Estimation, Inference and Specification Analysis
White, H. (1994) · Cambridge University Press eBooks · doi:10.1017/ccol0521252806 · Cited by 738
STOCHASTIC COMPLEXITY IN STATISTICAL INQUIRY
Dawid, A. P. (1991) · Bulletin of the London Mathematical Society · doi:10.1112/blms/23.1.106 · Cited by 651
Noise removal via Bayesian wavelet coring
Simoncelli, E. P., & Adelson, E. H. (2002) · Proceedings of 3rd IEEE International Conference on Image Processing · doi:10.1109/icip.1996.559512 · Cited by 612
Nonlinear Solution of Linear Inverse Problems by Wavelet–Vaguelette Decomposition
Donoho, D. L. (1995) · Applied and Computational Harmonic Analysis · doi:10.1006/acha.1995.1008 · Cited by 608
Adaptive Bayesian Wavelet Shrinkage
Chipman, H. A., Kolaczyk, E. D., & McCulloch, R. E. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10473662 · Cited by 553
Minimum complexity density estimation
Barron, A. R., & Cover, T. M. (1991) · IEEE Transactions on Information Theory · doi:10.1109/18.86996 · Cited by 497
Essential wavelets for statistical applications and data analysis
Ogden, R. T. (1997) · Choice Reviews Online · doi:10.5860/choice.34-5146 · Cited by 444
Wavelet Shrinkage Using Cross-Validation
Nason, G. P. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02094.x · Cited by 364
Wavelet Shrinkage Denoising Using the Non-Negative Garrote
Gao, H.-Y. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474789 · Cited by 364
From Model Selection to Adaptive Estimation
Birgé, L., & Massart, P. (1997) · Festschrift for Lucien Le Cam · doi:10.1007/978-1-4612-1880-7_4 · Cited by 344
Essential Wavelets for Statistical Applications and Data Analysis
Ogden, R. T. (1997) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4612-0709-2 · Cited by 299
Nonlinear Wavelet Shrinkage with Bayes Rules and Bayes Factors
Vidakovic, B. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10474099 · Cited by 294
Multiple shrinkage and subset selection in wavelets
Clyde, M. (1998) · Biometrika · doi:10.1093/biomet/85.2.391 · Cited by 248
Bayesian approach to best basis selection
Pesquet, J.-C., Krim, H., Leporini, D., & Hamman, E. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1996.548005 · Cited by 56
Complexity-regularized image denoising
Liu, J., & Moulin, P. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1997.638778 · Cited by 43
Self-citation
Cited by
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
Elad, M., & Aharon, M. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.881969 · Cited by 5,321
Image denoising using scale mixtures of gaussians in the wavelet domain
Portilla, J., Strela, V., Wainwright, M. J., & Simoncelli, E. P. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.818640 · Cited by 2,255
From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
Bruckstein, A. M., Donoho, D. L., & Elad, M. (2009) · SIAM Review · doi:10.1137/060657704 · Cited by 2,183
A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration
Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.909319 · Cited by 2,064
Metadata
- Authors
- Moulin, P., & Liu, J.
- Venue
- IEEE Transactions on Information Theory
- Published
- 1999-04
- Volume
- 45
- Issue
- 3
- Pages
- 909-919
- ISSN
- 0018-9448 (ISSN-L)
- OpenAlex
- W2124335859
- Cited by
- 500
- References
- 32
- FWCI
- 17.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.