The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients
Abstract
This paper presents an information-theoretic analysis of statistical dependencies between image wavelet coefficients. The dependencies are measured using mutual information, which has a fundamental relationship to data compression, estimation, and classification performance. Mutual information is computed analytically for several statistical image models, and depends strongly on the choice of wavelet filters. In the absence of an explicit statistical model, a method is studied for reliably estimating mutual information from image data. The validity of the model-based and data-driven approaches is assessed on representative real-world photographic images. Our results are consistent with empirical observations that coding schemes exploiting inter- and intrascale dependencies alone perform very well, whereas taking both into account does not significantly improve coding performance. A similar observation applies to other image processing applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
A Wavelet Tour of Signal Processing
(1999) · Elsevier eBooks · doi:10.1016/b978-0-12-466606-1.x5000-4 · Cited by 16,227
Daubechies, I. (1992) · doi:10.1137/1.9781611970104 · Cited by 15,979
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Daubechies, I., & Heil, C. (1992) · Computers in Physics · doi:10.1063/1.4823127 · Cited by 15,631
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Density Estimation for Statistics and Data Analysis
(1986) · Springer eBooks · doi:10.1007/978-1-4899-3324-9 · Cited by 8,525
Fundamentals of digital image processing
Jain, A. K. (1988) · Cited by 7,111
A new, fast, and efficient image codec based on set partitioning in hierarchical trees
Said, A., & Pearlman, W. A. (1996) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.499834 · Cited by 5,353
Embedded image coding using zerotrees of wavelet coefficients
Shapiro, J. M. (1993) · IEEE Transactions on Signal Processing · doi:10.1109/78.258085 · Cited by 4,815
Fundamentals of digital image processing
(1989) · Computer Vision, Graphics, and Image Processing · doi:10.1016/0734-189x(89)90041-8 · Cited by 4,677
An Introduction to Signal Detection and Estimation
Poor, H. V. (1988) · Springer Texts in Electrical Engineering · doi:10.1007/978-1-4757-3863-6 · Cited by 3,149
Digital Image Enhancement and Noise Filtering by Use of Local Statistics
Lee, J.-S. (1980) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1980.4766994 · Cited by 2,728
An Introduction to Signal Detection and Estimation
Poor, H. V. (1994) · Springer Texts in Electrical Engineering · doi:10.1007/978-1-4757-2341-0 · Cited by 2,659
Time Series: Data Analysis and Theory.
Koopmans, L. H., & Brillinger, D. R. (1976) · Journal of the American Statistical Association · doi:10.2307/2285347 · Cited by 2,637
Blind signal separation: statistical principles
Cardoso, J.-F. (1998) · Proceedings of the IEEE · doi:10.1109/5.720250 · Cited by 1,885
Wavelet-based statistical signal processing using hidden Markov models
Crouse, M. S., Nowak, R. D., & Baraniuk, R. G. (1998) · IEEE Transactions on Signal Processing · doi:10.1109/78.668544 · Cited by 1,643
Alignment by maximization of mutual information
Viola, P., & Wells, W. M. (2002) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466930 · Cited by 1,082
An introduction to signal detection and estimation (2nd ed.)
Poor, H. V. (1994) · Springer eBooks · Cited by 1,008
A generalized Gaussian image model for edge-preserving MAP estimation
Bouman, C., & Sauer, K. (1993) · IEEE Transactions on Image Processing · doi:10.1109/83.236536 · Cited by 884
Time Series: Data Analysis and Theory.
Brillinger, D. R. (1981) · Biometrics · doi:10.2307/2530198 · Cited by 799
Low-complexity image denoising based on statistical modeling of wavelet coefficients
Kivanc Mihcak, M., Kozintsev, I., Ramchandran, K., & Moulin, P. (1999) · IEEE Signal Processing Letters · doi:10.1109/97.803428 · Cited by 780
Self-citationInformation and information stability of random variables and processes
(1964) · Journal of the Franklin Institute · doi:10.1016/0016-0032(64)90319-9 · Cited by 758
Optimization of mutual information for multiresolution image registration
Unser, M., & Thevenaz, P. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.887976 · Cited by 697
Noise removal via Bayesian wavelet coring
Simoncelli, E. P., & Adelson, E. H. (2002) · Proceedings of 3rd IEEE International Conference on Image Processing · doi:10.1109/icip.1996.559512 · Cited by 612
(1997) · SZTAKI Publication Repository (Hungarian Academy of Sciences) · Cited by 598
Probability, Random Processes, and Estimation Theory for Engineers
Stark, H., & Woods, J. W. (1986) · Cited by 584
Image compression via joint statistical characterization in the wavelet domain
Buccigrossi, R. W., & Simoncelli, E. P. (1999) · IEEE Transactions on Image Processing · doi:10.1109/83.806616 · Cited by 523
Estimation of the information by an adaptive partitioning of the observation space
Darbellay, G. A., & Vajda, I. (1999) · IEEE Transactions on Information Theory · doi:10.1109/18.761290 · Cited by 493
Scale Mixtures of Gaussians and the Statistics of Natural Images
Wainwright, M. J., & Simoncelli, E. P. (1999) · Cited by 450
Marcellin, M. W., Gormish, M. J., Bilgin, A., & Boliek, M. P. (2002) · Proceedings DCC 2000. Data Compression Conference · doi:10.1109/dcc.2000.838192 · Cited by 405
Information and Information Stability of Random Variables and Processes.
Brillinger, D. R., Pinsker, M. S., & Feinstein, A. (1964) · Applied Statistics · doi:10.2307/2985711 · Cited by 378
Multiscale image segmentation using wavelet-domain hidden Markov models
Choi, H., & Baraniuk, R. G. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.941855 · Cited by 358
Probability, Random Processes and Estimation Theory for Engineers.
RS, Stark, H., & Woods, J. W. (1995) · Journal of the American Statistical Association · doi:10.2307/2291115 · Cited by 347
Lower bounds for parametric estimation with constraints
Gorman, J. D., & Hero, A. O. (1990) · IEEE Transactions on Information Theory · doi:10.1109/18.59929 · Cited by 332
Wavelet-based image denoising using a Markov random field a priori model
Malfait, M., & Roose, D. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.563320 · Cited by 320
Kivanc Mihcak, M., Kozintsev, I., & Ramchandran, K. (1999) · 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258) · doi:10.1109/icassp.1999.757535 · Cited by 283
Advances in Independent Component Analysis
(2000) · Perspectives in Neural Computing · doi:10.1007/978-1-4471-0443-8 · Cited by 197
Random Cascades on Wavelet Trees and Their Use in Analyzing and Modeling Natural Images
Wainwright, M. J., Simoncelli, E. P., & Willsky, A. S. (2001) · Applied and Computational Harmonic Analysis · doi:10.1006/acha.2000.0350 · Cited by 196
Modeling the joint statistics of images in the wavelet domain:
Simoncelli, E. P. (1999) · SPIE Proceedings · doi:10.1117/12.366779 · Cited by 193
Hall, P., & Morton, S. C. (1993) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf00773669 · Cited by 193
Image coding based on a morphological representation of wavelet data
Servetto, S. D., Ramchandran, K., & Orchard, M. T. (1999) · IEEE Transactions on Image Processing · doi:10.1109/83.784429 · Cited by 169
Multiscale modeling and estimation of Poisson processes with application to photon-limited imaging
Timmermann, K. E., & Nowak, R. D. (1999) · IEEE Transactions on Information Theory · doi:10.1109/18.761328 · Cited by 166
(1997) · Choice Reviews Online · doi:10.5860/choice.34-4526 · Cited by 120
Li, J., Gray, R. M., & Olshen, R. A. (2000) · IEEE Transactions on Information Theory · doi:10.1109/18.857794 · Cited by 120
Information-theoretic image formation
O’Sullivan, J. A., Blahut, R. E., & Snyder, D. L. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720533 · Cited by 119
Grenander, U. (1996) · Johns Hopkins University Press eBooks · doi:10.56021/9780801851872 · Cited by 107
Modeling the Joint Statistics of Images in the Wavelet Domain
Simoncelli, E. P. (1999) · Cited by 58
Cited by
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency
Sendur, L., & Selesnick, I. W. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2002.804091 · Cited by 1,014
Modern Image Quality Assessment
Wang, Z., & Bovik, A. C. (2006) · Synthesis Lectures on Image, Video, and Multimedia Processing · doi:10.1007/978-3-031-02238-8 · Cited by 967
Directional multiscale modeling of images using the contourlet transform
Po, D. D.-Y., & Do, M. N. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.873450 · Cited by 576
Modern Image Quality Assessment
Wang, Z., & Bovik, A. C. (2006) · Synthesis lectures on image, video, and multimedia processing · doi:10.2200/s00010ed1v01y200508ivm003 · Cited by 501
Metadata
- Authors
- Liu, J., & Moulin, P.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2001
- Volume
- 10
- Issue
- 11
- Pages
- 1647-1658
- ISSN
- 1057-7149 (ISSN-L)
- OpenAlex
- W2139282590
- Cited by
- 265
- References
- 49
- FWCI
- 11.86
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.