The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Data compression and harmonic analysis
Open accessAbstract
In this paper we review some recent interactions between harmonic analysis and data compression. The story goes back of course to Shannon's R(D) theory in the case of Gaussian stationary processes, which says that transforming into a Fourier basis followed by block coding gives an optimal lossy compression technique; practical developments like transform-based image compression have been inspired by this result. In this paper we also discuss connections perhaps less familiar to the information theory community, growing out of the field of harmonic analysis. Recent harmonic analysis constructions, such as wavelet transforms and Gabor transforms, are essentially optimal transforms for transform coding in certain settings. Some of these transforms are under consideration for future compression standards. We discuss some of the lessons of harmonic analysis in this century. Typically, the problems and achievements of this field have involved goals that were not obviously related to practical data compression, and have used a language not immediately accessible to outsiders. Nevertheless, through an extensive generalization of what Shannon called the "sampling theorem", harmonic analysis has succeeded in developing new forms of functional representation which turn out to have significant data compression interpretations. We explain why harmonic analysis has interacted with data compression, and we describe some interesting recent ideas in the field that may affect data compression in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
A theory for multiresolution signal decomposition: the wavelet representation
Mallat, S. G. (1989) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.192463 · Cited by 21,372
Daubechies, I. (1992) · doi:10.1137/1.9781611970104 · Cited by 15,979
Self-citationDaubechies, I., & Heil, C. (1992) · Computers in Physics · doi:10.1063/1.4823127 · Cited by 15,631
Self-citationSingular Integrals and Differentiability Properties of Functions.
Stein, E. M. (1971) · Cited by 10,183
Orthonormal bases of compactly supported wavelets
Daubechies, I. (1988) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.3160410705 · Cited by 8,190
Self-citationVector Quantization and Signal Compression
Gersho, A., & Gray, R. M. (1992) · Springer eBooks · doi:10.1007/978-1-4615-3626-0 · Cited by 7,003
Communication in the presence of noise
Shannon, C. E. (1949) · Proceedings of the IRE · doi:10.1109/jrproc.1949.232969 · Cited by 6,539
The wavelet transform, time-frequency localization and signal analysis
Daubechies, I. (1990) · IEEE Transactions on Information Theory · doi:10.1109/18.57199 · Cited by 6,483
Self-citationA new, fast, and efficient image codec based on set partitioning in hierarchical trees
Said, A., & Pearlman, W. A. (1996) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.499834 · Cited by 5,353
Ahmed, N., Natarajan, T., & Rao, K. R. (1974) · IEEE Transactions on Computers · doi:10.1109/t-c.1974.223784 · Cited by 5,156
Габор, Д. (1946) · Journal of the IEE · Cited by 5,036
Embedded image coding using zerotrees of wavelet coefficients
Shapiro, J. M. (1993) · IEEE Transactions on Signal Processing · doi:10.1109/78.258085 · Cited by 4,815
Communication In The Presence Of Noise
Shannon, C. E. (1998) · Proceedings of the IEEE · doi:10.1109/jproc.1998.659497 · Cited by 4,804
Triebel, H. (1983) · Springer eBooks · doi:10.1007/978-3-0346-0416-1 · Cited by 4,194
Decomposition of Hardy Functions into Square Integrable Wavelets of Constant Shape
Grossmann, A., & Morlet, J. (1984) · SIAM Journal on Mathematical Analysis · doi:10.1137/0515056 · Cited by 3,624
Relations between the statistics of natural images and the response properties of cortical cells
Field, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002379 · Cited by 3,241
Entropy-based algorithms for best basis selection
Coifman, R. R., & Wickerhauser, M. V. (1992) · IEEE Transactions on Information Theory · doi:10.1109/18.119732 · Cited by 3,188
Vetterli, M., & Kovačević, J. (1995) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 2,898
Self-citationDeVore, R. A., & Lorentz, G. G. (1993) · Grundlehren der mathematischen Wissenschaften · doi:10.1007/978-3-662-02888-9 · Cited by 2,352
Self-citationHarmonic analysis in phase space
Folland, G. B. (1989) · Medical Entomology and Zoology · Cited by 1,960
Gray, R. M., & Neuhoff, D. L. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.720541 · Cited by 1,642
Harmonic Analysis in Phase Space. (AM-122)
Folland, G. B. (1989) · Princeton University Press eBooks · doi:10.1515/9781400882427 · Cited by 1,257
What Is the Goal of Sensory Coding?
Field, D. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.4.559 · Cited by 1,183
Coherent States: Applications in Physics and Mathematical Physics
Klauder, J., & Skagerstam, B. (1985) · WORLD SCIENTIFIC eBooks · doi:10.1142/0096 · Cited by 1,156
Wavelets on the Interval and Fast Wavelet Transforms
Cohen, A. K., Daubechies, I. C., & Vial, P. (1993) · Applied and Computational Harmonic Analysis · doi:10.1006/acha.1993.1005 · Cited by 1,025
Self-citationWoods, J., & O'Neil, S. (1986) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1986.1164962 · Cited by 1,016
Muraki, E., Ramsay, J. O., & Silverman, B. W. (1999) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165264 · Cited by 1,013
The Volume of Convex Bodies and Banach Space Geometry
Pisier, G. (1989) · Cambridge University Press eBooks · doi:10.1017/cbo9780511662454 · Cited by 967
Rate distortion theory : a mathematical basis for data compression
Berger, T. (1971) · Prentice Hall eBooks · Cited by 953
Ramsay, J. O., & Silverman, B. W. (1997) · Springer Series in Statistics · doi:10.1007/978-1-4757-7107-7 · Cited by 932
Image compression through wavelet transform coding
DeVore, R. A., Jawerth, B., & Lucier, B. J. (1992) · IEEE Transactions on Information Theory · doi:10.1109/18.119733 · Cited by 910
Self-citationRate Distortion Theory: A Mathematical Basis for Data Compression
Davisson, L. (1972) · IEEE Transactions on Communications · doi:10.1109/tcom.1972.1091311 · Cited by 895
DeVore, R. A. (1998) · Acta Numerica · doi:10.1017/s0962492900002816 · Cited by 877
Self-citationLittlewood-Paley Theory and the Study of Function Spaces
Frazier, M., Jawerth, B., & Weiss, G. (1991) · CBMS Regional Conference Series in Mathematics · doi:10.1090/cbms/079 · Cited by 831
Image compression using the 2-D wavelet transform
Lewis, A. S., & Knowles, G. (1992) · IEEE Transactions on Image Processing · doi:10.1109/83.136601 · Cited by 718
Best wavelet packet bases in a rate-distortion sense
Ramchandran, K., & Vetterli, M. (1993) · IEEE Transactions on Image Processing · doi:10.1109/83.217221 · Cited by 679
Self-citationModesitt, V., & Hardy, G. H. (1942) · National Mathematics Magazine · doi:10.2307/3028462 · Cited by 635
Fefferman, C. L. (1983) · Bulletin of the American Mathematical Society · doi:10.1090/s0273-0979-1983-15154-6 · Cited by 533
The LOT: transform coding without blocking effects
Malvar, H. S., & Staelin, D. H. (1989) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.17536 · Cited by 483
The Sizes of Compact Subsets of Hilbert Space and Continuity of Gaussian Processes
Dudley, R. M. (2010) · Selected Works of R.M. Dudley · doi:10.1007/978-1-4419-5821-1_11 · Cited by 438
The sizes of compact subsets of Hilbert space and continuity of Gaussian processes
Dudley, R. M. (1967) · Journal of Functional Analysis · doi:10.1016/0022-1236(67)90017-1 · Cited by 423
Convergence of Estimates Under Dimensionality Restrictions
LeCam, L. (1973) · The Annals of Statistics · doi:10.1214/aos/1193342380 · Cited by 422
Unconditional Bases Are Optimal Bases for Data Compression and for Statistical Estimation
Donoho, D. L. (1993) · Applied and Computational Harmonic Analysis · doi:10.1006/acha.1993.1008 · Cited by 421
Self-citationOn the Shannon theory of information transmission in the case of continuous signals
Kolmogorov, A. (1956) · IRE Transactions on Information Theory · doi:10.1109/tit.1956.1056823 · Cited by 394
Block Quantization of Correlated Gaussian Random Variables
Huang, J., & Schultheiss, P. (1963) · IEEE Transactions on Communications · doi:10.1109/tcom.1963.1088759 · Cited by 386
Analysis of and on Uniformly Rectifiable Sets
David, G., & Semmes, S. (1993) · Mathematical Surveys and Monographs · doi:10.1090/surv/038 · Cited by 379
Origins of scaling in natural images
Ruderman, D. L. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00008-4 · Cited by 355
Ondelettes et bases hilbertiennes
Lemarié-Rieusset, P. G., & Meyer, Y. (1986) · Revista Matemática Iberoamericana · doi:10.4171/rmi/22 · Cited by 349
Compression of wavelet decompositions
DeVore, R., Jawerth, B. D., & Попов, В. В. (2009) · Princeton University Press eBooks · doi:10.1515/9781400827268.784 · Cited by 298
Self-citationAnalysis of low bit rate image transform coding
Mallat, S., & Falzon, F. (1998) · IEEE Transactions on Signal Processing · doi:10.1109/78.668554 · Cited by 288
Statistical models for images: compression, restoration and synthesis
Simoncelli, E. P. (2002) · Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136) · doi:10.1109/acssc.1997.680530 · Cited by 270
Rectifiable sets and the Traveling Salesman Problem
Jones, P. W. (1990) · Inventiones Mathematicae · doi:10.1007/bf01233418 · Cited by 259
A Simple Wilson Orthonormal Basis with Exponential Decay
Daubechies, I., Jaffard, S., & Journé, J.-L. (1991) · SIAM Journal on Mathematical Analysis · doi:10.1137/0522035 · Cited by 236
Self-citationPIECEWISE-POLYNOMIAL APPROXIMATIONS OF FUNCTIONS OF THE CLASSES $ W_{p}^{\alpha}$
Birman, M. Š., & Solomjak, M. Z. (1967) · Mathematics of the USSR-Sbornik · doi:10.1070/sm1967v002n03abeh002343 · Cited by 222
CART and best-ortho-basis: a connection
Donoho, D. L. (1997) · The Annals of Statistics · doi:10.1214/aos/1069362377 · Cited by 210
Self-citationMetric entropy and approximation
Lorentz, G. G. (1966) · Bulletin of the American Mathematical Society · doi:10.1090/s0002-9904-1966-11586-0 · Cited by 169
Tree Approximation and Optimal Encoding
Cohen, A. K., Dahmen, W., Daubechies, I. C., & DeVore, R. (2001) · Applied and Computational Harmonic Analysis · doi:10.1006/acha.2001.0336 · Cited by 156
Self-citationLocal Sine and Cosine Bases of Coifman and Meyer and the Construction of Smooth Wavelets
Auscher, P., Wells, R. O., & Wickerhauser, M. V. (1992) · Elsevier eBooks · doi:10.1016/b978-0-12-174590-5.50014-9 · Cited by 151
Subband coding of images using vector quantization
Westerink, P. H., Boekee, D. E., Biemond, J., & Woods, J. W. (1988) · IEEE Transactions on Communications · doi:10.1109/26.2791 · Cited by 149
Jaffard, S. (1991) · Vieweg+Teubner eBooks · doi:10.1007/978-3-663-01312-9_3 · Cited by 147
Kahane, J., & Lemarié–Rieusset, P. G. (1995) · Cited by 140
On the importance of combining wavelet-based nonlinear approximation with coding strategies
Cohen, A. K., Daubechies, I. C., Guleryuz, O. G., & Orchard, M. T. (2002) · IEEE Transactions on Information Theory · doi:10.1109/tit.2002.1013132 · Cited by 135
Self-citationWoods, J., & O'Neil, S. D. (2005) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1986.1168863 · Cited by 121
Unitary Representations of the Affine Group
Aslaksen, E. W., & Klauder, J. R. (1968) · Journal of Mathematical Physics · doi:10.1063/1.1664570 · Cited by 112
An Adaptive Compression Algorithm in Besov Spaces
Birgé, L., & Massart, P. (2000) · Constructive Approximation · doi:10.1007/s003659910001 · Cited by 61
Unconditional Bases and Bit-Level Compression
Donoho, D. L. (1996) · Applied and Computational Harmonic Analysis · doi:10.1006/acha.1996.0032 · Cited by 58
Self-citationNonlinear Approximation of Random Functions
Cohen, A. K., & d’Ales, J.-P. (1997) · SIAM Journal on Applied Mathematics · doi:10.1137/s0036139994279153 · Cited by 56
Orthonormal Bases of Compactly Supported Wavelets III. Better Frequency Resolution
Cohen, A. K., & Daubechies, I. C. (1993) · SIAM Journal on Mathematical Analysis · doi:10.1137/0524032 · Cited by 42
Self-citationComputation-distortion characteristics of block transform coding
Goyal, V. K., & Vetterli, M. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1997.595353 · Cited by 25
Self-citation
Cited by
Donoho, D. L. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.871582 · Cited by 23,994
Self-citationNear-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies?
Candes, E. J., & Tao, T. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.885507 · Cited by 6,839
Halko, N., Martinsson, P. G., & Tropp, J. A. (2011) · SIAM Review · doi:10.1137/090771806 · Cited by 4,002
The contourlet transform: an efficient directional multiresolution image representation
Do, M. N., & Vetterli, M. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.859376 · Cited by 3,952
Self-citationNew tight frames of curvelets and optimal representations of objects with piecewise C2 singularities
Candès, E. J., & Donoho, D. L. (2004) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.10116 · Cited by 1,545
Self-citation
Metadata
- Authors
- Donoho, D. L., Vetterli, M., DeVore, R. A., & Daubechies, I.
- Venue
- IEEE Transactions on Information Theory
- Published
- 1998
- Volume
- 44
- Issue
- 6
- Pages
- 2435-2476
- ISSN
- 0018-9448 (ISSN-L)
- OpenAlex
- W2096613063
- Cited by
- 432
- References
- 72
- FWCI
- 21.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.