The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Probabilistic framework for the adaptation and comparison of image codes
Abstract
We apply a Bayesian method for inferring an optimal basis to the problem of finding efficient image codes for natural scenes. The basis functions learned by the algorithm are oriented and localized in both space and frequency, bearing a resemblance to two-dimensional Gabor functions, and increasing the number of basis functions results in a greater sampling density in position, orientation, and scale. These properties also resemble the spatial receptive fields of neurons in the primary visual cortex of mammals, suggesting that the receptive-field structure of these neurons can be accounted for by a general efficient coding principle. The probabilistic framework provides a method for comparing the coding efficiency of different bases objectively by calculating their probability given the observed data or by measuring the entropy of the basis function coefficients. The learned bases are shown to have better coding efficiency than traditional Fourier and wavelet bases. This framework also provides a Bayesian solution to the problems of image denoising and filling in of missing pixels. We demonstrate that the results obtained by applying the learned bases to these problems are improved over those obtained with traditional techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Matching pursuits with time-frequency dictionaries
Mallat, S. G., & Zhang, Z. (1993) · IEEE Transactions on Signal Processing · doi:10.1109/78.258082 · Cited by 9,112
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Independent component analysis, A new concept?
Comon, P. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90029-9 · Cited by 8,205
Orthonormal bases of compactly supported wavelets
Daubechies, I. (1988) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.3160410705 · Cited by 8,190
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596304010 · Cited by 6,845
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
Self-citationBayesian Learning for Neural Networks
Neal, R. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0745-0 · Cited by 4,276
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Self-citationDaugman, J. G. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.001160 · Cited by 3,219
Entropy-based algorithms for best basis selection
Coifman, R. R., & Wickerhauser, M. V. (1992) · IEEE Transactions on Information Theory · doi:10.1109/18.119732 · Cited by 3,188
Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture
Jutten, C., & Herault, J. (1991) · Signal Processing · doi:10.1016/0165-1684(91)90079-x · Cited by 2,521
The “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 2,201
Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression
Daugman, J. G. (1988) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.1644 · Cited by 1,810
Barlow, H. B. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.295 · Cited by 1,650
Image representation using 2D Gabor wavelets
Lee, T. S. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.541406 · Cited by 1,629
Spatial frequency selectivity of cells in macaque visual cortex
De Valois, R. L., Albrecht, D. G., & Thorell, L. G. (1982) · Vision Research · doi:10.1016/0042-6989(82)90113-4 · Cited by 1,489
Self-organization in a perceptual network
Linsker, R. (1988) · Computer · doi:10.1109/2.36 · Cited by 1,469
Shiftable multiscale transforms
Simoncelli, E. P., Freeman, W. T., Adelson, E. H., & Heeger, D. J. (1992) · IEEE Transactions on Information Theory · doi:10.1109/18.119725 · Cited by 1,333
Mathematical description of the responses of simple cortical cells*
Marĉelja, S. (1980) · Journal of the Optical Society of America · doi:10.1364/josa.70.001297 · Cited by 1,252
What Is the Goal of Sensory Coding?
Field, D. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.4.559 · Cited by 1,183
Learning Overcomplete Representations
Lewicki, M. S., & Sejnowski, T. J. (2000) · Neural Computation · doi:10.1162/089976600300015826 · Cited by 1,129
Self-citationIndependent component filters of natural images compared with simple cells in primary visual cortex
van Hateren, J. H., & van der Schaaf, A. (1998) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1998.0303 · Cited by 1,106
Learning and relearning in Boltzmann machines
Hinton, G. E., & Sejnowski, T. J. (2001) · Graphical Models · doi:10.7551/mitpress/3349.003.0005 · Cited by 1,037
The statistics of natural images
Ruderman, D. (1994) · Network: Computation in Neural Systems · doi:10.1088/0954-898x/5/4/006 · Cited by 941
Karhunen–Loève procedure for gappy data
Everson, R., & Sirovich, L. (1995) · Journal of the Optical Society of America A · doi:10.1364/josaa.12.001657 · Cited by 906
Infomax and maximum likelihood for blind source separation
Cardoso, J.-F. (1997) · IEEE Signal Processing Letters · doi:10.1109/97.566704 · Cited by 684
Could information theory provide an ecological theory of sensory processing?
Atick, J. J. (2011) · Network: Computation in Neural Systems · doi:10.3109/0954898x.2011.638888 · Cited by 679
Noise removal via Bayesian wavelet coring
Simoncelli, E. P., & Adelson, E. H. (2002) · Proceedings of 3rd IEEE International Conference on Image Processing · doi:10.1109/icip.1996.559512 · Cited by 612
An affine scaling methodology for best basis selection
Rao, B. D., & Kreutz-Delgado, K. (1999) · IEEE Transactions on Signal Processing · doi:10.1109/78.738251 · Cited by 526
Image compression via joint statistical characterization in the wavelet domain
Buccigrossi, R. W., & Simoncelli, E. P. (1999) · IEEE Transactions on Image Processing · doi:10.1109/83.806616 · Cited by 523
Attias, H. (1999) · Neural Computation · doi:10.1162/089976699300016458 · Cited by 504
Chen, S., & Donoho, D. L. (1994) · Cited by 467
Could information theory provide an ecological theory of sensory processing?
Atick, J. J. (1992) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_3_2_009 · Cited by 446
Minimax Entropy Principle and Its Application to Texture Modeling
Zhu, S. C., Wu, Y. N., & Mumford, D. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1627 · Cited by 420
van Hateren, J. H., & Ruderman, D. L. (1998) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1998.0577 · Cited by 407
Reliable online human signature verification systems
Lee, L. L., Berger, T., & Aviczer, E. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.506415 · Cited by 375
Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex
Rao, R. P. N., & Ballard, D. H. (1997) · Neural Computation · doi:10.1162/neco.1997.9.4.721 · Cited by 290
Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer
Nadal, J., & Parga, N. (1994) · Network Computation in Neural Systems · doi:10.1088/0954-898x/5/4/008 · Cited by 282
The principal components of natural images
Hancock, P., Baddeley, R., & Smith, L. S. (1992) · Network Computation in Neural Systems · doi:10.1088/0954-898x/3/1/008 · Cited by 233
Entropy reduction and decorrelation in visual coding by oriented neural receptive fields
Daugman, J. G. (1989) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.16456 · Cited by 152
Maximum Likelihood Blind Source Separation: A Context-Sensitive Generalization of ICA
Pearlmutter, B. A., & Parra, L. C. (1996) · Cited by 143
What is the Goal of Sensory Coding?
Field, D. J. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/7011.003.0008 · Cited by 130
Two-dimensional spatial structure of receptive fields in monkey striate cortex
Parker, A. J., & Hawken, M. J. (1988) · Journal of the Optical Society of America A · doi:10.1364/josaa.5.000598 · Cited by 86
Whitteridge, D. (1959) · The Lancet · doi:10.1016/s0140-6736(59)90152-7 · Cited by 69
Nadal, J., & Parga, N. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1421 · Cited by 41
Finding compact and sparse-distributed representations of visual images
Fyfe, C., & Baddeley, R. J. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x_6_3_002 · Cited by 39
Rao, R. P. N., & Ballard, D. H. (1998) · Network Computation in Neural Systems · doi:10.1088/0954-898x_9_2_005 · Cited by 37
Cited by
$rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
Aharon, M., Elad, M., & Bruckstein, A. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2006.881199 · Cited by 9,451
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460
Self-citationFrom Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
Bruckstein, A. M., Donoho, D. L., & Elad, M. (2009) · SIAM Review · doi:10.1137/060657704 · Cited by 2,183
Face recognition by independent component analysis
Bartlett, M. S., Movellan, J. R., & Sejnowski, T. J. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.804287 · Cited by 1,930
Independent Component Analysis: Principles and Practice
(2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511624148 · Cited by 1,917
Metadata
- Authors
- Lewicki, M. S., & Olshausen, B. A.
- Venue
- Journal of the Optical Society of America A
- Publisher
- Optica Publishing Group
- Published
- 1999-07-01
- Volume
- 16
- Issue
- 7
- Pages
- 1587
- ISSN
- 1084-7529 (ISSN-L)
- 1520-8532
- OpenAlex
- W2061659108
- Cited by
- 308
- References
- 47
- FWCI
- 26.95
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.