The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
What Is the Goal of Sensory Coding?
Abstract
A number of recent attempts have been made to describe early sensory coding in terms of a general information processing strategy. In this paper, two strategies are contrasted. Both strategies take advantage of the redundancy in the environment to produce more effective representations. The first is described as a “compact” coding scheme. A compact code performs a transform that allows the input to be represented with a reduced number of vectors (cells) with minimal RMS error. This approach has recently become popular in the neural network literature and is related to a process called Principal Components Analysis (PCA). A number of recent papers have suggested that the optimal “compact” code for representing natural scenes will have units with receptive field profiles much like those found in the retina and primary visual cortex. However, in this paper, it is proposed that compact coding schemes are insufficient to account for the receptive field properties of cells in the mammalian visual pathway. In contrast, it is proposed that the visual system is near to optimal in representing natural scenes only if optimality is defined in terms of “sparse distributed” coding. In a sparse distributed code, all cells in the code have an equal response probability across the class of images but have a low response probability for any single image. In such a code, the dimensionality is not reduced. Rather, the redundancy of the input is transformed into the redundancy of the firing pattern of cells. It is proposed that the signature for a sparse code is found in the fourth moment of the response distribution (i.e., the kurtosis). In measurements with 55 calibrated natural scenes, the kurtosis was found to peak when the bandwidths of the visual code matched those of cells in the mammalian visual cortex. Codes resembling “wavelet transforms” are proposed to be effective because the response histograms of such codes are sparse (i.e., show high kurtosis) when presented with natural scenes. It is proposed that the structure of the image that allows sparse coding is found in the phase spectrum of the image. It is suggested that natural scenes, to a first approximation, can be considered as a sum of self-similar local functions (the inverse of a wavelet). Possible reasons for why sensory systems would evolve toward sparse coding are presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Laplacian pyramid as a compact image code
Burt, P., & Adelson, E. (1983) · IEEE Transactions on Communications · doi:10.1109/tcom.1983.1095851 · Cited by 6,077
Daugman, J. G. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.001160 · Cited by 3,219
Simplified neuron model as a principal component analyzer
Oja, E. (1982) · Journal of Mathematical Biology · doi:10.1007/bf00275687 · Cited by 2,309
Jones, J. P., & Palmer, L. A. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.58.6.1233 · Cited by 1,658 · cited 2×
“Although the Gabor function has found some support in the physiology (Webster and DeValois 1985; Field and Tolhurst 1986; Jones and Palmer 1987 ), other functions have been proposed such as the Cauchy (Klein and Levi 1985) and the log-Gabor used in this study (Field 1987).”
Method
Cited by
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
Self-citationSparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Self-citationNatural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460
The “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 2,201
Sparse coding of sensory inputs
Olshausen, B. A., & Field, D. J. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.07.007 · Cited by 1,404
Self-citationLei, Y., Jia, F., Lin, J., Xing, S., & Ding, S. X. (2016) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2519325 · Cited by 1,191
Independent component filters of natural images compared with simple cells in primary visual cortex
van Hateren, J. H., & van der Schaaf, A. (1998) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1998.0303 · Cited by 1,106
Blind deconvolution using a normalized sparsity measure
Krishnan, D., Tay, T., & Fergus, R. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995521 · Cited by 1,119
Visual statistical learning in infancy: evidence for a domain general learning mechanism
Kirkham, N. Z., Slemmer, J. A., & Johnson, S. P. (2002) · Cognition · doi:10.1016/s0010-0277(02)00004-5 · Cited by 1,072
Modern Image Quality Assessment
Wang, Z., & Bovik, A. C. (2006) · Synthesis Lectures on Image, Video, and Multimedia Processing · doi:10.1007/978-3-031-02238-8 · Cited by 967
Communication in neuronal networks
Laughlin, S. B., & Sejnowski, T. J. (2003) · Science · doi:10.1126/science.1089662 · Cited by 950
Visual features of intermediate complexity and their use in classification
Ullman, S., Vidal-Naquet, M., & Sali, E. (2002) · Nature Neuroscience · doi:10.1038/nn870 · Cited by 600
Minicolumnar abnormalities in autism
Casanova, M. F., van Kooten, I. A. J., Switala, A. E., van Engeland, H., Heinsen, H., Steinbusch, H. W. M., Hof, P. R., Trippe, J., Stone, J., & Schmitz, C. (2006) · Acta Neuropathologica · doi:10.1007/s00401-006-0085-5 · Cited by 499
Reduced-reference image quality assessment using a wavelet-domain natural image statistic model
Wang, Z., & Simoncelli, E. P. (2005) · SPIE Proceedings · doi:10.1117/12.597306 · Cited by 438
Wang, Z., Wu, G., Sheikh, H. R., Simoncelli, E. P., Yang, E.-H., & Bovik, A. C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.864165 · Cited by 293
Sparse coding based visual tracking: Review and experimental comparison
Zhang, S., Yao, H., Sun, X., & Lu, X. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2012.10.006 · Cited by 284
Reduced- and No-Reference Image Quality Assessment
Wang, Z., & Bovik, A. (2011) · IEEE Signal Processing Magazine · doi:10.1109/msp.2011.942471 · Cited by 280
Zhi, R., Flierl, M., Ruan, Q., & Kleijn, W. B. (2011) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2044788 · Cited by 260
Allocating structure to function: the strong links between neuroplasticity and natural selection
Anderson, M. L., & Finlay, B. L. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00918 · Cited by 115
Understanding vision in wholly empirical terms
Purves, D., Wojtach, W. T., & Lotto, R. B. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012178108 · Cited by 106
Neural correlates of sparse coding and dimensionality reduction
Beyeler, M., Rounds, E. L., Carlson, K. D., Dutt, N., & Krichmar, J. L. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006908 · Cited by 104
Zhang, Y., Moorthy, A. K., Chandler, D. M., & Bovik, A. C. (2014) · Signal Processing: Image Communication · doi:10.1016/j.image.2014.05.004 · Cited by 102
Chen, K., Kogan, J. F., & Fontanini, A. (2021) · Current Biology · doi:10.1016/j.cub.2020.10.014 · Cited by 66
Towards an Ecology of Motion Vision
Eckert, M. P., & Zeil, J. (2001) · Motion Vision · doi:10.1007/978-3-642-56550-2_18 · Cited by 57
Montijn, J. S., Goltstein, P. M., & Pennartz, C. M. (2015) · eLife · doi:10.7554/elife.10163 · Cited by 46
Coding of the contrasts in natural images by populations of neurons in primary visual cortex (V1)
Clatworthy, P. L., Chirimuuta, M., Lauritzen, J. S., & Tolhurst, D. J. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00277-3 · Cited by 54
Finlay, B. L. (2007) · Developmental Science · doi:10.1111/j.1467-7687.2007.00560.x · Cited by 39
Zhou, B., Li, Z., Kim, S., Lafferty, J., & Clark, D. A. (2022) · eLife · doi:10.7554/elife.72067 · Cited by 31
Deep Predictive Learning: A Comprehensive Model of Three Visual Streams
O'Reilly, R. C., Wyatte, D. R., & Rohrlich, J. (2017) · arXiv · doi:10.48550/arxiv.1709.04654 · Cited by 26
Willmore, B. D. B., Bulstrode, H., & Tolhurst, D. J. (2012) · Vision Research · doi:10.1016/j.visres.2011.12.008 · Cited by 10
Metadata
- Authors
- Field, D. J.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 1994-07
- Volume
- 6
- Issue
- 4
- Pages
- 559-601
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2085927826
- Cited by
- 1,183
- References
- 4
- FWCI
- 11.61
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
