The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Redundancy reduction revisited
Abstract
Soon after Shannon defined the concept of redundancy it was suggested that it gave insight into mechanisms of sensory processing, perception, intelligence and inference. Can we now judge whether there is anything in this idea, and can we see where it should direct our thinking? This paper argues that the original hypothesis was wrong in over-emphasizing the role of compressive coding and economy in neuron numbers, but right in drawing attention to the importance of redundancy. Furthermore there is a clear direction in which it now points, namely to the overwhelming importance of probabilities and statistics in neuroscience. The brain has to decide upon actions in a competitive, chance-driven world, and to do this well it must know about and exploit the non-random probabilities and interdependences of objects and events signalled by sensory messages. These are particularly relevant for Bayesian calculations of the optimum course of action. Instead of thinking of neural representations as transformations of stimulus energies, we should regard them as approximate estimates of the probable truths of hypotheses about the current environment, for these are the quantities required by a probabilistic brain working on Bayesian principles.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Relations between the statistics of natural images and the response properties of cortical cells
Field, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002379 · Cited by 3,241
Some informational aspects of visual perception.
Attneave, F. (1954) · Psychological Review · doi:10.1037/h0054663 · Cited by 2,890
Spikes: Exploring the Neural Code
Rieke, F. M., Warland, D., van Steveninck, R. R. D. R., & Bialek, W. (1996) · Medical Entomology and Zoology · Cited by 2,844
Prediction and Entropy of Printed English
Shannon, C. E. (1951) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1951.tb01366.x · Cited by 2,686
Craik, K. J. W. (1943) · Cited by 1,845
Single Units and Sensation: A Neuron Doctrine for Perceptual Psychology?
Barlow, H. B. (1972) · Perception · doi:10.1068/p010371 · Cited by 1,730
Self-citationGTM: The Generative Topographic Mapping
Bishop, C. M., Svensén, M., & Williams, C. K. I. (1998) · Neural Computation · doi:10.1162/089976698300017953 · Cited by 1,388
Encyclopedia of Statistical Sciences.
Aspinall, L. J., Kotz, S., & Johnson, N. L. (1983) · Applied Statistics · doi:10.2307/2347959 · Cited by 1,258
What Is the Goal of Sensory Coding?
Field, D. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.4.559 · Cited by 1,183
(1993) · Cited by 1,173
Predictive coding: a fresh view of inhibition in the retina
Srinivasan, M. V., Laughlin, S. B., & Dubs, A. (1982) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1982.0085 · Cited by 1,042
Bialek, W., Rieke, F., de Ruyter van Steveninck, R. R., & Warland, D. (1991) · Science · doi:10.1126/science.2063199 · Cited by 992
A Simple Coding Procedure Enhances a Neuron's Information Capacity
Laughlin, S. (1981) · Zeitschrift für Naturforschung C · doi:10.1515/znc-1981-9-1040 · Cited by 989
Shepard, R. N. (1984) · Psychological Review · doi:10.1037//0033-295x.91.4.417 · Cited by 940
Advances in Neural Information Processing Systems 7
Tesauro, G., Touretzky, D. S., & Leen, T. K. (1995) · Cited by 869
The Effect of Correlated Variability on the Accuracy of a Population Code
Abbott, L. F., & Dayan, P. (1999) · Neural Computation · doi:10.1162/089976699300016827 · Cited by 823
GREGORY, R. L. (1971) · American journal of optometry and archives of American Academy of Optometry · doi:10.1002/j.2330-9474.1971.tb04064.x · Cited by 803
Henry, N. W. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat02466 · Cited by 742
Pearson, K. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781139878548 · Cited by 720
Could information theory provide an ecological theory of sensory processing?
Atick, J. J. (2011) · Network: Computation in Neural Systems · doi:10.3109/0954898x.2011.638888 · Cited by 679
(1914) · The Mathematical Gazette · doi:10.2307/3604840 · Cited by 555
Connectionist learning of belief networks
Neal, R. M. (1992) · Artificial Intelligence · doi:10.1016/0004-3702(92)90065-6 · Cited by 513
Levy, W. B., & Baxter, R. A. (1996) · Neural Computation · doi:10.1162/neco.1996.8.3.531 · Cited by 481
Could information theory provide an ecological theory of sensory processing?
Atick, J. J. (1992) · Network: Computation in Neural Systems · doi:10.1088/0954-898x_3_2_009 · Cited by 446
Barlow, H. B. (1981) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1981.0022 · Cited by 366
Self-citationExpressiveness and tractability in knowledge representation and reasoning1
Levesque, H. J., & Brachman, R. J. (1987) · Computational Intelligence · doi:10.1111/j.1467-8640.1987.tb00176.x · Cited by 320
Perceptual-cognitive universals as reflections of the world
Shepard, R. N. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03200759 · Cited by 311
A theory of maximizing sensory information
van Hateren, J. H. (1992) · Biological Cybernetics · doi:10.1007/bf00203134 · Cited by 267
Critical limiting factors in the design of the eye and visual cortex
Barlow, H. B. (1981) · Cited by 244
Self-citationPredictability and redundancy of natural images
Kersten, D. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002395 · Cited by 143
The exploitation of regularities in the environment by the brain
Barlow, H. B. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01000024 · Cited by 139
Self-citationThe recall of events through the learning of associations between their parts
Gardner-Medwin, A. R. (1976) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1976.0084 · Cited by 125
PATTERN RECOGNITION AND THE RESPONSES OF SENSORY NEURONS*
Barlow, H. B. (1969) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1969.tb14019.x · Cited by 93
Self-citationInformation-Theoretical Aspects of Inductive and Deductive Inference
Watanabé, S. (1960) · IBM Journal of Research and Development · doi:10.1147/rd.42.0208 · Cited by 66
The Limits of Counting Accuracy in Distributed Neural Representations
Gardner-Medwin, A. R., & Barlow, H. B. (2001) · Neural Computation · doi:10.1162/089976601300014420 · Cited by 25
Self-citationLevy, W. B., & Baxter, R. A. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/4924.003.0008 · Cited by 23
Cited by
Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain
Saad, M. A., Bovik, A. C., & Charrier, C. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2191563 · Cited by 1,751
Neural correlations, population coding and computation
Averbeck, B. B., Latham, P. E., & Pouget, A. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1888 · Cited by 1,743
Kriegeskorte, N. (2015) · Annual Review of Vision Science · doi:10.1146/annurev-vision-082114-035447 · Cited by 1,093
Functional specificity of local synaptic connections in neocortical networks
Ko, H., Hofer, S. B., Pichler, B., Buchanan, K. A., Sjöström, P. J., & Mrsic-Flogel, T. D. (2011) · Nature · doi:10.1038/nature09880 · Cited by 857
Piqueras-Fiszman, B., & Spence, C. (2015) · Food Quality and Preference · doi:10.1016/j.foodqual.2014.09.013 · Cited by 855
Metadata
- Authors
- Barlow, H.
- Venue
- Network: Computation in Neural Systems
- Publisher
- Informa UK Limited
- Published
- 2001-01
- Volume
- 12
- Issue
- 3
- Pages
- 241-253
- ISSN
- 0954-898X (ISSN-L)
- 1361-6536
- OpenAlex
- W2130055919
- Cited by
- 620
- References
- 36
- FWCI
- 20.65
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.