Predictive information in a sensory population
Open accessAbstract
Significance: Prediction is an essential part of life. However, are we really “good” at making predictions? More specifically, are pieces of our brain close to being optimal predictors? To assess the efficiency of prediction, we need to measure the information that neurons carry about the future of our sensory experiences. We show how to do this, at least in simplified contexts, and find that groups of neurons in the retina indeed are close to maximally efficient at separating predictive information from the nonpredictive background. Efficient coding of predictive information is a principle that can be applied at every stage of neural computation.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Some evidence for extending HPP to non-cortical systems includes decoding of predictive information from retinal cells, and also models of motor control involving spinal reflex arcs as predictions.
“Some evidence for extending HPP to non-cortical systems includes decoding of predictive information from retinal cells (Palmer et al., 2015), and also models of motor control involving spinal reflex arcs as predictions (Adams et al., 2013).”
From An Integrated World Modeling Theory (IWMT) of Consciousness (2020) · cites this paper as Palmer et al., 2015
Cites
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2005) · doi:10.1002/047174882x · Cited by 13,791 · see citing works
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · see citing works
The information bottleneck method
Tishby, N., Pereira, F. C., & Bialek, W. (2000) · arXiv · doi:10.48550/arxiv.physics/0004057 · Cited by 2,626 · cited 2× · see citing works
“information about the past, and in any particular sensory environment this plane is divided into accessible and impossible regions; this is an example of the information bottleneck problem [23, 24].”
BackgroundSelf-citationPredictive coding: a fresh view of inhibition in the retina
Srinivasan, M. V., Laughlin, S. B., & Dubs, A. (1982) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1982.0085 · Cited by 1,042 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Hierarchical process memory: memory as an integral component of information processing
Hasson, U., Chen, J., & Honey, C. J. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.04.006 · Cited by 749 · see citing works
Heeger, D. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1619788114 · Cited by 220 · see citing works
Efficient compression in color naming and its evolution
Zaslavsky, N., Kemp, C., Regier, T., & Tishby, N. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800521115 · Cited by 178 · see citing works
Safron, A. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00030 · Cited by 133 · see citing works
“Some evidence for extending HPP to non-cortical systems includes decoding of predictive information from retinal cells (Palmer et al., 2015), and also models of motor control involving spinal reflex arcs as predictions (Adams et al., 2013).”
Background
- Authors
- Palmer, S. E., Marre, O., Berry, M. J., & Bialek, W.
- Affiliations
- Joseph Henry Laboratories of Physics and
- Princeton University (US)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2015-05-18
- Volume
- 112
- Issue
- 22
- Pages
- 6908-6913
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC4460449
- OpenAlex
- W1508769776
- Cited by
- 257
- References
- 4
- Citations by year
- 2026: 19 · 2025: 28 · 2024: 25 · 2023: 21 · 2022: 23 · 2021: 31 · 2020: 21 · 2019: 27 · 2018: 19 · 2017: 19 · 2016: 16 · 2015: 6 · 2014: 2
- FWCI
- 12.02
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion)
- Funders
- National Science Foundation (PHY-1305525, CCF-0939370, IIS-0613435)
- HHS | National Institutes of Health (EY-014196)
- W.M. Keck Foundation (N/A)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Keywords
- predictive information, retinal ganglion cells, visual prediction, information compression, feature selectivity, early visual processing, neural coding
- MeSH terms
- Humans, Information Theory, Models, Neurological, Neurons, Retina, Thinking, Vision, Ocular, Anticipation, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
