The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Toward a unified theory of efficient, predictive, and sparse coding
Open accessAbstract
Significance: Sensory neural circuits are thought to efficiently encode incoming signals. Several mathematical theories of neural coding formalize this notion, but it is unclear how these theories relate to each other and whether they are even fully consistent. Here we develop a unified framework that encompasses and extends previous proposals. We highlight key tradeoffs faced by sensory neurons; we show that trading off future prediction against efficiently encoding past inputs generates qualitatively different predictions for neural responses to natural visual stimulation. Our approach is a promising first step toward theoretically explaining the observed diversity of neural responses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · cited 2×
“For natural images, this leads to neurons that are selective for spatially localized image contours, with receptive fields (RFs) that are qualitatively similar to the RFs of V1 simple cells (25, 26).”
BackgroundRao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
The information bottleneck method
Tishby, N., Pereira, F. C., & Bialek, W. (2000) · arXiv · doi:10.48550/arxiv.physics/0004057 · Cited by 2,626
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460 · cited 1×
“A large body of work has investigated how neurons could efficiently represent such stimuli by encoding their nonredundant or independent components (4).”
BackgroundThe “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 2,201
Invariant visual representation by single neurons in the human brain
Quiroga, R. Q., Reddy, L., Kreiman, G., Koch, C., & Fried, I. (2005) · Nature · doi:10.1038/nature03687 · Cited by 1,988
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427
Sparse coding of sensory inputs
Olshausen, B. A., & Field, D. J. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.07.007 · Cited by 1,404
Independent component filters of natural images compared with simple cells in primary visual cortex
van Hateren, J. H., & van der Schaaf, A. (1998) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1998.0303 · Cited by 1,106
The functional diversity of retinal ganglion cells in the mouse
Baden, T., Berens, P., Franke, K., Román Rosón, M., Bethge, M., & Euler, T. (2016) · Nature · doi:10.1038/nature16468 · Cited by 999
Cited by
Encouraging an excitable brain state: mechanisms of brain repair in stroke
Joy, M. T., & Carmichael, S. T. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-00396-7 · Cited by 285
Causes and consequences of representational drift
Rule, M. E., O’Leary, T., & Harvey, C. D. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.08.005 · Cited by 227
A neural network trained for prediction mimics diverse features of biological neurons and perception
Lotter, W., Kreiman, G., & Cox, D. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0170-9 · Cited by 128
Retinotectal circuitry of larval zebrafish is adapted to detection and pursuit of prey
Förster, D., Helmbrecht, T. O., Mearns, D. S., Jordan, L., Mokayes, N., & Baier, H. (2020) · eLife · doi:10.7554/elife.58596 · Cited by 90
Dora, S., Bohte, S. M., & Pennartz, C. M. A. (2021) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2021.666131 · Cited by 24
Metadata
- Authors
- Chalk, M., Marre, O., & Tkačik, G.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2017-12-19
- Volume
- 115
- Issue
- 1
- Pages
- 186-191
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2949895299
- Cited by
- 181
- References
- 14
- FWCI
- 5.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Toward a unified theory of efficient, predictive, and sparse coding. https://app.cochat.ai/papers/10.1073/pnas.1711114115
- The paper
- Chalk, M., Marre, O., & Tkačik, G. (2018). Toward a unified theory of efficient, predictive, and sparse coding. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.1711114115
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.