Rate–distortion theory and human perception
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The fundamental goal of perception is to aid in the achievement of behavioral objectives. This requires extracting and communicating useful information from noisy and uncertain sensory signals. At the same time, given the complexity of sensory information and the limitations of biological information processing, it is necessary that some information must be lost or discarded in the act of perception. Under these circumstances, what constitutes an 'optimal' perceptual system? This paper describes the mathematical framework of rate-distortion theory as the optimal solution to the problem of minimizing the costs of perceptual error subject to strong constraints on the ability to communicate or transmit information. Rate-distortion theory offers a general and principled theoretical framework for developing computational-level models of human perception (Marr, 1982). Models developed in this framework are capable of producing quantitatively precise explanations for human perceptual performance, while yielding new insights regarding the nature and goals of perception. This paper demonstrates the application of rate-distortion theory to two benchmark domains where capacity limits are especially salient in human perception: discrete categorization of stimuli (also known as absolute identification) and visual working memory. A software package written for the R statistical programming language is described that aids in the development of models based on rate-distortion theory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The magical number 4 in short-term memory: A reconsideration of mental storage capacity
Cowan, N. (2001) · Behavioral and Brain Sciences · doi:10.1017/s0140525x01003922 · Cited by 6,779
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460 · cited 1×
“Rate–distortion theory generalizes the idea of efficient coding to allow for a broader range of possible cost functions (Hino & Murata, 2009; Simoncelli & Olshausen, 2001).”
BackgroundTutorial on maximum likelihood estimation
Myung, I. J. (2003) · Journal of Mathematical Psychology · doi:10.1016/s0022-2496(02)00028-7 · Cited by 1,802
Computation of channel capacity and rate-distortion functions
Blahut, R. (1972) · IEEE Transactions on Information Theory · doi:10.1109/tit.1972.1054855 · Cited by 1,381
Object perception as Bayesian inference
Kersten, D., Mamassian, P., & Yuille, A. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142005 · Cited by 1,269 · cited 2×
“…prior beliefs and uncertain sensory evidence, rate–distortion theory shares much in common with the probabilistic inference approach to perception (Kersten, Mamassian, & Yuille, 2004; Knill & Richards, 1996) and in particular Bayesian decision theory (Körding, 2007; Maloney & Mamassian, 2009).”
BackgroundInfluentialBayesian just-so stories in psychology and neuroscience.
Bowers, J. S., & Davis, C. J. (2012) · Psychological Bulletin · doi:10.1037/a0026450 · Cited by 436
Decision theory: what “should” the nervous system do?
Körding, K. (2007) · Science · doi:10.1126/science.1142998 · Cited by 313 · cited 2×
“…prior beliefs and uncertain sensory evidence, rate–distortion theory shares much in common with the probabilistic inference approach to perception (Kersten, Mamassian, & Yuille, 2004; Knill & Richards, 1996) and in particular Bayesian decision theory (Körding, 2007; Maloney & Mamassian, 2009).”
Factorial comparison of working memory models.
van den Berg, R., Awh, E., & Ma, W. J. (2014) · Psychological Review · doi:10.1037/a0035234 · Cited by 311 · cited 1×
“One intuitively plausible explanation suggests that the gain of neural activity maintaining memory representations is the limiting resource (Bays, 2014, 2015; van den Berg, Awh, & Ma, 2014).”
Bayesian decision theory as a model of human visual perception: Testing Bayesian transfer
MALONEY, L. T., & MAMASSIAN, P. (2009) · Visual Neuroscience · doi:10.1017/s0952523808080905 · Cited by 180
Cited by
Lieder, F., & Griffiths, T. L. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1900061x · Cited by 892
Communicating artificial neural networks develop efficient color-naming systems
Chaabouni, R., Kharitonov, E., Dupoux, E., & Baroni, M. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016569118 · Cited by 39
Action chunking as conditional policy compression
Lai, L., Huang, A. Z., & Gershman, S. J. (2022) · doi:10.31234/osf.io/z8yrv · Cited by 9
Metadata
- Authors
- Sims, C. R.
- Venue
- Cognition
- Publisher
- Elsevier BV
- Published
- 2016-07
- Volume
- 152
- Pages
- 181-198
- ISSN
- 0010-0277 (ISSN-L)
- OpenAlex
- W2339054975
- Cited by
- 122
- References
- 11
- FWCI
- 5.09
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Rate–distortion theory and human perception. https://app.cochat.ai/papers/10.1016/j.cognition.2016.03.020
- The paper
- Sims, C. R. (2016). Rate–distortion theory and human perception. Cognition. https://doi.org/10.1016/j.cognition.2016.03.020
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.