The DOI matches its Crossref record; 42 of the 44 references it cites were found in a registry or an index.
Simplicity: a unifying principle in cognitive science?
Abstract
Much of perception, learning and high-level cognition involves finding patterns in data. But there are always infinitely many patterns compatible with any finite amount of data. How does the cognitive system choose 'sensible' patterns? A long tradition in epistemology, philosophy of science, and mathematical and computational theories of learning argues that patterns 'should' be chosen according to how simply they explain the data. This article reviews research exploring the idea that simplicity drives a wide range of cognitive processes. We outline mathematical theory, computational results and empirical data that underpin this viewpoint.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Compression is a key feature of both human cognition and machine learning 109 ;”
From Machine culture (2023) · cites this paper as [109]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lecture Notes in Artificial Intelligence
Brézillon, P., & Bouquet, P. (1999) · Cited by 7,436
An Introduction to Kolmogorov Complexity and Its Applications
Li, M., & Vitanyi, P. M. B. (2019) · Texts in computer science · doi:10.1007/978-3-030-11298-1 · Cited by 3,769
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Some informational aspects of visual perception.
Attneave, F. (1954) · Psychological Review · doi:10.1037/h0054663 · Cited by 2,938
(1961) · Information and Control · doi:10.1016/s0019-9958(61)80064-8 · Cited by 2,904
Toward a Universal Law of Generalization for Psychological Science
Shepard, R. N. (1987) · Science · doi:10.1126/science.3629243 · Cited by 2,416
The Processing of Information and Structure
Royer, F. L., & Garner, W. R. (1974) · The American Journal of Psychology · doi:10.2307/1421985 · Cited by 2,130
An Introduction to Kolmogorov Complexity and Its Applications
Li, M., & Vitanyi, P. M. B. (1997) · Springer eBooks · doi:10.1007/978-1-4757-2606-0 · Cited by 1,792
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Miller, G. A. (2013) · David Fulton Publishers eBooks · doi:10.4324/9780203449097-13 · Cited by 1,365
Li, M., Chen, D., Li, X., Ma, B., & Vitanyi, P. M. B. (2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.838101 · Cited by 1,069
Bell, T., Cleary, J. G., & Witten, I. H. (1990) · Cited by 988
The processing of information and structure
(1974) · Behavior Therapy · doi:10.1016/s0005-7894(74)80071-7 · Cited by 947
Unsupervised Learning of the Morphology of a Natural Language
Goldsmith, J. (2001) · Computational Linguistics · doi:10.1162/089120101750300490 · Cited by 790
(1991) · Comparative Biochemistry and Physiology Part A Physiology · doi:10.1016/0300-9629(91)90509-b · Cited by 678
Inferring decision trees using the minimum description lenght principle
Quinlan, J. R., & Rivest, R. L. (1989) · Information and Computation · doi:10.1016/0890-5401(89)90010-2 · Cited by 650
The analysis of sensations and the relation of the physical to the psychical
Mach, E. (1914) · Virtual Defense Library (Ministerio de Defensa) · doi:10.2307/3604840 · Cited by 556
An information-based sequence distance and its application to whole mitochondrial genome phylogeny
Li, M., Badger, J. H., Chen, X., Kwong, S., Kearney, P., & Zhang, H. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.2.149 · Cited by 529
Estimation and Inference by Compact Coding
Wallace, C. S., & Freeman, P. R. (1987) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1987.tb01695.x · Cited by 521
Distributional regularity and phonotactic constraints are useful for segmentation
Brent, M. R., & Cartwright, T. A. (1996) · Cognition · doi:10.1016/s0010-0277(96)00719-6 · Cited by 514 · cited 1×
“analysis [30], segmentation [ 31 ,24] and grammar induction [32,33]”
MethodBennett, C. H., Gács, P., Li, M., Vitanyi, P. M. B., & Zurek, W. H. (1998) · IEEE Transactions on Information Theory · doi:10.1109/18.681318 · Cited by 510
Fisher, Y. (1995) · Springer eBooks · doi:10.1007/978-1-4612-2472-3 · Cited by 494
Minimization of Boolean complexity in human concept learning
Feldman, J. (2000) · Nature · doi:10.1038/35036586 · Cited by 475
A quantitative approach, to figural "goodness".
Hochberg, J. E., & McAlister, E. (1953) · Journal of Experimental Psychology · doi:10.1037/h0055809 · Cited by 363
Making sense of randomness: Implicit encoding as a basis for judgment.
Falk, R., & Konold, C. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.301 · Cited by 291
Hahn, U., Nick Chater, A., & Richardson, L. B. C. (2002) · Cognition · doi:10.1016/s0010-0277(02)00184-1 · Cited by 255
Minimum description length induction, Bayesianism, and Kolmogorov complexity
Vitanyi, P. M. B., & Li, M. (2000) · IEEE Transactions on Information Theory · doi:10.1109/18.825807 · Cited by 241
Perrett, D. I. (1991) · Endeavour · doi:10.1016/0160-9327(91)90174-a · Cited by 233
Reconciling simplicity and likelihood principles in perceptual organization.
Chater, N. (1996) · Psychological Review · doi:10.1037/0033-295x.103.3.566 · Cited by 226
Goodness of visual regularities: A nontransformational approach.
van der Helm, P. A., & Leeuwenberg, E. L. J. (1996) · Psychological Review · doi:10.1037/0033-295x.103.3.429 · Cited by 209
Barlow, H. B., Kaushal, T. P., & Mitchison, G. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.412 · Cited by 200
A simplicity principle in unsupervised human categorization
Pothos, E. M., & Chater, N. (2002) · Cognitive Science · doi:10.1207/s15516709cog2603_6 · Cited by 200
Language acquisition, data compression and generalization
Wolff, J. (1982) · Language & Communication · doi:10.1016/0271-5309(82)90035-0 · Cited by 136
Gács, P., Tromp, J., & Vitanyi, P. M. B. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.945257 · Cited by 112
The Use of Simplicity in Induction
Kemeny, J. G. (1953) · The Philosophical Review · doi:10.2307/2182878 · Cited by 101
Li, M., Chen, X., Li, X., Ma, B., & Vitanyi, P. M. B. (2003) · UvA-DARE (University of Amsterdam) · doi:10.5555/644108.644253 · Cited by 98
Pattern Theory: A Unifying Perspective
Mumford, D. B. (1994) · Birkhäuser Basel eBooks · doi:10.1007/978-3-0348-9110-3_6 · Cited by 95
Information-Theoretical Aspects of Inductive and Deductive Inference
Watanabé, S. (1960) · IBM Journal of Research and Development · doi:10.1147/rd.42.0208 · Cited by 66
Against the likelihood principle in visual form perception.
Leeuwenberg, E. L. J., & Boselie, F. (1988) · Psychological Review · doi:10.1037/0033-295x.95.4.485 · Cited by 61
Probabilistic Models of Grammar: Phonology as Information Minimization
Goldsmith, J. (2002) · Cited by 28
The Limits of Counting Accuracy in Distributed Neural Representations
Gardner-Medwin, A. R., & Barlow, H. B. (2001) · Neural Computation · doi:10.1162/089976601300014420 · Cited by 25
Information theory, complexity and linguistic descriptions
Clark, R. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511554360.005 · Cited by 9
Research works printed but not linked: 2
- Rissanen, J. (1989) Stochastic complexity and statistical inquiry. World Scientific Series in Computer Science (Vol 15), World Scientific.
- Chater, 2002, Generalized law of universal generalization, J. Math. Psychol.
Cited by
Sorted by citations
Misinformation and Its Correction: Continued Influence and Successful Debiasing
Lewandowsky, S., Ecker, U. K. H., Seifert, C. M., Schwarz, N., & Cook, J. (2012) · Psychological Science in the Public Interest · doi:10.1177/1529100612451018 · Cited by 2,920
Keil, F. C. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.57.102904.190100 · Cited by 1,350
The Effort Paradox: Effort Is Both Costly and Valued
Inzlicht, M., Shenhav, A., & Olivola, C. Y. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.01.007 · Cited by 977
Capturing causal complexity: Heuristics for configurational theorizing
Furnari, S., Crilly, D., Misangyi, V. F., Greckhamer, T., Fiss, P. C., & Aguilera, R. V. (2021) · Academy of Management Review · doi:10.5465/amr.2019.0298 · Cited by 861
Unsupervised Learning of the Morphology of a Natural Language
Goldsmith, J. (2001) · Computational Linguistics · doi:10.1162/089120101750300490 · Cited by 790
Metadata
- Authors
- Chater, N., & Vitányi, P.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2003-01
- Volume
- 7
- Issue
- 1
- Pages
- 19-22
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W2093777421
- Cited by
- 494
- References
- 44
- Citations by year
- 2026: 11 · 2025: 32 · 2024: 22 · 2023: 33 · 2022: 56 · 2021: 42 · 2020: 29 · 2019: 30 · 2018: 24 · 2017: 24 · 2016: 22 · 2015: 20 · 2014: 15 · 2013: 17 · 2012: 19
- FWCI
- 1.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Trends in Cognitive Sciences (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Computability, Logic, AI Algorithms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Cognitive Science and Education Research
- Keywords
- simplicity, pattern selection, inductive reasoning, epistemology, philosophy of science, perception, generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
