The DOI matches its Crossref record; 42 of the 44 references it cites were found in a registry or an index.
Simplicity: a unifying principle in cognitive science?
Abstract
Much of perception, learning and high-level cognition involves finding patterns in data. But there are always infinitely many patterns compatible with any finite amount of data. How does the cognitive system choose 'sensible' patterns? A long tradition in epistemology, philosophy of science, and mathematical and computational theories of learning argues that patterns 'should' be chosen according to how simply they explain the data. This article reviews research exploring the idea that simplicity drives a wide range of cognitive processes. We outline mathematical theory, computational results and empirical data that underpin this viewpoint.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Compression is a key feature of both human cognition and machine learning 109 ;”
From Machine culture (2023) · cites this paper as [109]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lecture Notes in Artificial Intelligence
Brézillon, P., & Bouquet, P. (1999) · Cited by 7,436
An Introduction to Kolmogorov Complexity and Its Applications
Li, M., & Vitanyi, P. M. B. (2019) · Texts in computer science · doi:10.1007/978-3-030-11298-1 · Cited by 3,769
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Some informational aspects of visual perception.
Attneave, F. (1954) · Psychological Review · doi:10.1037/h0054663 · Cited by 2,938
(1961) · Information and Control · doi:10.1016/s0019-9958(61)80064-8 · Cited by 2,904
Toward a Universal Law of Generalization for Psychological Science
Shepard, R. N. (1987) · Science · doi:10.1126/science.3629243 · Cited by 2,416
The Processing of Information and Structure
Royer, F. L., & Garner, W. R. (1974) · The American Journal of Psychology · doi:10.2307/1421985 · Cited by 2,130
An Introduction to Kolmogorov Complexity and Its Applications
Li, M., & Vitanyi, P. M. B. (1997) · Springer eBooks · doi:10.1007/978-1-4757-2606-0 · Cited by 1,792
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Miller, G. A. (2013) · David Fulton Publishers eBooks · doi:10.4324/9780203449097-13 · Cited by 1,365
Research works printed but not linked: 2
- Rissanen, J. (1989) Stochastic complexity and statistical inquiry. World Scientific Series in Computer Science (Vol 15), World Scientific.
- Chater, 2002, Generalized law of universal generalization, J. Math. Psychol.
Cited by
Sorted by citations
Items 401–498 of 498
Optimization in Mental Configuration Space
Yang, H. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-1628-8.ch009
An Integrative Approach to User Interface Design
Kljajević, V. (2009) · IGI Global eBooks · doi:10.4018/978-1-59904-845-1.ch060
Ambient Communication Experience (ACE), Information Interaction in Design Space
Hegarty, R., Lunney, T., Curran, K., & Mulvenna, M. D. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-549-0.ch014
Binz, M. (2002) · CRC Press eBooks · doi:10.1201/9780203164587.ch3
System complexity and (im)possible sound changes
Seinhorst, K. (2016) · Papers in Historical Phonology · doi:10.2218/pihph.1.2016.1701
Is there any Need to Mention Induction
Thornton, C. (2011) · eScholarship (California Digital Library)
Tano, P., Romano, S., Sigman, M., Salles, A., & Figueira, S. D. (2018) · arXiv (Cornell University)
From Reflex to Reflection: Two Tricks AI Could Learn from Us
Dessalles, J.-L. (2019) · Philosophies · doi:10.3390/philosophies4020027
Logic Conditionals, Supervenience, and Selection TasksPreprint
Sileno, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06773
Alternation blindness in the perception of binary sequences.
Yu, R. Q., Osherson, D. N., & Zhao, J. (2017) · eScholarship (California Digital Library)
Modality effects in the cultural evolution of language: An experimental iterated learning approach
Perelman, F. W. (2019) · ONOMAZEIN · doi:10.7764/onomazein.45.05
Hierarchical Inferences Support Systematicity in the LexiconPreprint
Hofer, M., Verhoef, T., & Lévy, R. (2020) · doi:10.31234/osf.io/m9xne
A Model of Temporal Connective Acquisition.
Gorenstein, M. I., Zhang, C., & Piantadosi, S. T. (2020) · eScholarship (California Digital Library)
Constructional change in Germanic
Culicover, P. W. (2021) · doi:10.1093/oso/9780198865391.003.0008
Learning, complexity, and competition
Culicover, P. W. (2021) · doi:10.1093/oso/9780198865391.003.0004
Culicover, P. W. (2021) · doi:10.1093/oso/9780198865391.003.0009
Culicover, P. W. (2021) · doi:10.1093/oso/9780198865391.003.0011
Constructional economy and analogy
Culicover, P. W. (2021) · doi:10.1093/oso/9780198865391.003.0010
Fast and Slow Thinking as Shaped by Sensitivity-to-FramingPreprint
Andersen, M., Hjelmer, K. P., & Selart, M. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3600481
Culicover, P. W. (2021) · doi:10.1093/oso/9780198865391.003.0007
Managing Computational Data for Models of Language Acquisition and Change
Lou‐Magnuson, M., & Onnis, L. (2022) · The MIT Press eBooks · doi:10.7551/mitpress/12200.003.0034
The Explanation of Disordered Eating: A Metatheoretical Approach
Hawkins-Elder, H. (2021) · doi:10.26686/wgtn.16895614.v1 · Cited by 3
Murphy, R. (2010) · doi:10.1002/9780470977484.refs
Culicover, P. W. (2021) · doi:10.1093/oso/9780198865391.003.0001
Culicover, P. W. (2021) · doi:10.1093/oso/9780198865391.003.0002
Learning and Using Written Word Forms
Rebecca Treiman, A., & Kessler, B. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.24
Learning words amidst speech sound variability
Creel, S. C. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.7
The Dynamics of Word Production
Kilbourn-Ceron, O., & Goldrick, M. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.25
Culicover, P. W. (2021) · doi:10.1093/oso/9780198865391.003.0006
Culicover, P. W. (2021) · doi:10.1093/oso/9780198865391.003.0005
How Learners Move From Sound To Morphology
Demuth, K. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.8
Crain, S. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.11
Αλεξιάδου, Ά. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.2
Gleitman, L. R., & Trueswell, J. C. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.30
(2005) · De Gruyter eBooks · doi:10.1515/9783110332865.fm
Anna Papafragou, A., Trueswell, J. C., & Gleitman, L. R. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.29
Hacquard, V. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.4
Stojnić, G., & Lepore, E. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.20
Culicover, P. W. (2021) · doi:10.1093/oso/9780198865391.003.0003
Varnum, M. E. W., Krems, J. A., Morris, C., & Grossmann, I. (2019) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/nmruj · Cited by 1
Pullum, G. K. (2011) · doi:10.1093/obo/9780199772810-0077
Sun, R. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816772.004
An Interdisciplinary Approach to the Evolution of Human Cognitive AbilityPreprint
Gadda, N. S. (2022) · doi:10.31234/osf.io/4gp3e
Algorithmic Complexity in Cognition
Zenil, H., Toscano, F. S., & Gauvrit, N. (2022) · Emergence, complexity and computation · doi:10.1007/978-3-662-64985-5_9
A Simulation of Bayesian Surprise
Maleki, A., Taherinassaj, A., & Mohammadzade, H. (2022) · Iranian Conference on Electrical Engineering · doi:10.1109/icee55646.2022.9827049
Clark, S. J. (2022) · Springer eBooks · doi:10.1007/978-3-031-05785-4_11
Vera, J., Fuentealba, D., Lopez, M., & Ponce, H. R. (2022) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/ac9f65
Function Estimation: Individual Differences in Quantitative InferencePreprint
Little, D. R., Shiffrin, R. M., & Laham, S. M. (2022) · doi:10.31234/osf.io/5c9na
Avanzi, F. (2023) · doi:10.5194/egusphere-2022-1250-ac2
Avanzi, F. (2023) · doi:10.5194/egusphere-2022-1250-ac1
(2023) · Cambridge University Press eBooks · doi:10.1017/9781108755610.004
Playing it safe: information constrains collective betting strategiesPreprint
Fleig, P., & Balasubramanian, V. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.04.18.537333
Survival Decisions in a Multidimensional WorldPreprint
Mobbs, D., Wise, T., Tashjian, S. M., Friston, K. J., & Headley, D. B. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/jkmpq
Beinborn, L., & Hollenstein, N. (2023) · Synthesis lectures on human language technologies · doi:10.1007/978-3-031-43260-6_4
(2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.002.0088
(2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.002.0006
(2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.002.0004
Does degree of innovation modulate the influence of cognitive biases on language structure?Preprint
Holtz, A., Kirby, S., & Culbertson, J. (2024) · doi:10.31234/osf.io/e9mwp
Getting the PicturePreprint
Akerlof, R. J., Holden, R. T., & Li, H. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4821349
The Generalization Artist - Or: How Can We Characterize Human Generalization?Preprint
Thalmann, M., & Schulz, E. (2024) · doi:10.31234/osf.io/k6ect
Function estimation: Quantifying individual differences of hand-drawn functions
Little, D. R., Shiffrin, R. M., & Laham, S. M. (2024) · Memory & Cognition · doi:10.3758/s13421-024-01598-5
Impact of education and music training on the development of early abstraction abilitiesPreprint
Morfoisse, T., Becuwe, S., Palu, M., Watkins, C. P., Dehaene‐Lambertz, G., & Dehaene, S. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.03.28.645996
Smith, K., & Culbertson, J. (2025) · doi:10.31234/osf.io/5nwhq_v2
How Can We Characterize Human Generalization and Distinguish It From Generalization in Machines?
Thalmann, M., & Schulz, E. (2025) · Current Directions in Psychological Science · doi:10.1177/09637214251336212 · Cited by 1
Information-theoretic and machine learning methods for semantic categorization
Mollica, F., & Zaslavsky, N. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780192886491.013.21
The AI Revolution in Education: From Cognitive Enhancement to Hybrid IntelligencePreprint
Rodrigues, D. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5327624
Variability and Predictability as Key Factors in a New Approach to Choreographic Complexity in DancePreprint
Rutgeerts, J., der Hulst, E. V., & Wagemans, J. P. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5363454
Converging creativity through semantic processing
Laine, P., Rousi, R. A., Parviainen, T. M., & Kujala, T. (2025) · Journal of Creativity · doi:10.1016/j.yjoc.2025.100111
Leadership Ethics in the Information Age
Demont-Biaggi, F. (2025) · Springer eBooks · doi:10.1007/978-3-032-03461-8_6
Huang, L. (2025) · Review of General Psychology · doi:10.1177/10892680251380430
The Symbol of Time: Efficiency of shape stimuli drives time estimatesPreprint
Macedo, G., & Wiener, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5688367
A geometric shape regularity effect in the human brainPreprint
Sablé-Meyer, M., Benjamin, L., Watkins, C. P., He, C., Pajot, M., Morfoisse, T., Roumi, F. A., & Dehaene, S. (2025) · eLife · doi:10.7554/elife.106464.2
How Occam’s razor guides human decision-makingPreprint
Piasini, E., Liu, S., Chaudhari, P., Balasubramanian, V., & Gold, J. I. (2025) · eLife · doi:10.7554/elife.109113
Is a closed-loop discovery system feasible?
Riegler, A. (2006) · VUBIR (Vrije Universiteit Brussel)
Thinking as shaped by framing sensitivityPreprint
Andersen, M., Hjelmer, K. P., & Selart, M. (2020) · doi:10.31235/osf.io/r83zx
Harry Potter and the sorcerer’s scope: Latent scope biases in explanatory reasoningPreprint
Sussman, A., Oppenheimer, D., & Khemlani, S. (2019) · OSF Preprints (OSF Preprints)
A music recommendation system for constructed music-evoked episodic memories (CoMEEMs)
de la Bletiere, P. R., Neerincx, M. A., Schaefer, R., & Oertel, C. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103717
Abela, J., Cachia, E., & Layfield, C. (2025) · Mathematics · doi:10.3390/math14010041
Five-factor model-based personality profiles in South Korea
Jyung, M., Kim, J. H., Kim, K., & Choi, I. (2026) · Scientific Reports · doi:10.1038/s41598-025-34511-4
Sample size dependence of Occam’s razor in human decision-makingPreprint
Rinaldi, F. G., & Piasini, E. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.01.25.701581
Approximating Cognitive Representations Using Space
Starr, J. R., Winship, A., & van Schijndel, M. (2026) · Open Mind · doi:10.1162/opmi.a.389
Diagnostic comportemental et cognitif des erreurs dans la résolution de problèmes arithmétiques
Martin, B. (2016) · theses.fr (ABES) · doi:10.70675/411833edz01d6z4036z9ddfzb844a7ea3baf
Pure awareness, entropy, and the foundation of perception
Mago, J., Chandaria, S., Miller, M., & Laukkonen, R. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.133443 · Cited by 1
La représentation de l’informativité chez l’enfant
Aguirre, M. (2021) · theses.fr (ABES) · doi:10.70675/34c56888zf035z4ab0zba21z1221fd7f4be3
Reasoning over Data : Analogy-based and Transfer Learning to improve Machine Learning
Marquer, E. (2024) · theses.fr (ABES) · doi:10.70675/c562c512z6f87z4babz951ez88b32850945b
Development and study of coadaptive interactive systems
Dechaux, A. (2024) · theses.fr (ABES) · doi:10.70675/24336488z62bdz4b32zbc69z1620e376bc34
The symbol of time: Efficiency and meaning of shape stimuli drives time estimates
Macedo, G., & Wiener, M. (2026) · Cognition · doi:10.1016/j.cognition.2026.106580
Humans compress order-based structure into short mental programsPreprint
Tabbane, E., Figueira, S. D., Benjamin, L., Dehaene, S., & Roumi, F. A. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.05.14.725160
Morfoisse, T., Becuwe, S., Palu, M., Watkins, C. P., Dehaene‐Lambertz, G., & Dehaene, S. (2026) · Open Mind · doi:10.1162/opmi.a.354
Culbertson, J. (2026) · Studies in bilingualism · doi:10.1075/sibil.69.07cul
Understanding, prediction, and compression
Poldrack, R. A. (2026) · Synthese · doi:10.1007/s11229-026-05801-9
Metadata
- Authors
- Chater, N., & Vitányi, P.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2003-01
- Volume
- 7
- Issue
- 1
- Pages
- 19-22
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W2093777421
- Cited by
- 494
- References
- 44
- Citations by year
- 2026: 11 · 2025: 32 · 2024: 22 · 2023: 33 · 2022: 56 · 2021: 42 · 2020: 29 · 2019: 30 · 2018: 24 · 2017: 24 · 2016: 22 · 2015: 20 · 2014: 15 · 2013: 17 · 2012: 19
- FWCI
- 1.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Trends in Cognitive Sciences (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Computability, Logic, AI Algorithms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Cognitive Science and Education Research
- Keywords
- simplicity, pattern selection, inductive reasoning, epistemology, philosophy of science, perception, generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
