The DOI matches its Crossref record; 42 of the 44 references it cites were found in a registry or an index.
Simplicity: a unifying principle in cognitive science?
Abstract
Much of perception, learning and high-level cognition involves finding patterns in data. But there are always infinitely many patterns compatible with any finite amount of data. How does the cognitive system choose 'sensible' patterns? A long tradition in epistemology, philosophy of science, and mathematical and computational theories of learning argues that patterns 'should' be chosen according to how simply they explain the data. This article reviews research exploring the idea that simplicity drives a wide range of cognitive processes. We outline mathematical theory, computational results and empirical data that underpin this viewpoint.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Compression is a key feature of both human cognition and machine learning 109 ;”
From Machine culture (2023) · cites this paper as [109]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lecture Notes in Artificial Intelligence
Brézillon, P., & Bouquet, P. (1999) · Cited by 7,436
An Introduction to Kolmogorov Complexity and Its Applications
Li, M., & Vitanyi, P. M. B. (2019) · Texts in computer science · doi:10.1007/978-3-030-11298-1 · Cited by 3,769
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Some informational aspects of visual perception.
Attneave, F. (1954) · Psychological Review · doi:10.1037/h0054663 · Cited by 2,938
(1961) · Information and Control · doi:10.1016/s0019-9958(61)80064-8 · Cited by 2,904
Toward a Universal Law of Generalization for Psychological Science
Shepard, R. N. (1987) · Science · doi:10.1126/science.3629243 · Cited by 2,416
The Processing of Information and Structure
Royer, F. L., & Garner, W. R. (1974) · The American Journal of Psychology · doi:10.2307/1421985 · Cited by 2,130
An Introduction to Kolmogorov Complexity and Its Applications
Li, M., & Vitanyi, P. M. B. (1997) · Springer eBooks · doi:10.1007/978-1-4757-2606-0 · Cited by 1,792
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Miller, G. A. (2013) · David Fulton Publishers eBooks · doi:10.4324/9780203449097-13 · Cited by 1,365
Research works printed but not linked: 2
- Rissanen, J. (1989) Stochastic complexity and statistical inquiry. World Scientific Series in Computer Science (Vol 15), World Scientific.
- Chater, 2002, Generalized law of universal generalization, J. Math. Psychol.
Cited by
Sorted by citations
Items 301–400 of 498
Looking at Islamic Patterns II: Making Sense of GeometryPreprint
Cromwell, P. R. (2021) · doi:10.31234/osf.io/kwce4 · Cited by 5
Infants’ Learning of Speech Sounds and Word-Forms
Swingley, D. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.6 · Cited by 4
Landau, B. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.5 · Cited by 4
A geometric shape regularity effect in the human brainPreprint
Sablé-Meyer, M., Benjamin, L., Watkins, C. P., He, C., Pajot, M., Morfoisse, T., Roumi, F. A., & Dehaene, S. (2025) · eLife · doi:10.7554/elife.106464.1 · Cited by 4
Black Summer arson: Examining the impact of climate misinformation and corrections on reasoning
Spearing, E. R., Newman, E. J., Walker, I. A., Cook, J., Kurz, T., & Ecker, U. K. H. (2025) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2025.102842 · Cited by 3
Keren, G. B., & Breugelmans, S. M. (2020) · Review of General Psychology · doi:10.1177/1089268020943860 · Cited by 3
Using Unexpected Simplicity to Control Moral Judgments and Interest in Narratives
Saillenfest, A., & Dessalles, J.-L. (2013) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.cmn.2013.214 · Cited by 3
Herget, F., Kleppmann, B., Ahrweiler, P., Gruca, J., & Neumann, M. (2022) · Springer proceedings in complexity · doi:10.1007/978-3-030-92843-8_16 · Cited by 3
Epistemic Causality and its Application to the Social and Cognitive Sciences
Shan, Y., Taylor, S. D., & Williamson, J. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780192863485.003.0010 · Cited by 4
Khubchandani, S., Menon, P., & Raman, R. (2024) · Benchmarking An International Journal · doi:10.1108/bij-04-2024-0315 · Cited by 3
Barrios, E. (2015) · Synthese · doi:10.1007/s11229-015-0843-9 · Cited by 3
Multi-agent models of social dynamics in children
Stewart, T. C., West, R. L., & Coplan, R. J. (2006) · Cognitive Systems Research · doi:10.1016/j.cogsys.2006.07.002 · Cited by 3
Compressionism: A Theory of Mind Based on Data Compression
Maguire, P., Mulhall, O., Maguire, R., & Taylor, J. (2015) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 3
Green, K. (2016) · Advances in Language and Literary Studies · doi:10.7575/aiac.alls.v.7n.5p.70 · Cited by 3
Face Representations via Tensorfaces of Various Complexities
Lehky, S. R., Phan, A. H., Cichocki, A. S., & Tanaka, K. (2019) · Neural Computation · doi:10.1162/neco_a_01258 · Cited by 3
A FOUNDATION FOR INDUCTIVE REASONING IN HARNESSING THE POTENTIAL OF BIG DATA
Hassad, R. (2020) · Statistics Education Research Journal · doi:10.52041/serj.v19i1.133 · Cited by 5
Compression mechanisms in working memory
Lemaire, B., Robinet, V., & Portrat, S. (2012) · Mathématiques et sciences humaines · doi:10.4000/msh.12301 · Cited by 4
Phonological variation and lexical form
Purse, R., Tamminga, M., & White, Y. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.15 · Cited by 3
Schwarz, F., & Zehr, J. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.18 · Cited by 3
Efficient Communication and The Organization of The Lexicon
Mahowald, K., Dautriche, I., Braginsky, M., & Gibson, T. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.19 · Cited by 7
Human languages trade off complexity against efficiencyPreprint
Koplenig, A., Wolfer, S., & Meyer, P. (2023) · Research Square · doi:10.21203/rs.3.rs-1462001/v2 · Cited by 5
Liu, Y., Newell, B. R., Lee, J. E., & Hayes, B. K. (2025) · Cognitive Science · doi:10.1111/cogs.70070 · Cited by 2
Fanelli, D., Tan, P. B., Amaral, O. B., & Neves, K. (2025) · Royal Society Open Science · doi:10.1098/rsos.241446 · Cited by 7
Belonovskii, A. V., Girshova, E. I., Lähderanta, E., & Kaliteevski, M. A. (2025) · The Journal of Physical Chemistry C · doi:10.1021/acs.jpcc.5c07169 · Cited by 2
A Dual Process Theory of Optimistic Cognition
Sunehag, P., & Hütter, M. (2014) · eScholarship (California Digital Library) · Cited by 2
A Computational Theory of Meaning
Adriaans, P. (2020) · doi:10.1093/oso/9780190636685.003.0002 · Cited by 2
Surface and Contextual Linguistic Cues in Dialog Act Classification: A Cognitive Science View
Linders, G. M., & Louwerse, M. M. (2023) · Cognitive Science · doi:10.1111/cogs.13367 · Cited by 2
Wolff, J. G. (2022) · Foundations · doi:10.3390/foundations2040070 · Cited by 2
Generic Priors Yield Competition Between Independently-Occurring Causes
Powell, D., Merrick, A., Lu, H., & Holyoak, K. J. (2013) · eScholarship (California Digital Library) · Cited by 2
11. Narration and reasoning, from structure to biological function
Dessalles, J.-L. (2016) · De Gruyter eBooks · doi:10.1515/9783110255478-012 · Cited by 2
Lombrozo, T., & Rutstein, J. J. (2004) · Cited by 2
Faucher, C. (2015) · World Academy of Science, Engineering and Technology, International Journal of Humanities and Social Sciences · Cited by 2
Epistemic Simplicity—A Virtue or a Vice?
Lichacz, P. (2021) · Metaphilosophy · doi:10.1111/meta.12479 · Cited by 2
Which matters more when it comes to learning styles: Introspection or experimental data?
Rubin, A., Revel, N., Weinstein, Y., & Hainselin, M. (2021) · Cognitive Systems Research · doi:10.1016/j.cogsys.2021.10.005 · Cited by 2
Comprehenders' Error Correction Mechanisms Are Finely Calibrated to Language Production Statistics
Qian, P., & Lévy, R. (2026) · Cognitive Science · doi:10.31234/osf.io/e3v5b · Cited by 2
The Mind Grows CircuitsPreprint
Panigrahy, R., & Zhang, L. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1203.0088 · Cited by 2
An investigation of human inductive biases in causality and probability judgments
Yeung, S. W. (2011) · eScholarship (California Digital Library) · Cited by 2
Towards a unifying theory of generalizationPreprint
Schulz, E. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/rzj2m · Cited by 2
Network connectivity dynamics affect the evolution of culturally transmitted variantsPreprint
Segovia‐Martín, J., Walker, B., Fay, N., & Tamariz, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.06598 · Cited by 2
From the world to word order: the link between conceptual structure and languagePreprint
Culbertson, J., Schouwstra, M., & Kirby, S. (2019) · doi:10.31234/osf.io/v7be4 · Cited by 2
Psychological Implications for Submarine Display Design
Dry, M. J., Lee, M. D., Vickers, D., & Huf, S. (2005) · Defense Technical Information Center (DTIC) · Cited by 2
Children’s Use of Syntax In Word Learning
Lidz, J. L. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.10 · Cited by 2
Phonological Abstraction in The Mental Lexicon
Bakovic, E. J., Heinz, J. N., & Rawski, J. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.14 · Cited by 2
Lombrozo, T. (2016) · Wiley eBooks · doi:10.1002/9781118661666.ch34 · Cited by 2
Order PreferencePreprint
Evers, E. R. K., Inbar, Y., Loewenstein, G. F., & Zeelenberg, M. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2466991 · Cited by 2
Culbertson, J. (2024) · Zeitschrift für Sprachwissenschaft · doi:10.1515/zfs-2024-2014 · Cited by 1
People Evaluate Agents Based on the Algorithms That Drive Their Behavior
Bigelow, E., & Ullman, T. D. (2025) · Open Mind · doi:10.1162/opmi.a.26 · Cited by 2
Integration of memory, perception and attention in episode processing
Čadež, E. (2014) · Journal of Integrative Neuroscience · doi:10.1142/s0219635214500083 · Cited by 1
Natural Descriptions and Anthropic Bias: Extant Problems In Solomonoff Induction
McGregor, S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-08019-2_30 · Cited by 1
Nature inspired Reasoning for the Semantic W eb (NatuReS)
Guéret, C., Hitzler, P., & Stefan Schlobach, A. (2008) · Cited by 1
Generic Priors Yield Competition Between Independently-Occurring Preventive Causes
Powell, D., Merrick, A., Lu, H., & Holyoak, K. J. (2014) · eScholarship (California Digital Library) · Cited by 1
Cognition as sense-making: An empirical enquiry
Johnson, S. G. B. (2017) · Cited by 1
Special Number or a Mere Numerical Array? Effect of Repdigits on Judgments and Choices
Honda, H., Matsunaga, S., & Ueda, K. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01551 · Cited by 1
Neural Networks Track the Logical Complexity of Boolean Concepts
Carcassi, F., & Szymanik, J. (2022) · Open Mind · doi:10.1162/opmi_a_00059 · Cited by 2
Wolff, J. G. (2023) · Analytics · doi:10.3390/analytics2010010 · Cited by 1
The Boolean Language of Thought is recoverable from learning data
Carcassi, F., & Szymanik, J. (2023) · Cognition · doi:10.1016/j.cognition.2023.105541 · Cited by 1
Plurality Over Parsimony: When Two Diagnoses Are More Likely Than One
Raghuwanshi, J. S., Roberts, N., Loughran, T. P., Chaer, F. E., Girton, M., & Moulder, G. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-023-08585-7 · Cited by 1
Language structure reflects biases in pattern learning across domains and modalities
Culbertson, J., Compostella, A., & Kirby, S. (2024) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218241282404 · Cited by 1
Evidence for word order harmony between abstract categories in silent gesture
Hughes, C., Culbertson, J., & Kirby, S. (2025) · Cognition · doi:10.1016/j.cognition.2025.106100 · Cited by 1
Temporal patterns in the complexity of child-directed song lyrics reflect their functions
Labendzki, P., Goupil, L., & Wass, S. V. (2025) · Communications Psychology · doi:10.1038/s44271-025-00219-4 · Cited by 1
Simplicity and complexity of probabilistically defined concepts.
Feldman, J. (2025) · Psychological Review · doi:10.1037/rev0000563 · Cited by 1
Monakhov, S., Diessel, H., & Balthes, B. (2025) · Cognition · doi:10.1016/j.cognition.2025.106292 · Cited by 1
Evolving minds: Helping students with cognitive dissonance
Bramschreiber, T. (2013) · Digital Commons - DU (University of Denver) · Cited by 1
Meta-Modeling of Classic and Modern Mathematical Proofs and Concepts
Ramírez, D. A. J. G. (2020) · Springer eBooks · doi:10.1007/978-3-030-50273-7_11 · Cited by 1
In defense of epicycles: Embracing complexity in psychological explanations
Endress, A. D. (2022) · Mind & Language · doi:10.1111/mila.12450 · Cited by 1
Reality as SimplicityPreprint
Ruffini, G. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0903.1193 · Cited by 5
Kirby, M. L. (2017) · Figshare · Cited by 1
Lou‐Magnuson, M. (2018) · doi:10.32657/10220/46659 · Cited by 1
Auditory information loss in real-world listening environmentsPreprint
Weisser, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07509 · Cited by 1
Algorithmic Simplicity and RelevancePreprint
Dessalles, J.-L. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1208.1921 · Cited by 1
Nielsen, A., & Drew Rendall, A. (2018) · doi:10.31234/osf.io/kjnbv · Cited by 1
Rodd, J. M. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.1 · Cited by 2
The Structure of The Lexical Item and Sentence Meaning Composition
Piñango, M. M. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.13 · Cited by 1
Systematicity and Arbitrariness In Language
Yang, C. D. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.9 · Cited by 1
Neural encoding of speech and word forms
Poeppel, D., & Sun, Y. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.16 · Cited by 1
Disorders of Lexical Access And Production
Mirman, D., & Middleton, E. L. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.28 · Cited by 1
Differences in vocabulary growth across groups and individuals
Potter, C. E., & Lew‐Williams, C. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.22 · Cited by 1
Lexical representation and access in sign languages
Mayberry, R. I., & Wille, B. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198845003.013.27 · Cited by 1
Sunehag, P., & Hütter, M. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.43001-1 · Cited by 1
Neural basis of melodic learning explains cross-cultural regularities in musical scalesPreprint
Pelofi, C., Rezaeizadeh, M., Farbood, M. M., & Shamma, S. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.01.512632 · Cited by 1
Koplenig, A., Wolfer, S., & Meyer, P. (2023) · Research Square · doi:10.21203/rs.3.rs-1462001/v3 · Cited by 1
The disturbing trend of state media use of deepfakes
Schoenherr, J. R. (2023) · The Conversation · doi:10.64628/aam.wtc97nvja · Cited by 1
How Occam’s razor guides human decision-makingPreprint
Piasini, E., Liu, S., Chaudhari, P., Balasubramanian, V., & Gold, J. I. (2025) · eLife · doi:10.7554/elife.109113.1 · Cited by 2
Exploring The Facilitating Effect Of Diminutives On The Acquisition of Serbian Noun Morphology
Ševa, N. (2006) · Stirling Online Research Repository (University of Stirling) · Cited by 1
The Dynamic Representation of Reality and of Ourself between Real and Virtual Worlds
Piwek, L. (2008) · UWE Research Repository (UWE Bristol)
Sociocultural determination of linguistic complexity
Atkinson, M. (2014) · The Evolution of Language · doi:10.1142/9789814603638_0053 · Cited by 2
Ambient Communication Experience (ACE)
Hegarty, R., Lunney, T., Curran, K., & Mulvenna, M. D. (2009) · International Journal of Ambient Computing and Intelligence · doi:10.4018/jaci.2009040107
SOME ISSUES IN COMPUTATIONAL MODELLING; OCCAM'S RAZOR AND HEGEL'S HAIR GEL
Shillcock, R. C., ROBERTS, M., Kreiner, H., & Obregón, M. (2011) · Neural Computation and Psychology Workshop (NCPW) · doi:10.1142/9789814340359_0022
Kaleidoscopic motion and velocity illusions
van der Helm, P. A. (2007) · Vision Research · doi:10.1016/j.visres.2006.12.004
A computational model of the emergence of early constructions
Chang, N. (2008)
Complexity Preserving Functions
Lemeire, J. (2003) · VUBIR (Vrije Universiteit Brussel)
Computational (Principles of) Psychology
Edelman, S. (2015)
Computational Modeling of Various Cognitive Functionalities and Domains
Sun, R. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511816772.010
eParticipation, Simulation Exercise and Leadership Training in Nigeria: Bridging the Digital Divide
Ahmed, T. (2015) · Public administration and information technology · doi:10.1007/978-3-319-12784-2_19
The impact of type of language and number of reasons on purchase intent
Botelho, E. T. F. (2010) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Analysis of Narrative Form in Three Kenyan Fiction Video Films
Maina, W. M. (2015) · Kenyatta University Institutional Repository (Kenyatta University)
Bia sToward sRegula rConfiguratio ni n2 DPointing
Xu, X. (2010)
Contextual abnormality for teleological explanation
Varga, A. (2014) · eScholarship (California Digital Library)
Understanding each other: Defining a conceptual space for cognitive modeling
West, R. L., & Leibovitz, D. P. (2012) · eScholarship (California Digital Library) · doi:10.13140/rg.2.1.2760.1128
Metadata
- Authors
- Chater, N., & Vitányi, P.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2003-01
- Volume
- 7
- Issue
- 1
- Pages
- 19-22
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W2093777421
- Cited by
- 494
- References
- 44
- Citations by year
- 2026: 11 · 2025: 32 · 2024: 22 · 2023: 33 · 2022: 56 · 2021: 42 · 2020: 29 · 2019: 30 · 2018: 24 · 2017: 24 · 2016: 22 · 2015: 20 · 2014: 15 · 2013: 17 · 2012: 19
- FWCI
- 1.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Trends in Cognitive Sciences (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Computability, Logic, AI Algorithms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Cognitive Science and Education Research
- Keywords
- simplicity, pattern selection, inductive reasoning, epistemology, philosophy of science, perception, generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review