Cited by 2,550Psychiatry, Mental Health, NeuroscienceAI-based Problem Solving and PlanningCognitive Computing and Networks

The DOI matches its Crossref record; 280 of the 282 references it cites were found in a registry or an index, and 2 are not checked yet; none of the 393 sources its claims cite is checked for support yet.

Building machines that learn and think like people

Open access

Abstract

Recent progress in artificial intelligence has renewed interest in building systems that learn and think like people. Many advances have come from using deep neural networks trained end-to-end in tasks such as object recognition, video games, and board games, achieving performance that equals or even beats that of humans in some respects. Despite their biological inspiration and performance achievements, these systems differ from human intelligence in crucial ways. We review progress in cognitive science suggesting that truly human-like learning and thinking machines will have to reach beyond current engineering trends in both what they learn and how they learn it. Specifically, we argue that these machines should (1) build causal models of the world that support explanation and understanding, rather than merely solving pattern recognition problems; (2) ground learning in intuitive theories of physics and psychology to support and enrich the knowledge that is learned; and (3) harness compositionality and learning-to-learn to rapidly acquire and generalize knowledge to new tasks and situations. We suggest concrete challenges and promising routes toward these goals that can combine the strengths of recent neural network advances with more structured cognitive models.

Checked 2026-10-05 · 2 references not checked yet

Overview

AI snapshot

Written from a shortened version of the paper’s full text (it is longer than we read).

TL;DR

The paper argues that deep learning systems can match or exceed human performance on some pattern-recognition tasks but still lack key ingredients of human-like learning and thought, especially causal model building, intuitive physics and psychology, compositionality, and learning-to-learn. It uses handwritten character learning and the Atari game Frostbite as challenge problems to show where current systems fall short and to propose routes toward more human-like machines.

Key findings

  • The DQN needed about 924 hours of unique experience per Atari game, roughly 500 times the approximately 2 hours given to a professional gamer, and achieved less than 10% of human-level Frostbite performance in a controlled test; later variants reached 83% and 172% of the expert score but still required far more experience. In the authors’ informal play, after watching about 2 minutes of expert video, they reached expert-comparable Frostbite scores within 15–20 minutes of practice.
  • On handwritten characters, deep convolutional networks approach human error on MNIST at 0.2%, but one-shot learning differs sharply: Bayesian program learning achieved human-level one-shot classification and generation after pretraining on five alphabets (about 150 character types), whereas deep ConvNets had 23% error versus 4% for humans with five alphabets, and 30% error with 30 alphabets.
  • AlphaGo was initially trained on 28.4 million positions from 160,000 human games and then improved through 30 million self-play games, while Lee Sedol is estimated to have played around 50,000 games in his life; the paper uses this contrast to argue that human-like understanding and flexible generalization remain distinct from benchmark performance.
  • The paper proposes core ingredients for human-like intelligence: intuitive physics, intuitive psychology, compositionality, causality, learning-to-learn, and fast approximate inference or model-free support for slower model-based reasoning.

Methods

  • Conceptual review and synthesis drawing on cognitive science, developmental psychology, and artificial intelligence; no new formal experiment is reported.
  • Two running challenge problems are used: the Characters Challenge for one-shot handwritten character concept learning, and the Frostbite Challenge for deep reinforcement learning control.
  • The analysis contrasts pattern recognition with model building, reviews evidence on human learning and machine learning, and proposes integration routes; it also includes informal author play of Frostbite after watching expert videos.

Limitations

  • Stated: the ingredient list is not intended to be complete; language is acknowledged as essential but not developed; the authors remain agnostic about whether the ingredients are innate or learned; and the focus is on neural networks, with probabilistic machine learning largely beyond scope.
  • Evident: there is no controlled empirical study; the Frostbite human comparison relies on informal author play and prior experience; and the challenge comparisons may be confounded by humans’ extensive prior knowledge, which the authors acknowledge but do not fully resolve.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1017/s0140525x16001837

Cites

280 of 282 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

267 Not checked yet · 224 Own interpretation · 128 No basis given · 9 Own result

Verify all 393 references — free account

Show all 333 claims

  • It may state two separate claims as one. 156
  • Probably not a substantial claim. 166
  • The quote only partly states this claim. 1
295 of 295
  • The paper relies on this without support.

    People are better than machines at solving a range of difficult computational problems including concept learning, scene understanding, language acquisition, language understanding, and speech recognition.

    “Despite recent computational achievements, people are better than machines at solving a range of difficult computational problems, including concept learning, scene understanding, language acquisition, language understanding, speech recognition, and so on.”
  • The paper relies on this without support.

    Children possess the ability and desire to uncover underlying causes of sparsely observed events and use that knowledge to go beyond limited data.

    “Children come with the ability and the desire to uncover the underlying causes of sparsely observed events and to use that knowledge to go far beyond the paucity of the data.”
  • The paper relies on this without support.

    People can comprehend a novel scene in a fraction of a second, or a novel utterance in little more than the time it takes to say and hear it.

    “People can comprehend a novel scene in a fraction of a second, or a novel utterance in little more than the time it takes to say it and hear it.”
  • The paper relies on this without support.

    Once a causal model of a task is learned, humans can use the model to plan action sequences that maximize future reward.

    “Once a causal model of a task has been learned, humans can use the model to plan action sequences that maximize future reward.”
  • The paper relies on this without support.

    Humans combine model-based and model-free learning algorithms both competitively and cooperatively, and these interactions are supervised by metacognitive processes.

    “We review evidence that humans combine model-based and model-free learning algorithms both competitively and cooperatively and that these interactions are supervised by metacognitive processes.”
  • The paper relies on this without support.

    People can integrate across multiple examples of a character to infer optional elements, such as the cross-bar in '7's, and combine variants into a single coherent representation.

    “Furthermore, people can efficiently integrate across multiple examples of a character to infer which have optional elements, such as the horizontal cross-bar in '7's, combining different variants of the same character into a single coherent representation.”
  • The paper relies on this without support.

    The core ingredients of human intelligence are not present in most current learning-based AI systems, and not all of them are present together.

    “they are key building blocks, which are not present in most current learningbased AI systemscertainly not all present together”
  • The paper relies on this without support.

    The DQN starts completely from scratch, without prior experience.

    “The DQN is starting completely from scratch”
  • The authors state this as an assumption.

    The success of the BPL framework in the Characters Challenge can be generalized to understanding human learning as rapid model building.

    “The following sections discuss the three main ingredientscompositionality, causality, and learning-to-learnthat were important to the success of this framework and, we believe, are important to understanding human learning as rapid model building more broadly.”
  • The paper relies on this without support.

    The Characters Challenge and the Frostbite Challenge are representative testbeds for studying human-like learning and thinking.

    “We can see this potential in both of our challenge problems.”
  • The authors state this as an assumption.

    Cognitive plausibility offers a surer foundation than biological plausibility for theories of intelligence.

    “For now, we believe cognitive plausibility offers a surer foundation.”
  • The paper relies on this without support.

    Brain cells are not motile enough to selectively deliver messages to their destinations.

    “Given that brain cells themselves are not motile enough to selectively deliver messages to their destination (unlike cells in the immune system, for example)”
  • The paper relies on this without support.

    The brain implements a generative model.

    “what kind of generative model the brain implements”
  • The paper relies on this without support.

    The power of neural networks lies in their ability to encode rich featural and contextual information.

    “On the other hand, the power of neural networks lies precisely in their ability to encode rich featural and contextual information.”
  • The paper relies on this without support.

    Experience with particular causal relations likely correlates with experience of more superficial features.

    “Given that experience with particular causal relations is likely to correlate with experience of more superficial features, a more powerful AI model generator may still suffer similar problems when faced with the difficult decision of which model to apply to a new situation.”
  • The paper relies on this without support.

    Current deep learning research does not include physical embodiment.

    “and yet it is out of the picture in current deep learning research”
  • The paper relies on this without support.

    Deep learning architectures often concentrate on inference and optimization.

    “Deep learning architectures often focus on inference and optimization.”
  • The paper relies on this without support.

    Learning happens through complex dynamical interactions among inference, memory, attention, motivation, low-level sensorimotor loops, embodiment, and social interaction.

    “learning occurs through complex dynamical interaction among systems of inference, memory, attention, motivation, low-level sensorimotor loops, embodiment, and social interaction”
  • The paper relies on this without support.

    Attention and memory are among the ingredients already present in current deep learning research.

    “Although some of these ingredients are part of current DL research, (e.g., attention and memory)”
  • The paper relies on this without support.

    AI algorithms draw inspiration from human cognitive systems where humans perform better than machines.

    “Artificial intelligence algorithms seek inspiration from human cognitive systems in areas where humans outperform machines.”
  • The paper relies on this without support.

    A human-like classification of the Figure 6 scene would conclude that it shows either a legal execution or a murder.

    “a human-like classification of such a scene would rather reach the conclusion that the scene depicts either a legal execution or a murder”
  • The paper relies on this without support.

    People interacting with the system will probably want a justification for why it chose one interpretation over another.

    “Humans interacting with the system will likely expect a justification of why it has picked one interpretation rather than another”
22 of 22

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 228 references

Research works printed but not linked: 40

  1. 1961, GPS, A program that simulates human thought
  2. 1966, Cognitive psychology
  3. 2012, JMLR Workshop on Unsupervised and Transfer Learning, 27, 195
  4. 2007, Contemporary Educational Psychology, 25, 54
  5. 1996, Rethinking innateness
  6. 2003, Artificial intelligence: A modern approach
  7. 2015, Journal of Experimental & Theoretical Artificial Intelligence, 28, 751
  8. 2014, Proceedings of Machine Learning Research, 32, 647
  9. 1986, Machine Learning, 1, 47
  10. 1986, Parallel distributed processing: Explorations in the microstructure of cognition, Vol. 1
  11. 1986, Parallel distributed processing: Explorations in the microstructure of cognition, Vol. 1, 216
  12. 2004, Semantic cognition
  13. 2015, Communications of the ACM, 58, 92
  14. 1986, Parallel distributed processing: Explorations in the microstructure of cognition, Vol. 2
  15. 1995, An invitation to cognitive science: vol. 2. Visual cognition, 297
  16. Ghahramani, 2014, Advances in neural information processing systems 27 (NIPS 2014)
  17. 1979, Cognitive Science, 3, 275
  18. 1950, Mind, 59, 433
  19. 2007, Nature, 450, 57
  20. 2010, Origins of human communication
  21. 1962, IRE Transactions on Information Theory, 8, 155
  22. 1982, Vision
  23. 2003, Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 1141
  24. 2007, The stuff of thought: Language as a window into human nature
  25. 1989, Categorization and naming in children
  26. 1978, Papers and Reports on Child Language Development, 15, 17
  27. 1998, Cognitive Psychology, 282, 243
  28. Bresnan, 1978, Linguistic theory and psychological reality, 264
  29. Woodward, 2009, Learning and the infant mind, 66
  30. 2006, Mind as machine: A history of cognitive science
  31. 2014, Machine: earning: An artificial intelligence approach, vol. 3
  32. 2014, PLoS Computational Biology, 10
  33. 1990, Technometric, 33, 251
  34. 1975, The psychology of computer vision, 157
  35. Damon, 1998, Handbook of child psychology: Vol. 2. Cognition, perception, and language development, 523
  36. 1992, Machine Learning, 8, 279
  37. 2012, IEEE Signal Processing Magazine, 29, 82
  38. 2013, Frontiers in Psychology, 4, 365
  39. 2015, Science, 34, 273
  40. 2004, Bayesian data analysis

Cited by

Sorted by citations

Items 1,001–1,013 of 1,013

Metadata

Authors
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J.
Affiliations
  • New York University (US)
  • Massachusetts Institute of Technology (US)
  • Harvard University (US)
Venue
Behavioral and Brain Sciences
Published
2016-11-24
Volume
40
Pages
e253-e253
ISSN
  • 0140-525X (ISSN-L)
  • 1469-1825
OpenAlex
W2328078142
Cited by
2,550
References
228
Citations by year
2026: 244 · 2025: 273 · 2024: 305 · 2023: 274 · 2022: 253 · 2021: 358 · 2020: 282 · 2019: 280 · 2018: 168 · 2017: 90 · 2016: 19
FWCI
152.60
Type
journal article
Language
en
Open access
Locations
  • Behavioral and Brain Sciences (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc-sa)
  • arXiv (Cornell University)
Funders
  • National Science Foundation (ES/K002201/1, RP2012-V-022, 1231216)
  • York University
  • Leverhulme Trust (RP2012-V022, ES/K002201/1)
  • Research Councils UK (EP/K039830/1)
  • Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (146702, 144413)
  • Companhia Brasileira de Metalurgia e Mineração (CCF-1231216)
  • Economic and Social Research Council (ES/K002201/1, RP2012-V-022, K002201, ES/K002201/)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
  • Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
  • Physical Sciences › Computer Science › Artificial Intelligence › Cognitive Computing and Networks
Keywords
human-like learning, artificial intelligence, causal models, explanation and understanding, intuitive theories, compositionality, meta-learning, knowledge generalization, cognitive models, deep neural network
MeSH terms
Achievement, Artificial Intelligence, Humans, Intelligence, Thinking, Visual Perception, Neural Networks, Computer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review