CoChat

The DOI matches its Crossref record; 174 of the 174 references it cites were found in a registry or an index; 37 of the 75 sources its claims cite were checked for support.

Meta-learned models of cognition

Open access

Abstract

Psychologists and neuroscientists extensively rely on computational models for studying and analyzing the human mind. Traditionally, such computational models have been hand-designed by expert researchers. Two prominent examples are cognitive architectures and Bayesian models of cognition. Although the former requires the specification of a fixed set of computational structures and a definition of how these structures interact with each other, the latter necessitates the commitment to a particular prior and a likelihood function that - in combination with Bayes' rule - determine the model's behavior. In recent years, a new framework has established itself as a promising tool for building models of human cognition: the framework of meta-learning. In contrast to the previously mentioned model classes, meta-learned models acquire their inductive biases from experience, that is, by repeatedly interacting with an environment. However, a coherent research program around meta-learned models of cognition is still missing to date. The purpose of this article is to synthesize previous work in this field and establish such a research program. We accomplish this by pointing out that meta-learning can be used to construct Bayes-optimal learning algorithms, allowing us to draw strong connections to the rational analysis of cognition. We then discuss several advantages of the meta-learning framework over traditional methods and reexamine prior work in the context of these new insights.

Overview

CoChat Summary

TL;DR

Meta-learning can be used to construct Bayes-optimal learning algorithms, connecting it to rational analysis and extending the scope of cognitive theories beyond traditional Bayesian models. The paper synthesizes prior work and proposes a research program around meta-learned models of cognition, with four arguments for their advantages and a review of applications.

Key findings

  • Meta-learning can produce Bayes-optimal learning algorithms; any behavioral phenomenon that can be explained by a Bayesian model can also be explained by a meta-learned model, linking meta-learning to rational analysis.
  • Four advantages over traditional Bayesian methods: (1) approximately optimal learning when exact Bayesian inference is computationally intractable; (2) optimal learning when the prior or likelihood cannot be specified; (3) resource-rational models by manipulating algorithmic and computational complexity; (4) integration of neuroscientific insights via model architectures.
  • Review examples: Dasgupta et al. (2020) with a single hidden unit captured conservatism bias and base rate neglect; Binz et al. (2022) discovered one-reason decision-making and equal weighting heuristics; Wang et al. (2016) showed a meta-learned model displaying model-based behavior despite pure model-free training; Lake (2019) showed compositional generalization.
  • Future domain-general models require more diverse task distributions, natural language instructions, embodiment, and scalable architectures; e.g., Team et al. (2023) trained on over 10^40 possible tasks.

Methods

  • Theoretical/conceptual synthesis and research program, not an empirical study; no human or animal sample is reported. It presents a simplified proof (Aitchison, 1975) that the posterior predictive distribution maximizes expected log-likelihood, and describes inner/outer-loop meta-learning with a ~30-line PyTorch reference implementation.
  • Main analysis is argumentation and review: four arguments for meta-learning over Bayesian inference, a thematic review of prior psychology/neuroscience studies (heuristics/biases, language, inductive biases, model-based reasoning, exploration, cognitive control), and discussion of limitations and future directions.
  • Running example uses insect lengths with assumed normal prior/likelihood; Figure 3 reports meta-learning loss across 30 runs and comparison to exact Bayesian inference.

Limitations

  • Stated: meta-learning lacks interpretability/analytical solutions; training is intricate and time-consuming, requiring retraining when assumptions change; there is no guarantee a converged meta-learned model implements Bayes-optimal inference, with reported failures (e.g., Wang et al., 2021); it is not a replacement for Bayesian inference.
  • Stated: it remains an empirical question which approximate inference method (meta-learning, variational inference, MCMC) better describes human learning.
  • Evident from text: as a review/synthesis, the paper reports no new empirical tests of its proposed research program; many claims about future domain-general models are explicitly speculative.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1017/s0140525x23003266

Cites

174 of 174 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

30 Valid · 10 Not valid · 26 Not checked · 69 Own results and interpretations

74 more claims · 15 with their cited sources checked

Create a free account to see all 135 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 28
  • It may state two separate claims as one. 34

Create a free account to see these claims.

Citations

Cites

Show all 106 references

Research works printed but not linked: 34

  1. Santoro, A. , Bartunov, S. , Botvinick, M. , Wierstra, D. , & Lillicrap, T. (2016). Meta-learning with memory-augmented neural networks. In International conference on machine learning (pp. 1842–1850).
  2. Lengyel, 2007, Hippocampal contributions to control: The third way, Advances in Neural Information Processing Systems, 20, 889
  3. Mitchell, 1997, Machine learning, 1
  4. Bishop, 2006, Pattern recognition and machine learning
  5. Riveland, 2022, Generalization in sensorimotor networks configured with natural language instructions, bioRxiv
  6. Mikulik, 2020, Advances in neural information processing systems, 33, 18691
  7. Savage, 1972, The foundations of statistics
  8. Duff, 2003, Optimal learning: Computational procedures for Bayes-adaptive Markov decision processes
  9. Chomsky, 2014, Aspects of the theory of syntax, 11
  10. Ritter, S. , Wang, J. , Kurth-Nelson, Z. , Jayakumar, S. , Blundell, C. , Pascanu, R. , & Botvinick, M. (2018). Been there, done that: Meta-learning with episodic recall. In International conference on machine learning (pp. 4354–4363).
  11. Dayan, 2000, Explaining away in weight space, Advances in Neural Information Processing Systems, 13, 430
  12. Schulze Buschoff, L. M. , Schulz, E. , & Binz, M. (2023). The acquisition of physical knowledge in generative neural networks. In Proceedings of the 40th international conference on machine learning (pp. 30321–30341).
  13. Vinyals, 2016, Matching networks for one shot learning, Advances in Neural Information Processing Systems, 29, 3637
  14. Cover, 1999, Elements of information theory
  15. Newell, 1972, Human problem solving, 104
  16. Snell, 2017, Prototypical networks for few-shot learning, Advances in Neural Information Processing Systems, 30, 4080
  17. Sancaktar, 2022, Advances in neural information processing systems, 24170
  18. Courville, 2008, Advances in neural information processing systems, 369
  19. Murphy, 2012, Machine learning: A probabilistic perspective
  20. Strouse, 2021, Collaborating with humans without human data, Advances in Neural Information Processing Systems, 34, 14502
  21. Rescorla, 1972, Current research and theory, 64
  22. Schlag, I. , Irie, K. , & Schmidhuber, J. (2021). Linear transformers are secretly fast weight programmers. In International conference on machine learning (pp. 9355–9366).
  23. Rumelhart, 1988, Parallel distributed processing, 1
  24. Schmidhuber, J. (1987). Evolutionary principles in self-referential learning, or on learning how to learn: The meta-meta-… hook . Unpublished doctoral dissertation, Technische Universität München.
  25. Paszke, 2019, Advances in neural information processing systems 32, 8024
  26. Hinton, 1993, Autoencoders, minimum description length and Helmholtz free energy, Advances in Neural Information Processing Systems, 6, 3
  27. Kruschke, 1990, Alcove: A connectionist model of human category learning, Advances in Neural Information Processing Systems, 3, 649
  28. Lueckmann, J.-M. , Boelts, J. , Greenberg, D. , Goncalves, P. , & Macke, J. (2021). Benchmarking simulation-based inference. In International conference on artificial intelligence and statistics (pp. 343–351).
  29. Czerlinski, 1999, Simple heuristics that make us smart, 97
  30. Brown, 2020, Language models are few-shot learners, Advances in Neural Information Processing Systems, 33, 1877
  31. Brändle, 2022b, Intrinsically motivated exploration as empowerment, PsyArXiv
  32. Kolmogorov, 1965, Three approaches to the quantitative definition of information, Problems of Information Transmission, 1, 1
  33. Jagadish, 2023, Zero-shot compositional reinforcement learning in humans
  34. Kumar, S. , Dasgupta, I. , Cohen, J. , Daw, N. , & Griffiths, T. (2020b). Meta-learning of structured task distributions in humans and machines. In International conference on learning representations.

Cited by

See all 38

Metadata

Authors
Binz, M., Dasgupta, I., Jagadish, A. K., Botvinick, M., Wang, J. X., & Schulz, E.
Affiliations
  • Max Planck Institute for Biological Cybernetics (DE)
  • Google DeepMind (United Kingdom) (GB)
Corresponding author
Binz, Marcel
Venue
Behavioral and Brain Sciences
Published
2023-11-23
Volume
47
Pages
e147-e147
ISSN
  • 0140-525X (ISSN-L)
  • 1469-1825
OpenAlex
W4388929313
Cited by
38
References
106
Citations by year
2026: 8 · 2025: 16 · 2024: 12 · 2023: 2
FWCI
1.42
Type
journal article
Language
en
Open access
Locations
  • Behavioral and Brain Sciences (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
Volkswagen Foundation
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Cognitive Science and Education Research
  • Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
  • Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
Keywords
meta-learning, cognitive models, cognitive architecture, Bayesian models of cognition, inductive bias
MeSH terms
Algorithms, Bayes Theorem, Cognition, Humans, Learning, Models, Psychological

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Meta-learned models of cognition. https://app.cochat.ai/papers/10.1017/s0140525x23003266
The paper
Binz, M., Dasgupta, I., Jagadish, A. K., Botvinick, M., Wang, J. X., & Schulz, E. (2024). Meta-learned models of cognition. Behavioral and Brain Sciences. https://doi.org/10.1017/s0140525x23003266

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.