The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Computational rationality: A converging paradigm for intelligence in brains, minds, and machines
Abstract
After growing up together, and mostly growing apart in the second half of the 20th century, the fields of artificial intelligence (AI), cognitive science, and neuroscience are reconverging on a shared view of the computational foundations of intelligence that promotes valuable cross-disciplinary exchanges on questions, methods, and results. We chart advances over the past several decades that address challenges of perception and action under uncertainty through the lens of computation. Advances include the development of representations and inferential procedures for large-scale probabilistic inference and machinery for enabling reflection and decisions about tradeoffs in effort, precision, and timeliness of computations. These tools are deployed toward the goal of computational rationality: identifying decisions with highest expected utility, while taking into consideration the costs of computation in complex real-world problems in which most relevant calculations can only be approximated. We highlight key concepts with examples that show the potential for interchange between computer science, cognitive science, and neuroscience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Theory of games and economic behavior
(2019) · 100 Years of Math Milestones · doi:10.1090/mbk/121/32 · Cited by 16,632
(1988) · Cited by 16,582
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290
On computable numbers, with an application to the entscheidungsproblem
Turing, A. M. (1937) · Proceedings of the London Mathematical Society · doi:10.1112/plms/s2-42.1.230 · Cited by 8,283
(2009) · Cited by 6,153
Computing Machinery and Intelligence (1950)
Turing, A. (2004) · The Essential Turing · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,118
CONDENSATION—Conditional Density Propagation for Visual Tracking
Isard, M., & Blake, A. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008078328650 · Cited by 4,886
Shackle, G. L. S., & Simon, H. A. (1959) · The Economic Journal · doi:10.2307/2228083 · Cited by 3,558
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
The Adaptive Character of Thought
Massaro, D. W., Friedman, D., & Anderson, J. R. (1991) · The American Journal of Psychology · doi:10.2307/1423253 · Cited by 2,174
Adaptive strategy selection in decision making.
Payne, J. W., Bettman, J. R., & Johnson, E. J. (1988) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.14.3.534 · Cited by 1,955
The computational complexity of probabilistic inference using bayesian belief networks
Cooper, G. F. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90060-d · Cited by 1,937
How to grow a mind: Statistics, structure, and abstraction
Tenenbaum, J. B., Kemp, C., Griffiths, T. L., & Goodman, N. D. (2011) · Science · doi:10.1126/science.1192788 · Cited by 1,815
Self-citationModel-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779
Self-citation(1988) · doi:10.1016/b978-0-08-051489-5.50008-4 · Cited by 1,429
Simon, H. A. (1957) · Economica · doi:10.2307/2550441 · Cited by 1,330
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226
Actions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217
Hippocampal place-cell sequences depict future paths to remembered goals
Pfeiffer, B. E., & Foster, D. J. (2013) · Nature · doi:10.1038/nature12112 · Cited by 1,216
Decision making and the avoidance of cognitive demand
Kool, W., McGuire, J. T., Rosen, Z. B., & Botvinick, M. M. (2010) · Journal of Experimental Psychology: General · doi:10.1037/a0020198 · Cited by 1,141
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003
Good, I. J. (1952) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1952.tb00104.x · Cited by 976
Man as an intuitive statistician.
Peterson, C. R., & Beach, L. R. (1967) · Psychological Bulletin · doi:10.1037/h0024722 · Cited by 963
von Neumann, J. (2017) · Yale University Press eBooks · doi:10.12987/9780300188080 · Cited by 877
Coordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748
Neural computations underlying arbitration between model-based and model-free learning
Lee, S. W., Shimojo, S., & O’Doherty, J. P. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.028 · Cited by 642
SSL: A Theory of How People Learn to Select Strategies.
Rieskamp, J., & Otto, P. E. (2006) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.135.2.207 · Cited by 618
Structure and strength in causal induction☆
Griffiths, T. L., & Tenenbaum, J. B. (2005) · Cognitive Psychology · doi:10.1016/j.cogpsych.2005.05.004 · Cited by 612
Self-citationOaksford, M., & Chater, N. (2007) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524496.001.0001 · Cited by 549
Bayesian Brain: Probabilistic Approaches to Neural Coding
(2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262042383.001.0001 · Cited by 511
Vul (2014) · doi:10.1111/cogs.12101 · Cited by 502
Rationality for Mortals: How People Cope with Uncertainty
Gigerenzer, G. (2008) · doi:10.1093/oso/9780195328981.001.0001 · Cited by 485
Rationality for mortals: how people cope with uncertainty
(2009) · Choice Reviews Online · doi:10.5860/choice.46-4133 · Cited by 469
Griffiths, T. L., Lieder, F., & Goodman, N. D. (2015) · Topics in Cognitive Science · doi:10.1111/tops.12142 · Cited by 397
Buesing, L., Bill, J., Nessler, B., & Maass, W. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002211 · Cited by 384
Rational approximations to rational models: alternative algorithms for category learning
Sanborn, A. N., Griffiths, T. L., & Navarro, D. J. (2010) · Psychological Review · doi:10.1037/a0020511 · Cited by 369
Russell, S., & Wefald, E. (1991) · Artificial Intelligence · doi:10.1016/0004-3702(91)90015-c · Cited by 358
Otto (2013) · doi:10.1177/0956797612463080 · Cited by 352
Speed/accuracy trade-off between the habitual and the goal-directed processes
Keramati, M., Dezfouli, A., & Piray, P. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002055 · Cited by 346
A labor/leisure tradeoff in cognitive control.
Kool, W., & Botvinick, M. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0031048 · Cited by 320
Monte-Carlo Tree Search: A New Framework for Game AI
Chaslot, G., Bakkes, S., Szita, I., & Spronck, P. (2008) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v4i1.18700 · Cited by 312
Reasoning about beliefs and actions under computational resource constraints
(1988) · International Journal of Approximate Reasoning · doi:10.1016/0888-613x(88)90148-x · Cited by 309
Prefrontal cortex, cognitive control, and the registration of decision costs
McGuire, J. T., & Botvinick, M. M. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0910662107 · Cited by 286
Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning
Guo, X., Singh, S. P., Lee, H., Lewis, R. L., & Wang, X. (2014) · Cited by 271
Computational Rationality: Linking Mechanism and Behavior Through Bounded Utility Maximization
Lewis, R. L., Howes, A., & Singh, S. (2014) · Topics in Cognitive Science · doi:10.1111/tops.12086 · Cited by 223
The grand challenge of computer Go: Monte Carlo tree search and extensions
Gelly, S., Kocsis, L., Schoenauer, M., Sébag, M., Silver, D., Szepesvári, C., & Teytaud, O. (2012) · Communications of the ACM · doi:10.1145/2093548.2093574 · Cited by 205
Planning under time constraints in stochastic domains
Dean, T., Kaelbling, L. P., Kirman, J., & Nicholson, A. (1995) · Artificial Intelligence · doi:10.1016/0004-3702(94)00086-g · Cited by 198
The Grand Challenge of Computer Go: Monte Carlo Tree Search and Extensions
Gelly, S., Schoenauer, M., Teytaud, O., et al. (2012) · Cited by 147
Multistability and perceptual inference
Gershman, S. J., Vul, E., & Tenenbaum, J. B. (2012) · Neural Computation · doi:10.1162/neco_a_00226 · Cited by 140
Rational variability in children's causal inferences: the sampling hypothesis
Denison, S., Bonawitz, E., Gopnik, A., & Griffiths, T. L. (2013) · Cognition · doi:10.1016/j.cognition.2012.10.010 · Cited by 126
Reflection and Action Under Scarce Resources: Theoretical Principles and Empirical Study
Horvitz, E., Cooper, G. F., & Heckerman, D. E. (1989) · Cited by 126
Self-citationVul, E., Alvarez, G. A., Tenenbaum, J. B., & Black, M. J. (2009) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 114
Self-citationTime-Dependent Utility and Action Under Uncertainty
Horvitz, E., & Rutledge, G. W. (1991) · Elsevier eBooks · doi:10.1016/b978-1-55860-203-8.50023-1 · Cited by 80
Self-citationModeling the effects of memory on human online sentence processing with particle filters
Lévy, R., Reali, F., & Griffiths, T. L. (2008) · neural information processing systems · Cited by 79
Algorithm selection by rational metareasoning as a model of human strategy selection
Lieder, F., Plunkett, D., Hamrick, J. B., Russell, S., Hay, N., & Griffiths, T. L. (2014) · doi:10.13140/2.1.2563.1686 · Cited by 40
The high availability of extreme events serves resource-rational decision-making
Lieder, F., Hsu, M., & Griffiths, T. L. (2014) · eScholarship (California Digital Library) · doi:10.13140/rg.2.2.22049.53605 · Cited by 26
Cited by
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Self-citationCausability and explainability of artificial intelligence in medicine
Holzinger, A., Langs, G., Denk, H., Zatloukal, K., & Müller, H. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1312 · Cited by 1,885
Kriegeskorte, N. (2015) · Annual Review of Vision Science · doi:10.1146/annurev-vision-082114-035447 · Cited by 1,093
Toward a rational and mechanistic account of mental effort
Shenhav, A., Musslick, S., Lieder, F., Kool, W., Griffiths, T. L., Cohen, J. D., & Botvinick, M. M. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031526 · Cited by 1,077
Lieder, F., & Griffiths, T. L. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1900061x · Cited by 892
Metadata
- Authors
- Gershman, S. J., Horvitz, E. J., & Tenenbaum, J. B.
- Venue
- Science
- Published
- 2015-07-17
- Volume
- 349
- Issue
- 6245
- Pages
- 273-278
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W1892018222
- Cited by
- 673
- References
- 60
- FWCI
- 40.98
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.