Planning in the brain
Open accessThe DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
Abstract
Recent breakthroughs in artificial intelligence (AI) have enabled machines to plan in tasks previously thought to be uniquely human. Meanwhile, the planning algorithms implemented by the brain itself remain largely unknown. Here, we review neural and behavioral data in sequential decision-making tasks that elucidate the ways in which the brain does-and does not-plan. To systematically review available biological data, we create a taxonomy of planning algorithms by summarizing the relevant design choices for such algorithms in AI. Across species, recording techniques, and task paradigms, we find converging evidence that the brain represents future states consistent with a class of planning algorithms within our taxonomy-focused, depth-limited, and serial. However, we argue that current data are insufficient for addressing more detailed algorithmic questions. We propose a new approach leveraging AI advances to drive experiments that can adjudicate between competing candidate algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
A Formal Basis for the Heuristic Determination of Minimum Cost Paths
Hart, P., Nilsson, N., & Raphael, B. (1968) · IEEE Transactions on Systems Science and Cybernetics · doi:10.1109/tssc.1968.300136 · Cited by 12,738
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
The functional anatomy of basal ganglia disorders
Albin, R. L., Young, A. B., & Penney, J. B. (1989) · Trends in Neurosciences · doi:10.1016/0166-2236(89)90074-x · Cited by 5,353
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256
DeepLabCut: markerless pose estimation of user-defined body parts with deep learning
Mathis, A., Mamidanna, P., Cury, K. M., Abe, T., Murthy, V. N., Mathis, M. W., & Bethge, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0209-y · Cited by 5,187
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733 · cited 1×
“the neural bases of planning in a domain that remains challenging for even today’s AI algorithms (Arulkumaran et al., 2017).”
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764 · cited 1×
“Single-step tasks have also allowed much progress in characterizing the computations and neural signals associated with related processes, such as perceptual decision making (Gold and Shadlen, 2007) and economic choice (Padoa-Schioppa and Assad, 2006).”
Specific impairments of planning
Shallice, T. (1982) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1982.0082 · Cited by 3,741
Acquisition of cognitive skill
Anderson, J. R. (1982) · Psychological Review · doi:10.1037/0033-295x.89.4.369 · Cited by 3,663 · cited 1×
“…labels, such as automatic versus deliberate control, habitual versus goal-directed behavior, model-free versus model-based decision making, and type I versus type II reasoning (Anderson, 1982; Adams and Dickinson, 1981; Dickinson and Balleine, 2002; Kahneman, 2011; Daw et al., 2005; Dayan, 2009).”
A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2018) · Science · doi:10.1126/science.aar6404 · Cited by 3,562
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
Sutton, R. S., Precup, D., & Singh, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00052-1 · Cited by 3,119
Optimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081 · cited 1×
“Studies on the control of eye and arm movements have provided particularly striking demonstrations of stochastic internal (so-called forward) models underlying motor planning (Harris and Wolpert, 1998; Todorov and Jordan, 2002).”
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Signal-dependent noise determines motor planning
Harris, C. M., & Wolpert, D. M. (1998) · Nature · doi:10.1038/29528 · Cited by 2,498
Bellman, R. (1957) · Indiana University Mathematics Journal · doi:10.1512/iumj.1957.6.56038 · Cited by 2,408
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271
Fully integrated silicon probes for high-density recording of neural activity
Jun, J. J., Steinmetz, N. A., Siegle, J. H., Denman, D. J., Bauza, M., Barbarits, B., Lee, A. K., Anastassiou, C. A., Andrei, A., Aydın, Ç., et al. (2017) · Nature · doi:10.1038/nature24636 · Cited by 2,190
Reverse replay of behavioural sequences in hippocampal place cells during the awake state
Foster, D. J., & Wilson, M. A. (2006) · Nature · doi:10.1038/nature04587 · Cited by 1,727 · cited 1×
“Also, unlike theta sequences, hippocampal replay can extend not only forward but also backward in space (Foster and Wilson, 2006),”
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Selective suppression of hippocampal ripples impairs spatial memory
Girardeau, G., Benchenane, K., Wiener, S. I., Buzsáki, G., & Zugaro, M. B. (2009) · Nature Neuroscience · doi:10.1038/nn.2384 · Cited by 1,560
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390
Neuroscience Needs Behavior: Correcting a Reductionist Bias
Krakauer, J. W., Ghazanfar, A. A., Gomez-Marin, A., MacIver, M. A., & Poeppel, D. (2017) · Neuron · doi:10.1016/j.neuron.2016.12.041 · Cited by 1,358
Memory of sequential experience in the hippocampus during slow wave sleep
Lee, A. K., & Wilson, M. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)01096-6 · Cited by 1,296
Schemas and Memory Consolidation.
Tse, D., Langston, R. F., Kakeyama, M., Bethus, I., Spooner, P. A., Wood, E. R., Witter, M. P., & Morris, R. G. M. (2007) · Science · doi:10.1126/science.1135935 · Cited by 1,244
Campbell, M., Hoane, A. J., & Hsu, F.-H. (2002) · Artificial Intelligence · doi:10.1016/s0004-3702(01)00129-1 · Cited by 1,226
Hippocampal place-cell sequences depict future paths to remembered goals
Pfeiffer, B. E., & Foster, D. J. (2013) · Nature · doi:10.1038/nature12112 · Cited by 1,216
Mastering Atari, Go, chess and shogi by planning with a learned model
Schrittwieser, J., Antonoglou, I., Hubert, T., Simonyan, K., Sifre, L., Schmitt, S., Guez, A., Lockhart, E., Hassabis, D., Graepel, T., et al. (2020) · Nature · doi:10.1038/s41586-020-03051-4 · Cited by 1,214
Forward and reverse hippocampal place-cell sequences during ripples
Diba, K., & Buzsáki, G. (2007) · Nature Neuroscience · doi:10.1038/nn1961 · Cited by 1,205
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
The role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099
A Recurrent Network Mechanism of Time Integration in Perceptual Decisions
Wong, K.-F., & Wang, X.-J. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3733-05.2006 · Cited by 1,029
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003
The hippocampus as a predictive map
Stachenfeld, K. L., Botvinick, M. M., & Gershman, S. J. (2017) · Nature Neuroscience · doi:10.1038/nn.4650 · Cited by 1,000
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
Reward processing in primate orbitofrontal cortex and basal ganglia
Schultz, W. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.272 · Cited by 942
Organizing conceptual knowledge in humans with a gridlike code
Constantinescu, A. O., O’Reilly, J. X., & Behrens, T. E. J. (2016) · Science · doi:10.1126/science.aaf0941 · Cited by 937 · cited 2×
“A number of studies have now used behavioral paradigms directly modeled after (simplified) navigation tasks but in which subjects navigated more abstract cognitive spaces (Eichenbaum and Cohen, 2014; Constantinescu et al., 2016).”
Awake hippocampal sharp-wave ripples support spatial memory
Jadhav, S. P., Kemere, C., German, P. W., & Frank, L. M. (2012) · Science · doi:10.1126/science.1217230 · Cited by 924
Intelligence and the Frontal Lobe: The Organization of Goal-Directed Behavior
Duncan, J., Emslie, H., Williams, P., Johnson, R., & Freer, C. (1996) · Cognitive Psychology · doi:10.1006/cogp.1996.0008 · Cited by 902
Lieder, F., & Griffiths, T. L. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1900061x · Cited by 892 · cited 1×
“For instance, starting from the assumption that people make rational use of their limited cognitive resources, one can derive rational models and algorithms, an approach known as resource-rational (Lieder and Griffiths, 2019).”
Orbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885 · cited 1×
“Moreover, the OFC is involved in representing not only rewarding outcomes but also expected future stimuli (Sadacca et al., 2018; Pauli et al., 2019) and the task space more generally (Wilson et al., 2014).”
Conjunctive representations in learning and memory: Principles of cortical and hippocampal function.
O'Reilly, R. C., & Rudy, J. W. (2001) · Psychological Review · doi:10.1037//0033-295x.108.2.311 · Cited by 865
The logic theory machine-A complex information processing system
Newell, A., & Simon, H. (1956) · IEEE Transactions on Information Theory · doi:10.1109/tit.1956.1056797 · Cited by 846
Hippocampal replay of extended experience
Davidson, T. J., Kloosterman, F., & Wilson, M. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.07.027 · Cited by 806
Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment
Berkes, P., Orbán, G., Lengyel, M., & Fiser, J. (2011) · Science · doi:10.1126/science.1195870 · Cited by 782
Self-citationDyna, an Integrated Architecture for Learning, Planning, and Reacting
Sutton, R. S. (1991) · ACM SIGART Bulletin · doi:10.1145/122344.122377 · Cited by 777 · cited 3×
“This 8 Neuron 110, March 16, 2022 strategy is particularly fruitful in stochastic environments, where algorithms can improve the agent’s policy by expanding a large number of such single-step trees, starting from all possible states (as in dynamic programming algorithms, such as value iteration or policy iteration) or…”
Mapping of a non-spatial dimension by the hippocampal-entorhinal circuit
Aronov, D., Nevers, R., & Tank, D. W. (2017) · Nature · doi:10.1038/nature21692 · Cited by 773
Awake replay of remote experiences in the hippocampus
Karlsson, M. P., & Frank, L. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2344 · Cited by 769 · cited 1×
“, 2009) than those spanned by theta sequences and may represent locations in different environments altogether (Karlsson and Frank, 2009).”
Hippocampal replay is not a simple function of experience
Gupta, A. S., van der Meer, M. A. A., Touretzky, D. S., & Redish, A. D. (2010) · Neuron · doi:10.1016/j.neuron.2010.01.034 · Cited by 733
Why are some problems hard? Evidence from Tower of Hanoi
Kotovsky, K., Hayes, J. R., & Simon, H. A. (1985) · Cognitive Psychology · doi:10.1016/0010-0285(85)90009-x · Cited by 722
Learning Latent Dynamics for Planning from Pixels
Hafner, D., Lillicrap, T., Fischer, I., Villegas, R., Ha, D., Lee, H., & Davidson, J. (2018) · arXiv · doi:10.48550/arxiv.1811.04551 · Cited by 708
Novel electrode technologies for neural recordings
Hong, G., & Lieber, C. M. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0140-6 · Cited by 695
Statistically optimal perception and learning: from behavior to neural representations
Fiser, J., Berkes, P., Orbán, G., & Lengyel, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.003 · Cited by 672
Self-citationPlanning for the future by western scrub-jays
Raby, C. R., Alexis, D. M., Dickinson, A., & Clayton, N. S. (2007) · Nature · doi:10.1038/nature05575 · Cited by 670
Whittington, J. C. R., Muller, T. H., Mark, S., Chen, G., Barry, C., Burgess, N., & Behrens, T. E. J. (2020) · Cell · doi:10.1016/j.cell.2020.10.024 · Cited by 660
Navigating cognition: Spatial codes for human thinking
Bellmund, J. L. S., Gärdenfors, P., Moser, E. I., & Doeller, C. F. (2018) · Science · doi:10.1126/science.aat6766 · Cited by 643
Gremel, C. M., & Costa, R. M. (2013) · Nature Communications · doi:10.1038/ncomms3264 · Cited by 618
Prefrontal cortex as a meta-reinforcement learning system
Wang, J. X., Kurth-Nelson, Z., Kumaran, D., Tirumala, D., Soyer, H., Leibo, J. Z., Hassabis, D., & Botvinick, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0147-8 · Cited by 596
Orbitofrontal Cortex and Representation of Incentive Value in Associative Learning
Gallagher, M., McMahan, R. W., & Schoenbaum, G. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-15-06610.1999 · Cited by 593
Spatial representation in the hippocampal formation: a history
Moser, E. I., Moser, M.-B., & McNaughton, B. L. (2017) · Nature Neuroscience · doi:10.1038/nn.4653 · Cited by 560
Determining the neural substrates of goal-directed learning in the human brain
Valentin, V. V., Dickinson, A., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0564-07.2007 · Cited by 529
Are the frontal lobes implicated in “planning” functions? Interpreting data from the Tower of Hanoi
Goel, V., & Grafman, J. (1995) · Neuropsychologia · doi:10.1016/0028-3932(95)90866-p · Cited by 510
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04219.x · Cited by 447 · cited 1×
“Indeed, both lesion and recording studies in rodents suggest that the dorsomedial portion of the striatum is essential for goal-directed behavior (Albin et al., 1989; Obeso et al., 2009; Ragozzino et al., 2002; Yin et al., 2005a; Balleine et al., 2007).”
Huys, Q. J. M., Eshel, N., O'Nions, E., Sheridan, L., Dayan, P., & Roiser, J. P. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002410 · Cited by 439
Rudebeck, P. H., & Murray, E. A. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.049 · Cited by 405
Prioritized memory access explains planning and hippocampal replay
Mattar, M. G., & Daw, N. D. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0232-z · Cited by 393 · cited 4×
“The role of replay in offline planning suggested by these various studies can be captured by a normative computational model associating place cell activity with nonlocal action evaluation (Mattar and Daw, 2018).”
InfluentialSelf-citationPrefrontal mechanisms of behavioral flexibility, emotion regulation and value updating
Rudebeck, P. H., Saunders, R. C., Prescott, A. T., Chau, L. S., & Murray, E. A. (2013) · Nature Neuroscience · doi:10.1038/nn.3440 · Cited by 383
Hippocampal place cells construct reward related sequences through unexplored space
Ólafsdóttir, H. F., Barry, C., Saleem, A. B., Hassabis, D., & Spiers, H. J. (2015) · eLife · doi:10.7554/elife.06063 · Cited by 319
Mapping value based planning and extensively trained choice in the human brain
Wunderlich, K., Dayan, P., & Dolan, R. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3068 · Cited by 310
Howard, L. R., Javadi, A. H., Yu, Y., Mill, R. D., Morrison, L. C., Knight, R., Loftus, M. M., Staskute, L., & Spiers, H. J. (2014) · Current Biology · doi:10.1016/j.cub.2014.05.001 · Cited by 298
Owen, A. M. (1997) · Progress in Neurobiology · doi:10.1016/s0301-0082(97)00042-7 · Cited by 251
Activity in the lateral prefrontal cortex reflects multiple steps of future events in action plans
Mushiake, H., Saito, N., Sakamoto, K., Itoyama, Y., & Tanji, J. (2006) · Neuron · doi:10.1016/j.neuron.2006.03.045 · Cited by 249 · cited 3×
“, by devaluation; Balleine and Dickinson, 1998) or goals (e.g., in a navigation-like setting; Mushiake et al., 2006) can promote planning-based strategies but still cannot exclude more sophisticated reflexive strategies that use temporal abstraction (such as the SR; Dayan, 1993; Russek et al.”
InfluentialInternal models in biological control
McNamee, D., & Wolpert, D. M. (2019) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-060117-105206 · Cited by 225
Triple dissociation of attention and decision computations across prefrontal cortex
Hunt, L. T., Malalasekera, W. M. N., de Berker, A. O., Miranda, B., Farmer, S. F., Behrens, T. E. J., & Kennerley, S. W. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0239-5 · Cited by 222
Retrospective revaluation in sequential decision making: a tale of two systems
Gershman, S. J., Markman, A. B., & Otto, A. R. (2014) · Journal of Experimental Psychology General · doi:10.1037/a0030844 · Cited by 217 · cited 1×
“behavioral experiment with humans suggests that processes occurring during a rest phase can impact a subject’s choices in a later test phase (Gershman et al., 2014).”
The algorithmic anatomy of model-based evaluation
Daw, N. D., & Dayan, P. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0478 · Cited by 195
THE FRONTAL LOBE IN MAN: A CLINICAL STUDY OF MAXIMUM REMOVALS
PENFIELD, W., & EVANS, J. (1935) · Brain · doi:10.1093/brain/58.1.115 · Cited by 193
Assembly-specific disruption of hippocampal replay leads to selective memory deficit
Gridchyn, I., Schoenenberger, P., O’Neill, J., & Csicsvari, J. (2020) · Neuron · doi:10.1016/j.neuron.2020.01.021 · Cited by 178
Goal-oriented searching mediated by ventral hippocampus early in trial-and-error learning
Ruediger, S., Spirig, D., Donato, F., & Caroni, P. (2012) · Nature Neuroscience · doi:10.1038/nn.3224 · Cited by 135
Reward revaluation biases hippocampal replay content away from the preferred outcome
Carey, A. A., Tanaka, Y., & van der Meer, M. A. A. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0464-6 · Cited by 106
Choice Coding in Frontal Cortex during Stimulus-Guided or Action-Guided Decision-Making
Luk, C.-H., & Wallis, J. D. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4920-12.2013 · Cited by 96
Goal-directed control and its antipodes
Dayan, P. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.004 · Cited by 93 · cited 1×
“…labels, such as automatic versus deliberate control, habitual versus goal-directed behavior, model-free versus model-based decision making, and type I versus type II reasoning (Anderson, 1982; Adams and Dickinson, 1981; Dickinson and Balleine, 2002; Kahneman, 2011; Daw et al., 2005; Dayan, 2009).”
Hippocampal place cells encode global location but not connectivity in a complex space
Duvelle, É., Grieves, R. M., Liu, A., Jedidi-Ayoub, S., Holeniewska, J., Harris, A., Nyberg, N., Donnarumma, F., Lefort, J. M., Jeffery, K. J., et al. (2021) · Current Biology · doi:10.1016/j.cub.2021.01.005 · Cited by 48 · cited 2×
“Although deterministic internal models are sufficient for standard navigation tasks (with the walls of a maze being fixed), more recent paradigms allow the introduction of stochasticity and thus pave the way to identifying a more general class of algorithms (Wood et al., 2018; Duvelle et al., 2021).”
Rational thoughts in neural codes
Wu, Z., Kwon, M., Daptardar, S., Schrater, P., & Pitkow, X. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912336117 · Cited by 27
Cited by
In vitro neurons learn and exhibit sentience when embodied in a simulated game-world
Kagan, B. J., Kitchen, A. C., Tran, N. T., Habibollahi, F., Khajehnejad, M., Parker, B. J., Bhat, A., Rollo, B., Razi, A., & Friston, K. J. (2022) · Neuron · doi:10.1016/j.neuron.2022.09.001 · Cited by 400
Discovering cognitive strategies with tiny recurrent neural networks
Ji-An, L., Benna, M. K., & Mattar, M. G. (2025) · Nature · doi:10.1038/s41586-025-09142-4 · Cited by 64
Self-citationEpisodic retrieval for model-based evaluation in sequential decision tasks.
Zhou, C. Y., Talmi, D., Daw, N. D., & Mattar, M. G. (2025) · Psychological Review · doi:10.1037/rev0000505 · Cited by 21
Self-citationRational Simplification and Rigidity in Human Planning
Ho, M. K., Cohen, J. D., & Griffiths, T. L. (2023) · Psychological Science · doi:10.1177/09567976231200547 · Cited by 11
“Flexible, goal-directed behavior rests on the human capacity to plan (Daw et al., 2005; Mattar & Lengyel, 2022; Newell & Simon, 1972).”
Background
Metadata
- Authors
- Mattar, M. G., & Lengyel, M.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2022-03
- Volume
- 110
- Issue
- 6
- Pages
- 914-934
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W4206198375
- Cited by
- 108
- References
- 87
- FWCI
- 10.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.