The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Cognitive control over learning: Creating, clustering, and generalizing task-set structure.
Open accessAbstract
Learning and executive functions such as task-switching share common neural substrates, notably prefrontal cortex and basal ganglia. Understanding how they interact requires studying how cognitive control facilitates learning but also how learning provides the (potentially hidden) structure, such as abstract rules or task-sets, needed for cognitive control. We investigate this question from 3 complementary angles. First, we develop a new context-task-set (C-TS) model, inspired by nonparametric Bayesian methods, specifying how the learner might infer hidden structure (hierarchical rules) and decide to reuse or create new structure in novel situations. Second, we develop a neurobiologically explicit network model to assess mechanisms of such structured learning in hierarchical frontal cortex and basal ganglia circuits. We systematically explore the link between these modeling levels across task demands. We find that the network provides an approximate implementation of high-level C-TS computations, with specific neural mechanisms modulating distinct C-TS parameters. Third, this synergism yields predictions about the nature of human optimal and suboptimal choices and response times during learning and task-switching. In particular, the models suggest that participants spontaneously build task-set structure into a learning problem when not cued to do so, which predicts positive and negative transfer in subsequent generalization tests. We provide experimental evidence for these predictions and show that C-TS provides a good quantitative fit to human sequences of choices. These findings implicate a strong tendency to interactively engage cognitive control and learning, resulting in structured abstract representations that afford generalization opportunities and, thus, potentially long-term rather than short-term optimality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Systematicity continues to challenge models and motivates new frameworks.
“Systematicity continues to challenge models11–18 and motivates new frameworks34–41.”
From Human-like systematic generalization through a meta-learning neural network (2023) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Decision theory, reinforcement learning, and the brain
Dayan, P., & Daw, N. D. (2008) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.8.4.429 · Cited by 580
Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making
Collins, A., & Koechlin, E. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001293 · Cited by 558 · cited 1×
“Although this abstract hidden state representation of a task-set feature is present in the model of Collins and Koechlin (2012), that model relies on the assumed episodic stability of external contingencies for task-set inference.”
Self-citationContext, learning, and extinction
Gershman, S. J., Blei, D. M., & Niv, Y. (2010) · Psychological Review · doi:10.1037/a0017808 · Cited by 386 · cited 1×
“N N k ϭ ␣ ϩ N is a normalizing constant (Gershman et al., 2010).”
Rational approximations to rational models: alternative algorithms for category learning
Sanborn, A. N., Griffiths, T. L., & Navarro, D. J. (2010) · Psychological Review · doi:10.1037/a0020511 · Cited by 369
The smart potential behind probability matching
Gaissmaier, W., & Schooler, L. J. (2008) · Cognition · doi:10.1016/j.cognition.2008.09.007 · Cited by 223
Calzavara, R., Mailly, P., & Haber, S. N. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05825.x · Cited by 170
Flagged first, then by citations
Research works printed but not linked: 88
- Acuña DE Schrater P Structure learning in human sequential decision-making PLoS computational biology 2010 6 12 e1001003 21151963 PMC2996460
- Aisa B Mingus B O’Reilly R The emergent neural modeling system Neural networks: the official journal of the International Neural Network Society 2008 21 8 1146 52 18684591
- Alexander G DeLong M Parallel organization of functionally segregated circuits linking basal ganglia and cortex Annual review of neuroscience 1986 3085570
- Anderson JR The adaptive nature of human categorization Psychological Review 1991 98 3 409 429
- Aron AR Behrens TE Smith S Frank MJ Poldrack RA Triangulating a cognitive control network using diffusion-weighted magnetic resonance imaging (MRI) and functional MRI The Journal of neuroscience: the official journal of the Society for Neuroscience 2007 27 14 3743 52 17409238 PMC6672420
- Ashby FG Alfonso-Reese L. a. Turken a. U. Waldron EM A neuropsychological theory of multiple systems in category learning Psychological review 1998 105 3 442 81 9697427
- Badre D Cognitive control, hierarchy, and the rostro-caudal organization of the frontal lobes Trends in cognitive sciences 2008 12 5 193 200 18403252
- Badre D Doll BB Long NM Frank MJ Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration Neuron 2012 73 3 595 607 22325209 PMC3285405
- Badre D Frank MJ Mechanisms of Hierarchical Reinforcement Learning in Cortico-Striatal Circuits 2: Evidence from fMRI Cerebral cortex (New York, N.Y.: 1991) 2011 1 10 PMC3278316 21693491
- Badre D Kayser AS D’Esposito M Frontal cortex and the discovery of abstract action rules Neuron 2010 66 2 315 26 20435006 PMC2990347
- Baier B Karnath H-O Dieterich M Birklein F Heinze C Muller NG Keeping Memory Clear and Stable–The Contribution of Human Basal Ganglia and Prefrontal Cortex to Working Memory Journal of Neuroscience 2010 30 29 9788 9792 20660261 PMC6632833
- Bogacz R Optimal decision-making theories: linking neurobiology with behaviour Trends in cognitive sciences 2007 11 3 118 25 17276130
- Botvinick MM Hierarchical models of behavior and prefrontal function Trends in cognitive sciences 2008 12 5 201 8 18420448 PMC2957875
- Botvinick MM Hierarchical reinforcement learning and decision making Current Opinion in Neurobiology 2012 (0), – 22695048
- Cavanagh JF Wiecki TV Cohen MX Figueroa CM Samanta J Sherman SJ Frank MJ Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold Nature Neuroscience 2011 PMC3394226 21946325
- Collins AGE Frank MJ How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis The European journal of neuroscience 2012 35 7 1024 35 22487033 PMC3390186
- Cools R Sheridan M Jacobs E D’Esposito M Impulsive personality predicts dopamine-dependent changes in frontostriatal activity during component processes of working memory The Journal of neuroscience: the official journal of the Society for Neuroscience 2007 27 20 5506 14 17507572 PMC6672352
- Daw ND Doya K The computational neurobiology of learning and reward Current opinion in neurobiology 2006 16 2 199 204 16563737
- Dosenbach NUF Visscher KM Palmer ED Miezin FM Wenger KK Kang HC Burgund ED Grimes AL Schlaggar BL Petersen SE A core system for the implementation of task sets Neuron 2006 50 5 799 812 16731517 PMC3621133
- Doshi F The Infinite Partially Observable Markov Decision Process Neural Information Processing Systems 2009 URL http://eprints.pascal-network.org/archive/00006513/
- Doya K Metalearning and neuromodulation Neural networks: the official journal of the International Neural Network Society 2002 15 4-6 495 506 12371507
- Draganski B Kherif F Klöppel S Cook PA Alexander DC Parker GJM Deichmann R Ashburner J Frackowiak RSJ Evidence for segregated and integrative connectivity patterns in the human Basal Ganglia The Journal of neuroscience: the official journal of the Society for Neuroscience 2008 28 28 7143 52 18614684 PMC6670486
- Frank MJ Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism Journal of cognitive neuroscience 2005 17 1 51 72 15701239
- Frank MJ Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making Neural networks: the official journal of the International Neural Network Society 2006 19 8 1120 36 16945502
- Frank MJ Badre D Mechanisms of Hierarchical Reinforcement Learning in Corticostriatal Circuits 1: Computational Analysis Cerebral cortex (New York, N.Y.: 1991), (2010) 2011 1 18 PMC3278315 21693490
- Frank MJ Loughry B O’Reilly RC Interactions between frontal cortex and basal ganglia in working memory: a computational model Cognitive, affective & behavioral neuroscience 2001 1 2 137 60 12467110
- Frank MJ Moustafa A. a. Haughey HM Curran T Hutchison KE Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning Proceedings of the National Academy of Sciences of the United States of America 2007a 104 41 16311 6 17913879 PMC2042203
- Frank MJ Scheres A Sherman SJ Understanding decision-making deficits in neurological conditions: insights from models of natural action selection Philosophical Transactions of the Royal Society of London - Series B: Biological Sciences 2007b 362 1485 1641 1654 PMC2440777 17428775
- Fuster JM The Prefrontal Cortex, An Update Neuron 2001 30 2 319 333 11394996
- Gerfen CR Wilson C Swanson L Bjorkland A Hokfelt T The basal ganglia Handbook of chemical neuroanatomy 1996 Vol 12: Integrated systems of the CNS 371 468 Elsevier Amsterdam
- Gershman SJ Blei DM A tutorial on Bayesian nonparametric models Journal of Mathematical Psychology 2012 56 1 1 12
- Green CS Benson C Kersten D Schrater P Alterations in choice behavior by manipulations of world model Proceedings of the National Academy of Sciences of the United States of America 2010 107 37 16401 6 20805507 PMC2941269
- Gruber AJ Dayan P Gutkin BS Solla SA Dopamine modulation in the basal ganglia locks the gate to working memory Journal of computational neuroscience 2006 20 2 153 66 16699839
- Gureckis TM Love BC Direct Associations or Internal Transformations? Exploring the Mechanisms Underlying Sequential Learning Behavior Cognitive science 2010 34 1 10 50 20396653 PMC2853039
- Haber SN The primate basal ganglia: parallel and integrative networks Journal of chemical neuroanatomy 2003 26 4 317 30 14729134
- Hahn U Prat-Sala M Pothos EM Brumby DP Exemplar similarity and rule application Cognition 2010 114 1 1 18 19815187
- Hampton AN Bossaerts P O’Doherty JP The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans The Journal of neuroscience: the official journal of the Society for Neuroscience 2006 26 32 8360 7 16899731 PMC6673813
- Haynes J-D Sakai K Rees G Gilbert S Frith C Passingham RE Reading hidden intentions in the human brain Current biology: CB 2007 17 4 323 8 17291759
- Houk JC Agents of the mind Biological cybernetics 2005 92 6 427 37 15915357
- Imamizu H Kuroda T Yoshioka T Kawato M Functional magnetic resonance imaging examination of two modular architectures for switching multiple internal models The Journal of neuroscience: the official journal of the Society for Neuroscience 2004 24 5 1173 81 14762135 PMC6793589
- Isoda M Hikosaka O Role for subthalamic nucleus neurons in switching from automatic to controlled eye movement The Journal of neuroscience: the official journal of the Society for Neuroscience 2008 28 28 7209 18 18614691 PMC2667154
- Jonides J Nee DE Brain mechanisms of proactive interference in working memory Neuroscience 2006 139 1 181 93 16337090
- Koechlin E Ody C Kouneiher F The architecture of cognitive control in the human prefrontal cortex Science (New York, N.Y.) 2003 302 5648 1181 5 14615530
- Koechlin E Summerfield C An information theoretical approach to prefrontal executive function Trends in cognitive sciences 2007 11 6 229 35 17475536
- Kruschke J Pothos EM Wills AJ Models of Attentional Learning Formal Approaches in Categorization 2011 120 152 Cambridge University Press chap. 6
- Kruschke JK Bayesian approaches to associative learning: From passive to active learning Learning & Behavior 2008 36 3 210 226 18683466
- Lewandowsky S Kirsner K Knowledge partitioning: context-dependent use of expertise Memory & cognition 2000 28 2 295 305 10790983
- Love BC Medin DL Gureckis TM SUSTAIN: a network model of category learning Psychological review 2004 111 2 309 32 15065912
- Maia TV Reinforcement learning, conditioning, and the brain: Successes and challenges Cognitive, affective & behavioral neuroscience 2009 9 4 343 64 19897789
- Maia TV Frank MJ From reinforcement learning models to psychiatric and neurological disorders Nature neuroscience 2011 14 2 154 62 PMC4408000 21270784
- Mansouri F. a. Tanaka K Buckley MJ Conflict-induced behavioural adjustment: a clue to the executive functions of the prefrontal cortex Nature reviews. Neuroscience 2009 10 2 141 52 19153577
- Meiran N Daichman A Advance task preparation reduces task error rate in the cuing task-switching paradigm Memory & cognition 2005 33 7 1272 88 16532859
- Mink JW The basal ganglia: focused selection and inhibition of competing motor programs Progress in neurobiology 1996 50 4 381 425 9004351
- Monsell S Task switching Trends in Cognitive Sciences 2003 7 3 134 140 12639695
- Montague PR Dayan P Sejnowski TJ A framework for mesencephalic dopamine systems based on predictive Hebbian learning The Journal of neuroscience: the official journal of the Society for Neuroscience 1996 16 5 1936 47 8774460 PMC6578666
- Moustafa AA Sherman SJ Frank MJ A dopaminergic basis for working memory, learning and attentional shifting in Parkinsonism Neuropsychologia 2008 46 13 3144 56 18687347
- Nagano-Saito A Leyton M Monchi O Goldberg YK He Y Dagher A Dopamine depletion impairs frontostriatal functional connectivity during a set-shifting task The Journal of neuroscience: the official journal of the Society for Neuroscience 2008 28 14 3697 706 18385328 PMC6671089
- Nambu A Somatotopic organization of the primate Basal Ganglia Frontiers in neuroanatomy 2011 5 26 21541304 PMC3082737
- Nassar MR Wilson RC Heasly B Gold JI An approximately Bayesian delta-rule model explains the dynamics of belief updating in a changing environment The Journal of neuroscience: the official journal of the Society for Neuroscience 2010 30 37 12366 78 20844132 PMC2945906
- O’Reilly RC Biologically based computational models of high-level cognition Science (New York, N.Y.) 2006 314 5796 91 4 17023651
- O’Reilly RC Frank MJ Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia Neural computation 2006 18 2 283 328 16378516
- O’Reilly RC Munakata Y Computational explorations in cognitive neuroscience: understanding the mind by simulating the brain 2000 MIT Press
- Ratcliff R Frank MJ Reinforcement-based decision making in corticostriatal circuits: mutual constraints by neurocomputational and diffusion models Neural computation 2012 24 1186 1229 22295983
- Redish AD Jensen S Johnson A Kurth-Nelson Z Reconciling reinforcement learning models with behavioral extinction and renewal: Implications for addiction, relapse, and problem gambling Psychological Review 2007 144 3 784 805 17638506
- Reverberi C Görgen K Haynes J-D Compositionality of Rule Representations in Human Prefrontal Cortex Cerebral cortex (New York, N.Y.: 1991) 2011 bhr200 21817092
- Reynolds JR O’Reilly RC Developing PFC representations using reinforcement learning Cognition 2009 113 3 281 92 19591977 PMC2783795
- Rougier NP Noelle DC Braver TS Cohen JD O’Reilly RC Prefrontal cortex and flexible cognitive control: rules without symbols Proceedings of the National Academy of Sciences of the United States of America 2005 102 20 7338 43 15883365 PMC1129132
- Sakai K Task set and prefrontal cortex Annual review of neuroscience 2008 31 219 45 18558854
- Samejima K Ueda Y Doya K Kimura M Representation of action-specific reward values in the striatum Science (New York, N.Y.) 2005 310 5752 1337 40 16311337
- Shafto P Kemp C Mansinghka V Tenenbaum JB A probabilistic model of cross-categorization Cognition 2011 120 1 1 25 21377146
- Simon JR Reactions toward the source of stimulation Journal of experimental psychology 1969 81 1 174 6 5812172
- Sobel DM Kirkham NZ Bayes nets and babies: infants’ developing statistical reasoning abilities and their representation of causal knowledge Developmental science 2007 10 3 298 306 17444971
- Solomon M Smith AC Frank MJ Ly S Carter CS Probabilistic reinforcement learning in adults with autism spectrum disorders Autism research: official journal of the International Society for Autism Research 2011 4 2 109 20 21425243 PMC5538882
- Stephan KE Penny WD Daunizeau J Moran RJ Friston KJ Bayesian model selection for group studies NeuroImage 2009 46 4 1004 17 19306932 PMC2703732
- Stocco A Lebiere C Anderson JR Conditional routing of information to the cortex: a model of the basal ganglia’s role in cognitive coordination Psychological review 2010 117 2 541 74 20438237 PMC3064519
- Stokes KS Planning for the future of a severely handicapped autistic child Journal of autism and childhood schizophrenia 1977 7 3 288 302 578515
- Sutton R Barto A reinforcement learning 1998 vol. 9 MIT Press
- Teh YW Jordan MI Beal MJ Blei DM Hierarchical Dirichlet Processes Journal of the American Statistical Association 2006 101 476 1566 1581
- Todd MT Niv Y Cohen JD Learning to use Working Memory in Partially Observable Environments through Dopaminergic Reinforcement Neural information processing systems 2009
- Usher M McClelland JL The time course of perceptual choice: the leaky, competing accumulator model Psychological review 2001 108 3 550 92 11488378
- van Schouwenburg MR den Ouden HEM Cools R The human basal ganglia modulate frontal-posterior connectivity during attention shifting The Journal of neuroscience: the official journal of the Society for Neuroscience 2010 30 29 9910 8 20660273 PMC6632831
- Wiecki TV Riedinger K von Ameln-Mayerhofer A Schmidt WJ Frank MJ A neurocomputational account of catalepsy sensitization induced by D2 receptor blockade in rats: context dependency, extinction, and renewal Psychopharmacology 2009 204 2 265 77 19169674 PMC3049926
- Wilson RC Niv Y Inferring relevance in a changing world Frontiers in human neuroscience 1 2011 5 189 22291631 PMC3264902
- Woolgar A Thompson R Bor D Duncan J Multi-voxel coding of stimuli, rules, and responses in human frontoparietal cortex NeuroImage 2011 56 2 744 52 20406690
- Wylie SA Ridderinkhof KR Bashore TR van den Wildenberg WPM The effect of Parkinson’s disease on the dynamics of on-line and proactive cognitive control during action selection Journal of cognitive neuroscience 2010 22 9 2058 73 19702465 PMC2923490
- Yu A Cohen J Sequential effects: Superstition or rational behavior Advances in neural information processing systems 2009 21 1873 1880 PMC4580342 26412953
- Yu A Dayan P Inference, attention, and decision in a Bayesian neural architecture Advances in neural information processing systems 2005 17 1577 1584
- Zaghloul KA Weidemann CT Lega BC Jaggi JL Baltuch GH Kahana MJ Neuronal activity in the human subthalamic nucleus encodes decision conflict during action selection The Journal of neuroscience: the official journal of the Society for Neuroscience 2012 32 7 2453 60 22396419 PMC3296967
Cited by
Sorted by citations
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Computational psychiatry as a bridge from neuroscience to clinical applications
Huys, Q. J. M., Maia, T. V., & Frank, M. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4238 · Cited by 1,002
Self-citationLearning-induced autonomy of sensorimotor systems
Bassett, D. S., Yang, M., Wymbs, N. F., & Grafton, S. T. (2015) · Nature Neuroscience · doi:10.1038/nn.3993 · Cited by 603
If deep learning is the answer, what is the question?
Saxe, A., Nelli, S., & Summerfield, C. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-00395-8 · Cited by 397
Learning task-state representations
Niv, Y. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0470-8 · Cited by 356
Multiple gates on working memory
Chatham, C. H., & Badre, D. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2014.08.001 · Cited by 268
Human-like systematic generalization through a meta-learning neural network
Lake, B. M., & Baroni, M. (2023) · Nature · doi:10.1038/s41586-023-06668-3 · Cited by 230
Banishing the Control Homunculi in Studies of Action Control and Behavior Change
Verbruggen, F., McLaren, I. P. L., & Chambers, C. D. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614526414 · Cited by 214
Cognitive Control: Core Constructs and Current Considerations
Cohen, J. D. (2017) · The Wiley Handbook of Cognitive Control · doi:10.1002/9781118920497.ch1 · Cited by 179
The computational nature of memory modification
Gershman, S. J., Monfils, M.-H., Norman, K. A., & Niv, Y. (2017) · eLife · doi:10.7554/elife.23763 · Cited by 172
Meta-learning in natural and artificial intelligence
Wang, J. X. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.01.002 · Cited by 171
Discovering latent causes in reinforcement learning
Gershman, S. J., Norman, K. A., & Niv, Y. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.07.007 · Cited by 151
Deep temporal models and active inference
Friston, K. J., Rosch, R., Parr, T., Price, C., & Bowman, H. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.04.004 · Cited by 119
A neural network model of individual differences in task switching abilities
Herd, S. A., O׳Reilly, R. C., Hazy, T. E., Chatham, C. H., Brant, A. M., & Friedman, N. P. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.04.014 · Cited by 128
Arousal-related adjustments of perceptual biases optimize perception in dynamic environments
Krishnamurthy, K., Nassar, M. R., Sarode, S., & Gold, J. I. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0107 · Cited by 117
The Tortoise and the Hare: Interactions between Reinforcement Learning and Working Memory
Collins, A. G. E. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01238 · Cited by 97
Self-citationRadulescu, A., Shin, Y. S., & Niv, Y. (2021) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-092920-120559 · Cited by 63
Meta-learned models of cognition
Binz, M., Dasgupta, I., Jagadish, A. K., Botvinick, M., Wang, J. X., & Schulz, E. (2024) · Behavioral and Brain Sciences · doi:10.1017/s0140525x23003266 · Cited by 38
Brain network dynamics during spontaneous strategy shifts and incremental task optimization
Allegra, M., Seyed-Allaei, S., Schuck, N. W., Amati, D., Laio, A., & Reverberi, C. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116854 · Cited by 27
Cultivating creativity: predictive brains and the enlightened room problem
Constant, A., Friston, K. J., & Clark, A. (2024) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2022.0415 · Cited by 19
Action chunking as conditional policy compression
Lai, L., Huang, A. Z., & Gershman, S. J. (2022) · doi:10.31234/osf.io/z8yrv · Cited by 9
Metadata
- Authors
- Collins, A. G. E., & Frank, M. J.
- Affiliations
- Brown University (US)
- Venue
- Psychological Review
- Published
- 2013-01
- Volume
- 120
- Issue
- 1
- Pages
- 190-229
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- PMC
- PMC3974273
- OpenAlex
- W2061304498
- Cited by
- 426
- References
- 9
- Citations by year
- 2026: 45 · 2025: 35 · 2024: 46 · 2023: 31 · 2022: 40 · 2021: 39 · 2020: 45 · 2019: 28 · 2018: 29 · 2017: 27 · 2016: 19 · 2015: 22 · 2014: 16 · 2013: 3
- FWCI
- 8.92
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Psychological Review (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Science Foundation (1125788)
- National Institute of Mental Health (R01MH080066-01)
- Department of the Interior (D10PC20023)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Keywords
- cognitive control, task switching, prefrontal cortex, basal ganglia, neural network model, positive transfer, negative transfer, generalization, reaction time (psychology), choice behavior, Bayesian nonparametrics
- MeSH terms
- Attention, Basal Ganglia, Bayes Theorem, Cognition, Frontal Lobe, Generalization, Psychological, Humans, Learning, Models, Psychological, Reinforcement, Psychology, Neural Networks, Computer, Executive Function
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
