Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making
Open accessThe DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
The frontal lobes subserve decision-making and executive control--that is, the selection and coordination of goal-directed behaviors. Current models of frontal executive function, however, do not explain human decision-making in everyday environments featuring uncertain, changing, and especially open-ended situations. Here, we propose a computational model of human executive function that clarifies this issue. Using behavioral experiments, we show that unlike others, the proposed model predicts human decisions and their variations across individuals in naturalistic situations. The model reveals that for driving action, the human frontal function monitors up to three/four concurrent behavioral strategies and infers online their ability to predict action outcomes: whenever one appears more reliable than unreliable, this strategy is chosen to guide the selection and learning of actions that maximize rewards. Otherwise, a new behavioral strategy is tentatively formed, partly from those stored in long-term memory, then probed, and if competitive confirmed to subsequently drive action. Thus, the human executive function has a monitoring capacity limited to three or four behavioral strategies. This limitation is compensated by the binary structure of executive control that in ambiguous and unknown situations promotes the exploration and creation of new behavioral strategies. The results support a model of human frontal function that integrates reasoning, learning, and creative abilities in the service of decision-making and adaptive behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Other functions, higher-order EF, such as planning, reasoning, and problem solving, develop from these core processes [16].”
From Comparing Executive Functions in Children and Adolescents with Autism and ADHD—A Systematic Review and Meta-Analysis (2024) · cites this paper as [16]
Experimental — accuracy not yet measuredIn the citing paper
“The frontal lobe performs executive functions, such as planning and organizing, and undergoes massive changes from puberty until mid-twenties [74].”
In the citing paper
“accurately inferring one’s confidence in a task is an important indicator of whether a previous decision should be revised 17, 57, whether a subsequent step in a chain of decisions should be initiated (58), or more generally when it is advantageous to deliberate (59) or engage cognitive control (18).”
From Psychiatric Symptom Dimensions Are Associated With Dissociable Shifts in Metacognition but Not Task Performance (2018) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hitch, G. (1984) · Science · doi:10.1017/s0033291700003548 · Cited by 16,233
Information theory and statistical mechanics
Jaynes, E. T. (1957) · Physical Review · doi:10.1103/physrev.106.620 · Cited by 12,931 · cited 2×
“Prior reliability lprior of the probe actor is chosen as minimizing prior information over task set reliability because no information is available to estimate it [32].”
BackgroundAn Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803 · cited 1×
“Neuroimaging studies suggest that these internal mappings are implemented in distinct frontal regions: (1) selective mappings in lateral premotor regions, because these regions are involved in learning and processing stimulus-response associations [10,46]; (2) predictive mappings in ventromedial prefrontal regions, be…”
BackgroundRescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 9,462
Kahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544 · cited 1×
“associating stimuli, actions, and expected outcomes [1–4]).”
Models of Bounded Rationality: Empirically Grounded Economic Reason
Simon, H. A. (1997) · The MIT Press eBooks · doi:10.7551/mitpress/4711.001.0001 · Cited by 4,205 · cited 1×
“Indeed, actor selection is based on a ‘‘satisficing’’ criterion based on task set reliability [1]: either a task set appears to be reliable, in which case it becomes the actor, because no other task sets meet this criterion, or no task set appears reliable, in which case a new task set is created and serves as an acto…”
BackgroundCosts of a predictible switch between simple cognitive tasks.
Rogers, R. D., & Monsell, S. (1995) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.124.2.207 · Cited by 3,170 · cited 1×
“. Thus, we assumed that in agreement with previous studies (e.g.,”
Result(2000) · doi:10.1017/cbo9780511803475 · Cited by 2,987
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976 · cited 6×
“After observing action outcome ot, the actor selective mapping is updated based on outcome values r[o] according to standard reinforcement learning mechanisms [11] (e.”
BackgroundMethodInfluentialBoden, M. A. (2004) · doi:10.4324/9780203508527 · Cited by 2,775
Cited by
Diamond, A. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143750 · Cited by 13,268
“From these, higherorder EFs are built such as reasoning, problem solving, and planning (Collins & Koechlin 2012, Lunt et al. 2012).”
Neuroscience-Inspired Artificial Intelligence
Hassabis, D., Kumaran, D., Summerfield, C., & Botvinick, M. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.011 · Cited by 1,557
“Intriguingly, the proposed architecture bears some resemblance to a successful computational model of sequential task learning in humans (Collins and Koechlin, 2012; Donoso et al., 2014).”
BackgroundDiamond, A., & Ling, D. S. (2016) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2015.11.005 · Cited by 1,177
“From those, igher-order EFs are built such as reasoning, problem-solving, and lanning (Collins and Koechlin, 2012; Lunt et al., 2012).”
BackgroundActivities and Programs That Improve Children’s Executive Functions
Diamond, A. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412453722 · Cited by 750
“These form the foundation for higher-order EFs, such as reasoning, problem solving, and planning (Christoff, Ream, Geddes, & Gabrieli, 2003; Collins & Koechlin, 2012; Lunt et al., 2012).”
BackgroundTen simple rules for the computational modeling of behavioral data
Wilson, R. C., & Collins, A. G. (2019) · eLife · doi:10.7554/elife.49547 · Cited by 710
Self-citationProbabilistic brains: knowns and unknowns
Pouget, A., Beck, J. M., Ma, W. J., & Latham, P. E. (2013) · Nature Neuroscience · doi:10.1038/nn.3495 · Cited by 615
“As a result, the subject has to figure out which sensory and motor variables matter for the task 72 .”
BackgroundExecutive Function Performance in Obesity and Overweight Individuals: A Meta-Analysis and Review
Yang, Y., Shields, G. S., Guo, C., & Liu, Y. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.11.020 · Cited by 498
The Importance of Falsification in Computational Cognitive Modeling
Palminteri, S., Wyart, V., & Koechlin, E. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.03.011 · Cited by 448
“These guidelines combine both relative model comparison criteria and model simulations ( [240_TD$DIFF]see [16,19,20] as examples of studies that include [241_TD$DIFF]all these steps).”
Self-citationCognitive control over learning: Creating, clustering, and generalizing task-set structure.
Collins, A. G. E., & Frank, M. J. (2013) · Psychological Review · doi:10.1037/a0030852 · Cited by 426
“Although this abstract hidden state representation of a task-set feature is present in the model of Collins and Koechlin (2012), that model relies on the assumed episodic stability of external contingencies for task-set inference.”
Self-citationFoundations of human reasoning in the prefrontal cortex
Donoso, M., Collins, A. G. E., & Koechlin, E. (2014) · Science · doi:10.1126/science.1252254 · Cited by 406
Self-citationRouault, M., Seow, T., Gillan, C. M., & Fleming, S. M. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.12.017 · Cited by 393
“In many other settings, accurately inferring one’s confidence in a task is an important indicator of whether a previous decision should be revised (17,57), whether a subsequent step in a chain of decisions should be initiated (58), or more generally when it is advantageous to deliberate (59) or engage cognitive contro…”
BackgroundActive Inference, Curiosity and Insight
Friston, K. J., Lin, M., Frith, C. D., Pezzulo, G., Hobson, J. A., & Ondobaka, S. (2017) · Neural Computation · doi:10.1162/neco_a_00999 · Cited by 351
“…(Koechlin, Ody, & Kouneiher, 2003; Oaksford & Chater, 2003; Coltheart, Menzies, & Sutton, 2010; Nelson, McKenzie, Cottrell, & Sejnowski, 2010; Collins & Koechlin, 2012; Solway & Botvinick, 2012; Donoso, Collins, & Koechlin, 2014; Seth, 2014; Koechlin, 2015; Lu, Rojas, Beckers, & Yuille,…”
MethodThe neural representation of unexpected uncertainty during value-based decision making
Payzan-LeNestour, E., Dunne, S., Bossaerts, P., & O’Doherty, J. P. (2013) · Neuron · doi:10.1016/j.neuron.2013.04.037 · Cited by 257
“A recent experimental study of behavioral adaptation in humans (Collins and Koechlin, 2012) suggests that after a contextual change, humans retrieve from their memory similar contexts experienced in the past and select the behavioral strategy that they previously learned to be optimal in that context.”
BackgroundThe population doctrine in cognitive neuroscience
Ebitz, R. B., & Hayden, B. Y. (2021) · Neuron · doi:10.1016/j.neuron.2021.07.011 · Cited by 249
DREVER, A. I., ODDERS‐WHITE, E., KALISH, C. W., ELSE‐QUEST, N. M., HOAGLAND, E. M., & NELMS, E. N. (2015) · Journal of Consumer Affairs · doi:10.1111/joca.12068 · Cited by 286
Why improving and assessing executive functions early in life is critical.
Diamond, A. (2016) · Executive function in preschool-age children: Integrating measurement, neurodevelopment, and translational research. · doi:10.1037/14797-002 · Cited by 250
Contextual inference underlies the learning of sensorimotor repertoires
Heald, J. B., Lengyel, M., & Wolpert, D. M. (2021) · Nature · doi:10.1038/s41586-021-04129-3 · Cited by 238
(2020) · Handbook of Clinical Neurology · doi:10.1016/b978-0-444-64150-2.00020-4 · Cited by 223
“From these, higher-order executive functions are built, such as reasoning, problem solving, and planning (Collins & Koechlin, 2012; Lunt et al., 2012).”
Working Memory Contributions to Reinforcement Learning Impairments in Schizophrenia
Collins, A. G. E., Brown, J. K., Gold, J. M., Waltz, J. A., & Frank, M. J. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0989-14.2014 · Cited by 212
“where U is the uniform random policy (U(a) 1/nA, nA 3) and the parameter 0 1 controls the amount of noise (Collins and Koechlin, 2012; Guitart-Masip et al., 2012; Collins and Frank, 2013).”
BackgroundSelf-citationExecutive control and decision-making in the prefrontal cortex
Domenech, P., & Koechlin, E. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2014.10.007 · Cited by 236
Self-citationCausal inference in the multisensory brain
Cao, Y., Summerfield, C., Park, H., Giordano, B. L., & Kayser, C. (2018) · bioRxiv · doi:10.1101/500413 · Cited by 193
Twenty-Five Lessons from Computational Neuromodulation
Dayan, P. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.027 · Cited by 190
“As we mentioned, in some cases, the whole framework itself may be found to be inadequate, implying that a new one needs to be inferred (Collins and Koechlin, 2012).”
BackgroundCognitive Control Predicts Use of Model-based Reinforcement Learning
Otto, A. R., Skatova, A., Madlon-Kay, S., & Daw, N. D. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00709 · Cited by 186
“Recent research (Collins & Frank, 2013; Collins & Koechlin, 2012; Gershman & Niv, 2010) aims to extend principles of RL, hierarchically, to learning at this level.”
MethodThe computational nature of memory modification
Gershman, S. J., Monfils, M.-H., Norman, K. A., & Niv, Y. (2017) · eLife · doi:10.7554/elife.23763 · Cited by 172
Abstract context representations in primate amygdala and prefrontal cortex
Saez, A., Rigotti, M., Ostojic, S., Fusi, S., & Salzman, C. D. (2015) · Neuron · doi:10.1016/j.neuron.2015.07.024 · Cited by 183
“…contexts, or if a task employs unreliable feedback, immediate switching becomes impossible, and exploration is necessary to figure out the new context (Koechlin, 2014; Yu and Dayan, 2005) (also see Collins and Koechlin, 2012; Donoso et al., 2014) (these papers refer to a context as a ‘‘task set’’).”
BackgroundExecutive, language, or both? An examination of the construct validity of verbal fluency measures
Aita, S. L., Beach, J. D., Taylor, S. E., Borgogna, N. C., Harrell, M. N., & Hill, B. D. (2019) · Applied Neuropsychology: Adult · doi:10.1080/23279095.2018.1439830 · Cited by 188
“These domains of EF are also intimately involved in other higher-order processes such as planning, problem solving, and abstract reasoning (Collins & Koechlin, 2012).”
BackgroundSonuga‐Barke, E. J. S., Cortese, S., Fairchild, G., & Stringaris, A. (2016) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12496 · Cited by 165
“Additional higher order executive functions, such as reasoning, problem solving, and planning, are conceptualized as processes that build on the afore-mentioned more basic processes (Collins & Koechlin, 2012; Lunt et al., 2012).”
BackgroundPrefrontal executive function and adaptive behavior in complex environments
Koechlin, É. (2015) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.11.004 · Cited by 190
Self-citationMavilidi, M. F., Ruiter, M., Schmidt, M., Okely, A. D., Loyens, S. M. M., Chandler, P., & PAAS, F. G. W. C. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02079 · Cited by 190
“These foundational components, form the basis for higher order EFs, such as reasoning, problem solving, and planning (Collins and Koechlin, 2012; Lunt et al., 2012).”
BackgroundCavanagh, J. F. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.02.007 · Cited by 158
“While such imputed structure is sometimes termed model-based learning (Daw et al., 2011), an options model (Botvinick et al., 2009), or a rule (Bunge, 2004), here this phenomenon is described as a task-set (Botvinick et al., 2009; Collins and Koechlin, 2012; Collins and Frank, 2013).”
BackgroundCollins, A. G. E., & Frank, M. J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1720963115 · Cited by 164
Self-citationChen, Q., Yang, W., Li, W., Wei, D., Li, H., Lei, Q., Zhang, Q., & Qiu, J. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.08.008 · Cited by 153
“Regarding deliberate creativity, several researchers have speculated that cognitiveflexibility, which reflects the adaptability of thought and behavior (Collins and Koechlin, 2012), could facilitate a shift of thought in the face of environmental change, leading to generation of innovative ideas and the promotion of n…”
Want to Optimize Executive Functions and Academic Outcomes? Simple, Just Nourish the Human Spirit
Diamond, A. D. (2013) · Wiley eBooks · doi:10.1002/9781118732373.ch7 · Cited by 175
“From these, higher-order EFs are built such as reasoning, problem solving, and planning (Collins & Koechlin, 2012; Lunt et al., 2012; see Figure 7.1).”
BackgroundInfluentialModel averaging, optimal inference, and habit formation
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00457 · Cited by 121
“The issue of how to select the correct hidden variables in the first place has been less well explored, at least in cognitive science (though see Collins and Koechlin, 2012; Gershman and Niv, 2012), but one solution to this problem is provided by Bayesian non-parametric models that entertain, in…”
BackgroundNeural mechanisms resolving exploitation-exploration dilemmas in the medial prefrontal cortex
Domenech, P., Rheims, S., & Koechlin, E. (2020) · Science · doi:10.1126/science.abb0184 · Cited by 159
“We addressed this issue by recording neuronal activity in six participantswhile theywere performing a task that induced systematic exploitation-exploration dilemmas in an uncertain, changing, and open-ended environment (2, 6) (Fig.”
BackgroundResultInfluentialSelf-citationHow executive functions contribute to reading comprehension
Nouwens, S., Groen, M. A., Kleemans, T., & Verhoeven, L. T. W. (2020) · British Journal of Educational Psychology · doi:10.1111/bjep.12355 · Cited by 198
“From these core executive functions, higher-order executive functions are built such as reasoning, problem solving, and planning (Collins & Koechlin, 2012; Lunt et al., 2012).”
BackgroundManwell, L. A., Tadros, M., Ciccarelli, T. M., & Eikelboom, R. (2022) · Journal of Integrative Neuroscience · doi:10.31083/j.jin2101028 · Cited by 122
Medial Prefrontal Cortex Predicts Internally Driven Strategy Shifts
Schuck, N. W., Gaschler, R., Wenke, D., Heinzle, J., Frensch, P. A., Haynes, J., & Reverberi, C. (2015) · Neuron · doi:10.1016/j.neuron.2015.03.015 · Cited by 149
“Thus, the observed exploration of alternative strategies does not seem to be driven by unreliability, conflict, or errors, as in previous studies (Botvinick et al., 2001; Collins and Koechlin, 2012; Daw et al., 2006; Donoso et al., 2014; Nassar et al., 2010).”
ResultWorking Memory Load Strengthens Reward Prediction Errors
Collins, A. G. E., Ciullo, B., Frank, M. J., & Badre, D. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.2700-16.2017 · Cited by 143
“…executive processes (such as those involved in representing sequential or hierarchical task structure) contribute substantially to human learning over and above incremental RL (Botvinick et al., 2009; Badre and Frank, 2011; Daw et al., 2011; Collins and Koechlin, 2012; Collins and Frank, 2013).”
BackgroundSelf-citationSport type determines differences in executive functions in elite athletes
Krenn, B., Finkenzeller, T., Würth, S., & Amesberger, G. (2018) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2018.06.002 · Cited by 155
“These three core EF represent top-down processes allowing for goal-directed behavior, reasoning and problem solving (Collins & Koechlin, 2012; Miyake et al., 2000), which present indispensable determinants of athletic behavior and athletic performance in numerous sports (Marchetti et al., 2015;…”
BackgroundAhmed, A. O., Mantini, A. M., Fridberg, D. J., & Buckley, P. F. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2014.12.069 · Cited by 129
Architecture of cognitive flexibility revealed by lesion mapping
Barbey, A. K., Colom, R., & Grafman, J. H. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.087 · Cited by 156
“1): (1) cognitive flexibility was assessed by measures of mental flexibility (category switching; Collins and Koechlin, 2012) and the fluent generation of ideas (letter fluency, category fluency; Costafreda et al.”
BackgroundMethodInfluentialNyongesa, M. K., Ssewanyana, D., Mutua, A. M., Chongwo, E., Scerif, G., Newton, C. R. J. C., & Abubakar, A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00311 · Cited by 111
Beyond dichotomies in reinforcement learning
Collins, A. G. E., & Cockburn, J. (2020) · Nature reviews. Neuroscience · doi:10.1038/s41583-020-0355-6 · Cited by 172
“…relies on a representation of reward functions and transition functions; however, such representations may not necessarily be used for planning at all 66 , or may serve other processes such as credit assignment, indicating they are not uniquely associated with a ‘planning’ system per se 13,63 .”
BackgroundMethodInfluentialSelf-citationAlexander, W. H., & Brown, J. W. (2015) · Neural Computation · doi:10.1162/neco_a_00779 · Cited by 123
The Tortoise and the Hare: Interactions between Reinforcement Learning and Working Memory
Collins, A. G. E. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01238 · Cited by 97
“…adding undirected noise consists in defining the new mixture choice policy: where U is the uniform random policy (U(a) = 1/nA, with number of actions nA=3), and the parameter 0 < ε < 1 controls the amount of noise (Collins & Frank, 2013; Collins & Koechlin, 2012; Guitart-Masip et al., 2012).”
BackgroundSelf-citationA Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems
Wilson, R. C., Nassar, M. R., & Gold, J. I. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003150 · Cited by 118
“This qualitative difference in the behavior of the fastest node could indicate a very different underlying process such as working memory for the last trial as is proposed in [30,31].”
BackgroundStatistical computations underlying the dynamics of memory updating
Gershman, S. J., Radulescu, A., Norman, K. A., & Niv, Y. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003939 · Cited by 101
“This prior has previously been used to model category formation [34,35], Pavlovian conditioning in multiple contexts [24,45], word segmentation [46] and task-set learning [47] (for a review of this literature, see [48]).”
MethodMagalhães, S., Carneiro, L., Limpo, T., & Filipe, M. G. (2020) · Child Neuropsychology · doi:10.1080/09297049.2020.1740188 · Cited by 142
Contextual inference in learning and memory
Heald, J. B., Lengyel, M., & Wolpert, D. M. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.10.004 · Cited by 145
An evolutionary computational theory of prefrontal executive function in decision-making
Koechlin, É. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0474 · Cited by 100
“Collins & Koechlin [25] showed that this computational algorithm predicts human choices in recurrent and new situations featuring uncertain and variable contingencies possibly associated with the occurrences of contextual cues.”
BackgroundInfluentialSelf-citationTheories of development: In dialog with Jean Piaget
Carey, S. E., Zaitchik, D., & Bascandziev, I. (2015) · Developmental Review · doi:10.1016/j.dr.2015.07.003 · Cited by 145
The interpretation of computational model parameters depends on the context
Eckstein, M. K., Master, S. L., Xia, L., Dahl, R., Wilbrecht, L., & Collins, A. (2021) · bioRxiv · doi:10.1101/2021.05.28.446162 · Cited by 90
Self-citationTaming the beast: extracting generalizable knowledge from computational models of cognition
Nassar, M. R., & Frank, M. J. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.04.003 · Cited by 104
“But several studies have shown that choice likelihood can deviate substantially from either of these functions (for example as a result of just a few choices driven by a different process altogether, such as attentional lapses), and the failure to take into account this irreducible noise can over-emphasize or under-em…”
BackgroundVinckier, F., Gaillard, R., Palminteri, S., Rigoux, L., Salvador, A., Fornito, A., Adapa, R., Krebs, M. O., Pessiglione, M., & Fletcher, P. C. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.73 · Cited by 87
Computational evidence for hierarchically structured reinforcement learning in humans
Eckstein, M. K., & Collins, A. (2019) · Proceedings of the National Academy of Sciences of the United States of America · doi:10.1101/731752 · Cited by 87
Self-citationFormalizing planning and information search in naturalistic decision-making
Hunt, L. T., Daw, N. D., Kaanders, P., MacIver, M. A., Mugan, U., Procyk, E., Redish, A. D., Russo, E., Scholl, J., Stachenfeld, K., et al. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00866-w · Cited by 132
Dare, S. E., DIJK, W. W. V., van Dijk, E., van Dillen, L. F., Gallucci, M., & Simonse, O. (2022) · Journal of Family and Economic Issues · doi:10.1007/s10834-022-09845-0 · Cited by 126
“Together, these three core executive functions allow for higher-order thinking, such as reasoning and problem solving (Collins & Koechlin, 2012).”
BackgroundBrain signatures of a multiscale process of sequence learning in humans
Maheu, M., Dehaene, S., & Meyniel, F. (2019) · eLife · doi:10.7554/elife.41541 · Cited by 112
Franklin, N. T., & Frank, M. J. (2015) · eLife · doi:10.7554/elife.12029 · Cited by 95
“…with change points (Behrens et al., 2007; Nassar et al., 2010), and in different contexts in a process that likely involves the frontal cortex (Collins and Koechlin, 2012; Collins and Frank, 2013): why would the striatum consider uncertainty in a heuristic fashion if other systems are able to…”
BackgroundA Survey on Large Language Models for Mathematical Reasoning
Wang, P.-Y., Liu, T.-S., Wang, C., Li, Z., Wang, Y., Yan, S., Jia, C., Liu, X.-H., Chen, X., Xu, J., et al. (2025) · ACM Computing Surveys · doi:10.1145/3786333 · Cited by 96
“Inspired by the mechanisms of the human brain [33, 47], a structured framework can be conceptualized around two high-level cognitive components: comprehension and answer generation.”
Contreras-Osorio, F., Campos-Jara, C., Martínez-Salazar, C., Chirosa-Ríos, L., & Martínez-García, D. (2021) · Brain Sciences · doi:10.3390/brainsci11060755 · Cited by 86
“It is also responsible for monitoring and controlling the mechanisms that mediate the use of information [2].”
BackgroundCollins, A. G. E., & Frank, M. J. (2016) · Cognition · doi:10.1016/j.cognition.2016.04.002 · Cited by 96
“This property is similar to some of our previous work where structures are cued by episodic contexts (Collins & Koechlin, 2012; Donoso, Collins, & Koechlin, 2014), but is extended to building this structure even in the absence of a temporal shaping process.”
Self-citationTamm, L., Loren, R. E. A., Peugh, J., & Ciesielski, H. A. (2020) · Journal of Learning Disabilities · doi:10.1177/0022219420961338 · Cited by 98
Palamarchuk, I. S., & Vaillancourt, T. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.719674 · Cited by 120
Shokrkon, A., & Nicoladis, E. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.848696 · Cited by 124
Advances in modeling learning and decision-making in neuroscience
Collins, A. G. E., & Shenhav, A. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01126-y · Cited by 123
“Recent proposals have introduced heuristics that approximate such processes to a high degree of optimality, while staying closer to potential mechanisms [55, 76].”
BackgroundSelf-citationStatistical context dictates the relationship between feedback-related EEG signals and learning
Nassar, M. R., Bruckner, R., & Frank, M. J. (2019) · eLife · doi:10.7554/elife.46975 · Cited by 110
“through flexible replacement of state representations (35-37).”
Human EEG Uncovers Latent Generalizable Rule Structure during Learning
Collins, A. G. E., Cavanagh, J. F., & Frank, M. J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.3900-13.2014 · Cited by 89
“Computational models highlight the potential utility of such strategies for long-term optimality, even when there is some cost in using them during initial learning of tasks that have no obvious structure (Collins and Koechlin, 2012; Collins and Frank, 2013).”
BackgroundSelf-citationΛεμονάκη, Ρ., Xanthopoulou, D., Bardos, A. N., Karademas, E. C., & Simos, P. G. (2021) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2021.1892818 · Cited by 124
“These “executive” functions include working memory, inhibition, cognitive flexibility (or set shifting), reasoning, problem solving, and planning (Collins & Koechlin, 2012; Diamond, 2013; Lunt et al., 2012).”
BackgroundCompulsive smartphone usage and users' ill-being among young Indians: Does personality matter?
Panda, A., & Jain, N. K. (2018) · Telematics and Informatics · doi:10.1016/j.tele.2018.03.006 · Cited by 67
Pupil diameter encodes the idiosyncratic, cognitive complexity of belief updating
Filipowicz, A. L. S., Glaze, C. M., Kable, J. W., & Gold, J. I. (2020) · eLife · doi:10.7554/elife.57872 · Cited by 93
“…when beliefs are weak and alternative explanations for the observed data are sought in terms of the hypothesis space of possible hazard rates (e.g., the prior distribution over hazard rates in our Bayesian learning model; Collins & Koechlin, 2012; Glaze et al., 2018; Wilson, Nassar, & Gold, 2010).”
BackgroundComputational models of adaptive behavior and prefrontal cortex
Soltani, A., & Koechlin, É. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01123-1 · Cited by 94
Self-citationBattini, R., Chieffo, D. R. P., Bulgheroni, S., Piccini, G., Pecini, C., Lucibello, S., Lenzi, S., Moriconi, F., Pane, M., Astrea, G., et al. (2017) · Neuromuscular Disorders · doi:10.1016/j.nmd.2017.11.018 · Cited by 85
Martínez, L., Sarmiento, E. L. P., Satler, C. E., Tavares, M. C. H., & Tomaz, C. A. B. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01230 · Cited by 82
“…inhibition – and control of interference, selective attention and cognitive inhibition), as well as working memory (WM), cognitive flexibility (also known as mental flexibility; Miyake et al., 2000), reasoning, problem solving, and planning (Collins and Koechlin, 2012; Lunt et al., 2012).”
BackgroundSuicidal risk and executive functions in major depressive disorder: a study protocol
Roca, M., del Amo, A. R.-L., Serra, P. R., Pérez-Ara, M. Á., Castro, A., Roman‐Juan, J., García-Toro, M., Pazo, P. G., & Gili, M. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2233-1 · Cited by 73
“Inhibition, Working Memory and Cognitive Flexibility are considered to be the cores of EF [24, 25], and from their interaction a higherorder set of EF such as reasoning, problem solving, and planning emerges [26].”
BackgroundActive Inference, epistemic value, and vicarious trial and error
Pezzulo, G., Cartoni, E., Rigoli, F., Pio‐Lopez, L., & Friston, K. J. (2016) · Learning & Memory · doi:10.1101/lm.041780.116 · Cited by 82
“…domain, the question of “when to create a new context (or task set)” has been recently posed in a series of computational studies that use Bayesian nonparametrics coupled with reward contingencies (Collins and Koechlin 2012; Collins and Frank 2013; Stoianov et al. 2015; Maisto et al. 2016).”
Effects of music training in executive function performance in children: A systematic review
Rodríguez-Gomez, D. A., & Talero‐Gutiérrez, C. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.968144 · Cited by 110
“In this model, the three core functions interact to build higherorder EFs: reasoning, problem-solving, and planning (Collins and Koechlin, 2012; Diamond, 2013).”
BackgroundHausman, H. K., Hardcastle, C., Albizu, A., Kraft, J. N., Evangelista, N. D., Boutzoukas, E. M., Langer, K. G., O’Shea, A. M., Etten, E. J. V., Bharadwaj, P. K., et al. (2021) · GeroScience · doi:10.1007/s11357-021-00503-1 · Cited by 78
Contextual influence on confidence judgments in human reinforcement learning
Lebreton, M. P., Bacily, K., Palminteri, S., & Engelmann, J. B. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006973 · Cited by 99
Consensus Goals in the Field of Visual Metacognition
Rahnev, D., Balsdon, T., Charles, L., de Gardelle, V., Denison, R., Desender, K., Faivre, N., Filevich, E., Fleming, S. M., Jehee, J., et al. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221075615 · Cited by 63
A Probabilistic Palimpsest Model of Visual Short-term Memory
Matthey, L., Bays, P. M., & Dayan, P. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004003 · Cited by 54
“There is substantial precedence for the approximation of focusing on a single item, ignoring some or all of the statistical structure associated with other actual or potential items [72–75].”
BackgroundDomic‐Siede, M., Irani, M., Valdés, J., Perrone‐Bertolotti, M., & Ossandón, T. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117557 · Cited by 86
Differences in Coping Strategies Between Young and Older Adults: The Role of Executive Functions
Nieto, M., Ayuso, D. M. R., Ros, L., Zabala, C., Martínez, M., Ricarte, J. J., Serrano, J. P., & Latorre, J. M. (2019) · The International Journal of Aging and Human Development · doi:10.1177/0091415018822040 · Cited by 94
“These underlie more complex processes such as planning, problem-solving (PS), and reasoning (Collins & Koechlin, 2012).”
BackgroundGarcía-Madruga, J. A., Veiga, I. G., & Chaves, J. Ó. V. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00058 · Cited by 92
“According to Diamond, there are other higher order EFs, such as thinking, problem solving, and reasoning, which are built from the core EFs (Collins and Koechlin, 2012; Lunt et al., 2012).”
BackgroundOn the Association Between Musical Training, Intelligence and Executive Functions in Adulthood
Criscuolo, A., Bonetti, L., Särkämö, T., Kliuchko, M., & Brattico, E. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01704 · Cited by 82
“Executive functions designate a set of abilities related to updating and manipulating relevant information (WM), inhibiting automatic responses, shifting attention to mental tasks (selective attention), planning, reasoning and decision making (Guare and Dawson, 2004; Perrotin et al., 2008; Garner, 2009; Collins and Ko…”
BackgroundThe Dark Triad traits and individual differences in self-reported and other-rated creativity
Jonason, P. K., Abboud, R., Tomé, J., Dummett, M., & Hazer, A. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2017.06.005 · Cited by 79
“…psychology of children (Urban, 1991) and the elderly (Flood & Phillips, 2007), and is related to individual differences in intelligence (Barron & Harrington, 1981), decision making (Collins & Koechlin, 2012), and personality (Baas, Roskes, Sligte, Nijstad, & De Dreu, 2013; Wolfradt & Pretz, 2001).”
BackgroundContext-dependent decision-making: a simple Bayesian model
Lloyd, K., & Leslie, D. S. (2013) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0069 · Cited by 56
Understanding Digital Dementia and Cognitive Impact in the Current Era of the Internet: A Review
Ali, Z., Janarthanan, J., & Mohan, P. (2024) · Cureus · doi:10.7759/cureus.70029 · Cited by 93
“The executive functions of these cognitive abilities include directed behavior towards a goal, making decisions, and the ability to adapt to novel and ever-changing environments [20].”
BackgroundGoel, M., Mittal, A., Jain, V. R., Bharadwaj, A., Modi, S., Ahuja, G., Jain, A., & Kumar, K. (2025) · Annals of Neurosciences · doi:10.1177/09727531241255492 · Cited by 60
Fundamental processes in sensorimotor learning: Reasoning, refinement, and retrieval
Tsay, J. S., Kim, H. E., McDougle, S. D., Taylor, J. A., Haith, A. M., Avraham, G., Krakauer, J. W., Collins, A. G. E., & Ivry, R. B. (2024) · eLife · doi:10.7554/elife.91839 · Cited by 98
“This involves understanding (often arbitrary) action–outcome relationships and using this knowledge to construct an effective control policy ( Collins and Koechlin, 2012 ; Donoso et al., 2014 ; Heald et al., 2021 ; Lillicrap et al., 2013 ; Schone et al., 2023 ; Todorov and Jordan, 2002 ; Yang et…”
BackgroundSelf-citationA critical review of research on executive functions in sport and exercise
Furley, P., Schütz, L.-M., & Wood, G. (2023) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2023.2217437 · Cited by 96
“The core executive functions – WM, inhibitory control, and cognitive fl exibility – are theoretically assumed to underpin higher-order EFs such as reasoning, problem solving, and planning (Collins & Koechlin, 2012) which together comprise fl uid intelligence.”
Sung, M., Ku, B., Leung, W. C. W., & MacDonald, M. (2021) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05009-5 · Cited by 73
“The interaction of these three core components form higher-level EF behaviors, such as planning and reasoning (Collins & Koechlin, 2012).”
BackgroundJanz, P., Dawe, S., & Wyllie, M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02052 · Cited by 75
Prefrontal mechanisms combining rewards and beliefs in human decision-making
Rouault, M., Drugowitsch, J., & Koechlin, É. (2019) · Nature Communications · doi:10.1038/s41467-018-08121-w · Cited by 66
Self-citationCentral precuneus lesions are associated with impaired executive function
Yeager, B. E., Bruss, J., Duffau, H., Herbet, G., Hwang, K., Tranel, D., & Boes, A. D. (2022) · Brain Structure and Function · doi:10.1007/s00429-022-02556-0 · Cited by 63
“Together these processes contribute to several higher-order functions, such as decision making (Collins and Koechlin 2012), conflict monitoring and resolution (Fan et al.”
BackgroundEffects of the Type of Sports Practice on the Executive Functions of Schoolchildren
Contreras-Osorio, F., Guzmán‐Guzmán, I. P., Cerda-Vega, E., Ríos, L. J. C., Ramírez‐Campillo, R., & Campos‐Jara, C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19073886 · Cited by 86
“There is consensus for the classification of these skills into three main dimensions: inhibition or inhibitory control, working memory, and cognitive flexibility [6,7], along with another set of higher-order processes, including reasoning, problem solving, and planning [8].”
BackgroundEntrepreneurship Competence Model for Supporting Learners Development at All Educational Levels
Venesaar, U., Malleus, E., Arro, G., & Toding, M. (2021) · Administrative Sciences · doi:10.3390/admsci12010002 · Cited by 67
“Planning involves reflection and the organisation of activities to achieve the desired goal (see e.g., Collins and Koechlin 2012; Cowan 2014).”
BackgroundFogel, Y., Stuart, N. J., Joyce, T., & Barnett, A. L. (2021) · Scandinavian Journal of Occupational Therapy · doi:10.1080/11038128.2021.2019306 · Cited by 61
Why we may not find intentions in the brain
Uithol, S., Burnston, D. C., & Haselager, P. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.01.010 · Cited by 52
“Branching control, for instance, attempts to mediate shifting task demands (Collins & Koechlin, 2012; Rogers & Monsell, 1995; Sakai, 2008) with changes in context, and does so by keeping track of relations between a variety of different informational sources.”
Background
Metadata
- Authors
- Collins, A., & Koechlin, E.
- Affiliations
- Brown University (US)
- Corresponding author
- Collins, Anne
- ORCID
- Collins, Anne
- Venue
- PLoS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-03-27
- Volume
- 10
- Issue
- 3
- Pages
- e1001293
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC3313946
- OpenAlex
- W2093397813
- Cited by
- 558
- References
- 64
- Citations by year
- 2026: 24 · 2025: 45 · 2024: 47 · 2023: 47 · 2022: 66 · 2021: 69 · 2020: 58 · 2019: 47 · 2018: 39 · 2017: 29 · 2016: 24 · 2015: 25 · 2014: 19 · 2013: 14 · 2012: 5
- FWCI
- 10.33
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- HAL (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- FP7 Ideas: European Research Council (250106)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Keywords
- frontal lobe function, executive function, decision-making, behavioral strategies, strategy monitoring, exploration, creativity, reasoning, learning, reward maximization, individual differences, naturalistic decision making, adaptive behavior
- MeSH terms
- Adaptation, Psychological, Behavior, Cognition, Creativity, Cues, Decision Making, Frontal Lobe, Humans, Individuality, Learning, Models, Neurological, Computational Biology, Executive Function
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.