The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Frontal Cortex and the Discovery of Abstract Action Rules
Open accessAbstract
Summary Although we often encounter circumstances with which we have no prior experience, we rapidly learn how to behave in these novel situations. Such adaptive behavior relies on abstract behavioral rules that are generalizable, rather than concrete rules mapping specific cues to specific responses. Though the frontal cortex is known to support concrete rule learning, less well understood are the neural mechanisms supporting the acquisition of abstract rules. Here we use a novel reinforcement learning paradigm to demonstrate that more anterior regions along the rostro-caudal axis of frontal cortex support rule learning at higher levels of abstraction. Moreover, these results indicate that when humans confront new rule learning problems, this rostro-caudal division of labor supports the search for relationships between context and action at multiple levels of abstraction simultaneously.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
Cortical Surface-Based Analysis
Dale, A. M., Fischl, B., & Sereno, M. I. (1999) · NeuroImage · doi:10.1006/nimg.1998.0395 · Cited by 10,910
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
Cortical Surface-Based Analysis
Fischl, B., Sereno, M. I., & Dale, A. M. (1999) · NeuroImage · doi:10.1006/nimg.1998.0396 · Cited by 6,147
Plans and the structure of behavior.
Miller, G. A., Galanter, E., & Pribram, K. H. (1960) · doi:10.1037/10039-000 · Cited by 4,630
(1991) · Choice Reviews Online · doi:10.5860/choice.28-5376 · Cited by 4,207
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
Plans and the Structure of Behavior
Brown, R., Miller, G. A., Galanter, E., & Pribram, K. H. (1960) · Language · doi:10.2307/411065 · Cited by 3,513
Schema induction and analogical transfer
Gick, M. L., & Holyoak, K. J. (1983) · Cognitive Psychology · doi:10.1016/0010-0285(83)90002-6 · Cited by 3,010 · cited 2×
“…learning and adapting to novel circumstances because they have the ability to represent information at multiple, increasingly abstract levels (Chase and Simon, 1973; Estes, 1972; Gick and Holyoak, 1983; Greeno and Simon, 1974; Lashley, 1951; Miller et al., 1960; Newell, 1990; Paine and Tani, 2005).”
The problem of serial order in behavior
Lashley, K. S. (1951) · MPG.PuRe (Max Planck Society) · Cited by 2,734
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Cohen, J. D., Dunbar, K., & McClelland, J. L. (1990) · Psychological Review · doi:10.1037//0033-295x.97.3.332 · Cited by 2,139
Solso, R., & Chase, W. G. (1974) · The American Journal of Psychology · doi:10.2307/1421395 · Cited by 2,124
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
The Architecture of Cognitive Control in the Human Prefrontal Cortex
Koechlin, E., Ody, C., & Kouneiher, F. (2003) · Science · doi:10.1126/science.1088545 · Cited by 1,838
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717
Coding Processes in Human Memory
Peterson, L. R., Melton, A. W., & Martin, E. (1973) · The American Journal of Psychology · doi:10.2307/1421959 · Cited by 1,619
The neural basis of the central executive system of working memory
D'Esposito, M., Detre, J. A., Alsop, D. C., Shin, R. K., Atlas, S., & Grossman, M. (1995) · Nature · doi:10.1038/378279a0 · Cited by 1,472
Self-citationChase, W. G., & Simon, H. A. (1973) · Visual Information Processing · doi:10.1016/b978-0-12-170150-5.50011-1 · Cited by 1,419
Lateral prefrontal cortex: architectonic and functional organization
Petrides, M. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1631 · Cited by 1,212
An information theoretical approach to prefrontal executive function
Koechlin, E., & Summerfield, C. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.04.005 · Cited by 1,183
Single neurons in prefrontal cortex encode abstract rules
Wallis, J. D., Anderson, K. C., & Miller, E. K. (2001) · Nature · doi:10.1038/35082081 · Cited by 1,073
O'Reilly, R. C., & Frank, M. J. (2006) · Neural Computation · doi:10.1162/089976606775093909 · Cited by 1,066
The Basal Ganglia and Chunking of Action Repertoires
Graybiel, A. M. (1998) · Neurobiology of Learning and Memory · doi:10.1006/nlme.1998.3843 · Cited by 1,042 · cited 1×
“In the first, frontal cortex serves to uncover patterns in the environment that are subsequently consolidated in the basal ganglia (Graybiel, 1998).”
Mapping directed influence over the brain using Granger causality and fMRI
Roebroeck, A., Formisano, E., & Goebel, R. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.11.017 · Cited by 1,016
Cognitive control, hierarchy, and the rostro–caudal organization of the frontal lobes
Badre, D. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.02.004 · Cited by 980
Self-citationThe Frontal Lobes and Voluntary Action
Passingham, R. (1993) · doi:10.1093/oso/9780198521853.001.0001 · Cited by 970
Plans And The Structure Of Behavior
Galanter, & Eugène (1960) · Cited by 966
The cognitive functions of the caudate nucleus
Grahn, J. A., Parkinson, J. A., & Owen, A. M. (2008) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2008.09.004 · Cited by 940
Cerebral mechanisms in behavior.
indicated, N. A. (1952) · Journal of Consulting Psychology · doi:10.1037/h0051344 · Cited by 913
An adaptive coding model of neural function in prefrontal cortex
Duncan, J. (2001) · Nature Reviews Neuroscience · doi:10.1038/35097575 · Cited by 874
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Neural mechanisms of transient and sustained cognitive control during task switching.
Braver, T. S., Reynolds, J. R., & Donaldson, D. I. (2003) · Neuron · doi:10.1016/s0896-6273(03)00466-5 · Cited by 826
Cools, R., Clark, L., Owen, A. M., & Robbins, T. W. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-11-04563.2002 · Cited by 784
Cerebral Mechanisms in Behavior
Morgan, C. T., & Jeffress, L. A. (1953) · The American Journal of Psychology · doi:10.2307/1417992 · Cited by 727
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712
(1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.3.301 · Cited by 707
Goebel, R., Roebroeck, A., Kim, D.-S., & Formisano, E. (2003) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2003.08.026 · Cited by 686
Badre, D., & D'Esposito, M. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.12.2082 · Cited by 615
Self-citationNeural Activity in the Primate Prefrontal Cortex during Associative Learning
Asaad, W. F., Rainer, G., & Miller, E. K. (1998) · Neuron · doi:10.1016/s0896-6273(00)80658-3 · Cited by 593
Houk, J. C., & Wise, S. P. (1995) · Cerebral Cortex · doi:10.1093/cercor/5.2.95 · Cited by 593
Frank, M. J., & Claus, E. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.300 · Cited by 585
Hierarchical models of behavior and prefrontal function
Botvinick, M. M. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.02.009 · Cited by 532
Broca's Area and the Hierarchical Organization of Human Behavior
Koechlin, E., & Jubault, T. (2006) · Neuron · doi:10.1016/j.neuron.2006.05.017 · Cited by 492
Selection, Integration, and Conflict Monitoring
Badre, D., & Wagner, A. D. (2004) · Neuron · doi:10.1016/s0896-6273(03)00851-1 · Cited by 466
Self-citationFalse discovery rate revisited: FDR and topological inference using Gaussian random fields
CHUMBLEY, J., & FRISTON, K. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.05.021 · Cited by 464
Hazy, T. E., Frank, M. J., & O'Reilly, R. C. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2055 · Cited by 452
Hoshi, E., & Tanji, J. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.02.003 · Cited by 445
How we use rules to select actions: A review of evidence from cognitive neuroscience
BUNGE, S. A. (2004) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.4.4.564 · Cited by 436
Deficits on conditional associative-learning tasks after frontal- and temporal-lobe lesions in man
Petrides, M. (1985) · Neuropsychologia · doi:10.1016/0028-3932(85)90062-4 · Cited by 434
A Brain-Based Account of the Development of Rule Use in Childhood
Bunge, S. A., & Zelazo, P. D. (2006) · Current Directions in Psychological Science · doi:10.1111/j.0963-7214.2006.00419.x · Cited by 433
Rule-dependent neuronal activity in the prefrontal cortex
White, I. M., & Wise, S. P. (1999) · Experimental Brain Research · doi:10.1007/s002210050740 · Cited by 429
The Time Course of Changes during Motor Sequence Learning: A Whole-Brain fMRI Study
Toni, I., Krams, M., Turner, R., & Passingham, R. E. (1998) · NeuroImage · doi:10.1006/nimg.1998.0349 · Cited by 411
The Roles of the Caudate Nucleus in Human Classification Learning
Seger, C. A., & Cincotta, C. M. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3401-04.2005 · Cited by 407
Schönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390
(2019) · Psychology Press eBooks · doi:10.4324/9781315788975 · Cited by 389
Mitz, A., Godschalk, M., & Wise, S. (1991) · The Journal of Neuroscience · doi:10.1523/jneurosci.11-06-01855.1991 · Cited by 385
Botvinick, M., & Plaut, D. C. (2004) · Psychological Review · doi:10.1037/0033-295x.111.2.395 · Cited by 363
Dynamic Analysis of Learning in Behavioral Experiments
Smith, A. C., Frank, L. M., Wirth, S., Yanike, M., Hu, D., Kubota, Y., Graybiel, A. M., Suzuki, W. A., & Brown, E. N. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.2908-03.2004 · Cited by 312
Visuospatial versus visuomotor activity in the premotor and prefrontal cortex of a primate
di Pellegrino, G., & Wise, S. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-01227.1993 · Cited by 311
Seger, C. A. (2008) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.07.010 · Cited by 274
Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
Tremblay, L., Hollerman, J. R., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.964 · Cited by 268
Hierarchical cognitive control deficits following damage to the human frontal lobe
Badre, D., Hoffman, J., Cooney, J. W., & D'Esposito, M. (2009) · Nature Neuroscience · doi:10.1038/nn.2277 · Cited by 266
Self-citationThe role of the basal ganglia in learning and memory: Neuropsychological studies
Grahn, J. A., Parkinson, J. A., & Owen, A. M. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.11.020 · Cited by 255
Neurocomputational models of basal ganglia function in learning, memory and choice
Cohen, M. X., & Frank, M. J. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.029 · Cited by 237
Dynamics of Frontal, Striatal, and Hippocampal Systems during Rule Learning
Seger, C. A. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj092 · Cited by 223
Frontal Networks for Learning and Executing Arbitrary Stimulus-Response Associations
Boettiger, C. A., & D'Esposito, M. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3697-04.2005 · Cited by 213
Self-citationRole of prefrontal cortex in a network for arbitrary visuomotor mapping
Murray, E. A., Bussey, T. J., & Wise, S. P. (2000) · Experimental Brain Research · doi:10.1007/s002210000406 · Cited by 211
Computational and neurobiological mechanisms underlying cognitive flexibility
Badre, D., & Wagner, A. D. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0509550103 · Cited by 199
Self-citationFunctional–Anatomic Correlates of Control Processes in Memory
Buckner, R. L. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-10-03999.2003 · Cited by 199
Deficits in non-spatial conditional associative learning after periarcuate lesions in the monkey
Petrides, M. (1985) · Behavioural Brain Research · doi:10.1016/0166-4328(85)90085-3 · Cited by 194
Hoshi, E., & Tanji, J. (2006) · Journal of Neurophysiology · doi:10.1152/jn.01126.2005 · Cited by 189
Comparison of learning‐related neuronal activity in the dorsal premotor cortex and striatum
Brasted, P. J., & Wise, S. P. (2004) · European Journal of Neuroscience · doi:10.1111/j.0953-816x.2003.03181.x · Cited by 173
PVLV: The Primary Value and Learned Value Pavlovian Learning Algorithm.
O’Reilly, R. C., Frank, M. J., Hazy, T. E., & Watz, B. (2007) · Behavioral Neuroscience · doi:10.1037/0735-7044.121.1.31 · Cited by 160
Bussey, T. J., Wise, S. P., & Murray, E. A. (2001) · Behavioral Neuroscience · doi:10.1037//0735-7044.115.5.971 · Cited by 158
Wechsler, A. F. (1988) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-198804000-00011 · Cited by 150
The Frontal Lobes and Control of Cognition and Memory
Stuss, D. T., & Benson, D. F. (2019) · Psychology Press eBooks · doi:10.4324/9781315788975-8 · Cited by 137
Race, E., Shanker, S., & Wagner, A. D. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21132 · Cited by 133
Multilevel structure in behaviour and in the brain: a model of Fuster's hierarchy
Botvinick, M. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2056 · Cited by 118
Premotor cortex and preparation for movement
Passingham, R. E. (1988) · Experimental Brain Research · doi:10.1007/bf00247607 · Cited by 118
How Hierarchical Control Self-organizes in Artificial Adaptive Systems
Paine, R. W., & Tani, J. (2005) · Adaptive Behavior · doi:10.1177/105971230501300303 · Cited by 92
Processes for sequence production.
Greeno, J. G., & Simon, H. A. (1974) · Psychological Review · doi:10.1037/h0036340 · Cited by 76
Fujii, N., & Graybiel, A. M. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0503541102 · Cited by 73
Abstraction of Mental Representations: Theoretical Considerations and Neuroscientific Evidence
Kalina Christoff, A., & Keramatian, K. (2007) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195314274.003.0007 · Cited by 54
Conditional visuo-motor learning in primates: a key role for the basal ganglia
Hadj‐Bouziane, F., Meunier, M., & Boussaoud, D. (2003) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2004.01.014 · Cited by 50
From Monkey Brain to Human Brain: A Fyssen Foundation Symposium
Schoenemann, T. (2006) · American Journal of Human Biology · doi:10.1002/ajhb.20556 · Cited by 48
A comparison of Granger causality and coherency in fMRI‐based analysis of the motor system
Kayser, A. S., Sun, F. T., & D’Esposito, M. (2009) · Human Brain Mapping · doi:10.1002/hbm.20771 · Cited by 48
Self-citationPremotor Cortex and the Retrieval of Movement
Passingham, R. E. (2008) · Brain Behavior and Evolution · doi:10.1159/000115927 · Cited by 43
Time-modulated neuronal activity in the premotor cortex of macaque monkeys
Lucchetti, C., & Bon, L. (2001) · Experimental Brain Research · doi:10.1007/s002210100818 · Cited by 42
From monkey brain to human brain : a Fyssen Foundation symposium
Dehaene, S. (2005) · Cited by 41
Neurodynamics of the Prefrontal Cortex during Conditional Visuomotor Associations
Loh, M., Pasupathy, A., Miller, E. K., & Deco, G. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20031 · Cited by 15
Xiong (1999) · doi:10.1002/(sici)1097-0193(1999)8:2/3
Research works printed but not linked: 1
- Dale, 1999, Optimal experimental design for event-related fMRI, Hum. Brain Mapp., 8, 109, 10.1002/(SICI)1097-0193(1999)8:2/3<109::AID-HBM7>3.0.CO;2-W · doi:10.1002/(sici)1097-0193(1999)8:2/3<109::aid-hbm7>3.0.co;2-w
Cited by
Frontal Cortex and the Hierarchical Control of Behavior
Badre, D., & Nee, D. E. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.11.005 · Cited by 611
Self-citationReasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making
Collins, A., & Koechlin, E. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001293 · Cited by 558
Cognitive control over learning: Creating, clustering, and generalizing task-set structure.
Collins, A. G. E., & Frank, M. J. (2013) · Psychological Review · doi:10.1037/a0030852 · Cited by 426
Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition
Pezzulo, G., & Cisek, P. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.013 · Cited by 419
Foundations of human reasoning in the prefrontal cortex
Donoso, M., Collins, A. G. E., & Koechlin, E. (2014) · Science · doi:10.1126/science.1252254 · Cited by 406
Metadata
- Authors
- Badre, D., Kayser, A. S., & D'Esposito, M.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2010-04
- Volume
- 66
- Issue
- 2
- Pages
- 315-326
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2149112028
- Cited by
- 329
- References
- 94
- FWCI
- 9.05
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (vor, 1203 d)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Funders
- National Institutes of Health (MH63901, NS065046, NS40813)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.