Different time courses of learning-related activity in the prefrontal cortex and striatum.
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To navigate our complex world, our brains have evolved a sophisticated ability to quickly learn arbitrary rules such as 'stop at red'. Studies in monkeys using a laboratory test of this capacity--conditional association learning--have revealed that frontal lobe structures (including the prefrontal cortex) as well as subcortical nuclei of the basal ganglia are involved in such learning. Neural correlates of associative learning have been observed in both brain regions, but whether or not these regions have unique functions is unclear, as they have typically been studied separately using different tasks. Here we show that during associative learning in monkeys, neural activity in these areas changes at different rates: the striatum (an input structure of the basal ganglia) showed rapid, almost bistable, changes compared with a slower trend in the prefrontal cortex that was more in accordance with slow improvements in behavioural performance. Also, pre-saccadic activity began progressively earlier in the striatum but not in the prefrontal cortex as learning took place. These results support the hypothesis that rewarded associations are first identified by the basal ganglia, the output of which 'trains' slower learning mechanisms in the frontal cortex.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Interactions between the dorsal striatum and prefrontal cortex have been shown in primates to be critical to integrating reward associations with behavioral output (Pasupathy & Miller, 2005), a finding paralleled by adult human imaging literature (Galvan, et al., 2005; Poldrack, Prabhakaran, Seger, & Gabrieli, 1999).”
From Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents (2011) · cites this paper as Pasupathy & Miller, 2005
In the citing paper
“For example, using single-unit recordings in monkeys, Pasupathy & Miller (Pasupathy and Miller, 2005) showed that when flexibly learning a set of reward contingencies, very early activity in the striatum provides the foundation for reward-based associations, whereas later, more deliberative prefrontal mechanisms are engaged to maintain the behavioral outputs that can optimize the greatest gains”
From Adolescence: what do transmission, transition and translation have to do with it? (2010) · cites this paper as Pasupathy and Miller, 2005
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundSelf-citationBerti, A. (1992) · Neuropsychologia · doi:10.1016/0028-3932(92)90076-x · Cited by 4,162
The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe
Fuster, J. M. (1980) · Cited by 2,407
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 1×
“Dopaminergic reward-prediction error signals from the midbrai”
Role of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements
Hikosaka, O., Takikawa, Y., & Kawagoe, R. (2000) · Physiological Reviews · doi:10.1152/physrev.2000.80.3.953 · Cited by 1,302 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundEling, P. (1993) · Acta Psychologica · doi:10.1016/0001-6918(93)90027-o · Cited by 1,184
Neural Control of Voluntary Movement Initiation
Hanes, D. P., & Schall, J. D. (1996) · Science · doi:10.1126/science.274.5286.427 · Cited by 1,145 · cited 1×
“Although pre-saccadic activity might also be linked to the improvement in choices with learning, it seems likely to reflect the decrease in reaction time; a correlation between caudate nucleus (and frontal cortex) pre-saccadic activity and reaction time has been previously demonstrate”
BackgroundThe Basal Ganglia and Chunking of Action Repertoires
Graybiel, A. M. (1998) · Neurobiology of Learning and Memory · doi:10.1006/nlme.1998.3843 · Cited by 1,042 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultThe Frontal Lobes and Voluntary Action
Passingham, R. (1993) · doi:10.1093/oso/9780198521853.001.0001 · Cited by 970
Research works printed but not linked: 1
- DeLong, M. R. & Georgopoulos, A. P. in Handbook of Physiology—Nervous System (eds Brookhart, J. M. & Mountcastle, V. B.) 1017–1061 (American Physiological Society, Bethesda, 1981)
Cited by
Items 101–200 of 701
Cerebellar contributions to working memory
Hayter, A. L., Langdon, D. W., & Ramnani, N. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.03.011 · Cited by 160
“These findings parallel electrophysiological investigations in nonhuman primates, where neuronal firing is sustained across working memory delays (Levy and Goldman-Rakic, 1999; Quintana and Fuster, 1999) and the implementation of rules (Muhammad et al., 2006; Pasupathy and Miller, 2005; Wallis and Miller, 2003).”
BackgroundGluN2B in corticostriatal circuits governs choice learning and choice shifting
Brigman, J. L., Daut, R. A., Wright, T., Gunduz-Cinar, O., Graybeal, C., Davis, M. I., Jiang, Z., Saksida, L. M., Jinde, S., Pease, M., et al. (2013) · Nature Neuroscience · doi:10.1038/nn.3457 · Cited by 165
Rodent Medial Frontal Control of Temporal Processing in the Dorsomedial Striatum
Emmons, E. B., Corte, B. J. D., Kim, Y.-C., Parker, K. L., Matell, M. S., & Narayanan, N. S. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.1376-17.2017 · Cited by 176
“These data are distinct from previous work that has, in different contexts, suggested that the striatum can serve as a “teaching signal” to the frontal cortex (Pasupathy and Miller, 2005; Histed et al., 2009) and encodes specific actions (Ma et al., 2014a, 2014b).”
ResultUllman, H., Almeida, R., & Klingberg, T. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0842-13.2014 · Cited by 158
“In a study of associative learning using a delayed-response task in primates, basal ganglia activity changes preceded the slower change in prefrontal cortex, where the latter matched the changes in behavior (Pasupathy and Miller, 2005).”
BackgroundBasal Ganglia Mechanisms of Reward‐Oriented Eye Movement
HIKOSAKA, O. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.012 · Cited by 158
Functional and structural connectivity of frontostriatal circuitry in Autism Spectrum Disorder
Delmonte, S., Gallagher, L., O'Hanlon, E., McGrath, J., & Balsters, J. H. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00430 · Cited by 156
Antzoulatos, E. G., & Miller, E. K. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.040 · Cited by 172
“We also used rise time (Pasupathy and Miller, 2005) to measure when saccade-direction information first reached considerable strength on each trial (half-maximum).”
InfluentialSelf-citationGail, A., & Andersen, R. A. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1570-06.2006 · Cited by 144
“…networks, including prefrontal cortex, dorsal premotor cortex, and basal ganglia (Petrides, 1982; Toni and Passingham, 1999; White and Wise, 1999; Wallis et al., 2001; Wallis and Miller, 2003; Nixon et al., 2004; Boettiger and D’Esposito, 2005; Pasupathy and Miller, 2005; Petrides, 2005).”
BackgroundRajkumar, R., & Ganapathy, V. (2020) · IEEE Access · doi:10.1109/access.2020.2984591 · Cited by 153
“The researchers Freedman [33], Nieder [34] and Pasupathy [35] found that different types of behaviours are accompanied by different patterns of brain waves.”
BackgroundThe Role of Prefrontal Dopamine D1 Receptors in the Neural Mechanisms of Associative Learning
Puig, M. V., & Miller, E. K. (2012) · Neuron · doi:10.1016/j.neuron.2012.04.018 · Cited by 146
“Delayed Associative Learning Task and Pharmacology (A) Monkeys performed a delayed associative learning task, similar to that described previously (Asaad et al., 1998; Pasupathy and Miller, 2005).”
InfluentialSelf-citationAction-verb processing in Parkinson’s disease: new pathways for motor–language coupling
Cardona, J. F., Gershanik, O. S., Gelormini‐Lezama, C., Houck, A. L., Cardona, S., Kargieman, L., Trujillo, N., Arévalo, A. L., Amoruso, L., Manes, F. F., et al. (2013) · Brain Structure and Function · doi:10.1007/s00429-013-0510-1 · Cited by 148
“Anatomical findings in nonhuman primates (Antzoulatos and Miller 2011; Lo and Wang 2006; Pasupathy and Miller 2005; Middleton and Strick 2000, 2002) and functional neuroimaging studies in humans (McNab and Klingberg 2008; Booth et al.”
BackgroundA Wireless Multi-Channel Recording System for Freely Behaving Mice and Rats
Fan, D., Rich, D., Holtzman, T., Ruther, P., Dalley, J. W., Lopez, A., Rossi, M. A., Barter, J. W., Salas-Meza, D., Herwik, S., et al. (2011) · PLoS ONE · doi:10.1371/journal.pone.0022033 · Cited by 143
“Recent advances in electrode array technologies address the first of these limitations, making it possible to use multiple chronically implanted electrodes to measure neural activity from multiple brain regions and neurons simultaneously [3,4,5,6,7].”
BackgroundIncreases in Functional Connectivity between Prefrontal Cortex and Striatum during Category Learning
Antzoulatos, E. G., & Miller, E. K. (2014) · Neuron · doi:10.1016/j.neuron.2014.05.005 · Cited by 143
“This is consistent with models positing that the STR (through the BG) continually “trains” the PFC (Antzoulatos and Miller, 2011; Ashby et al., 2007; Djurfeldt et al., 2001; Houk and Wise, 1995; Miller and Buschman, 2008; Pasupathy and Miller, 2005; Seger and Miller, 2010).”
BackgroundResultInfluentialSelf-citationReward-related processing in the human brain: developmental considerations
Fareri, D. S., Martin, L. N., & Delgado, M. R. (2008) · Development and Psychopathology · doi:10.1017/s0954579408000576 · Cited by 141
“Third, and finally, some examples of what can happen when atypical reward circuitry development occurs will be discussed, particularly how these disturbances may affect decision making in clinical developmental populations.”
BackgroundDefault mode network connectivity during task execution
Vatansever, D., Menon, D. K., Manktelow, A. E., Sahakian, B. J., & Stamatakis, E. A. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.07.053 · Cited by 144
“The membership switch we observed in the cerebellar and deep grey matter structures might represent associative learning and motivational assignments to the ongoing motor task demands (Pasupathy and Miller, 2005).”
BackgroundActivity in prefrontal cortex during dynamic selection of action sequences
Averbeck, B. B., Sohn, J.-W., & Lee, D. (2006) · Nature Neuroscience · doi:10.1038/nn1634 · Cited by 157
Functional role of the ventrolateral prefrontal cortex in decision making
Sakagami, M., & Pan, X. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.02.008 · Cited by 141
Differential roles of caudate nucleus and putamen during instrumental learning
Brovelli, A., Nazarian, B., Meunier, M., & Boussaoud, D. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.059 · Cited by 142
“1999; Barnes et al., 2005; Tang et al., 2007; Kim et al., 2009; Kimchi et al., 2009; Tremblay et al., 1998; Hadj-Bouziane and Boussaoud, 2003; Brasted and Wise, 2004; Pasupathy and Miller, 2005; Samejima et al., 2005; Buch et al., 2006; Williams and Eskandar, 2006; Histed et al., 2009).”
Prefrontal dopamine in associative learning and memory
Puig, M. V., Antzoulatos, E. G., & Miller, E. K. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.09.026 · Cited by 139
Self-citationNeural and computational processes underlying dynamic changes in self-esteem
Will, G.-J., Rutledge, R. B., Moutoussis, M., & Dolan, R. J. (2017) · eLife · doi:10.7554/elife.28098 · Cited by 142
“Value representations in vmPFC are updated by teaching signals in the form of reward prediction errors that mediate an effect on vmPFC ( Frank and Claus, 2006 ; Garvert et al., 2015 ; Hampton et al., 2006 ; Jocham et al., 2011 ; Pasupathy and Miller, 2005 ).”
MethodAndersen, R. A., Burdick, J. W., Musallam, S., Pesaran, B., & Cham, J. G. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.09.009 · Cited by 157
TRoPICALS: A computational embodied neuroscience model of compatibility effects.
Caligiore, D., Borghi, A. M., Parisi, D., & Baldassarre, G. (2010) · Psychological Review · doi:10.1037/a0020887 · Cited by 134
“…“learning during life” mimics the slow learning processes underlying the formation of habits (Salmon & Butters, 1995), whereas “learning during the experiment” mimics the fast learning/problem solving processes taking place in prefrontal areas (Pasupathy & Miller, 2005; Seger & Cincotta, 2006).”
BackgroundReward-Dependent Modulation of Working Memory in Lateral Prefrontal Cortex
Kennerley, S. W., & Wallis, J. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.5353-08.2009 · Cited by 132
“Using PEVspace as a measure of neuronal selectivity is particularly useful when comparing neurons in different brain areas since it is independent of the neuron’s firing rate and dynamic firing range (Pasupathy and Miller, 2005; Sugase-Miyamoto and Richmond, 2005).”
MethodIto, M., & Doya, K. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.04.001 · Cited by 162
“Action command While the representation of upcoming action has been reported in DS [5,10,31 ,49], its representation in the ventral striatum is not consistent, with both positive [48] and negative reports [11 ,31 ,44], Action command is also represented in the cortical areas in the loop circuit with the striatum, such…”
ResultRuge, H., & Wolfensteller, U. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp228 · Cited by 134
Neural Basis of Motivational and Cognitive Control
(2011) · The MIT Press eBooks · doi:10.7551/mitpress/9780262016438.001.0001 · Cited by 128
Neuroanatomy of Reward: A View from the Ventral Striatum
Haber, S. N. (2011) · Europe PMC (PubMed Central) · Cited by 174
Multiple Representations of Belief States and Action Values in Corticobasal Ganglia Loops
SAMEJIMA, K., & DOYA, K. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.024 · Cited by 124
Behavioral and Neural Evidence for Item-specific Performance Monitoring
Blais, C., & Bunge, S. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21365 · Cited by 116
Goal-direction and top-down control
Buschman, T. J., & Miller, E. K. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0471 · Cited by 122
Self-citationDifferent Time Courses for Learning-Related Changes in Amygdala and Orbitofrontal Cortex
Morrison, S. E., Saez, A., Lau, B., & Salzman, C. D. (2011) · Neuron · doi:10.1016/j.neuron.2011.07.016 · Cited by 123
“The striatum itself contains neurons that signal changing reinforcement contingencies during instrumental tasks (Brasted and Wise, 2004; Pasupathy and Miller, 2005; Tremblay et al., 1998), and one study reported that signals update even more rapidly in striatum than in PFC upon repeated reversals…”
InfluentialGrossberg, S. (2017) · Neural Networks · doi:10.1016/j.neunet.2016.11.003 · Cited by 120
Toward an integration of deep learning and neuroscience
Marblestone, A. H., Wayne, G., & Kording, K. P. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00094 · Cited by 119
“Theideathatthebasalgangliacantrainthecortexisnotnew,andalreadyappearstohaveconsiderable experimentalandanatomicalsupport(PasupathyandMiller,2005;Ashbyetal.,2007,2010;TurnerandDesmurget,2010). the lamprey more than five hundred million years ago.”
BackgroundTask-specific versus generalized mnemonic representations in parietal and prefrontal cortices
Sarma, A., Masse, N. Y., Wang, X.-J., & Freedman, D. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4168 · Cited by 123
Cerebral Changes during Performance of Overlearned Arbitrary Visuomotor Associations
Grol, M. J., de Lange, F. P., Verstraten, F. A. J., Passingham, R. E., & Toni, I. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2786-05.2006 · Cited by 118
“It has been suggested that reward-prediction signals processed in the striatum (Seymour et al., 2004; Tobler et al., 2005) might support the generation of rapid stimulus–response associations during the early stages of learning (Pasupathy and Miller, 2005).”
BackgroundInfluentialTooth brushing as routine behaviour
Aunger, R. V. (2007) · International Dental Journal · doi:10.1111/j.1875-595x.2007.tb00163.x · Cited by 134
Genovesio, A., Brasted, P. J., & Wise, S. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.0699-06.2006 · Cited by 115
“…Funahashi et al., 1989; Takeda and Funahashi, 2004) and in associative learning tasks (Asaad et al., 1998; White and Wise, 1999; Fuster et al., 2000; Pasupathy and Miller, 2005), the location of any previous goal was irrelevant to the choice of the next one, which was cued separately on each trial.”
BackgroundIto, M., & Doya, K. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.1962-14.2015 · Cited by 113
How mechanisms of perceptual decision-making affect the psychometric function
Gold, J. I., & Ding, L. (2012) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2012.05.008 · Cited by 135
“…error used in the model described above, and the striatum and prefrontal cortex, which are primary targets of the dopaminergic projections and can reflect associative learning (Ding and Gold, 2010; Nomoto et al., 2010; Pasupathy and Miller, 2005; Schultz et al., 1997; Williams and Eskandar, 2006).”
MethodNeural Circuitry Underlying Rule Use in Humans and Nonhuman Primates: Figure 1.
Bunge, S. A., Wallis, J. D., Parker, A., Brass, M., Crone, E. A., Hoshi, E., & Sakai, K. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2937-05.2005 · Cited by 112
“While examining changes in neuronal selectivity associated with conditional learning in monkeys, Pasupathy and Miller (2005) found rapid changes in caudate neuron selectivity, followed by changes in behavioral performance and prefrontal selectivity.”
Dynamic Encoding of Action Selection by the Medial Striatum
Kimchi, E. Y., & Laubach, M. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.5206-08.2009 · Cited by 115
“Other groups have reported similar learning-related changes in task-related activity in the primate striatum (Brasted and Wise, 2004; Pasupathy and Miller, 2005; Williams and Eskandar, 2006).”
Feedback signals in the caudate reflect goal achievement on a declarative memory task
Tricomi, E. M., & Fiez, J. A. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.066 · Cited by 122
“This fits within the context of other experiments that have shown diminished activation in the caudate as appropriate responses become well-learned (Delgado et al., 2005; Haruno et al., 2004; Jueptner et al., 1997; Law et al., 2005; Pasupathy and Miller, 2005; Williams and Eskandar, 2006).”
BackgroundResultInfluentialA cortical motor nucleus drives the basal ganglia-recipient thalamus in singing birds
Goldberg, J. H., & Fee, M. S. (2012) · Nature Neuroscience · doi:10.1038/nn.3047 · Cited by 113
Akhlaghpour, H., Wiskerke, J., Choi, J. Y., Taliaferro, J. P., Au, J., & Witten, I. B. (2016) · eLife · doi:10.7554/elife.19507 · Cited by 115
“…case of relatively short delay period (1–4 s), but less is known about striatal dynamics in the case of longer delay periods (Antzoulatos and Miller, 2011; Chiba et al., 2015; Hikosaka et al., 1989; Histed et al., 2009; Kawagoe et al., 1998; Kermadi and Joseph, 1995; Pasupathy and Miller, 2005).”
BackgroundStalnaker, T. A. (2010) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00012 · Cited by 110
Fast and slow transitions in frontal ensemble activity during flexible sensorimotor behavior
Siniscalchi, M. J., Phoumthipphavong, V., Ali, F., Lozano, M., & Kwan, A. C. (2016) · Nature Neuroscience · doi:10.1038/nn.4342 · Cited by 108
“We found that rule type could be decoded with high accuracy using ensemble activity from ALM (matched sound: action-left trials: 78±4%, t(7)=6.”
MethodSobel, L. J., Bansal, R., Maia, T. V., Sanchez, J., Mazzone, L., Durkin, K., Liu, J., Hao, X., Ivanov, I., Miller, A., et al. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09091259 · Cited by 105
Asaad, W. F., & Eskandar, E. N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3793-11.2011 · Cited by 105
“…observed here (Schultz et al., 1993; Tremblay et al., 1998; Brasted and Wise, 2004; Schmitzer-Torbert and Redish, 2004; Barnes et al., 2005; Pasupathy and Miller, 2005; Williams and Eskandar, 2006; Kimchi et al., 2009), the encoding of RPEs by striatal neurons (and in particular, by the…”
BackgroundDivergent Plasticity of Prefrontal Cortex Networks
Moghaddam, B., & Homayoun, H. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301554 · Cited by 118
“Although the emphasis of this line of reasoning has been on cortical–subcortical interactions (Fujii and Graybiel, 2005; Pasupathy and Miller, 2005), the evidence reviewed above argues for the importance of intra-PFC circuit-level reorganization during learning and as a substrate for pathological…”
BackgroundMULTIPLE SYSTEMS OF PERCEPTUAL CATEGORY LEARNING: THEORY AND COGNITIVE TESTS
Ashby, F. G., & Valentin, V. V. (2005) · Elsevier eBooks · doi:10.1016/b978-008044612-7/50080-9 · Cited by 120
Modulation of the feedback-related negativity by instruction and experience
Walsh, M. M., & Anderson, J. R. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1117189108 · Cited by 102
“This result is also consistent with the finding that neurons in the PFC and BG adapt at different rates during reversal learning (31).”
ResultMasticatory Deficiency as a Risk Factor for Cognitive Dysfunction
Teixeira, F. B., Fernandes, L. M. P., Tavares, P. A. N., dos Santos, M. A. R., Gomes‐Leal, W., Maia, C. D. S. F., & Lima, R. R. (2014) · International Journal of Medical Sciences · doi:10.7150/ijms.6801 · Cited by 114
“Other reports have suggested that the basal ganglia plays a pivotal role in learning[24,25].”
BackgroundBasal Ganglia Neurons Dynamically Facilitate Exploration during Associative Learning
Sheth, S. A., Abuelem, T., Gale, J. T., & Eskandar, E. N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3658-10.2011 · Cited by 98
“Dynamic modulation of striatal activity appears causally related to the behavioral changes observed in associative learning, providing evidence for the third mechanism (Brasted and Wise, 2004; Pasupathy and Miller, 2005; Williams and Eskandar, 2006).”
BackgroundGuthrie, M., Leblois, A., Garenne, A., & Boraud, T. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00026.2013 · Cited by 111
“This may also have led to some transfer to cortical learning that is beyond the scope of the present model (Pasupathy and Miller 2005; Turner and Desmurget 2010).”
BackgroundCavina-Pratesi, C., Valyear, K. F., Culham, J. C., Köhler, S., Obhi, S. S., Marzi, C. A., & Goodale, M. A. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3176-05.2006 · Cited by 99
“…von Cramon, 2002, 2004a,b; Thoenissen et al., 2002; Bunge et al., 2003) (for review, see Bunge, 2005) and neurophysiological studies in macaques (Stoet and Snyder, 2004; Pasupathy and Miller, 2005) have investigated the neural correlates of preparatory set in prelearned arbitrary S-R associations.”
BackgroundEmotion regulation in children and adolescents: Boundaries between normalcy and bipolar disorder
DICKSTEIN, D. P., & LEIBENLUFT, E. (2006) · Development and Psychopathology · doi:10.1017/s0954579406060536 · Cited by 95
“…to trials during which the animal is certain to receive a reward, after initially responding to all trials regardless of reward probability ~Pasupathy & Miller, 2005; Schultz, Tremblay, & Hollerman, 1998!. Neuroimaging studies in healthy adults also demonstrate increased striatal…”
BackgroundStriatal dopamine release in sequential learning
Badgaiyan, R. D., Fischman, A. J., & Alpert, N. M. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.052 · Cited by 107
Chronic methamphetamine self-administration disrupts cortical control of cognition
Bernheim, A. P., See, R. E., & Reichel, C. M. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.07.020 · Cited by 105
“Given the substantial amount of PFC efferents to dorsal striatal areas [36], together with the role of the dorsal striatum in encoding stimulus-response relations [37, 38], frontostriatal connectivity plays a key role in regulating set-shifting performance.”
BackgroundSmits‐Bandstra, S., & Nil, L. F. D. (2007) · Journal of Fluency Disorders · doi:10.1016/j.jfludis.2007.06.001 · Cited by 111
“Pre-movement firing activity begins progressively earlier in these neurons during learning (Pasupathy & Miller, 2005).”
BackgroundMethodInfluentialKato, S., Kuramochi, M., Kobayashi, K., Fukabori, R., Okada, K., Uchigashima, M., Watanabe, M., Tsutsui, Y., & Kobayashi, K. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4005-11.2011 · Cited by 93
“Neuronal activity in the dorsal striatum undergoes dynamic changes during the acquisition of instrumental conditioning (Tremblay et al., 1998; Jog et al., 1999; Pasupathy and Miller, 2005).”
Bilingualism trains specific brain circuits involved in flexible rule selection and application
Stocco, A., & Prat, C. S. (2014) · Brain and Language · doi:10.1016/j.bandl.2014.07.005 · Cited by 113
Exploring prefrontal cortical memory mechanisms with eyeblink conditioning.
Weiss, C., & Disterhoft, J. F. (2011) · Behavioral Neuroscience · doi:10.1037/a0023520 · Cited by 108
“An example of the functional impact of these connections was shown by Pasupathy and Miller (2005) while recording from the caudate and areas 9 and 46 of the PFC in monkeys trained to make reversals of newly acquired memory guided saccades to one of two potential targets.”
BackgroundBasal ganglia output to the thalamus: still a paradox
Goldberg, J. H., Farries, M. A., & Fee, M. S. (2013) · Trends in Neurosciences · doi:10.1016/j.tins.2013.09.001 · Cited by 99
“For example, in the song system, HVC and LMAN are two cortical premotor nuclei that also exhibit syllable-locked firing, including activations at syllable onsets [73].”
BackgroundHeimer, L., Hoesen, G. W. V., Trimble, M., & Zahm, D. S. (2007) · Cited by 95
Male-specific deficits in natural reward learning in a mouse model of neurodevelopmental disorders
Grissom, N. M., McKee, S. E., Schoch, H., Bowman, N., Havekes, R., O'Brien, W. T., Mahrt, E., Siegel, S., Commons, K., Portfors, C., et al. (2018) · Molecular Psychiatry · doi:10.1038/mp.2017.184 · Cited by 92
Attentional Selection and Action Selection in the Ventral and Orbital Prefrontal Cortex
Rushworth, M. F. S., Buckley, M. J., Gough, P. M., Alexander, I. H., Kyriazis, D., McDonald, K. R., & Passingham, R. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2765-05.2005 · Cited by 90
“The particular contribution made by PFv o remains unclear; conditional learning also depends on a network of striatal, premotor, and periarcuate regions (Petrides, 1985; Wallis and Miller, 2003; Brasted and Wise, 2004; Nixon et al., 2004; Pasupathy and Miller, 2005).”
BackgroundTwo Forms of Implicit Learning in Childhood ADHD
Barnes, K. A., Howard, J. H., Howard, D. V., Kenealy, L., & Vaidya, C. J. (2010) · Developmental Neuropsychology · doi:10.1080/87565641.2010.494750 · Cited by 89
“During associative learning, activity in striatal neurons encodes probabilistic information and their firing rate precedes that of prefrontal neurons ( Pasupathy & Miller, 2005 ), whereas during executive control, activity in prefrontal neurons encodes goal related information and their firing rate precedes that of st…”
BackgroundAdolescent suicide attempts and ideation are linked to brain function during peer interactions
Harms, M. B., Casement, M. D., Teoh, J. Y., Ruiz, S., Scott, H., Wedan, R., & Quevedo, K. (2019) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2019.05.001 · Cited by 87
The role of efference copy in striatal learning
Fee, M. S. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2014.01.012 · Cited by 87
“ganglia circuitry in oculomotor learning, in which animals are trained, using rewards, to make saccades in a particular direction depending on which visual stimulus is presented [11-13].”
Siegel, J. J., Kalmbach, B. E., Chitwood, R. A., & Mauk, M. D. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00689.2011 · Cited by 99
“…during associative tasks that include a temporal gap (Bodner et al. 1996; Funahashi et al. 1989; Fuster et al. 2000; Narayanan and Laubach 2006; Pasupathy and Miller 2005), including prelimbic recordings during trace conditioning in rats (Takehara-Nishiuchi and McNaughton 2008), it was not…”
The bilingual brain: Flexibility and control in the human cortex
Buchweitz, A., & Prat, C. S. (2013) · Physics of Life Reviews · doi:10.1016/j.plrev.2013.07.020 · Cited by 115
“[49,99]).”
Spatiotemporal refinement of signal flow through association cortex during learning
Gilad, A., & Helmchen, F. (2020) · Nature Communications · doi:10.1038/s41467-020-15534-z · Cited by 83
The pathophysiological basis of sensory disturbances in Parkinson's disease
Carlos Juri, C., Rodríguez-Oroz, M. C., & Obeso, J. A. (2009) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2009.08.018 · Cited by 97
Poggio, T., & Serre, T. (2006) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 109
Puig, M. V., & Miller, E. K. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu096 · Cited by 85
Self-citationAn evolutionary computational theory of prefrontal executive function in decision-making
Koechlin, E. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0474 · Cited by 83
A neurochemical hypothesis for the origin of hominids
Raghanti, M. A., Edler, M. K., Stephenson, A. R., Munger, E. L., Jacobs, B., Hof, P. R., Sherwood, C. C., Holloway, R. L., & Lovejoy, C. O. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1719666115 · Cited by 83
“Of note, some domains of the basal ganglia are activated before cortical regions during cognitively demanding tasks, highlighting their importance in directing cortico-basal ganglia loop activity (23, 24).”
Evidence for Cortical Automaticity in Rule-Based Categorization
Helie, S., Roeder, J. L., & Ashby, F. G. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2393-10.2010 · Cited by 85
Integration of Reinforcement Learning and Optimal Decision-Making Theories of the Basal Ganglia
Bogacz, R., & Larsen, T. (2011) · Neural Computation · doi:10.1162/neco_a_00103 · Cited by 84
“Pasupathy and Miller (2005) reported longer reaction times on trials with higher stimulus-response uncertainty (trials following a change in stimulus response mapping).”
BackgroundNeuronal Correlates of Instrumental Learning in the Dorsal Striatum
Kimchi, E. Y., Torregrossa, M. M., Taylor, J. R., & Laubach, M. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00262.2009 · Cited by 87
Saga, Y., Hoshi, E., & Tremblay, L. (2017) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2017.00030 · Cited by 83
“The striatal region, which is thought to project to the GP and head and body of the caudate nucleus, plays a major role in learning stimulus-response associations (Pasupathy and Miller, 2005).”
BackgroundLearning-Related Human Brain Activations Reflecting Individual Finances
Tobler, P. N., Fletcher, P. C., Bullmore, E. T., & Schultz, W. (2007) · Neuron · doi:10.1016/j.neuron.2007.03.004 · Cited by 91
Reduced caudate volume and enhanced striatal-DMN integration in chess experts
Duan, X., He, S., Liao, W., Liang, D., Qiu, L., Wei, L., Li, Y., Liu, C.-Y., Gong, Q., & Chen, H. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.047 · Cited by 83
“This proposal has been supported by a series of findings including one that demonstrated that learning-related changes occurred significantly earlier in the striatum than in the cortex in monkeys (Pasupathy and Miller, 2005).”
ResultEfficient reinforcement learning: computational theories, neuroscience and robotics
Kawato, M., & Samejima, K. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.03.004 · Cited by 94
Hampshire, A., Chaudhry, A. M., Owen, A. M., & Roberts, A. C. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.072 · Cited by 78
“The finding of activity in the CN in response switching is consistent with findings from lesion and electrophysiological recording studies in animals (Pasupathy and Miller, 2005; Yin et al., 2005) and imaging in humans (Arana et al.”
Grossberg, S. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0307 · Cited by 80
Increased Dependence of Action Selection on Recent Motor History in Parkinson's Disease
Helmich, R. C. G., Aarts, E., de Lange, F. P., Bloem, B. R., & Toni, I. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0704-09.2009 · Cited by 99
“Accordingly, these neurochemical and computational properties suggests a functional division of labor between a rapid contextual updating (supported by the BG) and a slower contextual updating, mediated by the frontal cortex (Pasupathy and Miller, 2005; O’Reilly, 2006).”
BackgroundZahm, D. S., Becker, M. L., Freiman, A. J., Strauch, S., DeGarmo, B., Geisler, S., Meredith, G. E., & Marinelli, M. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2009.149 · Cited by 97
“…occupied mainly the cortex and basal ganglia, including the caudate-putamen and accumbens, of which all contribute to planning and initiating learned voluntary actions (Pasupathy and Miller, 2005) and become less active as task acquisition proceeds (Kleim et al., 1996; Nordquist et al., 2003).”
Action Selection and Flexible Switching Controlled by the Intralaminar Thalamic Neurons
Kato, S., Fukabori, R., Nishizawa, K., Okada, K., Yoshioka, N., Sugawara, M., Maejima, Y., Shimomura, K., Okamoto, M., Eifuku, S., et al. (2018) · Cell Reports · doi:10.1016/j.celrep.2018.02.016 · Cited by 89
All My Circuits: Using Multiple Electrodes to Understand Functioning Neural Networks
Miller, E. K., & Wilson, M. A. (2008) · Neuron · doi:10.1016/j.neuron.2008.10.033 · Cited by 76
“For example, Pasupathy and Miller (2005) recorded simultaneously from the lateral prefrontal cortex (PFC) and the striatum of the basal ganglia (BG) during learning of new arbitrary rules (akin to ‘‘stop at red’’).”
Self-citationGoodman, J., Marsh, R., Peterson, B. S., & Packard, M. G. (2014) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12169 · Cited by 80
“Presumably striatal connections to these limbic regions help guide reinforcement-based learning (Pasupathy and Miller, 2005), and therefore striatal disturbances could account for the difficulties that ADHD youth have with delaying gratification and with selecting inappropriate behaviors for a…”
BackgroundBrown, T. I., & Stern, C. E. (2014) · Cerebral Cortex · doi:10.1093/cercor/bht041 · Cited by 77
Neurotransmission systems in Parkinson’s disease
Moghaddam, H. S., Zare-Shahabadi, A., Rahmani, F., & Rezaei, N. (2017) · Reviews in the Neurosciences · doi:10.1515/revneuro-2016-0068 · Cited by 87
Prefrontal Neural Correlates of Memory for Sequences
Averbeck, B. B., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4483-06.2007 · Cited by 76
Woolley, S. C., & Kao, M. H. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.10.010 · Cited by 90
“that signals arising in cortical-basal ganglia circuits can incorporate information about reward or context to bias behavior on a moment-by-moment basis (Hikosaka et al., 1989; Kawagoe et al., 1998; Handel and Glimcher, 2000; Gdowski et al., 2001; Lauwereyns et al., 2002; Brasted and Wise, 2004; Kao et al., 2005; Pasu…”
Neural basis of sensorimotor learning: modifying internal models
Lalazar, H., & Vaadia, E. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.11.003 · Cited by 90
How may the basal ganglia contribute to auditory categorization and speech perception?
Lim, S.-J., Fiez, J. A., & Holt, L. L. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00230 · Cited by 84
“…ganglia are projected to the prefrontal cortex through a cortico-striatal loop, while the prefrontal cortex slowly integrates and binds multiple information sources to build higher-order representations (i.e., the process of generalization) (Pasupathy and Miller, 2005; Miller and Buschman, 2008).”
BackgroundBrovelli, A., Laksiri, N., Nazarian, B., Meunier, M., & Boussaoud, D. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm198 · Cited by 81
“A complementary approach searched for changes in selectivity for the rewarded action in the average firing rate of neuronal populations (Asaad et al. 1998; Pasupathy and Miller 2005 ).”
BackgroundAdjusting behavior to changing environmental demands with development
Lourenco, F., & Casey, B. J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.003 · Cited by 67
“Within the dopamine system (Buckley et al., 2009; Cardinal et al., 2001; Gill et al., 2010; Pasupathy and Miller, 2005), a peak in dopamine receptor density occurs in the striatum during early adolescence (Benes et al., 2000; Brenhouse et al., 2008; Galvan et al., 2005), whereas this peak does not…”
BackgroundKojima, S., Kao, M. H., & Doupe, A. J. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1216308110 · Cited by 82
Metadata
- Authors
- Pasupathy, A., & Miller, E. K.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Pasupathy, Anitha
- Venue
- Nature
- Published
- 2005-02
- Volume
- 433
- Issue
- 7028
- Pages
- 873-876
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2068949971
- Cited by
- 712
- References
- 33
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 20 · 2023: 17 · 2022: 12 · 2021: 25 · 2020: 22 · 2019: 26 · 2018: 32 · 2017: 23 · 2016: 40 · 2015: 39 · 2014: 42 · 2013: 37 · 2012: 37
- FWCI
- 28.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- associative learning, prefrontal cortex, striatum, basal ganglia, time course of learning, monkeys, rule induction, neural correlates of learning
- MeSH terms
- Animals, Haplorhini, Cues, Fixation, Ocular, Learning, Models, Biological, Reward, Saccades, Time Factors, Neostriatum, Prefrontal Cortex
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.