Different time courses of learning-related activity in the prefrontal cortex and striatum.
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To navigate our complex world, our brains have evolved a sophisticated ability to quickly learn arbitrary rules such as 'stop at red'. Studies in monkeys using a laboratory test of this capacity--conditional association learning--have revealed that frontal lobe structures (including the prefrontal cortex) as well as subcortical nuclei of the basal ganglia are involved in such learning. Neural correlates of associative learning have been observed in both brain regions, but whether or not these regions have unique functions is unclear, as they have typically been studied separately using different tasks. Here we show that during associative learning in monkeys, neural activity in these areas changes at different rates: the striatum (an input structure of the basal ganglia) showed rapid, almost bistable, changes compared with a slower trend in the prefrontal cortex that was more in accordance with slow improvements in behavioural performance. Also, pre-saccadic activity began progressively earlier in the striatum but not in the prefrontal cortex as learning took place. These results support the hypothesis that rewarded associations are first identified by the basal ganglia, the output of which 'trains' slower learning mechanisms in the frontal cortex.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Interactions between the dorsal striatum and prefrontal cortex have been shown in primates to be critical to integrating reward associations with behavioral output (Pasupathy & Miller, 2005), a finding paralleled by adult human imaging literature (Galvan, et al., 2005; Poldrack, Prabhakaran, Seger, & Gabrieli, 1999).”
From Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents (2011) · cites this paper as Pasupathy & Miller, 2005
In the citing paper
“For example, using single-unit recordings in monkeys, Pasupathy & Miller (Pasupathy and Miller, 2005) showed that when flexibly learning a set of reward contingencies, very early activity in the striatum provides the foundation for reward-based associations, whereas later, more deliberative prefrontal mechanisms are engaged to maintain the behavioral outputs that can optimize the greatest gains”
From Adolescence: what do transmission, transition and translation have to do with it? (2010) · cites this paper as Pasupathy and Miller, 2005
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundSelf-citationBerti, A. (1992) · Neuropsychologia · doi:10.1016/0028-3932(92)90076-x · Cited by 4,162
The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe
Fuster, J. M. (1980) · Cited by 2,407
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 1×
“Dopaminergic reward-prediction error signals from the midbrai”
Role of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements
Hikosaka, O., Takikawa, Y., & Kawagoe, R. (2000) · Physiological Reviews · doi:10.1152/physrev.2000.80.3.953 · Cited by 1,302 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundEling, P. (1993) · Acta Psychologica · doi:10.1016/0001-6918(93)90027-o · Cited by 1,184
Neural Control of Voluntary Movement Initiation
Hanes, D. P., & Schall, J. D. (1996) · Science · doi:10.1126/science.274.5286.427 · Cited by 1,145 · cited 1×
“Although pre-saccadic activity might also be linked to the improvement in choices with learning, it seems likely to reflect the decrease in reaction time; a correlation between caudate nucleus (and frontal cortex) pre-saccadic activity and reaction time has been previously demonstrate”
BackgroundThe Basal Ganglia and Chunking of Action Repertoires
Graybiel, A. M. (1998) · Neurobiology of Learning and Memory · doi:10.1006/nlme.1998.3843 · Cited by 1,042 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultThe Frontal Lobes and Voluntary Action
Passingham, R. (1993) · doi:10.1093/oso/9780198521853.001.0001 · Cited by 970
Research works printed but not linked: 1
- DeLong, M. R. & Georgopoulos, A. P. in Handbook of Physiology—Nervous System (eds Brookhart, J. M. & Mountcastle, V. B.) 1017–1061 (American Physiological Society, Bethesda, 1981)
Cited by
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718
“Indeed, cells in the dorsal striatum are progressively recruited during different types of learning from simple motor tasks to drug self-administration (Everitt and Robbins, 2005; Lehericy et al, 2005; Pasupathy and Miller, 2005; Porrino et al, 2004; Volkow et al, 2006).”
BackgroundDaw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
“) This suggested dissociation is consistent with a range of electrophysiologica”
ResultThe role of the basal ganglia in habit formation
Yin, H. H., & Knowlton, B. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1919 · Cited by 2,402
“Simultaneous recording from the prefrontal cortex (PFC) and caudate has shown that caudate activity rapidly adapts to the contingency before PFC activity does, and even before significant improvements in performance occu”
BackgroundA new look at habits and the habit-goal interface.
Wood, W., & Neal, D. T. (2007) · Psychological Review · doi:10.1037/0033-295x.114.4.843 · Cited by 1,470
“Specifically, the associative learning underlying habits is characterized by the slow, incremental accrual of information over time in procedural memory (see Graybiel, 1998; Packard & Knowlton, 2002; although also see Pasupathy & Miller, 2005 ).”
BackgroundThe Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390
“Notably, visuomotor (saccadic) activity appropriate for the correct saccadic response appeared earlier in the associative striatum (caudate nucleus) than in the dorsolateral prefrontal cortex during the course of learning (Pasupathy and Miller, 2005).”
BackgroundGalvan, A., Hare, T. A., Parra, C. E., Penn, J., Voss, H., Glover, G., & Casey, B. J. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.1062-06.2006 · Cited by 1,282
“Recently, neuroimaging studies have begun to examine reward-related processing in adolescents and have shown NAcc activation as shown in adults (Bjork et al., 2004; May et al., 2004; Ernst et al., 2005).”
BackgroundSchemas and Memory Consolidation.
Tse, D., Langston, R. F., Kakeyama, M., Bethus, I., Spooner, P. A., Wood, E. R., Witter, M. P., & Morris, R. G. M. (2007) · Science · doi:10.1126/science.1135935 · Cited by 1,244
The ventral visual pathway: an expanded neural framework for the processing of object quality
Kravitz, D. J., Saleem, K. S., Baker, C. I., Ungerleider, L. G., & Mishkin, M. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.10.011 · Cited by 1,173
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
“The changes occur several trials earlier in striatal neurons compared with prefrontal neurons (421), but are similar between orbitofrontal and amygdala neurons (378).”
BackgroundRepresentation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939
Replay of rule-learning related neural patterns in the prefrontal cortex during sleep
Peyrache, A., Khamassi, M., Benchenane, K., Wiener, S. I., & Battaglia, F. P. (2009) · Nature Neuroscience · doi:10.1038/nn.2337 · Cited by 767
“Learning-related changes in neural activity over brief time scales have been described in both the prefrontal corte”
BackgroundThe correlative triad among aging, dopamine, and cognition: Current status and future prospects
Bäckman, L., Nyberg, L., Lindenberger, U., Li, S.-C., & Farde, L. (2006) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2006.06.005 · Cited by 765
“, slow, flexible, accuracy-related) during conditional association learning (Pasupathy and Miller, 2005).”
BackgroundThe cortico-basal ganglia integrative network: The role of the thalamus
Haber, S. N., & Calzavara, R. (2009) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2008.09.013 · Cited by 718
Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making
Frank, M. J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.006 · Cited by 706
“…(Choi, Balsam, & Horvitz, 2005; Parkinson et al., 2002; Smith-Roe & Kelley, 2000 ), and with recent physiological observations that learningrelated activity is initially seen in the BG, and is only observed later in frontal cortex (Delgado, Miller, Inati, & Phelps, 2005; Pasupathy & Miller, 2005).”
Neurobiology of the Adolescent Brain and Behavior: Implications for Substance Use Disorders
Casey, B. J., & Jones, R. M. (2010) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2010.08.017 · Cited by 692
Haber, S. N., Kim, K.-S., Mailly, P., & Calzavara, R. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.0271-06.2006 · Cited by 686
“Indeed, changes in striatal activation during learning can occur in the striatum before cortex (Pasupathy and Miller, 2005).”
BackgroundFunctional organization of the basal ganglia: Therapeutic implications for Parkinson's disease
Obeso, J. A., Rodríguez-Oroz, M. C., Benitez-Temino, B., Blesa, F. J., Guridi, J., Marin, C., & Rodriguez, M. (2008) · Movement Disorders · doi:10.1002/mds.22062 · Cited by 663
Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning
Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., & Hutchison, K. E. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0706111104 · Cited by 683
Solving the Distal Reward Problem through Linkage of STDP and Dopamine Signaling
Izhikevich, E. M. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl152 · Cited by 657
The basal ganglia: learning new tricks and loving it
Graybiel, A. M. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.10.006 · Cited by 649
Developmental neurobiology of cognitive control and motivational systems.
Somerville, L. H., & Casey, B. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.01.006 · Cited by 634
“Using single-unit recordings in monkeys, Pasupathy and Miller [22] demonstrated that when flexibly learning a set of reward contingencies, very early activity in the dorsal striatum lays down reward-based associations, whereas later, more deliberative prefrontal mechanisms are engaged to maintain the behavioral output…”
BackgroundThe proactive brain: memory for predictions
Bar, M. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0310 · Cited by 498
“For example, the striatum, the caudate nucleus and the cerebellum have all been shown to be involved in various paradigms related to associative processing (Pasupathy & Miller 2005).”
BackgroundFrank, M. J., & Claus, E. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.300 · Cited by 585
“…of instrumental responses (Parkinson et al., 2002; Smith-Roe & Kelley, 2000) and with recent physiological observations that learning-related activity is initially seen in the BG and is observed only later in the frontal cortex (Delgado, Miller, Inati, & Phelps, 2005; Pasupathy & Miller, 2005).”
BackgroundGrossberg, S. (2013) · Neural Networks · doi:10.1016/j.neunet.2012.09.017 · Cited by 410
“Buschman and Miller (2007) have reported such prefrontal–parietal resonances during movement control, and Pasupathy and Miller (2004) have reported that the different time courses of activity in the prefrontal cortex and basal ganglia are consistent with how basal ganglia-mediated gating of…”
BackgroundFrontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents
Somerville, L. H., Hare, T., & Casey, B. J. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21572 · Cited by 523
“…between the dorsal striatum and the PFC have been shown in primates to be critical to integrating reward associations with behavioral output (Pasupathy & Miller, 2005), a finding paralleled by adult human imaging literature (Galvan et al., 2005; Poldrack, Prabhakaran, Seger, & Gabrieli,…”
How psychotherapy changes the brain – the contribution of functional neuroimaging
Linden, D. E. J. (2006) · Molecular Psychiatry · doi:10.1038/sj.mp.4001816 · Cited by 491
The computational neurobiology of learning and reward
Daw, N. D., & Doya, K. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.03.006 · Cited by 465
“Where in the brain are actions actually selected? In recent simultaneous recordings in primate prefrontal cortex and dorsal striatum during a learning task in which the learned associations between stimuli and actions were periodically reversed [ 32 ], striatal and prefrontal neurons were both closely tied to animals’…”
BackgroundCategory Learning in the Brain
Seger, C. A., & Miller, E. K. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135546 · Cited by 461
Self-citationSerotonin and Prefrontal Cortex Function: Neurons, Networks, and Circuits
Puig, M. V., & Gulledge, A. T. (2011) · Molecular Neurobiology · doi:10.1007/s12035-011-8214-0 · Cited by 421
“It is involved in learning [4, 5], memory [6], categorization [5, 7], inhibitory control [8, 9], and cognitive flexibility [10–12], among others.”
BackgroundBasal ganglia contributions to motor control: a vigorous tutor
Turner, R. S., & Desmurget, M. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.08.022 · Cited by 420
“Single unit recording studies have demonstrated major changes in neuronal activity in the BG as animals learn procedural tasks [88–90], and a few of these studies provided evidence that learning-related activity appears earlier in the course of learning in the striatum than in connected regions of cortex [89,90].”
Value Representations in the Primate Striatum during Matching Behavior
Lau, B., & Glimcher, P. W. (2008) · Neuron · doi:10.1016/j.neuron.2008.02.021 · Cited by 409
“…2001) and by changes in reward contingencies (Kawagoe et al., 1998; Lauwereyns et al., 2002a) as well as association learning (Barnes et al., 2005; Pasupathy and Miller, 2005; Tremblay et al., 1998; Williams and Eskandar, 2006), and they respond in a manner consistent with a role in biasing…”
Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value
Tai, L.-H., Lee, A. M., Benavidez, N., Bonci, A., & Wilbrecht, L. (2012) · Nature Neuroscience · doi:10.1038/nn.3188 · Cited by 399
Basal ganglia orient eyes to reward
Hikosaka, O., Nakamura, K., & Nakahara, H. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00458.2005 · Cited by 377
Working memory plasticity in old age: practice gain, transfer, and maintenance
Li, S.-C., Schmiedek, F., Huxhold, O., Röcke, C., Smith, J., & Lindenberger, U. (2008) · Psychology and Aging · doi:10.1037/a0014343 · Cited by 369
“The dorsolateral prefrontal cortex and the striatum interact closely in a corticostriatal network (Pasupathy & Miller, 2005; Postuma & Dagher, 2006; Seamans & Yang, 2004), and this network plays a central role in executive control and working memory (Miller & Cohen, 2001).”
BackgroundCorticostriatal plasticity is necessary for learning intentional neuroprosthetic skills
Koralek, A. C., Jin, X., Long II, J. D., Costa, R. M., & Carmena, J. M. (2012) · Nature · doi:10.1038/nature10845 · Cited by 371
The place of dopamine in the cortico-basal ganglia circuit
Haber, S. N. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.10.008 · Cited by 364
“Functionally, cells in the striatum are progressively recruited during different types of learning (Graybiel, 2005; Lehericy et al., 2005; Pasupathy and Miller, 2005; Pennartz et al., 2009).”
The nucleus accumbens as part of a basal ganglia action selection circuit
Nicola, S. M. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0510-4 · Cited by 362
“The idea that NAc neurons facilitate the actions encoded by such weak associations is consistent with recent evidence that the basal ganglia detect new (and therefore weak) stimulus– action associations during very early stages of learning (Laubach 2005; Pasupathy and Miller 2005).”
ResultThe integrative function of the basal ganglia in instrumental conditioning
Balleine, B. W., Liljeholm, M., & Ostlund, S. B. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.10.034 · Cited by 356
“[66] Pasupathy A, Miller EK.”
BackgroundResultInfluentialStocco, A., Lebiere, C., & Anderson, J. R. (2010) · Psychological Review · doi:10.1037/a0019077 · Cited by 350
Durstewitz, D., Vittoz, N. M., Floresco, S. B., & Seamans, J. K. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.029 · Cited by 351
“Therefore, we focused on the deduction of a completely novel rule rather than the shifting between familiar rules or multiple reversals as in most previous studies (Asaad et al., 1998; Everling and DeSouza, 2005; Genovesio et al., 2005; Pasupathy and Miller, 2005; Wallis et al., 2001).”
ResultCorticostriatal neurons in auditory cortex drive decisions during auditory discrimination
Znamenskiy, P., & Zador, A. M. (2013) · Nature · doi:10.1038/nature12077 · Cited by 348
Frontal Cortex and the Discovery of Abstract Action Rules
Badre, D., Kayser, A. S., & D'Esposito, M. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.025 · Cited by 329
“Pasupathy and Miller (2005) found that recordings from both area 9/46 of the prefrontal cortex and the head and body of the caudate were consistent with the latter hypothesis in macaques performing a well-learned serial reversal task.”
A basal ganglia-forebrain circuit in the songbird biases motor output to avoid vocal errors
Andalman, A. S., & Fee, M. S. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903214106 · Cited by 332
“Striatal neurons have been shown to be involved in the rapid evaluation of rewarded associations (13) and in the coding of action-specific reward values (24, 25).”
BackgroundSwitching from automatic to controlled behavior: cortico-basal ganglia mechanisms
Hikosaka, O., & Isoda, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.006 · Cited by 304
Adolescence: what do transmission, transition and translation have to do with it?
Casey, B. J., Duhoux, S., & Cohen, M. M. (2010) · Neuron · doi:10.1016/j.neuron.2010.08.033 · Cited by 297
van den Bos, W., Cohen, M. X., Kahnt, T., & Crone, E. A. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr198 · Cited by 276
“…to be updated by means of fronto-striatal connections, relating striatal prediction errors to medial prefrontal representations (Houk & Wise, 1995; Pasupathy & Miller, 2005 ; Page 4 of 34 Cerebral Cortex 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34…”
Seger, C. A. (2008) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.07.010 · Cited by 274
“Pasupathy and Miller (2005) examined single unit activity in the head of the caudate and prefrontal cortex while monkeys learned to reverse simple rules associating visual stimuli with actions.”
BackgroundCalculating Consequences: Brain Systems That Encode the Causal Effects of Actions
Tanaka, S. C., Balleine, B. W., & O'Doherty, J. P. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1808-08.2008 · Cited by 268
“running in the converse direction to that proposed here (Pasupathy and Miller, 2005).”
BackgroundClarke, H. F., Robbins, T. W., & Roberts, A. C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1521-08.2008 · Cited by 263
“However, functional imaging studies in humans and electrophysiological studies in monkeys do highlight differences in the activity of these two regions during task performance (Pasupathy and Miller, 2005; Seger and Cincotta, 2006).”
BackgroundResultPrefrontal Cortex Fails to Learn from Reward Prediction Errors in Alcohol Dependence
Park, S. Q., Kahnt, T., Beck, A., Cohen, M. X., Dolan, R. J., Wrase, J., & Heinz, A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5587-09.2010 · Cited by 258
“Evidence from primate electrophysiology studies demonstrates that reward associations initially formed in striatum are subsequently used to guide learning in dlPFC (Pasupathy and Miller, 2005).”
BackgroundAction-based effects on music perception
Maes, P.-J., Leman, M., Palmer, C., & Wanderley, M. M. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.01008 · Cited by 250
The mental cost of cognitive enhancement
Iuculano, T., & Cohen Kadosh, R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4927-12.2013 · Cited by 249
“1) while they received TES to either the posterior parietal cortex (PPC), a key brain area for numerical understanding (Butterworth et al., 2011), or the dorsolateral prefrontal cortex (DLPFC), an area widely implicated in learning (Pasupathy and Miller, 2005).”
BackgroundReward functions of the basal ganglia
Schultz, W. (2016) · Journal of Neural Transmission · doi:10.1007/s00702-016-1510-0 · Cited by 248
“With reversals of reward predictions, striatal neurons switch differential responses rapidly whena previously rewarded stimulus becomes unrewarded, in close correspondence to behavioral choices (Pasupathy and Miller 2005).”
BackgroundNeurobiological roots of language in primate audition: common computational properties
Bornkessel-Schlesewsky, I., Schlesewsky, M., Small, S. L., & Rauschecker, J. P. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.12.008 · Cited by 246
Separate neural substrates for skill learning and performance in the ventral and dorsal striatum
Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W., & O'Reilly, R. C. (2007) · Nature Neuroscience · doi:10.1038/nn1817 · Cited by 241
“Consistent with that idea, one recent study reported that learning-related changes in cortical neuronal activity lag behind changes in the striatu”
ResultFan, J., Kolster, R., Ghajar, J., Suh, M., Knight, R. T., Sarkar, R., & McCandliss, B. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3470-06.2007 · Cited by 242
“The ACC, along with the PFC (Frith et al., 1991; Cohen et al., 1999) and basal ganglia (Pasupathy and Miller, 2005), which are interconnected in corticobasal ganglionic loops (Middleton and Strick, 2002), have been implicated in volitional action, consistent with their activation during the period…”
BackgroundActivity patterns of serotonin neurons underlying cognitive flexibility
Matias, S., Lottem, E., Dugué, G. P., & Mainen, Z. F. (2017) · eLife · doi:10.7554/elife.20552 · Cited by 239
Andersen, R. A., Hwang, E. J., & Mulliken, G. H. (2010) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100503 · Cited by 237
Selective enhancement of associative learning by microstimulation of the anterior caudate
Williams, Z. M., & Eskandar, E. N. (2006) · Nature Neuroscience · doi:10.1038/nn1662 · Cited by 240
Network Resets in Medial Prefrontal Cortex Mark the Onset of Behavioral Uncertainty
Karlsson, M. P., Tervo, D. G. R., & Karpova, A. Y. (2012) · Science · doi:10.1126/science.1226518 · Cited by 236
A hypothesis for basal ganglia-dependent reinforcement learning in the songbird
Fee, M. S., & Goldberg, J. H. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.09.069 · Cited by 228
“When cue-reward contingencies are unexpectedly violated in these studies, MSNs can change their response rapidly— within a few trials—and this change in firing may precede the changed behavioral response that follows from the reversed association with the cue (Pasupathy and Miller, 2005; Watanabe and Hikosaka, 2005).”
BackgroundHaber, S. N., & Behrens, T. E. J. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.031 · Cited by 230
Brain Activation during Anticipation of Sound Sequences
Leaver, A. M., Van Lare, J., Zielinski, B., Halpern, A. R., & Rauschecker, J. P. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4921-08.2009 · Cited by 233
“Interestingly, run 2 signal was only slightly greater for the AS than NS condition in GP/Pu ( p 0.02), suggesting that the BG may be most crucial to early stages of learning (Pasupathy and Miller, 2005).”
BackgroundResultInfluentialCircuit Mechanisms of Sensorimotor Learning
Makino, H., Hwang, E. J., Hedrick, N. G., & Komiyama, T. (2016) · Neuron · doi:10.1016/j.neuron.2016.10.029 · Cited by 228
“…this associationselective activity developed earlier in the striatum than the dorsolateral PFC during the training, suggesting that rewarded associations are first identified by the basal ganglia, and the basal ganglia output may train slower learning mechanisms in PFC (Pasupathy and Miller, 2005).”
InfluentialStriatal activity topographically reflects cortical activity
Peters, A. J., Fabre, J. M. J., Steinmetz, N. A., Harris, K. D., & Carandini, M. (2021) · Nature · doi:10.1038/s41586-020-03166-8 · Cited by 245
Dynamics of Frontal, Striatal, and Hippocampal Systems during Rule Learning
Seger, C. A. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj092 · Cited by 223
“We chose the head of the caudate and the middle frontal gyrus for further analyses both because these areas showed the most pronounced peaks and also because they are the closest to the human analogs of the areas examined in monkeys by Pasupathy and Miller (2005) .”
BackgroundResultInfluentialRole of Striatum in Updating Values of Chosen Actions
Kim, H., Sul, J. H., Huh, N., Lee, D., & Jung, M. W. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2728-09.2009 · Cited by 224
“Finally, physiological studies have found neuronal activity in the BG correlated with upcoming movement of the animal (Hikosaka et al., 1989; Alexander and Crutcher, 1990b; Apicella et al., 1992; Setlow et al., 2003; Nicola et al., 2004; Pasupathy and Miller, 2005).”
BackgroundResultEvidence for Two Concurrent Inhibitory Mechanisms during Response Preparation
Duque, J., Lew, D., Mazzocchio, R., Olivier, E., & Ivry, R. B. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5722-09.2010 · Cited by 227
Basal ganglia and dopamine contributions to probabilistic category learning
Shohamy, D., Myers, C. E., Kalanithi, J., & Gluck, M. A. (2008) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.07.008 · Cited by 218
“Similar results have been obtained with electrophysiological studies from monkeys engaged in reversal of extensively trained stimulus–response associations, with learningrelated changes in caudate appearing early and PFC supporting later performance (Pasupathy and Miller, 2005).”
ResultMuhammad, R., Wallis, J. D., & Miller, E. K. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.6.974 · Cited by 216
“Furthermore, a recent study (Pasupathy & Miller, 2005) showed that neural correlates for the learning of specific rules (conditional visuomotor associations between a specific cue and a specific response) were more strongly reflected in STR activity than PFC activity.”
Self-citationDarki, F., & Klingberg, T. (2015) · Cerebral Cortex · doi:10.1093/cercor/bht352 · Cited by 212
Human neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209
Instructional control of reinforcement learning: A behavioral and neurocomputational investigation
Doll, B. B., Jacobs, W. J., Sanfey, A. G., & Frank, M. J. (2009) · Brain Research · doi:10.1016/j.brainres.2009.07.007 · Cited by 215
“Pasupathy and Miller (2005), who recorded from monkey BG and PFC, demonstrated that that, although striatal cells indicate the correct response early in training, the behavior did not.”
BackgroundTranslating Birdsong: Songbirds as a Model for Basic and Applied Medical Research
Brainard, M. S., & Doupe, A. J. (2013) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-060909-152826 · Cited by 202
“Such song consolidation is consistent with other cases in which mammalian striatal activity initially implements adaptive changes in behavior but ultimately drives downstream consolidation of those changes (e.g., Censor et al. 2012, Pasupathy & Miller 2005).”
ResultThe neural correlates of statistical learning in a word segmentation task: An fMRI study
Karuza, E. A., Newport, E. L., Aslin, R. N., Starling, S. J., Tivarus, M. E., & Bavelier, D. (2013) · Brain and Language · doi:10.1016/j.bandl.2012.11.007 · Cited by 213
“This result also fits with the monkey physiology work of Pasupathy and Miller (2005), which showed that activity in basal ganglia was related to rapid associative learning, while slow improvements in performance over time were correlated with activity in prefrontal areas.”
ResultThe role of ventral frontostriatal circuitry in reward-based learning in humans.
Galvan, A., Hare, T. A., Davidson, M., Spicer, J., Glover, G., & Casey, B. J. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2431-05.2005 · Cited by 207
“First, the striatum identifies rewarded associations and the PFC is subsequently active during behavioral executions to obtain the identified reward (Pasupathy and Miller, 2005).”
BackgroundResultInfluentialFusi, S., Asaad, W. F., Miller, E. K., & Wang, X.-J. (2007) · Neuron · doi:10.1016/j.neuron.2007.03.017 · Cited by 199
“…et al., 2005) studies suggest that basal ganglia and prefrontal cortex are engaged in signaling rewards at different (short versus long) timescales; it remains unclear whether this view is consistent with the electrophysiological data of Pasupathy and Miller (2005) in conditional learning tasks.”
BackgroundResultInfluentialSelf-citationMansouri, F. A., Matsumoto, K., & Tanaka, K. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.5238-05.2006 · Cited by 193
“In contrast to the relatively consistent performance of monkeys in adapting to reversals in previous studies with stimulus– response association tasks (Pasupathy and Miller, 2005), the monkeys’ performance in learning the new rule after rule changes considerably varied from block to block in the present study.”
BackgroundResultAction selection and refinement in subcortical loops through basal ganglia and cerebellum
Houk, J. C., Bastianen, C., Fansler, D., Fishbach, A., Fraser, D., Reber, P. J., Roy, S. A., & Simo, L. S. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2063 · Cited by 197
“The executed submovement follows an approximately bell-shaped velocity profile. of single cell activity from the neostriatum and frontal cortex (Brasted & Wise 2004; Pasupathy & Miller 2005).”
Performance Feedback Drives Caudate Activation in a Phonological Learning Task
Tricomi, E., Delgado, M. R., McCandliss, B. D., McClelland, J. L., & Fiez, J. A. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.6.1029 · Cited by 199
“…it should be noted that work from other investigators indicates that neural processing in the caudate nuclei appears to change over the course of learning (Delgado, Miller, Inati, & Phelps, 2005; Pasupathy & Miller, 2005; Seger & Cincotta, 2005; Haruno et al., 2004; Packard & Knowlton, 2002).”
ResultA Flexible Model of Working Memory
Bouchacourt, F., & Buschman, T. J. (2019) · Neuron · doi:10.1016/j.neuron.2019.04.020 · Cited by 201
Cole, M. W., Laurent, P., & Stocco, A. (2013) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-012-0125-7 · Cited by 196
“Single-cell recording in primates learning new rule-based tasks, for instance, suggested that caudate responses anticipate responses in LPFC and mediate the acquisition of new behaviors (Pasupathy & Miller, 2005).”
BackgroundSubcellular localization of type 1 cannabinoid receptors in the rat basal ganglia
Mátyás, F., Yanovsky, Y., MacKie, K., Kelsch, W., Misgeld, U., & Freund, T. F. (2006) · Neuroscience · doi:10.1016/j.neuroscience.2005.09.005 · Cited by 190
Hoshi, E., & Tanji, J. (2006) · Journal of Neurophysiology · doi:10.1152/jn.01126.2005 · Cited by 189
“Therefore the PMd seems to be involved in the process of action planning in concert with the prefrontal cortex as well as by other structures including the parietal cortex (Calton et al. 2002) and basal ganglia (Brasted and Wise 2004; Inase et al. 2001; Pasupathy and Miller 2005).”
BackgroundBar, M., Aminoff, E., Mason, M., & Fenske, M. (2007) · Hippocampus · doi:10.1002/hipo.20287 · Cited by 187
“For example, the striatum (Pasupathy and Miller, 2005), the caudate nucleus (Poldrock and Rodriguez, 2004), and even the cerebellum have all been shown to be involved in various FIGURE 1.”
BackgroundHisted, M. H., Pasupathy, A., & Miller, E. K. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.019 · Cited by 187
Self-citationThe basal ganglia in human learning
Seger, C. A. (2006) · The Neuroscientist · doi:10.1177/1073858405285632 · Cited by 182
Puig, M. V., Rose, J., Schmidt, R., & Freund, N. (2014) · Frontiers in Neural Circuits · doi:10.3389/fncir.2014.00093 · Cited by 184
“The monkey lateral PFC has also been implicated in associative stimulus-response learning (Asaad et al., 1998; Pasupathy and Miller, 2005; Histed et al., 2009; Antzoulatos and Miller, 2011; Puig and Miller, 2012, 2014).”
BackgroundPerceptual Learning and Decision-Making in Human Medial Frontal Cortex
Kahnt, T., Grueschow, M., Speck, O., & Haynes, J.-D. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.054 · Cited by 179
Prefrontal cortex and basal ganglia contributions to visual working memory
Voytek, B., & Knight, R. T. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1007277107 · Cited by 181
“Research suggests that the BG are critical in learning behavioral requirements (8, 21, 32, 47, 48).”
BackgroundKennerley, S. W., & Walton, M. E. (2011) · Behavioral Neuroscience · doi:10.1037/a0023575 · Cited by 176
“…change to meet task demands, or shift/ spread between areas, just as other goal-relevant representations shift during learning (Amiez et al., 2006; M. Matsumoto et al., 2007; Pasupathy & Miller, 2005; Procyk, Tanaka, & Joseph, 2000; Schoenbaum, Chiba, & Gallagher, 1999; Tremblay & Schultz, 2000a).”
BackgroundAction and Outcome Encoding in the Primate Caudate Nucleus
Lau, B., & Glimcher, P. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3060-07.2007 · Cited by 177
“…basal ganglia promotes learning in cortical areas (Wise et al., 1996) via projections through the substantia nigra pars reticulata (SNr) and thalamus (Ilinsky et al., 1985; Middleton and Strick, 1994), an idea supported by recent experiments (Fujii and Graybiel, 2005; Pasupathy and Miller, 2005).”
BackgroundResultAn update on the connections of the ventral mesencephalic dopaminergic complex
Yetnikoff, L., Lavezzi, H. N., Reichard, R. A., & Zahm, D. S. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.04.010 · Cited by 172
“…uthor M anuscript A uthor M anuscript A uthor M anuscript Excitation of the direct and indirect pathways is usually attributed to the cortical inputs, but may also (or instead) reflect activity in thalamostriatal projections from the midlineintralaminar thalamic nuclei (Pasupathy and Miller, 2005).”
BackgroundLearning robust cortico-cortical associations with the basal ganglia: An integrative review
Hélie, S., Ell, S. W., & Ashby, F. G. (2015) · Cortex · doi:10.1016/j.cortex.2014.10.011 · Cited by 173
“Moreover, Pasupathy and Miller (2005) showed that activation in both the PFC and the striatum changes when training monkeys in an associative rule-learning task, but that learningrelated changes occur earlier in the striatum than in the PFC. Similar results were found by Helie, Roeder, and Ashby…”
Calzavara, R., Mailly, P., & Haber, S. N. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05825.x · Cited by 170
“In some instances the striatum is the ‘teacher’ of the cortex (Pasupathy & Miller, 2005) but, in other experimental paradigms, learning occurs simultaneously in cortex and striatum (Brasted & Wise, 2004).”
BackgroundA critical review of habit learning and the basal ganglia
Seger, C. A., & Spiering, B. J. (2011) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2011.00066 · Cited by 170
“…for his contributions during the development of this manuscript. more recent theories argue that the basal ganglia are active primarily during learning, and that well established habits are represented cortically (Pasupathy and Miller, 2005; Seger and Cincotta, 2006; Ashby et al., 2007, 2010).”
Summerfield, C., & Tsetsos, K. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00070 · Cited by 167
“…compelling evidence in favor of this view comes from singlecell recordings in the striatum and PFC during reversal learning, which have revealed that responses in the caudate adapt earlier than in the cortex – within as little as five trials of an unpredicted switch (Pasupathy and Miller, 2005).”
BackgroundFrank, M. J., Scheres, A., & Sherman, S. J. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2058 · Cited by 166
Conway, C. M., & Pisoni, D. B. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1416.009 · Cited by 163
“In other cases, learning appears to occur first in the basal ganglia, which then guide learning in prefrontal cortex (Pasupathy & Miller, 2005).”
BackgroundAction Selection and Action Value in Frontal-Striatal Circuits
Seo, M., Lee, E., & Averbeck, B. B. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.037 · Cited by 161
Metadata
- Authors
- Pasupathy, A., & Miller, E. K.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Pasupathy, Anitha
- Venue
- Nature
- Published
- 2005-02
- Volume
- 433
- Issue
- 7028
- Pages
- 873-876
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2068949971
- Cited by
- 712
- References
- 33
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 20 · 2023: 17 · 2022: 12 · 2021: 25 · 2020: 22 · 2019: 26 · 2018: 32 · 2017: 23 · 2016: 40 · 2015: 39 · 2014: 42 · 2013: 37 · 2012: 37
- FWCI
- 28.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- associative learning, prefrontal cortex, striatum, basal ganglia, time course of learning, monkeys, rule induction, neural correlates of learning
- MeSH terms
- Animals, Haplorhini, Cues, Fixation, Ocular, Learning, Models, Biological, Reward, Saccades, Time Factors, Neostriatum, Prefrontal Cortex
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.