Different time courses of learning-related activity in the prefrontal cortex and striatum.
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To navigate our complex world, our brains have evolved a sophisticated ability to quickly learn arbitrary rules such as 'stop at red'. Studies in monkeys using a laboratory test of this capacity--conditional association learning--have revealed that frontal lobe structures (including the prefrontal cortex) as well as subcortical nuclei of the basal ganglia are involved in such learning. Neural correlates of associative learning have been observed in both brain regions, but whether or not these regions have unique functions is unclear, as they have typically been studied separately using different tasks. Here we show that during associative learning in monkeys, neural activity in these areas changes at different rates: the striatum (an input structure of the basal ganglia) showed rapid, almost bistable, changes compared with a slower trend in the prefrontal cortex that was more in accordance with slow improvements in behavioural performance. Also, pre-saccadic activity began progressively earlier in the striatum but not in the prefrontal cortex as learning took place. These results support the hypothesis that rewarded associations are first identified by the basal ganglia, the output of which 'trains' slower learning mechanisms in the frontal cortex.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Interactions between the dorsal striatum and prefrontal cortex have been shown in primates to be critical to integrating reward associations with behavioral output (Pasupathy & Miller, 2005), a finding paralleled by adult human imaging literature (Galvan, et al., 2005; Poldrack, Prabhakaran, Seger, & Gabrieli, 1999).”
From Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents (2011) · cites this paper as Pasupathy & Miller, 2005
In the citing paper
“For example, using single-unit recordings in monkeys, Pasupathy & Miller (Pasupathy and Miller, 2005) showed that when flexibly learning a set of reward contingencies, very early activity in the striatum provides the foundation for reward-based associations, whereas later, more deliberative prefrontal mechanisms are engaged to maintain the behavioral outputs that can optimize the greatest gains”
From Adolescence: what do transmission, transition and translation have to do with it? (2010) · cites this paper as Pasupathy and Miller, 2005
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundSelf-citationBerti, A. (1992) · Neuropsychologia · doi:10.1016/0028-3932(92)90076-x · Cited by 4,162
The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe
Fuster, J. M. (1980) · Cited by 2,407
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 1×
“Dopaminergic reward-prediction error signals from the midbrai”
Role of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements
Hikosaka, O., Takikawa, Y., & Kawagoe, R. (2000) · Physiological Reviews · doi:10.1152/physrev.2000.80.3.953 · Cited by 1,302 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundEling, P. (1993) · Acta Psychologica · doi:10.1016/0001-6918(93)90027-o · Cited by 1,184
Neural Control of Voluntary Movement Initiation
Hanes, D. P., & Schall, J. D. (1996) · Science · doi:10.1126/science.274.5286.427 · Cited by 1,145 · cited 1×
“Although pre-saccadic activity might also be linked to the improvement in choices with learning, it seems likely to reflect the decrease in reaction time; a correlation between caudate nucleus (and frontal cortex) pre-saccadic activity and reaction time has been previously demonstrate”
BackgroundThe Basal Ganglia and Chunking of Action Repertoires
Graybiel, A. M. (1998) · Neurobiology of Learning and Memory · doi:10.1006/nlme.1998.3843 · Cited by 1,042 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultThe Frontal Lobes and Voluntary Action
Passingham, R. (1993) · doi:10.1093/oso/9780198521853.001.0001 · Cited by 970
Research works printed but not linked: 1
- DeLong, M. R. & Georgopoulos, A. P. in Handbook of Physiology—Nervous System (eds Brookhart, J. M. & Mountcastle, V. B.) 1017–1061 (American Physiological Society, Bethesda, 1981)
Cited by
Items 301–400 of 701
Competitive and cooperative interactions between medial temporal and striatal learning systems
Freedberg, M., Toader, A. C., Wassermann, E. M., & Voss, J. L. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2019.107257 · Cited by 48
Fee, M. S. (2012) · Frontiers in Neural Circuits · doi:10.3389/fncir.2012.00038 · Cited by 40
“For example, monkeys can be trained to saccade toward or away from a particular stimulus (Kunimatsu and Tanaka, 2010), or can be trained to make saccades in a particular direction depending the identity of an object image, rather than its location (Pasupathy and Miller, 2005).”
BackgroundTan, C. O., & Bullock, D. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.0259-08.2008 · Cited by 41
“Uncertainty responses may also facilitate behavioral switches during reversal learning (Pasupathy and Miller, 2005) (but see Tan and Bullock, 2008a).”
Moustafa, A. A., & Gluck, M. A. (2011) · Neural Networks · doi:10.1016/j.neunet.2011.02.006 · Cited by 42
Glucocorticoids boost stimulus-response memory formation in humans
Guenzel, F. M., Wolf, O. T., & Schwabe, L. (2014) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2014.02.015 · Cited by 47
“Previous evidence indicates that this kind of association learning relies on the striatum (Pasupathy and Miller, 2005; Graybiel, 2008).”
BackgroundPrefrontal Cortex Networks Shift from External to Internal Modes during Learning
Brincat, S. L., & Miller, E. K. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.0274-16.2016 · Cited by 49
“PFC spiking activity shifts from sensory to memory information with learning We have previously shown that, as monkeys learn new object– object or object–saccade associations, associative cues elicit progressively more information about their anticipated pair in the PFC (Asaad et al., 1998; Pasupathy and Miller, 2005;…”
BackgroundSelf-citationThe Dorsomedial Striatum Reflects Response Bias during Learning
Kimchi, E. Y., & Laubach, M. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4060-09.2009 · Cited by 39
“This interpretation could actually account for findings that the dorsomedial striatum is active early during more familiar learning, even appearing to lead other brain areas such as other parts of striatum or prefrontal cortex (Pasupathy and Miller, 2005; Williams and Eskandar, 2006).”
BackgroundResultInfluentialDopamine–endocannabinoid interactions mediate spike-timing-dependent potentiation in the striatum
Xu, H., Siaume‐Perez, S., Cornil, A., Detraux, B., Prokin, I., Cui, Y., Degos, B., Berry, H., d’Exaerde, A. D. K., & Venance, L. (2018) · Nature Communications · doi:10.1038/s41467-018-06409-5 · Cited by 49
Lamichhane, B., & Dhamala, M. (2015) · Brain Connectivity · doi:10.1089/brain.2014.0282 · Cited by 45
“…reported in various decision-making tasks (Adhikari et al., 2013; Carlson et al., 2006; de Lafuente and Romo, 2005; Hernandez et al., 2010; Lamichhane et al., 2014) and is also considered a part of the cognitive system (Miller and Cohen, 2001; Pasupathy and Miller, 2005; Weissman et al., 2008).”
Lee, A. M., Tai, L.-H., Zador, A., & Wilbrecht, L. (2015) · Neuroscience · doi:10.1016/j.neuroscience.2014.12.042 · Cited by 37
“The basal ganglia may also provide an evaluation of ongoing performance, which can facilitate learning (Brainard and Doupe, 2000; Pasupathy and Miller, 2005) or modulate the vigor or speed with which an action is performed (Desmurget and Turner, 2010; Turner and Desmurget, 2010; Wang et al., 2013).”
Pehrson, A. L., Jeyarajah, T., & Sanchez, C. (2016) · CNS Spectrums · doi:10.1017/s1092852915000486 · Cited by 36
Rational and mechanistic perspectives on reinforcement learning
Chater, N. (2008) · Cognition · doi:10.1016/j.cognition.2008.06.014 · Cited by 52
Beeler, J. A., Petzinger, G. M., & Jakowec, M. W. (2013) · Frontiers in Neurology · doi:10.3389/fneur.2013.00134 · Cited by 41
“STRIATAL LEARNING SHAPES CORTICAL ACTIVITY AND LEARNING Though cortical activity and learning shape activity in the striatum, evidence suggests that the striatum may learn earlier and faster and may shape cortical learning (55), consistent with the idea that the basal ganglia provide a filter for cortical activity.”
BackgroundPrefrontal mechanisms of comorbidity from a transdiagnostic and ontogenic perspective
MacDonald, A. N., Goines, K., Novacek, D. M., & Walker, E. F. (2016) · Development and Psychopathology · doi:10.1017/s0954579416000742 · Cited by 44
“…striatum are central to accomplishing goal-directed behavioral regulation (Belleine, Delgado, & Hikoshaka, 2007), suppressing impulses (Miller & Cohen, 2001), regulating of positive affect (Heller et al., 2009), and integrating reward association with behavioral outputs (Pasupathy & Miller, 2005).”
BackgroundTang, C. C., Root, D. H., Duke, D. C., Zhu, Y., Teixeria, K., Ma, S., Barker, D. J., & West, M. O. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2824-09.2009 · Cited by 44
“This is consistent with the idea that the striatum may act to “train” the cortex in acquiring the motor program but contribute less as movements become automatic (Marsden, 1982; Wise et al., 1996; Pasupathy and Miller, 2005).”
The Involvement of Corticostriatal Loops in Learning Across Tasks, Species, and Methodologies
Seger, C. A. (2009) · Advances in behavioral biology · doi:10.1007/978-1-4419-0340-2_2 · Cited by 42
“2004; Seger and Cincotta 2006), and when relearning after a rule reversal (Cools et al. 2002; Pasupathy and Miller 2005).”
BackgroundNeurophysiology of rule switching in the corticostriatal circuit
Bissonette, G. B., & Roesch, M. R. (2016) · Neuroscience · doi:10.1016/j.neuroscience.2016.01.062 · Cited by 41
“Indeed, recording data from the striatum suggest that the onset of learning new associations in striatum precedes PFC in some instances (Pasupathy and Miller, 2005) and that this striatal activity may be critical to sustaining associations between previously correct decisions, overtime culminating…”
BackgroundResultInfluentialTemporal Learning Among Prefrontal and Striatal Ensembles
Emmons, E. B., Tunes, G. C., Choi, J., Bruce, R. A., Weber, M. A., Kim, Y.-C., & Narayanan, N. (2020) · Cerebral Cortex Communications · doi:10.1093/texcom/tgaa058 · Cited by 42
Electrical Stimulation-Evoked Dopamine Release in the Primate Striatum
Gale, J. T., Lee, K. H., Amirnovin, R., Roberts, D. W., Williams, Z. M., Blaha, C. D., & Eskandar, E. N. (2013) · Stereotactic and Functional Neurosurgery · doi:10.1159/000351523 · Cited by 35
Gain Mechanisms for Contextually Guided Visuomotor Transformations
Brozović, M., Gail, A., & Andersen, R. A. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.2685-07.2007 · Cited by 35
“…et al., 2000; Buneo and Andersen, 2006) in the cerebral cortex must be flexible enough to produce radically different motor plans based on contextual information despite identical sensory conditions (Petrides, 1982; Platt and Glimcher, 1999; Wallis and Miller, 2003; Pasupathy and Miller, 2005).”
BackgroundKumar, S., Zomorrodi, R., Ghazala, Z., Goodman, M. S., Blumberger, D. M., Daskalakis, Z. J., Fischer, C. E., Mulsant, B. H., Pollock, B. G., & Rajji, T. K. (2020) · International Psychogeriatrics · doi:10.1017/s1041610220003518 · Cited by 39
“DLPFC is important for the maintenance of executive function that includes the abilities to select, maintain, and manipulate information online, collectively referred to as working memory (Fuster et al., 2000; Pasupathy and Miller, 2005; Baddeley, 1996).”
BackgroundBrain representations for acquiring and recalling visual–motor adaptations
Bédard, P., & Sanes, J. N. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.07.009 · Cited by 44
“Prior work on associative motor learning reported non-linear relationships between behavioral improvements and brain responses (Mitz et al., 1991; Pasupathy and Miller, 2005; Seger and Cincotta, 2006).”
Basal ganglia circuits underlying the pathophysiology of levodopa-induced dyskinesia
Barroso‐Chinea, P., & Bezard, E. (2010) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2010.00131 · Cited by 44
“In MPTP-treated primates, GAD 65 mRNA and GAD 67 mRNA are increased in the striatum (Pedneault and Soghomonian, 1994; Soghomonian et al., 1994; Levy et al., 1995).”
Integrative Networks Across Basal Ganglia Circuits
Haber, S. N. (2010) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-12-374767-9.00024-x · Cited by 43
Moyer, J. T., Halterman, B. L., Finkel, L. H., & Wolf, J. A. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00152 · Cited by 36
“ORIGINAL RESEARCH ARTICLE published: 25 November 2014 doi: 10.3389/fncom.2014.00152 Lateral and feedforward inhibition suppress asynchronous activity in a large, biophysically-detailed computational model of the striatal network”
BackgroundInfluentialSensorimotor Learning Biases Choice Behavior: A Learning Neural Field Model for Decision Making
Klaes, C., Schneegans, S., Schöner, G., & Gail, A. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002774 · Cited by 37
Is there a tape recorder in your head? How the brain stores and retrieves musical melodies
Rauschecker, J. P. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00149 · Cited by 38
“Studies in monkeys have shown that during learning of a new sensorimotor association the basal ganglia are very active (Pasupathy and Miller, 2005).”
BackgroundRebec, G. V. (2018) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.12828 · Cited by 42
Characteristics of fast-spiking neurons in the striatum of behaving monkeys
Yamada, H., Inokawa, H., Hori, Y., Pan, X., Matsuzaki, R., Nakamura, K., Samejima, K., Shidara, M., Kimura, M., Sakagami, M., et al. (2015) · Neuroscience Research · doi:10.1016/j.neures.2015.10.003 · Cited by 37
“Another functional subregion of the striatum, the anterior striatum, was suggested to guide animal’s actions toward rewards by quickly adjusting action–outcome associations through learning in monkeys (Pasupathy and Miller, 2005; Williams and Eskandar, 2006).”
The influence of recent decisions on future goal selection
Genovesio, A., & Ferraina, S. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0477 · Cited by 34
“The slow-learning mechanisms of the PF cortex, in conjunction with the fast-learning mechanisms of the hippocampus and striatum [80], could facilitate the search for regularities among simple representations in the process of building an abstract representation of the task structure (see [81] in this issue).”
BackgroundYamagata, T., Nakayama, Y., Tanji, J., & Hoshi, E. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00452.2009 · Cited by 38
Ikeda, H., Saigusa, T., Kamei, J., Koshikawa, N., & Cools, A. R. (2013) · Neuroscience · doi:10.1016/j.neuroscience.2013.03.023 · Cited by 36
Substantia Nigra Activity Level Predicts Trial-to-Trial Adjustments in Cognitive Control
Boehler, C. N., Bunzeck, N., Krebs, R. M., Noesselt, T., Schoenfeld, M. A., Heinze, H., Münte, T. F., Woldorff, M. G., & Hopf, J. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21473 · Cited by 36
“In particular, dopaminergic projections from the midbrain (i.e., from the substantia nigra [SN] and the ventral tegmental area) have been proposed to play a pivotal role in modulating the activity in these areas for cognitive control purposes.”
BackgroundCui, Y., Siaume‐Perez, S., & Venance, L. (2018) · Frontiers in Cellular Neuroscience · doi:10.3389/fncel.2018.00182 · Cited by 38
Behavioral and Neurophysiological Analyses of Dynamic Learning Processes
SUZUKI, W. A., & Brown, E. N. (2005) · Behavioral and Cognitive Neuroscience Reviews · doi:10.1177/1534582305280030 · Cited by 32
“Recently, Pasupathy and Miller (2005) compared the time course of learning-related neural activity in the prefrontal cortex to that in the striatum on the same conditional motor learning task used by Asaad et al. (1998).”
BackgroundMethodInfluentialRecognition memory is modulated by visual similarity
Yago, E., & Ishai, A. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.12.014 · Cited by 40
“A recent report has shown that during associative learning in monkeys , rapid learning - related responses in the caudate precedes slower responses in the PFC , further suggesting that output from the basal ganglia also modulates PFC activation during learning ( Pasupathy and Miller , 2005 ) .”
BackgroundThe Evo–Eco Approach to Behaviour Change
Aunger, R. V., & Curtis, V. A. (2014) · Springer eBooks · doi:10.1007/978-1-4939-0280-4_12 · Cited by 40
“Over time, in stable environments, repeated behaviour leads to reduced errors, until these are eliminated, at which point the brain releases control to reactive level production (i.e. the response becomes habitual; Pasupathy and Miller 2005).”
BackgroundDistinct dynamics of ramping activity in the frontal cortex and caudate nucleus in monkeys
Ding, L. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00395.2015 · Cited by 31
Properties of Neurons in External Globus Pallidus Can Support Optimal Action Selection
Bogacz, R., Moraud, E. M., Abdi, A., Magill, P. J., & Baufreton, J. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005004 · Cited by 36
“However, experimental data [43] suggest that while acquiring a task the stimulus-response mapping is initially learnt in striatum, and many computational models of this learning process have been proposed [4,44].”
BackgroundMiller, E. K., & Buschman, T. J. (2007) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195314274.003.0022 · Cited by 37
“Fast plasticity, such as the nearly bistable changes that Pasupathy and Miller (2005 ) observed in the striatum, would seem ideal for learning the reinforcement-related snapshots that capture the immediate circumstances and identify which alternative is preferable for a particular state.”
BackgroundResultSelf-citationLearning Complex Cell Invariance from Natural Videos: A Plausibility Proof
Masquelier, T., Serre, T., Thorpe, S. J., & Poggio, T. (2007) · Defense Technical Information Center (DTIC) · doi:10.21236/ada477541 · Cited by 38
“, both in higher areas like PFC (Rainer and Miller, 2000; Freedman et al., 2003; Pasupathy and Miller, 2005) and IT (see for instance (Logothetis et al.”
BackgroundInfluentialDissociable behavioural outcomes of visual statistical learning
Bays, B. C., Turk‐Browne, N. B., & Seitz, A. R. (2015) · Visual Cognition · doi:10.1080/13506285.2016.1139647 · Cited by 37
“The left inferior frontal cortex also supports statistical learning (Karuza et al., 2013; Turk-Browne et al., 2009), and it has been suggested that learning in frontal cortex differs from the striatum in terms of the speed of learning (Pasupathy & Miller, 2005).”
BackgroundDissociating language and word meaning in the bilingual brain
Chee, M. W. L. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.09.009 · Cited by 40
Sleezer, B. J., & Hayden, B. Y. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01011 · Cited by 32
“Consistent with previous work, we find that associative learning signals are present in both the VS and DS (Pasupathy & Miller, 2005; Setlow, Schoenbaum, & Gallagher, 2003).”
Grossberg, S. (2018) · Brain and Neuroscience Advances · doi:10.1177/2398212818772179 · Cited by 37
Reward Inference by Primate Prefrontal and Striatal Neurons
Pan, X., Fan, H., Sawa, K., Tsuda, I., Tsukada, M., & Sakagami, M. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.2263-13.2014 · Cited by 34
“Therefore, the signal from the striatum is suggested to engender learning in the PFC (Pasupathy and Miller, 2005).”
BackgroundHadj‐Bouziane, F., Bénatru, I., Brovelli, A., Klinger, H., Thobois, S., Broussolle, E., Boussaoud, D., & Meunier, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00351 · Cited by 36
“…et al., 2009; Kimchi et al., 2009; electrophysiology in monkeys: Tremblay et al., 1998; Hadj-Bouziane and Boussaoud, 2003; Brasted and Wise, 2004; Pasupathy and Miller, 2005; Buch et al., 2006; Williams and Eskandar, 2006; Histed et al., 2009; neuropsychology in humans and monkeys: Petrides,…”
BackgroundMethodStocco, A. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00018 · Cited by 33
“…some researchers believe that skills are permanently encoded in the basal ganglia (Anderson, 2007), while others believe that they are encoded in the basal ganglia initially, but eventually re-encoded in the form of corticocortical pathways (Pasupathy and Miller, 2005; Stocco et al., 2010).”
BackgroundStress Transiently Affects Pavlovian-to-Instrumental Transfer
Morgado, P. F., Silva, M., Sousa, N., & Cerqueira, J. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00093 · Cited by 42
“In addition, these regions are known to regulate the activity of cortical sites integrating affective stimuli with executive commands, such as the mPFC and the OFC (Christakou et al., 2004; Kelley, 2004; Pasupathy and Miller, 2005; Saddoris et al., 2005; Stalnaker et al., 2007).”
BackgroundFagotti, J., Targa, A., Rodrigues, L. S., Noseda, A. C. D., Dorieux, F. W. C., Scarante, F. F., Ilkiw, J. L., Louzada, F. M., Chowdhury, N. R., van der Veen, D. R., et al. (2019) · Scientific Reports · doi:10.1038/s41598-018-37657-6 · Cited by 31
Sendhilnathan, N., Ipata, A. E., & Goldberg, M. E. (2021) · Nature Communications · doi:10.1038/s41467-021-26338-0 · Cited by 31
Monetary reward speeds up voluntary saccades
Chen, L. L., Chen, Y., Zhou, W., & Mustain, W. D. (2014) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2014.00048 · Cited by 31
“…visual-oculomotor association neurons of the frontal lobes, which were intimately inter-connected within the cortico-basal ganglia loops (Chen and Wise, 1995a,b, 1996, 1997; Wise et al., 1996; Amador et al., 2000, 2004; Pasupathy and Miller, 2005; Ding and Hikosaka, 2006; Chen and Tehovnik, 2007).”
BackgroundRule-based categorization deficits in focal basal ganglia lesion and Parkinson's disease patients
Ell, S. W., Weinstein, A. M., & Ivry, R. B. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.06.006 · Cited by 36
“…previous work (Ell et al., 2006) and related findings of a pronounced early-training dependence on the BG in rule-based tasks (e.g., Knowlton, Mangels, & Squire, 1996; Pasupathy & Miller, 2005), we conducted a planned comparison of the focal BG patients and controls during the first training block.”
Eye Movements in Neuropsychological Tasks
Hodgson, T. L., Ezard, G., & Hermens, F. (2019) · Current topics in behavioral neurosciences · doi:10.1007/7854_2019_98 · Cited by 35
Neural representation of newly instructed rule identities during early implementation trials
Ruge, H., Schäfer, T. A. J., Zwosta, K., Mohr, H., & Wolfensteller, U. (2019) · eLife · doi:10.7554/elife.48293 · Cited by 31
Sensitivity to value-driven attention is predicted by how we learn from value
Jahfari, S., & Theeuwes, J. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1106-6 · Cited by 28
“The effects found with high-value rewards could rely on higher dopamine levels within the striatum, a region not restricted by memory decay or capacity and central to the formation of Bhabit memory^ (Knowlton, Mangels, & Squire, 1996; Pasupathy & Miller, 2005).”
BackgroundMethodTimescales of learning in prefrontal cortex
Miller, J. A., & Constantinidis, C. (2024) · Nature reviews. Neuroscience · doi:10.1038/s41583-024-00836-8 · Cited by 35
“Rule reversal learning, for example, is facilitated by cortico-striatal interactions 103 , and WM and reinforcement learning show a push–pull influence on each other in both PFC and striatal reward prediction error signals 76 .”
Masuda, N., & Amari, S. (2007) · Journal of Computational Neuroscience · doi:10.1007/s10827-007-0045-7 · Cited by 34
“In the saccadic task, memory of rewarded association tasks is first stored in the basal ganglia, and its signal is used as an effective teacher for slower learning sites in the frontal cortex (Pasupathy and Miller 2005).”
BackgroundNeurocognitive Correlates of Emotional Stimulus Processing in Pediatric Bipolar Disorder: A Review
Rosen, H. R., & Rich, B. A. (2010) · Postgraduate Medicine · doi:10.3810/pgm.2010.07.2177 · Cited by 34
Pomirleanu, N., Gustafson, B. M., & Bi, S. (2020) · Psychology and Marketing · doi:10.1002/mar.21363 · Cited by 30
Modulation of cue-guided choices by transcranial direct current stimulation
Garofalo, S., Battaglia, S., Starita, F., & di Pellegrino, G. (2021) · Cortex · doi:10.1016/j.cortex.2021.01.004 · Cited by 28
Effects of frontal cortex lesions on action sequence learning in the rat
Bailey, K. R., & Mair, R. G. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05492.x · Cited by 33
“Neural recordings have revealed temporally correlated changes in cortical and striatal activity during visuomotor learning although the precise contributions of these areas remain to be established (Brasted & Wise, 2004; Fujii & Graybiel, 2005; Laubach, 2005; Pasupathy & Miller, 2005).”
BackgroundEnhanced metabolic capacity of the frontal cerebral cortex after Pavlovian conditioning
Bruchey, A. K., & Gonzalez-Lima, F. (2007) · Neuroscience · doi:10.1016/j.neuroscience.2007.08.036 · Cited by 33
The role of the orbitofrontal cortex in human discrimination learning
Chase, H. W., Clark, L., Myers, C. E., Gluck, M. A., Sahakian, B. J., Bullmore, E. T., & Robbins, T. W. (2007) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2007.12.011 · Cited by 29
Two sides of the same coin: Learning via positive and negative reinforcers in the human striatum
Niznikiewicz, M. A., & Delgado, M. R. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.07.006 · Cited by 28
“Further, striatum signals are ound to be important particularly during the acquisition f reward contingencies, showing a decrement as assoiations become fully predictable (Delgado et al., 2005; aruno et al., 2004; Pasupathy and Miller, 2005).”
Hargreaves, E. L., Mattfeld, A. T., Stark, C. E. L., & SUZUKI, W. A. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.029 · Cited by 31
“Previous studies in monkeys have shown associative learning signals in the anterior caudate and putamen using tasks very similar to the one used here (Pasupathy and Miller, 2005; Williams and Eskandar, 2006).”
BackgroundMethodCognitive flexibility and decision‐making in a model of conditional visuomotor associations
Loh, M., & Deco, G. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04505.x · Cited by 27
“…supplementary eye field (Chen & Wise, 1995a,b), prefrontal areas (Asaad et al ., 1998, 2000; Pasupathy & Miller, 2005), the hippocampus (Cahusac et al ., 1993; Wirth et al ., 2003) and the basal ganglia (Tremblay et al ., 1998; Inase et al ., 2001; Brasted & Wise, 2004; Pasupathy & Miller, 2005).”
BackgroundInfluentialNakayama, Y., Yamagata, T., & Hoshi, E. (2016) · European Journal of Neuroscience · doi:10.1111/ejn.13254 · Cited by 30
“These areas may receive goal signals from the basal ganglia, which is crucially involved in conditional visuomotor behaviour (Toni & Passingham, 1999; Pasupathy & Miller, 2005).”
BackgroundAnatomy and connectivity of the reward circuit
Haber, S. N. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374620-7.00001-7 · Cited by 35
Assembling Old Tricks for New Tasks: A Neural Model of Instructional Learning and Control
Huang, T.-R., Hazy, T. E., Herd, S. A., & O’Reilly, R. C. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00365 · Cited by 30
“…overall architecture is consistent with findings about hippocampal and striatal contributions to initial learning and that neocortical learning is gradually shaped by experience (Pasupathy & Miller, 2005; for reviews, see Ashby, Turner, & Horvitz, 2010; McClelland, McNaughton, & O ʼ Reilly, 1995).”
ResultFast spiking interneuron activity in primate striatum tracks learning of attention cues
Boroujeni, K. B., Oemisch, M., Hassani, S. A., & Womelsdorf, T. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2001348117 · Cited by 32
Experience‐related enhancements in striatal temporal encoding
Bruce, R. A., Weber, M. A., Volkman, R. A., Oya, M., Emmons, E. B., Kim, Y.-C., & Narayanan, N. S. (2021) · European Journal of Neuroscience · doi:10.1111/ejn.15344 · Cited by 27
“…UL1TR002537; University of Iowa ICTS Edited by: Serge Schiffmann 5063 | BRUCE Et al. activity adapts with learning of specific contexts and tasks, and disrupting dorsal striatal activity can impair previously learned associations (Pasupathy & Miller, 2005; Yin & Knowlton, 2006; Yin et al., 2005).”
BackgroundRapid Association Learning in the Primate Prefrontal Cortex in the Absence of Behavioral Reversals
Cromer, J. A., Machon, M., & Miller, E. K. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21555 · Cited by 26
“Our laboratory has used conditional association learning paradigms to examine PFC neural activity while arbitrary rules were being acquired (Pasupathy & Miller, 2005; Asaad, Rainer, & Miller, 1998).”
InfluentialSelf-citationIto, M., & Doya, K. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004540 · Cited by 34
Involvement of primate orbitofrontal neurons in reward, uncertainty, and learning
Schultz, W., & Tremblay, L. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198565741.003.0007 · Cited by 28
Integrating associative learning signals across the brain
SUZUKI, W. A. (2007) · Hippocampus · doi:10.1002/hipo.20321 · Cited by 32
Monoaminergic Modulation of Cortical Excitability
Tseng, K.-Y., & Atzori, M. (2007) · Springer eBooks · doi:10.1007/978-0-387-72256-6 · Cited by 25
Extrasynaptic glutamate NMDA receptors: Key players in striatal function
Garcia-Munoz, M., López-Huerta, V. G., Carrillo‐Reid, L., & Arbuthnott, G. W. (2014) · Neuropharmacology · doi:10.1016/j.neuropharm.2014.09.013 · Cited by 31
“In animals trained to perform a task, striatal and cortical activity manifest an impressive temporal relationship (Brasted andWise, 2004; Shi et al., 2004; Graybiel, 2005; Pasupathy and Miller, 2005; Wagenaar et al., 2005; Koralek et al., 2013).”
Ruge, H., & Wolfensteller, U. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.10.005 · Cited by 27
“…Ghahremani et al., 2010) and single cell recording studies suggest the possibility that other regions like the dorsolateral prefrontal cortex might exhibit differences in the precise learning dynamics between initial learning and reversal learning (Cromer et al., 2011; Pasupathy and Miller, 2005).”
Rule encoding in dorsal striatum impacts action selection
Bissonette, G. B., & Roesch, M. R. (2015) · European Journal of Neuroscience · doi:10.1111/ejn.13042 · Cited by 28
“It is already known that mDS encodes the direction of impending movements and the associations between response and outcomes (Ragozzino et al., 2002; Pasupathy & Miller, 2005; Balleine et al., 2007, 2009; Kimchi & Laubach, 2009; Balleine & O’Doherty, 2010; van der Meer et al., 2010; Hilario et al.,…”
BackgroundStriatal direct pathway modulates response time in execution of visual discrimination
Fukabori, R., Okada, K., Nishizawa, K., Kai, N., Kobayashi, K., Uchigashima, M., Watanabe, M., Tsutsui, Y., & Kobayashi, K. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08005.x · Cited by 25
“Neuronal activity in the dorsal striatum undergoes plastic changes during behavioral acquisition (Tremblay et al., 1998; Jog et al., 1999; Kawagoe et al., 2004; Pasupathy & Miller, 2005).”
BackgroundVillagrasa, F., Baladron, J., Vitay, J., Schroll, H., Antzoulatos, E. G., Miller, E. K., & Hamker, F. H. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.0874-18.2018 · Cited by 30
“Some studies have suggested that the BG may train the PFC to slowly learn categories (Pasupathy and Miller, 2005; Miller and Buschman, 2007; Seger and Miller, 2010; Antzoulatos and Miller, 2011; Hélie et al., 2015).”
BackgroundSelf-citationZareian, B., Lam, A., & Zagha, E. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.1506-22.2023 · Cited by 29
Ruiz, M. H., Huebl, J., Schönecker, T., Kupsch, A. R., Yarrow, K., Krauss, J. K., Schneider, G., & Kühn, A. A. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht002 · Cited by 29
Motor thalamus supports striatum-driven reinforcement
Lalive, A. L., Lien, A. D., Roseberry, T. K., Donahue, C. H., & Kreitzer, A. C. (2018) · eLife · doi:10.7554/elife.34032 · Cited by 27
“Additionally, dMSN activation, through inhibition of SNc-projecting SNr neurons (Mailly et al., 2001; Brazhnik et al., 2008), may disinhibit SNc dopamine neurons and thus increase DA release, which is sufficient for reinforcement (Phillips et al., 1976; Gratton et al., 1988; Ilango et al., 2014).”
BackgroundCovert spatial selection in primate basal ganglia
Arcizet, F., & Krauzlis, R. J. (2018) · PLoS Biology · doi:10.1371/journal.pbio.2005930 · Cited by 30
Modeling awake hippocampal reactivations with model-based bidirectional search
Khamassi, M., & Girard, B. (2020) · Biological Cybernetics · doi:10.1007/s00422-020-00817-x · Cited by 24
“…cortex is known for its role in decision making and cognitive control (Miller and Cohen 2001) and is thus a good candidate to store in long-termmemory the behavioral policy learned by an animal through reinforcement learning (Pasupathy and Miller 2005; Frank and Claus 2006; Khamassi et al. 2015).”
BackgroundConceptual representations in goal-directed decision making
Shea, N. J., Krug, K., & Tobler, P. N. (2008) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.8.4.418 · Cited by 29
“Converging evidence is found in electrophysiological recordings (Jog, Kubota, Connolly, Hillegaart, & Graybiel, 1999; Pasupathy & Miller, 2005) and lesion studies (Balleine & Dickinson, 1998a; Coutureau & Killcross, 2003; Killcross & Coutureau, 2003; Ramirez & Savage, 2007; Yin, Knowlton, &…”
Moustafa, A. A., & Maida, A. S. (2007) · Cognitive Systems Research · doi:10.1016/j.cogsys.2007.02.001 · Cited by 24
“We also tested whether the model accounts for delayed-reversal task performance (Pasupathy and Miller, 2005).”
Method5.3 Dopamine’s Influence on Prefrontal Cortical Cognition: Actions and Circuits in Behaving Primates
Arnsten, A. F. T., Vijayraghavan, S., Wang, M., Gamo, N. J., & Paspalas, C. D. (2009) · Dopamine Handbook · doi:10.1093/acprof:oso/9780195373035.003.0016 · Cited by 23
Cortico-spinal modularity in the parieto-frontal system: A new perspective on action control
Bufacchi, R. J., Battaglia-Mayer, A., Iannetti, G. D., & Caminiti, R. (2023) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2023.102537 · Cited by 22
“In this interplay, the striatum forms early arbitrary associations, prefrontal neural circuits monitor the evolution of training, and the hippocampus is responsible for long-term memory storage and recall of new associations (Pasupathy and Miller, 2005).”
Ceccarelli, F., Ferrucci, L., Londei, F., Ramawat, S., Brunamonti, E., & Genovesio, A. (2023) · Nature Communications · doi:10.1038/s41467-023-43712-2 · Cited by 28
“Such a function may be generated both locally and at the network level of communication between PF with the caudate nucleus, putamen via corticostriatal loops 98,99 , and hippocampus 100 , which exhibited to engage bidirectional communication during associative learning.”
The Prefrontal Cortex and Executive Brain Functions
Miller, E. K., & Wallis, J. D. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-385870-2.00050-0 · Cited by 23
Self-citationSolving the Credit Assignment Problem With the Prefrontal Cortex
Stolyarova, A. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00182 · Cited by 30
“(A) An example of a distal reward task that can be successfully learned with eligibility traces and TD rules, where intermediate choices can acquire motivational significance and subsequently reinforce preceding decisions (ex., Pasupathy and Miller, 2005; Histed et al., 2009).”
BackgroundThe impact of early musical training on striatal functional connectivity
van Vugt, F. T., Hartmann, K., ALTENMÜLLER, E. O., Mohammadi, B., & Margulies, D. S. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118251 · Cited by 31
Functional Anatomy and Physiology of the Basal Ganglia: Non-motor Functions
Haber, S. N. (2008) · Humana Press eBooks · doi:10.1007/978-1-59745-360-8_2 · Cited by 25
Investigation of sequence processing: A cognitive and computational neuroscience perspectivePreprint
Bapi, R. S., Pammi, V. S. C., Miyapuram, K. P., & Ahmed, A. (2005) · CogPrints (University of Southampton) · Cited by 22
Neural Activity in the Macaque Putamen Associated with Saccades and Behavioral Outcome
Phillips, J. M., & Everling, S. (2012) · PLoS ONE · doi:10.1371/journal.pone.0051596 · Cited by 25
“[26,36,41] and also the lack of preparatory saccade-related”
BackgroundSallet, J., Mars, R. B., Quilodran, R., Procyk, E., Petrides, M., & Rushworth, M. F. S. (2011) · The MIT Press eBooks · doi:10.7551/mitpress/8791.003.0003 · Cited by 46
Performance-Dependent Consolidation of Learned Vocal Changes in Adult Songbirds
Tachibana, R. O., Lee, D., Kai, K., & Kojima, S. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1942-21.2021 · Cited by 24
Metadata
- Authors
- Pasupathy, A., & Miller, E. K.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Pasupathy, Anitha
- Venue
- Nature
- Published
- 2005-02
- Volume
- 433
- Issue
- 7028
- Pages
- 873-876
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2068949971
- Cited by
- 712
- References
- 33
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 20 · 2023: 17 · 2022: 12 · 2021: 25 · 2020: 22 · 2019: 26 · 2018: 32 · 2017: 23 · 2016: 40 · 2015: 39 · 2014: 42 · 2013: 37 · 2012: 37
- FWCI
- 28.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- associative learning, prefrontal cortex, striatum, basal ganglia, time course of learning, monkeys, rule induction, neural correlates of learning
- MeSH terms
- Animals, Haplorhini, Cues, Fixation, Ocular, Learning, Models, Biological, Reward, Saccades, Time Factors, Neostriatum, Prefrontal Cortex
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.