Different time courses of learning-related activity in the prefrontal cortex and striatum.
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To navigate our complex world, our brains have evolved a sophisticated ability to quickly learn arbitrary rules such as 'stop at red'. Studies in monkeys using a laboratory test of this capacity--conditional association learning--have revealed that frontal lobe structures (including the prefrontal cortex) as well as subcortical nuclei of the basal ganglia are involved in such learning. Neural correlates of associative learning have been observed in both brain regions, but whether or not these regions have unique functions is unclear, as they have typically been studied separately using different tasks. Here we show that during associative learning in monkeys, neural activity in these areas changes at different rates: the striatum (an input structure of the basal ganglia) showed rapid, almost bistable, changes compared with a slower trend in the prefrontal cortex that was more in accordance with slow improvements in behavioural performance. Also, pre-saccadic activity began progressively earlier in the striatum but not in the prefrontal cortex as learning took place. These results support the hypothesis that rewarded associations are first identified by the basal ganglia, the output of which 'trains' slower learning mechanisms in the frontal cortex.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Interactions between the dorsal striatum and prefrontal cortex have been shown in primates to be critical to integrating reward associations with behavioral output (Pasupathy & Miller, 2005), a finding paralleled by adult human imaging literature (Galvan, et al., 2005; Poldrack, Prabhakaran, Seger, & Gabrieli, 1999).”
From Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents (2011) · cites this paper as Pasupathy & Miller, 2005
In the citing paper
“For example, using single-unit recordings in monkeys, Pasupathy & Miller (Pasupathy and Miller, 2005) showed that when flexibly learning a set of reward contingencies, very early activity in the striatum provides the foundation for reward-based associations, whereas later, more deliberative prefrontal mechanisms are engaged to maintain the behavioral outputs that can optimize the greatest gains”
From Adolescence: what do transmission, transition and translation have to do with it? (2010) · cites this paper as Pasupathy and Miller, 2005
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundSelf-citationBerti, A. (1992) · Neuropsychologia · doi:10.1016/0028-3932(92)90076-x · Cited by 4,162
The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe
Fuster, J. M. (1980) · Cited by 2,407
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 1×
“Dopaminergic reward-prediction error signals from the midbrai”
Role of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements
Hikosaka, O., Takikawa, Y., & Kawagoe, R. (2000) · Physiological Reviews · doi:10.1152/physrev.2000.80.3.953 · Cited by 1,302 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundEling, P. (1993) · Acta Psychologica · doi:10.1016/0001-6918(93)90027-o · Cited by 1,184
Neural Control of Voluntary Movement Initiation
Hanes, D. P., & Schall, J. D. (1996) · Science · doi:10.1126/science.274.5286.427 · Cited by 1,145 · cited 1×
“Although pre-saccadic activity might also be linked to the improvement in choices with learning, it seems likely to reflect the decrease in reaction time; a correlation between caudate nucleus (and frontal cortex) pre-saccadic activity and reaction time has been previously demonstrate”
BackgroundThe Basal Ganglia and Chunking of Action Repertoires
Graybiel, A. M. (1998) · Neurobiology of Learning and Memory · doi:10.1006/nlme.1998.3843 · Cited by 1,042 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultThe Frontal Lobes and Voluntary Action
Passingham, R. (1993) · doi:10.1093/oso/9780198521853.001.0001 · Cited by 970
Research works printed but not linked: 1
- DeLong, M. R. & Georgopoulos, A. P. in Handbook of Physiology—Nervous System (eds Brookhart, J. M. & Mountcastle, V. B.) 1017–1061 (American Physiological Society, Bethesda, 1981)
Cited by
Items 201–300 of 701
Corticocortical Systems Underlying High-Order Motor Control
Battaglia‐Mayer, A., & Caminiti, R. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.2094-18.2019 · Cited by 80
“In the same vein, a new study (Rikhye et al., 2018a) shows that MD participates in switching PFC neural representations of cues that instruct the allocation of attention to different targets, which implies a role for the thalamus in cognitive flexibility, which is severely disturbed in schizophrenia and other mental d…”
BackgroundInfluentialTrial Outcome and Associative Learning Signals in the Monkey Hippocampus
Wirth, S., Avsar, E., Chiu, C. C., Sharma, V., Smith, A. C., Brown, E., & Suzuki, W. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.012 · Cited by 73
Endocannabinoids mediate bidirectional striatal spike‐timing‐dependent plasticity
Cui, Y., Paillé, V., Xu, H., Genet, S., Delord, B., Fino, É., Berry, H., & Venance, L. (2015) · The Journal of Physiology · doi:10.1113/jp270324 · Cited by 87
“In mammals, associative memories and behavioral rules can be learned within few (5-10) trials or even sometimes within a single trial (Pasupathy and Miller, 2005; Tse et al., 2007; Schultz et al., 2003; Quilodran et al., 2008; Ito and Doya, 2009).”
BackgroundInfluentialWhen Actions Speak Louder Than Words: Improving Children's Flexibility in a Card-Sorting Task
Brace, J. J., Morton, J. B., & Munakata, Y. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01763.x · Cited by 78
“Memory relies on multiple specialized systems (e.g., Gabrieli, 1998; Schacter & Tulving, 1994), which can interact in supportive (McClelland, McNaughton, &O’Reilly, 1995; Pasupathy & Miller, 2005) or competitive (Poldrack & Packard, 2003) ways.”
BackgroundCortico-striatal function in sentence comprehension: Insights from neurophysiology and modeling
Dominey, P. F., & Inui, T. (2009) · Cortex · doi:10.1016/j.cortex.2009.03.007 · Cited by 79
“Pasupathy and Miller (2005) have provided neurophysiological evidence that during the time course of learning arbitrary associations, the cortico-striatal system will be involved in the early identification of the relevant associations.”
Davidson, P. S. R., Anaki, D., Saint-Cyr, J. A., Chow, T. W., & Moscovitch, M. (2006) · Brain · doi:10.1093/brain/awl115 · Cited by 76
Reward Stability Determines the Contribution of Orbitofrontal Cortex to Adaptive Behavior
Riceberg, J. S., & Shapiro, M. L. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.0776-12.2012 · Cited by 71
“Without the OFC, brain structures that respond more rapidly to instantaneous contingencies may gain more influence on behavior (Pasupathy and Miller, 2005).”
BackgroundApicella, P., Deffains, M., Ravel, S., & Legallet, E. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06872.x · Cited by 66
“…in firing during the acquisition of action–outcome relations and their retention after extensive training (Jog et al., 1999; Barnes et al., 2005; Pasupathy & Miller, 2005; Brasted & Wise, 2004; Tang et al., 2007; Tremblay et al., 1998), whereas tonically active neurons (TANs), presumed to be…”
BackgroundVeit, L., Pidpruzhnykova, G., & Nieder, A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1509760112 · Cited by 76
“Such a task-relevant representation shows general parallels between the NCL and association cortices in the primate brain (14, 16, 34, 35), but also sets it apart from neuronal encoding in the PFC, where familiar, “ overlearned ” stimuli typically evoke only weak activity (14, 36; but see ref.”
Piron, C., Kase, D., Topalidou, M., Goillandeau, M., Orignac, H., N'Guyen, T., Rougier, N., & Boraud, T. (2016) · Movement Disorders · doi:10.1002/mds.26542 · Cited by 66
“Other studies showed that the neural correlates of learning occurred earlier in the BG when compared with the cortical areas.(3) Based on these observations, it has been proposed that the CBG network is involved in the decisionmaking process by comparing the value of the different options in different dimensions (cogn…”
BackgroundResultMultiple Systems of Perceptual Category Learning
Ashby, F. G., & Valentin, V. V. (2017) · Elsevier eBooks · doi:10.1016/b978-0-08-101107-2.00007-5 · Cited by 91
Bilinearity, rules, and prefrontal cortex
Dayan, P. (2007) · Frontiers in Computational Neuroscience · doi:10.3389/neuro.10.001.2007 · Cited by 65
“, 2007) of a particular, influential conditional visuo-motor task that has been administered to monkeys (Pasupathy and Miller, 2005).”
BackgroundKubota, Y., Liu, J., Hu, D., DeCoteau, W. E., Eden, U. T., Smith, A. C., & Graybiel, A. M. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00522.2009 · Cited by 70
Aunger, R. V. (2010) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2010.01.008 · Cited by 86
“Of course, once skills have been acquired through some long-term learning process, execution of particular productions can become routinized and stereotyped through habit formation (i.e., it becomes procedural) [83].”
Hebbian Learning in a Random Network Captures Selectivity Properties of the Prefrontal Cortex
Lindsay, G. W., Rigotti, M., Warden, M. R., Miller, E. K., & Fusi, S. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.1222-17.2017 · Cited by 70
“This work shows that mixed selectivity increases with learning, and these changes in the PFC may correspond to increases in performance (Pasupathy and Miller, 2005), as learning in our model leads to increases in performance on classification tasks.”
ResultSelf-citationStriatal degeneration impairs language learning: evidence from Huntington's disease
De Diego-Balaguer, R., Couette, M., Dolbeau, G., Durr, A., Youssov, K., & Bachoud-Levi, A.-C. (2008) · Brain · doi:10.1093/brain/awn242 · Cited by 67
“…have shown that the acquisition of simple associations induce an early rapid response from the striatum followed by gradual implication of the dorsolateral prefrontal cortex (Pasupathy and Miller, 2005) leading to frontal engagement for the application of automatized rules (Wallis et al., 2001).”
BackgroundQin, S., Piekema, C., Petersson, K. M., Han, B., Luo, J., & Fernández, G. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.020 · Cited by 66
“Several lines of evidence also have suggested that the dorsolateral prefrontal cortex interacts closely with the basal ganglia when complex information has to be maintained in working memory (Levy et al., 1997; Ashby et al., 2005; Pasupathy and Miller, 2005; Chudasama and Robbins, 2006; O’Reilly and Frank, 2006).”
Backgroundvan Duuren, E., Escámez, F. A. N., Joosten, R. N. J. M. A., Visser, R., Mulder, A. B., & Pennartz, C. M. A. (2007) · Learning & Memory · doi:10.1101/lm.546207 · Cited by 64
“Recording depth ranged from ∼3 mm to 5.5 mm below cortical surface (Paxinos and Watson 1996).”
BackgroundMethodInfluentialDominey, P. F., Inui, T., & Hoen, M. (2009) · Brain and Language · doi:10.1016/j.bandl.2008.08.002 · Cited by 64
Hearne, L. J., Cocchi, L., Zalesky, A., & Mattingley, J. B. (2015) · Human Brain Mapping · doi:10.1002/hbm.22802 · Cited by 72
“Likewise, striatal activity appears important for rapidly linking acquired representations with specific actions [Bunge et al., 2005; Pasupathy and Miller, 2005].”
BackgroundPolicy Adjustment in a Dynamic Economic Game
Li, J., McClure, S. M., King-Casas, B., & Read Montague, P. (2006) · PLoS ONE · doi:10.1371/journal.pone.0000103 · Cited by 63
“Interestingly, a recent paper by Pasupathy and Miller [ 42 ] showed that in a conditional visual-motor learning task, rapid changes of striatum activity as well as a slower trend changes in the prefrontal cortex have been observed.”
BackgroundVolitional Modulation of Primary Visual Cortex Activity Requires the Basal Ganglia
Neely, R., Koralek, A. C., Athalye, V. R., Costa, R. M., & Carmena, J. M. (2018) · Neuron · doi:10.1016/j.neuron.2018.01.051 · Cited by 70
Anatomy and Connectivity of the Reward Circuit
Haber, S. N. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805308-9.00001-4 · Cited by 74
Seo, R., Stocco, A., & Prat, C. S. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.02.010 · Cited by 69
“Importantly for cognitive control, the BG are rich in dopamine, and thus have been associated with cognitive flexibility more so than the DLPFC (Pasupathy and Miller, 2005).”
BackgroundRapid Learning of Odor–Value Association in the Olfactory Striatum
Millman, D. J., & Murthy, V. N. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.2604-19.2020 · Cited by 71
“In contrast, neurons in the prefrontal cortex took much longer to acquire 620 reward selectivity (Pasupathy and Miller, 2005).”
BackgroundInfluentialMaking New Memories: The Role of the Hippocampus in New Associative Learning
SUZUKI, W. A. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1379.007 · Cited by 71
Eisinger, R. S., Urdaneta, M. E., Foote, K. D., Okun, M. S., & Gunduz, A. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00385 · Cited by 64
“When monkeys learn to pair a saccade direction with reward-receipt, a study of 432 prefrontal cortex (PFC) and 279 caudate nucleus neurons showed that caudate nucleus activity coded for rewardassociated saccade direction sooner than the PFC (Pasupathy and Miller, 2005).”
Social performance reveals unexpected vocal competency in young songbirds
Kojima, S., & Doupe, A. J. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1010502108 · Cited by 71
“As has been suggested in homologous mammalian circuits (29), the output of the basal ganglia circuit may gradually “train” slower learning mechanisms in the motor pathway through numerous productions of Undir.”
BackgroundEnhanced Modulation of Neuronal Activity during Antisaccades in the Primate Globus Pallidus
Yoshida, A., & Tanaka, M. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn069 · Cited by 62
Boraud, T., Leblois, A., & Rougier, N. P. (2018) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2018.08.003 · Cited by 64
“Convergent experimental findings and theoretical investigations support this idea that the “engram” of automatized skills shifts to regions outside the basal ganglia after sufficient training, including the neocortex (Graybiel, 1998; Houk and Wise, 1995; O’Reilly and Frank, 2006; Pasupathy and Miller, 2005).”
BackgroundDesrochers, T. M., Amemori, K.-I., & Graybiel, A. M. (2015) · Neuron · doi:10.1016/j.neuron.2015.07.019 · Cited by 54
“…have examined the short-term acquisition of new stimulus-response associations (Asaad and Eskandar, 2011; Histed et al., 2009; Kawagoe et al., 1998; Pasupathy and Miller, 2005; Samejima et al., 2005; Watanabe and Hikosaka, 2005; Williams and Eskandar, 2006), but none have examined the composition…”
Grossberg, S., & Kazerounian, S. (2011) · The Journal of the Acoustical Society of America · doi:10.1121/1.3589258 · Cited by 55
Contributions of dorsal striatal subregions to spatial alternation behavior
Moussa, R., Poucet, B., Amalric, M., & Sargolini, F. (2011) · Learning & Memory · doi:10.1101/lm.2123811 · Cited by 56
“Further, rapid changes in firing patterns of DMS neurons have been shown during the initial acquisition of cue-response associations (Pasupathy and Miller 2005) and after a switch in stimulus-reward contingencies (Kimchi and Laubach 2009).”
BackgroundA Meta-Analysis Suggests Different Neural Correlates for Implicit and Explicit Learning
Loonis, R. F., Brincat, S. L., Antzoulatos, E. G., & Miller, E. K. (2017) · Neuron · doi:10.1016/j.neuron.2017.09.032 · Cited by 66
“…improves and their activity becomes a better predictor of task events (Antzoulatos and Miller, 2011; Asaad and Miller, 1998; Brincat and Miller, 2015; Chen and Wise, 1995; Sakai and Miyashita, 1991; Pasupathy and Miller, 2005; Williams and Eskandar, 2006; Wirth et al., 2003; Wirth et al., 2009).”
Self-citationPsychological characteristics in musician׳s dystonia: A new diagnostic classification
Ioannou, C. I., & ALTENMÜLLER, E. O. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.05.014 · Cited by 60
“Research during the last two decades has revealed that basal ganglia circuits are not only involved in motor control functions but are also associated with the learning of complex new behaviours (Graybiel, 2005; Pasupathy & Miller, 2005).”
Kumar, V. J., Grissom, N. M., McKee, S. E., Schoch, H., Bowman, N., Havekes, R., Kumar, M., Pickup, S., Poptani, H., Reyes, T. M., et al. (2018) · Translational Psychiatry · doi:10.1038/s41398-018-0157-z · Cited by 54
Tracking the Temporal Evolution of a Perceptual Judgment Using a Compelled-Response Task
Shankar, S., Massoglia, D. P., Zhu, D., Costello, M. G., Stanford, T. R., & Salinas, E. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1419-11.2011 · Cited by 65
“…the precision with which such correlates may be temporally localized provides a unique opportunity to assess the relative position of structures (Pasupathy and Miller, 2005) like the superior colliculus, the frontal eye fields, and others within a functional hierarchy of visuomotor control.”
BackgroundChildhood cognitive development as a skill
Klingberg, T. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.06.007 · Cited by 62
Watanabe, K., & Hikosaka, O. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00012.2005 · Cited by 56
Role of medial cortical, hippocampal and striatal interactions during cognitive set-shifting
Graham, S., Phua, E., Soon, C. S., Oh, T. M., Au, C., Shuter, B., Wang, S.-C., & Yeh, I. B. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.040 · Cited by 59
“In primates, caudate activity reflected anticipation of the correct discrimination choice more rapidly than neural activity in the prefrontal cortex (Pasupathy and Miller, 2005).”
BackgroundDistributed Representations of Rule Identity and Rule Order in Human Frontal Cortex and Striatum
Reverberi, C., Görgen, K., & Haynes, J. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.2344-12.2012 · Cited by 54
“The dorsal striatum and its target areas in the frontal cortex are known to be involved in sequence learning and arbitrary rule learning (e.g., Toni et al., 2001; Boettiger and D’Esposito, 2005; Pasupathy and Miller, 2005; Averbeck et al., 2006; Mushiake et al., 2006; Brovelli et al., 2008; Graybiel, 2008; Jin et al.,…”
BackgroundCorticostriatal Flow of Action Selection Bias
Hwang, E. J., Link, T. D., Hu, Y. Y., Lu, S., Wang, E. H.-J., Lilascharoen, V., Aronson, S., O’Neil, K., Lim, B. K., & Komiyama, T. (2019) · Neuron · doi:10.1016/j.neuron.2019.09.028 · Cited by 58
“We selected these two areas as plausible downstream targets to which PPC may send bias information, because they have been implicated in action selection and preparation (Lauwereyns et al., 2002; Pasupathy and Miller, 2005; Samejima et al., 2005; Sul et al., 2011; Znamenskiy and Zador, 2013; Barthas and Kwan, 2017).”
BackgroundDimensionality, information and learning in prefrontal cortex
Bartolo, R., Saunders, R. C., Mitz, A. R., & Averbeck, B. B. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007514 · Cited by 60
“Previous work has shown that single neurons in dlPFC represent important aspects of learning and choice behavior [13, 15, 19-22].”
BackgroundThe “working” of working memory
Miller, E. K. (2013) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2013.15.4/emiller · Cited by 64
“This may explain our observation that during operant learning, learning-related changes in the striatum appear sooner and faster than those in the PFC.(26) Thus, the trade-off between the advantages of slow plasticity versus fast plasticity may play out in interactions between the PFC and BG.”
BackgroundInfluentialSelf-citationDecoding the Formation of Reward Predictions across Learning
Kahnt, T., Heinzle, J., Park, S. Q., & Haynes, J.-D. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3412-11.2011 · Cited by 52
“Similar dissociations of learning in striatal and prefrontal areas have been revealed in animal recording studies, where striatal processes have been shown to precede prefrontal representations (Pasupathy and Miller, 2005).”
ResultError detection in the stop signal task
Chevrier, A., & Schachar, R. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.056 · Cited by 57
Neural correlates of auditory recognition memory in primate lateral prefrontal cortex
Plakke, B., Ng, C.-W., & Poremba, A. (2013) · Neuroscience · doi:10.1016/j.neuroscience.2013.04.002 · Cited by 54
“…1982; Goldman-Rakic, 1987; Owen et al., 1990, 1995; Courtney et al., 1996; Miller et al., 1996; Cohen et al., 1997; Rao et al., 1997; White and Wise, 1999; Wallis et al., 2001; Pasupathy and Miller, 2005; D’Esposito et al., 2000, 2006; Barcelo and Knight, 2007; Warden and Miller, 2007).”
Unconscious reinforcement learning of hidden brain states supported by confidence
Cortese, A., Lau, H. C., & Kawato, M. (2020) · Nature Communications · doi:10.1038/s41467-020-17828-8 · Cited by 61
Response selection versus feedback analysis in conditional visuo-motor learning
Amiez, C., Hadj‐Bouziane, F., & Petrides, M. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.058 · Cited by 56
“, 2001a,b, 1999), but it is in agreement with electrophysiological studies in monkeys showing learning-related changes in activity within PMd (Brasted and Wise, 2004; Mitz et al., 1991; Pasupathy and Miller, 2005).”
ResultBehavioral regulation in methamphetamine abusers: An fMRI study
Salo, R. E., Fassbender, C., Buonocore, M. H., & Ursu, S. (2012) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2012.10.003 · Cited by 53
“Give the physiological interaction between medial and lateral frontal cortices and striatum in mediating cognitive control, we wanted to examine the specificity of brain-behaviorrelationships within the PFC (Frank et al., 2005; Pasupathy and Miller, 2005).”
BackgroundModeling Basal Ganglia for Understanding Parkinsonian Reaching Movements
Magdoom, K. N., Subramanian, D., Chakravarthy, V. S., Ravindran, B., Амари, Ш.-И., & Meenakshisundaram, N. (2010) · Neural Computation · doi:10.1162/neco_a_00073 · Cited by 55
“Studies on different time-courses of learning in basal ganglia and prefrontal areas exhibit a 37 similar sequencing (first basal ganglia and then prefrontal) in saccade related behavior in monkeys (Pasupathy & Miller 2005).”
BackgroundWolfensteller, U., & Ruge, H. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00192 · Cited by 61
“Contrary to this finding, single cell recordings from asSTR neurons in monkeys learning a two-alternative forcedchoice task by trial-and-error revealed that asSTR neurons did not change their rule-selective tuning even after 20 correctly implemented trials (Pasupathy and Miller, 2005).”
BackgroundMethodResultInfluentialSukhodolsky, D. G., Leckman, J. F., Rothenberger, A., & Scahill, L. D. (2007) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-007-1007-3 · Cited by 54
“The neural activity between the functionally related areas of the basal ganglia and the cortex during learning [16, 87 ] and performance [41 ]o f habitual behavior is a highly dynamic process, working on-line simultaneously in multiple neural ensembles, contexts and time-scales [44].”
BackgroundAlmada, R. C., Coimbra, N. C., & Brandão, M. L. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.11.001 · Cited by 52
Striatal and Medial Temporal Lobe Functional Interactions during Visuomotor Associative Learning
Mattfeld, A. T., & Stark, C. E. L. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhq144 · Cited by 54
IQ-Related fMRI Differences during Cognitive Set Shifting
Graham, S., Jiang, J., Manning, V., Nejad, A. B., Koh, Z., Salleh, S. R., Golay, X., Yeh, I. B., & McKenna, P. J. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp130 · Cited by 55
“A study of associative conditioning in which monkeys learned to discriminate between visual cues showed that caudate activity preceded activity in the prefrontal cortex, thus reflecting more rapid anticipation of the correct discrimination choice; activation in the prefrontal cortex in contrast reflected a slower lear…”
BackgroundStatistical Analysis of Parieto-Frontal Cognitive-Motor Networks
Averbeck, B. B., Battaglia-Mayer, A., Guglielmo, C., & Caminiti, R. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00519.2009 · Cited by 50
Integration of Cognitive and Motivational Information in the Primate Lateral Prefrontal Cortex
SAKAGAMI, M., & WATANABE, M. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.010 · Cited by 48
Kalmbach, B. E., Chitwood, R. A., Dembrow, N. C., & Johnston, D. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2018-13.2013 · Cited by 48
“PFC involvement in these tasks appears to involve the ability of individual pyramidal neurons to fire persistently in response to transient stimuli (Funahashi et al., 1989; Jung et al., 1998; Pasupathy and Miller, 2005).”
BackgroundFrom Real-World Events to Psychosis: The Emerging Neuropharmacology of Delusions
Morrison, P. D., & Murray, R. M. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp049 · Cited by 48
“It has been shown however, that for associative learning, modifications in the striatum occurred before those in the cortex, suggesting that the basal ganglia ‘‘inform’’ the higher cortices about new associations rather than the other way around.(11,12) Three aspects of basal ganglia–dependent learning are relevant to…”
BackgroundCatecholaminergic modulation of meta-learning
Cook, J. L., Swart, J. C., Froböse, M. I., Diaconescu, A. O., Geurts, D. E. M., den Ouden, H. E. M., & Cools, R. (2019) · eLife · doi:10.7554/elife.51439 · Cited by 59
“…mechanisms include meta-learning models which suggest a critical role for phasic dopamine in training the dynamics of a prefrontal system, which then learns about the structure of the environment (Collins and Frank, 2016; Massi et al., 2018; Pasupathy and Miller, 2005; Wang et al., 2018).”
BackgroundIgarashi, J., Shouno, O., Fukai, T., & Tsujino, H. (2011) · Neural Networks · doi:10.1016/j.neunet.2011.06.008 · Cited by 52
Chapter 19 Associative learning signals in the brain
SUZUKI, W. A. (2008) · Progress in brain research · doi:10.1016/s0079-6123(07)00019-2 · Cited by 60
Feingold, J., Desrochers, T. M., Fujii, N., Harlan, R., Tierney, P. L., Shimazu, H., Amemori, K., & Graybiel, A. M. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00625.2011 · Cited by 52
“First, neuronal activity has been recorded simultaneously from multiple brain structures (Hernandez et al. 2008; Pasupathy and Miller 2005) or from multiple sites within a single structure (Baker et al. 1999; Courtemanche et al. 2003; Gray et al. 2007) in acute preparations.”
BackgroundMethodThe effect of P arkinson's disease and H untington's disease on human visuomotor learning
Gutiérrez-Garralda, J. M., Moreno‐Briseño, P., Boll, M., Morgado‐Valle, C., Campos‐Romo, A., Díaz, R., & Fernández-Ruíz, J. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12288 · Cited by 59
“…in many different learning paradigms (Doyon et al., 1997, 2003; Toni & Passingham, 1999; Murray et al., 2000; Fernandez-Ruiz et al., 2001; Packard & Knowlton, 2002; Frank et al., 2004; Haruno et al., 2004; Shohamy et al., 2004; Pasupathy & Miller, 2005; Rosas et al., 2005; Palminteri et al., 2011).”
BackgroundGuthrie, M., Myers, C. E., & Gluck, M. A. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.036 · Cited by 55
“It has been shown that learning in the cortex is slower than in the basal ganglia [58, 66].”
BackgroundNeural Substrates for Reversing Stimulus–Outcome and Stimulus–Response Associations
Xue, G., Ghahremani, D. G., & Poldrack, R. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4001-08.2008 · Cited by 48
“The different time courses of learning in pIFC and VLPFC revealed by the present study, together with that found by Pasupathy and Miller (2005), are consistent with the idea that subregions of PFC might show different time courses of learning or reversal learning (Laubach, 2005).”
ResultChang, Y.-M., & Luebke, J. I. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00585.2007 · Cited by 49
Ruge, H., & Wolfensteller, U. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.12.003 · Cited by 50
“In this latter case, single cell recordings suggest that there is no clear-cut leading role for either region for initial learning (Cromer et al., 2011) and under reversal learning conditions there is strong evidence that the anterior striatum even leads the LPFC (Pasupathy and Miller, 2005).”
BackgroundKobayashi, S., Kawagoe, R., Takikawa, Y., Koizumi, M., Sakagami, M., & Hikosaka, O. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0622-4 · Cited by 51
Motor Skill Learning, Retention, and Control Deficits in Parkinson's Disease
Maurer, L. K., Reuter, I., & Müller, H. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021669 · Cited by 59
“Since several lines of research provided evidence of BG involvement in motor learning [1–8], a considerable number of studies has tried to answer the question whether and how strong PD patients are impaired in learning motor skills.”
BackgroundCategory-specific organization of prefrontal response-facilitation during priming
Bunzeck, N., Schütze, H., & Düzel, E. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.03.019 · Cited by 53
Reward feedback processing in children and adolescents: medial frontal theta oscillations
Crowley, M. J., van Noordt, S. J. R., Wu, J., Hommer, R. E., South, M., Fearon, R. M. P., & Mayes, L. C. (2014) · Brain and Cognition · doi:10.1016/j.bandc.2013.11.011 · Cited by 45
“…value assigned to available options (Kahneman & Tversky, 1979), with the relative value computed in a system supported by the medial prefrontal cortex (mPFC) (Frank & Claus, 2006; O'Doherty, Dayan, Friston, Critchley, & Dolan, 2003; Pagnoni, Zink, Montague, & Berns, 2002; Pasupathy & Miller, 2005).”
MethodExtended LATER model can account for trial-by-trial variability of both pre- and post-processes
Nakahara, H., Nakamura, K., & Hikosaka, O. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.07.001 · Cited by 45
Homayoun, H., & Moghaddam, B. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06679.x · Cited by 54
“…which notably includes subregions of the prefrontal cortex (PFC), such as the medial and orbital PFC (mPFC and OFC, respectively), to integrate affective stimuli with executive commands (Christakou et al., 2004; Kelley, 2004; Pasupathy & Miller, 2005; Saddoris et al., 2005; Stalnaker et al., 2007).”
On a basal ganglia role in learning and rehearsing visual–motor associations
Bédard, P., & Sanes, J. N. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.050 · Cited by 48
“Prior work directly measured the head/body of the caudate and the dlPFC reporting earlier and later involvement in learning, respectively (Pasupathy and Miller, 2005; Seger and Cincotta, 2006).”
BackgroundResultInfluentialBuch, E. R., Brasted, P. J., & Wise, S. P. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-0130-y · Cited by 51
“It seems likely that, together, the caudate nucleus (Pasupathy and Miller, 2005) and the hippocampus (Wirth et al.”
BackgroundResultInfluentialMannarelli, D., Pauletti, C., Grippo, A., Amantini, A., Augugliaro, V., Currà, A., Missori, P., Locuratolo, N., Lucia, M. C. D., Rinalduzzi, S., et al. (2015) · Neural Plasticity · doi:10.1155/2015/410785 · Cited by 50
“The PFC is known to consist of a set of neocortical areas that have bidirectional links with several brain cortical regions, including the sensory and motor areas [41], and a wide range of subcortical structures with widespread projections, such as the basal ganglia [42] and ACC [43, 44].”
Attractor concretion as a mechanism for the formation of context representations
Rigotti, M., Ben Dayan Rubin, D., Morrison, S. E., Salzman, C. D., & Fusi, S. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.01.047 · Cited by 46
“For example in (Asaad et al., 1998; Pasupathy and Miller, 2005) the monkeys are trained to associate saccadic movements to visual responses.”
BackgroundAron, A. R., Poldrack, R. A., & Wise, S. P. (2009) · Elsevier eBooks · doi:10.1016/b978-008045046-9.00410-1 · Cited by 53
Neural networks supporting switching, hypothesis testing, and rule application
Liu, Z., Braunlich, K., Wehe, H. S., & Seger, C. A. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.07.019 · Cited by 49
“Animal studies have found that reversal learning requires orbitofrontal cortex and the ventral striatum (Robbins and Roberts, 2007; Dalton et al., 2014), though reversal learning also affects activity in striatal and lateral prefrontal regions (Pasupathy and Miller, 2005).”
BackgroundFunctional organization of intrinsic connectivity networks in Chinese-chess experts
Duan, X., Long, Z., Chen, H., Liang, D., Qiu, L., Huang, X., Liu, T. C., & Gong, Q. (2014) · Brain Research · doi:10.1016/j.brainres.2014.02.033 · Cited by 46
“…and medial temporal lobe form interacting memory systems, which contribute to skill and knowledge acquisition as well as habit formation, especially during the early phases of learning, relying on both procedural and declarative memory systems (Poldrack et al., 2001; Poldrack and Rodriguez, 2004).”
Functional Connectivity in Patients With Sensorineural Hearing Loss Using Resting-State MRI
Liu, B., Feng, Y., Yang, M., Chen, J.-Y., Li, J., Huang, Z.-C., & Zhang, L. (2015) · American Journal of Audiology · doi:10.1044/2015_aja-13-0068 · Cited by 46
Plasticity and Memory in the Prefrontal Cortex
Jung, M. W., Baeg, E. H., Kim, M. J., Kim, Y. B., & Kim, J. J. (2008) · Reviews in the Neurosciences · doi:10.1515/revneuro.2008.19.1.29 · Cited by 43
Neural activation during risky decision-making in youth at high risk for substance use disorders
Hulvershorn, L. A., Hummer, T. A., Fukunaga, R., Leibenluft, E., Finn, P., Cyders, M. A., Anand, A., Overhage, L., Dir, A., & Brown, J. (2015) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2015.05.007 · Cited by 42
“, 2014), suggesting a neural mechanism underlying future risk-taking in HR youth (Pasupathy and Miller, 2005; Lau and Glimcher, 2007; Yamada et al., 2011).”
Pauli, W. M., Clark, A. D., Guenther, H. J., O’Reilly, R. C., & Rudy, J. W. (2012) · Learning & Memory · doi:10.1101/lm.025148.111 · Cited by 44
Representation of Outcome Risk and Action in the Anterior Caudate Nucleus
Yanike, M., & Ferrera, V. P. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3818-13.2014 · Cited by 44
Predicting perceptual learning from higher-order cortical processing
Wang, F., Huang, J., Lv, Y., Ma, X., Yang, B., Wang, E., Du, B., Li, W., & Song, Y. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.09.024 · Cited by 48
Learning Predictive Statistics: Strategies and Brain Mechanisms
Wang, R., Shen, Y., Tiňo, P., Welchman, A. E., & Kourtzi, Z. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.0144-17.2017 · Cited by 54
Brain regions modulated during covert visual attention in the macaque
Bogadhi, A. R., Bollimunta, A., Leopold, D. A., & Krauzlis, R. J. (2018) · Scientific Reports · doi:10.1038/s41598-018-33567-9 · Cited by 50
Encoding of Action History in the Rat Ventral Striatum
Kim, Y. B., Huh, N., Lee, H., Baeg, E. H., Lee, D., & Jung, M. W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00310.2007 · Cited by 42
Corticostriatothalamic reward prediction error signals and executive control in late-life depression
Dombrovski, A. Y., Szanto, K., Clark, L., Aizenstein, H. J., Chase, H. W., Reynolds, C. F., & Siegle, G. J. (2015) · Psychological Medicine · doi:10.1017/s0033291714002517 · Cited by 41
“Striatocortical functional connectivity in the context of unexpected rewards We aimed to test the effects of poor executive control and depression on the training of sustained prefrontal representations by trial-by-trial striatal signals (Pasupathy & Miller, 2005).”
Flexible control of sequence working memory in the macaque frontal cortex
Chen, J., Zhang, C., Hu, P., Min, B., & Wang, L. (2024) · Neuron · doi:10.1016/j.neuron.2024.07.024 · Cited by 44
“15,16 For example, independent subspaces were found in the prefrontal cortex to separately represent WM content and its motor preparation, 17 and multiple-item information in WM could be transferred using orthogonal subspaces through selective attention.”
MethodPrefrontal Cortex Represents Long-Term Memory of Object Values for Months
Ghazizadeh, A., Hong, S., & Hikosaka, O. (2018) · Current Biology · doi:10.1016/j.cub.2018.05.017 · Cited by 40
“Although there is some evidence for the precedence of basal ganglia relative to PFC in associative learning and formation of reward-based short-term memory [3], whether reward-based long-term memory formation emerges in a single area or separately across various components of this interconnected network is an open que…”
Kasanetz, F., Riquelme, L. A., Della-Maggiore, V., O'Donnell, P., & Murer, M. G. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0711113105 · Cited by 41
Involvement of the Globus Pallidus in Behavioral Goal Determination and Action Specification
Arimura, N., Nakayama, Y., Yamagata, T., Tanji, J., & Hoshi, E. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1620-13.2013 · Cited by 47
“Miller and colleagues revealed that association learning in the striatum precedes that in the lPFC (Pasupathy and Miller, 2005), whereas the lPFC plays a major role in abstract categorization of visual signals for saccadic eye movements (Antzoulatos and Miller, 2011).”
BackgroundHabit and Nonhabit Systems for Unconscious and Conscious Behavior: Implications for Multitasking
Lisman, J., & Sternberg, E. J. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00319 · Cited by 39
Hoshi, E. (2013) · Frontiers in Neural Circuits · doi:10.3389/fncir.2013.00158 · Cited by 45
“Furthermore, association learning in the BG (the striatum) has been shown to precede that in the lateral PFC (Pasupathy and Miller, 2005).”
BackgroundGatev, P., & Wichmann, T. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn171 · Cited by 42
“The functional balance between these pathways between the cerebral cortex and the basal ganglia has not been conclusively established, but it is clear that the transstriatal pathways (e.g., Pasupathy and Miller 2005; DeLong and Wichmann 2007) are anatomically more prominent than either the corticosubthalamic or the co…”
BackgroundTranslational Research on Habit and Alcohol
McKim, T. H., Shnitko, T. A., Robinson, D. L., & Boettiger, C. A. (2016) · Current Addiction Reports · doi:10.1007/s40429-016-0089-8 · Cited by 41
Metadata
- Authors
- Pasupathy, A., & Miller, E. K.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Pasupathy, Anitha
- Venue
- Nature
- Published
- 2005-02
- Volume
- 433
- Issue
- 7028
- Pages
- 873-876
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2068949971
- Cited by
- 712
- References
- 33
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 20 · 2023: 17 · 2022: 12 · 2021: 25 · 2020: 22 · 2019: 26 · 2018: 32 · 2017: 23 · 2016: 40 · 2015: 39 · 2014: 42 · 2013: 37 · 2012: 37
- FWCI
- 28.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- associative learning, prefrontal cortex, striatum, basal ganglia, time course of learning, monkeys, rule induction, neural correlates of learning
- MeSH terms
- Animals, Haplorhini, Cues, Fixation, Ocular, Learning, Models, Biological, Reward, Saccades, Time Factors, Neostriatum, Prefrontal Cortex
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.