Different time courses of learning-related activity in the prefrontal cortex and striatum.
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To navigate our complex world, our brains have evolved a sophisticated ability to quickly learn arbitrary rules such as 'stop at red'. Studies in monkeys using a laboratory test of this capacity--conditional association learning--have revealed that frontal lobe structures (including the prefrontal cortex) as well as subcortical nuclei of the basal ganglia are involved in such learning. Neural correlates of associative learning have been observed in both brain regions, but whether or not these regions have unique functions is unclear, as they have typically been studied separately using different tasks. Here we show that during associative learning in monkeys, neural activity in these areas changes at different rates: the striatum (an input structure of the basal ganglia) showed rapid, almost bistable, changes compared with a slower trend in the prefrontal cortex that was more in accordance with slow improvements in behavioural performance. Also, pre-saccadic activity began progressively earlier in the striatum but not in the prefrontal cortex as learning took place. These results support the hypothesis that rewarded associations are first identified by the basal ganglia, the output of which 'trains' slower learning mechanisms in the frontal cortex.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Interactions between the dorsal striatum and prefrontal cortex have been shown in primates to be critical to integrating reward associations with behavioral output (Pasupathy & Miller, 2005), a finding paralleled by adult human imaging literature (Galvan, et al., 2005; Poldrack, Prabhakaran, Seger, & Gabrieli, 1999).”
From Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents (2011) · cites this paper as Pasupathy & Miller, 2005
In the citing paper
“For example, using single-unit recordings in monkeys, Pasupathy & Miller (Pasupathy and Miller, 2005) showed that when flexibly learning a set of reward contingencies, very early activity in the striatum provides the foundation for reward-based associations, whereas later, more deliberative prefrontal mechanisms are engaged to maintain the behavioral outputs that can optimize the greatest gains”
From Adolescence: what do transmission, transition and translation have to do with it? (2010) · cites this paper as Pasupathy and Miller, 2005
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundSelf-citationBerti, A. (1992) · Neuropsychologia · doi:10.1016/0028-3932(92)90076-x · Cited by 4,162
The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe
Fuster, J. M. (1980) · Cited by 2,407
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 1×
“Dopaminergic reward-prediction error signals from the midbrai”
Role of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements
Hikosaka, O., Takikawa, Y., & Kawagoe, R. (2000) · Physiological Reviews · doi:10.1152/physrev.2000.80.3.953 · Cited by 1,302 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundEling, P. (1993) · Acta Psychologica · doi:10.1016/0001-6918(93)90027-o · Cited by 1,184
Neural Control of Voluntary Movement Initiation
Hanes, D. P., & Schall, J. D. (1996) · Science · doi:10.1126/science.274.5286.427 · Cited by 1,145 · cited 1×
“Although pre-saccadic activity might also be linked to the improvement in choices with learning, it seems likely to reflect the decrease in reaction time; a correlation between caudate nucleus (and frontal cortex) pre-saccadic activity and reaction time has been previously demonstrate”
BackgroundThe Basal Ganglia and Chunking of Action Repertoires
Graybiel, A. M. (1998) · Neurobiology of Learning and Memory · doi:10.1006/nlme.1998.3843 · Cited by 1,042 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultThe Frontal Lobes and Voluntary Action
Passingham, R. (1993) · doi:10.1093/oso/9780198521853.001.0001 · Cited by 970
Research works printed but not linked: 1
- DeLong, M. R. & Georgopoulos, A. P. in Handbook of Physiology—Nervous System (eds Brookhart, J. M. & Mountcastle, V. B.) 1017–1061 (American Physiological Society, Bethesda, 1981)
Cited by
Items 501–600 of 701
Neuronal representation of audio-place associations in the medial prefrontal cortex of rats
Wang, Q., Yang, S., & Li, B. (2015) · Molecular Brain · doi:10.1186/s13041-015-0147-5 · Cited by 11
“Electrophysiological studies showed that dlPFC neurons are involved in representing the response category of instruction cue in an associative task [8], and encoding the specific associations between sensory stimuli and behavioral choices [5, 7].”
BackgroundA Dual Process Account of Coarticulation in Motor Skill Acquisition
Shah, A., Barto, A. G., & Fagg, A. H. (2013) · Journal of Motor Behavior · doi:10.1080/00222895.2013.837423 · Cited by 11
“While it is likely that representations of proficiency can be improved with experience (Pasupathy & Miller, 2005; Shad-mehr & Krakauer, 2008; Todorov, Li, & Pan, 2005), it is also likely to be expensive to do so and to use updated representations to find better movements.”
BackgroundDistinct brain areas process novel and repeating tone sequences
Green, B. M., Jääskeläinen, I. P., Sams, M. E., & Rauschecker, J. P. (2018) · Brain and Language · doi:10.1016/j.bandl.2018.09.006 · Cited by 9
Evolutionary Specializations of Human Brain Microstructure
Sherwood, C. C., Bauernfeind, A. L., Verendeev, A., Raghanti, M. A., & Hof, P. R. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-804042-3.00127-5 · Cited by 10
Learning temporal statistics for sensory predictions in mild cognitive impairment
Luft, C. D. B., Baker, R., Bentham, P., & Kourtzi, Z. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.06.002 · Cited by 9
“…findings are consistent with previous work implicating subcortical areas in associative learning and temporal memory, while prefrontal circuits in rule-based behaviours and prediction of future events (Bar, 2009; Leaver, Van Lare, Zielinski, Halpern, & Rauschecker, 2009; Pasupathy & Miller, 2005).”
ResultA dual-process model for cognitive training
Ericson, J., & Klingberg, T. (2023) · npj Science of Learning · doi:10.1038/s41539-023-00161-2 · Cited by 8
“Similar results, with a distinction between striatal and cortical involvement, have been reported in associative learning studies 15 .”
Neural Interactions Underlying Visuomotor Associations in the Human Brain
Madhavan, R., Bansal, A. K., Madsen, J. R., Golby, A. J., Tierney, T. S., Eskandar, E. N., Anderson, W. S., & Kreiman, G. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhy333 · Cited by 8
Estrada‐Sánchez, A. M., Blake, C. L., Barton, S. J., Howe, A. G., & Rebec, G. V. (2019) · Journal of Neurophysiology · doi:10.1152/jn.00777.2018 · Cited by 9
“Striatum, for example, responds more rapidly than cortex during associative learning, and striatal responses emerge first as learning occurs (Pasupathy and Miller 2005).”
BackgroundHow do high-level specifications of the brain relate to variational approaches?
Viéville, T., Chemla, S., & Kornprobst, P. (2007) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2007.10.010 · Cited by 8
“The neural substrate for such mechanism of prediction and reward is not discussed here (see, e.g. Schultz et al., 1997; Sutton and Barto, 1998; Pasupathy and Miller, 2005).”
Biologically-based functional mechanisms of motor skill acquisition
Shah, A. (2008) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 8
de la Crompe, B., Schneck, M., Steenbergen, F., Schneider, A., & Diester, I. (2023) · eNeuro · doi:10.1523/eneuro.0469-22.2023 · Cited by 12
“These findings corroborate results observed with electrophysiological striatal and cortical recordings of monkeys performing a RL task (Histed et al., 2009; Pasupathy & Miller, 2005).”
ResultDesigning Tools for Assumption-Proof Brain Mapping
Marblestone, A. H., & Boyden, E. S. (2014) · Neuron · doi:10.1016/j.neuron.2014.09.004 · Cited by 10
Freund, R., Favara, M., Porter, C., & Behrman, J. R. (2023) · The World Bank Economic Review · doi:10.1093/wber/lhad035 · Cited by 12
“In the game described above, individuals press more quickly when the movement of the dot follows a pattern, even when they themselves are unaware of the pattern ( Pasupathy and Miller 2005 ).”
BackgroundFrank, M. J., Scheres, A., & Sherman, S. J. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511731525.019 · Cited by 8
Targeted training of the decision rule benefits rule-guided behavior in Parkinson’s disease
Ell, S. W. (2013) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-013-0176-4 · Cited by 9
Contributions to the Functional Neuroanatomy of Morphosyntactic Processing in L2
de Diego‐Balaguer, R., & Rodríguez‐Fornells, A. (2010) · Language Learning · doi:10.1111/j.1467-9922.2009.00557.x · Cited by 9
Miller, E. K., & Buschman, T. J. (2007) · Elsevier eBooks · doi:10.1016/b978-012372540-0/50011-x · Cited by 7
“A recent experiment by Pasupathy and Miller (2005) provides suggestive evidence.”
BackgroundResultInfluentialSelf-citationLearning Recruits Neurons Representing Previously Established Associations in the Corvid Endbrain
Veit, L., Pidpruzhnykova, G., & Nieder, A. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01152 · Cited by 10
White-Matter Pathways for Statistical Learning of Temporal Structures
Karlaftis, V. M., Wang, R., Shen, Y., Tiňo, P., Williams, G. B., Welchman, A. E., & Kourtzi, Z. (2018) · eNeuro · doi:10.1523/eneuro.0382-17.2018 · Cited by 8
“Previous work on humans and animals provides evidence for the role of caudate in switching between strategies (Monchi et al., 2001; Cools et al., 2004; Seger and Cincotta, 2006) and learning after a rule reversal (Cools et al., 2002; Pasupathy and Miller, 2005).”
BackgroundHavenith, M. N., Zijderveld, P. M., van Heukelum, S., Abghari, S., Tiesinga, P. H. E., & Glennon, J. C. (2019) · Scientific Reports · doi:10.1038/s41598-019-41250-w · Cited by 10
Computational models of motivated frontal function
O’Reilly, R. C., Russin, J., & Herd, S. A. (2019) · Handbook of clinical neurology · doi:10.1016/b978-0-12-804281-6.00017-3 · Cited by 7
“More recently, there has been increasing evidence that the BG are also important for flexible, higher-level cognitive functions (Pasupathy and Miller, 2005), and there is now a general consensus that the habit-learning role of the BG is specifically associated with the dorsolateral striatum, in…”
BackgroundKhamassi, M. (2007) · HAL · doi:10.13140/rg.2.1.4065.8004 · Cited by 12
Bhandari, A., & Badre, D. (2020) · bioRxiv · doi:10.1101/2020.05.10.086587 · Cited by 6
“Notable in this context, Pasupathy and Miller (2005) found learning-related changes in neural activity recorded from caudate nucleus occurred sooner and more abruptly than lateral PFC in a rule-learning study in monkeys, similar to the current study.”
ResultEarly Sensory Deprivation Leads to Differential Inhibitory Changes in the Striatum During Learning
Paraouty, N., & Mowery, T. M. (2021) · Frontiers in Neural Circuits · doi:10.3389/fncir.2021.670858 · Cited by 7
Morin, T., Chang, A., Ma, W., McGuire, J. T., & Stern, C. E. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab175 · Cited by 6
Age group differences in learning-related activity reflect task stage, not learning stage
Merenstein, J. L., Petok, J. R., & Bennett, I. J. (2021) · Behavioural Brain Research · doi:10.1016/j.bbr.2021.113570 · Cited by 6
Arbitrary visuomotor mapping during object manipulation in Parkinson's disease
Nowak, D. A., Ameli, M., Kemper, F., Sarfeld, A., Bensmaïl, D., Konczak, J., & Fink, G. R. (2009) · Movement Disorders · doi:10.1002/mds.22543 · Cited by 6
“In humans, premotor-striatal circuits have been shown to be necessary for the retention and retrieval of learned arbitrary visuomotor mappings, whereas other portions of the striatum, the hippocampal system, and the ventral prefrontal cortex seem to be more concerned with the acquisition of novel mappings.(11) These o…”
BackgroundLearning Temporal Statistics for Sensory Predictions in Aging
Luft, C. D. B., Baker, R., Goldstone, A., Zhang, Y., & Kourtzi, Z. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00907 · Cited by 6
Neuroanatomical Systems Relevant to Neuropsychiatric Disorders
Holt, D. J., Öngür, D., Wright, C. I., Dickerson, B. C., & Rauch, S. L. (2008) · Elsevier eBooks · doi:10.1016/b978-0-323-04743-2.50073-1 · Cited by 10
(2007) · Springer eBooks · doi:10.1007/978-3-540-34686-9_14 · Cited by 7
Ravel, S., & Richmond, B. J. (2005) · Nature Neuroscience · doi:10.1038/nn0605-705 · Cited by 6
Inhibitory control of frontal metastability sets the temporal signature of cognitionPreprint
Fontanier, V., Sarazin, M., Stoll, F. M., Delord, B., & Procyk, E. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.20.259192 · Cited by 6
SYNCHRONICITY: THE ROLE OF MIDBRAIN DOPAMINE IN GENERATING WHOLE BRAIN COHERENCE, A HYPOTHESISPreprint
Beeler, J. A., & Dreyer, J. K. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/8qfp2 · Cited by 6
Deficits in consummatory reward relate to severity of cocaine use
Wardle, M. C., Hoots, J. K., Miloslavich, K., Nunez, C., de Dios, C., Holden, C. C., Ahluwahlia, A., Green, C. E., Lane, S. D., & Schmitz, J. M. (2023) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2023.109950 · Cited by 6
Moustafa, A. A., Herzallah, M. M., & Gluck, M. A. (2013) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2013.08.003 · Cited by 7
“For example, Pasupathy and Miller (2005) recorded from both the striatum and PFC while a monkey performed a reversal task.”
BackgroundSigurdardottir, H. M., & Sheinberg, D. L. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00789 · Cited by 5
“It has been argued that subcortical regions gradually train cortical areas on the associations so that eventually the behavior can be supported by the cortex (Pasupathy & Miller, 2005).”
Xie, F., You, L., Cai, D., Liu, M., Yue, Y., Wang, Y., & Yuan, K. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx284 · Cited by 6
The Song Circuit as a Model of Basal Ganglia Function
Leblois, A., & Perkel, D. J. (2020) · Springer handbook of auditory research · doi:10.1007/978-3-030-34683-6_4 · Cited by 5
Maladie de Huntington : aspects diagnostiques actuels et applications pratiques
Youssov, K., & Bachoud‐Lévi, A. (2008) · Encyclopédie médico-chirurgicale. Neurologie · doi:10.1016/s0246-0378(07)27525-6 · Cited by 6
Incitations monétaires et motivation au travail : de la théorie économique à la neuroéconomie
Merlateaux, M. (2011) · Économie et Institutions · doi:10.4000/ei.78 · Cited by 5
“Plus récemment, les avancées des neurosciences ont permis de mettre en évidence le rôle d’un ensemble de structures, les ganglions de la base, dans les processus d’apprentissage implicites et non conscients qui constituent les bases de l’intuition (Miller et Pasupathy 2005).”
BackgroundRey, H. G., Lew, S. E., & Zanutto, B. S. (2007) · Springer eBooks · doi:10.1007/978-0-387-72256-6_17 · Cited by 5
“At this stage, previous contingencies between CSs and responses are inverted ( Pasupathy and Miller, 2005 ).”
BackgroundNeural Correlates of Auditory Object Perception
Schnupp, J. W. H., Honey, C., & Willmore, B. D. B. (2012) · Springer handbook of auditory research · doi:10.1007/978-1-4614-2350-8_5 · Cited by 5
Single Neuron Activity Underlying Behavior‐Guiding Rules
Wallis, J. D. (2007) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195314274.003.0003 · Cited by 6
Ognibene, D., Mannella, F., Pezzulo, G., & Baldassarre, G. (2006) · Cited by 5
Neural Mechanisms of High‐Level Vision
Hegdé, J. (2018) · Comprehensive physiology · doi:10.1002/cphy.c160035 · Cited by 7
Flexible cognition in context-modulated reservoir networksPreprint
Masse, N. Y., Rosen, M. C., Tsao, D. Y., & Freedman, D. J. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.05.09.491102 · Cited by 6
“This might suggest that when an animal is confronted by a new task, context, or environment, synaptic plasticity might (initially) be located primarily in subcortical circuits to facilitate rapid learning [52], consistent with experimental evidence [9, 53].”
ResultProspective and retrospective representations of saccadic movements in primate prefrontal cortex
Calangiu, I., Kollmorgen, S., Reppas, J. B., & Mante, V. (2025) · Cell Reports · doi:10.1016/j.celrep.2025.115289 · Cited by 4
Cui, Y., Paillé, V., Delord, B., Genet, S., Fino, É., Venance, L., & Berry, H. (2013) · BMC Neuroscience · doi:10.1186/1471-2202-14-s1-o1 · Cited by 4
Liang, P., & Jia, X. (2015) · Journal of Advanced Neuroscience Research · doi:10.15379/2409-3564.2015.02.01.2 · Cited by 4
“This is also congruent with the involvement of the caudate in conditional association learning [50], rule-based category learning [51], and rule switching[52].”
ResultAdaptive heading performance during self‐motion perception
Kuang, S., Deng, H., & Zhang, T. (2019) · PsyCh Journal · doi:10.1002/pchj.330 · Cited by 6
Studying Bilingualism Through Eye-Tracking and Brain Imaging
Hayakawa, S. L., & Marian, V. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316535967.012 · Cited by 6
“An important feature of the BG is that they are rich in dopamine, potentially allowing for quick reward-mediated learning and high cognitive flexibility (Pasupathy & Miller, 2005).”
BackgroundPrinciples of Brain and Emotion: Beyond the Cortico-Centric Bias
Thomasson, M., & Péron, J. (2022) · Advances in experimental medicine and biology · doi:10.1007/978-3-030-99550-8_2 · Cited by 7
Response properties of neurons in the cat’s putamen during auditory discrimination
Zhao, Z., Sato, Y., & Qin, L. (2015) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.07.002 · Cited by 4
Anxiety and depressive disorders
Pine, D. S. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511757402.015 · Cited by 4
Brain Activation and Deactivation in Human Inductive Reasoning: An fMRI Study
Liang, P., Yang, M., Jia, X., Yang, Y., Lu, S., Zhong, N., & Li, K. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15314-3_37 · Cited by 4
“This is consistent with previous studies, including studies of human subjects [15,16,17,18,19,20] and studies of primate animals [21, 22 ,23].”
ResultNeuroimaging of Human Memory Linking cognitive process to neural systems
Rösler, F., Ranganath, C., Röder, B., & Kluwe, R. H. (2008) · Cited by 4
Xiang, J. ‐., & Brown, M. W. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05520.x · Cited by 4
“Learningrelated effects have recently been reported to appear more rapidly in the striatum than in the PFCdl during the learning of a conditional association (Pasupathy & Miller, 2005).”
BackgroundSarazin, M., Victor, J., Medernach, D., Naudé, J., & Delord, B. (2021) · Frontiers in Neural Circuits · doi:10.3389/fncir.2021.648538 · Cited by 4
“Consistent with our results, learning occurs gradually in the PFC, and at a slower pace than in the hippocampus and basal ganglia (Pasupathy and Miller, 2005; Buschman and Miller, 2014).”
ResultPrefrontal Representations Underlying Goal-Directed Behavior
Wallis, J. D. (2007) · Springer eBooks · doi:10.1007/978-4-431-73021-7_12 · Cited by 5
Computational benefits of structural plasticity, illustrated in songbirds
Sankar, R., Rougier, N. P., & Leblois, A. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.10.033 · Cited by 4
Guo, H., Kuang, S., & Gail, A. (2025) · Nature Communications · doi:10.1038/s41467-025-56360-5 · Cited by 4
Fregni, S., Wolfensteller, U., & Ruge, H. (2025) · Cerebral Cortex · doi:10.1093/cercor/bhaf123 · Cited by 4
Estimating the hidden learning representations
Brovelli, A., Coquelin, P.-A., & Boussaoud, D. (2007) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2007.10.002 · Cited by 3
“A complementary approach searched for changes in the selectivity of neuronal activity for the rewarded motor response in the average firing rate of neuronal populations (Asaad et al., 1998; Pasupathy and Miller, 2005).”
InfluentialANAGRAM PROBLEM-SOLVING AND LEARNING IN ANTERIOR PREFRONTAL CORTEX
Nioka, S., TRACY, J. I., Raines, S. R., Bunce, S. C., & Chance, B. (2008) · Journal of Innovative Optical Health Sciences · doi:10.1142/s1793545808000194 · Cited by 3
Park, H., Doh, H., Lee, E., Park, H., & Ahn, W. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011692 · Cited by 8
Gating of Cortical Input Through the Striatum
Murer, M. G., & O’Donnell, P. (2016) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-12-802206-1.00022-2 · Cited by 4
Battaglia, F. P., Peyrache, A., Khamassi, M., & Wiener, S. I. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195323245.003.0021 · Cited by 4
“However Pasupathy and Miller (2005) recently showed in electrophysiological experiments in monkey that while both the prefrontal cortex and the striatum adapt their neural responses with learning, the prefrontal cortex adapts more slowly than the striatum, and the former is more correlated to…”
BackgroundFinding minimal action sequences with a simple evaluation of actions
Shah, A., & GURNEY, K. N. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00151 · Cited by 3
“…of observed behavior in biological systems may be distributed across different learning and control processes (Dickinson, 1985; Milner et al., 1998; Packard and Knowlton, 2002; Pasupathy and Miller, 2005; Yin et al., 2008; Balleine et al., 2009; Balleine and O’Dohrety, 2010; Redgrave et al., 2010).”
BackgroundNeural Mechanism of Figural Inductive Reasoning: An fMRI Study
Mei, Y., Liang, P., Lu, S., Yan-Hui, Y. A. N. G., Zhong, N., & Li, K. (2010) · Acta Psychologica Sinica · doi:10.3724/sp.j.1041.2010.00496 · Cited by 4
Mechanisms of Action Generation and Recognition in the Human Brain
Inui, T. (2007) · International Conference on Informatics Education and Research for Knowledge-Circulating Society (ICKS) · doi:10.1109/icks.2007.16 · Cited by 3
Wagels, L., Habel, U., & Nickl‐Jockschat, T. (2024) · Springer eBooks · doi:10.1007/978-3-030-51366-5_31 · Cited by 3
Parsing Heterogeneous Striatal Activity
Nakamura, K., & Ding, L. (2017) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2017.00043 · Cited by 4
“…context, outcome expectation, choice and learning status (Apicella et al., 1992; Hollerman et al., 1998; Kawagoe et al., 1998; Lauwereyns et al., 2002; Takikawa et al., 2002; Brasted and Wise, 2004; Barnes et al., 2005; Pasupathy and Miller, 2005; Ding and Hikosaka, 2006; Lau and Glimcher, 2007).”
BackgroundThe Neurobiology of Adolescent Addiction
Boucher, M., & Sandhu, P. (2012) · Wiley eBooks · doi:10.1002/9781118340851.ch8 · Cited by 3
“The PFC later is engaged in maintaining and optimizing behavioral patterns to receive the reward [14].”
BackgroundFunctional Organization of the Basal Ganglia: Dopaminergic and Non‐Dopaminergic Features
Carlos Juri, C., Rodríguez-Oroz, M. C., & Obeso, J. A. (2011) · Parkinson s Disease · doi:10.1002/9781444397970.ch5 · Cited by 3
The mid-lateral cerebellum is necessary for reinforcement learningPreprint
Sendhilnathan, N., & Goldberg, M. E. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.03.20.000190 · Cited by 3
Unveiling the neural correlates of habit in the dorsal striatumPreprint
Vandaele, Y., & Janak, P. H. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.04.03.438314 · Cited by 3
Recycling of prefrontal subspaces dynamically multiplexes informationPreprint
Wentz, P. T., Brincat, S. L., Pasupathy, A., & Miller, E. K. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.05.02.651965 · Cited by 4
“Previously we analyzed learning 18 and reward coding 19 in this task.”
Self-citationHow dopamine shapes trust beliefs
Schuster, B. A., & Lamm, C. (2024) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2024.111206 · Cited by 6
“…(such as the TPJ and dmPFC (Diaconescu et al., 2017)), signalling the need to infer the causes of current information by either forming new beliefs or new causal associations between novel information and existing beliefs (Nour et al., 2018; Diaconescu et al., 2019; Pasupathy and Miller, 2005).”
Miranda, B., Butler, J. L., Malalasekera, W. M. N., Behrens, T. E. J., Dayan, P., & Kennerley, S. W. (2026) · eLife · doi:10.7554/elife.106032.3 · Cited by 2
Chafee, M. V. (2022) · Current topics in behavioral neurosciences · doi:10.1007/7854_2022_407 · Cited by 2
Lavenex, P. B., Blandin, M.-L., Gaborieau, C., & Lavenex, P. (2024) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2024.1377133 · Cited by 4
“Interestingly, and perhaps not coincidentally, the tasks on which AMIPI operators exhibited improvements, the Purdue Pegboard assembly task, the attention task, and the visual memory task, are all thought to evaluate nondeclarative, hippocampus-independent processes (101, 122 – 125).”
BackgroundInitial learning in the brain: From rules to action
Fregni, S., Wolfensteller, U., & Ruge, H. (2024) · Imaging Neuroscience · doi:10.1162/imag_a_00274 · Cited by 3
Kobayashi-Noami, K., Maruo, K., Sakamoto, T., Takahashi, Y., & Horikoshi, M. (2019) · Rinsho Shinkeigaku · doi:10.5692/clinicalneurol.cn-001268 · Cited by 3
Coarse-Grained Neural Network Model of the Basal Ganglia to Simulate Reinforcement Learning Tasks
Drapała, J., & Frydecka, D. (2022) · Brain Sciences · doi:10.3390/brainsci12020262 · Cited by 3
“The dynamic modulation of striatal activity is causally related to behavioral changes [10].”
BackgroundDual Policy as Self-Model for Planning
Yoo, J.-S., de la Torre, F., & Yang, G. R. (2024) · Journal of Korean institute of intelligent systems · doi:10.5391/jkiis.2024.34.1.15 · Cited by 3
“Neuroscience studies on reinforcement learning and goal-directed behaviors suggest that the dorsolateral striatum (a part of basal ganglia) is involved in making model-free, habitual actions [10, 11, 12] whereas planned actions for goaldirected behaviors activate the prefrontal cortex [13, 14, 15, 16].”
BackgroundIpata, A. E., Fascianelli, V., Zeeuw, C. I. D., Sendhilnathan, N., Fusi, S., & Goldberg, M. E. (2026) · Journal of Neuroscience · doi:10.1523/jneurosci.0082-25.2026 · Cited by 2
“…et al., 2006; Hoshi and Tanji, 2006; Wang et al., 2019), parietal cortex (Shadlen and Newsome, 2001), and prefrontal cortex (Tanji and Hoshi, 2001; Pasupathy and Miller, 2005; Histed et al., 2009; Yamagata et al., 2012; Nakayama et al., 2015) together with subcortical structures (Pasupathy and…”
How cortico-basal ganglia-thalamic subnetworks can shift decision policies to increase reward rate
Bahuguna, J., Verstynen, T., & Rubin, J. E. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1013712 · Cited by 4
“Interestingly, experiments have also found evidence for an earlier onset of activity in the striatum with the progression of learning in non-human primates [61].”
Dem Geist auf der Spur: Neurokognitive Methoden zur Messung von Lern- und Gedächtnisprozessen
Jacobs, A. M., Hutzler, F., & Engl, V. (2006) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-531-90607-2_6 · Cited by 8
The Prefrontal Cortex: Categories, Concepts, and Cognitive Control
Miller, E. K. (2007) · Research and perspectives in neurosciences · doi:10.1007/978-3-540-45702-2_10 · Cited by 7
Self-citationDynamic alternation of primate response properties during trial-and-error knowledge updating
Fujimoto, A., Nishida, S., & Ogawa, T. (2011) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2011.06.014 · Cited by 2
Rapanelli, M., Frick, L. R., Fernández, A. M. M. M., & Zanutto, B. S. (2014) · Behavioural Brain Research · doi:10.1016/j.bbr.2014.11.031 · Cited by 3
Neuronal mechanisms underlying exploration-exploitation strategies in operant learning
Lew, S. E., Rey, H. G., & Zanutto, B. S. (2013) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6706987 · Cited by 2
“To force a new exploration process, a reversal procedure is applied when the model executes 30 correct consecutive responses and the previous pairing between CSs and responses were inverted [33].”
MethodStimulus sampling as an exploration mechanism for fast reinforcement learning
Vladimirskiy, B., Vasilaki, E., Urbanczik, R., & Senn, W. (2009) · Biological Cybernetics · doi:10.1007/s00422-009-0305-x · Cited by 2
“…Chen and Wise 1995a,b; Brasted and Wise 2004), pre-frontal cortex (Asaad et al. 1998), and the striatum (Schultz et al. 2003; Brasted and Wise 2004; Pasupathy and Miller 2005; Williams and Eskandar 2006), on a variety of tasks, commonly including conditional motor associative learning in which…”
BackgroundBasal Ganglia Models for Autonomous Behavior Learning
Tsujino, H., Takeuchi, J., & Shouno, O. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-00616-6_16 · Cited by 2
“Recently, it has been found that the BG identifies new “state-reward associations” at the earliest stage of learning and trains the frontal cortex during later stages of learning [31].”
BackgroundAnderson, B. J. P. (2010) · doi:10.17077/etd.6usjkjo3 · Cited by 2
“…found that cells in lPFC are responsive to an array of visual stimulus categories; both for visual objects and visual location information across the delay time in working memory tasks (Fuster, 1973; Kojima & Goldman-Rakic, 1982; Pasupathy & Miller, 2005; Rao et al., 1997; Warden & Miller, 2007).”
BackgroundShephard, E. (2014) · Nottingham ePrints (University of Nottingham) · Cited by 3
A model of reward-modulated motor learning with parallelcortical and basal ganglia pathwaysPreprint
Pyle, R., & Rosenbaum, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.03304 · Cited by 2
“…takes over as tasks become well learned or “automatized” (Bottjer, Miesner, & Arnold, 1984; Carelli, Wolske, & West, 1997; Brainard & Doupe, 2000; Pasupathy & Miller, 2005; Ashby, Ennis, & Spiering, 2007; Obeso et al., 2009; Andalman & Fee, 2009; Ashby et al., 2010; Turner & Desmurget, 2010;…”
BackgroundArakaki, T. (2016) · theses.fr (ABES) · doi:10.70675/b0711d35z04ebz4e91z8e52zbae5a3e72fb8 · Cited by 4
Skurvydas, A., Šatas, A., Valančienė, D., Mamkus, G., Mickevičienė, D., Majauskienė, D., & Brazaitis, M. (2020) · European Journal of Applied Physiology · doi:10.1007/s00421-020-04342-4 · Cited by 2
“Based on the data of other researchers, we suggest that fast learning may occur even in the first session; that is, during the first 60–180 repetitions (Smith et al. 2006; Karni et al. 1998; Pasupathy and Miller 2005).”
BackgroundChase, H. W. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1211528 · Cited by 1
“The most simple contrast is between fast and slow learning systems (e.g., Balleine and Dickinson, 1998; Ashby and Maddox, 2005; Daw et al., 2005; Pasupathy and Miller, 2005; Collins et al., 2014; Perez and Dickinson, 2020): broadly, fast learning systems are thought to mediate symbolic, detailed…”
Background
Metadata
- Authors
- Pasupathy, A., & Miller, E. K.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Pasupathy, Anitha
- Venue
- Nature
- Published
- 2005-02
- Volume
- 433
- Issue
- 7028
- Pages
- 873-876
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2068949971
- Cited by
- 712
- References
- 33
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 20 · 2023: 17 · 2022: 12 · 2021: 25 · 2020: 22 · 2019: 26 · 2018: 32 · 2017: 23 · 2016: 40 · 2015: 39 · 2014: 42 · 2013: 37 · 2012: 37
- FWCI
- 28.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- associative learning, prefrontal cortex, striatum, basal ganglia, time course of learning, monkeys, rule induction, neural correlates of learning
- MeSH terms
- Animals, Haplorhini, Cues, Fixation, Ocular, Learning, Models, Biological, Reward, Saccades, Time Factors, Neostriatum, Prefrontal Cortex
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.