Different time courses of learning-related activity in the prefrontal cortex and striatum.
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
To navigate our complex world, our brains have evolved a sophisticated ability to quickly learn arbitrary rules such as 'stop at red'. Studies in monkeys using a laboratory test of this capacity--conditional association learning--have revealed that frontal lobe structures (including the prefrontal cortex) as well as subcortical nuclei of the basal ganglia are involved in such learning. Neural correlates of associative learning have been observed in both brain regions, but whether or not these regions have unique functions is unclear, as they have typically been studied separately using different tasks. Here we show that during associative learning in monkeys, neural activity in these areas changes at different rates: the striatum (an input structure of the basal ganglia) showed rapid, almost bistable, changes compared with a slower trend in the prefrontal cortex that was more in accordance with slow improvements in behavioural performance. Also, pre-saccadic activity began progressively earlier in the striatum but not in the prefrontal cortex as learning took place. These results support the hypothesis that rewarded associations are first identified by the basal ganglia, the output of which 'trains' slower learning mechanisms in the frontal cortex.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Interactions between the dorsal striatum and prefrontal cortex have been shown in primates to be critical to integrating reward associations with behavioral output (Pasupathy & Miller, 2005), a finding paralleled by adult human imaging literature (Galvan, et al., 2005; Poldrack, Prabhakaran, Seger, & Gabrieli, 1999).”
From Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents (2011) · cites this paper as Pasupathy & Miller, 2005
In the citing paper
“For example, using single-unit recordings in monkeys, Pasupathy & Miller (Pasupathy and Miller, 2005) showed that when flexibly learning a set of reward contingencies, very early activity in the striatum provides the foundation for reward-based associations, whereas later, more deliberative prefrontal mechanisms are engaged to maintain the behavioral outputs that can optimize the greatest gains”
From Adolescence: what do transmission, transition and translation have to do with it? (2010) · cites this paper as Pasupathy and Miller, 2005
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundSelf-citationBerti, A. (1992) · Neuropsychologia · doi:10.1016/0028-3932(92)90076-x · Cited by 4,162
The Prefrontal Cortex: Anatomy, Physiology, and Neuropsychology of the Frontal Lobe
Fuster, J. M. (1980) · Cited by 2,407
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 1×
“Dopaminergic reward-prediction error signals from the midbrai”
Role of the Basal Ganglia in the Control of Purposive Saccadic Eye Movements
Hikosaka, O., Takikawa, Y., & Kawagoe, R. (2000) · Physiological Reviews · doi:10.1152/physrev.2000.80.3.953 · Cited by 1,302 · cited 1×
“The prefrontal cortex (PFC) is a cortical area important for the organization of goal-directed, rule-based behaviours; the basal ganglia are a group of subcortical nuclei long associated with the control of volitional movement”
BackgroundEling, P. (1993) · Acta Psychologica · doi:10.1016/0001-6918(93)90027-o · Cited by 1,184
Neural Control of Voluntary Movement Initiation
Hanes, D. P., & Schall, J. D. (1996) · Science · doi:10.1126/science.274.5286.427 · Cited by 1,145 · cited 1×
“Although pre-saccadic activity might also be linked to the improvement in choices with learning, it seems likely to reflect the decrease in reaction time; a correlation between caudate nucleus (and frontal cortex) pre-saccadic activity and reaction time has been previously demonstrate”
BackgroundThe Basal Ganglia and Chunking of Action Repertoires
Graybiel, A. M. (1998) · Neurobiology of Learning and Memory · doi:10.1006/nlme.1998.3843 · Cited by 1,042 · cited 1×
“Some results have led to the suggestion of a sequential relationship, in which the PFC is involved in new learning and the basal ganglia are subsequently involved in consolidating familiar routines into automatic habit”
ResultThe Frontal Lobes and Voluntary Action
Passingham, R. (1993) · doi:10.1093/oso/9780198521853.001.0001 · Cited by 970
Research works printed but not linked: 1
- DeLong, M. R. & Georgopoulos, A. P. in Handbook of Physiology—Nervous System (eds Brookhart, J. M. & Mountcastle, V. B.) 1017–1061 (American Physiological Society, Bethesda, 1981)
Cited by
Items 401–500 of 701
Theory meets pigeons: The influence of reward-magnitude on discrimination-learning
Rose, J., Schmidt, R., Grabemann, M., & Güntürkün, O. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.10.038 · Cited by 30
“Release of dopamine in the striatum can be observed after the presentation of a contingent CS, but not after a non-contingent CS [16]; learning-rate can be increased by microstimulation in the dorsal striatum during the reinforcement-period of a visuo-motor association task [42]; during learning, the activation of str…”
Lee, H., Leamey, C. A., & Sawatari, A. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003020 · Cited by 24
“Cortico-striatal and nigrostriatal connections are of particular interest as these networks are considered vital for the integration of sensory information [8,9], goal directed learning [10,11], self-initiated action [12–16], and the selection and execution of motor programs [17–20].”
BackgroundPlasticity of the Primate Prefrontal Cortex
Kuboshima-Amemori, S., & Sawaguchi, T. (2007) · The Neuroscientist · doi:10.1177/1073858406298554 · Cited by 22
“These adaptive changes in activity have also been reported in the dorsolateral PFC (Asaad and others 1998; Pasupathy and Miller 2005) and in the orbitofrontal cortex (Tremblay and Schultz 2000).”
BackgroundPiette, C., Touboul, J., & Venance, L. (2020) · Frontiers in Cellular Neuroscience · doi:10.3389/fncel.2020.575915 · Cited by 24
“Thus, one should keep in mind that fast and slow cortical dynamics are closely intertwined as exemplified in tasks necessitating high levels of cognitive flexibility (Pasupathy and Miller, 2005; Tse et al., 2007; Durstewitz et al., 2010; Siniscalchi et al., 2016; Perich et al., 2018; Remington et al., 2018; Rikhye et…”
BackgroundXu, T., Zhou, X., Kanen, J. W., Wang, L., Li, J., Chen, Z., Zhang, R., Jiao, G., Zhou, F., Zhao, W., et al. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02001-6 · Cited by 23
“The important role of fronto-striatal connectivity in reinforcement learning has 543 been extensively documented [41], indicating that reward associations initially formed in the 544 striatum are subsequently used to guide learning and decisions engaging the dlPFC [56].”
MethodSchroll, H., Horn, A., Gröschel, C., Brücke, C., Lütjens, G., Schneider, G., Krauss, J. K., Kühn, A. A., & Hamker, F. H. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.07.061 · Cited by 21
“Learning of stimulus–response associations via rewards relies on the basal ganglia and their synaptic target, the ventral thalamus (Knowlton et al., 1996; Komura et al., 2001; Featherstone and McDonald, 2004; Pasupathy and Miller, 2005).”
BackgroundYamada, H., Inokawa, H., Matsumoto, N., Ueda, Y., & Kimura, M. (2011) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07771.x · Cited by 24
“Conversely, for voluntary choices, processing in the dorsal striatum and in frontal cortical areas (e.g. the LPFC) may cooperate or compete with one another, depending on the requirements for behavioral control (Daw et al., 2005; Pasupathy & Miller, 2005).”
BackgroundAnticipatory activity in rat medial prefrontal cortex during a working memory task
Bai, W., Liu, T., Hu, Y., Li, S., & Tian, X. (2012) · Neuroscience Bulletin · doi:10.1007/s12264-012-1291-x · Cited by 23
“Gradually, learning-related changes in neuronal activity have been shown in several brain areas, such as the PFC([58]), basal ganglia([59]), premotor cortex([60]) and supplementary eye field([61]).”
BackgroundA neurocomputational view of the effects of Parkinson’s disease on speech production
Manes, J. L., Bullock, L., Meier, A. M., Turner, R. S., Richardson, R. M., & Guenther, F. H. (2024) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2024.1383714 · Cited by 20
Lee, H., & Sawatari, A. (2011) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07852.x · Cited by 22
“…of the basal ganglia, integrates excitatory cortical ⁄ thalamic drive and dopaminergic neuromodulatory input from the substantia nigra to coordinate motor control, procedural learning and goal-directed behavior (Schultz, 2002; Barnes et al., 2005; Pasupathy & Miller, 2005; Yin et al., 2005).”
BackgroundTsutsui, K., Hosokawa, T., Yamada, M., & Iijima, T. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.2063-15.2016 · Cited by 23
“…category coding from outcome or response contingency coding, which has been well known to be prevalent in the PFC (Watanabe, 1986; Quintana et al., 1988; Watanabe, 1990; Sakagami and Niki, 1994; Rolls et al., 1996; Watanabe, 1996; Asaad et al., 1998; Pasupathy and Miller, 2005; Pan et al., 2008).”
BackgroundMethodInfluentialRole of human premotor dorsal region in learning a conditional visuomotor task
Parikh, P. J., & Santello, M. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00658.2016 · Cited by 21
“…supplementary and frontal eye fields, midcingulate cortex, striatum, and globus pallidum (Amiez et al. 2013; Brasted and Wise 2004; Chen and Wise 1995; Deiber et al. 1997; Eliassen et al. 2003; Mitz et al. 1991; Pasupathy and Miller 2005; Rushworth et al. 2007; Wirth et al. 2003; Zach et al. 2008).”
Backgroundvan Noordt, S. J. R., Wu, J., Venkataraman, A., Larson, M. J., South, M., & Crowley, M. J. (2017) · Research in Autism · doi:10.1016/j.rasd.2017.01.011 · Cited by 25
“Activity in the striatum and medial frontal cortex is sensitive to deviations from expected outcomes (Pagnoni et al., 2002; Pasupathy & Miller, 2005) and is linked to the rapid updating of expectations following prediction errors (Silvetti, Nunez Castellar, Roger, & Verguts, 2014).”
Modulating risky decision‐making in Parkinson's disease by transcranial direct current stimulation
Benussi, A., Alberici, A., Cantoni, V., Manenti, R., Brambilla, M., Dell’Era, V., Gazzina, S., Manes, M. A., Cristillo, V., Padovani, A., et al. (2017) · European Journal of Neurology · doi:10.1111/ene.13286 · Cited by 27
“In the present work, we aimed to evaluate the effects of an inhibitory tDCS protocol with cathodal stimulation over the right DLPFC to try to reduce the pathological overdrive in frontostriatal circuits, mediated by an ‘overdose’ of dopaminergic medication in patients with PD on medication, and thus increase decision-…”
BackgroundInfluentialHow bad do you want it? Reward modulation in the avian nidopallium caudolaterale.
Koenen, C., Millar, J., & Colombo, M. (2013) · Behavioral Neuroscience · doi:10.1037/a0033551 · Cited by 31
Vellema, M., Rocha, M. D., Bascones, S., Zsebők, S., Dreier, J., Leitner, S., der Linden, A. V., Brewer, J. R., & Gahr, M. L. (2019) · eLife · doi:10.7554/elife.43194 · Cited by 22
“…humans (Albouy et al., 2008; Debas et al., 2010; Lehéricy et al., 2006; Poldrack et al., 2005; Coynel et al., 2010), mammals (Barnes et al., 2005; Pasupathy and Miller, 2005; Sheth et al., 2011; Yin et al., 2009), and birds (Bottjer et al., 1984; Scharff and Nottebohm, 1991; Brainard and Doupe,…”
BackgroundWho's on first? What's on second? The time course of learning in corticostriatal systems
Laubach, M. (2005) · Trends in Neurosciences · doi:10.1016/j.tins.2005.07.008 · Cited by 20
“The basal ganglia could then ‘train’ task-related activity in areas such as the dorsolateral prefrontal cortex during later stages of learning[ 3 ,29].Severalhypotheticalschemes for corticostriatal interactions (Figure 1) are possible and should be investigated, using methods for recording simultaneously in multiple c…”
BackgroundMethodResultInfluentialA hybrid generative and predictive model of the motor cortex
Weber, C., Wermter, S., & Elshaw, M. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.10.004 · Cited by 22
“In contrary, the striatum may not be so easily controllable by (prefrontal) cortex (Ravel & Richmond, 2005), as its quick response in the experiments of Pasupathy & Miller (2005) suggests.”
Boredom and Flow: A Counterfactual Theory of Attention-Directing Motivational StatesPreprint
Chater, N., Loewenstein, G. F., & Wojtowicz, Z. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3339123 · Cited by 29
Action selection and refinement in subcortical loops through basal ganglia and cerebellum
Houk, J. C. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511731525.014 · Cited by 22
“, 1997) and by combined recordings of single cell activity from the striatum and frontal cortex (Pasupathy and Miller, 2005; see also Brasted and Wise, 2004).”
Effects of cancer therapy on hippocampus-related function
Moon, C., & Yang, M. (2015) · Neural Regeneration Research · doi:10.4103/1673-5374.165234 · Cited by 19
“Several brain regions, including the hippocampus, prefrontal cortex, amygdala, striatum, and several parts of the parietal lobe, are involved in cognitive processing (Pasupathy and Miller, 2005; Yang and Moon, 2013).”
Neural Mechanisms of Human Decision-Making
Herd, S. A., Krueger, K. A., Nair, A., Mollick, J., & O’Reilly, R. C. (2021) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-020-00842-0 · Cited by 32
History information emerges in the cortex during learning
Marmor, O., Pollak, Y. E., Doron, C., Helmchen, F., & Gilad, A. (2023) · eLife · doi:10.7554/elife.83702 · Cited by 21
“…et al., 2020 ), inhibitory subtypes, other pathways ( Lacefield et al., 2019 ; Mohan et al., 2022 ; Musall et al., 2023 ; Petreanu et al., 2012 ; Williams and Holtmaat, 2019 ), and subcortical areas ( Fu et al., 2015 ; Garrett et al., 2020 ; Pasupathy and Miller, 2005 ; Pfeffer et al., 2013 ).”
BackgroundDissociable functions of reward inference in the lateral prefrontal cortex and the striatum
Tanaka, S., Pan, X., Oguchi, M., Taylor, J. E., & Sakagami, M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00995 · Cited by 22
“To investigate this issue, Pan et al. (2014) conducted a study where the monkeys were required to predict reward for a stimulus without any direct reward experience.”
BackgroundMethodInfluentialChand, G. B., Lamichhane, B., & Dhamala, M. (2016) · Brain Connectivity · doi:10.1089/brain.2016.0421 · Cited by 21
“…revealed that a higher order cortical area in the brain, named the dorsolateral prefrontal cortex (DLPFC), computes higher-level cognitive functions (Bar et al., 2001; Carlson et al., 2006; Gabrieli et al., 1998), including image categorization (Heekeren et al., 2008; Pasupathy and Miller, 2005).”
Functional brain networks for learning predictive statistics
Giorgio, J., Karlaftis, V. M., Wang, R., Shen, Y., Tiňo, P., Welchman, A. E., & Kourtzi, Z. (2017) · Cortex · doi:10.1016/j.cortex.2017.08.014 · Cited by 22
“M AN US CR IP T AC CE PT ED ACCEPTED MANUSCRIPT and Cincotta, 2005), and learning after a rule reve rsal (Cools et al., 2002; Pasupathy and Miller, 2005).”
BackgroundKays, J. S., & Yamamoto, B. K. (2019) · Brain Sciences · doi:10.3390/brainsci9120340 · Cited by 19
The Relevance of Ecological Transitions to Intelligence in Marine Mammals
Bauer, G. B., Cook, P. F., & Harley, H. E. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.02053 · Cited by 22
“Subcortical regions processing reward can be activated in concert with memory supporting and motor control regions to support complex learning and planning based on prior and simulated outcomes (Pasupathy and Miller, 2005).”
BackgroundCorticostriatal Plasticity Established by Initial Learning Persists after Behavioral Reversal
Ghosh, S., & Zador, A. M. (2021) · eNeuro · doi:10.1523/eneuro.0209-20.2021 · Cited by 23
“…showing tonotopic separation quantified in E. Training induces a tonotopic gradient of synaptic strength in the auditory striatum Striatal plasticity has been previously implicated in skill learning and associative learning (Cox and Witten, 2019; Pasupathy and Miller, 2005; Yin et al., 2005).”
BackgroundNeural dynamics underlying the acquisition of distinct auditory category structures
Feng, G., Gan, Z., Yi, H. G., Ell, S. W., Roark, C. L., Wang, S., Wong, P. C. M., & Chandrasekaran, B. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118565 · Cited by 21
Doeller, C. F., Opitz, B., Krick, C. M., Mecklinger, A., & Reith, W. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.02.006 · Cited by 18
“Finally, it could be speculated that there is a cooperative functional interaction between lateral prefrontal and striatal structures during learning within and across-blocks in the present task, possibly with different time courses in either structure (cf. Pasupathy and Miller, 2005).”
BackgroundBeetles, boxes and brain cells: neural mechanisms underlying valuation and learning
Salzman, C. D., Belova, M. A., & Paton, J. J. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.10.016 · Cited by 20
Szalisznyó, K., Silverstein, D. N., Teichmann, M., Duffau, H., & Smits, A. (2016) · Brain and Language · doi:10.1016/j.bandl.2016.08.005 · Cited by 20
“It has also been shown that during early phases of sequential learning, changes occur significantly earlier in the striatum (caudate) than in the cortex (Pasupathy & Miller, 2005).”
BackgroundRizzo, J., Fung, J. K., Hosseini, M., Shafieesabet, A., Ahdoot, E., Pasculli, R. M., Rucker, J. C., Raghavan, P., Landy, M. S., & Hudson, T. E. (2017) · Frontiers in Neurology · doi:10.3389/fneur.2017.00330 · Cited by 20
Brasted, P. J., Bussey, T. J., Murray, E. A., & Wise, S. P. (2005) · Behavioral Neuroscience · doi:10.1037/0735-7044.119.3.662 · Cited by 18
Parieto-frontal circuitry in visuomotor control
Grol, M. (2008) · Utrecht University Repository (Utrecht University) · Cited by 141
Stimulus-reward association and reversal learning in individuals with Asperger Syndrome
Zalla, T., Sav, A.-M., & Leboyer, M. (2009) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2009.03.004 · Cited by 17
“Recently, Pasupathy and Miller (2005) T. Zalla et al. / Research in Autism Spectrum Disorders 3 (2009) 913–923914”
BackgroundContributions of the Basal Ganglia to Visual Perceptual Decisions
Ding, L. (2023) · Annual Review of Vision Science · doi:10.1146/annurev-vision-111022-123804 · Cited by 21
“For example, when the categorization demand is low (few categories need to be learned), the category selectivity of cue-related activity develops sooner and is more strongly represented in caudate neurons than in prefrontal cortical neurons (Pasupathy & Miller 2005, Seo et al. 2012).”
Chaotic recurrent neural networks for brain modelling: A review
Mattera, A., Alfieri, V., Granato, G., & Baldassarre, G. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.107079 · Cited by 25
Psychological and Neuroscientific Connections with Reinforcement Learning
Shah, A. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_16 · Cited by 20
Ponzi, A. P. D. (2008) · Neural Networks · doi:10.1016/j.neunet.2007.12.040 · Cited by 18
“…basal ganglia are well known to be involved in reward learning mechanisms (Schultz, 1998; Wickens, 1997) and cortico-basal ganglia loops are critical for the learning of rewarded cued procedures (Barnes, Kubota, Hu, Jin, & Graybiel, 2005) and in cued working memory tasks (Pasupathy & Miller, 2005).”
Cerebral reorganization in Parkinson's disease.
Helmich, R. C. G. (2011) · Radboud Repository (Radboud University) · Cited by 123
Algermissen, J., Swart, J. C., Scheeringa, R., Cools, R., & den Ouden, H. E. M. (2024) · Nature Communications · doi:10.1038/s41467-023-44632-x · Cited by 20
“Although there are reports of striatal processespreceding prefrontalprocesses within learningtasks 48,54 ,the opposite pattern of PFC preceding striatum has been observed as well 55 and a causal impact of PFC on striatal learning is well established 56,57 .”
Shah, A., & Barto, A. G. (2009) · Brain Research · doi:10.1016/j.brainres.2009.07.006 · Cited by 16
“Though we do not explore it in this paper, there is evidence that cortical areas incorporate information provided by the basal ganglia (Pasupathy and Miller, 2005; Seger and Cincotta, 2006); computational models suggest how such information may aid cortex-based mechanisms (Houk and Wise, 1995;…”
BackgroundWang, M., Gu, X., Ji, B., Wang, L., Guo, Z., Yang, B. T., Wang, X., Li, C.-Y., & Liu, J. (2019) · Biosensors and Bioelectronics · doi:10.1016/j.bios.2019.01.019 · Cited by 16
Learning to select actions shapes recurrent dynamics in the corticostriatal system
Márton, C. D., Schultz, S. R., & Averbeck, B. B. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.09.008 · Cited by 19
Frank, S., Maechler, M. R., Fogelson, S. V., & Tse, P. U. (2023) · Human Brain Mapping · doi:10.1002/hbm.26323 · Cited by 19
“…et al., 2018) found that the dorsal striatum (caudate) changed activity more rapidly than prefrontal cortical areas in category learning and in learning to reverse acquired rules (Pasupathy & Miller, 2005), indicating that the dorsal striatum might act as a “ teacher ” of cortical regions.”
Decoding the future from past experience: learning shapes predictions in early visual cortex
Luft, C. D. B., Meeson, A., Welchman, A. E., & Kourtzi, Z. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00753.2014 · Cited by 21
“Possible candidates include 1) medial temporal lobe and subcortical areas that are known to be involved in associative learning and temporal memory and 2) prefrontal circuits that support rule-based behaviors and prediction of future events (Bar 2009; Leaver et al. 2009; Pasupathy and Miller 2005).”
BackgroundRizzo, J., Hudson, T. E., Abdou, A., Lui, Y. W., Rucker, J. C., Raghavan, P., & Landy, M. S. (2017) · Frontiers in Neurology · doi:10.3389/fneur.2017.00012 · Cited by 17
Manteghi, F., Nasehi, M., & Zarrindast, M. (2017) · EXCLI journal · doi:10.17179/excli2016-693 · Cited by 21
“…be reached by using tDCS (Rohan et al., 2015) and even one exposure could be sufficient for learning new associative memory and behavioral patterns (Pasupathy and Miller, 2005; Schultz et al., 2003). tDCS plus ACPA effects on fear memory formation The effect of preconditioning with tDCS on fear…”
Pallidal circuits for aversive motivation and learning
Stephenson‐Jones, M. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.09.015 · Cited by 19
Tracking the Sensory Environment: An ERP Study of Probability and Context Updating in ASD
Westerfield, M., Zinni, M., Vo, K., & Townsend, J. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2045-6 · Cited by 16
A Spiking Neuron Model of the Basal Ganglia Circuitry that Can Generate Behavioral Variability
Shouno, O., Takeuchi, J., & Tsujino, H. (2009) · Advances in behavioral biology · doi:10.1007/978-1-4419-0340-2_15 · Cited by 17
“In a delayedresponse task, an animal can choose an appropriate movement and initiate it at the right time in response to external events that inform the animal how and when to react and which rewards to expect (Hollerman et al. 1998; Pasupathy and Miller 2005; Turner and Anderson 2005).”
BackgroundInfluentialNeural representations of time-linked memory
Pilkiw, M., & Takehara‐Nishiuchi, K. (2018) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2018.03.024 · Cited by 20
Neurodynamics of the Prefrontal Cortex during Conditional Visuomotor Associations
Loh, M., Pasupathy, A., Miller, E. K., & Deco, G. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20031 · Cited by 16
“Pasupathy and Miller (2005) showed that the onset of the direction selectivity in the basal ganglia moved to an early position rapidly as learning progressed and reached a steady point in time after a few trials.”
BackgroundMethodResultSelf-citationThe impact of motor impairment on the processing of sensory information
Klingner, C. M., Brodoehl, S., Witte, O. W., Guntinas‐Lichius, O., & Volk, G. F. (2018) · Behavioural Brain Research · doi:10.1016/j.bbr.2018.09.016 · Cited by 16
“The increased connectivity between the basal ganglia and thalamus should be interpreted with respect to the critical role of the basal ganglia in learning new motor behaviors [32,33].”
Mishra, A., Marzban, N., Cohen, M. X., & Englitz, B. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.2256-20.2021 · Cited by 15
Inhibitory control of frontal metastability sets the temporal signature of cognition
Fontanier, V., Sarazin, M., Stoll, F. M., Delord, B., & Procyk, E. (2022) · eLife · doi:10.7554/elife.63795 · Cited by 20
“Such a configuration might be relevant for flexible behaviours, directed exploration, and switching ( Durstewitz et al., 2010 ; Pasupathy and Miller, 2005 ; Russo et al., 2020 ; Stoll et al., 2016 ).”
Temporal context and conditional associative learning
Hamid, O. H., Wendemuth, A., & Braun, J. (2010) · BMC Neuroscience · doi:10.1186/1471-2202-11-45 · Cited by 21
“This emphasis on visual recognition was modeled on paradigms developed for behaving non-human primates [15,39,40].”
BackgroundOpen and closed loops: A computational approach to attention and consciousness
Trapp, S., Schroll, H., & Hamker, F. H. (2012) · Advances in Cognitive Psychology · doi:10.5709/acp-0096-y · Cited by 16
Metacognitive monitoring during category learning: how success affects future behaviour
Doyle, M. E., & Hourihan, K. L. (2015) · Memory · doi:10.1080/09658211.2015.1086805 · Cited by 16
“The reason behind this prediction is based on Pasupathy and Miller’s (2005) direction selectivity effect.”
BackgroundForebrain-Cerebellar Interactions During Learning.
Weiss, C., Weible, A. P., Galvez, R., & Disterhoft, J. F. (2006) · PubMed · Cited by 17
Haber, S. N. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195373035.003.0004 · Cited by 16
A neuropsychological investigation of music, emotion, and autobiographical memory
Belfi, A. M., McMurray, B., Voss, M. W., Denburg, N. L., Tranel, D., Duff, M. C., & Gfeller, K. E. (2015) · doi:10.17077/etd.a919ybkm · Cited by 18
“As learning progressed, activity in the striatum increased during presentation of the visual cue (Pasupathy & Miller, 2005).”
BackgroundTowards an understanding of the neural dynamics of intentional learning: Considering the timescale
Ruge, H., & Wolfensteller, U. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.006 · Cited by 14
“Specifically, it was shown that caudate engagement precedes the LPFC in coding new associations consistent with the notion that the anterior caudate might be teaching the LPFC (Pasupathy and Miller, 2005).”
A direct test of competitive versus cooperative episodic–procedural network dynamics in human memory
Freedberg, M., Reeves, J. A., Fioriti, C. M., Murillo, J., Voss, J. L., & Wassermann, E. M. (2022) · Cerebral Cortex · doi:10.1093/cercor/bhab512 · Cited by 18
Neural Dynamics of the Basal Ganglia During Perceptual, Cognitive, and Motor Learning and Gating
Grossberg, S. (2016) · Innovations in cognitive neuroscience · doi:10.1007/978-3-319-42743-0_19 · Cited by 16
“Buschman and Miller (2007) have reported such prefrontal–parietal resonances during movement control, and Pasupathy and Miller (2004) have reported different time courses of activity in the prefrontal cortex and basal ganglia that are consistent with how basal ganglia-mediated gating of prefrontal…”
BackgroundLamichhane, B., & Dhamala, M. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00498 · Cited by 18
“Here, the function of the dlPCF also fits with its role in disambiguation (Carlson et al., 2006), in semantic analysis involved in recognition (Gabrieli et al., 1998) and in decision making (Miller and Cohen, 2001; Pasupathy and Miller, 2005; Weissman et al., 2008).”
BackgroundMethodO’Reilly, R. C., Nair, A., Russin, J., & Herd, S. A. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00380 · Cited by 18
“…striatum, most of the BG is more clearly involved with nonhabitual behavior and deliberative, controlled cognition in novel and challenging tasks (Pasupathy and Miller, 2005; Samejima et al., 2005; Yin et al., 2005; Balleine et al., 2007; Seger and Spiering, 2011; Pauli et al., 2012).”
BackgroundDistinct Neural Circuits Underlie Prospective and Concurrent Memory-Guided Behavior
Hamm, A. G., & Mattfeld, A. T. (2019) · Cell Reports · doi:10.1016/j.celrep.2019.08.002 · Cited by 13
“…in the dorsal anterior caudate modulate firing as goal-directed associations are learned (Tremblay et al., 1998; Blazquez et al., 2002;Miyachi et al., 2002; Hadj-Bouziane and Boussaoud, 2003; Brasted and Wise, 2004), with preceding responses observed in the dlPFC (Pasupathy and Miller, 2005).”
ResultYamasaki, B. L., Stocco, A., Liu, A., & Prat, C. S. (2019) · Brain and Language · doi:10.1016/j.bandl.2019.104665 · Cited by 13
Learning the meaning of new stimuli increases the cross-correlated activity of prefrontal neurons
Nougaret, S., & Genovesio, A. (2018) · Scientific Reports · doi:10.1038/s41598-018-29862-0 · Cited by 13
Neural Activity in the Human Brain Signals Logical Rule Identification
Tachibana, K., Suzuki, K., Mori, E., Miura, N., Kawashima, R., Horie, K., Sato, S., Tanji, J., & Mushiake, H. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90659.2008 · Cited by 14
Incidental learning of S-R contingencies in the masked prime task.
Schlaghecken, F., Blagrove, E., & Maylor, E. A. (2007) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.33.5.1177 · Cited by 12
A Model of Reaching that Integrates Reinforcement Learning and Population Encoding of Postures
Ognibene, D., Rega, A., & Baldassarre, G. (2006) · Lecture notes in computer science · doi:10.1007/11840541_32 · Cited by 12
“For example, it does not model the different time courses of learning in basal ganglia and prefrontal cortex [17], the role of basal-ganglia direct and indirect pathways [10, 12], the possible separation of selection vs.”
BackgroundInductive biases of neural network modularity in spatial navigation
Zhang, R., Pitkow, X., & Angelaki, D. E. (2024) · Science Advances · doi:10.1126/sciadv.adk1256 · Cited by 20
Behavioral Flexibility and the Frontal Lobe
Rainer, G. (2007) · Neuron · doi:10.1016/j.neuron.2007.01.015 · Cited by 11
“Differences in response dynamics between PF cortex and the basal ganglia during a reversal learning task (Pasupathy and Miller, 2005) bear many similarities to the work of Johnston et al. For example both studies have found that task-switching-related changes in the basal ganglia and the AC cortex…”
ResultLong-range cortical synchronization supports abrupt visual learning
Csorba, B. A., Krause, M. R., Zanos, T. P., & Pack, C. C. (2022) · Current Biology · doi:10.1016/j.cub.2022.04.029 · Cited by 14
Joseph, D., Garipelli, G., & Chakravarthy, V. S. (2010) · Neurocomputing · doi:10.1016/j.neucom.2010.03.001 · Cited by 11
“The different time-courses of learning in basal ganglia and prefrontal areas (first basal ganglia and then prefrontal) observed in saccade-related behavior in monkeys provide experimental support to such hypothesis [43].”
Muralidharan, V., Mandali, A., Balasubramani, P. P., Mehta, H., Chakravarthy, V. S., & Jahanshahi, M. (2018) · Cognitive science and technology · doi:10.1007/978-981-10-8494-2_10 · Cited by 13
Baxter, M. G., & Browning, P. G. F. (2007) · Neuron · doi:10.1016/j.neuron.2007.03.008 · Cited by 11
“Other studies have highlighted the interactions between prefrontal cortex and the striatum in the modulation of response-outcome associations (for example, Pasupathy and Miller, 2005).”
BackgroundDeep brain stimulation modulates effects of motivation in Parkinson's disease
Sauleau, P., Eusébio, A., Vandenberghe, W., Nuttin, B., & Brown, P. (2009) · Neuroreport · doi:10.1097/wnr.0b013e32832aa928 · Cited by 11
MODEL-BASED NEUROIMAGING FOR COGNITIVE COMPUTING
Poznański, R. R. (2009) · Journal of Integrative Neuroscience · doi:10.1142/s021963520900223x · Cited by 10
Functional Connectivity of the Dorsal Striatum in Female Musicians
Tanaka, S., & Kirino, E. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00178 · Cited by 14
“The striatum is thought to provide instructions to the cortex (Graybiel, 2005), because learning-related changes occur earlier in the striatum than in the PFC of monkeys performing reversals in a conditional association task (Pasupathy and Miller, 2005).”
BackgroundIntegrative Networks Across Basal Ganglia Circuits
Haber, S. N. (2016) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-12-802206-1.00027-1 · Cited by 18
Reis, A. S., Brugnago, E. L., Caldas, I. L., Batista, A. M., Iarosz, K. C., Ferrari, F. A. S., & Viana, R. L. (2021) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0056672 · Cited by 10
“25 The areas in the cortex are organized into an architecture of neuronal networks.”
BackgroundNovelty encoding by the output neurons of the basal ganglia
Joshua (2009) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.020.2009 · Cited by 10
Ameli, M., Kemper, F., Sarfeld, A., Kessler, J., Fink, G. R., & Nowak, D. A. (2011) · Clinical Neurology and Neurosurgery · doi:10.1016/j.clineuro.2011.01.011 · Cited by 11
Maurer, L. K., Maurer, H., & Müller, H. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00226 · Cited by 10
Tan, C. O., & Bullock, D. H. (2007) · Neuroscience Letters · doi:10.1016/j.neulet.2007.10.039 · Cited by 11
Lew, S. E., Rey, H. G., Gutnisky, D. A., & Zanutto, B. S. (2007) · Neurocomputing · doi:10.1016/j.neucom.2007.09.010 · Cited by 11
Neural dynamics of accumulating and updating linguistic knowledge structuresPreprint
Berkers, R. M. W. J., van der Linden, M., Neville, D. A., van Kesteren, M. T. R., Morris, R., Murre, J. M. J., & Fernández, G. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/495168 · Cited by 10
Villalba, K., Dévieux, J. G., Rosenberg, R., & Cadet, J. L. (2016) · Genetics Research International · doi:10.1155/2016/7169172 · Cited by 9
“Moreover, a significant association between SNP rs6741892 and memory was demonstrated, which may imply SNP rs6741892 as a functional polymorphism in the GALM gene.”
BackgroundA neural network model of basal ganglia’s decision-making circuitry
Chen, X., & Yang, T. (2020) · Cognitive Neurodynamics · doi:10.1007/s11571-020-09609-2 · Cited by 9
The contributions of entorhinal cortex and hippocampus to error driven learning
Ku, S.-P., Hargreaves, E. L., Wirth, S., & SUZUKI, W. A. (2021) · Communications Biology · doi:10.1038/s42003-021-02096-z · Cited by 15
Distributed Neural Systems Support Flexible Attention Updating during Category Learning
Weichart, E. R., Evans, D. G., Galdo, M., Bahg, G., & Turner, B. M. (2022) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01882 · Cited by 10
“…1998), and pFC activation is the earliest predictor of the choice after category distinctions have been acquired (Antzoulatos&Miller, 2011, 2014; Pasupathy & Miller, 2005; Djurfeldt, Eleberg, & Graybiel, 2001). pFC has additionally been shown to be involved in error monitoring and corrective…”
BackgroundDíaz, E., Vargas, J. P., Quintero, E., la Casa, L. G. D., O’Donnell, P., & López, J. C. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.02.008 · Cited by 11
“The poor functioning of these systems could be involved in learning deficits observed in patient with mental disorders (Grace & Sesack, 2010; Homayoun & Moghaddam, 2009; Milad & Rauch, 2012; Pasupathy & Miller, 2005; Simpson, Kellendonk, & Kandel, 2010).”
BackgroundWang, L., Li, X., Hsiao, S. S., Bodner, M., Lenz, F. A., & Zhou, Y. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00169 · Cited by 10
“This is consistent with other studies (Pasupathy & Miller, 2005; Messinger, Squire, Zola, & Albright, 2001).”
ResultInfluentialA Reservoir Computing Model of Reward-Modulated Motor Learning and Automaticity
Pyle, R., & Rosenbaum, R. (2019) · Neural Computation · doi:10.1162/neco_a_01198 · Cited by 13
“…the basal ganglia are responsible for early learning but train a parallel cortical pathway that gradually takes over the generation of output as tasks become well learned and “automatized” (Pasupathy & Miller, 2005; Ashby et al., 2007, 2010; Turner & Desmurget, 2010; Hélie, Paul, & Ashby, 2012).”
BackgroundInfluentialReinforcement Learning Embedded in Brains and Robots
Weber, C., Elshaw, M., Wermter, S., Triesch, J., & Willmot, C. (2008) · doi:10.5772/5278 · Cited by 9
Metadata
- Authors
- Pasupathy, A., & Miller, E. K.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Pasupathy, Anitha
- Venue
- Nature
- Published
- 2005-02
- Volume
- 433
- Issue
- 7028
- Pages
- 873-876
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2068949971
- Cited by
- 712
- References
- 33
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 20 · 2023: 17 · 2022: 12 · 2021: 25 · 2020: 22 · 2019: 26 · 2018: 32 · 2017: 23 · 2016: 40 · 2015: 39 · 2014: 42 · 2013: 37 · 2012: 37
- FWCI
- 28.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- associative learning, prefrontal cortex, striatum, basal ganglia, time course of learning, monkeys, rule induction, neural correlates of learning
- MeSH terms
- Animals, Haplorhini, Cues, Fixation, Ocular, Learning, Models, Biological, Reward, Saccades, Time Factors, Neostriatum, Prefrontal Cortex
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.