The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Dopamine modulation of learning and memory in the prefrontal cortex: insights from studies in primates, rodents, and birds
Open accessAbstract
In this review, we provide a brief overview over the current knowledge about the role of dopamine transmission in the prefrontal cortex during learning and memory. We discuss work in humans, monkeys, rats, and birds in order to provide a basis for comparison across species that might help identify crucial features and constraints of the dopaminergic system in executive function. Computational models of dopamine function are introduced to provide a framework for such a comparison. We also provide a brief evolutionary perspective showing that the dopaminergic system is highly preserved across mammals. Even birds, following a largely independent evolution of higher cognitive abilities, have evolved a comparable dopaminergic system. Finally, we discuss the unique advantages and challenges of using different animal models for advancing our understanding of dopamine function in the healthy and diseased brain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Baddeley, A. D., & Hitch, G. (1974) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60452-1 · Cited by 9,860
The episodic buffer: a new component of working memory?
Baddeley, A. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01538-2 · Cited by 7,359 · cited 1×
“…the term WM is strongly associated with its original definition by Baddeley and Hitch (1974), who famously proposed that systems for sensory storage (phonological loop, visuospatial sketchpad, and more recently, an episodic buffer) are governed by a central executive (Baddeley, 1992, 2000).”
BackgroundPredictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Functional architecture of basal ganglia circuits: neural substrates of parallel processing
Alexander, G. E., & Crutcher, M. D. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90107-l · Cited by 4,131
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Swanson, L. W. (1982) · Brain Research Bulletin · doi:10.1016/0361-9230(82)90145-9 · Cited by 1,718 · cited 1×
“However, the PFC in primates is much more extensively innervated by midbrain DA afferents than in rodents (Thierry et al., 1973; Lindvall et al., 1978; Swanson, 1982; Descarries et al., 1987; Lewis and Sesack, 1997; Björklund and Dunnett, 2007).”
BackgroundHabits, Rituals, and the Evaluative Brain
Graybiel, A. M. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112851 · Cited by 1,697 · cited 1×
“So there may be a transition from goal-directed to habit-based instrumental performance likely orchestrated by the basal ganglia (Wickens et al., 2007; Graybiel, 2008).”
BackgroundChen, J., Lipska, B. K., Halim, N., Ma, Q. D., Matsumoto, M., Melhem, S., Kolachana, B. S., Hyde, T. M., Herman, M. M., Apud, J., et al. (2004) · The American Journal of Human Genetics · doi:10.1086/425589 · Cited by 1,675
The importance of mixed selectivity in complex cognitive tasks
Rigotti, M., Barak, O., Warden, M. R., Wang, X.-J., Daw, N. D., Miller, E. K., & Fusi, S. (2013) · Nature · doi:10.1038/nature12160 · Cited by 1,639
Modulation of memory fields by dopamine Dl receptors in prefrontal cortex
Williams, G. V., & Goldman-Rakic, P. S. (1995) · Nature · doi:10.1038/376572a0 · Cited by 1,593 · cited 1×
“…extracellular DA in the PFC during WM tasks (Watanabe et al., 1997) that exerts its actions via local D1R (Sawaguchi and Goldman-Rakic, 1991, 1994; Williams and Goldman-Rakic, 1995; Murphy et al., 1996; Collins et al., 1998; Robbins, 2000; Seamans and Yang, 2004; Castner and Williams, 2007;…”
BackgroundThe principal features and mechanisms of dopamine modulation in the prefrontal cortex
Seamans, J. K., & Yang, C. R. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.05.006 · Cited by 1,592
Cognitive Deficit Caused by Regional Depletion of Dopamine in Prefrontal Cortex of Rhesus Monkey
Brozoski, T. J., Brown, R. M., Rosvold, H. E., & Goldman, P. S. (1979) · Science · doi:10.1126/science.112679 · Cited by 1,500
Multiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378
D1 Dopamine Receptors in Prefrontal Cortex: Involvement in Working Memory
Sawaguchi, T., & Goldman-Rakic, P. S. (1991) · Science · doi:10.1126/science.1825731 · Cited by 1,364 · cited 1×
“…showed that there is an increase of extracellular DA in the PFC during WM tasks (Watanabe et al., 1997) that exerts its actions via local D1R (Sawaguchi and Goldman-Rakic, 1991, 1994; Williams and Goldman-Rakic, 1995; Murphy et al., 1996; Collins et al., 1998; Robbins, 2000; Seamans and…”
BackgroundInput-specific control of reward and aversion in the ventral tegmental area
Lammel, S., Lim, B. K., Ran, C., Huang, K. W., Betley, M. J., Tye, K. M., Deisseroth, K., & Malenka, R. C. (2012) · Nature · doi:10.1038/nature11527 · Cited by 1,300
Subsecond dopamine release promotes cocaine seeking
Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003) · Nature · doi:10.1038/nature01476 · Cited by 1,113
Inverted-U dopamine D1 receptor actions on prefrontal neurons engaged in working memory
Vijayraghavan, S., Wang, M., Birnbaum, S. G., Williams, G. V., & Arnsten, A. F. T. (2007) · Nature Neuroscience · doi:10.1038/nn1846 · Cited by 1,013 · cited 2×
“A D1R agonist modulates persistent activity during memory delays following an inverted-U response, whereby low levels of D1R stimulation enhance spatial tuning whereas high levels reduce it (Vijayraghavan et al., 2007).”
BackgroundMesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967
Interactions between frontal cortex and basal ganglia in working memory: A computational model
FRANK, M. J., LOUGHRY, B., & O'REILLY, R. C. (2001) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.1.2.137 · Cited by 879 · cited 1×
“This matches a series of computational modeling studies in which PFC becomes part of the system that determines the value of the current state and propagates this information to the DA system (e.g., Frank et al., 2001; O’Reilly and Frank, 2006; Hazy et al., 2007).”
BackgroundZahrt, J., Taylor, J. R., Mathew, R. G., & Arnsten, A. F. T. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-21-08528.1997 · Cited by 796
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712 · cited 1×
“The monkey lateral PFC has also been implicated in associative stimulus-response learning (Asaad et al., 1998; Pasupathy and Miller, 2005; Histed et al., 2009; Antzoulatos and Miller, 2011; Puig and Miller, 2012, 2014).”
BackgroundAssociative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
Day, J. J., Roitman, M. F., Wightman, R. M., & Carelli, R. M. (2007) · Nature Neuroscience · doi:10.1038/nn1923 · Cited by 710
Structural Brain Imaging of Attention-Deficit/Hyperactivity Disorder
Seidman, L. J., Valera, E. M., & Makris, N. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.11.019 · Cited by 676
Updating dopamine reward signals
Schultz, W. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.012 · Cited by 651 · cited 2×
“Reward-prediction error responses of DA cells might be critically involved in these learning processes (Schultz, 1998, 2007, 2013; see above).”
BackgroundBrunel, N., & Wang, X.-J. (2001) · Journal of Computational Neuroscience · doi:10.1023/a:1011204814320 · Cited by 620
Durstewitz, D., & Seamans, J. K. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.05.015 · Cited by 586
Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons
Morris, G., Arkadir, D., Nevet, A., Vaadia, E., & Bergman, H. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.012 · Cited by 574
Dopamine D1 receptor mechanisms in the cognitive performance of young adult and aged monkeys
Arnsten, A. F. T., Cai, J. X., Murphy, B. L., & Goldman-Rakic, P. S. (1994) · Psychopharmacology · doi:10.1007/bf02245056 · Cited by 566
Prolonged dopamine signalling in striatum signals proximity and value of distant rewards
Howe, M. W., Tierney, P. L., Sandberg, S. G., Phillips, P. E. M., & Graybiel, A. M. (2013) · Nature · doi:10.1038/nature12475 · Cited by 565
Arnsten, A. F. T., Wang, M. J., & Paspalas, C. D. (2012) · Neuron · doi:10.1016/j.neuron.2012.08.038 · Cited by 538
Kellendonk, C., Simpson, E. H., Polan, H. J., Malleret, G., Vronskaya, S., Winiger, V., Moore, H., & Kandel, E. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.01.023 · Cited by 520
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503
Catecholamine Influences on Dorsolateral Prefrontal Cortical Networks
Arnsten, A. F. T. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.01.027 · Cited by 493 · cited 1×
“More recent work has evidenced that an optimal level of D1R tone is required for adequate WM performance, and this may be particularly vulnerable to changes in arousal state such as fatigue or stress (Arnsten et al., 2010; Arnsten, 2011).”
BackgroundPan, W.-X., Schmidt, R., Wickens, J. R., & Hyland, B. I. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1478-05.2005 · Cited by 429
Self-citationMesocortical dopamine modulation of executive functions: beyond working memory
Floresco, S. B., & Magyar, O. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0404-5 · Cited by 426
Tseng, K. Y., & O'Donnell, P. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1021-04.2004 · Cited by 402
Prefrontal Serotonin Depletion Affects Reversal Learning But Not Attentional Set Shifting
Clarke, H. F., Walker, S. C., Crofts, H. S., Dalley, J. W., Robbins, T. W., & Roberts, A. C. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3690-04.2005 · Cited by 358
Clarke, H., Walker, S., Dalley, J., Robbins, T., & Roberts, A. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj120 · Cited by 351
Floresco, S. B. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00062 · Cited by 336
Selective D2 receptor actions on the functional circuitry of working memory
Wang, M., Vijayraghavan, S., & Goldman-Rakic, P. S. (2004) · Science · doi:10.1126/science.1091162 · Cited by 319 · cited 1×
“By contrast, D2R have little effect on delay activity and instead modulate the motor component of the task, suggesting some contribution of PFC D2R to motor control function (Wang et al., 2004).”
BackgroundCai, J. X., & Arnsten, A. F. T. (1997) · The Journal of Pharmacology and Experimental Therapeutics · doi:10.1016/s0022-3565(24)36983-6 · Cited by 285
Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex
Takahashi, Y. K., Roesch, M. R., Wilson, R. C., Toreson, K., O'Donnell, P., Niv, Y., & Schoenbaum, G. (2011) · Nature Neuroscience · doi:10.1038/nn.2957 · Cited by 280
Differential regulation of fronto-executive function by the monoamines and acetylcholine
Robbins, T., & Roberts, A. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm066 · Cited by 279
Dopaminergic Mechanisms in Actions and Habits: Figure 1.
Wickens, J. R., Horvitz, J. C., Costa, R. M., & Killcross, S. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1671-07.2007 · Cited by 271 · cited 1×
“So there may be a transition from goal-directed to habit-based instrumental performance likely orchestrated by the basal ganglia (Wickens et al., 2007; Graybiel, 2008).”
BackgroundClarke, H. F., Robbins, T. W., & Roberts, A. C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1521-08.2008 · Cited by 263
Similar roles of substantia nigra and ventral tegmental dopamine neurons in reward and aversion
Ilango, A., Kesner, A. J., Keller, K. L., Stuber, G. D., Bonci, A., & Ikemoto, S. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.1703-13.2014 · Cited by 255
O'Reilly, R. C. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.3.246 · Cited by 241
Mesocortical Dopamine Neurons Operate in Distinct Temporal Domains Using Multimodal Signaling
Lavin, A., Nogueira, L., Lapish, C. C., Wightman, R. M., Phillips, P. E. M., & Seamans, J. K. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0557-05.2005 · Cited by 233 · cited 2×
“…also well-suited to support the on- and offset of WM-related persistent activity (Box 2), it remains unclear whether the timescales of DA modulation of the PFC firing are fast enough (Cohen et al., 2002; O’Reilly et al., 2002; Seamans and Yang, 2004; Lavin et al., 2005; Sheynikhovich et al., 2013).”
Background(2013) · doi:10.1002/cne.23404 · Cited by 224 · cited 1×
“In other words, in spite of a shared evolutionary ancestry and a similar functionality, the avian and mammalian “cortex” look entirely different: what has evolved into layers in the mammalian brain might have evolved into different regions in the avian brain (Jarvis et al., 2013).”
BackgroundOrganization and evolution of the avian forebrain
Reiner, A., Yamamoto, K., & Karten, H. J. (2005) · The Anatomical Record Part A: Discoveries in Molecular, Cellular, and Evolutionary Biology · doi:10.1002/ar.a.20253 · Cited by 222 · cited 2×
“The lines of birds and mammals separated around 300 million years ago, long before many of the cognitive functions attributed to the PFC evolved (Jarvis et al., 2005; Reiner et al., 2005; Jarvis, 2009; Rose et al., 2009a).”
BackgroundInfluentialBrown, T. E. (2006) · International Journal of Disability, Development and Education · doi:10.1080/10349120500510024 · Cited by 215 · cited 1×
“Furthermore, research conducted in attention deficit hyperactivity disorder (ADHD) patients, who also display learning and memory deficits, have also provided some insight into the role of DA in learning and memory (Brown, 2006; Alderson et al., 2013).”
BackgroundGee, S., Ellwood, I., Patel, T., Luongo, F., Deisseroth, K., & Sohal, V. S. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5835-11.2012 · Cited by 214
Rosenberg, D. R., & Lewis, D. A. (1994) · Biological Psychiatry · doi:10.1016/0006-3223(94)90610-6 · Cited by 174
Dopamine, but not serotonin, regulates reversal learning in the marmoset caudate nucleus
Clarke, H. F., Hill, G. J., Robbins, T. W., & Roberts, A. C. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5066-10.2011 · Cited by 144
Olver, J. S., Pinney, M., Maruff, P., & Norman, T. R. (2015) · Stress and Health · doi:10.1002/smi.2533 · Cited by 114
Lataster, J., Collip, D., Ceccarini, J., Haas, D., Booij, L., van Os, J., Pruessner, J., Van Laere, K., & Myin-Germeys, I. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.030 · Cited by 109
Developmental changes in human dopamine neurotransmission: cortical receptors and terminators
Rothmond, D. A., Weickert, C. S., & Webster, M. J. (2012) · BMC Neuroscience · doi:10.1186/1471-2202-13-18 · Cited by 97 · cited 1×
“…of human postmortem brain tissue reveal that the levels of mRNA expression of the D2R and D5R subtypes in PFC are highest in neonates and infants and decrease with age, whereas the D1R subtype mRNA expression and protein levels increase with age and are highest in adulthood (Rothmond et al., 2012).”
BackgroundDruzin, M. Y., Kurzina, N. P., Malinina, E. P., & Kozlov, A. P. (2000) · Behavioural Brain Research · doi:10.1016/s0166-4328(99)00166-7 · Cited by 59 · cited 6×
“Another study using a comparable range of delays (0–16 s) found that intra-PFC infusions of a D1R agonist, but not a D2R antagonist, could disrupt or facilitate performance in a task designed to account for the contribution of attention to WM. Importantly, this work suggested that different levels of DA may be require…”
ResultInfluentialClarke, H. F., Cardinal, R. N., Rygula, R., Hong, Y. T., Fryer, T. D., Sawiak, S. J., Ferrari, V., Cockcroft, G., Aigbirhio, F. I., Robbins, T. W., et al. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0718-14.2014 · Cited by 54 · cited 1×
“In contrast, DA, but not serotonin, depletions in the caudate nucleus disrupt reversal learning, revealing striking neurochemical dissociations between the DAergic and serotonergic neuromodulatory systems in fronto-striatal circuits (Clarke et al., 2011, 2014).”
BackgroundArnsten, A. F. T., & Goldman-Rakic, P. S. (1998) · Archives of General Psychiatry · doi:10.1001/archpsyc.55.4.362 · Cited by 6
Cited by
Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development?
Eckstein, M. K., Guerra-Carrillo, B., Miller Singley, A. T., & Bunge, S. A. (2017) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2016.11.001 · Cited by 686
Xing, B., Li, Y.-C., & Gao, W.-J. (2016) · Brain Research · doi:10.1016/j.brainres.2016.01.005 · Cited by 196
The Diversity of Cortical Inhibitory Synapses
Kubota, Y., Karube, F., Nomura, M., & Kawaguchi, Y. (2016) · Frontiers in Neural Circuits · doi:10.3389/fncir.2016.00027 · Cited by 180
Extensive accumulation of misfolded protein aggregates during natural aging and senescence
Cuanalo-Contreras, K., Schulz, J., Mukherjee, A., Park, K.-W., Armijo, E., & Soto, C. (2023) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2022.1090109 · Cited by 92
Andica, C., Kamagata, K., Hatano, T., Okuzumi, A., Saito, A., Nakazawa, M., Ueda, R., Motoi, Y., Kamiya, K., Suzuki, M., et al. (2018) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2018.02.046 · Cited by 60
Metadata
- Authors
- Puig, M. V., Rose, J., Schmidt, R., & Freund, N.
- Venue
- Frontiers in Neural Circuits
- Publisher
- Frontiers Media SA
- Published
- 2014-08-05
- Volume
- 8
- Pages
- 93-93
- ISSN
- 1662-5110 (ISSN-L)
- OpenAlex
- W2080617748
- Cited by
- 184
- References
- 62
- FWCI
- 4.96
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.