A “Good Parent” Function of Dopamine: Transient Modulation of Learning and Performance during Early Stages of Training
Open accessAbstract
While extracellular dopamine (DA) concentrations are increased by a wide category of salient stimuli, there is evidence to suggest that DA responses to primary and conditioned rewards may be distinct from those elicited by other types of salient events. A reward-specific mode of neuronal responding would be necessary if DA acts to strengthen behavioral response tendencies under particular environmental conditions or to set current environmental inputs as goals that direct approach responses. As described in this review, DA critically mediates both the acquisition and expression of learned behaviors during early stages of training, however, during later stages, at least some forms of learned behavior become independent of (or less dependent upon) DA transmission for their expression.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Dopamine plays a role not only in reinforced learning but also in the expression of previously-learned behaviors.
“Dopamine plays a role not only in reinforced learning, but also in the expression of previously-learned behaviors [42–44].”
From Cortical and basal ganglia contributions to habit learning and automaticity (2010) · cites this paper as [42]
Dopamine appears to play a diminishing role in behavioral expression over the course of extended training.
“Of particular interest, dopamine appears to play a diminishing role in behavioral expression over the course of extended training [38, 42].”
From Cortical and basal ganglia contributions to habit learning and automaticity (2010) · cites this paper as [42]
Cites
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
Wise, R. A., & Rompre, P.-P. (1989) · Annual Review of Psychology · doi:10.1146/annurev.ps.40.020189.001203 · Cited by 1,968 · see citing works
Actions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217 · see citing works
Abercrombie, E. D., Keefe, K. A., DiFrischia, D. S., & Zigmond, M. J. (1989) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.1989.tb09224.x · Cited by 1,106 · see citing works
Neuroleptics and operant behavior: The anhedonia hypothesis
Wise, R. A. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00010372 · Cited by 1,022 · see citing works
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967 · see citing works
Self-citationSCH 23390, a potential benzazepine antipsychotic with unique interactions on dopaminergic systems.
Iorio, L. C., Barnett, A., Leitz, F. H., Houser, V. P., & Korduba, C. A. (1983) · Journal of Pharmacology and Experimental Therapeutics · doi:10.1016/s0022-3565(25)21599-3 · Cited by 896 · see citing works
The role of dopamine in locomotor activity and learning
Beninger, R. J. (1983) · Brain Research Reviews · doi:10.1016/0165-0173(83)90038-3 · Cited by 848 · see citing works
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844 · see citing works
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829 · see citing works
Salamone, J. D., & Correa, M. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00282-6 · Cited by 817 · see citing works
Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli
Ungless, M. A., Magill, P. J., & Bolam, J. P. (2004) · Science · doi:10.1126/science.1093360 · Cited by 782 · see citing works
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762 · see citing works
Greengard, P., Allen, P. B., & Nairn, A. C. (1999) · Neuron · doi:10.1016/s0896-6273(00)80798-9 · Cited by 743 · see citing works
The involvement of nucleus accumbens dopamine in appetitive and aversive motivation
Salamone, J. D. (1994) · Behavioural Brain Research · doi:10.1016/0166-4328(94)90153-8 · Cited by 584 · see citing works
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506 · see citing works
Dopamine: generalization and bonuses
Kakade, S. M., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00048-5 · Cited by 477 · see citing works
The basal ganglia and posture.
MARTIN, J. P. (1967) · Medical Entomology and Zoology · Cited by 470 · see citing works
Amphetamine Exposure Enhances Habit Formation
Nelson, A., & Killcross, S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4305-05.2006 · Cited by 445 · see citing works
Bidirectional Regulation of DARPP-32 Phosphorylation by Dopamine
Nishi, A., Snyder, G. L., & Greengard, P. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-21-08147.1997 · Cited by 424 · see citing works
Kerr, J. N. D., & Wickens, J. R. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.1.117 · Cited by 384 · see citing works
Calabresi, P., Gubellini, P., Centonze, D., Picconi, B., Bernardi, G., Chergui, K., Svenningsson, P., Fienberg, A. A., & Greengard, P. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-22-08443.2000 · Cited by 379 · see citing works
Dopaminergic control of synaptic plasticity in the dorsal striatum
Centonze, D., Picconi, B., Gubellini, P., Bernardi, G., & Calabresi, P. (2001) · European Journal of Neuroscience · doi:10.1046/j.0953-816x.2001.01485.x · Cited by 361 · see citing works
Schultz, W., & Romo, R. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.607 · Cited by 334 · see citing works
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326 · see citing works
Smith‐Roe, S. L., & Kelley, A. E. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-20-07737.2000 · Cited by 321 · see citing works
Suaud-Chagny, M. F., Chergui, K., Chouvet, G., & Gonon, F. (1992) · Neuroscience · doi:10.1016/0306-4522(92)90076-e · Cited by 307 · see citing works
Dopamine D1-like Receptors and Reward-related Incentive Learning
Beninger, R. J. (1998) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(97)00019-5 · Cited by 299 · see citing works
Abnormal Synaptic Plasticity in the Striatum of Mice Lacking Dopamine D2 Receptors
Calabresi, P., Saiardi, A., Pisani, A., Baik, J., Centonze, D., Mercuri, N. B., Bernardi, G., & Borrelli, E. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-12-04536.1997 · Cited by 287 · see citing works
A neurobiological theory of automaticity in perceptual categorization
Ashby, F. G., Ennis, J. M., & Spiering, B. J. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.632 · Cited by 286 · see citing works
Selective association and conditioning
Kamin, L. J. (1969) · Medical Entomology and Zoology · Cited by 285 · see citing works
Carli, M., Evenden, J. L., & Robbins, T. W. (1985) · Nature · doi:10.1038/313679a0 · Cited by 284 · see citing works
Neural mechanisms of reward-related motor learning
Wickens, J. R., Reynolds, J. N., & Hyland, B. I. (2003) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2003.10.013 · Cited by 284 · see citing works
Cepeda, C., Colwell, C. S., Itri, J. N., Chandler, S. H., & Levine, M. S. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.79.1.82 · Cited by 283 · see citing works
Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat
Horvitz, J. C., Stewart, T., & Jacobs, B. L. (1997) · Brain Research · doi:10.1016/s0006-8993(97)00265-5 · Cited by 283 · see citing works
Self-citationRussell, W. R. (1968) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.31.2.200 · Cited by 281 · see citing works
Latent inhibition of conditioned dopamine release in rat nucleus accumbens
Young, A. M. J., Joseph, M. H., & Gray, J. A. (1993) · Neuroscience · doi:10.1016/0306-4522(93)90378-s · Cited by 261 · see citing works
Dopamine gating of forebrain neural ensembles
O’Donnell, P. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02463.x · Cited by 253 · see citing works
West, A. R., & Grace, A. A. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-01-00294.2002 · Cited by 252 · see citing works
Kiyatkin, E. A., & Rebec, G. V. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.1.142 · Cited by 243 · see citing works
Effects of cocaine and footshock stress on extracellular dopamine levels in the ventral striatum
Sorg, B. A., & Kalivas, P. W. (1991) · Brain Research · doi:10.1016/0006-8993(91)90283-2 · Cited by 241 · see citing works
WILLED ACTION AND ITS IMPAIRMENTS
Jahanshahi, M. (1998) · Cognitive Neuropsychology · doi:10.1080/026432998381005 · Cited by 229 · see citing works
Dalley, J. W., Lääne, K., Theobald, D. E. H., Armstrong, H. C., Corlett, P. R., Chudasama, Y., & Robbins, T. W. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502080102 · Cited by 214 · see citing works
Guarraci, F. A., & Kapp, B. S. (1999) · Behavioural Brain Research · doi:10.1016/s0166-4328(98)00102-8 · Cited by 201 · see citing works
Horvitz, J. C. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00285-1 · Cited by 201 · see citing works
Self-citationBaldwin, A. E., Sadeghian, K., & Kelley, A. E. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-03-01063.2002 · Cited by 191 · see citing works
Striatal dopamine in motor activation and reward-mediated learning: steps towards a unifying model
Wickens, J. R. (1990) · Journal of Neural Transmission · doi:10.1007/bf01245020 · Cited by 145 · see citing works
Hemmings, H. C., Nairn, A. C., & Greengard, P. (1984) · Journal of Biological Chemistry · doi:10.1016/s0021-9258(17)42626-3 · Cited by 143 · see citing works
Extended habit training reduces dopamine mediation of appetitive response expression
Choi, W. Y., Balsam, P. D., & Horvitz, J. C. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1498-05.2005 · Cited by 122 · see citing works
Self-citationDopamine, neuroleptics and reinforced behavior
Ettenberg, A. (1989) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(89)80018-1 · Cited by 116 · see citing works
Carelli, R. M., Wolske, M., & West, M. O. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-05-01804.1997 · Cited by 114 · see citing works
Lahti, A. C., Weiler, M. A., Corey, P. K., et al. (1998) · Biological Psychiatry · doi:10.1016/s0006-3223(97)00030-9 · Cited by 104 · see citing works
Rapid contextual conditioning in autoshaping.
Balsam, P. D., & Schwartz, A. L. (1981) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.7.4.382 · Cited by 90 · see citing works
Self-citationOpposing Roles of D1and D2Receptors in Appetitive Conditioning
Eyny, Y. S., & Horvitz, J. C. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-05-01584.2003 · Cited by 86 · see citing works
Self-citationWhich Motor Disorder in Parkinson's Disease Indicates the True Motor Function of the Basal Ganglia?
Marsden, C. D. (1984) · Novartis Foundation symposium · doi:10.1002/9780470720882.ch12 · Cited by 83 · see citing works
Takikawa, Y., Kawagoe, R., & Hikosaka, O. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00238.2004 · Cited by 82 · see citing works
Hernandez, P. J., Andrzejewski, M. E., Sadeghian, K., Panksepp, J. B., & Kelley, A. E. (2005) · Learning & Memory · doi:10.1101/lm.93105 · Cited by 79 · see citing works
Horvitz, J. C., & Ettenberg, A. (1988) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(88)90396-6 · Cited by 75 · see citing works
Self-citationAzzara, A. V., Bodnar, R. J., Delamater, A. R., & Sclafani, A. J. (2001) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(01)00484-1 · Cited by 74 · see citing works
Response of dopaminergic neurons in cat to auditory stimuli presented across the sleep-waking cycle
Steinfels, G. F., Heym, J. H., Strecker, R. E., & Jacobs, B. L. (1983) · Brain Research · doi:10.1016/0006-8993(83)90917-4 · Cited by 60 · see citing works
Kiaytkin, E. A. (1988) · International Journal of Neuroscience · doi:10.3109/00207458808985756 · Cited by 59 · see citing works
Ahlénius, S., Hillegaart, V., Thorell, G., et al. (1987) · Brain Research · doi:10.1016/0006-8993(87)91055-9 · Cited by 54 · see citing works
Deficits in the evolution of hand preshaping in Parkinson’s disease
Schettino, L. F., Rajaraman, V., Jack, D., Adamovich, S., Sage, J., & Howard Poizner, A. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(03)00150-7 · Cited by 50 · see citing works
Fowler, S. C., & Liou, J.-R. (1998) · Psychopharmacology · doi:10.1007/s002130050742 · Cited by 49 · see citing works
Altar, C. A., Boyar, W. C., Oei, E. J., & Wood, P. L. (1987) · Journal of Pharmacology and Experimental Therapeutics · doi:10.1016/s0022-3565(25)39040-3 · Cited by 46 · see citing works
Voluntary vs autonomous control of repetitive finger tapping in a patient with Parkinson's disease
Frischer, M. (1989) · Neuropsychologia · doi:10.1016/0028-3932(89)90038-9 · Cited by 29 · see citing works
Yamamoto, Y., Nakanishi, H., Takai, N., et al. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00611-3 · Cited by 28 · see citing works
Balsam, P. D., & Gibbon, J. (1988) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.14.4.401 · Cited by 25 · see citing works
Self-citationHorvitz, J. C., & Eyny, Y. S. (2000) · Behavioral Neuroscience · doi:10.1037/0735-7044.114.5.934 · Cited by 19 · see citing works
Self-citationFunctional Classification of Different Dopamine Receptors
Ungerstedt, U., Herrera‐Marschitz, M., Ståhle, L., et al. (1985) · Psychopharmacology series · doi:10.1007/978-3-642-70140-5_3 · Cited by 13 · see citing works
Stern, E. R., Horvitz, J. C., COTE, L. J., & Mangels, J. A. (2005) · Neuropsychology · doi:10.1037/0894-4105.19.1.54 · Cited by 11 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Cortical and basal ganglia contributions to habit learning and automaticity
Ashby, F. G., Turner, B. O., & Horvitz, J. C. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.02.001 · Cited by 481 · see citing works
Self-citationZweifel, L. S., Parker, J. G., Lobb, C. J., Rainwater, A., Wall, V. Z., Fadok, J. P., Darvas, M., Kim, M. J., Mizumori, S. J. Y., Paladini, C. A., et al. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0813415106 · Cited by 426 · see citing works
Stimulus-response and response-outcome learning mechanisms in the striatum
Horvitz, J. C. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.014 · Cited by 58 · see citing works
Self-citation
- Authors
- HORVITZ, J. C., CHOI, W. Y., MORVAN, C., EYNY, Y., & BALSAM, P. D.
- Affiliations
- Boston College (US)
- Columbia University (US)
- New York State Psychiatric Institute (US)
- Corresponding author
- HORVITZ, JON C.
- Venue
- Annals of the New York Academy of Sciences
- Publisher
- Wiley
- Published
- 2007-05
- Volume
- 1104
- Issue
- 1
- Pages
- 270-288
- ISSN
- 0077-8923 (ISSN-L)
- 1749-6632
- PMC
- PMC2827849
- OpenAlex
- W2046007632
- Cited by
- 26
- References
- 74
- Citations by year
- 2025: 1 · 2022: 2 · 2020: 1 · 2018: 1 · 2017: 1 · 2016: 1 · 2015: 2 · 2014: 2 · 2013: 1 · 2012: 2
- FWCI
- 0.25
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Annals of the New York Academy of Sciences (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Drug Abuse (R01DA023641)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neuropharmacology Research
- Keywords
- dopamine, reward, primary reward, conditioned reward, salient stimuli, learning, goal-directed behavior, approach behavior, dopamine signaling
- MeSH terms
- Animals, Behavior, Behavior, Animal, Benzazepines, Dopamine, Electrophysiology, Humans, Learning, Models, Biological, Models, Neurological, Neurons, Parkinson Disease, Reward, Dopamine Antagonists, Raclopride
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review