Is the short-latency dopamine response too short to signal reward error?
Abstract
Unexpected stimuli that are behaviourally significant have the capacity to elicit a short-latency, short-duration burst of firing in mesencephalic dopaminergic neurones. An influential interpretation of the experimental data that characterize this response proposes that dopaminergic neurones have a crucial role in reinforcement learning because they signal error in the prediction of future reward. In this article we propose a different functional role for this 'short-latency dopamine response' in the mechanisms that underlie associative learning. We suggest that the initial burst of dopaminergic-neurone firing could represent an essential component in the process of switching attentional and behavioural selections to unexpected, behaviourally important stimuli. This switching response could be a crucial prerequisite for associative learning and might be part of a general short-latency response that is mediated by catecholamines and prepares the organism for an appropriate reaction to biologically significant events. Any act which in a given situation produces satisfaction becomes associated with that situation so that when the situation recurs the act is more likely than before to recur also. E.L. Thorndike (1911) 1.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Reward-related mesolimbic dopamine steers animal behavior, creating automatic approach toward reward-associated objects and avoidance of objects unlikely to be beneficial.
“Reward-related mesolimbic dopamine steers animal behavior, creating automatic approach toward reward-associated objects and avoidance of objects unlikely to be beneficial.”
From Reward Changes Salience in Human Vision via the Anterior Cingulate (2010) · cites this paper as Redgrave et al., 1999
The Introduction (p. 3) says rewarding stimuli elicit approach, and the discussion (p. 6) links dopamine responses to switching behavior to locate and acquire reward. But the paper does not establish that mesolimbic dopamine automatically produces approach or avoidance of objects unlikely to be beneficial. In Response generalisation (p. 8), a never-baited box evokes a dopamine response and orienting, although the monkey does not reach for it. (LLM, conf=0.86)
Experimental — accuracy not yet measuredTheories of the function of dopamine in reinforcement learning and animal approach behavior place reward firmly at the center of attentional control.
“theories of the function of dopamine in reinforcement learning and animal approach behavior place reward firmly at the center of attentional control (Berridge and Robinson, 1998; Ikemoto and Panksepp, 1999; Redgrave et al., 1999; Wise, 2004; Alcaro et al., 2007).”
From Reward Changes Salience in Human Vision via the Anterior Cingulate (2010) · cites this paper as Redgrave et al., 1999
The introduction (p. 3) describes a popular theory in which dopamine signals reinforcement and influences action selection, and notes that rewarding stimuli elicit approach. But it does not say that these reward-centered theories put reward at the center of attentional control. Instead, the authors propose that dopamine reallocates attention toward unexpected biologically significant events, including non-rewarding ones (pp. 3, 6). (LLM, conf=0.83)
Experimental — accuracy not yet measuredRecognition of the two-component structure of phasic dopamine responses may resolve earlier controversies that suggested an attentional rather than rewarding role of the dopamine prediction-error signal.
“Recognition of the two-component structure of phasic dopamine responses may also resolve earlier controversies, which suggested an attentional rather than rewarding role of the dopamine prediction-error signal64,65 on the basis of activations following exposure to physically salient stimuli16,20 and punishers24.”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [64]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
(1961) · Information and Control · doi:10.1016/s0019-9958(61)80064-8 · Cited by 2,904 · see citing works
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
Mink, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,478 · see citing works
The basal ganglia: a vertebrate solution to the selection problem?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00319-4 · Cited by 1,199 · see citing works
Self-citationModels of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works
Contemporary Animal Learning Theory
LoLordo, V. M., & Dickinson, A. (1982) · The American Journal of Psychology · doi:10.2307/1422669 · Cited by 891 · see citing works
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829 · see citing works
Dopamine neurons and their role in reward mechanisms
Schultz, W. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80007-4 · Cited by 769 · see citing works
The functions of the basal ganglia and the paradox of stereotaxic surgery in Parkinson's disease
Marsden, C. D., & Obeso, J. A. (1994) · Brain · doi:10.1093/brain/117.4.877 · Cited by 718 · see citing works
Aston‐Jones, G., Chiang, C., & Alexinsky, T. (1991) · Progress in brain research · doi:10.1016/s0079-6123(08)63830-3 · Cited by 589 · see citing works
The involvement of nucleus accumbens dopamine in appetitive and aversive motivation
Salamone, J. D. (1994) · Behavioural Brain Research · doi:10.1016/0166-4328(94)90153-8 · Cited by 584 · see citing works
The mesolimbic dopamine system : from motivation to action
Willner, P., & Scheel‐Krüger, J. (1991) · Wiley eBooks · Cited by 556 · see citing works
Hikosaka, O., & Wurtz, R. H. (1983) · Journal of Neurophysiology · doi:10.1152/jn.1983.49.5.1230 · Cited by 524 · see citing works
The Mesolimbic Dopamine System: From Motivation to Action
Phillipson, O. T. (1992) · Trends in Neurosciences · doi:10.1016/0166-2236(92)90348-c · Cited by 517 · see citing works
Salamone, J. D., Cousins, M. S., & Snyder, B. J. (1997) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(96)00017-6 · Cited by 514 · see citing works
Burst firing in midbrain dopaminergic neurons
Overton, P. G., & Clark, D. (1997) · Brain Research Reviews · doi:10.1016/s0165-0173(97)00039-8 · Cited by 466 · see citing works
Koob, G. F., Riley, S. J., Smith, S. C., & Robbins, T. W. (1978) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0077542 · Cited by 416 · see citing works
Neural substrates of latent inhibition: The switching model.
Weiner, I. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.442 · Cited by 380 · see citing works
Schultz, W., & Romo, R. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.607 · Cited by 334 · see citing works
The role of noradrenaline in tuning and dopamine in switching between signals in the CNS
Oades, R. D. (1985) · Neuroscience & Biobehavioral Reviews · doi:10.1016/0149-7634(85)90050-8 · Cited by 306 · see citing works
Dopamine D1-like Receptors and Reward-related Incentive Learning
Beninger, R. J. (1998) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(97)00019-5 · Cited by 299 · see citing works
Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat
Horvitz, J. C., Stewart, T., & Jacobs, B. L. (1997) · Brain Research · doi:10.1016/s0006-8993(97)00265-5 · Cited by 283 · see citing works
Cools, A. R. (1980) · Behavioural Brain Research · doi:10.1016/0166-4328(80)90035-2 · Cited by 283 · see citing works
Models of information processing in the basal Ganglia
Hikosaka, O. (1995) · Trends in Neurosciences · doi:10.1016/0166-2236(95)90004-7 · Cited by 248 · see citing works
Sensorimotor integration in the primate superior colliculus. I. Motor convergence
Jay, M. F., & Sparks, D. L. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.22 · Cited by 211 · see citing works
Schultz, W., & Romo, R. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.201 · Cited by 184 · see citing works
(1993) · Elsevier eBooks · doi:10.1016/c2009-0-35344-1 · Cited by 161 · see citing works
Midbrain dopamine system electrophysiological functioning: A review and new hypothesis
Bunney, B. S., Chiodo, L. A., & Grace, A. A. (1991) · Synapse · doi:10.1002/syn.890090202 · Cited by 160 · see citing works
Young, A. M. J., Ahier, R. G., Upton, R. L., Joseph, M. H., & Gray, J. A. (1998) · Neuroscience · doi:10.1016/s0306-4522(97)00483-1 · Cited by 149 · see citing works
The Role of the Striatum in the Mental Chronometry of Action: A Theoretical Review
Robbins, T. W., & Brown, V. J. (1990) · Reviews in the Neurosciences · doi:10.1515/revneuro.1990.2.4.181 · Cited by 108 · see citing works
The superior colliculus and eye movement control
Moschovakis, A. K. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80032-8 · Cited by 105 · see citing works
Network models of the basal ganglia
Beiser, D. G., Hua, S. E., & Houk, J. C. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80006-2 · Cited by 95 · see citing works
Basal ganglia: structure and computations
Wickens, J. R. (1997) · Network Computation in Neural Systems · doi:10.1088/0954-898x_8_4_001 · Cited by 77 · see citing works
The Basal Ganglia Iv: New Ideas And Data On Structure And Function
Percheron, G., McKenzie, J. S., & Férger, J. (2011) · Medical Entomology and Zoology · Cited by 73 · see citing works
The Basal Ganglia IV. New Ideas and Data on Structure and Function
Barker, R. B. (1995) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.58.3.396-a · Cited by 65 · see citing works
Stimulants: Neurochemical, Behavioural, and Clinical Perspectives
Jenner, P. (1985) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.48.3.293 · Cited by 41 · see citing works
Kimura, M., & Matsumoto, N. (2008) · European Neurology · doi:10.1159/000113438 · Cited by 10 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- 16 Redgrave, P., et al. (1998) Neuroscience in press
- 17 Prescott, T. J., et al. (1998) Adaptive Behavior (in press)
- 39 Weiner, I. (1990) Psychological Bulletin 108, 442-461
Cited by
Sorted by citations
The reorienting system of the human brain: from environment to theory of mind
Corbetta, M., Patel, G., & Shulman, G. L. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.017 · Cited by 3,889 · see citing works
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027 · see citing works
Kapur, S. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.13 · Cited by 2,813 · see citing works
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
The principal features and mechanisms of dopamine modulation in the prefrontal cortex
Seamans, J. K., & Yang, C. R. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.05.006 · Cited by 1,592 · see citing works
Ikemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477 · see citing works
Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450 · see citing works
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · see citing works
Functional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404 · see citing works
How do emotion and motivation direct executive control?
Pessoa, L. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.01.006 · Cited by 1,286 · see citing works
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303 · see citing works
The role of dopamine in the pathophysiology of depression
Dunlop, B. W., & Nemeroff, C. B. (2007) · Archives of General Psychiatry · doi:10.1001/archpsyc.64.3.327 · Cited by 1,244 · see citing works
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126 · see citing works
Drevets, W. C. (2001) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00203-8 · Cited by 1,146 · see citing works
Dopamine and the regulation of cognition and attention
Nieoullon, A. (2002) · Progress in Neurobiology · doi:10.1016/s0301-0082(02)00011-4 · Cited by 1,131 · see citing works
Floresco, S. B., West, A. R., Ash, B., Moore, H., & Grace, A. A. (2003) · Nature Neuroscience · doi:10.1038/nn1103 · Cited by 1,106 · see citing works
Dopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036 · see citing works
Nucleus accumbens shell and core dopamine: differential role in behavior and addiction
Di Chiara, G. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00286-3 · Cited by 996 · see citing works
The Nucleus Accumbens: An Interface Between Cognition, Emotion, and Action
Floresco, S. B. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115159 · Cited by 938 · see citing works
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966 · see citing works
depue, R. A., & morrone-strupinsky, J. V. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000063 · Cited by 958 · see citing works
Dopamine and drug addiction: the nucleus accumbens shell connection
Di Chiara, G., Bassareo, V., Fenu, S., De Luca, M. A., Spina, L., Cadoni, C., Acquas, E., Carboni, E., Valentini, V., & Lecca, D. (2004) · Neuropharmacology · doi:10.1016/j.neuropharm.2004.06.032 · Cited by 935 · see citing works
Berke, J. D. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0152-y · Cited by 904 · see citing works
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762 · see citing works
Self-citationAmphetamine-induced dopamine release in human ventral striatum correlates with euphoria
Drevets, W. C., Gautier, C., Price, J. C., Kupfer, D. J., Kinahan, P. E., Grace, A. A., Price, J. L., & Mathis, C. A. (2001) · Biological Psychiatry · doi:10.1016/s0006-3223(00)01038-6 · Cited by 706 · see citing works
Pruessner, J. C., Champagne, F., Meaney, M. J., & Dagher, A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3422-03.2004 · Cited by 709 · see citing works
Dopamine reward prediction error coding
Schultz, W. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/wschultz · Cited by 597 · see citing works
Reward Changes Salience in Human Vision via the Anterior Cingulate
Hickey, C., Chelazzi, L., & Theeuwes, J. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1026-10.2010 · Cited by 606 · see citing works
“…behavior that suggest that reward-related mesolimbic dopamine acts to facilitate perceptual and attentional processing of stimuli with reward-conditioned features (Schultz et al., 1997; Berridge and Robinson, 1998; Ikemoto and Panksepp, 1999; Redgrave et al., 1999; Wise, 2004; Alcaro et al., 2007).”
BackgroundCoincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons
Morris, G., Arkadir, D., Nevet, A., Vaadia, E., & Bergman, H. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.012 · Cited by 574 · see citing works
Absolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA
Bunzeck, N., & Düzel, E. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.021 · Cited by 503 · see citing works
Actor–critic models of the basal ganglia: new anatomical and computational perspectives
Joel, D., Niv, Y., & Ruppin, E. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00047-3 · Cited by 500 · see citing works
Frank, M. J., & O'Reilly, R. C. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.3.497 · Cited by 472 · see citing works
Direct Activation of the Ventral Striatum in Anticipation of Aversive Stimuli
Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00724-4 · Cited by 455 · see citing works
Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value
Tai, L.-H., Lee, A. M., Benavidez, N., Bonci, A., & Wilbrecht, L. (2012) · Nature Neuroscience · doi:10.1038/nn.3188 · Cited by 399 · see citing works
Schönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390 · see citing works
Mechanisms of cognitive set flexibility in Parkinson's disease
Cools, R. (2001) · Brain · doi:10.1093/brain/124.12.2503 · Cited by 406 · see citing works
Barto, A., Mirolli, M., & Baldassarre, G. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00907 · Cited by 397 · see citing works
“…function of dopamine surprise activations is to encourage the animal to engage in activity to discover which aspects of its own activity may trigger surprising events so that the animal may add new actions to its repertoire (Redgrave et al., 1999; Redgrave and Gurney, 2006; Mirolli et al., 2013).”
BackgroundEndocannabinoid signaling system and brain reward: emphasis on dopamine
GARDNER, E. (2005) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2005.01.032 · Cited by 387 · see citing works
Bassareo, V., De Luca, M. A., & Di Chiara, G. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-11-04709.2002 · Cited by 339 · see citing works
Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300 · see citing works
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298 · see citing works
A direct projection from superior colliculus to substantia nigra for detecting salient visual events
Comoli, E., Coizet, V., Boyes, J., Bolam, J. P., Canteras, N. S., Quirk, R. H., Overton, P. G., & Redgrave, P. (2003) · Nature Neuroscience · doi:10.1038/nn1113 · Cited by 295 · see citing works
Robinson, D. L., Heien, M. L. A. V., & Wightman, R. M. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-23-10477.2002 · Cited by 290 · see citing works
How visual stimuli activate dopaminergic neurons at short latency
Dommett, E., Coizet, V., Blaha, C. D., Martindale, J., Lefebvre, V., Walton, N., Mayhew, J. E. W., Overton, P. G., & Redgrave, P. (2005) · Science · doi:10.1126/science.1107026 · Cited by 285 · see citing works
Self-citationTesting the Reward Prediction Error Hypothesis with an Axiomatic Model
Rutledge, R. B., Dean, M., Caplin, A., & Glimcher, P. W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1747-10.2010 · Cited by 244 · see citing works
Parkinson, J. A., Willoughby, P. J., Robbins, T. W., & Everitt, B. J. (2000) · Behavioral Neuroscience · doi:10.1037/0735-7044.114.1.42 · Cited by 314 · see citing works
Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats
Anstrom, K. K., Miczek, K. A., & Budygin, E. A. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.03.023 · Cited by 246 · see citing works
Frank, M. J., Santamaria, A., O'Reilly, R. C., & Willcutt, E. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301278 · Cited by 227 · see citing works
Guitart-Masip, M., Fuentemilla, L., Bach, D. R., Huys, Q. J. M., Dayan, P., Dolan, R. J., & Duzel, E. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6376-10.2011 · Cited by 216 · see citing works
Faure, A., Reynolds, S. M., Richard, J. M., & Berridge, K. C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4961-07.2008 · Cited by 193 · see citing works
Twenty-Five Lessons from Computational Neuromodulation
Dayan, P. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.027 · Cited by 190 · see citing works
Restraint increases dopaminergic burst firing in awake rats
Anstrom, K. K., & Woodward, D. J. (2005) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300730 · Cited by 181 · see citing works
Limbic cortical-ventral striatal systems underlying appetitive conditioning
Parkinson, J. A., Cardinal, R. N., & Everitt, B. J. (2000) · Progress in Brain Research · doi:10.1016/s0079-6123(00)26019-6 · Cited by 149 · see citing works
Balcita‐Pedicino, J. J., & Sesack, S. R. (2007) · Journal of Comparative Neurology · doi:10.1002/cne.21420 · Cited by 150 · see citing works
Aversive stimulus differentially triggers subsecond dopamine release in reward regions
Budygin, E. A., Park, J., Bass, C. E., Grinevich, V. P., Bonin, K. D., & Wightman, R. M. (2012) · Neuroscience · doi:10.1016/j.neuroscience.2011.10.056 · Cited by 152 · see citing works
Wenzel, J. M., Rauscher, N. A., Cheer, J. F., & Oleson, E. B. (2015) · ACS Chemical Neuroscience · doi:10.1021/cn500255p · Cited by 131 · see citing works
Extended habit training reduces dopamine mediation of appetitive response expression
Choi, W. Y., Balsam, P. D., & Horvitz, J. C. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1498-05.2005 · Cited by 122 · see citing works
Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
Metereau, E., & Dreher, J.-C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs037 · Cited by 114 · see citing works
An integrative framework for perceptual disturbances in psychosis
Horga, G., & Abi-Dargham, A. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0234-1 · Cited by 103 · see citing works
van der Schaaf, M. E., van Schouwenburg, M. R., Geurts, D. E. M., Schellekens, A. F. A., Buitelaar, J. K., Verkes, R. J., & Cools, R. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs344 · Cited by 102 · see citing works
Fiorillo, C. D., Song, M. R., & Yun, S. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3883-12.2013 · Cited by 98 · see citing works
Mesolimbic Dopamine Transients in Motivated Behaviors: Focus on Maternal Behavior
Robinson, D. L., Zitzman, D. L., & Williams, S. K. (2011) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2011.00023 · Cited by 89 · see citing works
Caligiore, D., Pezzulo, G., Miall, R. C., & Baldassarre, G. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.07.016 · Cited by 87 · see citing works
Précis on <i>The Cognitive-Emotional Brain</i>
Pessoa, L. (2015) · Behavioral and Brain Sciences · doi:10.1017/s0140525x14000120 · Cited by 84 · see citing works
Morrow, J. D., Maren, S., & Robinson, T. E. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.02.013 · Cited by 84 · see citing works
Dopamine neurons learn to encode the long-term value of multiple future rewards
Enomoto, K., Matsumoto, N., Nakai, S., Satoh, T., Sato, T. K., Ueda, Y., Inokawa, H., Haruno, M., & Kimura, M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014457108 · Cited by 83 · see citing works
Early development of subcortical regions involved in non-cued attention switching
Casey, B. J., Davidson, M. C., Hara, Y., Thomas, K. M., Martinez, A., Galvan, A., Halperin, J. M., Rodríguez‐Aranda, C. E., & Tottenham, N. (2004) · Developmental Science · doi:10.1111/j.1467-7687.2004.00377.x · Cited by 80 · see citing works
Sleep and dreaming are for important matters
Perogamvros, L., Dang-Vu, T. T., Desseilles, M., & Schwartz, S. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00474 · Cited by 77 · see citing works
“…is compatible with other models of reward system such as those focusing on the reinforcementlearning functions of the reward system (Schultz, 2010a), the reward prediction error (Schultz, 1997, 2002; Redgrave et al., 1999; Schultz and Dickinson, 2000) or the ’incentive salience’ (Berridge, 2007).”
MethodDopamine signaling in the nucleus accumbens core mediates latent inhibition
Kutlu, M. G., Zachry, J. E., Melugin, P. R., Tat, J., Cajigas, S., Isiktas, A. U., Patel, D. D., Siciliano, C. A., Schoenbaum, G., Sharpe, M. J., et al. (2022) · Nature Neuroscience · doi:10.1038/s41593-022-01126-1 · Cited by 78 · see citing works
Stimulus-response and response-outcome learning mechanisms in the striatum
Horvitz, J. C. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.014 · Cited by 58 · see citing works
Galea, J. M., Bestmann, S., Beigi, M., Jahanshahi, M., & Rothwell, J. C. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3621-11.2012 · Cited by 52 · see citing works
Methylphenidate alters selective attention by amplifying salience
ter Huurne, N., Fallon, S. J., van Schouwenburg, M., van der Schaaf, M., Buitelaar, J., Jensen, O., & Cools, R. (2015) · Psychopharmacology · doi:10.1007/s00213-015-4059-y · Cited by 31 · see citing works
HORVITZ, J. C., CHOI, W. Y., MORVAN, C., EYNY, Y., & BALSAM, P. D. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.017 · Cited by 26 · see citing works
- Authors
- Redgrave, P., Prescott, T. J., & Gurney, K.
- Affiliations
- University of Sheffield (GB)
- Venue
- Trends in Neurosciences
- Publisher
- Elsevier BV
- Published
- 1999-04
- Volume
- 22
- Issue
- 4
- Pages
- 146-151
- ISSN
- 0166-2236 (ISSN-L)
- OpenAlex
- W2041589773
- Cited by
- 506
- References
- 38
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 2 · 2023: 9 · 2022: 8 · 2021: 9 · 2020: 3 · 2019: 9 · 2018: 2 · 2017: 13 · 2016: 17 · 2015: 17 · 2014: 16 · 2013: 23 · 2012: 26
- FWCI
- 2.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Trends in Neurosciences (publishedVersion)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- dopaminergic neurons, reward prediction error, reinforcement learning, associative learning, attentional shift, behavioural selection, catecholamines, midbrain
- MeSH terms
- Action Potentials, Animals, Association, Attention, Avoidance Learning, Basal Ganglia, Behavior, Animal, Catecholamines, Conditioning, Operant, Dopamine, Exploratory Behavior, Humans, Learning, Mesencephalon, Models, Neurological, Models, Psychological, Reaction Time, Reinforcement, Psychology, Reward, Time Factors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review