The short-latency dopamine signal: a role in discovering novel actions?

Redgrave, Peter; Gurney, Kevin

doi:10.1038/nrn2022

Cited by 762Neurotransmitter Receptor Influence on BehaviorNeural and Behavioral Psychology StudiesReinforcement Learning in Robotics

The short-latency dopamine signal: a role in discovering novel actions?

Redgrave, Peter, Gurney, Kevin·2006·Nature Reviews Neuroscience

DOI 10.1038/nrn2022

Open this paper in CoChat — free account

Abstract

An influential concept in contemporary computational neuroscience is the reward prediction error hypothesis of phasic dopaminergic function. It maintains that midbrain dopaminergic neurons signal the occurrence of unpredicted reward, which is used in appetitive learning to reinforce existing actions that most often lead to reward. However, the availability of limited afferent sensory processing and the precise timing of dopaminergic signals suggest that they might instead have a central role in identifying which aspects of context and behavioural output are crucial in causing unpredicted events.

Integrity signals

Registry

Crossref · 10.1038/nrn2022

Cites

128 of 128 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The magnitude of dopaminergic responses to unrewarded visual stimuli in primates is significantly more robust in rewarded environments.
“However, the magnitude of these responses is significantly more robust in rewarded environments, suggesting that dopaminergic responses to sensory stimuli primarily serve to promote interaction with potentially rewarding objects (Kobayashi and Schultz, 2014) or enable novel action discovery that could lead to reward (Redgrave and Gurney, 2006).”
From Ventral striatum dopamine release encodes unique properties of visual stimuli in mice (2023) · cites this paper as Redgrave and Gurney, 2006
Recognition of the two-component structure of phasic dopamine responses may resolve earlier controversies that suggested an attentional rather than rewarding role of the dopamine prediction-error signal.
“Recognition of the two-component structure of phasic dopamine responses may also resolve earlier controversies, which suggested an attentional rather than rewarding role of the dopamine prediction-error signal64,65 on the basis of activations following exposure to physically salient stimuli16,20 and punishers24.”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [65]
Novelty acts as an exploration bonus in reward seeking tasks and is encoded in dopamine cells as an intrinsic bonus for exploration.
“Novelty has been proposed to act as an exploration bonus in reward seeking tasks (Wittmann et al., 2008), and to be encoded in dopamine cells as an intrinsic bonus for exploration (Redgrave and Gurney, 2006).”
From Attention, learning, and the value of information (2012) · cites this paper as Redgrave and Gurney, 2006

Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Handbook of Chemical Neuroanatomy
Stern, C. D. (1986) · Neurochemistry International · doi:10.1016/0197-0186(86)90021-5 · Cited by 4,159 · see citing works
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127 · see citing works
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · see citing works
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · see citing works
THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
Mink, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,478 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
The hippocampal-VTA loop: controlling the entry of information into long-term memory
Lisman, J. E., & Grace, A. A. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.002 · Cited by 1,983 · see citing works
Advances in Neural Information Processing Systems 18
Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927 · see citing works
The merging of the senses
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4365 · Cited by 1,897 · see citing works
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · see citing works
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · see citing works
Neurotransmitters and neuromodulators in the basal ganglia
Graybiel, A. M. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90104-i · Cited by 1,576 · see citing works
The primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479 · see citing works
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · see citing works
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · see citing works
Multiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303 · see citing works
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · see citing works
The basal ganglia: a vertebrate solution to the selection problem?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00319-4 · Cited by 1,199 · see citing works
Self-citation
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
The intralaminar and midline nuclei of the thalamus. Anatomical and functional evidence for participation in processes of arousal and awareness
Van der Werf, Y. D., Witter, M. P., & Groenewegen, H. J. (2002) · Brain Research Reviews · doi:10.1016/s0165-0173(02)00181-9 · Cited by 994 · see citing works
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987 · see citing works
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967 · see citing works
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966 · see citing works
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · see citing works
Dynamic Dopamine Modulation in the Basal Ganglia: A Neurocomputational Account of Cognitive Deficits in Medicated and Nonmedicated Parkinsonism
Frank, M. J. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929052880093 · Cited by 925 · see citing works
The primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917 · see citing works
Handbook of chemical neuroanatomy
(2005) · Handbook of chemical neuroanatomy · doi:10.1016/s0924-8196(05)80001-6 · Cited by 906 · see citing works
Visual-Motor Function of the Primate Superior Colliculus
Wurtz, R. H., & Albano, J. E. (1980) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.03.030180.001201 · Cited by 904 · see citing works
Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus
Sparks, D. L. (1986) · Physiological Reviews · doi:10.1152/physrev.1986.66.1.118 · Cited by 824 · see citing works
Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine
Salamone, J. D., & Correa, M. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00282-6 · Cited by 817 · see citing works
Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli
Ungless, M. A., Magill, P. J., & Bolam, J. P. (2004) · Science · doi:10.1126/science.1093360 · Cited by 782 · see citing works
Dopamine operates as a subsecond modulator of food seeking
Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., & Carelli, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3823-03.2004 · Cited by 718 · see citing works
The neurobiology of positive emotions
Burgdorf, J., & Panksepp, J. (2006) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.06.001 · Cited by 677 · see citing works
A computational model of action selection in the basal ganglia. I. A new functional anatomy
GURNEY, K. N., Prescott, T. J., & Redgrave, P. (2001) · Biological Cybernetics · doi:10.1007/pl00007984 · Cited by 633 · see citing works
Self-citation
Physiological aspects of information processing in the basal ganglia of normal and parkinsonian primates
Bergman, H., Feingold, A., Nini, A., Raz, A., Slovin, H., Abeles, M., & Vaadia, E. (1998) · Trends in Neurosciences · doi:10.1016/s0166-2236(97)01151-x · Cited by 630 · see citing works
The thalamostriatal system: a highly specific network of the basal ganglia circuitry
Smith, Y., Raju, D. V., Paré, J., & Sidibé, M. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.07.004 · Cited by 595 · see citing works
Event or emergency? Two response systems in the mammalian superior colliculus
Dean, P., Redgrave, P., & Westby, G. W. M. (1989) · Trends in Neurosciences · doi:10.1016/0166-2236(89)90052-0 · Cited by 589 · see citing works
Self-citation
Looking for the agent: an investigation into consciousness of action and self-consciousness in schizophrenic patients
Daprati, E., Franck, N., Georgieff, N., Proust, J., Pacherie, É., Daléry, J., & Jeannerod, M. (1997) · Cognition · doi:10.1016/s0010-0277(97)00039-5 · Cited by 563 · see citing works
Importance of unpredictability for reward responses in primate dopamine neurons
Mirenowicz, J., & Schultz, W. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.2.1024 · Cited by 544 · see citing works
Choosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536 · see citing works
Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex
Roesch, M. R., & Olson, C. R. (2004) · Science · doi:10.1126/science.1093223 · Cited by 535 · see citing works
Dopamine-dependent plasticity of corticostriatal synapses
Reynolds, J. N. J., & Wickens, J. R. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00045-x · Cited by 528 · see citing works
Visual and oculomotor functions of monkey substantia nigra pars reticulata. I. Relation of visual and auditory responses to saccades
Hikosaka, O., & Wurtz, R. H. (1983) · Journal of Neurophysiology · doi:10.1152/jn.1983.49.5.1230 · Cited by 524 · see citing works
From dopamine to salience to psychosis—Linking biology, pharmacology and phenomenology of psychosis
Kapur, S., Mizrahi, R., & Li, M. (2005) · Schizophrenia Research · doi:10.1016/j.schres.2005.01.003 · Cited by 512 · see citing works
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506 · see citing works
Self-citation
Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala.
Schoenbaum, G., Setlow, B., Saddoris, M. P., & Gallagher, M. (2003) · Neuron · doi:10.1016/s0896-6273(03)00474-4 · Cited by 484 · see citing works
A PET study of voluntary movement in schizophrenic patients experiencing passivity phenomena (delusions of alien control)
Spence, S. (1997) · Brain · doi:10.1093/brain/120.11.1997 · Cited by 477 · see citing works
Neurons in the Thalamic CM-Pf Complex Supply Striatal Neurons With Information About Behaviorally Significant Sensory Events
Matsumoto, N., Minamimoto, T., Graybiel, A. M., & Kimura, M. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.2.960 · Cited by 451 · see citing works
Blockade of NMDA receptors in the dorsomedial striatum prevents action–outcome learning in instrumental conditioning
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04219.x · Cited by 447 · see citing works
The Frontal Cortex-Basal Ganglia System in Primates
Wise, S. P., Murray, E. A., & Gerfen, C. R. (1996) · Critical Reviews in Neurobiology · doi:10.1615/critrevneurobiol.v10.i3-4.30 · Cited by 443 · see citing works
Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network
Pan, W.-X., Schmidt, R., Wickens, J. R., & Hyland, B. I. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1478-05.2005 · Cited by 429 · see citing works
The role of prelimbic cortex in instrumental conditioning
Corbit, L. H., & Balleine, B. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.023 · Cited by 423 · see citing works
Subcortical loops through the basal ganglia
McHaffie, J. G., Stanford, T. R., Stein, B. E., Coizet, V., & Redgrave, P. (2005) · Trends in Neurosciences · doi:10.1016/j.tins.2005.06.006 · Cited by 419 · see citing works
Self-citation
Single cell studies of the primate putamen
Crutcher, M. D., & DeLong, M. R. (1984) · Experimental Brain Research · doi:10.1007/bf00238153 · Cited by 379 · see citing works
Basal ganglia orient eyes to reward
Hikosaka, O., Nakamura, K., & Nakahara, H. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00458.2005 · Cited by 377 · see citing works
Topographical organization of amygdaloid projections to the caudatoputamen, nucleus accumbens, and related striatal-like areas of the rat brain
Mcdonald, A. J. (1991) · Neuroscience · doi:10.1016/0306-4522(91)90248-m · Cited by 372 · see citing works
Dopaminergic control of synaptic plasticity in the dorsal striatum
Centonze, D., Picconi, B., Gubellini, P., Bernardi, G., & Calabresi, P. (2001) · European Journal of Neuroscience · doi:10.1046/j.0953-816x.2001.01485.x · Cited by 361 · see citing works
Neuroanatomy of the oculomotor system.
Heermann, S. (1988) · PubMed · Cited by 360 · see citing works
Dopamine neurons of the monkey midbrain: contingencies of responses to stimuli eliciting immediate behavioral reactions
Schultz, W., & Romo, R. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.607 · Cited by 334 · see citing works
Brainstem projections to midline and intralaminar thalamic nuclei of the rat
Krout, K. E., Belzer, R. E., & Loewy, A. D. (2002) · Journal of Comparative Neurology · doi:10.1002/cne.10236 · Cited by 328 · see citing works
Corticothalamic projections from layer V cells in rat are collaterals of long-range corticofugal axons
Deschênes, M., Bourassa, J., & Pinault, D. (1994) · Brain Research · doi:10.1016/0006-8993(94)91974-7 · Cited by 326 · see citing works
Functional properties of monkey caudate neurons. II. Visual and auditory responses
Hikosaka, O., Sakamoto, M., & Usui, S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.4.799 · Cited by 319 · see citing works
A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour
GURNEY, K. N., Prescott, T. J., & Redgrave, P. (2001) · Biological Cybernetics · doi:10.1007/pl00007985 · Cited by 301 · see citing works
Self-citation
Seeking Categories in the Brain
Thorpe, S. J., & Fabre-Thorpe, M. (2001) · Science · doi:10.1126/science.1058249 · Cited by 300 · see citing works
Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300 · see citing works
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298 · see citing works
A direct projection from superior colliculus to substantia nigra for detecting salient visual events
Comoli, E., Coizet, V., Boyes, J., Bolam, J. P., Canteras, N. S., Quirk, R. H., Overton, P. G., & Redgrave, P. (2003) · Nature Neuroscience · doi:10.1038/nn1113 · Cited by 295 · see citing works
How visual stimuli activate dopaminergic neurons at short latency
Dommett, E., Coizet, V., Blaha, C. D., Martindale, J., Lefebvre, V., Walton, N., Mayhew, J. E. W., Overton, P. G., & Redgrave, P. (2005) · Science · doi:10.1126/science.1107026 · Cited by 285 · see citing works
Self-citation
Neural mechanisms of reward-related motor learning
Wickens, J. R., Reynolds, J. N., & Hyland, B. I. (2003) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2003.10.013 · Cited by 284 · see citing works
Neuroanatomy of the Oculomotor System
(2006) · Progress in brain research · doi:10.1016/s0079-6123(05)x5100-7 · Cited by 283 · see citing works
Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat
Horvitz, J. C., Stewart, T., & Jacobs, B. L. (1997) · Brain Research · doi:10.1016/s0006-8993(97)00265-5 · Cited by 283 · see citing works
Single cell studies of the primate putamen
Crutcher, M. D., & DeLong, M. R. (1984) · Experimental Brain Research · doi:10.1007/bf00238154 · Cited by 283 · see citing works
Transient changes in mesolimbic dopamine and their association with ‘reward’
Wightman, R. M., & Robinson, D. L. (2002) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.2002.01005.x · Cited by 280 · see citing works
Dopamine Neurons Can Represent Context-Dependent Prediction Error
Nakahara, H., Itoh, H., Kawagoe, R., Takikawa, Y., & Hikosaka, O. (2004) · Neuron · doi:10.1016/s0896-6273(03)00869-9 · Cited by 276 · see citing works
Visual and oculomotor functions of monkey subthalamic nucleus
Matsumura, M., Kojima, J., Gardiner, T. W., & Hikosaka, O. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.6.1615 · Cited by 265 · see citing works
Models of information processing in the basal Ganglia
Hikosaka, O. (1995) · Trends in Neurosciences · doi:10.1016/0166-2236(95)90004-7 · Cited by 248 · see citing works
Contiguity and contingency in action-effect learning
Elsner, B., & Hommel, B. (2004) · Psychological Research · doi:10.1007/s00426-003-0151-8 · Cited by 243 · see citing works
Differential morphology of pyramidal tract‐type and intratelencephalically projecting‐type corticostriatal neurons and their intrastriatal terminals in rats
Reiner, A. J., Jiao, Y., Mar, N. D., Laverghetta, A., & Lei, W. L. (2003) · The Journal of Comparative Neurology · doi:10.1002/cne.10541 · Cited by 237 · see citing works
Firing properties of substantia nigra dopaminergic neurons in freely moving rats
Freeman, A. S., Meltzer, L. T., & Bunney, B. S. (1985) · Life Sciences · doi:10.1016/0024-3205(85)90448-5 · Cited by 236 · see citing works
Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus
Ikeda, T., & Hikosaka, O. (2003) · Neuron · doi:10.1016/s0896-6273(03)00464-1 · Cited by 233 · see citing works
Amygdaloid projections to ventromedial striatal subterritories in the primate
Fudge, J. L., Kunishio, K., Walsh, P., Richard, C., & Haber, S. N. (2002) · Neuroscience · doi:10.1016/s0306-4522(01)00546-2 · Cited by 226 · see citing works
Sensorimotor integration in the primate superior colliculus. I. Motor convergence
Jay, M. F., & Sparks, D. L. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.22 · Cited by 211 · see citing works
Stepping out of the box: information processing in the neural networks of the basal ganglia
Bar‐Gad, I., & Bergman, H. (2001) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(01)00270-7 · Cited by 209 · see citing works
An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit
Guarraci, F. A., & Kapp, B. S. (1999) · Behavioural Brain Research · doi:10.1016/s0166-4328(98)00102-8 · Cited by 201 · see citing works
How parallel is visual processing in the ventral pathway?
Rousselet, G. A., Thorpe, S. J., & Fabre‐Thorpe, M. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.06.003 · Cited by 198 · see citing works
Dopamine: the salient issue
Ungless, M. A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.001 · Cited by 190 · see citing works
The 28th Bartlett Memorial Lecture Causal learning: An associative analysis
Dickinson, A. (2001) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/02724990042000010 · Cited by 184 · see citing works
A robot model of the basal ganglia: Behavior and intrinsic processing
Prescott, T. J., Montes-González, F., GURNEY, K. N., Humphries, M. D., & Redgrave, P. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.06.049 · Cited by 182 · see citing works
Self-citation
Reward or reinforcement: What's the difference?
White, N. M. (1989) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(89)80028-4 · Cited by 166 · see citing works
Responses of tonically discharging neurons in the monkey striatum to primary rewards delivered during different behavioral states
Apicella, P., Legallet, E., & Trouche, E. (1997) · Experimental Brain Research · doi:10.1007/pl00005773 · Cited by 162 · see citing works
A Theory of the Striatum
(1993) · Elsevier eBooks · doi:10.1016/c2009-0-35344-1 · Cited by 161 · see citing works
Metabolic Disorders of the Nervous System
Rose, F. C. (1981) · Medical Entomology and Zoology · Cited by 160 · see citing works
Corticostriatal projections from layer V cells in rat are collaterals of long-range corticofugal axons
Lévesque, M., Charara, A., Gagnon, S., Parent, A., & Deschênes, M. (1996) · Brain Research · doi:10.1016/0006-8993(95)01333-4 · Cited by 151 · see citing works
Computational models of the basal ganglia: from robots to membranes
GURNEY, K. N., Prescott, T. J., Wickens, J. R., et al. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.06.003 · Cited by 147 · see citing works
Self-citation
Repetitive Behaviors in Monkeys Are Linked to Specific Striatal Activation Patterns
Saka, E., Goodrich, C. M., Harlan, P. C., Madras, B. K., & Graybiel, A. M. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.1072-04.2004 · Cited by 139 · see citing works
Agents of the mind
Houk, J. C. (2005) · Biological Cybernetics · doi:10.1007/s00422-005-0569-8 · Cited by 138 · see citing works
TD models of reward predictive responses in dopamine neurons
Suri, R. E. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00046-1 · Cited by 137 · see citing works
Single-axon tracing and three-dimensional reconstruction of centre médian-parafascicular thalamic neurons in primates
Parent, M., & Parent, A. (2004) · The Journal of Comparative Neurology · doi:10.1002/cne.20348 · Cited by 136 · see citing works
Sensitivity to Instrumental Contingency Degradation Is Mediated by the Entorhinal Cortex and Its Efferents via the Dorsal Hippocampus
Corbit, L. H., Ostlund, S. B., & Balleine, B. W. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-24-10976.2002 · Cited by 110 · see citing works
Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior colliculus in the rat
Coizet, V., Dommett, E. J., Redgrave, P., & Overton, P. G. (2006) · Neuroscience · doi:10.1016/j.neuroscience.2006.01.030 · Cited by 92 · see citing works
Self-citation
A direct projection from superior colliculus to substantia nigra pars compacta in the cat
McHaffie, J. G., Jiang, H., May, P. J., Coizet, V., Overton, P. G., Stein, B. E., & Redgrave, P. (2005) · Neuroscience · doi:10.1016/j.neuroscience.2005.11.015 · Cited by 88 · see citing works
Self-citation
Unit responses to visual stimuli in the superior colliculus of the unanesthetized, mid-pontine cat.
Jm, S., Pl, M., & Rixxolatti, G. (1968) · PubMed · Cited by 87 · see citing works
A Possible Role of Midbrain Dopamine Neurons in Short- and Long-Term Adaptation of Saccades to Position-Reward Mapping
Takikawa, Y., Kawagoe, R., & Hikosaka, O. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00238.2004 · Cited by 82 · see citing works
Collateral projections of predorsal bundle cells of the superior colliculus in the rat
Bickford, M. E., & Hall, W. C. (1989) · The Journal of Comparative Neurology · doi:10.1002/cne.902830108 · Cited by 79 · see citing works
Short review on dopamine agonists: insight into clinical and research studies relevant to Parkinson's disease.
Radad, K., Gille, G., & Rausch, W. (2006) · PubMed · Cited by 78 · see citing works
The Basal Ganglia Iv: New Ideas And Data On Structure And Function
Percheron, G., McKenzie, J. S., & Férger, J. (2011) · Medical Entomology and Zoology · Cited by 73 · see citing works
Ultrastructural features of the nitric oxide synthase-containing interneurons in the nucleus accumbens and their relationship with tyrosine hydroxylase-containing terminals
Hidaka, S., & Totterdell, S. (2001) · The Journal of Comparative Neurology · doi:10.1002/1096-9861(20010305)431:2 · Cited by 72 · see citing works
Phasic activation of substantia nigra and the ventral tegmental area by chemical stimulation of the superior colliculus: an electrophysiological investigation in the rat
Coizet, V., Comoli, E., Westby, G. W. M., & Redgrave, P. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02415.x · Cited by 70 · see citing works
Self-citation
Intrinsic reinforcing properties of putatively neutral stimuli in an instrumental two-lever discrimination task
Reed, P., Mitchell, C., & Nokes, T. (1996) · Animal Learning & Behavior · doi:10.3758/bf03198952 · Cited by 59 · see citing works
The visual-oculomotor striatum of the cat: functional relationship to the superior colliculus
Harting, J. K., Updyke, B. V., & Lieshout, D. P. V. (2001) · Experimental Brain Research · doi:10.1007/s002210000606 · Cited by 49 · see citing works
Effect of Removing the Neocortex on the Response to Repeated Sensory Stimulation of Neurones in the Mid-brain
Horn, G., & Hill, R. M. (1966) · Nature · doi:10.1038/211754a0 · Cited by 47 · see citing works
Role of Basal Ganglia in Control of Innate Movements, Learned Behavior and Cognition—A Hypothesis
Hikosaka, O. (1994) · Advances in behavioral biology · doi:10.1007/978-1-4613-0485-2_61 · Cited by 46 · see citing works
In cat four times as many lamina I neurons project to the parabrachial nuclei and twice as many to the periaqueductal gray as to the thalamus
Klop, E. M., Mouton, L. J., Hulsebosch, R., Boers, J., & Holstege, G. (2005) · Neuroscience · doi:10.1016/j.neuroscience.2005.03.035 · Cited by 43 · see citing works
The rat's resistance to superstition: Role of the hippocampus.
Devenport, L. D., & Holloway, F. A. (1980) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0077703 · Cited by 42 · see citing works
Molecular dissection of dopamine receptor signaling
Hiroi, N., Martı́n, A. B., Grande, C., et al. (2002) · Journal of Chemical Neuroanatomy · doi:10.1016/s0891-0618(02)00010-8 · Cited by 26 · see citing works
Variation of bar-press duration: Where do new responses come from?
Roberts, S., & Gharib, A. (2006) · Behavioural Processes · doi:10.1016/j.beproc.2006.03.003 · Cited by 25 · see citing works
Release from GABAA receptor-mediated inhibition unmasks interlaminar connection within superior colliculus in anesthetized adult rats
Katsuta, H., & Isa, T. (2003) · Neuroscience Research · doi:10.1016/s0168-0102(03)00029-4 · Cited by 22 · see citing works
Beetles, boxes and brain cells: neural mechanisms underlying valuation and learning
Salzman, C. D., Belova, M. A., & Paton, J. J. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.10.016 · Cited by 18 · see citing works
Response preconditioning effects.
Claire-Smith, R. S., & MacLaren, D. (1983) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.9.1.41 · Cited by 13 · see citing works
Response preconditioning effects.
Claire-Smith, R. S., & MacLaren, D. (1983) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.9.1.41 · Cited by 9 · see citing works

Flagged first, then by citations

Sorted by citations

The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · see citing works
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · see citing works
Habits, Rituals, and the Evaluative Brain
Graybiel, A. M. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112851 · Cited by 1,697 · see citing works
How do emotion and motivation direct executive control?
Pessoa, L. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.01.006 · Cited by 1,286 · see citing works
Affective neuroscience of pleasure: reward in humans and animals
Berridge, K. C., & Kringelbach, M. L. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1099-6 · Cited by 1,254 · see citing works
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126 · see citing works
Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease
Redgrave, P., Rodriguez, M., Smith, Y., Rodriguez-Oroz, M. C., Lehericy, S., Bergman, H., Agid, Y., DeLong, M. R., & Obeso, J. A. (2010) · Nature reviews. Neuroscience · doi:10.1038/nrn2915 · Cited by 1,134 · see citing works
Dopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036 · see citing works
Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis
Glimcher, P. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014269108 · Cited by 955 · see citing works
The Psychology and Neuroscience of Curiosity
Kidd, C., & Hayden, B. Y. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.010 · Cited by 1,026 · see citing works
Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits
Salamone, J. D., Correa, M., Farrar, A., & Mingote, S. M. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0668-9 · Cited by 1,000 · see citing works
An Interoceptive Predictive Coding Model of Conscious Presence
Seth, A. K., Suzuki, K., & Critchley, H. D. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00395 · Cited by 950 · see citing works
“This account is also compatible with an alternative interpretation of short-latency dopaminergic signaling in identifying aspects of environmental context and behavior potentially responsible for causing unpredicted events (Redgrave and Gurney, 2006).”
Result
The Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928 · see citing works
The Social Salience Hypothesis of Oxytocin
Shamay-Tsoory, S. G., & Abu-Akel, A. (2016) · Biological Psychiatry · doi:10.1016/j.biopsych.2015.07.020 · Cited by 904 · see citing works
“This signal is involved in rapid detection of and alerting to potentially important sensory cues (89), and is most likely triggered by information received from the superior colliculi (90)—brain stem areas associated with eye movement and attention.”
Consciousness without a cerebral cortex: A challenge for neuroscience and medicine
Merker, B. (2007) · Behavioral and Brain Sciences · doi:10.1017/s0140525x07000891 · Cited by 868 · see citing works
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731 · see citing works
Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective
Botvinick, M. M., Niv, Y., & Barto, A. G. (2009) · Cognition · doi:10.1016/j.cognition.2008.08.011 · Cited by 646 · see citing works
<i>Spatial Cognition and the Brain</i>
Burgess, N. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1440.002 · Cited by 614 · see citing works
Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards
Bromberg-Martin, E. S., & Hikosaka, O. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.009 · Cited by 548 · see citing works
Prolonged dopamine signalling in striatum signals proximity and value of distant rewards
Howe, M. W., Tierney, P. L., Sandberg, S. G., Phillips, P. E. M., & Graybiel, A. M. (2013) · Nature · doi:10.1038/nature12475 · Cited by 565 · see citing works
Dopamine and Cognitive Control in Prefrontal Cortex
Ott, T., & Nieder, A. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.12.006 · Cited by 530 · see citing works
How prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512 · see citing works
Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction
Belin, D., Jonkman, S., Dickinson, A., Robbins, T. W., & Everitt, B. J. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.027 · Cited by 520 · see citing works
Reinforcement learning or active inference?
Friston, K. J., Daunizeau, J., & Kiebel, S. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006421 · Cited by 443 · see citing works
Habenula: crossroad between the basal ganglia and the limbic system
Hikosaka, O., Sesack, S. R., Lecourtier, L., & Shepard, P. D. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3463-08.2008 · Cited by 432 · see citing works
Coordinated and compartmentalized neuromodulation shapes sensory processing in Drosophila
Cohn, R., Morantte, I., & Ruta, V. (2015) · Cell · doi:10.1016/j.cell.2015.11.019 · Cited by 430 · see citing works
Toward a neurobiology of delusions
Corlett, P. R., Taylor, J. R., Wang, X.-J., Fletcher, P. C., & Krystal, J. H. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.06.007 · Cited by 394 · see citing works
Dopamine, affordance and active inference
Friston, K. J., Shiner, T., FitzGerald, T., Galea, J. M., Adams, R., Brown, H., Dolan, R. J., Moran, R., Stephan, K. E., & Bestmann, S. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002327 · Cited by 381 · see citing works
Novelty or Surprise?
Barto, A., Mirolli, M., & Baldassarre, G. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00907 · Cited by 397 · see citing works
“…function of dopamine surprise activations is to encourage the animal to engage in activity to discover which aspects of its own activity may trigger surprising events so that the animal may add new actions to its repertoire (Redgrave et al., 1999; Redgrave and Gurney, 2006; Mirolli et al., 2013).”
Background
Hierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning
Iglesias, S., Mathys, C., Brodersen, K. H., Kasper, L., Piccirelli, M., den Ouden, H. E. M., & Stephan, K. E. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.009 · Cited by 342 · see citing works
The anatomy of choice: active inference and agency
Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00598 · Cited by 340 · see citing works
A Neural Computational Model of Incentive Salience
Zhang, J., Berridge, K. C., Tindell, A. J., Smith, K. S., & Aldridge, J. W. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000437 · Cited by 299 · see citing works
The anatomy of choice: dopamine and decision-making.
Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0481 · Cited by 289 · see citing works
Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials
Joshua, M., Adler, A., Mitelman, R., Vaadia, E., & Bergman, H. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3839-08.2008 · Cited by 273 · see citing works
Adaptive learning under expected and unexpected uncertainty
Soltani, A., & Izquierdo, A. (2019) · Nature reviews. Neuroscience · doi:10.1038/s41583-019-0180-y · Cited by 286 · see citing works
Lateral habenula neurons signal errors in the prediction of reward information
Bromberg-Martin, E. S., & Hikosaka, O. (2011) · Nature Neuroscience · doi:10.1038/nn.2902 · Cited by 275 · see citing works
Attention, learning, and the value of information
Gottlieb, J. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.034 · Cited by 241 · see citing works
“For instance, novelty has been proposed to act as an exploration bonus in reward seeking tasks (Wittmann et al., 2008) and to be encoded in dopamine cells as an intrinsic bonus for exploration (Redgrave and Gurney, 2006).”
Background
The dopaminergic midbrain encodes the expected certainty about desired outcomes
Schwartenbeck, P., FitzGerald, T. H. B., Mathys, C., Dolan, R., & Friston, K. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu159 · Cited by 219 · see citing works
Dopaminergic basis of salience dysregulation in psychosis
Winton-Brown, T. T., Fusar-Poli, P., Ungless, M. A., & Howes, O. D. (2014) · Trends in Neurosciences · doi:10.1016/j.tins.2013.11.003 · Cited by 231 · see citing works
Dopamine release in the nucleus accumbens core signals perceived saliency
Kutlu, M. G., Zachry, J. E., Melugin, P. R., Cajigas, S. A., Chevee, M. F., Kelly, S. J., Kutlu, B., Tian, L., Siciliano, C. A., & Calipari, E. S. (2021) · Current Biology · doi:10.1016/j.cub.2021.08.052 · Cited by 238 · see citing works
Building a neuroscience of pleasure and well-being
Berridge, K. C., & Kringelbach, M. L. (2011) · Psychology of Well-Being: Theory, Research and Practice · doi:10.1186/2211-1522-1-3 · Cited by 229 · see citing works
Parallel maturation of goal-directed behavior and dopaminergic systems during adolescence
Naneix, F., Marchand, A. R., Di Scala, G., Pape, J.-R., & Coutureau, E. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3080-12.2012 · Cited by 209 · see citing works
Dopamine signaling in the nucleus accumbens of animals self-administering drugs of abuse
Willuhn, I., Wanat, M. J., Clark, J. J., & Phillips, P. E. M. (2010) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2009_27 · Cited by 193 · see citing works
The evolutionary origin of the vertebrate basal ganglia and its role in action selection
Grillner, S., Robertson, B., & Stephenson‐Jones, M. (2013) · The Journal of Physiology · doi:10.1113/jphysiol.2012.246660 · Cited by 184 · see citing works
Phasic dopamine release in appetitive behaviors and drug addiction
Wanat, M., Willuhn, I., Clark, J., & Phillips, P. (2009) · Current Drug Abuse Reviewse · doi:10.2174/1874473710902020195 · Cited by 177 · see citing works
Relationship between the corticostriatal terminals from areas 9 and 46, and those from area 8A, dorsal and rostral premotor cortex and area 24c: an anatomical substrate for cognition to action
Calzavara, R., Mailly, P., & Haber, S. N. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05825.x · Cited by 170 · see citing works
Reward prediction error
Schultz, W. (2017) · Current Biology · doi:10.1016/j.cub.2017.02.064 · Cited by 177 · see citing works
The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis
Mannella, F., Gurney, K., & Baldassarre, G. (2013) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2013.00135 · Cited by 166 · see citing works
Self-citation
Distinct contributions of nicotinic acetylcholine receptor subunit α4 and subunit α6 to the reinforcing effects of nicotine
Exley, R., Maubourguet, N., David, V., Eddine, R., Evrard, A., Pons, S., Marti, F., Threlfell, S., Cazala, P., McIntosh, J. M., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1103000108 · Cited by 159 · see citing works
Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity
Coddington, L. T., & Dudman, J. T. (2019) · Neuron · doi:10.1016/j.neuron.2019.08.036 · Cited by 150 · see citing works
Why do delusions persist?
Corlett, P. R. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.012.2009 · Cited by 146 · see citing works
Motivation from control
Eitam, B., Kennedy, P. M., & Tory Higgins, E. (2013) · Experimental Brain Research · doi:10.1007/s00221-012-3370-7 · Cited by 141 · see citing works
Dopamine-modulated dynamic cell assemblies generated by the GABAergic striatal microcircuit
Humphries, M. D., Wood, R., & Gurney, K. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.07.018 · Cited by 129 · see citing works
Self-citation
I control therefore I do: Judgments of agency influence action selection
Karsh, N., & Eitam, B. (2015) · Cognition · doi:10.1016/j.cognition.2015.02.002 · Cited by 125 · see citing works
Reward facilitates tactile judgments and modulates hemodynamic responses in human primary somatosensory cortex
Pleger, B., Blankenburg, F., Ruff, C. C., Driver, J., & Dolan, R. J. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1093-08.2008 · Cited by 120 · see citing works
Reinforcement learning: Computational theory and biological mechanisms
Doya, K. (2007) · HFSP journal · doi:10.2976/1.2732246 · Cited by 150 · see citing works
Dopamine neurons code subjective sensory experience and uncertainty of perceptual decisions
de Lafuente, V., & Romo, R. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1117636108 · Cited by 117 · see citing works
Cortical coupling reflects Bayesian belief updating in the deployment of spatial attention
Vossel, S., Mathys, C., Stephan, K. E., & Friston, K. J. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.1382-15.2015 · Cited by 99 · see citing works
The neurobiology of schizotypy: Fronto-striatal prediction error signal correlates with delusion-like beliefs in healthy people
Corlett, P. R., & Fletcher, P. C. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.09.045 · Cited by 96 · see citing works
Reward-Guided Learning with and without Causal Attribution
Jocham, G., Brodersen, K. H., Constantinescu, A. O., Kahn, M. C., Ianni, A. M., Walton, M. E., Rushworth, M. F. S., & Behrens, T. E. J. (2016) · Neuron · doi:10.1016/j.neuron.2016.02.018 · Cited by 92 · see citing works
Axiomatic methods, dopamine and reward prediction error
Caplin, A., & Dean, M. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.07.007 · Cited by 88 · see citing works
Précis on <i>The Cognitive-Emotional Brain</i>
Pessoa, L. (2015) · Behavioral and Brain Sciences · doi:10.1017/s0140525x14000120 · Cited by 84 · see citing works
Intrinsic motivations and open-ended development in animals, humans, and robots: an overview
Baldassarre, G., Stafford, T., Mirolli, M., Redgrave, P., Ryan, R. M., & Barto, A. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00985 · Cited by 73 · see citing works
Self-citation
Nicotinic receptors in the ventral tegmental area promote uncertainty-seeking
Naudé, J., Tolu, S., Dongelmans, M., Torquet, N., Valverde, S., Rodriguez, G., Pons, S., Maskos, U., Mourot, A., Marti, F., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4223 · Cited by 61 · see citing works
Stimulus-response and response-outcome learning mechanisms in the striatum
Horvitz, J. C. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.014 · Cited by 58 · see citing works
Visual adaptation and novelty responses in the superior colliculus: Adaptation in the SC
Boehnke, S. E., Berg, D. J., Marino, R. A., Baldi, P. F., Itti, L., & Munoz, D. P. (2011) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07805.x · Cited by 60 · see citing works
Action reprogramming in Parkinson's disease: Response to prediction error is modulated by levels of dopamine
Galea, J. M., Bestmann, S., Beigi, M., Jahanshahi, M., & Rothwell, J. C. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3621-11.2012 · Cited by 52 · see citing works
Neural circuitry of novelty salience processing in psychosis risk: Association with clinical outcome
Modinos, G., Allen, P., Zugman, A., Dima, D., Azis, M., Samson, C., Bonoldi, I., Quinn, B., Gifford, G. W. G., Smart, S. E., et al. (2020) · Schizophrenia Bulletin · doi:10.1093/schbul/sbz089 · Cited by 31 · see citing works
A “Good Parent” Function of Dopamine: Transient Modulation of Learning and Performance during Early Stages of Training
HORVITZ, J. C., CHOI, W. Y., MORVAN, C., EYNY, Y., & BALSAM, P. D. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.017 · Cited by 26 · see citing works
Strategic cognitive sequencing: a computational cognitive neuroscience approach
Herd, S. A., Krueger, K. A., Kriete, T. E., Huang, T.-R., Hazy, T. E., & O'Reilly, R. C. (2013) · Computational Intelligence and Neuroscience · doi:10.1155/2013/149329 · Cited by 20 · see citing works
Frontostriatal contribution to the interplay of flexibility and stability in serial prediction
Trempler, I., Schiffer, A.-M., El-Sourani, N., Ahlheim, C., Fink, G. R., & Schubotz, R. I. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01040 · Cited by 18 · see citing works
Ventral striatum dopamine release encodes unique properties of visual stimuli in mice
Gonzalez, L. S., Fisher, A. A., D'Souza, S. P., Cotella, E. M., Lang, R. A., & Robinson, J. E. (2023) · eLife · doi:10.7554/elife.85064 · Cited by 18 · see citing works
“DOI: https://doi.org/10.7554/eLife.85064 7 of 20 neural activity, structure, or biology (Fenno et al., 2011; Resendez and Stuber, 2015; Sabatini and Tian, 2020).”
Influential
The architecture challenge: Future artificial-intelligence systems will require sophisticated architectures, and knowledge of the brain might guide their construction
Baldassarre, G., Santucci, V. G., Cartoni, E., & Caligiore, D. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x17000036 · Cited by 11 · see citing works
Impaired context-sensitive adjustment of behaviour in Parkinson’s disease patients tested on and off medication: an fMRI study
Trempler, I., Bürkner, P.-C., El-Sourani, N., Binder, E., Reker, P., Fink, G. R., & Schubotz, R. I. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116674 · Cited by 6 · see citing works

Dopamine Neuron Agenesis in Nurr1-Deficient Mice
Zetterström, R. H., Solomin, L., Jansson, L., Hoffer, B. J., Olson, L., & Perlmann, T. (1997) · Science · doi:10.1126/science.276.5310.248 · Cited by 1,096 · see citing works
Age-related changes in midbrain dopaminergic regulation of the human reward system
Dreher, J.-C., Meyer-Lindenberg, A., Kohn, P., & Berman, K. F. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0802127105 · Cited by 230 · see citing works
Characterization of the Synaptic Inputs to Dopaminergic Neurones in the Rat Substantia Nigra
Bolam, P., & Smith, Y. (1991) · Advances in behavioral biology · doi:10.1007/978-1-4684-5871-8_13 · Cited by 10 · see citing works
Presymptomatic compensation in Parkinson's disease is not dopamine-mediated
Bézard, E., Gross, C. E., & Brotchie, J. M. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00038-9 · Cited by 351 · see citing works
Dopaminergic axons track somatic signaling in behaving micePreprint
Azcorra, M., Gaertner, Z. A., Davidson, C., Ramakrishnan, C., Fenno, L. E., Kim, Y. S., Deisseroth, K. A., Awatramani, R. B., & Dombeck, D. A. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.06.20.496872 · Cited by 7 · see citing works

Authors: Redgrave, P., & Gurney, K.
Affiliations: University of Sheffield (GB)
Corresponding author: Redgrave, Peter
ORCID: Redgrave, Peter
Gurney, Kevin
Venue: Nature Reviews Neuroscience
Publisher: Springer Science and Business Media LLC
Published: 2006-11-08
Volume: 7
Issue: 12
Pages: 967-975
ISSN: 1471-003X (ISSN-L)
1471-0048
DOI: 10.1038/nrn2022
OpenAlex: W2069258922
Cited by: 762
References: 128
Citations by year: 2026: 13 · 2025: 27 · 2024: 43 · 2023: 18 · 2022: 35 · 2021: 22 · 2020: 22 · 2019: 47 · 2018: 20 · 2017: 33 · 2016: 36 · 2015: 42 · 2014: 50 · 2013: 51 · 2012: 73
FWCI: 3.95
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Nature reviews. Neuroscience (publishedVersion)
PubMed (publishedVersion)
Funders: Wellcome Trust
Engineering and Physical Sciences Research Council (EP/C516303/1)
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords: basal ganglia, appetitive learning, reward prediction
MeSH terms: Animals, Brain, Dopamine, Exploratory Behavior, Humans, Models, Neurological, Neural Pathways, Synaptic Transmission, Reaction Time, Reinforcement, Psychology, Reward

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The short-latency dopamine signal: a role in discovering novel actions?

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks