The DOI matches its Crossref record; 165 of the 165 references it cites were found in a registry or an index.
What is reinforced by phasic dopamine signals?
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 2×
“…version of biasing action selection that has receivedmost attention inanalysesof thebasal ganglia's role in reinforcement learning (Arbuthnott and Wickens, 2007; Everitt and Robbins, 2005; Reynolds and Wickens, 2002; Schultz, 1998; Schultz, 2006; Wickens, 1993; Wickens et al., 2003; Wise, 2004).”
BackgroundTHE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS
MINK, J. W. (1996) · Progress in Neurobiology · doi:10.1016/s0301-0082(96)00042-1 · Cited by 2,486
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 5×
“This should be surprising because in a later study, when a conditioned stimulus predicted a reward with 50% reliability, a second phasic DA neuronal response was regularly elicited on trials when reward was subsequently delivered (Fiorillo et al., 2003).”
BackgroundInfluentialA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
The hippocampal-VTA loop: controlling the entry of information into long-term memory
Lisman, J. E., & Grace, A. A. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.002 · Cited by 1,983
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4365 · Cited by 1,882
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · cited 10×
“…vision) are associated either with the opportunity to explore novel environments or objects (Bardo et al., 1993; Bevins et al., 2002; Sheldon, 1969), or view images or movies, the most effective being of conspecifics with significant social content (Blatter and Schultz, 2006; Deaner et al., 2005).”
BackgroundMethodInfluentialNeurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Multiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 5×
“However, it is the ability of phasic responses to adapt when experimental conditions are changed that suggests that they could code errors of reward prediction (Bayer and Glimcher, 2005; Nakahara et al., 2004; Satoh et al., 2003; Schultz, 1998; Schultz, 2006).”
BackgroundInfluentialMultiple reward signals in the brain
Schultz, W. (2000) · Nature Reviews Neuroscience · doi:10.1038/35044563 · Cited by 1,303
Lateral habenula as a source of negative reward signals in dopamine neurons
Matsumoto, M., & Hikosaka, O. (2007) · Nature · doi:10.1038/nature05860 · Cited by 1,292
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · cited 4×
“…(Morris et al., 2004; Ravel and Richmond, 2006), independent of the modality (visual, auditory or somatosensory (Schultz, 1998)), or perceptual complexity of eliciting events (Fiorillo et al., 2003; Ravel and Richmond, 2006; Takikawa et al., 2004; Tobler et al., 2003; Tobler et al., 2005).”
BackgroundInfluentialThe basal ganglia: a vertebrate solution to the selection problem?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00319-4 · Cited by 1,199
Self-citationModels of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Lindvall, O., & Björklund, A. (1974) · PubMed · Cited by 1,131
Floresco, S. B., West, A. R., Ash, B., Moore, H., & Grace, A. A. (2003) · Nature Neuroscience · doi:10.1038/nn1103 · Cited by 1,106
A new view of pain as a homeostatic emotion
(Bud) Craig, A. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00123-1 · Cited by 1,023
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
Johnson, M. H. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1766 · Cited by 969
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966
State-dependent opioid control of pain
Fields, H. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1431 · Cited by 946 · cited 1×
“The reinforcing consequences of terminating an aversive event are widely appreciated (Craig, 2003; Fields, 2004; Kim et al., 2006; Seymour et al., 2005).”
BackgroundRepresentation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939
The primate amygdala represents the positive and negative value of visual stimuli during learning
Paton, J. J., Belova, M. A., Morrison, S. E., & Salzman, C. D. (2006) · Nature · doi:10.1038/nature04490 · Cited by 917 · cited 2×
“It is likely that the associative learning linking the CS and UCS in Pavlovian conditioning is promoted by the phasic DA signals that are directed to structures other than the striatum, e.g. the amygdala (Balleine and Killcross, 2006; Fanselow and Poulos, 2005; Paton et al., 2006).”
BackgroundVisual-Motor Function of the Primate Superior Colliculus
Wurtz, R. H., & Albano, J. E. (1980) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.03.030180.001201 · Cited by 904
Alexander, G. E. (1998) · Cited by 890
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879
Self-citationDisinhibition as a basic process in the expression of striatal functions
Chevalier, G., & Deniau, J. M. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90109-n · Cited by 865
Dopamine-mediated regulation of corticostriatal synaptic plasticity
Calabresi, P., Picconi, B., Tozzi, A., & Di Filippo, M. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.001 · Cited by 865
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855
Sparks, D. L. (1986) · Physiological Reviews · doi:10.1152/physrev.1986.66.1.118 · Cited by 824
Salamone, J. D., & Correa, M. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00282-6 · Cited by 817
Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli
Ungless, M. A., Magill, P. J., & Bolam, J. P. (2004) · Science · doi:10.1126/science.1093360 · Cited by 782
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762
Self-citationGreengard, P., Allen, P. B., & Nairn, A. C. (1999) · Neuron · doi:10.1016/s0896-6273(00)80798-9 · Cited by 746
Dopamine operates as a subsecond modulator of food seeking
Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., & Carelli, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3823-03.2004 · Cited by 718 · cited 2×
“…is clear that DA neurones can operate in a range of different modes (Fiorillo et al., 2003; Floresco et al., 2003; Grace, 1995; Heien et al., 2005; Roitman et al., 2004; Schultz, 2007; Venton and Wightman, 2007), the activity pattern that has received most attention in the context of…”
BackgroundThe role of the amygdala in human fear: automatic detection of threat
Öhman, A. (2005) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2005.03.019 · Cited by 691
The Neuroscience of Mammalian Associative Learning
Fanselow, M. S., & Poulos, A. M. (2005) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070213 · Cited by 683
Solving the Distal Reward Problem through Linkage of STDP and Dopamine Signaling
Izhikevich, E. M. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl152 · Cited by 657
A computational model of action selection in the basal ganglia. I. A new functional anatomy
Gurney, K., Prescott, T. J., & Redgrave, P. (2001) · Biological Cybernetics · doi:10.1007/pl00007984 · Cited by 629
Self-citationParallel incentive processing: an integrated view of amygdala function
Balleine, B. W., & Killcross, S. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.03.002 · Cited by 622 · cited 2×
“It is likely that the associative learning linking the CS and UCS in Pavlovian conditioning is promoted by the phasic DA signals that are directed to structures other than the striatum, e.g. the amygdala (Balleine and Killcross, 2006; Fanselow and Poulos, 2005; Paton et al., 2006).”
BackgroundIntrinsically Motivated Reinforcement Learning
Singh, S., Barto, A. G., & Chentanez, N. (2005) · doi:10.21236/ada440280 · Cited by 610
The thalamostriatal system: a highly specific network of the basal ganglia circuitry
Smith, Y., Raju, D. V., Pare, J.-F., & Sidibe, M. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.07.004 · Cited by 602
Mechanisms for selection of basic motor programs – roles for the striatum and pallidum
Grillner, S., Hellgren, J., Ménard, A., Saitoh, K., & Wikström, M. A. (2005) · Trends in Neurosciences · doi:10.1016/j.tins.2005.05.004 · Cited by 592
Event or emergency? Two response systems in the mammalian superior colliculus
Dean, P., Redgrave, P., & Westby, G. W. M. (1989) · Trends in Neurosciences · doi:10.1016/0166-2236(89)90052-0 · Cited by 586
Self-citationCoincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons
Morris, G., Arkadir, D., Nevet, A., Vaadia, E., & Bergman, H. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.012 · Cited by 574
Importance of unpredictability for reward responses in primate dopamine neurons
Mirenowicz, J., & Schultz, W. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.2.1024 · Cited by 569
Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex
Roesch, M. R., & Olson, C. R. (2004) · Science · doi:10.1126/science.1093223 · Cited by 542
Dopamine-dependent plasticity of corticostriatal synapses
Reynolds, J. N. J., & Wickens, J. R. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00045-x · Cited by 535
Self-citationHikosaka, O., & Wurtz, R. H. (1983) · Journal of Neurophysiology · doi:10.1152/jn.1983.49.5.1230 · Cited by 523
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506 · cited 4×
“Two recurring themes in relevant literature point to their involvement in action selection (Grillner et al., 2005; Hikosaka, 2007; Mink, 1996; Redgrave et al., 1999a) and reinforcement learning (Houk, 2005; Schultz, 1998; Schultz et al., 1997; Wickens, 1993; Wickens et al., 2003).”
BackgroundResultInfluentialSelf-citationMidbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503 · cited 1×
“Since most experiments analysing the sensory properties of DA neurones have used visual stimuli (Morris et al., 2004; Morris et al., 2006; Ravel and Richmond, 2006; Satoh et al., 2003; Schultz, 1998; Schultz, 2006; Takikawa et al., 2004), we will concentrate on the potential sources of visual…”
BackgroundFiring modes of midbrain dopamine cells in the freely moving rat
Hyland, B. I., Reynolds, J. N. J., Hay, J., Perk, C. G., & Miller, R. (2002) · Neuroscience · doi:10.1016/s0306-4522(02)00267-1 · Cited by 492
Self-citationReal-time measurement of dopamine fluctuations after cocaine in the brain of behaving rats
Heien, M. L. A. V., Khan, A. S., Ariansen, J. L., Cheer, J. F., Phillips, P. E. M., Wassum, K. M., & Wightman, R. M. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504657102 · Cited by 482 · cited 1×
“While it is clear that DA neurones can operate in a range of different modes (Fiorillo et al., 2003; Floresco et al., 2003; Grace, 1995; Heien et al., 2005; Roitman et al., 2004; Schultz, 2007; Venton and Wightman, 2007), the activity pattern that has received most attention in the context of…”
BackgroundDopamine: generalization and bonuses
Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00048-5 · Cited by 480
Schoenbaum, G., Setlow, B., Saddoris, M. P., & Gallagher, M. (2003) · Neuron · doi:10.1016/s0896-6273(03)00474-4 · Cited by 469
Matsumoto, N., Minamimoto, T., Graybiel, A. M., & Kimura, M. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.2.960 · Cited by 461
Kim, H., Shimojo, S., & O'Doherty, J. P. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040233 · Cited by 453
Opponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439
Monkeys Pay Per View: Adaptive Valuation of Social Images by Rhesus Macaques
Deaner, R. O., Khera, A. V., & Platt, M. L. (2005) · Current Biology · doi:10.1016/j.cub.2005.01.044 · Cited by 432
Pan, W.-X., Schmidt, R., Wickens, J. R., & Hyland, B. I. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1478-05.2005 · Cited by 429
The role of prelimbic cortex in instrumental conditioning
Corbit, L. H., & Balleine, B. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.023 · Cited by 423
Subcortical loops through the basal ganglia
MCHAFFIE, J., STANFORD, T., STEIN, B., COIZET, V, & REDGRAVE, P. (2005) · Trends in Neurosciences · doi:10.1016/j.tins.2005.06.006 · Cited by 421
Self-citationInformation processing, dimensionality reduction and reinforcement learning in the basal ganglia
Bar-Gad, I., Morris, G., & Bergman, H. (2003) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2003.12.001 · Cited by 399
Kerr, J. N. D., & Wickens, J. R. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.1.117 · Cited by 383
Calabresi, P., Gubellini, P., Centonze, D., Picconi, B., Bernardi, G., Chergui, K., Svenningsson, P., Fienberg, A. A., & Greengard, P. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-22-08443.2000 · Cited by 380
Basal ganglia orient eyes to reward
Hikosaka, O., Nakamura, K., & Nakahara, H. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00458.2005 · Cited by 377
A Physiologically Plausible Model of Action Selection and Oscillatory Activity in the Basal Ganglia
Humphries, M. D., Stewart, R. D., & Gurney, K. N. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3486-06.2006 · Cited by 370
Self-citationDopaminergic control of synaptic plasticity in the dorsal striatum
Centonze, D., Picconi, B., Gubellini, P., Bernardi, G., & Calabresi, P. (2001) · European Journal of Neuroscience · doi:10.1046/j.0953-816x.2001.01485.x · Cited by 364
Neuroanatomy of the oculomotor system.
Heermann, S. (1988) · PubMed · Cited by 362
Schultz, W., & Romo, R. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.607 · Cited by 334 · cited 2×
“Thus, stimuli with similar sensory properties but with no actual association with reward often elicit phasic DA neuronal responses (Schultz and Romo, 1990).”
BackgroundDeschênes, M., Bourassa, J., & Pinault, D. (1994) · Brain Research · doi:10.1016/0006-8993(94)91974-7 · Cited by 325
Functional properties of monkey caudate neurons. II. Visual and auditory responses
Hikosaka, O., Sakamoto, M., & Usui, S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.4.799 · Cited by 319
Potts, G. F., Martin, L. E., Burton, P., & Montague, P. R. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.7.1112 · Cited by 316
Berridge, K. C., Aldridge, J. W., Houchard, K. R., & Zhuang, X. (2005) · BMC Biology · doi:10.1186/1741-7007-3-4 · Cited by 309
Seeking Categories in the Brain
Thorpe, S. J., & Fabre-Thorpe, M. (2001) · Science · doi:10.1126/science.1058249 · Cited by 300
Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298
Gurney, K., Prescott, T. J., & Redgrave, P. (2001) · Biological Cybernetics · doi:10.1007/pl00007985 · Cited by 298
Self-citationA direct projection from superior colliculus to substantia nigra for detecting salient visual events
Comoli, E., Coizet, V., Boyes, J., Bolam, J. P., Canteras, N. S., Quirk, R. H., Overton, P. G., & Redgrave, P. (2003) · Nature Neuroscience · doi:10.1038/nn1113 · Cited by 295 · cited 6×
“…sensory processing in the midbrain superior colliculus as the most likely source of early visual input to DA neurones (Coizet et al., 2003; Comoli et al., 2003; Dommett et al., 2005): (i) Direct input from retinal ganglion cells, ensures visual response latencies in the superior…”
BackgroundInfluentialDopamine Neurons Can Represent Context-Dependent Prediction Error
Nakahara, H., Itoh, H., Kawagoe, R., Takikawa, Y., & Hikosaka, O. (2004) · Neuron · doi:10.1016/s0896-6273(03)00869-9 · Cited by 286
How visual stimuli activate dopaminergic neurons at short latency
Dommett, E., Coizet, V., Blaha, C. D., Martindale, J., Lefebvre, V., Walton, N., Mayhew, J. E. W., Overton, P. G., & Redgrave, P. (2005) · Science · doi:10.1126/science.1107026 · Cited by 285
Self-citationNeural mechanisms of reward-related motor learning
Wickens, J. R., Reynolds, J. N., & Hyland, B. I. (2003) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2003.10.013 · Cited by 284
Self-citationBurst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat
Horvitz, J. C., Stewart, T., & Jacobs, B. L. (1997) · Brain Research · doi:10.1016/s0006-8993(97)00265-5 · Cited by 283 · cited 3×
“…(including rats, rabbits, cats and monkeys), and many experimental paradigms (Bayer and Glimcher, 2005; Freeman, 1985; Guarraci and Kapp, 1999; Horvitz et al., 1997; Hyland et al., 2002; Ravel and Richmond, 2006; Schultz, 1998; Takikawa et al., 2004) including under certain conditions,…”
BackgroundNeuroanatomy of the Oculomotor System
(2006) · Progress in Brain Research · doi:10.1016/s0079-6123(05)x5100-7 · Cited by 283
Crutcher, M. D., & DeLong, M. R. (1984) · Experimental Brain Research · doi:10.1007/bf00238154 · Cited by 282
Transient changes in mesolimbic dopamine and their association with ‘reward’
Wightman, R. M., & Robinson, D. L. (2002) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.2002.01005.x · Cited by 281
Models of information processing in the basal ganglia
Alexander, G. (1996) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0921-884x(96)89703-7 · Cited by 278
Arbuthnott, G. W., & Wickens, J. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2006.12.003 · Cited by 274
Grace, A. A. (1995) · Drug and Alcohol Dependence · doi:10.1016/0376-8716(94)01066-t · Cited by 274
Neuropsychiatry of the basal ganglia
Ring, H. A. (2002) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.72.1.12 · Cited by 270
Visual and oculomotor functions of monkey subthalamic nucleus
Matsumura, M., Kojima, J., Gardiner, T. W., & Hikosaka, O. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.6.1615 · Cited by 265
Contiguity and contingency in action-effect learning
Elsner, B., & Hommel, B. (2004) · Psychological Research · doi:10.1007/s00426-003-0151-8 · Cited by 243
Reiner, A., Jiao, Y., Del Mar, N., Laverghetta, A. V., & Lei, W. L. (2003) · Journal of Comparative Neurology · doi:10.1002/cne.10541 · Cited by 241
Firing properties of substantia nigra dopaminergic neurons in freely moving rats
Freeman, A. S., Meltzer, L. T., & Bunney, B. S. (1985) · Life Sciences · doi:10.1016/0024-3205(85)90448-5 · Cited by 236
Reward-Dependent Gain and Bias of Visual Responses in Primate Superior Colliculus
Ikeda, T., & Hikosaka, O. (2003) · Neuron · doi:10.1016/s0896-6273(03)00464-1 · Cited by 233
Evolution of the basal ganglia in tetrapods: a new perspective based on recent studies in amphibians
Marı́n, O., Smeets, W. J. A. J., & González, A. (1998) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01297-1 · Cited by 231
Amygdaloid projections to ventromedial striatal subterritories in the primate
Fudge, J. L., Kunishio, K., Walsh, P., Richard, C., & Haber, S. N. (2002) · Neuroscience · doi:10.1016/s0306-4522(01)00546-2 · Cited by 229
Human neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209
Influence of Reward Expectation on Visuospatial Processing in Macaque Lateral Prefrontal Cortex
Kobayashi, S., Lauwereyns, J., Koizumi, M., Sakagami, M., & Hikosaka, O. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00472.2001 · Cited by 206
Sensorimotor integration in the primate superior colliculus. I. Motor convergence
Jay, M. F., & Sparks, D. L. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.22 · Cited by 205
Guarraci, F. A., & Kapp, B. S. (1999) · Behavioural Brain Research · doi:10.1016/s0166-4328(98)00102-8 · Cited by 201
How parallel is visual processing in the ventral pathway?
Rousselet, G. A., Thorpe, S. J., & Fabre-Thorpe, M. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.06.003 · Cited by 197
Ungless, M. A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.001 · Cited by 192
The 28th Bartlett Memorial Lecture Causal learning: An associative analysis
Dickinson, A. (2001) · The Quarterly Journal of Experimental Psychology B · doi:10.1080/02724990042000010 · Cited by 186
Schultz, W., & Romo, R. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.201 · Cited by 184 · cited 1×
“Indeed, several studies (Maeda and Mogenson, 1982; Schultz and Romo, 1987; Tsai et al., 1980; Ungless et al., 2004), including our own (Coizet et al., 2006), now show that noxious stimuli cause a phasic suppression of DA neuronal activity.”
BackgroundA robot model of the basal ganglia: Behavior and intrinsic processing
Prescott, T. J., Montes González, F. M., Gurney, K., Humphries, M. D., & Redgrave, P. (2006) · Neural Networks · doi:10.1016/j.neunet.2005.06.049 · Cited by 180
Self-citationGABAergic output of the basal ganglia
Hikosaka, O. (2007) · Progress in Brain Research · doi:10.1016/s0079-6123(06)60012-5 · Cited by 171
Dopamine-dependent synaptic plasticity in striatum during in vivo development
Tang, K.-C. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.031374698 · Cited by 171
Prediction Error during Retrospective Revaluation of Causal Associations in Humans
Corlett, P. R., Aitken, M. R. F., Dickinson, A., Shanks, D. R., Honey, G. D., Honey, R. A. E., Robbins, T. W., Bullmore, E. T., & Fletcher, P. C. (2004) · Neuron · doi:10.1016/j.neuron.2004.11.022 · Cited by 168
Neural correlates of decision processes: neural and mental chronometry
Schall, J. D. (2003) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(03)00039-4 · Cited by 165
Apicella, P., Legallet, E., & Trouche, E. (1997) · Experimental Brain Research · doi:10.1007/pl00005773 · Cited by 162
(1993) · Elsevier eBooks · doi:10.1016/c2009-0-35344-1 · Cited by 161
Shepard, D. S., Holcomb, H. H., & Gold, J. M. (2005) · Schizophrenia Bulletin · doi:10.1093/schbul/sbj083 · Cited by 159
Evolution of the basal ganglia: new perspectives through a comparative approach
SMEETS, W. J. A. J., MARÍN, O., & GONZÁLEZ, A. (2000) · Journal of Anatomy · doi:10.1046/j.1469-7580.2000.19640501.x · Cited by 159
Coding and Monitoring of Motivational Context in the Primate Prefrontal Cortex
Watanabe, M., Hikosaka, K., Sakagami, M., & Shirakawa, S.-I. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-06-02391.2002 · Cited by 159
Repetitive Behaviors in Monkeys Are Linked to Specific Striatal Activation Patterns
Saka, E., Goodrich, C. M., Harlan, P. C., Madras, B. K., & Graybiel, A. M. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.1072-04.2004 · Cited by 154
Lévesque, M., Charara, A., Gagnon, S., Parent, A., & Deschênes, M. (1996) · Brain Research · doi:10.1016/0006-8993(95)01333-4 · Cited by 151
Houk, J. C. (2005) · Biological Cybernetics · doi:10.1007/s00422-005-0569-8 · Cited by 149
Medina, L. M., & Reiner, A. J. (2008) · Brain Behavior and Evolution · doi:10.1159/000113277 · Cited by 145
Omelchenko, N., & Sesack, S. R. (2007) · Neuroscience · doi:10.1016/j.neuroscience.2007.02.016 · Cited by 138
Windmann, S., Kirsch, P., Mier, D. U., Stark, R. M., Walter, B., Güntürkün, O., & Vaitl, D. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.7.1198 · Cited by 136
Activity of single neurons in the monkey amygdala during performance of a visual discrimination task
Nakamura, K., Mikami, A., & Kubota, K. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.6.1447 · Cited by 136
Comparison of Reward Modulation in the Frontal Eye Field and Caudate of the Macaque
Ding, L., & Hikosaka, O. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.0836-06.2006 · Cited by 135
Plastic Corticostriatal Circuits for Action Learning
Costa, R. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.015 · Cited by 129
Young, A. M. J. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2004.03.003 · Cited by 127
Non-conscious recognition of emotional body language
de Gelder, B., & Hadjikhani, N. K. (2006) · Neuroreport · doi:10.1097/00001756-200604240-00006 · Cited by 122
Influences of Rewarding and Aversive Outcomes on Activity in Macaque Lateral Prefrontal Cortex
Kobayashi, S., Nomoto, K., Watanabe, M., Hikosaka, O., Schultz, W., & Sakagami, M. (2006) · Neuron · doi:10.1016/j.neuron.2006.08.031 · Cited by 114
Coizet, V., Dommett, E. J., Redgrave, P., & Overton, P. G. (2006) · Neuroscience · doi:10.1016/j.neuroscience.2006.01.030 · Cited by 112
Self-citationGaze control through superior colliculus: structure and function.
Grantyn, R. (1988) · PubMed · Cited by 111
Corbit, L. H., Ostlund, S. B., & Balleine, B. W. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-24-10976.2002 · Cited by 110
A direct projection from superior colliculus to substantia nigra pars compacta in the cat
McHaffie, J. G., Jiang, H., May, P. J., Coizet, V., Overton, P. G., Stein, B. E., & Redgrave, P. (2005) · Neuroscience · doi:10.1016/j.neuroscience.2005.11.015 · Cited by 105
Self-citationNeuronal Signals in the Monkey Basolateral Amygdala during Reward Schedules
Sugase-Miyamoto, Y., & Richmond, B. J. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.1796-05.2005 · Cited by 105
Corticostriatal plasticity: life after the depression
Mahon, S., Deniau, J., & Charpier, S. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.06.010 · Cited by 100
Bevins, R. A., Besheer, J., Palmatier, M. I., Jensen, H. C., Pickett, K. S., & Eurek, S. E. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(01)00326-6 · Cited by 99
Takikawa, Y., Kawagoe, R., & Hikosaka, O. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00238.2004 · Cited by 96
Functional anatomy of movement disorders
Crossman, A. R. (2000) · Journal of Anatomy · doi:10.1046/j.1469-7580.2000.19640519.x · Cited by 94
Unit responses to visual stimuli in the superior colliculus of the unanesthetized, mid-pontine cat.
Jm, S., Pl, M., & Rixxolatti, G. (1968) · PubMed · Cited by 90
Concentration-dependent actions of stimulated dopamine release on neuronal activity in rat striatum
Williams, G. V., & Millar, J. (1990) · Neuroscience · doi:10.1016/0306-4522(90)90217-r · Cited by 87
Collateral projections of predorsal bundle cells of the superior colliculus in the rat
Bickford, M. E., & Hall, W. C. (1989) · The Journal of Comparative Neurology · doi:10.1002/cne.902830108 · Cited by 81
Reiner, A. J. (2002) · Brain Research Bulletin · doi:10.1016/s0361-9230(01)00667-0 · Cited by 76
Preference for familiar versus novel stimuli as a function of the familiarity of the environment.
Sheldon, A. B. (1969) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0027305 · Cited by 73
Coizet, V., Comoli, E., Westby, G. W. M., & Redgrave, P. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02415.x · Cited by 72
Self-citationRewarding properties of visual stimuli
Blatter, K., & Schultz, W. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-0114-y · Cited by 58
Maeda, H., & Mogenson, G. J. (1982) · Brain Research Bulletin · doi:10.1016/0361-9230(82)90021-1 · Cited by 57
Role of dopamine D-sub-1 and D-sub-2 receptors in novelty-maintained place preference.
Bardo, M. T., Bowling, S. L., Robinet, P. M., Rowlett, J. K., Lacy, M., & Mattingly, B. A. (1993) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.1.1-4.101 · Cited by 56
The nigrostriatal DA pathway and Parkinson’s disease
Fuxé, K., Manger, P. R., Genedani, S., & Agnati, L. F. (2006) · Springer eBooks · doi:10.1007/978-3-211-45295-0_13 · Cited by 55
Venton, B. J., & Wightman, R. M. (2006) · Synapse · doi:10.1002/syn.20343 · Cited by 50
Horn, G., & Hill, R. M. (1966) · Nature · doi:10.1038/211754a0 · Cited by 48
Tsai, C. T., Nakamura, S., & Iwama, K. (1980) · Brain Research · doi:10.1016/0006-8993(80)90066-9 · Cited by 47
Klop, E. M., Mouton, L. J., Hulsebosch, R., Boers, J., & Holstege, G. (2005) · Neuroscience · doi:10.1016/j.neuroscience.2005.03.035 · Cited by 47
Coizet, V., Overton, P. G., & Redgrave, P. (2006) · The Journal of Comparative Neurology · doi:10.1002/cne.21202 · Cited by 46
Self-citationDopamine neuronal responses in monkeys performing visually cued reward schedules
Ravel, S., & Richmond, B. J. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04905.x · Cited by 46
Reinforcement delay of one second severely impairs acquisition of brain self-stimulation
Black, J., Belluzzi, J. D., & Stein, L. (1985) · Brain Research · doi:10.1016/0006-8993(85)91418-0 · Cited by 44
An Investigation of Two Mediation Strategies Suitable for Behavioural Control in Animals and Animats
Snaith, M., & Holland, O. E. (1991) · The MIT Press eBooks · doi:10.7551/mitpress/3115.003.0035 · Cited by 32
Katsuta, H., & Isa, T. (2003) · Neuroscience Research · doi:10.1016/s0168-0102(03)00029-4 · Cited by 23
Cited by
Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease
Redgrave, P., Rodriguez, M., Smith, Y., Rodriguez-Oroz, M. C., Lehericy, S., Bergman, H., Agid, Y., DeLong, M. R., & Obeso, J. A. (2010) · Nature reviews. Neuroscience · doi:10.1038/nrn2915 · Cited by 1,134
“, whereas sensory-evoked phasic activity provides 'teaching signals' for instrumental learning”
Cortico-Basal Ganglia Reward Network: Microcircuitry
Sesack, S. R., & Grace, A. A. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.93 · Cited by 985
The Social Salience Hypothesis of Oxytocin
Shamay-Tsoory, S. G., & Abu-Akel, A. (2016) · Biological Psychiatry · doi:10.1016/j.biopsych.2015.07.020 · Cited by 904
“The detection of salient stimuli is centrally regulated by the dopaminergic system (86, 87) and is characterized by a sharp increase (phasic) in dopaminergic activity, 70-100ms post the presentation of the stimulus, and occurs before an orienting gaze-shift, which has a latency of 150-200ms indicative of its role in a…”
Striatal Dopamine Release Is Triggered by Synchronized Activity in Cholinergic Interneurons
Threlfell, S., Lalic, T., Platt, N. J., Jennings, K. A., Deisseroth, K., & Cragg, S. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.04.038 · Cited by 845
Information-seeking, curiosity, and attention: computational and neural mechanisms
Gottlieb, J., Oudeyer, P.-Y., Lopes, M., & Baranes, A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.001 · Cited by 784
Metadata
- Authors
- Redgrave, P., Gurney, K., & Reynolds, J.
- Venue
- Brain Research Reviews
- Publisher
- Elsevier BV
- Published
- 2008-08
- Volume
- 58
- Issue
- 2
- Pages
- 322-339
- ISSN
- 0165-0173 (ISSN-L)
- OpenAlex
- W2017559332
- Cited by
- 261
- References
- 165
- FWCI
- 5.92
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.