Getting formal with dopamine and reward
Open accessAbstract
Recent neurophysiological studies reveal that neurons in certain brain structures carry specific signals about past and future rewards. Dopamine neurons display a short-latency, phasic reward signal indicating the difference between actual and predicted rewards. The signal is useful for enhancing neuronal processing and learning behavioral reactions. It is distinctly different from dopamine's tonic enabling of numerous behavioral processes. Neurons in the striatum, frontal cortex, and amygdala also process reward information but provide more differentiated information for identifying and anticipating rewards and organizing goal-directed behavior. The different reward signals have complementary functions, and the optimal use of rewards in voluntary behavior would benefit from interactions between the signals. Addictive psychostimulant drugs may exert their action by amplifying the dopamine reward signal.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Self-citationThe neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346 · see citing works
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
Cognitive, social, and physiological determinants of emotional state.
Schachter, S., & Singer, J. (1962) · Psychological Review · doi:10.1037/h0046234 · Cited by 6,223 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Self-citation(1996) · Cited by 3,692 · see citing works
The Cerebellum as a Neuronal Machine
Eccles, J. C., Ito, M., & Szentágothai, J. (1967) · Springer eBooks · doi:10.1007/978-3-662-13147-3 · Cited by 3,253 · see citing works
Marr, D. (1969) · The Journal of Physiology · doi:10.1113/jphysiol.1969.sp008820 · Cited by 3,253 · see citing works
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,238 · see citing works
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · see citing works
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733 · see citing works
Hyperlocomotion and indifference to cocaine and amphetamine in mice lacking the dopamine transporter
Giros, B., Jaber, M., Jones, S. R., Wightman, R. M., & Caron, M. G. (1996) · Nature · doi:10.1038/379606a0 · Cited by 2,476 · see citing works
Burns, R. S., Chiueh, C. C., Markey, S. P., Ebert, M. H., Jacobowitz, D. M., & Kopin, I. J. (1983) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.80.14.4546 · Cited by 2,149 · see citing works
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
The formation of learning sets.
Harlow, H. F. (1949) · Psychological Review · doi:10.1037/h0062474 · Cited by 1,959 · see citing works
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777 · see citing works
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · see citing works
Falkenstein, M., Hohnsbein, J., Hoormann, J., & Blanke, L. (1991) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(91)90062-9 · Cited by 1,706 · see citing works
Cognitive Deficit Caused by Regional Depletion of Dopamine in Prefrontal Cortex of Rhesus Monkey
Brozoski, T. J., Brown, R. M., Rosvold, H. E., & Goldman, P. S. (1979) · Science · doi:10.1126/science.112679 · Cited by 1,500 · see citing works
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450 · see citing works
D1 Dopamine Receptors in Prefrontal Cortex: Involvement in Working Memory
Sawaguchi, T., & Goldman-Rakic, P. S. (1991) · Science · doi:10.1126/science.1825731 · Cited by 1,364 · see citing works
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · see citing works
Self-citationSchultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291 · see citing works
Self-citationModels of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works
Neurobehavioural mechanisms of reward and motivation
Robbins, T. W., & Everitt, B. J. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80077-8 · Cited by 1,187 · see citing works
Ito, M. (1989) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.12.030189.000505 · Cited by 1,167 · see citing works
Single cocaine exposure in vivo induces long-term potentiation in dopamine neurons
Ungless, M. A., Whistler, J. L., Malenka, R. C., & Bonci, A. (2001) · Nature · doi:10.1038/35079077 · Cited by 1,106 · see citing works
Abercrombie, E. D., Keefe, K. A., DiFrischia, D. S., & Zigmond, M. J. (1989) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.1989.tb09224.x · Cited by 1,106 · see citing works
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,103 · see citing works
Self-citationWise, R. A. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80079-1 · Cited by 1,072 · see citing works
Smith, A. D., & Bolam, J. P. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90106-k · Cited by 1,040 · see citing works
Aston-Jones, G., & Bloom, F. (1981) · Journal of Neuroscience · doi:10.1523/jneurosci.01-08-00887.1981 · Cited by 1,033 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
Self-citationMotivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · see citing works
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987 · see citing works
Self-citationMesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967 · see citing works
Contemporary Animal Learning Theory.
Abrahamson, D. (1981) · Europe PMC (PubMed Central) · Cited by 945 · see citing works
Contemporary Animal Learning Theory
LoLordo, V. M., & Dickinson, A. (1982) · The American Journal of Psychology · doi:10.2307/1422669 · Cited by 891 · see citing works
Wise, R. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)00965-0 · Cited by 881 · see citing works
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879 · see citing works
Freund, T. F., Powell, J. F., & Smith, A. D. (1984) · Neuroscience · doi:10.1016/0306-4522(84)90294-x · Cited by 867 · see citing works
Foote, S. L., Aston-Jones, G., & Bloom, F. E. (1980) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.77.5.3033 · Cited by 857 · see citing works
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836 · see citing works
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829 · see citing works
Self-citationTD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level Play
Tesauro, G. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.215 · Cited by 803 · see citing works
Addictive Drugs and Brain Stimulation Reward
Wise, R. A. (1996) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.19.030196.001535 · Cited by 792 · see citing works
Rolls, E. T. (1996) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1996.0128 · Cited by 755 · see citing works
Long-term potentiation of excitatory inputs to brain reward areas by nicotine
Mansvelder, H. D., & McGehee, D. S. (2000) · Neuron · doi:10.1016/s0896-6273(00)00042-8 · Cited by 720 · see citing works
Synaptic mechanisms underlie nicotine-induced excitability of brain reward areas
Mansvelder, H. D., Keath, J. R., & McGehee, D. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00625-6 · Cited by 701 · see citing works
Reward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · cited 4× · see citing works
“…and amounts of food and Given the central importance of rewards for survival, reproduction, and competitive gains, it may not be sur-liquid rewards (Watanabe, 1996; Leon and Shadlen, 1999; Tremblay and Schultz, 1999; Hassani et al., 2001) prising that several specialized and only partly…”
InfluentialGonon, F. G. (1988) · Neuroscience · doi:10.1016/0306-4522(88)90307-7 · Cited by 676 · see citing works
Long-term synaptic depression in the striatum: physiological and pharmacological characterization
Calabresi, P., Maj, R., Pisani, A., Mercuri, N. B., & Bernardi, G. (1992) · Journal of Neuroscience · doi:10.1523/jneurosci.12-11-04224.1992 · Cited by 673 · see citing works
Purkinje cell activity during motor learning
Gilbert, P. F. C., & Thach, W. T. (1977) · Brain Research · doi:10.1016/0006-8993(77)90997-0 · Cited by 657 · see citing works
Role for Cingulate Motor Area Cells in Voluntary Movement Selection Based on Reward
Shima, K., & Tanji, J. (1998) · Science · doi:10.1126/science.282.5392.1335 · Cited by 653 · see citing works
Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task
Aston-Jones, G., Rajkowski, J., Kubiak, P., & Alexinsky, T. (1994) · The Journal of Neuroscience · doi:10.1523/jneurosci.14-07-04467.1994 · Cited by 637 · see citing works
Expectation of reward modulates cognitive signals in the basal ganglia
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998) · Nature Neuroscience · doi:10.1038/1625 · Cited by 632 · see citing works
Murphy, B. L., Arnsten, A. F., Goldman-Rakic, P. S., & Roth, R. H. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.3.1325 · Cited by 590 · see citing works
Hikosaka, O., Sakamoto, M., & Usui, S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.4.814 · Cited by 579 · see citing works
Presynaptic regulation of neurotransmitter release in the brain: Facts and hypothesis
Chesselet, M.-F. (1984) · Neuroscience · doi:10.1016/0306-4522(84)90058-7 · Cited by 577 · see citing works
Cortical remodelling induced by activity of ventral tegmental dopamine neurons
Bao, S., Chan, V. T., & Merzenich, M. M. (2001) · Nature · doi:10.1038/35083586 · Cited by 569 · see citing works
A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
Houk, J. C., Adams, J. L., & Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0020 · Cited by 555 · see citing works
Cepeda, C., Buchwald, N. A., & Levine, M. S. (1993) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.90.20.9576 · Cited by 554 · see citing works
Cognitive effects of false heart-rate feedback
Valins, S. (1966) · Journal of Personality and Social Psychology · doi:10.1037/h0023791 · Cited by 550 · see citing works
Importance of unpredictability for reward responses in primate dopamine neurons
Mirenowicz, J., & Schultz, W. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.2.1024 · Cited by 544 · see citing works
Self-citationLearning and Computational Neuroscience: Foundations of Adaptive Networks
Gabriel, M., & Moore, J. (1990) · Cited by 519 · see citing works
Prefrontal and cingulate unit activity during timing behavior in the monkey
Niki, H., & Watanabe, M. (1979) · Brain Research · doi:10.1016/0006-8993(79)90328-7 · Cited by 507 · see citing works
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506 · see citing works
Perspectives on Cognitive Neuroscience
Churchland, P. S., & B, T. J. S. A. (1988) · Science · doi:10.1126/science.3055294 · Cited by 505 · see citing works
Time-Derivative Models of Pavlovian Reinforcement
Sutton, R. S., & Barto, A. G. (1990) · Cited by 496 · see citing works
Hernández‐López, S., Bargas, J., Surmeier, D. J., Reyes, A., & Galarraga, E. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-09-03334.1997 · Cited by 495 · see citing works
Critchley, H., & Rolls, E. T. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.4.1673 · Cited by 467 · see citing works
Adaptive Critics and the Basal Ganglia
Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0018 · Cited by 466 · see citing works
Spatial Processing in the Monkey Frontal Eye Field. I. Predictive Visual Responses
Umeno, M. M., & Goldberg, M. E. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.3.1373 · Cited by 462 · see citing works
Leon, M. I., & Shadlen, M. N. (1999) · Neuron · doi:10.1016/s0896-6273(00)80854-5 · Cited by 449 · see citing works
Richfield, E. K., Penney, J. B., & Young, A. B. (1989) · Neuroscience · doi:10.1016/0306-4522(89)90168-1 · Cited by 448 · see citing works
Dopamine synaptic complex with pyramidal neurons in primate cerebral cortex.
Goldman-Rakic, P. S., Leranth, C., Williams, S. M., Mons, N. E., & Geffard, M. (1989) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.86.22.9015 · Cited by 433 · see citing works
Cerebellar complex spikes encode both destinations and errors in arm movements
Kitazawa, S., Kimura, T., & Yin, P.-B. (1998) · Nature · doi:10.1038/33141 · Cited by 401 · see citing works
Nicotinic effects on the firing pattern of midbrain dopamine neurons
GRENHOFF, J., ASTON‐JONES, G., & SVENSSON, T. H. (1986) · Acta Physiologica Scandinavica · doi:10.1111/j.1748-1716.1986.tb07988.x · Cited by 399 · see citing works
Performance monitoring by the supplementary eye field
Stuphorn, V., Taylor, T. L., & Schall, J. D. (2000) · Nature · doi:10.1038/35048576 · Cited by 392 · see citing works
Sakurai, M. (1987) · The Journal of Physiology · doi:10.1113/jphysiol.1987.sp016881 · Cited by 391 · see citing works
Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey
Schultz, W. (1986) · Journal of Neurophysiology · doi:10.1152/jn.1986.56.5.1439 · Cited by 390 · see citing works
Self-citationEffects of methylphenidate on spatial working memory and planning in healthy young adults
Elliott, R., Sahakian, B. J., Matthews, K., Bannerjea, A., Rimmer, J., & Robbins, T. W. (1997) · Psychopharmacology · doi:10.1007/s002130050284 · Cited by 389 · see citing works
Kerr, J. N. D., & Wickens, J. R. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.1.117 · Cited by 384 · see citing works
Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380 · see citing works
Self-citationOtmakhova, N. A., & Lisman, J. E. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-23-07478.1996 · Cited by 377 · see citing works
Rat navigation guided by remote control
Talwar, S. K., Xu, S., Hawley, E. S., Weiss, S. A., Moxon, K. A., & Chapin, J. K. (2002) · Nature · doi:10.1038/417037a · Cited by 372 · see citing works
Yang, C., & Seamans, J. K. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01922.1996 · Cited by 369 · see citing works
Gurden, H., Takita, M., & Jay, T. M. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-22-j0003.2000 · Cited by 366 · see citing works
Dopaminergic A10 neurones are involved in cognitive functions
Simon, H., Scatton, B., & Moal, M. L. (1980) · Nature · doi:10.1038/286150a0 · Cited by 364 · see citing works
Brain Regions Responsive to Novelty in the Absence of Awareness
Berns, G. S., Cohen, J. D., & Mintun, M. A. (1997) · Science · doi:10.1126/science.276.5316.1272 · Cited by 361 · see citing works
Romo, R., & Schultz, W. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.592 · Cited by 353 · cited 3× · see citing works
“These data might ward-predicting stimuli (which are tested in separate trials) (Romo and Schultz, 1990; Mirenowicz and Schultz,sugggest that phasic dopamine activations reflect attention-inducing properties of stimuli, including rewards, 1994).”
Self-citationDopamine-mediated modulation of odour-evoked amygdala potentials during pavlovian conditioning
Rosenkranz, J. A., & Grace, A. A. (2002) · Nature · doi:10.1038/417282a · Cited by 348 · see citing works
Operant Reward Learning in <i>Aplysia</i> : Neuronal Correlates and Mechanisms
Brembs, B., Lorenzetti, F. D., Reyes, F. D., Baxter, D. A., & Byrne, J. H. (2002) · Science · doi:10.1126/science.1069434 · Cited by 338 · see citing works
Filion, M., Tremblay, L., & Bédard, P. J. (1988) · Brain Research · doi:10.1016/0006-8993(88)90924-9 · Cited by 337 · see citing works
Schultz, W., & Romo, R. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.607 · Cited by 334 · cited 2× · see citing works
“…only to the onset of conditioned stimuli and not to their offset, even if stimuli are used whose offsets,Pavlovian or instrumental tasks, such as visual or audi- tory reaction time tasks, spatial delayed response or rather than their onsets, are valid predictors of reward (Schultz and Romo, 1990).”
Self-citationSingle unit activity of locus coeruleus neurons in the freely moving cat
Rasmussen, K., Morilak, D. A., & Jacobs, B. L. (1986) · Brain Research · doi:10.1016/0006-8993(86)90370-7 · Cited by 324 · see citing works
Waterhouse, B. D., & Woodward, D. J. (1980) · Experimental Neurology · doi:10.1016/0014-4886(80)90159-4 · Cited by 322 · see citing works
The cerebellum and VOR/OKR learning models
Kawato, M., & Gomi, H. (1992) · Trends in Neurosciences · doi:10.1016/0166-2236(92)90008-v · Cited by 320 · see citing works
Smith, Y., Bennett, B. D., Bolam, J. P., Parent, A., & Sadikot, A. F. (1994) · The Journal of Comparative Neurology · doi:10.1002/cne.903440102 · Cited by 312 · see citing works
Bee foraging in uncertain environments using predictive hebbian learning
Montague, P. R., Dayan, P., Person, C., & Sejnowski, T. J. (1995) · Nature · doi:10.1038/377725a0 · Cited by 311 · see citing works
Response to Novelty and its Rapid Habituation in Locus Coeruleus Neurons of the Freely Exploring Rat
Vankov, A., Hervé‐Minvielle, A., & Sara, S. J. (1995) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1995.tb01108.x · Cited by 309 · see citing works
Neuronal activity in monkey striatum related to the expectation of predictable environmental events
Apicella, P., Scarnati, E., Ljungberg, T., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.3.945 · Cited by 305 · see citing works
Self-citationGonon, F. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-15-05972.1997 · Cited by 301 · see citing works
Jörntell, H., & Ekerot, C. ‐. (2002) · Neuron · doi:10.1016/s0896-6273(02)00713-4 · Cited by 299 · see citing works
Wickens, J. R., Begg, A., & Arbuthnott, G. W. (1996) · Neuroscience · doi:10.1016/0306-4522(95)00436-m · Cited by 294 · see citing works
Suri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294 · see citing works
Self-citationAbnormal Synaptic Plasticity in the Striatum of Mice Lacking Dopamine D2 Receptors
Calabresi, P., Saiardi, A., Pisani, A., Baik, J., Centonze, D., Mercuri, N. B., Bernardi, G., & Borrelli, E. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-12-04536.1997 · Cited by 287 · see citing works
Selective association and conditioning
Kamin, L. J. (1969) · Medical Entomology and Zoology · Cited by 285 · see citing works
Williams, S. M., & Goldman-Rakic, P. S. (1993) · Cerebral Cortex · doi:10.1093/cercor/3.3.199 · Cited by 284 · see citing works
Responses to the Sensory Properties of Fat of Neurons in the Primate Orbitofrontal Cortex
Rolls, E. T., Critchley, H. D., Browning, A. S., Hernadi, I., & Lenard, L. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-04-01532.1999 · Cited by 278 · see citing works
Neural mechanisms in disorders of movement
Crossman, A. R. (1989) · Comparative Biochemistry and Physiology Part A Physiology · doi:10.1016/0300-9629(89)90201-6 · Cited by 276 · see citing works
Localization of drug reward mechanisms by intracranial injections
Wise, R. A., & Hoffman, D. C. (1992) · Synapse · doi:10.1002/syn.890100307 · Cited by 276 · see citing works
Value-dependent selection in the brain: Simulation in a synthetic neural model
Friston, K. J., Tononi, G., Reeke, G. N., Sporns, O., & Edelman, G. M. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90592-4 · Cited by 268 · see citing works
Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
Tremblay, L., Hollerman, J. R., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.964 · Cited by 267 · see citing works
Self-citationVisual and oculomotor functions of monkey subthalamic nucleus
Matsumura, M., Kojima, J., Gardiner, T. W., & Hikosaka, O. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.6.1615 · Cited by 265 · see citing works
Berger, B., Trottier, S., Verney, C., Gaspar, P., & Alvarez, C. (1988) · The Journal of Comparative Neurology · doi:10.1002/cne.902730109 · Cited by 263 · see citing works
Influence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum
Hassani, O. K., Cromwell, H. C., & Schultz, W. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.6.2477 · Cited by 257 · see citing works
Self-citationFacilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus.
Lovibond, P. (1983) · Journal of experimental psychology. Animal behavior processes · doi:10.1037/0097-7403.9.3.225 · Cited by 257 · see citing works
EXPERIMENTAL AND HISTOLOGICAL STUDY OF MIDBRAIN DYSKINESIAS
POIRIER, L. J. (1960) · Journal of Neurophysiology · doi:10.1152/jn.1960.23.5.534 · Cited by 255 · see citing works
On the cerebellum and motor learning
Llinás, R., & Welsh, J. P. (1993) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(93)90168-x · Cited by 252 · see citing works
Inhibition of climbing fibres is a signal for the extinction of conditioned eyelid responses
Medina, J. F., Nores, W. L., & Mauk, M. D. (2002) · Nature · doi:10.1038/416330a · Cited by 252 · see citing works
Orbitofrontal cortex is activated during breaches of expectation in tasks of visual attention
Nobre, A. C., Coull, J. T., Frith, C., & Mesulam, M. M. (1999) · Nature Neuroscience · doi:10.1038/4513 · Cited by 249 · see citing works
Relations between movement and single cell discharge in the substantia nigra of the behaving monkey
DeLong, M., Crutcher, M., & Georgopoulos, A. (1983) · The Journal of Neuroscience · doi:10.1523/jneurosci.03-08-01599.1983 · Cited by 247 · see citing works
Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards
Bowman, E. M., Aigner, T. G., & Richmond, B. J. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.3.1061 · Cited by 246 · see citing works
Noradrenergic Regulation of Synaptic Plasticity in the Hippocampal CA1 Region
Katsuki, H., Izumi, Y., & Zorumski, C. F. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.6.3013 · Cited by 244 · see citing works
Use‐dependent changes in synaptic efficacy in rat prefrontal neurons in vitro.
Hirsch, J. C., & Crépel, F. (1990) · The Journal of Physiology · doi:10.1113/jphysiol.1990.sp018159 · Cited by 239 · see citing works
Fletcher, P. C., Anderson, J. M., Shanks, D. R., Honey, R., Carpenter, T. A., Donovan, T., Papadakis, N., & Bullmore, E. T. (2001) · Nature Neuroscience · doi:10.1038/nn733 · Cited by 238 · see citing works
Models of the cerebellum and motor learning
Houk, J. C., Buckingham, J. T., & Barto, A. G. (1997) · Cambridge University Press eBooks · doi:10.1017/cbo9780511666896.006 · Cited by 234 · see citing works
Single cell activity in ventral prefrontal cortex of behaving monkeys
Rosenkilde, C. E., Bauer, R. H., & Fuster, J. M. (1981) · Brain Research · doi:10.1016/0006-8993(81)90160-8 · Cited by 233 · see citing works
Interaction of norepinephrine with cerebellar activity evoked by mossy and climbing fibers
Freedman, R., Hoffer, B. J., Woodward, D. J., & Puro, D. G. (1977) · Experimental Neurology · doi:10.1016/0014-4886(77)90175-3 · Cited by 230 · see citing works
The cerebellum and motor learning
Glickstein, M. (1992) · Current Biology · doi:10.1016/0960-9822(92)90096-s · Cited by 230 · see citing works
Chergui, K., Suaud‐Chagny, M., & Gonon, F. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90465-0 · Cited by 229 · see citing works
Church, W. H., Justice, J. B., & Byrd, L. D. (1987) · European Journal of Pharmacology · doi:10.1016/0014-2999(87)90592-9 · Cited by 227 · see citing works
Models of the cerebellum and motor learning
Houk, J. C., Buckingham, J. T., & Barto, A. G. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00081474 · Cited by 227 · see citing works
Aston‐Jones, G., Rajkowski, J., & Kubiak, P. (1997) · Neuroscience · doi:10.1016/s0306-4522(97)00060-2 · Cited by 227 · see citing works
Perspectives on cognitive neuroscience
(1992) · Choice Reviews Online · doi:10.5860/choice.30-0604 · Cited by 226 · see citing works
Sears, L. L., & Steinmetz, J. E. (1991) · Brain Research · doi:10.1016/0006-8993(91)91276-7 · Cited by 224 · see citing works
Sara, S. J., & Segal, M. (1991) · Progress in brain research · doi:10.1016/s0079-6123(08)63835-2 · Cited by 223 · see citing works
Quantification of the dopamine innervation in adult rat neostriatum
Doucet, G., Descarries, L., & Garcia, S. (1986) · Neuroscience · doi:10.1016/0306-4522(86)90272-1 · Cited by 214 · see citing works
Inhibitory Cerebello-Olivary Projections and Blocking Effect in Classical Conditioning
Kim, J. J., Krupa, D. J., & Thompson, R. F. (1998) · Science · doi:10.1126/science.279.5350.570 · Cited by 211 · see citing works
Response of nucleus accumbens neurons to amygdala stimulation and its modification by dopamine
Yim, C. Y., & Mogenson, G. J. (1982) · Brain Research · doi:10.1016/0006-8993(82)90518-2 · Cited by 210 · see citing works
Reward, Motivation, Cognition: Psychobiology of Mesotelencephalic Dopamine Systems
Fibiger, H. C., & Phillips, A. G. (1986) · Comprehensive physiology · doi:10.1002/cphy.cp010412 · Cited by 204 · see citing works
German, D. C., Dubach, M. F., Askari, S., Speciale, S. G., & Bowden, D. M. (1988) · Neuroscience · doi:10.1016/0306-4522(88)90320-x · Cited by 200 · see citing works
Learning of sequential movements by neural network model with dopamine-like reinforcement signal
Suri, R. E., & Schultz, W. (1998) · Experimental Brain Research · doi:10.1007/s002210050467 · Cited by 198 · see citing works
Self-citationDopamine facilitates long-term depression of glutamatergic transmission in rat prefrontal cortex
Otani, S., Blond, O., Desce, J. M., & Crépel, F. (1998) · Neuroscience · doi:10.1016/s0306-4522(97)00677-5 · Cited by 196 · see citing works
Ojakangas, C. L., & Ebner, T. J. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.6.2222 · Cited by 190 · see citing works
Gurden, H., Tassin, J., & Jay, T. M. (1999) · Neuroscience · doi:10.1016/s0306-4522(99)00395-4 · Cited by 187 · see citing works
The 28th Bartlett Memorial Lecture Causal learning: An associative analysis
Dickinson, A. (2001) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/02724990042000010 · Cited by 184 · see citing works
Schultz, W., & Romo, R. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.201 · Cited by 184 · cited 1× · see citing works
“Primary re-insensitive to aversive stimuli, as they show depressions or activations with slower time courses following pain wards elicit neuronal activations during initial learning periods which decrease progressively and are trans-pinch in anesthetized monkeys (Schultz and Romo, 1987).”
Self-citationCellular mechanisms of long-term depression in the cerebellum
Linden, D. J., & Connor, J. A. (1993) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(93)90133-j · Cited by 181 · see citing works
Activity of dopamine neurons in the behaving primate
Schultz, W. (1992) · Seminars in Neuroscience · doi:10.1016/1044-5765(92)90011-p · Cited by 178 · see citing works
Self-citationChang, J., Sawyer, S. F., Lee, R., & Woodward, D. J. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-03-01224.1994 · Cited by 177 · see citing works
D1/D5 Dopamine Receptors Inhibit Depotentiation at CA1 Synapses via cAMP-Dependent Mechanism
Otmakhova, N. A., & Lisman, J. E. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-04-01270.1998 · Cited by 176 · see citing works
The primate globus pallidus: neuronal activity related to direction of movement
Mitchell, S. J., Richardson, R. T., Baker, F., & DeLong, M. R. (1987) · Experimental Brain Research · doi:10.1007/bf00249793 · Cited by 175 · see citing works
‘Error’ potentials in limbic cortex (anterior cingulate area 24) of monkeys during motor learning
Gemba, H., Sasaki, K., & Brooks, V. B. (1986) · Neuroscience Letters · doi:10.1016/0304-3940(86)90467-2 · Cited by 173 · see citing works
Dopamine-dependent synaptic plasticity in striatum during in vivo development
Tang, K., Low, M. J., Grandy, D. K., & Lovinger, D. M. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.3.1255 · Cited by 171 · see citing works
Dahl, D. R., & Sarvey, J. M. (1989) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.86.12.4776 · Cited by 171 · see citing works
Mesencephalic dopaminergic unit activity in the behaviorally conditioned rat
Miller, J. D., Sanghera, M. K., & German, D. C. (1981) · Life Sciences · doi:10.1016/0024-3205(81)90231-9 · Cited by 170 · see citing works
Louilot, A., Moal, M. L., & Simon, H. (1986) · Brain Research · doi:10.1016/0006-8993(86)90646-3 · Cited by 168 · see citing works
Cerebellar Function in Consolidation of a Motor Memory
Attwell, P. J. E., Cooke, S. F., & Yeo, C. H. (2002) · Neuron · doi:10.1016/s0896-6273(02)00719-5 · Cited by 167 · see citing works
Herrera‐Marschitz, M., You, Z. ‐., Goiny, M., et al. (1996) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.1996.66041726.x · Cited by 167 · see citing works
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1877 · Cited by 167 · see citing works
Self-citationLynd‐Balta, E., & Haber, S. N. (1994) · The Journal of Comparative Neurology · doi:10.1002/cne.903450407 · Cited by 164 · see citing works
Wilson, F. A. W., & Rolls, E. T. (1990) · Experimental Brain Research · doi:10.1007/bf00228852 · Cited by 164 · see citing works
Apicella, P., Legallet, E., & Trouche, E. (1997) · Experimental Brain Research · doi:10.1007/pl00005773 · Cited by 162 · see citing works
Topographic distribution of modality-specific amygdalar neurons in alert monkey
Nishijo, H., Ono, T., & Nishino, H. (1988) · Journal of Neuroscience · doi:10.1523/jneurosci.08-10-03556.1988 · Cited by 153 · see citing works
Amphetamine Blocks Long-Term Synaptic Depression in the Ventral Tegmental Area
Jones, S., Gutlerner, J. L., & Kauer, J. A. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-15-05575.2000 · Cited by 151 · see citing works
Neural correlates of decisions
Platt, M. L. (2002) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(02)00302-1 · Cited by 151 · see citing works
Brown, J. R., & Arbuthnott, G. W. (1983) · Neuroscience · doi:10.1016/0306-4522(83)90138-0 · Cited by 138 · see citing works
Continuousin vivo monitoring of evoked dopamine release in the rat nucleus accumbens by amperometry
Dugast, C., Suaud‐Chagny, M., & Gonon, F. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90466-9 · Cited by 137 · see citing works
The activity of pars compacta neurons of the monkey substantia nigra in relation to motor activation
Schultz, W., Ruffieux, A., & Aebischer, P. (1983) · Experimental Brain Research · doi:10.1007/bf00237874 · Cited by 136 · see citing works
Self-citationThe performance on learning tasks of patients in the early stages of Parkinson's disease
Canavan, A. G. M., Passingham, R. E., Marsden, C. D., Quinn, N., Wyke, M., & Polkey, C. E. (1989) · Neuropsychologia · doi:10.1016/0028-3932(89)90167-x · Cited by 133 · see citing works
Neuronal responses related to reinforcement in the primate basal forebrain
Wilson, F. A. W., & Rolls, E. T. (1990) · Brain Research · doi:10.1016/0006-8993(90)90546-n · Cited by 130 · see citing works
Firing patterns of nucleus accumbens neurons during cocaine self-administration in rats
Carelli, R. M., King, V. C., Hampson, R. E., & Deadwyler, S. A. (1993) · Brain Research · doi:10.1016/0006-8993(93)90557-4 · Cited by 129 · see citing works
Reward-Predicting and Reward-Detecting Neuronal Activity in the Primate Supplementary Eye Field
Amador, N., Schlag-Rey, M., & Schlag, J. D. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.4.2166 · Cited by 128 · see citing works
Responses of monkey midbrain dopamine neurons during delayed alternation performance
Ljungberg, T., Apicella, P., & Schultz, W. (1991) · Brain Research · doi:10.1016/0006-8993(91)90816-e · Cited by 128 · see citing works
Self-citationMemory for temporal order and conditional associative-learning in patients with Parkinson's disease
Vriezen, E. R., & Moscovitch, M. (1990) · Neuropsychologia · doi:10.1016/0028-3932(90)90044-o · Cited by 124 · see citing works
Nucleus basalis of Meynert neuronal activity during a delayed response task in monkey
Richardson, R. T., & DeLong, M. R. (1986) · Brain Research · doi:10.1016/0006-8993(86)91529-5 · Cited by 122 · see citing works
Nishino, H., Ono, T., Muramoto, K., Fukuda, M., & Sasaki, K. (1987) · Brain Research · doi:10.1016/0006-8993(87)91021-3 · Cited by 120 · see citing works
Wilson, F., & Rolls, E. T. (1990) · Journal of Neuroscience · doi:10.1523/jneurosci.10-04-01254.1990 · Cited by 120 · see citing works
Dopamine Modulates Excitability of Spiny Neurons in the Avian Basal Ganglia
Ding, L., & Perkel, D. J. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-12-05210.2002 · Cited by 119 · see citing works
Young, A. M. J., Joseph, M. H., & Gray, J. A. (1992) · Neuroscience · doi:10.1016/0306-4522(92)90275-7 · Cited by 111 · see citing works
Doherty, M. D., & Gratton, A. P. (1992) · Brain Research · doi:10.1016/0006-8993(92)91639-v · Cited by 108 · see citing works
Dopaminergic Synapses Mediate Neuronal Changes in an Analogue of Operant Conditioning
Nargeot, R., Baxter, D. A., Patterson, G. W., & Byrne, J. H. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.81.4.1983 · Cited by 104 · see citing works
Uptake of Dopamine Released by Impulse Flow in the Rat Mesolimbic and Striatal Systems In Vivo
Suaud‐Chagny, M., Dugast, C., Chergui, K., Msghina, M., & Gonon, F. (1995) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.1995.65062603.x · Cited by 103 · see citing works
A Predictive Reinforcement Model of Dopamine Neurons for Learning Approach Behavior
Contreras-Vidal, J. L., & Schultz, W. (1999) · Journal of Computational Neuroscience · doi:10.1023/a:1008862904946 · Cited by 102 · see citing works
Self-citationContext-dependent responses of primate nucleus basalis neurons in a go/no-go task
Richardson, R., & DeLong, M. (1990) · Journal of Neuroscience · doi:10.1523/jneurosci.10-08-02528.1990 · Cited by 97 · see citing works
LICHTENSTEIGER, W., Felix, D., Lienhart, R., et al. (1976) · Brain Research · doi:10.1016/0006-8993(76)90558-8 · Cited by 96 · see citing works
Peoples, L. L., Gee, F., Bibi, R., & West, M. O. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-18-07588.1998 · Cited by 76 · see citing works
Sprengelmeyer, R., Canavan, A. G. M., Lange, H. W., & Hömberg, V. (1995) · Movement Disorders · doi:10.1002/mds.870100110 · Cited by 72 · see citing works
The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units
Watanabe, M. (1989) · Neuroscience Letters · doi:10.1016/0304-3940(89)90450-3 · Cited by 64 · see citing works
Sardo, P., Ravel, S., Legallet, E., & Apicella, P. (2000) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2000.00068.x · Cited by 60 · see citing works
Elements of the Intrinsic Organization and Information Processing in the Neostriatum
Groves, P. M., Garcia-Munoz, M., Linder, J. C., Manley, M. S., Martone, M. E., & Young, S. J. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0007 · Cited by 59 · see citing works
Tong, Z.-Y., Overton, P. G., & Clark, D. T. (1995) · Brain Research · doi:10.1016/0006-8993(94)01439-o · Cited by 56 · see citing works
Long-term potentiation in rat prefrontal slices facilitated by phased application of dopamine
Blond, O., Crépel, F., & Otani, S. (2002) · European Journal of Pharmacology · doi:10.1016/s0014-2999(02)01291-8 · Cited by 51 · see citing works
Responses of rat pallidum cells to cortex stimulation and effects of altered dopaminergic activity
Toan, D. L., & Schultz, W. (1985) · Neuroscience · doi:10.1016/0306-4522(85)90070-3 · Cited by 49 · see citing works
Self-citationBlocking observed in human eyelid conditioning.
Martin, I., & Levey, A. B. (1991) · PubMed · Cited by 39 · see citing works
Sessler, F. M., Liu, W., Kirifides, M. L., Mouradian, R., Lin, R. C. S., & Waterhouse, B. D. (1995) · Brain Research · doi:10.1016/0006-8993(95)00060-4 · Cited by 39 · see citing works
Learning admittance mappings for force-guided assembly
Gullapalli, V., Barto, A. G., & Grupen, R. A. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1994.351117 · Cited by 37 · see citing works
Low-dose amphetamine elevates movement-related firing of rat striatal neurons
West, M. O., Peoples, L. L., Michael, A. J., Chapin, J. K., & Woodward, D. J. (1997) · Brain Research · doi:10.1016/s0006-8993(96)01215-2 · Cited by 33 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718 · see citing works
The role of the medial frontal cortex in cognitive control
Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., & Nieuwenhuis, S. (2004) · Science · doi:10.1126/science.1100301 · Cited by 2,974 · see citing works
Model of autism: increased ratio of excitation/inhibition in key neural systems
Rubenstein, J. L. R., & Merzenich, M. M. (2003) · Genes, Brain and Behavior · doi:10.1034/j.1601-183x.2003.00037.x · Cited by 2,768 · see citing works
The Dopamine Hypothesis of Schizophrenia: Version III--The Final Common Pathway
Howes, O. D., & Kapur, S. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp006 · Cited by 2,693 · see citing works
Dibner, C., Schibler, U., & Albrecht, U. (2010) · Annual Review of Physiology · doi:10.1146/annurev-physiol-021909-135821 · Cited by 2,421 · see citing works
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964 · see citing works
Neurobiologic advances from the brain disease model of addiction
Volkow, N. D., Koob, G. F., & McLellan, A. T. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1511480 · Cited by 2,008 · see citing works
Berridge, K. C., & Robinson, T. E. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00233-9 · Cited by 1,869 · see citing works
Charney, D. S. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.2.195 · Cited by 1,605 · see citing works
Ikemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477 · see citing works
Ridderinkhof, K. R., van den Wildenberg, W. P. M., Segalowitz, S. J., & Carter, C. S. (2004) · Brain and Cognition · doi:10.1016/j.bandc.2004.09.016 · Cited by 1,407 · see citing works
Reward, dopamine and the control of food intake: implications for obesity
Volkow, N. D., Wang, G.-J., & Baler, R. D. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.11.001 · Cited by 1,400 · see citing works
Closed-loop brain training: the science of neurofeedback
Sitaram, R., Ros, T., Stoeckel, L., Haller, S., Scharnowski, F., Lewis-Peacock, J., Weiskopf, N., Blefari, M. L., Rana, M., Oblak, E., et al. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.164 · Cited by 1,306 · see citing works
The brain on drugs: from reward to addiction
Volkow, N. D., & Morales, M. (2015) · Cell · doi:10.1016/j.cell.2015.07.046 · Cited by 1,306 · see citing works
Lateral habenula as a source of negative reward signals in dopamine neurons
Matsumoto, M., & Hikosaka, O. (2007) · Nature · doi:10.1038/nature05860 · Cited by 1,292 · see citing works
Affective consciousness: core emotional feelings in animals and humans.
Panksepp, J. (2005) · Consciousness and Cognition · doi:10.1016/j.concog.2004.10.004 · Cited by 1,217 · see citing works
The Psychobiology of Depression and Resilience to Stress: Implications for Prevention and Treatment
Southwick, S. M., Vythilingam, M., & Charney, D. S. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.143948 · Cited by 1,160 · see citing works
Saper, C. B., Chou, T. C., & Elmquist, J. K. (2002) · Neuron · doi:10.1016/s0896-6273(02)00969-8 · Cited by 1,120 · see citing works
Ventral tegmental area: cellular heterogeneity, connectivity and behaviour
Morales, M., & Margolis, E. B. (2017) · Nature reviews. Neuroscience · doi:10.1038/nrn.2016.165 · Cited by 1,108 · see citing works
Dopamine in drug abuse and addiction: results from imaging studies and treatment implications
Volkow, N. D., Fowler, J. S., Wang, G.-J., & Swanson, J. M. (2004) · Molecular Psychiatry · doi:10.1038/sj.mp.4001507 · Cited by 1,101 · see citing works
sagvolden, T., johansen, E. B., aase, H., & russell, V. A. (2005) · Behavioral and Brain Sciences · doi:10.1017/s0140525x05000075 · Cited by 1,035 · see citing works
Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits
Salamone, J. D., Correa, M., Farrar, A., & Mingote, S. M. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0668-9 · Cited by 1,000 · see citing works
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · see citing works
Imaging dopamine's role in drug abuse and addiction
Volkow, N. D., Fowler, J. S., Wang, G. J., Baler, R., & Telang, F. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2008.05.022 · Cited by 988 · see citing works
Sonuga-Barke, E. J. S. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.09.008 · Cited by 962 · see citing works
The neural basis of human moral cognition
Moll, J., Zahn, R., de Oliveira-Souza, R., Krueger, F., & Grafman, J. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1768 · Cited by 930 · see citing works
Vigilance, alertness, or sustained attention: physiological basis and measurement
Oken, B. S., Salinsky, M. C., & Elsas, S. M. (2006) · Clinical Neurophysiology · doi:10.1016/j.clinph.2006.01.017 · Cited by 887 · see citing works
Wise, R. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)00965-0 · Cited by 881 · see citing works
Processing of Social and Monetary Rewards in the Human Striatum
Izuma, K., Saito, D. N., & Sadato, N. (2008) · Neuron · doi:10.1016/j.neuron.2008.03.020 · Cited by 855 · see citing works
Dopamine-mediated regulation of corticostriatal synaptic plasticity
Calabresi, P., Picconi, B., Tozzi, A., & Di Filippo, M. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.001 · Cited by 865 · see citing works
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855 · see citing works
Hein, G., Silani, G., Preuschoff, K., Batson, C. D., & Singer, T. (2010) · Neuron · doi:10.1016/j.neuron.2010.09.003 · Cited by 821 · see citing works
Anhedonia in schizophrenia: Distinctions between anticipatory and consummatory pleasure
Gard, D. E., Kring, A. M., Gard, M. G., Horan, W. P., & Green, M. F. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.008 · Cited by 817 · see citing works
The dual pathway model of AD/HD: an elaboration of neuro-developmental characteristics
Sonuga-Barke, E. J. S. (2003) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2003.08.005 · Cited by 816 · see citing works
Overlapping neuronal circuits in addiction and obesity: evidence of systems pathology
Volkow, N. D., Wang, G.-J., Fowler, J. S., & Telang, F. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0107 · Cited by 809 · see citing works
Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli
Ungless, M. A., Magill, P. J., & Bolam, J. P. (2004) · Science · doi:10.1126/science.1093360 · Cited by 782 · see citing works
Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E., & Zald, D. H. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006598 · Cited by 769 · see citing works
Bilder, R. M., Volavka, J., Lachman, H. M., & Grace, A. A. (2004) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300542 · Cited by 769 · see citing works
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762 · see citing works
Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making
Frank, M. J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.006 · Cited by 706 · see citing works
Triadic model of the neurobiology of motivated behavior in adolescence.
ERNST, M., PINE, D. S., & HARDIN, M. (2006) · Psychological Medicine · doi:10.1017/s0033291705005891 · Cited by 718 · see citing works
Borgland, S. L., Taha, S. A., Sarti, F., Fields, H. L., & Bonci, A. (2006) · Neuron · doi:10.1016/j.neuron.2006.01.016 · Cited by 718 · see citing works
Haber, S. N., Kim, K.-S., Mailly, P., & Calzavara, R. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.0271-06.2006 · Cited by 686 · see citing works
Probing compulsive and impulsive behaviors, from animal models to endophenotypes: A narrative review
Fineberg, N. A., Potenza, M. N., Chamberlain, S. R., Berlin, H. A., Menzies, L., Bechara, A., Sahakian, B. J., Robbins, T. W., Bullmore, E. T., & Hollander, E. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.185 · Cited by 654 · see citing works
Unmanageable motivation in addiction: a pathology in prefrontal-accumbens glutamate transmission
Kalivas, P. W., Volkow, N., & Seamans, J. (2005) · Neuron · doi:10.1016/j.neuron.2005.02.005 · Cited by 657 · see citing works
Leptin Regulation of the Mesoaccumbens Dopamine Pathway
Fulton, S., Pissios, P., Manchon, R. P., Stiles, L., Frank, L., Pothos, E. N., Maratos-Flier, E., & Flier, J. S. (2006) · Neuron · doi:10.1016/j.neuron.2006.09.006 · Cited by 644 · see citing works
Ernst, M., Nelson, E. E., Jazbec, S., McClure, E. B., Monk, C. S., Leibenluft, E., Blair, J., & Pine, D. S. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.038 · Cited by 635 · see citing works
Valjent, E., Pascoli, V., Svenningsson, P., Paul, S., Enslen, H., Corvol, J.-C., Stipanovich, A., Caboche, J., Lombroso, P. J., Nairn, A. C., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0408305102 · Cited by 614 · see citing works
Overbeek, T. J. M., Nieuwenhuis, S., & Ridderinkhof, K. R. (2005) · Journal of Psychophysiology · doi:10.1027/0269-8803.19.4.319 · Cited by 600 · see citing works
Dopamine in Drug Abuse and Addiction: Results of Imaging Studies and Treatment Implications
Volkow, N. D., Fowler, J. S., Wang, G.-J., Swanson, J. M., & Telang, F. (2007) · Archives of Neurology · doi:10.1001/archneur.64.11.1575 · Cited by 605 · see citing works
<i>Spatial Cognition and the Brain</i>
Burgess, N. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1440.002 · Cited by 614 · see citing works
Baayen, R. H., Milin, P., Đurđević, D. F., Hendrix, P., & Marelli, M. (2011) · Psychological Review · doi:10.1037/a0023851 · Cited by 595 · see citing works
Performance monitoring by the anterior cingulate cortex during saccade countermanding
Ito, S., Stuphorn, V., Brown, J. W., & Schall, J. D. (2003) · Science · doi:10.1126/science.1087847 · Cited by 581 · see citing works
Reward Changes Salience in Human Vision via the Anterior Cingulate
Hickey, C., Chelazzi, L., & Theeuwes, J. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1026-10.2010 · Cited by 606 · see citing works
“Other theories propose a more general role for dopamine in reinforcement learning but also suggest that reward has a direct impact on vision (Schultz et al., 1997; Schultz, 2002) (for review and integration of dopamine models, see McClure et al., 2003).”
BackgroundRoesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597 · see citing works
Remote Control of Behavior through Genetically Targeted Photostimulation of Neurons
Lima, S. Q., & Miesenböck, G. (2005) · Cell · doi:10.1016/j.cell.2005.02.004 · Cited by 562 · see citing works
Disclosing information about the self is intrinsically rewarding
Tamir, D. I., & Mitchell, J. P. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1202129109 · Cited by 563 · see citing works
An Integrative Model of the Maturation of Cognitive Control
Luna, B., Marek, S., Larsen, B., Tervo-Clemmens, B., & Chahal, R. (2015) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071714-034054 · Cited by 550 · see citing works
Decision theory, reinforcement learning, and the brain
Dayan, P., & Daw, N. D. (2008) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.8.4.429 · Cited by 580 · see citing works
The default-mode, ego-functions and free-energy: a neurobiological account of Freudian ideas
Carhart-Harris, R. L., & Friston, K. J. (2010) · Brain · doi:10.1093/brain/awq010 · Cited by 574 · see citing works
Prolonged dopamine signalling in striatum signals proximity and value of distant rewards
Howe, M. W., Tierney, P. L., Sandberg, S. G., Phillips, P. E. M., & Graybiel, A. M. (2013) · Nature · doi:10.1038/nature12475 · Cited by 565 · see citing works
Pathological Gambling Caused by Drugs Used to Treat Parkinson Disease
Dodd, M. L., Klos, K. J., Bower, J. H., Geda, Y. E., Josephs, K. A., & Ahlskog, J. E. (2005) · Archives of Neurology · doi:10.1001/archneur.62.9.noc50009 · Cited by 563 · see citing works
Nieuwenhuis, S., Holroyd, C. B., Mol, N., & Coles, M. G. H. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.05.003 · Cited by 557 · see citing works
Hyperdopaminergic mutant mice have higher "wanting" but not "liking" for sweet rewards
Peciña, S., Cagniard, B., Berridge, K. C., Aldridge, J. W., & Zhuang, X. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-28-09395.2003 · Cited by 551 · see citing works
Ventral pallidum roles in reward and motivation
Smith, K. S., Tindell, A. J., Aldridge, J. W., & Berridge, K. C. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.038 · Cited by 548 · see citing works
The impact of reinforcement contingencies on AD/HD: A review and theoretical appraisal
Luman, M., Oosterlaan, J., & Sergeant, J. A. (2005) · Clinical Psychology Review · doi:10.1016/j.cpr.2004.11.001 · Cited by 541 · see citing works
Choosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536 · see citing works
Reward Processing in Schizophrenia: A Deficit in the Representation of Value
Gold, J. M., Waltz, J. A., Prentice, K. J., Morris, S. E., & Heerey, E. A. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn068 · Cited by 521 · see citing works
From dopamine to salience to psychosis—Linking biology, pharmacology and phenomenology of psychosis
Kapur, S., Mizrahi, R., & Li, M. (2005) · Schizophrenia Research · doi:10.1016/j.schres.2005.01.003 · Cited by 512 · see citing works
Cortico–basal ganglia circuit mechanism for a decision threshold in reaction time tasks
Lo, C.-C., & Wang, X.-J. (2006) · Nature Neuroscience · doi:10.1038/nn1722 · Cited by 505 · see citing works
Modalities, Modes, and Models in Functional Neuroimaging
Friston, K. J. (2009) · Science · doi:10.1126/science.1174521 · Cited by 489 · see citing works
Frank, M. J., & O'Reilly, R. C. (2006) · Behavioral Neuroscience · doi:10.1037/0735-7044.120.3.497 · Cited by 472 · see citing works
Placebo and the New Physiology of the Doctor-Patient Relationship
Benedetti, F. (2013) · Physiological Reviews · doi:10.1152/physrev.00043.2012 · Cited by 492 · see citing works
Cortical and basal ganglia contributions to habit learning and automaticity
Ashby, F. G., Turner, B. O., & Horvitz, J. C. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.02.001 · Cited by 481 · see citing works
Tripp, G., & Wickens, J. R. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2009.07.026 · Cited by 492 · see citing works
It could be habit forming: drugs of abuse and striatal synaptic plasticity
Gerdeman, G. L., Partridge, J. G., Lupica, C. R., & Lovinger, D. M. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00065-1 · Cited by 480 · see citing works
Recent advances in Tourette syndrome research
Albin, R. L., & Mink, J. W. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.01.001 · Cited by 478 · see citing works
The striatum: where skills and habits meet
Graybiel, A. M., & Grafton, S. T. (2015) · Cold Spring Harbor Perspectives in Biology · doi:10.1101/cshperspect.a021691 · Cited by 463 · see citing works
Brain reward circuitry beyond the mesolimbic dopamine system: a neurobiological theory
Ikemoto, S. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.02.001 · Cited by 454 · see citing works
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456 · see citing works
Nicotine addiction and nicotinic receptors: lessons from genetically modified mice
Changeux, J.-P. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2849 · Cited by 453 · see citing works
PICCIOTTO, M., ADDY, N., MINEUR, Y., & BRUNZELL, D. (2008) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2007.12.005 · Cited by 451 · see citing works
The neuropsychology of ventral prefrontal cortex: Decision-making and reversal learning
Clark, L., Cools, R., & Robbins, T. W. (2004) · Brain and Cognition · doi:10.1016/s0278-2626(03)00284-7 · Cited by 439 · see citing works
Anterior cingulate activity during error and autonomic response
Critchley, H. D., Tang, J., Glaser, D., Butterworth, B., & Dolan, R. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.05.047 · Cited by 445 · see citing works
Garland, T., Schutz, H., Chappell, M. A., Keeney, B. K., Meek, T. H., Copes, L. E., Acosta, W., Drenowatz, C., Maciel, R. C., van Dijk, G., et al. (2011) · Journal of Experimental Biology · doi:10.1242/jeb.048397 · Cited by 444 · see citing works
Membrane potential correlates of sensory perception in mouse barrel cortex
Sachidhanandam, S., Sreenivasan, V., Kyriakatos, A., Kremer, Y., & Petersen, C. C. H. (2013) · Nature Neuroscience · doi:10.1038/nn.3532 · Cited by 384 · see citing works
Pan, W.-X., Schmidt, R., Wickens, J. R., & Hyland, B. I. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1478-05.2005 · Cited by 429 · see citing works
Toward constructing an endophenotype strategy for bipolar disorders
Hasler, G., Drevets, W. C., Gould, T. D., Gottesman, I. I., & Manji, H. K. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.11.006 · Cited by 423 · see citing works
Overlapping Brain Circuits for Homeostatic and Hedonic Feeding
Rossi, M. A., & Stuber, G. D. (2018) · Cell Metabolism · doi:10.1016/j.cmet.2017.09.021 · Cited by 415 · see citing works
Schönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390 · see citing works
Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation
Faure, A., Haberland, U., Condé, F., & Massioui, N. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3894-04.2005 · Cited by 402 · see citing works
Tseng, K. Y., & O'Donnell, P. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1021-04.2004 · Cited by 402 · see citing works
Immaturities in reward processing and its influence on inhibitory control in adolescence.
Geier, C. F., Terwilliger, R., Teslovich, T., Velanova, K., & Luna, B. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp225 · Cited by 396 · see citing works
Involvement of the dorsal striatum in cue-controlled cocaine seeking
Vanderschuren, L. J. M. J., Di Ciano, P., & Everitt, B. J. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0925-05.2005 · Cited by 393 · see citing works
Dynorphin and the pathophysiology of drug addiction
Shippenberg, T. S., Zapata, A., & Chefer, V. I. (2007) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2007.06.011 · Cited by 387 · see citing works
Abnormal temporal difference reward-learning signals in major depression
Kumar, P., Waiter, G., Ahearn, T., Milders, M., Reid, I., & Steele, J. D. (2008) · Brain · doi:10.1093/brain/awn136 · Cited by 374 · see citing works
Choice selection and reward anticipation: an fMRI study
Ernst, M., Nelson, E. E., McClure, E. B., Monk, C. S., Munson, S., Eshel, N., Zarahn, E., Leibenluft, E., Zametkin, A., Towbin, K., et al. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.05.011 · Cited by 377 · see citing works
Acute stress reduces reward responsiveness: Implications for depression
Bogdan, R., & Pizzagalli, D. A. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.03.037 · Cited by 364 · see citing works
Redish, A. D., Jensen, S., Johnson, A., & Kurth-Nelson, Z. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.784 · Cited by 346 · see citing works
The origins of altruism in offspring care.
Preston, S. D. (2013) · Psychological Bulletin · doi:10.1037/a0031755 · Cited by 368 · see citing works
- Authors
- Schultz, W.
- Affiliations
- University of Fribourg (CH)
- Corresponding author
- Schultz, Wolfram
- ORCID
- Schultz, Wolfram
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2002-10
- Volume
- 36
- Issue
- 2
- Pages
- 241-263
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W1998152406
- Cited by
- 2,574
- References
- 208
- Citations by year
- 2026: 22 · 2025: 56 · 2024: 101 · 2023: 46 · 2022: 54 · 2021: 76 · 2020: 94 · 2019: 87 · 2018: 91 · 2017: 88 · 2016: 117 · 2015: 113 · 2014: 146 · 2013: 130 · 2012: 138
- FWCI
- 8.71
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust (095495)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- dopamine, reward signals, prediction error, striatum, frontal cortex, amygdala, goal-directed behavior, stimulant use disorder
- MeSH terms
- Animals, Brain, Dopamine, Humans, Neurons, Reward, Illicit Drugs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review