The DOI matches its Crossref record; 208 of the 208 references it cites were found in a registry or an index.
Getting Formal with Dopamine and Reward
Open accessAbstract
Recent neurophysiological studies reveal that neurons in certain brain structures carry specific signals about past and future rewards. Dopamine neurons display a short-latency, phasic reward signal indicating the difference between actual and predicted rewards. The signal is useful for enhancing neuronal processing and learning behavioral reactions. It is distinctly different from dopamine's tonic enabling of numerous behavioral processes. Neurons in the striatum, frontal cortex, and amygdala also process reward information but provide more differentiated information for identifying and anticipating rewards and organizing goal-directed behavior. The different reward signals have complementary functions, and the optimal use of rewards in voluntary behavior would benefit from interactions between the signals. Addictive psychostimulant drugs may exert their action by amplifying the dopamine reward signal.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationThe neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268
Cognitive, social, and physiological determinants of emotional state.
Schachter, S., & Singer, J. (1962) · Psychological Review · doi:10.1037/h0046234 · Cited by 6,223
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Self-citation(1996) · Cited by 3,692
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,325
Marr, D. (1969) · The Journal of Physiology · doi:10.1113/jphysiol.1969.sp008820 · Cited by 3,253
The Cerebellum as a Neuronal Machine
Eccles, J. C., Ito, M., & Szentágothai, J. (1967) · Springer eBooks · doi:10.1007/978-3-662-13147-3 · Cited by 3,229
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
A theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733
Hyperlocomotion and indifference to cocaine and amphetamine in mice lacking the dopamine transporter
Giros, B., Jaber, M., Jones, S. R., Wightman, R. M., & Caron, M. G. (1996) · Nature · doi:10.1038/379606a0 · Cited by 2,476
Burns, R. S., Chiueh, C. C., Markey, S. P., Ebert, M. H., Jacobowitz, D. M., & Kopin, I. J. (1983) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.80.14.4546 · Cited by 2,149
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
The formation of learning sets.
Harlow, H. F. (1949) · Psychological Review · doi:10.1037/h0062474 · Cited by 1,959
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721
Falkenstein, M., Hohnsbein, J., Hoormann, J., & Blanke, L. (1991) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(91)90062-9 · Cited by 1,706
Cognitive Deficit Caused by Regional Depletion of Dopamine in Prefrontal Cortex of Rhesus Monkey
Brozoski, T. J., Brown, R. M., Rosvold, H. E., & Goldman, P. S. (1979) · Science · doi:10.1126/science.112679 · Cited by 1,500
Toward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450
D1 Dopamine Receptors in Prefrontal Cortex: Involvement in Working Memory
Sawaguchi, T., & Goldman-Rakic, P. S. (1991) · Science · doi:10.1126/science.1825731 · Cited by 1,364
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314
Self-citationSchultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Self-citationModels of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Neurobehavioural mechanisms of reward and motivation
Robbins, T. W., & Everitt, B. J. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80077-8 · Cited by 1,187
Ito, M. (1989) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.12.030189.000505 · Cited by 1,167
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,161
Self-citationSingle cocaine exposure in vivo induces long-term potentiation in dopamine neurons
Ungless, M. A., Whistler, J. L., Malenka, R. C., & Bonci, A. (2001) · Nature · doi:10.1038/35079077 · Cited by 1,106
Abercrombie, E. D., Keefe, K. A., DiFrischia, D. S., & Zigmond, M. J. (1989) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.1989.tb09224.x · Cited by 1,106
Wise, R. A. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80079-1 · Cited by 1,072
Aston‐Jones, G., & Bloom, F. E. (1981) · Journal of Neuroscience · doi:10.1523/jneurosci.01-08-00887.1981 · Cited by 1,072
Smith, A. D., & Bolam, J. P. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90106-k · Cited by 1,040
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Self-citationMotivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
Self-citationMesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967
Contemporary Animal Learning Theory.
Abrahamson, D. (1981) · Europe PMC (PubMed Central) · Cited by 945
Contemporary Animal Learning Theory
LoLordo, V. M., & Dickinson, A. (1982) · The American Journal of Psychology · doi:10.2307/1422669 · Cited by 890
Wise, R. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)00965-0 · Cited by 881
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879
Freund, T. F., Powell, J. F., & Smith, A. D. (1984) · Neuroscience · doi:10.1016/0306-4522(84)90294-x · Cited by 875
Foote, S. L., Aston-Jones, G., & Bloom, F. E. (1980) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.77.5.3033 · Cited by 857
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829
Self-citationTD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level Play
Tesauro, G. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.215 · Cited by 821
Addictive Drugs and Brain Stimulation Reward
Wise, R. A. (1996) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.19.030196.001535 · Cited by 792
Rolls, E. T. (1996) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1996.0128 · Cited by 755
Long-term potentiation of excitatory inputs to brain reward areas by nicotine
Mansvelder, H. D., & McGehee, D. S. (2000) · Neuron · doi:10.1016/s0896-6273(00)00042-8 · Cited by 720
Synaptic mechanisms underlie nicotine-induced excitability of brain reward areas
Mansvelder, H. D., Keath, J. R., & McGehee, D. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00625-6 · Cited by 701
Reward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · cited 4×
“…and amounts of food and Given the central importance of rewards for survival, reproduction, and competitive gains, it may not be sur-liquid rewards (Watanabe, 1996; Leon and Shadlen, 1999; Tremblay and Schultz, 1999; Hassani et al., 2001) prising that several specialized and only partly…”
InfluentialLong-term synaptic depression in the striatum: physiological and pharmacological characterization
Calabresi, P., Maj, R., Pisani, A., Mercuri, N. B., & Bernardi, G. (1992) · Journal of Neuroscience · doi:10.1523/jneurosci.12-11-04224.1992 · Cited by 682
Gonon, F. G. (1988) · Neuroscience · doi:10.1016/0306-4522(88)90307-7 · Cited by 676
Purkinje cell activity during motor learning
Gilbert, P. F. C., & Thach, W. T. (1977) · Brain Research · doi:10.1016/0006-8993(77)90997-0 · Cited by 657
Role for Cingulate Motor Area Cells in Voluntary Movement Selection Based on Reward
Shima, K., & Tanji, J. (1998) · Science · doi:10.1126/science.282.5392.1335 · Cited by 645
Expectation of reward modulates cognitive signals in the basal ganglia
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998) · Nature Neuroscience · doi:10.1038/1625 · Cited by 643
Locus coeruleus neurons in monkey are selectively activated by attended cues in a vigilance task
Aston-Jones, G., Rajkowski, J., Kubiak, P., & Alexinsky, T. (1994) · The Journal of Neuroscience · doi:10.1523/jneurosci.14-07-04467.1994 · Cited by 637
Murphy, B. L., Arnsten, A. F., Goldman-Rakic, P. S., & Roth, R. H. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.3.1325 · Cited by 590
Hikosaka, O., Sakamoto, M., & Usui, S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.4.814 · Cited by 579
Presynaptic regulation of neurotransmitter release in the brain: Facts and hypothesis
Chesselet, M.-F. (1984) · Neuroscience · doi:10.1016/0306-4522(84)90058-7 · Cited by 577
Cortical remodelling induced by activity of ventral tegmental dopamine neurons
Bao, S., Chan, V. T., & Merzenich, M. M. (2001) · Nature · doi:10.1038/35083586 · Cited by 569
Cepeda, C., Buchwald, N. A., & Levine, M. S. (1993) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.90.20.9576 · Cited by 559
A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
Houk, J. C., Adams, J. L., & Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0020 · Cited by 554
Cognitive effects of false heart-rate feedback
Valins, S. (1966) · Journal of Personality and Social Psychology · doi:10.1037/h0023791 · Cited by 550
Importance of unpredictability for reward responses in primate dopamine neurons
Mirenowicz, J., & Schultz, W. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.2.1024 · Cited by 544
Self-citationLearning and Computational Neuroscience: Foundations of Adaptive Networks
Gabriel, M., & Moore, J. (1990) · Cited by 518
Prefrontal and cingulate unit activity during timing behavior in the monkey
Niki, H., & Watanabe, M. (1979) · Brain Research · doi:10.1016/0006-8993(79)90328-7 · Cited by 511
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506
Perspectives on Cognitive Neuroscience
Churchland, P. S., & B, T. J. S. A. (1988) · Science · doi:10.1126/science.3055294 · Cited by 505
Time-Derivative Models of Pavlovian Reinforcement
Sutton, R. S., & Barto, A. G. (1990) · Cited by 501
Spatial Processing in the Monkey Frontal Eye Field. I. Predictive Visual Responses
Umeno, M. M., & Goldberg, M. E. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.3.1373 · Cited by 500
Hernández‐López, S., Bargas, J., Surmeier, D. J., Reyes, A., & Galarraga, E. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-09-03334.1997 · Cited by 495
Adaptive Critics and the Basal Ganglia
Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0018 · Cited by 476
Critchley, H., & Rolls, E. T. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.4.1673 · Cited by 467
Leon, M. I., & Shadlen, M. N. (1999) · Neuron · doi:10.1016/s0896-6273(00)80854-5 · Cited by 449
Richfield, E. K., Penney, J. B., & Young, A. B. (1989) · Neuroscience · doi:10.1016/0306-4522(89)90168-1 · Cited by 448
Dopamine synaptic complex with pyramidal neurons in primate cerebral cortex.
Goldman-Rakic, P. S., Leranth, C., Williams, S. M., Mons, N. E., & Geffard, M. (1989) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.86.22.9015 · Cited by 429
Cerebellar complex spikes encode both destinations and errors in arm movements
Kitazawa, S., Kimura, T., & Yin, P.-B. (1998) · Nature · doi:10.1038/33141 · Cited by 401
Nicotinic effects on the firing pattern of midbrain dopamine neurons
GRENHOFF, J., ASTON‐JONES, G., & SVENSSON, T. H. (1986) · Acta Physiologica Scandinavica · doi:10.1111/j.1748-1716.1986.tb07988.x · Cited by 399
Kerr, J. N. D., & Wickens, J. R. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.1.117 · Cited by 395
Performance monitoring by the supplementary eye field
Stuphorn, V., Taylor, T. L., & Schall, J. D. (2000) · Nature · doi:10.1038/35048576 · Cited by 392
Sakurai, M. (1987) · The Journal of Physiology · doi:10.1113/jphysiol.1987.sp016881 · Cited by 391
Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey
Schultz, W. (1986) · Journal of Neurophysiology · doi:10.1152/jn.1986.56.5.1439 · Cited by 390
Self-citationEffects of methylphenidate on spatial working memory and planning in healthy young adults
Elliott, R., Sahakian, B. J., Matthews, K., Bannerjea, A., Rimmer, J., & Robbins, T. W. (1997) · Psychopharmacology · doi:10.1007/s002130050284 · Cited by 389
Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380
Self-citationOtmakhova, N. A., & Lisman, J. E. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-23-07478.1996 · Cited by 377
Rat navigation guided by remote control
Talwar, S. K., Xu, S., Hawley, E. S., Weiss, S. A., Moxon, K. A., & Chapin, J. K. (2002) · Nature · doi:10.1038/417037a · Cited by 372
Yang, C., & Seamans, J. K. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01922.1996 · Cited by 369
Brain Regions Responsive to Novelty in the Absence of Awareness
Berns, G. S., Cohen, J. D., & Mintun, M. A. (1997) · Science · doi:10.1126/science.276.5316.1272 · Cited by 367
Gurden, H., Takita, M., & Jay, T. M. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-22-j0003.2000 · Cited by 366
Dopaminergic A10 neurones are involved in cognitive functions
Simon, H., Scatton, B., & Moal, M. L. (1980) · Nature · doi:10.1038/286150a0 · Cited by 362
Romo, R., & Schultz, W. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.592 · Cited by 353 · cited 3×
“These data might ward-predicting stimuli (which are tested in separate trials) (Romo and Schultz, 1990; Mirenowicz and Schultz,sugggest that phasic dopamine activations reflect attention-inducing properties of stimuli, including rewards, 1994).”
Self-citationDopamine-mediated modulation of odour-evoked amygdala potentials during pavlovian conditioning
Rosenkranz, J. A., & Grace, A. A. (2002) · Nature · doi:10.1038/417282a · Cited by 348
Operant Reward Learning in Aplysia : Neuronal Correlates and Mechanisms
Brembs, B., Lorenzetti, F. D., Reyes, F. D., Baxter, D. A., & Byrne, J. H. (2002) · Science · doi:10.1126/science.1069434 · Cited by 338
Filion, M., Tremblay, L., & Bédard, P. J. (1988) · Brain Research · doi:10.1016/0006-8993(88)90924-9 · Cited by 337
Schultz, W., & Romo, R. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.607 · Cited by 334 · cited 2×
“…only to the onset of conditioned stimuli and not to their offset, even if stimuli are used whose offsets,Pavlovian or instrumental tasks, such as visual or audi- tory reaction time tasks, spatial delayed response or rather than their onsets, are valid predictors of reward (Schultz and Romo, 1990).”
Self-citationSingle unit activity of locus coeruleus neurons in the freely moving cat
Rasmussen, K., Morilak, D. A., & Jacobs, B. L. (1986) · Brain Research · doi:10.1016/0006-8993(86)90370-7 · Cited by 324
The cerebellum and VOR/OKR learning models
Kawato, M., & Gomi, H. (1992) · Trends in Neurosciences · doi:10.1016/0166-2236(92)90008-v · Cited by 323
Waterhouse, B. D., & Woodward, D. J. (1980) · Experimental Neurology · doi:10.1016/0014-4886(80)90159-4 · Cited by 322
Smith, Y., Bennett, B. D., Bolam, J. P., Parent, A., & Sadikot, A. F. (1994) · The Journal of Comparative Neurology · doi:10.1002/cne.903440102 · Cited by 312
Bee foraging in uncertain environments using predictive hebbian learning
Montague, P. R., Dayan, P., Person, C., & Sejnowski, T. J. (1995) · Nature · doi:10.1038/377725a0 · Cited by 311
Response to Novelty and its Rapid Habituation in Locus Coeruleus Neurons of the Freely Exploring Rat
Vankov, A., Hervé‐Minvielle, A., & Sara, S. J. (1995) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1995.tb01108.x · Cited by 309
Neuronal activity in monkey striatum related to the expectation of predictable environmental events
Apicella, P., Scarnati, E., Ljungberg, T., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.3.945 · Cited by 305
Self-citationJörntell, H., & Ekerot, C. ‐. (2002) · Neuron · doi:10.1016/s0896-6273(02)00713-4 · Cited by 302
Gonon, F. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-15-05972.1997 · Cited by 301
Wickens, J. R., Begg, A., & Arbuthnott, G. W. (1996) · Neuroscience · doi:10.1016/0306-4522(95)00436-m · Cited by 298
Selective association and conditioning
Kamin, L. J. (1969) · Medical Entomology and Zoology · Cited by 297
Suri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294
Self-citationAbnormal Synaptic Plasticity in the Striatum of Mice Lacking Dopamine D2 Receptors
Calabresi, P., Saiardi, A., Pisani, A., Baik, J., Centonze, D., Mercuri, N. B., Bernardi, G., & Borrelli, E. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-12-04536.1997 · Cited by 289
Williams, S. M., & Goldman-Rakic, P. S. (1993) · Cerebral Cortex · doi:10.1093/cercor/3.3.199 · Cited by 284 · cited 2×
“Thus, synaptically released frontal cortex (Berger et al., 1988; Williams and Goldman-Rakic, 1993).”
Localization of drug reward mechanisms by intracranial injections
Wise, R. A., & Hoffman, D. C. (1992) · Synapse · doi:10.1002/syn.890100307 · Cited by 279
Responses to the Sensory Properties of Fat of Neurons in the Primate Orbitofrontal Cortex
Rolls, E. T., Critchley, H. D., Browning, A. S., Hernadi, I., & Lenard, L. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-04-01532.1999 · Cited by 278
Neural mechanisms in disorders of movement
Crossman, A. R. (1989) · Comparative Biochemistry and Physiology Part A Physiology · doi:10.1016/0300-9629(89)90201-6 · Cited by 276
Modifications of Reward Expectation-Related Neuronal Activity During Learning in Primate Striatum
Tremblay, L., Hollerman, J. R., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.964 · Cited by 273
Self-citationValue-dependent selection in the brain: Simulation in a synthetic neural model
Friston, K. J., Tononi, G., Reeke, G. N., Sporns, O., & Edelman, G. M. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90592-4 · Cited by 268
Visual and oculomotor functions of monkey subthalamic nucleus
Matsumura, M., Kojima, J., Gardiner, T. W., & Hikosaka, O. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.6.1615 · Cited by 265
Berger, B., Trottier, S., Verney, C., Gaspar, P., & Alvarez, C. (1988) · The Journal of Comparative Neurology · doi:10.1002/cne.902730109 · Cited by 264
Influence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum
Hassani, O. K., Cromwell, H. C., & Schultz, W. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.6.2477 · Cited by 257
Self-citationEXPERIMENTAL AND HISTOLOGICAL STUDY OF MIDBRAIN DYSKINESIAS
POIRIER, L. J. (1960) · Journal of Neurophysiology · doi:10.1152/jn.1960.23.5.534 · Cited by 255
On the cerebellum and motor learning
Llinás, R., & Welsh, J. P. (1993) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(93)90168-x · Cited by 252
Inhibition of climbing fibres is a signal for the extinction of conditioned eyelid responses
Medina, J. F., Nores, W. L., & Mauk, M. D. (2002) · Nature · doi:10.1038/416330a · Cited by 252
Orbitofrontal cortex is activated during breaches of expectation in tasks of visual attention
Nobre, A. C., Coull, J. T., Frith, C., & Mesulam, M. M. (1999) · Nature Neuroscience · doi:10.1038/4513 · Cited by 249
Relations between movement and single cell discharge in the substantia nigra of the behaving monkey
DeLong, M., Crutcher, M., & Georgopoulos, A. (1983) · The Journal of Neuroscience · doi:10.1523/jneurosci.03-08-01599.1983 · Cited by 247
Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards
Bowman, E. M., Aigner, T. G., & Richmond, B. J. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.3.1061 · Cited by 246
Noradrenergic Regulation of Synaptic Plasticity in the Hippocampal CA1 Region
Katsuki, H., Izumi, Y., & Zorumski, C. F. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.6.3013 · Cited by 244
Use‐dependent changes in synaptic efficacy in rat prefrontal neurons in vitro.
Hirsch, J. C., & Crépel, F. (1990) · The Journal of Physiology · doi:10.1113/jphysiol.1990.sp018159 · Cited by 239
Fletcher, P. C., Anderson, J. M., Shanks, D. R., Honey, R., Carpenter, T. A., Donovan, T., Papadakis, N., & Bullmore, E. T. (2001) · Nature Neuroscience · doi:10.1038/nn733 · Cited by 238
Models of the cerebellum and motor learning
Houk, J. C., Buckingham, J. T., & Barto, A. G. (1997) · Cambridge University Press eBooks · doi:10.1017/cbo9780511666896.006 · Cited by 234
Single cell activity in ventral prefrontal cortex of behaving monkeys
Rosenkilde, C. E., Bauer, R. H., & Fuster, J. M. (1981) · Brain Research · doi:10.1016/0006-8993(81)90160-8 · Cited by 233
Models of the cerebellum and motor learning
Houk, J. C., Buckingham, J. T., & Barto, A. G. (1996) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00081474 · Cited by 231
Interaction of norepinephrine with cerebellar activity evoked by mossy and climbing fibers
Freedman, R., Hoffer, B. J., Woodward, D. J., & Puro, D. G. (1977) · Experimental Neurology · doi:10.1016/0014-4886(77)90175-3 · Cited by 230
The cerebellum and motor learning
Glickstein, M. (1992) · Current Biology · doi:10.1016/0960-9822(92)90096-s · Cited by 230
Chergui, K., Suaud‐Chagny, M., & Gonon, F. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90465-0 · Cited by 229
Church, W. H., Justice, J. B., & Byrd, L. D. (1987) · European Journal of Pharmacology · doi:10.1016/0014-2999(87)90592-9 · Cited by 227
Aston‐Jones, G., Rajkowski, J., & Kubiak, P. (1997) · Neuroscience · doi:10.1016/s0306-4522(97)00060-2 · Cited by 227
Perspectives on cognitive neuroscience
(1992) · Choice Reviews Online · doi:10.5860/choice.30-0604 · Cited by 226
Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus.
Lovibond, P. F. (1983) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.9.3.225 · Cited by 225
Sears, L. L., & Steinmetz, J. E. (1991) · Brain Research · doi:10.1016/0006-8993(91)91276-7 · Cited by 224
Sara, S. J., & Segal, M. (1991) · Progress in brain research · doi:10.1016/s0079-6123(08)63835-2 · Cited by 223
Quantification of the dopamine innervation in adult rat neostriatum
Doucet, G., Descarries, L., & Garcia, S. (1986) · Neuroscience · doi:10.1016/0306-4522(86)90272-1 · Cited by 214
Inhibitory Cerebello-Olivary Projections and Blocking Effect in Classical Conditioning
Kim, J. J., Krupa, D. J., & Thompson, R. F. (1998) · Science · doi:10.1126/science.279.5350.570 · Cited by 212
Response of nucleus accumbens neurons to amygdala stimulation and its modification by dopamine
Yim, C. Y., & Mogenson, G. J. (1982) · Brain Research · doi:10.1016/0006-8993(82)90518-2 · Cited by 210
Reward, Motivation, Cognition: Psychobiology of Mesotelencephalic Dopamine Systems
Fibiger, H. C., & Phillips, A. G. (1986) · Comprehensive physiology · doi:10.1002/cphy.cp010412 · Cited by 206
German, D. C., Dubach, M. F., Askari, S., Speciale, S. G., & Bowden, D. M. (1988) · Neuroscience · doi:10.1016/0306-4522(88)90320-x · Cited by 200
Learning of sequential movements by neural network model with dopamine-like reinforcement signal
Suri, R. E., & Schultz, W. (1998) · Experimental Brain Research · doi:10.1007/s002210050467 · Cited by 198
Self-citationDopamine facilitates long-term depression of glutamatergic transmission in rat prefrontal cortex
Otani, S., Blond, O., Desce, J. M., & Crépel, F. (1998) · Neuroscience · doi:10.1016/s0306-4522(97)00677-5 · Cited by 196
Ojakangas, C. L., & Ebner, T. J. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.6.2222 · Cited by 190
Gurden, H., Tassin, J., & Jay, T. M. (1999) · Neuroscience · doi:10.1016/s0306-4522(99)00395-4 · Cited by 189
The 28th Bartlett Memorial Lecture Causal learning: An associative analysis
Dickinson, A. (2001) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/02724990042000010 · Cited by 187
Schultz, W., & Romo, R. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.201 · Cited by 184 · cited 1×
“Primary re-insensitive to aversive stimuli, as they show depressions or activations with slower time courses following pain wards elicit neuronal activations during initial learning periods which decrease progressively and are trans-pinch in anesthetized monkeys (Schultz and Romo, 1987).”
Self-citationCellular mechanisms of long-term depression in the cerebellum
Linden, D. J., & Connor, J. A. (1993) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(93)90133-j · Cited by 181
Activity of dopamine neurons in the behaving primate
Schultz, W. (1992) · Seminars in Neuroscience · doi:10.1016/1044-5765(92)90011-p · Cited by 178
Self-citationChang, J., Sawyer, S. F., Lee, R., & Woodward, D. J. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-03-01224.1994 · Cited by 177
D1/D5 Dopamine Receptors Inhibit Depotentiation at CA1 Synapses via cAMP-Dependent Mechanism
Otmakhova, N. A., & Lisman, J. E. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-04-01270.1998 · Cited by 176
‘Error’ potentials in limbic cortex (anterior cingulate area 24) of monkeys during motor learning
Gemba, H., Sasaki, K., & Brooks, V. B. (1986) · Neuroscience Letters · doi:10.1016/0304-3940(86)90467-2 · Cited by 176
The primate globus pallidus: neuronal activity related to direction of movement
Mitchell, S. J., Richardson, R. T., Baker, F., & DeLong, M. R. (1987) · Experimental Brain Research · doi:10.1007/bf00249793 · Cited by 175
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1877 · Cited by 172
Self-citationDopamine-dependent synaptic plasticity in striatum during in vivo development
Tang, K., Low, M. J., Grandy, D. K., & Lovinger, D. M. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.3.1255 · Cited by 171
Dahl, D. R., & Sarvey, J. M. (1989) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.86.12.4776 · Cited by 171
Mesencephalic dopaminergic unit activity in the behaviorally conditioned rat
Miller, J. D., Sanghera, M. K., & German, D. C. (1981) · Life Sciences · doi:10.1016/0024-3205(81)90231-9 · Cited by 170
Louilot, A., Moal, M. L., & Simon, H. (1986) · Brain Research · doi:10.1016/0006-8993(86)90646-3 · Cited by 168
Cerebellar Function in Consolidation of a Motor Memory
Attwell, P. J. E., Cooke, S. F., & Yeo, C. H. (2002) · Neuron · doi:10.1016/s0896-6273(02)00719-5 · Cited by 167
Herrera‐Marschitz, M., You, Z. ‐., Goiny, M., et al. (1996) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.1996.66041726.x · Cited by 167
Lynd‐Balta, E., & Haber, S. N. (1994) · The Journal of Comparative Neurology · doi:10.1002/cne.903450407 · Cited by 164
Wilson, F. A. W., & Rolls, E. T. (1990) · Experimental Brain Research · doi:10.1007/bf00228852 · Cited by 164
Apicella, P., Legallet, E., & Trouche, E. (1997) · Experimental Brain Research · doi:10.1007/pl00005773 · Cited by 162
Topographic distribution of modality-specific amygdalar neurons in alert monkey
Nishijo, H., Ono, T., & Nishino, H. (1988) · Journal of Neuroscience · doi:10.1523/jneurosci.08-10-03556.1988 · Cited by 153
Neural correlates of decisions
Platt, M. L. (2002) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(02)00302-1 · Cited by 152
Amphetamine Blocks Long-Term Synaptic Depression in the Ventral Tegmental Area
Jones, S., Gutlerner, J. L., & Kauer, J. A. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-15-05575.2000 · Cited by 151
Brown, J. R., & Arbuthnott, G. W. (1983) · Neuroscience · doi:10.1016/0306-4522(83)90138-0 · Cited by 138
Continuousin vivo monitoring of evoked dopamine release in the rat nucleus accumbens by amperometry
Dugast, C., Suaud‐Chagny, M., & Gonon, F. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90466-9 · Cited by 138
The activity of pars compacta neurons of the monkey substantia nigra in relation to motor activation
Schultz, W., Ruffieux, A., & Aebischer, P. (1983) · Experimental Brain Research · doi:10.1007/bf00237874 · Cited by 136
Self-citationThe performance on learning tasks of patients in the early stages of Parkinson's disease
Canavan, A. G. M., Passingham, R. E., Marsden, C. D., Quinn, N., Wyke, M., & Polkey, C. E. (1989) · Neuropsychologia · doi:10.1016/0028-3932(89)90167-x · Cited by 133
Firing patterns of nucleus accumbens neurons during cocaine self-administration in rats
Carelli, R. M., King, V. C., Hampson, R. E., & Deadwyler, S. A. (1993) · Brain Research · doi:10.1016/0006-8993(93)90557-4 · Cited by 130
Neuronal responses related to reinforcement in the primate basal forebrain
Wilson, F. A. W., & Rolls, E. T. (1990) · Brain Research · doi:10.1016/0006-8993(90)90546-n · Cited by 130
Reward-Predicting and Reward-Detecting Neuronal Activity in the Primate Supplementary Eye Field
Amador, N., Schlag-Rey, M., & Schlag, J. D. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.4.2166 · Cited by 128
Responses of monkey midbrain dopamine neurons during delayed alternation performance
Ljungberg, T., Apicella, P., & Schultz, W. (1991) · Brain Research · doi:10.1016/0006-8993(91)90816-e · Cited by 128
Self-citationMemory for temporal order and conditional associative-learning in patients with Parkinson's disease
Vriezen, E. R., & Moscovitch, M. (1990) · Neuropsychologia · doi:10.1016/0028-3932(90)90044-o · Cited by 124
Nucleus basalis of Meynert neuronal activity during a delayed response task in monkey
Richardson, R. T., & DeLong, M. R. (1986) · Brain Research · doi:10.1016/0006-8993(86)91529-5 · Cited by 122
Nishino, H., Ono, T., Muramoto, K., Fukuda, M., & Sasaki, K. (1987) · Brain Research · doi:10.1016/0006-8993(87)91021-3 · Cited by 120
Wilson, F., & Rolls, E. T. (1990) · Journal of Neuroscience · doi:10.1523/jneurosci.10-04-01254.1990 · Cited by 120
Dopamine Modulates Excitability of Spiny Neurons in the Avian Basal Ganglia
Ding, L., & Perkel, D. J. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-12-05210.2002 · Cited by 119
Young, A. M. J., Joseph, M. H., & Gray, J. A. (1992) · Neuroscience · doi:10.1016/0306-4522(92)90275-7 · Cited by 111
Doherty, M. D., & Gratton, A. P. (1992) · Brain Research · doi:10.1016/0006-8993(92)91639-v · Cited by 108
A Predictive Reinforcement Model of Dopamine Neurons for Learning Approach Behavior
Contreras-Vidal, J. L., & Schultz, W. (1999) · Journal of Computational Neuroscience · doi:10.1023/a:1008862904946 · Cited by 107
Self-citationDopaminergic Synapses Mediate Neuronal Changes in an Analogue of Operant Conditioning
Nargeot, R., Baxter, D. A., Patterson, G. W., & Byrne, J. H. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.81.4.1983 · Cited by 104
Uptake of Dopamine Released by Impulse Flow in the Rat Mesolimbic and Striatal Systems In Vivo
Suaud‐Chagny, M., Dugast, C., Chergui, K., Msghina, M., & Gonon, F. (1995) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.1995.65062603.x · Cited by 103
Context-dependent responses of primate nucleus basalis neurons in a go/no-go task
Richardson, R., & DeLong, M. (1990) · Journal of Neuroscience · doi:10.1523/jneurosci.10-08-02528.1990 · Cited by 97
LICHTENSTEIGER, W., Felix, D., Lienhart, R., & Hefti, F. F. (1976) · Brain Research · doi:10.1016/0006-8993(76)90558-8 · Cited by 96
Peoples, L. L., Gee, F., Bibi, R., & West, M. O. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-18-07588.1998 · Cited by 76
Sprengelmeyer, R., Canavan, A. G. M., Lange, H. W., & Hömberg, V. (1995) · Movement Disorders · doi:10.1002/mds.870100110 · Cited by 72
The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units
Watanabe, M. (1989) · Neuroscience Letters · doi:10.1016/0304-3940(89)90450-3 · Cited by 64
Sardo, P., Ravel, S., Legallet, E., & Apicella, P. (2000) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2000.00068.x · Cited by 60
Elements of the Intrinsic Organization and Information Processing in the Neostriatum
Groves, P. M., Garcia-Munoz, M., Linder, J. C., Manley, M. S., Martone, M. E., & Young, S. J. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0007 · Cited by 59
Tong, Z.-Y., Overton, P. G., & Clark, D. T. (1995) · Brain Research · doi:10.1016/0006-8993(94)01439-o · Cited by 56
Long-term potentiation in rat prefrontal slices facilitated by phased application of dopamine
Blond, O., Crépel, F., & Otani, S. (2002) · European Journal of Pharmacology · doi:10.1016/s0014-2999(02)01291-8 · Cited by 52
Responses of rat pallidum cells to cortex stimulation and effects of altered dopaminergic activity
Toan, D. L., & Schultz, W. (1985) · Neuroscience · doi:10.1016/0306-4522(85)90070-3 · Cited by 49
Self-citationBlocking observed in human eyelid conditioning.
Martin, I., & Levey, A. B. (1991) · PubMed · Cited by 40
Sessler, F. M., Liu, W., Kirifides, M. L., Mouradian, R., Lin, R. C. S., & Waterhouse, B. D. (1995) · Brain Research · doi:10.1016/0006-8993(95)00060-4 · Cited by 39
Learning admittance mappings for force-guided assembly
Gullapalli, V., Barto, A. G., & Grupen, R. A. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.1994.351117 · Cited by 37
Low-dose amphetamine elevates movement-related firing of rat striatal neurons
West, M. O., Peoples, L. L., Michael, A. J., Chapin, J. K., & Woodward, D. J. (1997) · Brain Research · doi:10.1016/s0006-8993(96)01215-2 · Cited by 33
Research works printed but not linked: 1
- Andén, 1966, A quantitative study on the nigro-neostriatal dopamine neurons. Acta physiol, Scand., 67, 306
Cited by
Sorted by citations
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718
The role of the medial frontal cortex in cognitive control
Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., & Nieuwenhuis, S. (2004) · Science · doi:10.1126/science.1100301 · Cited by 2,974
Model of autism: increased ratio of excitation/inhibition in key neural systems
Rubenstein, J. L. R., & Merzenich, M. M. (2003) · Genes, Brain and Behavior · doi:10.1034/j.1601-183x.2003.00037.x · Cited by 2,768
The Dopamine Hypothesis of Schizophrenia: Version III--The Final Common Pathway
Howes, O. D., & Kapur, S. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp006 · Cited by 2,693
Dibner, C., Schibler, U., & Albrecht, U. (2010) · Annual Review of Physiology · doi:10.1146/annurev-physiol-021909-135821 · Cited by 2,421
Metadata
- Authors
- Schultz, W.
- Affiliations
- University of Fribourg (CH)
- Corresponding author
- Schultz, Wolfram
- ORCID
- Schultz, Wolfram
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2002-10
- Volume
- 36
- Issue
- 2
- Pages
- 241-263
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W1998152406
- Cited by
- 2,574
- References
- 208
- Citations by year
- 2026: 22 · 2025: 56 · 2024: 101 · 2023: 46 · 2022: 54 · 2021: 76 · 2020: 94 · 2019: 87 · 2018: 91 · 2017: 88 · 2016: 117 · 2015: 113 · 2014: 146 · 2013: 130 · 2012: 138
- FWCI
- 8.71
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust (095495)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- dopamine, reward signals, prediction error, striatum, frontal cortex, amygdala, goal-directed behavior, stimulant use disorder
- MeSH terms
- Animals, Brain, Dopamine, Humans, Neurons, Reward, Illicit Drugs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review