The DOI matches its Crossref record.
Importance of unpredictability for reward responses in primate dopamine neurons
Abstract
1. We used single neuron recording techniques in two behaving monkeys to investigate the conditions in which dopamine neurons respond to primary rewarding or potentially rewarding stimuli. Animals received drops of liquid either outside behavioral tasks or as rewards during learning or established performance of an auditory reaction time task. 2. Three quarters of dopamine neurons showed a short-latency, phasic response to liquid that was delivered outside the task without being predicted by phasic stimuli. The same neurons responded to liquid reward during learning but not when task performance was established, at which time the neuronal response occurred to the conditioned, reward-predicting, movement-triggering stimulus. 3. These data suggest that the responses of dopamine neurons to rewarding or potentially rewarding liquid are due to the temporally unpredicted stimulus occurrence. A known, reward-predicting, tonic context does not prevent dopamine neurons from responding to the rewarding liquid. The responses during learning apparently occur because reward is not yet reliably predicted by a conditioned phasic stimulus. Because the unpredicted occurrence of reward is of central importance for learning, these responses allow dopamine neurons to play an important role in reward-driven learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Still being checked.
Cited by
Items 401–500 of 569
From learned value to sustained bias: how reward conditioning changes attentional priority
Meyer, K. N., Hopfinger, J. B., Vidrascu, E. M., Boettiger, C. A., Robinson, D. L., & Sheridan, M. A. (2024) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2024.1354142 · Cited by 5
McClure, S. M., & D’Ardenne, K. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374620-7.00010-8 · Cited by 5
Takahashi, Y. K., Zhang, Z., Kahnt, T., & Schoenbaum, G. M. (2025) · Behavioral Neuroscience · doi:10.1037/bne0000633 · Cited by 5
De la récompense à l’utilité : la trajectoire économique du béhaviorisme de 1961 à nos jours
Vallois, N. (2017) · Cahiers d économie politique · doi:10.3917/cep.072.0027 · Cited by 7
Rad, F. S., Haghparast, A., & Eliassi, A. (2020) · Basic and Clinical Neuroscience Journal · doi:10.32598/bcn.11.6.2226.1 · Cited by 6
Beck, F. (2008) · German Journal of Exercise and Sport Research · doi:10.1007/bf03217046 · Cited by 8
Lee, H., Jiang, N., & Samuel, S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111688 · Cited by 5
Distributed midbrain responses signal the content of positive identity prediction errors
Howard, J. D., Edmonds, D., Schoenbaum, G. M., & Kahnt, T. (2024) · Current Biology · doi:10.1016/j.cub.2024.07.105 · Cited by 4
Dopamine gates sensory representations in cortex
Eshel, N., & Tian, J. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00795.2013 · Cited by 4
Neostriatal Neuronal Activity Correlates Better with Movement Kinematics under Certain Rewards
Opriș, I. C., Lebedev, M., & Nelson, R. J. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00336 · Cited by 5
Cellular learning theory: Theoretical comment on Cole and McNally (2007).
Lattal, K. M., & Bernardi, R. E. (2007) · Behavioral Neuroscience · doi:10.1037/0735-7044.121.5.1140 · Cited by 5
Reconsidering Food Reward, Brain Stimulation, and Dopamine: Incentives Act Forward
Newquist, G., & Gardner, R. A. (2015) · The American Journal of Psychology · doi:10.5406/amerjpsyc.128.4.0431 · Cited by 4
Electrophysiological correlates of reward processing in dopamine neurons
Tobler, P. N., & Kobayashi, S. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374620-7.00002-9 · Cited by 5
Brain Stimulation in Childhood Mental Health
MacMaster, F. P., Sembo, M., Ma, K., & Croarkin, P. E. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-802001-2.00016-3 · Cited by 6
Brain Systems Mediating Reward
(2004) · Elsevier eBooks · doi:10.1016/b978-012264841-0/50023-8 · Cited by 7
Locomotion induced by non-contingent intracranial stimulation: comparison to psychomotor stimulant
Farmer‐Dougan, V. A., Dougan, J. D., Rokosik, S. L., Lewis, J., & Garris, P. A. (2004) · Behavioural Processes · doi:10.1016/j.beproc.2004.04.004 · Cited by 4
Turner, P., & Curran, A. (2006) · Bioscience Education · doi:10.3108/beej.2006.07000006 · Cited by 5
Kelly, E. A., Love, T., & Fudge, J. L. (2023) · Synapse · doi:10.1002/syn.22284 · Cited by 3
Long, K. L. P., Hoglen, N. E. G., Keip, A. J., Klinkel, R., See, D. L., Maa, J., Wong, J. C., Sherman, M., & Manoli, D. S. (2026) · Nature Communications · doi:10.1038/s41467-026-76876-8 · Cited by 3
Neurobiological theories of addiction
Koob, G. F., Arends, M. A., McCracken, M. L., & Moal, M. L. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-816863-9.00003-0 · Cited by 3
Theory of the brain and mind: Visions and history
Levine, D. S. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-96104-2.00004-x · Cited by 3
Reward learning capacity in a community sample of individuals who use cannabis.
Turner, O., Punia, K., Pizzagalli, D. A., MacKillop, J. M., & Balodis, I. M. (2023) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000701 · Cited by 3
Modeling the effects of nicotine on a continuous performance task
Levine, D. S., Jani, N. G., & Gilbert, D. G. (2003) · Neurocomputing · doi:10.1016/s0925-2312(02)00801-9 · Cited by 3
Shapovalova, K. B., & Kamkina, Y. V. (2009) · Neuroscience and Behavioral Physiology · doi:10.1007/s11055-009-9228-1 · Cited by 3
Eshel, N., & Steinberg, E. E. (2018) · PLoS Biology · doi:10.1371/journal.pbio.3000043 · Cited by 3
Reward Prediction Error Computation in the Pedunculopontine Tegmental Nucleus Neurons
Kobayashi, Y., & Ok, K.-I. (2011) · InTech eBooks · doi:10.5772/13378 · Cited by 3
6.4 Behavioral Functions of Dopamine Neurons
Tobler, P. N. (2009) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195373035.003.0022 · Cited by 4
Reward responses of dopamine neurons: A biological reinforcement signal
Schultz, W. (1997) · Lecture notes in computer science · doi:10.1007/bfb0020125 · Cited by 3
Self-citationCrescimanno, G., Sorbera, F., Emmi, A., & Amato, G. (1998) · Brain Research Bulletin · doi:10.1016/s0361-9230(97)00290-6 · Cited by 3
Synaptic Triad in the Neostriatum: Dopamine, Glutamate, and the MSN
Klug, J. R., Deutch, A. Y., Colbran, R. J., & Winder, D. J. (2011) · Frontiers in neuroscience · doi:10.1201/b11284-5 · Cited by 2
van der Vegt, J. P. M., Hulme, O. J., Madsen, K. H., Buhmann, C., Bloem, B. R., Münchau, A. M., Helmich, R. C. G., & Siebner, H. R. (2020) · NeuroImage Clinical · doi:10.1016/j.nicl.2020.102362 · Cited by 3
Murray, S. B., Diaz‐Fong, J. P., Mak, V. W. T., & Feusner, J. D. (2024) · Brain and Behavior · doi:10.1002/brb3.3573 · Cited by 2
A brief history of dopamine prediction errors
Dudhabhate, B. B., & Costa, K. M. (2026) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2026.1825622 · Cited by 2
Levine, D. S. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-815480-9.00009-8 · Cited by 2
Shearrer, G. E., Nansel, T. R., Lipsky, L. M., Sadler, J. R., & Burger, K. S. (2019) · Physiology & Behavior · doi:10.1016/j.physbeh.2019.04.009 · Cited by 2
Induced Positive Affect Reduces the Magnitude of the Startle Response and Prepulse Inhibition
Ruiz-Salas, J. C., & la Casa, L. G. D. (2020) · Journal of Psychophysiology · doi:10.1027/0269-8803/a000261 · Cited by 2
Can we tackle climate change by behavioral hacking of the dopaminergic system?
Munuera, J., & Burguière, E. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.996955 · Cited by 2
Modeling dopamine activity by Reinforcement Learning methods: implications from two recent models
Horgan, P., & Cummins, F. (2006) · Artificial Intelligence Review · doi:10.1007/s10462-007-9036-3 · Cited by 2
Internal model reproduces anticipatory neural activity
Suri, R. E., & Schulz, W. (1999) · doi:10.3929/ethz-a-007587119 · Cited by 2
Tryon, V. L. (2017) · ResearchWorks at the University of Washington (University of Washington) · Cited by 3
The Kamin Blocking Effect in Sign and Goal TrackersPreprint
Aggarwal, M., & Wickens, J. R. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.01.232553 · Cited by 2
Matsumoto, N., Hanakawa, T., Maki, S., & Kimura, M. (1996) · Advances in behavioral biology · doi:10.1007/978-1-4899-0194-1_23 · Cited by 2
Heck, M., Quertemont, É., & Anselme, P. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1796424 · Cited by 1
Neuronale Korrelate von nutzenbasierten Entscheidungen
Plaßmann, H. (2010) · Gabler eBooks · doi:10.1007/978-3-8349-6373-4_8 · Cited by 1
A Context for Science with a Commitment to Behavior Change
Lootens, C. M., Mitchell, J. T., Robertson, C. D., Hundt, N. E., Kimbrel, N. A., & Ishuin, T. (2007) · Cited by 1
Effects of dopamine depletion on reward-seeking behavior
Pessiglione, M., & Tremblay, L. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374620-7.00012-1 · Cited by 3
A biologically plausible decision-making model based on interacting neural populations
Baspinar, E., Cecchini, G., DePass, M., Andujar, M., Pani, P., Ferraina, S., Moreno‐Bote, R., Cos, I., & Destexhe, A. (2026) · PLoS ONE · doi:10.1371/journal.pone.0340393 · Cited by 1
Striking parallels between the dopaminergic systems of flies and mammals
Jovanoski, K. D., & Waddell, S. (2025) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-443-29867-7.00025-6 · Cited by 2
Ikegami, A. (2003) · Texas ScholarWorks (Texas Digital Library) · Cited by 1
Petropoulos, A. (2010) · QSpace (Queen's University Library) · Cited by 2
A Neuroeconomic Theory of Attention- and Task-Switching with Implications for Autism and ADHDPreprint
Landry, P. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2725953 · Cited by 1
Reinforcement Neuronal Signals and Dimensionality Reduction in the Cortico-Basal Ganglia System
Morris, G., Arkadir, D., & Bergman, H. (2002) · Advances in behavioral biology · doi:10.1007/978-1-4757-3538-3_88 · Cited by 1
Neural representation of social, monetary and chocolate reinforcer processing
Zhu, J. (2016) · Aston Publications Explorer (Aston University) · doi:10.48780/publications.aston.ac.uk.00030063 · Cited by 1
Shen, Y. F. (2015) · TSpace (University of Toronto) · Cited by 3
The limbic circuit for response vigourPreprint
Porr, B., Gomes, P. D. S., & Andreassen, T. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/600973 · Cited by 1
The Measurement of Expectations
Curtin, R. T. (2019) · Cambridge University Press eBooks · doi:10.1017/9780511791598.009 · Cited by 1
Yamamoto, M., Okuda, J., Samejima, K., & Sakagami, M. (2008) · The Brain & Neural Networks · doi:10.3902/jnns.15.3 · Cited by 1
Phase-precession-like Effect in the Anterior Insula Cortex during Reward ExpectancyPreprint
Yang, L., Lehongre, K., Ye, H., Yu, X., Navarro, V., Cheng, S., Axmacher, N., Wang, S., & Zhang, H. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.09.19.558205 · Cited by 1
Fudge, J. L., Song, D. D., & Haber, S. N. (2002) · Advances in behavioral biology · doi:10.1007/978-1-4615-0179-4_32 · Cited by 1
NEURAL PROCESSING OF EMOTIONAL MUSIC AND SOUNDS IN DEPRESSION
Lepping, R. J. (2013) · KU ScholarWorks (The University of Kansas) · Cited by 2
The essential architecture of the learning experience in history museums : a phenomenological study
McLauchlan, R. (2013) · UTS ePRESS (University of Technology Sydney) · Cited by 2
Dual dopamine/serotonin treatment approach for addictive behaviour
Dassanayake, A. F. (2013) · UC Research Repository (University of Canterbury) · doi:10.26021/7328
Ventral Tegmental Area Neuronal Ensembles Accurately Encode Action Number
Wood, J. T. (2015) · D-Scholarship@Pitt (University of Pittsburgh)
Neural Processes Involved in Action Selection During a Mixed-Strategy Game
Thevarajah, D. (2009) · QSpace (Queen's University Library)
Mitelman, R., Joshua, M., & Bergman, H. (2009) · Advances in behavioral biology · doi:10.1007/978-1-4419-0340-2_16
Neurobiology of Impulse Control Disorders in Parkinson's Disease
Steeves, T. D. L., Miyasaki, J. M., Lang, A. E., & Strafella, A. P. (2011) · Parkinson s Disease · doi:10.1002/9781444397970.ch20
Hierarchical error processing during motor control
Krigolson, O. E. (2007) · UVic’s Research and Learning Repository (University of Victoria)
Babayan, B. M. (2014) · theses.fr (ABES) · doi:10.70675/e8b97eb3z03b7z4874z8a4cz73f0efdb6981 · Cited by 3
Prediction error dependent changes in brain connectivity during associative learning
den Ouden, H. E. M. (2009) · UCL Discovery (University College London) · Cited by 1
MacLaren, D. A. A. (2012) · St Andrews Research Repository (St Andrews Research Repository)
The neural bases of regularity learning
Doeller, C. F. (2005) · PsyDok Dokumentenserver für die Psychologie (Leibniz-Zentrum für Psychologische Information und Dokumentation) · doi:10.22028/d291-23263
Prior Knowledge and Recognition Memory - a Computational Modeling Approach
Hellman, J. (2013) · Lund University Publications (Lund University)
Genetic and experiential effects on dopaminergic systems
Woolley, S. C. (2002) · Texas ScholarWorks (Texas Digital Library)
Emotional Modulation of Time Perception
Lake, J. I. (2014) · DukeSpace (Duke University) · Cited by 1
The effects of probability and uncertainty on spatial attention
Close, A. (2012) · Bangor University Research Portal (Bangor University)
Bernier, B. E. (2011) · Texas ScholarWorks (Texas Digital Library)
Theile, J. W. (2009) · Texas ScholarWorks (Texas Digital Library)
Cognitive Modeling of Unusual Association with Declarative Knowledge by Positive Affect
Park, S.-J., & Myung, R. (2015) · Journal of Korean Institute of Industrial Engineers · doi:10.7232/jkiie.2015.41.1.043
Tessel, R. E., Loupe, P. S., Schroeder, S. R., & Schloss, J. (2002) · Experimental and Clinical Psychopharmacology · doi:10.1037//1064-1297.10.4.408
Activity of substantia nigra neurons in the cat brain during a self-initiated behavioral act
Vg, S., Pavlenko, V. B., Куличенко, А. М., Ev, G., & Om, P. (1998) · Neuroscience and Behavioral Physiology · doi:10.1007/bf02462952
EFFECTS OF JOINT COCAINE AND ETHANOL ON THE BRAIN OPIOID SYSTEMS
Rosin, Å. (2005) · Figshare
Ismail, N. (2008) · Spectrum Research Repository (Concordia University)
The Role of the Ventral Tegmental Area in the Extinction of Probabilistic Rewards
Song, M. R. (2011) · UA Campus Repository (The University of Arizona)
Action control in uncertain environments
Smittenaar, P. (2015) · UCL Discovery (University College London)
A computational model of learned behavioural sequences in prefrontal cortex
van der Ham, E. (2007)
Sobie, J. L. (2007) · ScholarWorks - WMU (Western Michigan University)
Cameron, C. M. (2014) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/qcsd-bh97
Analysis framework for adaptive spiking neural networks
Wang, F. (2014) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Day, J. J. (2010) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/s1tk-dq52
Pattison, L. P. (2013) · WakeSpace Scholarship (Wake Forest University)
Altered bold fMRI response toward survival-pertinent stimuli in the early postpartum dam
Caffrey, M. K. (2013) · Digital Repository Service (Northeastern University) · doi:10.17760/d20003119
Role of the basal ganglia in conditional associative learning : a multidisciplinary approach
Hadj‐Bouziane, F. (2003) · HAL
MONITORING AND MODULATING DOPAMINE RELEASE AND UNIT ACTIVITY IN REAL-TIME
Belle, A. M., & Wightman, R. M. (2014) · WORLD SCIENTIFIC eBooks · doi:10.1142/9789814619776_0007
Investigating Basal Ganglia Function With Cell-Type-Specific Manipulations
Kravitz, A. V., Devarakonda, K., & Kreitzer, A. C. (2016) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-12-802206-1.00033-7
Reward and Decision Encoding in Basal Ganglia
Tian, J., Uchida, N., & Eshel, N. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805308-9.00005-1 · Cited by 1
Schimmel, L. P. (2015) · QSpace (Queen's University Library)
The Evolutionary Foundation of the Preference for Surprise
Chen, H. K. (2015)
Metadata
- Authors
- Mirenowicz, J., & Schultz, W.
- Affiliations
- University of Fribourg (CH)
- ORCID
- Schultz, W.
- Venue
- Journal of Neurophysiology
- Publisher
- American Physiological Society
- Published
- 1994-08-01
- Volume
- 72
- Issue
- 2
- Pages
- 1024-1027
- ISSN
- 0022-3077 (ISSN-L)
- 1522-1598
- OpenAlex
- W1771503649
- Semantic Scholar
- 8d6a83e1165dde01fad3da3773db9377adda4ed7
- Cited by
- 569
- References
- 0
- Citations by year
- 2026: 7 · 2025: 6 · 2024: 19 · 2023: 12 · 2022: 7 · 2021: 14 · 2020: 16 · 2019: 32 · 2018: 17 · 2017: 24 · 2016: 35 · 2015: 33 · 2014: 27 · 2013: 24 · 2012: 19
- FWCI
- 2.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Neurophysiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- dopaminergic neurons, reward prediction, unpredictability
- MeSH terms
- Animals, Appetitive Behavior, Arousal, Attention, Auditory Perception, Dopamine, Drinking, Macaca fascicularis, Male, Mesencephalon, Motivation, Reaction Time, Reinforcement Schedule
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.