BOLD responses reflecting dopaminergic signals in the human ventral tegmental area
Abstract
Current theories hypothesize that dopamine neuronal firing encodes reward prediction errors. Although studies in nonhuman species provide direct support for this theory, functional magnetic resonance imaging (fMRI) studies in humans have focused on brain areas targeted by dopamine neurons [ventral striatum (VStr)] rather than on brainstem dopaminergic nuclei [ventral tegmental area (VTA) and substantia nigra]. We used fMRI tailored to directly image the brainstem. When primary rewards were used in an experiment, the VTA blood oxygen level–dependent (BOLD) response reflected a positive reward prediction error, whereas the VStr encoded positive and negative reward prediction errors. When monetary gains and losses were used, VTA BOLD responses reflected positive reward prediction errors modulated by the probability of winning. We detected no significant VTA BOLD response to nonrewarding events.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The signed prediction error indicates whether an outcome is better or worse than expected and plays a crucial role in changing the value allocated to cues, thereby guiding future decisions.
“First, the signed prediction error indicates whether an outcome is better or worse than expected, and thereby plays a crucial role in changing the value allocated to cues, thereby guiding future decisions [14–21].”
From Precision weighting of cortical unsigned prediction error signals benefits learning, is mediated by dopamine, and is impaired in psychosis (2021) · cites this paper as [14]
This approach has been used to identify links between activity in neuromodulatory nuclei and computational trajectories, such as precision-weighted prediction errors or uncertainty.
“This approach has been used, for example, to identify links between activity in neuromodulatory nuclei and computational trajectories, such as (precision-weighted) prediction errors or uncertainty (111, 115–117).”
From Can Bayesian Theories of Autism Spectrum Disorder Help Improve Clinical Practice? (2016) · cites this paper as [115]
The human SN/VTA is activated by rewards.
“Such studies (e.g. [48, 51]) have demonstrated that the human SN/VTA is activated by rewards, a finding confirmed by a recent study using electrophysiological recordings [52].”
From A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP (2011) · cites this paper as [48]
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,542 · see citing works
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472 · see citing works
Self-citationDissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · see citing works
Control of Cognitive Processes: Attention and Performance XVIII
Monsell, S., & Driver, J. (2000) · UCL Discovery (University College London) · Cited by 1,451 · see citing works
FMRI visualization of brain activity during a monetary incentive delay task
Knutson, B., Westdorp, A., Kaiser, E., & Hommer, D. (2000) · NeuroImage · doi:10.1006/nimg.2000.0593 · Cited by 1,414 · see citing works
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · see citing works
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,103 · see citing works
The rewards of music listening: Response and physiological connectivity of the mesolimbic system
Menon, V., & Levitin, D. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.05.053 · Cited by 1,059 · see citing works
Time Discounting for Primary Rewards
McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4246-06.2007 · Cited by 971 · see citing works
Self-citationTemporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917 · see citing works
Self-citationOpponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844 · see citing works
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829 · see citing works
Uniform Inhibition of Dopamine Neurons in the Ventral Tegmental Area by Aversive Stimuli
Ungless, M. A., Magill, P. J., & Bolam, J. P. (2004) · Science · doi:10.1126/science.1093360 · Cited by 782 · see citing works
Wittmann, B. C., Schott, B. H., Guderian, S., Frey, J. U., Heinze, H.-J., & Düzel, E. (2005) · Neuron · doi:10.1016/j.neuron.2005.01.010 · Cited by 698 · see citing works
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · see citing works
Absolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA
Bunzeck, N., & Düzel, E. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.021 · Cited by 503 · see citing works
Activity in human ventral striatum locked to errors of reward prediction
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002) · Nature Neuroscience · doi:10.1038/nn802 · Cited by 451 · see citing works
Neurometabolic coupling in cerebral cortex reflects synaptic more than spiking activity
Viswanathan, A., & Freeman, R. D. (2007) · Nature Neuroscience · doi:10.1038/nn1977 · Cited by 397 · see citing works
O'Doherty, J. P., Buchanan, T. W., Seymour, B., & Dolan, R. J. (2006) · Neuron · doi:10.1016/j.neuron.2005.11.014 · Cited by 322 · see citing works
Anticipation of novelty recruits reward system and hippocampus while promoting recollection
Wittmann, B. C., Bunzeck, N., Dolan, R. J., & Düzel, E. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.06.038 · Cited by 265 · see citing works
Dunckley, P., Wise, R. G., Fairhurst, M. T., Hobden, P., Aziz, Q., Chang, L., & Tracey, I. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.1100-05.2005 · Cited by 262 · see citing works
Anticipatory brainstem activity predicts neural processing of pain in humans
Fairhurst, M., Wiech, K., Dunckley, P., & Tracey, I. (2007) · Pain · doi:10.1016/j.pain.2006.09.001 · Cited by 231 · see citing works
Schott, B. H., Seidenbecher, C. I., Fenker, D. B., Lauer, C. J., Bunzeck, N., Bernstein, H.-G., Tischmeyer, W., Gundelfinger, E. D., Heinze, H.-J., & Düzel, E. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3463-05.2006 · Cited by 214 · see citing works
Belger, A., Puce, A., Krystal, J. H., Gore, J. C., Goldman‐Rakic, P. S., & McCarthy, G. (1998) · Human Brain Mapping · doi:10.1002/(sici)1097-0193(1998)6:1 · Cited by 203 · see citing works
Schott, B. H., Niehaus, L., Wittmann, B. C., Schütze, H., Seidenbecher, C. I., Heinze, H. –., & Düzel, E. (2007) · Brain · doi:10.1093/brain/awm147 · Cited by 193 · see citing works
Statistics of Midbrain Dopamine Neuron Spike Trains in the Awake Primate
Bayer, H. M., Lau, B., & Glimcher, P. W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01140.2006 · Cited by 184 · see citing works
Neural coding of distinct statistical properties of reward information in humans
Dreher, J.-C., Kohn, P., & Berman, K. F. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj004 · Cited by 180 · see citing works
Schneider, K. A., Richter, M. C., & Kästner, S. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.2413-04.2004 · Cited by 179 · see citing works
A subset of ventral tegmental area neurons is inhibited by dopamine, 5-hydroxytryptamine and opioids
Cameron, D., Wessendorf, M. W., & Williams, J. T. (1997) · Neuroscience · doi:10.1016/s0306-4522(96)00444-7 · Cited by 163 · see citing works
Eckert, T., Sailer, M., Kaufmann, J., Schrader, C., Peschel, T., Bodammer, N., Heinze, H., & Schoenfeld, M. A. (2003) · NeuroImage · doi:10.1016/j.neuroimage.2003.08.028 · Cited by 150 · see citing works
Schneider, K. A., & Kästner, S. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00288.2005 · Cited by 149 · see citing works
Oikawa, H., Sasaki, M., Tamakawa, Y., Ehara, S., & Tohyama, K. (2002) · PubMed Central · Cited by 149 · see citing works
Schott, B. H., Sellner, D., Lauer, C., Habib, R., Frey, J. U., Guderian, S., Heinze, H., & Düzel, E. (2004) · Learning & Memory · doi:10.1101/lm.75004 · Cited by 130 · see citing works
Duvernoy, H. M. (1995) · Medical Entomology and Zoology · Cited by 108 · see citing works
Learning-Related Human Brain Activations Reflecting Individual Finances
Tobler, P. N., Fletcher, P. C., Bullmore, E. T., & Schultz, W. (2007) · Neuron · doi:10.1016/j.neuron.2007.03.004 · Cited by 85 · see citing works
Mesolimbic novelty processing in older adults.
Bunzeck, N., Schütze, H., Stallforth, S., Kaufmann, J., Düzel, S., Heinze, H., & Düzel, E. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm020 · Cited by 79 · see citing works
Automated Brainstem Co-registration (ABC) for MRI
Napadow, V., Dhond, R. P., Kennedy, D. N., Hui, K. K. S., & Makris, N. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.05.050 · Cited by 76 · see citing works
Anatomy of the brain stem and cerebellum surfaces
Duvernoy, H. M. (1995) · Springer eBooks · doi:10.1007/978-3-7091-3078-0_3 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718 · see citing works
An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381 · see citing works
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126 · see citing works
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166 · see citing works
The Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928 · see citing works
Associative learning of social value
Behrens, T. E. J., Hunt, L. T., Woolrich, M. W., & Rushworth, M. F. S. (2008) · Nature · doi:10.1038/nature07538 · Cited by 925 · see citing works
Liu, X., Hairston, J., Schrier, M., & Fan, J. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.12.012 · Cited by 916 · see citing works
Reward and aversion in a heterogeneous midbrain dopamine system
Lammel, S., Lim, B. K., & Malenka, R. C. (2014) · Neuropharmacology · doi:10.1016/j.neuropharm.2013.03.019 · Cited by 804 · see citing works
Sescousse, G., Caldú, X., Segura, B., & Dreher, J.-C. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.002 · Cited by 782 · see citing works
Stice, E., Spoor, S., Bohon, C., & Small, D. M. (2008) · Science · doi:10.1126/science.1161550 · Cited by 786 · see citing works
Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli
Lammel, S., Ion, D. I., Roeper, J., & Malenka, R. C. (2011) · Neuron · doi:10.1016/j.neuron.2011.03.025 · Cited by 766 · see citing works
Active inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731 · see citing works
The neurobiology of rewards and values in social decision making
Ruff, C. C., & Fehr, E. (2014) · Nature reviews. Neuroscience · doi:10.1038/nrn3776 · Cited by 716 · see citing works
Effort-Based Cost–Benefit Valuation and the Human Brain
Croxson, P. L., Walton, M. E., O'Reilly, J. X., Behrens, T. E. J., & Rushworth, M. F. S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4515-08.2009 · Cited by 560 · see citing works
Disclosing information about the self is intrinsically rewarding
Tamir, D. I., & Mitchell, J. P. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1202129109 · Cited by 563 · see citing works
How prediction errors shape perception, attention, and motivation
den Ouden, H. E. M., Kok, P., & de Lange, F. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00548 · Cited by 512 · see citing works
What the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531 · see citing works
Learning, reward, and decision making
O'Doherty, J. P., Cockburn, J., & Pauli, W. M. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044216 · Cited by 475 · see citing works
Schott, B. H., Minuzzi, L., Krebs, R. M., Elmenhorst, D., Lang, M., Winz, O. H., Seidenbecher, C. I., Coenen, H. H., Heinze, H.-J., Zilles, K., et al. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2058-08.2008 · Cited by 496 · see citing works
Gujar, N., Yoo, S.-S., Hu, P., & Walker, M. P. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3220-10.2011 · Cited by 491 · see citing works
Tripp, G., & Wickens, J. R. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2009.07.026 · Cited by 492 · see citing works
Neural Circuitry of Reward Prediction Error
Watabe-Uchida, M., Eshel, N., & Uchida, N. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031109 · Cited by 437 · see citing works
Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis
Huys, Q. J., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-3-12 · Cited by 480 · see citing works
Serotonin and dopamine: unifying affective, activational, and decision functions.
Cools, R., Nakamura, K., & Daw, N. D. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.121 · Cited by 464 · see citing works
A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP
Lisman, J., Grace, A. A., & Duzel, E. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.07.006 · Cited by 465 · see citing works
Neural correlates of long-term intense romantic love
Acevedo, B. P., Aron, A., Fisher, H. E., & Brown, L. L. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq092 · Cited by 441 · see citing works
“, 2008), monetary gains (Delgado et al., 2003; D’Ardenne et al., 2008; Carter et al., 2009), cocaine and alcohol (Heinz et al.”
BackgroundNeural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain
Niv, Y., Edlund, J. A., Dayan, P., & O'Doherty, J. P. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5498-10.2012 · Cited by 356 · see citing works
Gambling near-misses enhance motivation to gamble and recruit win-related brain circuitry
Clark, L., Lawrence, A. J., Astley-Jones, F., & Gray, N. (2009) · Neuron · doi:10.1016/j.neuron.2008.12.031 · Cited by 410 · see citing works
Serotonin in Affective Control
Dayan, P., & Huys, Q. J. M. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135607 · Cited by 381 · see citing works
Hierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning
Iglesias, S., Mathys, C., Brodersen, K. H., Kasper, L., Piccirelli, M., den Ouden, H. E. M., & Stephan, K. E. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.009 · Cited by 342 · see citing works
Neural basis of the undermining effect of monetary reward on intrinsic motivation
Murayama, K., Matsumoto, M., Izuma, K., & Matsumoto, K. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1013305107 · Cited by 365 · see citing works
Luman, M., Tripp, G., & Scheres, A. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.11.021 · Cited by 335 · see citing works
The role of the striatum in aversive learning and aversive prediction errors
Delgado, M. R., Li, J., Schiller, D., & Phelps, E. A. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0161 · Cited by 328 · see citing works
Striatal Prediction Error Modulates Cortical Coupling
den Ouden, H. E. M., Daunizeau, J., Roiser, J., Friston, K. J., & Stephan, K. E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4458-09.2010 · Cited by 304 · see citing works
Anorexia nervosa and obesity are associated with opposite brain reward response
Frank, G. K. W., Reynolds, J. R., Shott, M. E., Jappe, L., Yang, T. T., Tregellas, J. R., & O'Reilly, R. C. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2012.51 · Cited by 311 · see citing works
Younger, J., Aron, A., Parke, S., Chatterjee, N., & Mackey, S. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013309 · Cited by 314 · see citing works
A unique adolescent response to reward prediction errors
Cohen, J. R., Asarnow, R. F., Sabb, F. W., Bilder, R. M., Bookheimer, S. Y., Knowlton, B. J., & Poldrack, R. A. (2010) · Nature Neuroscience · doi:10.1038/nn.2558 · Cited by 285 · see citing works
Self-citationEmbedding reward signals into perception and cognition
Pessoa, L. (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00017 · Cited by 279 · see citing works
Action versus valence in decision making
Guitart-Masip, M., Duzel, E., Dolan, R., & Dayan, P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.003 · Cited by 270 · see citing works
Telzer, E. H. (2016) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2015.10.010 · Cited by 274 · see citing works
Testing the Reward Prediction Error Hypothesis with an Axiomatic Model
Rutledge, R. B., Dean, M., Caplin, A., & Glimcher, P. W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1747-10.2010 · Cited by 244 · see citing works
Hu, H. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-014106 · Cited by 253 · see citing works
The social brain and reward: Social information processing in the human striatum
Bhanji, J. P., & Delgado, M. R. (2014) · WIREs Cognitive Science · doi:10.1002/wcs.1266 · Cited by 256 · see citing works
Deserno, L., Huys, Q. J. M., Boehme, R., Buchert, R., Heinze, H.-J., Grace, A. A., Dolan, R. J., Heinz, A., & Schlagenhauf, F. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1417219112 · Cited by 233 · see citing works
Functional imaging of the human dopaminergic midbrain
Düzel, E., Bunzeck, N., Guitart-Masip, M., Wittmann, B., Schott, B. H., & Tobler, P. N. (2009) · Trends in Neurosciences · doi:10.1016/j.tins.2009.02.005 · Cited by 216 · see citing works
Impaired reward prediction error encoding and striatal-midbrain connectivity in depression
Kumar, P., Goer, F., Murray, L., Dillon, D. G., Beltzer, M. L., Cohen, A. L., Brooks, N. H., & Pizzagalli, D. A. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0032-x · Cited by 219 · see citing works
Glutamatergic model psychoses: prediction error, learning, and inference
Corlett, P. R., Honey, G. D., Krystal, J. H., & Fletcher, P. C. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.163 · Cited by 229 · see citing works
Overlapping neural systems represent cognitive effort and reward anticipation
Vassena, E., Silvetti, M., Boehler, C. N., Achten, E., Fias, W., & Verguts, T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0091008 · Cited by 200 · see citing works
Planning and navigation as active inference
Kaplan, R., & Friston, K. J. (2018) · Biological Cybernetics · doi:10.1007/s00422-018-0753-2 · Cited by 203 · see citing works
Guitart-Masip, M., Fuentemilla, L., Bach, D. R., Huys, Q. J. M., Dayan, P., Dolan, R. J., & Duzel, E. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6376-10.2011 · Cited by 216 · see citing works
Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176 · see citing works
Prediction error associated with the perceptual segmentation of naturalistic events
Zacks, J. M., Kurby, C. A., Eisenberg, M. L., & Haroutunian, N. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00078 · Cited by 202 · see citing works
Computational substrates of norms and their violations during social exchange
Xiang, T., Lohrenz, T., & Montague, P. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.1642-12.2013 · Cited by 197 · see citing works
Behavioral and Neural Properties of Social Reinforcement Learning
Jones, R. M., Somerville, L. H., Li, J., Ruberry, E. J., Libby, V., Glover, G., Voss, H. U., Ballon, D. J., & Casey, B. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.2972-11.2011 · Cited by 191 · see citing works
Nicotine Dependence Is Characterized by Disordered Reward Processing in a Network Driving Motivation
Bühler, M., Vollstädt-Klein, S., Kobiella, A., Budde, H., Reed, L. J., Braus, D. F., Büchel, C., & Smolka, M. N. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.10.029 · Cited by 185 · see citing works
Neural Components Underlying Behavioral Flexibility in Human Reversal Learning
Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., & Poldrack, R. A. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp247 · Cited by 180 · see citing works
Waltz, J. A., Schweitzer, J. B., Gold, J. M., Kurup, P. K., Ross, T. J., Jo Salmeron, B., Rose, E. J., McClure, S. M., & Stein, E. A. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2008.214 · Cited by 186 · see citing works
Self-citationTranslational perspectives for computational neuroimaging
Stephan, K. E., Iglesias, S., Heinzle, J., & Diaconescu, A. O. (2015) · Neuron · doi:10.1016/j.neuron.2015.07.008 · Cited by 169 · see citing works
Phasic dopamine release in appetitive behaviors and drug addiction
Wanat, M., Willuhn, I., Clark, J., & Phillips, P. (2009) · Current Drug Abuse Reviewse · doi:10.2174/1874473710902020195 · Cited by 177 · see citing works
Dopamine neurons encoding long-term memory of object value for habitual behavior
Kim, H. F., Ghazizadeh, A., & Hikosaka, O. (2015) · Cell · doi:10.1016/j.cell.2015.10.063 · Cited by 157 · see citing works
Luciana, M., Wahlstrom, D., Porter, J. N., & Collins, P. F. (2012) · Developmental Psychology · doi:10.1037/a0027432 · Cited by 156 · see citing works
Tomasi, D., Volkow, N. D., Wang, R., Telang, F., Wang, G.-J., Chang, L., Ernst, T., & Fowler, J. S. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006102 · Cited by 154 · see citing works
Disambiguating ventral striatum fMRI-related bold signal during reward prediction in schizophrenia
Morris, R. W., Vercammen, A., Lenroot, R., Moore, L., Langton, J. M., Short, B., Kulkarni, J., Curtis, J., O'Donnell, M., Weickert, C. S., et al. (2012) · Molecular Psychiatry · doi:10.1038/mp.2011.75 · Cited by 149 · see citing works
Can Bayesian Theories of Autism Spectrum Disorder Help Improve Clinical Practice?
Haker, H., Schneebeli, M., & Stephan, K. E. (2016) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2016.00107 · Cited by 130 · see citing works
Oxytocin Modulates Neural Reactivity to Children's Faces as a Function of Social Salience
Wittfoth-Schardt, D., Gründing, J., Wittfoth, M., Lanfermann, H., Heinrichs, M., Domes, G., Buchheim, A., Gündel, H., & Waller, C. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2012.47 · Cited by 139 · see citing works
Krebs, R. M., Heipertz, D., Schuetze, H., & Duzel, E. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.06.038 · Cited by 135 · see citing works
Qin (2011) · doi:10.1016/j.neuroimage.2011.05.006 · Cited by 124 · see citing works
Dopamine, reward learning, and active inference
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00136 · Cited by 112 · see citing works
Computational and dynamic models in neuroimaging
Friston, K. J., & Dolan, R. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.068 · Cited by 131 · see citing works
Krebs, R. M., Schott, B. H., & Düzel, E. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.08.019 · Cited by 129 · see citing works
Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game
Seo, H., Barraclough, D. J., & Lee, D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1479-09.2009 · Cited by 125 · see citing works
Social rewards and social networks in the human brain
Fareri, D. S., & Delgado, M. R. (2014) · The Neuroscientist · doi:10.1177/1073858414521869 · Cited by 124 · see citing works
Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
Metereau, E., & Dreher, J.-C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs037 · Cited by 114 · see citing works
Dopamine Modulates Adaptive Prediction Error Coding in the Human Midbrain and Striatum
Diederen, K. M. J., Ziauddeen, H., Vestergaard, M. D., Spencer, T., Schultz, W., & Fletcher, P. C. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.1979-16.2016 · Cited by 110 · see citing works
Unpredictable saccharin reinforcement enhances locomotor responding to amphetamine
Singer, B. F., Scott-Railton, J., & Vezina, P. (2012) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.09.003 · Cited by 117 · see citing works
Kuepper, R., Morrison, P. D., van Os, J., Murray, R. M., Kenis, G., & Henquet, C. (2010) · Schizophrenia Research · doi:10.1016/j.schres.2010.05.031 · Cited by 116 · see citing works
Haarsma, J., Fletcher, P. C., Griffin, J. D., Taverne, H. J., Ziauddeen, H., Spencer, T. J., Miller, C., Katthagen, T., Goodyer, I., Diederen, K. M. J., et al. (2021) · Molecular Psychiatry · doi:10.1038/s41380-020-0803-8 · Cited by 108 · see citing works
Using fMRI to study reward processing in humans: past, present, and future
Wang, K. S., Smith, D. V., & Delgado, M. R. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00333.2015 · Cited by 105 · see citing works
Asaad, W. F., & Eskandar, E. N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3793-11.2011 · Cited by 105 · see citing works
Contextual novelty changes reward representations in the striatum
Guitart-Masip, M., Bunzeck, N., Stephan, K. E., Dolan, R. J., & Düzel, E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5331-09.2010 · Cited by 104 · see citing works
Diederen, K. M. J., Spencer, T., Vestergaard, M. D., Fletcher, P. C., & Schultz, W. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.019 · Cited by 102 · see citing works
Progress in understanding mood disorders: optogenetic dissection of neural circuits
Lammel, S., Tye, K. M., & Warden, M. R. (2014) · Genes, Brain and Behavior · doi:10.1111/gbb.12049 · Cited by 98 · see citing works
Aversive stimuli and loss in the mesocorticolimbic dopamine system
Brooks, A. M., & Berns, G. S. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.04.001 · Cited by 85 · see citing works
Bernacer, J., Corlett, P. R., Ramachandra, P., McFarlane, B., Turner, D. C., Clark, L., Robbins, T. W., Fletcher, P. C., & Murray, G. K. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2013.12070978 · Cited by 77 · see citing works
Faulconbridge, L. F., Ruparel, K., Loughead, J., Allison, K. C., Hesson, L. A., Fabricatore, A. N., Rochette, A., Ritter, S., Hopson, R. D., Sarwer, D. B., et al. (2016) · Obesity · doi:10.1002/oby.21464 · Cited by 78 · see citing works
Dissociable reward and timing signals in human midbrain and ventral striatum
Klein-Flügge, M. C., Hunt, L. T., Bach, D. R., Dolan, R. J., & Behrens, T. E. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.08.024 · Cited by 75 · see citing works
Impaired reward-related learning signals in remitted unmedicated patients with recurrent depression
Geugies, H., Mocking, R. J. T., Figueroa, C. A., Groot, P. F. C., Marsman, J.-B. C., Servaas, M. N., Steele, J. D., Schene, A. H., & Ruhé, H. G. (2019) · Brain · doi:10.1093/brain/awz167 · Cited by 67 · see citing works
Cholinergic modulation of dopamine pathways through nicotinic acetylcholine receptors
de Kloet, S. F., Mansvelder, H. D., & De Vries, T. J. (2015) · Biochemical Pharmacology · doi:10.1016/j.bcp.2015.07.014 · Cited by 69 · see citing works
Isolating the delay component of impulsive choice in adolescent rats
McClure, J., Podos, J., & Richardson, H. N. (2014) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2014.00003 · Cited by 62 · see citing works
Smoking-related cue-induced brain activation in adolescent light smokers
Rubinstein, M. L., Luks, T. L., Moscicki, A.-B., Dryden, W., Rait, M. A., & Simpson, G. V. (2011) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2010.09.016 · Cited by 62 · see citing works
Fouragnan, E., Queirazza, F., Retzler, C., Mullinger, K. J., & Philiastides, M. G. (2017) · Scientific Reports · doi:10.1038/s41598-017-04507-w · Cited by 61 · see citing works
Parr, A. C., Calabro, F., Larsen, B., Tervo-Clemmens, B., Elliot, S., Foran, W., Olafsson, V., & Luna, B. (2021) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2021.101997 · Cited by 60 · see citing works
Modulation of corticospinal excitability by reward depends on task framing
Mooshagian, E., Keisler, A., Zimmermann, T., Schweickert, J. M., & Wassermann, E. M. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.12.021 · Cited by 24 · see citing works
Midbrain fMRI: Applications, Limitations and Challenges
Düzel, E., Guitart-Masip, M., Maass, A., Hämmerer, D., Betts, M. J., Speck, O., Weiskopf, N., & Kanowski, M. (2015) · Biological Magnetic Resonance · doi:10.1007/978-1-4899-7591-1_20 · Cited by 16 · see citing works
Neural activations associated with feedback and retrieval success.
Wiklund-Hörnqvist, C., Andersson, M., Jonsson, B., & Nyberg, L. (2017) · npj Science of Learning · doi:10.1038/s41539-017-0013-6 · Cited by 10 · see citing works
- Authors
- D'Ardenne, K., McClure, S. M., Nystrom, L. E., & Cohen, J. D.
- Affiliations
- Department of Chemistry, Princeton University, Princeton, NJ 08544, USA.
- University of Pittsburgh (US)
- ORCID
- Cohen, Jonathan D.
- Venue
- Science
- Published
- 2008-02-29
- Volume
- 319
- Issue
- 5867
- Pages
- 1264-1267
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W1994728257
- Cited by
- 661
- References
- 42
- Citations by year
- 2026: 12 · 2025: 25 · 2024: 19 · 2023: 21 · 2022: 19 · 2021: 26 · 2020: 32 · 2019: 36 · 2018: 36 · 2017: 33 · 2016: 53 · 2015: 49 · 2014: 43 · 2013: 46 · 2012: 54
- FWCI
- 22.35
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (F32MH072141, P50MH062196, T32MH065214)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Keywords
- ventral tegmental area, dopamine, reward prediction error, BOLD signal, brainstem, ventral striatum, monetary rewards, winning probability, dopaminergic signaling
- MeSH terms
- Adolescent, Adult, Basal Ganglia, Conditioning, Classical, Cues, Dopamine, Female, Humans, Magnetic Resonance Imaging, Male, Mental Processes, Oxygen, Probability, Reinforcement, Psychology, Reward, Ventral Tegmental Area
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
