The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
Open accessAbstract
Functional MRI experiments in human subjects strongly suggest that the striatum participates in processing information about the predictability of rewarding stimuli. However, stimuli can be unpredictable in character (what stimulus arrives next), unpredictable in time (when the stimulus arrives), and unpredictable in amount (how much arrives). These variables have not been dissociated in previous imaging work in humans, thus conflating possible interpretations of the kinds of expectation errors driving the measured brain responses. Using a passive conditioning task and fMRI in human subjects, we show that positive and negative prediction errors in reward delivery time correlate with BOLD changes in human striatum, with the strongest activation lateralized to the left putamen. For the negative prediction error, the brain response was elicited by expectations only and not by stimuli presented directly; that is, we measured the brain response to nothing delivered (juice expected but not delivered) contrasted with nothing delivered (nothing expected).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Research suggests that to make this choice, the brain uses representations of reward-expectancy and effort/risk requirement from prior experiences to optimize cost/benefit”
From Food reward, hyperphagia, and obesity (2011) · cites this paper as [111]
In the citing paper
“This is consistent with many previous accounts (McClure et al., 2003; O’Doherty et al., 2003; Seymour et al., 2004).”
From States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning (2010) · cites this paper as McClure et al., 2003
In the citing paper
“These changes in striatum BOLD activity coincide with the process of learning how to predict rewards 15, 16 – an observation supported by electrophysiological properties of its dopaminergic afferents.”
From The social brain and reward: Social information processing in the human striatum (2014) · cites this paper as [16]
In the citing paper
“and that this region may not be selective for the learning and prediction of rewarding outcomes (McClure et al., 2003; O’Doherty et al., 2004; 2003).”
From Neural correlates of social exclusion across ages: A coordinate-based meta-analysis of functional MRI studies (2017) · cites this paper as McClure et al., 2003
Citations
Cites
AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages
Cox, R. W. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0014 · Cited by 10,913
Statistical parametric maps in functional imaging: A general linear approach
Friston, K. J., Holmes, A. P., Worsley, K. J., Poline, J. ‐., Frith, C. D., & Frackowiak, R. S. J. (1994) · Human Brain Mapping · doi:10.1002/hbm.460020402 · Cited by 9,688
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Self-citationPredictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Analysis of fMRI Time-Series Revisited
Friston, K. J., Holmes, A. P., Poline, J., Grasby, P. M., Williams, S., Frackowiak, R. S. J., & Turner, R. (1995) · NeuroImage · doi:10.1006/nimg.1995.1007 · Cited by 2,504
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Self-citationAbstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
Wise, R. A., & Rompre, P.-P. (1989) · Annual Review of Psychology · doi:10.1146/annurev.ps.40.020189.001203 · Cited by 1,968
Cited by
Sorted by citations
Items 101–150 of 150
Is internet pornography causing sexual dysfunctions? A review with clinical reports
Park, B., Wilson, G., Berger, J., Christman, M., Reina, B., Bishop, F., Klam, W., & Doan, A. (2016) · Behavioral Sciences · doi:10.3390/bs6030017 · Cited by 187
Waltz, J. A., Schweitzer, J. B., Gold, J. M., Kurup, P. K., Ross, T. J., Jo Salmeron, B., Rose, E. J., McClure, S. M., & Stein, E. A. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2008.214 · Cited by 186
Self-citationKim, H., Shimojo, S., & O'Doherty, J. P. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq145 · Cited by 176
Corlett, P. R., Honey, G. D., Aitken, M. R. F., Dickinson, A., Shanks, D. R., Absalom, A. R., Lee, M., Pomarol-Clotet, E., Murray, G. K., McKenna, P. J., et al. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.6.611 · Cited by 182
Neural coding of distinct statistical properties of reward information in humans
Dreher, J.-C., Kohn, P., & Berman, K. F. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj004 · Cited by 180
Vijayakumar, N., Cheng, T. W., & Pfeifer, J. H. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.02.050 · Cited by 161
“Our results may therefore suggest that adolescent hyper-reactivity of VS is not limited to reward processing, and that this region may not be selective for the learning and prediction of rewarding outcomes (McClure et al., 2003; O'Doherty et al., 2004; 2003).”
BackgroundDistorted expectancy coding in problem gambling: is the addictive in the anticipation?
van Holst, R. J., Veltman, D. J., Büchel, C., van den Brink, W., & Goudriaan, A. E. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.12.030 · Cited by 155
Striatal sensitivity to reward deliveries and omissions in substance dependent patients
Bjork, J. M., Smith, A. R., & Hommer, D. W. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.06.035 · Cited by 154
Disambiguating ventral striatum fMRI-related bold signal during reward prediction in schizophrenia
Morris, R. W., Vercammen, A., Lenroot, R., Moore, L., Langton, J. M., Short, B., Kulkarni, J., Curtis, J., O'Donnell, M., Weickert, C. S., et al. (2012) · Molecular Psychiatry · doi:10.1038/mp.2011.75 · Cited by 149
Reputation for reciprocity engages the brain reward center
Phan, K. L., Sripada, C. S., Angstadt, M., & McCabe, K. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1008137107 · Cited by 152
Early adversity and learning: implications for typical and atypical behavioral development
Hanson, J. L., van den Bos, W., Roeber, B. J., Rudolph, K. D., Davidson, R. J., & Pollak, S. D. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12694 · Cited by 136
Reward-related processing in the human brain: developmental considerations
Fareri, D. S., Martin, L. N., & Delgado, M. R. (2008) · Development and Psychopathology · doi:10.1017/s0954579408000576 · Cited by 141
Neural systems underlying aversive conditioning in humans with primary and secondary reinforcers
Delgado, M. R., Jou, R. L., & Phelps, E. A. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00071 · Cited by 141
Adding prediction risk to the theory of reward learning
PREUSCHOFF, K., & BOSSAERTS, P. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.005 · Cited by 133
Chib, V. S., De Martino, B., Shimojo, S., & O'Doherty, J. P. (2012) · Neuron · doi:10.1016/j.neuron.2012.02.038 · Cited by 130
Zhu, L., Mathewson, K. E., & Hsu, M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1116783109 · Cited by 125
Reputational Priors Magnify Striatal Responses to Violations of Trust
Fouragnan, E., Chierchia, G., Greiner, S., Neveu, R., Avesani, P., & Coricelli, G. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3086-12.2013 · Cited by 128
Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game
Seo, H., Barraclough, D. J., & Lee, D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1479-09.2009 · Cited by 125
Generalization of value in reinforcement learning by humans
Wimmer, G. E., Daw, N. D., & Shohamy, D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08017.x · Cited by 111
Gershman, S. J., Pesaran, B., & Daw, N. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2469-09.2009 · Cited by 118
Ventral–striatal/nucleus–accumbens sensitivity to prediction errors during classification learning
Rodriguez, P. F., Aron, A. R., & Poldrack, R. A. (2006) · Human Brain Mapping · doi:10.1002/hbm.20186 · Cited by 122
Midbrain activation during pavlovian conditioning and delusional symptoms in schizophrenia
Romaniuk, L., Honey, G. D., King, J. R. L., Whalley, H. C., McIntosh, A. M., Levita, L., Hughes, M., Johnstone, E. C., Day, M., Lawrie, S. M., et al. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.169 · Cited by 113
Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
Metereau, E., & Dreher, J.-C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs037 · Cited by 114
Enhanced striatal sensitivity to aversive reinforcement in adolescents versus adults
Galván, A., & McGlennen, K. M. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00326 · Cited by 111
Social rewards: From basic social building blocks to complex social behavior
Tamir, D. I., & Hughes, B. L. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691618776263 · Cited by 109
Model-based approaches to neuroimaging: combining reinforcement learning theory with fMRI data
Gläscher, J. P., & O'Doherty, J. P. (2010) · WIREs Cognitive Science · doi:10.1002/wcs.57 · Cited by 104
Adaptive coding of action values in the human rostral cingulate zone
Jocham, G., Neumann, J., Klein, T. A., Danielmeier, C., & Ullsperger, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0349-09.2009 · Cited by 106
Using fMRI to study reward processing in humans: past, present, and future
Wang, K. S., Smith, D. V., & Delgado, M. R. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00333.2015 · Cited by 105
Asaad, W. F., & Eskandar, E. N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3793-11.2011 · Cited by 105
Koch, K., Schachtzabel, C., Wagner, G., Schikora, J., Schultz, C., Reichenbach, J. R., Sauer, H., & Schlösser, R. G. M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.031 · Cited by 101
Cooper, J. C., Dunne, S., Furey, T., & O'Doherty, J. P. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00114 · Cited by 101
Short-Term Temporal Discounting of Reward Value in Human Ventral Striatum
Gregorios-Pippas, L., Tobler, P. N., & Schultz, W. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90730.2008 · Cited by 101
Experiential reward learning outweighs instruction prior to adulthood
Decker, J. H., Lourenco, F. S., Doll, B. B., & Hartley, C. A. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0332-5 · Cited by 96
Turner, D. C. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh046 · Cited by 94
Neural correlates of risk prediction error during reinforcement learning in humans
d'Acremont, M., Lu, Z.-L., Li, X., Van der Linden, M., & Bechara, A. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.04.096 · Cited by 94
Aversive stimuli and loss in the mesocorticolimbic dopamine system
Brooks, A. M., & Berns, G. S. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.04.001 · Cited by 85
Self-citationMind matters: placebo enhances reward learning in Parkinson's disease
Schmidt, L., Braun, E. K., Wager, T. D., & Shohamy, D. (2014) · Nature Neuroscience · doi:10.1038/nn.3842 · Cited by 84
Early development of subcortical regions involved in non-cued attention switching
Casey, B. J., Davidson, M. C., Hara, Y., Thomas, K. M., Martinez, A., Galvan, A., Halperin, J. M., Rodríguez‐Aranda, C. E., & Tottenham, N. (2004) · Developmental Science · doi:10.1111/j.1467-7687.2004.00377.x · Cited by 80
Watanabe, N., Sakagami, M., & Haruno, M. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3400-12.2013 · Cited by 65
Reward-based spatial learning in unmedicated adults with obsessive-compulsive disorder
Marsh, R., Tau, G. Z., Wang, Z., Huo, Y., Liu, G., Hao, X., Packard, M. G., Peterson, B. S., & Simpson, H. B. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.13121700 · Cited by 53
Galea, J. M., Bestmann, S., Beigi, M., Jahanshahi, M., & Rothwell, J. C. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3621-11.2012 · Cited by 52
Cooper, J. C., Dunne, S., Furey, T., & O'Doherty, J. P. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.2558-12.2012 · Cited by 45
A selective emotional decision-making bias elicited by facial expressions
Furl, N., Gallagher, S., & Averbeck, B. B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033461 · Cited by 36
Sethi, A., Voon, V., Critchley, H. D., Cercignani, M., & Harrison, N. A. (2018) · Brain · doi:10.1093/brain/awy048 · Cited by 36
Psychomotor Changes in Major Depressive Disorder during Sertraline Treatment
Schrijvers, D., Maas, Y. J., Pier, M. P. B. I., Madani, Y., Hulstijn, W., & Sabbe, B. G. C. (2009) · Neuropsychobiology · doi:10.1159/000205516 · Cited by 36
Lecei, A., van Hulst, B. M., de Zeeuw, P., van der Pluijm, M., Rijks, Y., & Durston, S. (2019) · NeuroImage: Clinical · doi:10.1016/j.nicl.2018.11.011 · Cited by 27
Surprise beyond prediction error
Chumbley, J. R., Burke, C. J., Stephan, K. E., Friston, K. J., Tobler, P. N., & Fehr, E. (2014) · Human Brain Mapping · doi:10.1002/hbm.22513 · Cited by 23
Short-term mindfulness practice attenuates reward prediction errors signals in the brain
Kirk, U., Pagnoni, G., Hétu, S., & Montague, R. (2019) · Scientific Reports · doi:10.1038/s41598-019-43474-2 · Cited by 23
Macoveanu, J., Meluken, I., Chase, H. W., Phillips, M. L., Kessing, L. V., Siebner, H. R., Vinberg, M., & Miskowiak, K. W. (2021) · Psychological Medicine · doi:10.1017/s0033291720000367 · Cited by 12
State-dependent value representation: evidence from the striatum
Burke, C. J., Dreher, J.-C., Seymour, B., & Tobler, P. N. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00193 · Cited by 4
Metadata
- Authors
- McClure, S. M., Berns, G. S., & Montague, P. R.
- Affiliations
- Baylor College of Medicine (US)
- Emory University (US)
- Corresponding author
- Montague, P.Read
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2003-04
- Volume
- 38
- Issue
- 2
- Pages
- 339-346
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2157088567
- Cited by
- 917
- References
- 32
- Citations by year
- 2026: 11 · 2025: 15 · 2024: 18 · 2023: 23 · 2022: 23 · 2021: 32 · 2020: 18 · 2019: 28 · 2018: 31 · 2017: 36 · 2016: 47 · 2015: 39 · 2014: 50 · 2013: 52 · 2012: 77
- FWCI
- 16.00
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- National Institutes of Health (5r01mh061010-02)
- National Institute of Mental Health (R01 MH61010, R01MH52797, R01MH052797)
- National Institute on Drug Abuse (K08 DA00367, K08DA000367, R01-DA11723, R01DA011723)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- prediction error, striatum, putamen, reward anticipation, temporal prediction, expectation errors, BOLD signal
- MeSH terms
- Adult, Conditioning, Classical, Corpus Striatum, Cues, Female, Humans, Learning, Magnetic Resonance Imaging, Male, Nucleus Accumbens, Photic Stimulation, Reaction Time, Reference Values, Regression Analysis, Taste, Time Factors, Time Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
