Predictability modulates human brain response to reward
Open accessAbstract
Certain classes of stimuli, such as food and drugs, are highly effective in activating reward regions. We show in humans that activity in these regions can be modulated by the predictability of the sequenced delivery of two mildly pleasurable stimuli, orally delivered fruit juice and water. Using functional magnetic resonance imaging, the activity for rewarding stimuli in both the nucleus accumbens and medial orbitofrontal cortex was greatest when the stimuli were unpredictable. Moreover, the subjects' stated preference for either juice or water was not directly correlated with activity in reward regions but instead was correlated with activity in sensorimotor cortex. For pleasurable stimuli, these findings suggest that predictability modulates the response of human reward regions, and subjective preference can be dissociated from this response.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Many early fMRI studies into prediction errors used model-free accounts in Pavlovian paradigms and located prediction errors in striatal BOLD.
“Many early fMRI studies into prediction errors used model-free accounts in Pavlovian paradigms and located prediction errors in striatal BOLD (Berns et al., 2001; O’Doherty, 2004; O’Doherty et al., 2003; Haruno et al., 2004).”
From Goals and Habits in the Brain (2013) · cites this paper as Berns et al., 2001
The orbital frontal cortex has been implicated in prior studies of prediction error learning.
“As the OFC has been implicated in prior studies of prediction error learning (Berns et al., 2001; Takahashi et al., 2009), we selected this region as an a priori structure in which to search for learning signals.”
From Behavioral and Neural Properties of Social Reinforcement Learning (2011) · cites this paper as Berns et al., 2001
The ventral striatum and orbital frontal cortex are implicated in prediction error signaling.
“Non-human primate and human imaging studies have implicated the ventral striatum and orbital frontal cortex (OFC) in prediction error signaling (Schultz et al., 1997; Berns et al., 2001; Fiorillo et al., 2003; McClure et al., 2003).”
From Behavioral and Neural Properties of Social Reinforcement Learning (2011) · cites this paper as Berns et al., 2001
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Co-Planar Stereotaxic Atlas of the Human Brain
Talairach, J., & Tournoux, P. (1988) · Medical Entomology and Zoology · Cited by 11,798 · see citing works
Statistical parametric maps in functional imaging: A general linear approach
Friston, K. J., Holmes, A. P., Worsley, K. J., Poline, J. ‐., Frith, C. D., & Frackowiak, R. S. J. (1994) · Human Brain Mapping · doi:10.1002/hbm.460020402 · Cited by 9,688 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Self-citationThe neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346 · see citing works
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation.
Kwong, K. K., Belliveau, J. W., Chesler, D. A., Goldberg, I. E., Weisskoff, R. M., Poncelet, B. P., Kennedy, D. N., Hoppel, B. E., Cohen, M. S., & Turner, R. (1992) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.89.12.5675 · Cited by 4,212 · see citing works
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,061 · see citing works
Ogawa, S., Tank, D. W., Menon, R., Ellermann, J. M., Kim, S. G., Merkle, H., & Ugurbil, K. (1992) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.89.13.5951 · Cited by 3,681 · see citing works
Drugs of abuse: anatomy, pharmacology and function of reward pathways
Koob, G. F. (1992) · Trends in Pharmacological Sciences · doi:10.1016/0165-6147(92)90060-j · Cited by 2,070 · see citing works
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
Self-citationThe Biochemical Basis of Neuropharmacology.
(1974) · Annals of Internal Medicine · doi:10.7326/0003-4819-81-4-575_2 · Cited by 1,882 · see citing works
Principles of Behavior. An Introduction to Behavior Theory
N., E., & Hull, C. L. (1943) · The Journal of Philosophy · doi:10.2307/2019960 · Cited by 1,731 · see citing works
The Orbitofrontal Cortex and Reward
Rolls, E. T. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.284 · Cited by 1,595 · see citing works
Context, cortex, and dopamine: A connectionist approach to behavior and biology in schizophrenia.
Cohen, J. D., & Servan‐Schreiber, D. (1992) · Psychological Review · doi:10.1037/0033-295x.99.1.45 · Cited by 1,494 · see citing works
FMRI visualization of brain activity during a monetary incentive delay task
Knutson, B., Westdorp, A., Kaiser, E., & Hommer, D. (2000) · NeuroImage · doi:10.1006/nimg.2000.0593 · Cited by 1,414 · see citing works
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · see citing works
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291 · see citing works
Evidence for striatal dopamine release during a video game
Koepp, M. J., Gunn, R. N., Lawrence, A. D., Cunningham, V. J., Dagher, A., Jones, T., Brooks, D. J., Bench, C. J., & Grasby, P. M. (1998) · Nature · doi:10.1038/30498 · Cited by 1,279 · see citing works
Acute effects of cocaine on human brain activity and emotion
Breiter, H. C., Gollub, R. L., Weisskoff, R. M., Kennedy, D. N., Makris, N., Berke, J. D., Goodman, J. M., Kantor, H. L., Gastfriend, D. R., Riorden, J. P., et al. (1997) · Neuron · doi:10.1016/s0896-6273(00)80374-8 · Cited by 1,270 · see citing works
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works
Neurobehavioural mechanisms of reward and motivation
Robbins, T. W., & Everitt, B. J. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80077-8 · Cited by 1,187 · see citing works
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116 · see citing works
Rogers, R. D., Owen, A. M., Middleton, H. C., Williams, E., Pickard, J. D., Sahakian, B. J., & Robbins, T. W. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-20-09029.1999 · Cited by 865 · see citing works
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829 · see citing works
How Many Subjects Constitute a Study?
Friston, K. J., Holmes, A. P., & Worsley, K. J. (1999) · NeuroImage · doi:10.1006/nimg.1999.0439 · Cited by 814 · cited 3× · see citing works
“A random-effects, event-related, statistical analysis was performed with SPM99 (Friston et al., 1995a; Friston et al., 1999).”
MethodInfluentialNeuronal activity in monkey ventral striatum related to the expectation of reward
Schultz, W., Apicella, P., Scarnati, E., & Ljungberg, T. (1992) · Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04595.1992 · Cited by 744 · see citing works
Dissociable Neural Responses in Human Reward Systems
Elliott, R., Friston, K. J., & Dolan, R. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-16-06159.2000 · Cited by 740 · see citing works
Ojemann, J. G., Akbudak, E., Snyder, A. Z., McKinstry, R. C., Raichle, M. E., & Conturo, T. E. (1997) · NeuroImage · doi:10.1006/nimg.1997.0289 · Cited by 699 · see citing works
Characterizing Dynamic Brain Responses with fMRI: A Multivariate Approach
Friston, K. J., Frith, C., Frackowiak, R. S. J., & Turner, R. (1995) · NeuroImage · doi:10.1006/nimg.1995.1019 · Cited by 568 · see citing works
A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
Houk, J. C., Adams, J. L., & Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0020 · Cited by 554 · see citing works
Francis, S., Rolls, E. T., Bowtell, R. W., McGlone, F. P., O’Doherty, J. P., Browning, A., Clare, S., & Smith, E. (1999) · Neuroreport · doi:10.1097/00001756-199902250-00003 · Cited by 421 · see citing works
Cortical activation during human volitional swallowing: an event-related fMRI study
Hamdy, S., Mikulis, D. J., Crawley, A. P., Xue, S., Lau, H. W., Henry, S. C., & Diamant, N. E. (1999) · American Journal of Physiology-Gastrointestinal and Liver Physiology · doi:10.1152/ajpgi.1999.277.1.g219 · Cited by 382 · see citing works
Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation
Garris, P. A., Kilpatrick, M., Bunin, M. A., Michael, D., Walker, Q. D., & Wightman, R. M. (1999) · Nature · doi:10.1038/18019 · Cited by 327 · see citing works
Dopaminergic regulation of cerebral cortical microcirculation
Krimer, L. S., Muly, E., Williams, G. V., & Goldman‐Rakic, P. S. (1998) · Nature Neuroscience · doi:10.1038/1099 · Cited by 327 · see citing works
Bee foraging in uncertain environments using predictive hebbian learning
Montague, P. R., Dayan, P., Person, C., & Sejnowski, T. J. (1995) · Nature · doi:10.1038/377725a0 · Cited by 311 · see citing works
Self-citationCarelli, R. M., Ijames, S. G., & Crumling, A. J. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-11-04255.2000 · Cited by 310 · see citing works
Activation of the human brain by monetary reward
Thut, G., Schultz, W., Roelcke, U., Nienhusmeier, M., Missimer, J. H., Maguire, R. P., & Leenders, K. L. (1997) · Neuroreport · doi:10.1097/00001756-199703240-00033 · Cited by 273 · see citing works
Orbitofrontal cortex is activated during breaches of expectation in tasks of visual attention
Nobre, A. C., Coull, J. T., Frith, C., & Mesulam, M. M. (1999) · Nature Neuroscience · doi:10.1038/4513 · Cited by 249 · see citing works
A Computational Model of How the Basal Ganglia Produce Sequences
Berns, G. S., & B, T. J. S. A. (1998) · Journal of Cognitive Neuroscience · doi:10.1162/089892998563815 · Cited by 231 · see citing works
Self-citationShidara, M., Aigner, T. G., & Richmond, B. J. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-07-02613.1998 · Cited by 205 · see citing works
Corfield, D. R., Murphy, K., Josephs, O., Fink, G. R., Frackowiak, R. S. J., Guz, A., Adams, L., & Turner, R. (1999) · Journal of Applied Physiology · doi:10.1152/jappl.1999.86.5.1468 · Cited by 146 · see citing works
Bradberry, C. W., Barrett-Larimore, R. L., Jatlow, P., & Rubino, S. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-10-03874.2000 · Cited by 137 · see citing works
A parallel network that learns to play backgammon
Tesauro, G., & Sejnowski, T. J. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90017-9 · Cited by 122 · see citing works
Reproducibility of BOLD-based functional MRI obtained at 4 T
Tegeler, C., Strother, S. C., Anderson, J. R., & Kim, S. (1999) · Human Brain Mapping · doi:10.1002/(sici)1097-0193(1999)7:4 · Cited by 121 · see citing works
A theory of pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 108 · see citing works
Conscious and Unconscious Processing of Nonverbal Predictability in Wernicke's Area
Bischoff‐Grethe, A., Proper, S. M., Mao, H. Z., Daniels, K. A., & Berns, G. S. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-05-01975.2000 · Cited by 77 · see citing works
Self-citationLovell-Badge, R. H. (1995) · Nature · doi:10.1038/376725a0 · Cited by 57 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027 · see citing works
The reward circuit: linking primate anatomy and human imaging
Haber, S. N., & Knutson, B. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.129 · Cited by 3,718 · see citing works
The Neural Basis of Addiction: A Pathology of Motivation and Choice
Kalivas, P. W., & Volkow, N. D. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.8.1403 · Cited by 2,757 · see citing works
Goldstein, R. Z., & Volkow, N. D. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.10.1642 · Cited by 2,667 · see citing works
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244 · see citing works
The somatic marker hypothesis: A neural theory of economic decision
Bechara, A., & Damasio, A. R. (2005) · Games and Economic Behavior · doi:10.1016/j.geb.2004.06.010 · Cited by 1,986 · see citing works
Model-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779 · see citing works
KRINGELBACH, M. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.03.006 · Cited by 1,977 · see citing works
Social cognition and the brain: A meta-analysis
Van Overwalle, F. (2009) · Human Brain Mapping · doi:10.1002/hbm.20547 · Cited by 1,792 · see citing works
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · see citing works
A neural basis for social cooperation
Rilling, J. K., Gutman, D. A., Zeh, T. R., Pagnoni, G., Berns, G. S., & Kilts, C. D. (2002) · Neuron · doi:10.1016/s0896-6273(02)00755-9 · Cited by 1,451 · see citing works
Self-citationAffective neuroscience of pleasure: reward in humans and animals
Berridge, K. C., & Kringelbach, M. L. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1099-6 · Cited by 1,254 · see citing works
Pizzagalli, D. A., Holmes, A. J., Dillon, D. G., Goetz, E. L., Birk, J. L., Bogdan, R., Dougherty, D. D., Iosifescu, D. V., Rauch, S. L., & Fava, M. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08081201 · Cited by 1,232 · see citing works
“Liking” and “wanting” food rewards: Brain substrates and roles in eating disorders
Berridge, K. C. (2009) · Physiology & Behavior · doi:10.1016/j.physbeh.2009.02.044 · Cited by 1,147 · see citing works
Dorsal anterior cingulate cortex: A role in reward-based decision making
Bush, G., Vogt, B. A., Holmes, J., Dale, A. M., Greve, D., Jenike, M. A., & Rosen, B. R. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.012470999 · Cited by 1,096 · see citing works
Beautiful Faces Have Variable Reward Value
Aharon, I., Etcoff, N., Ariely, D., Chabris, C. F., O'Connor, E., & Breiter, H. C. (2001) · Neuron · doi:10.1016/s0896-6273(01)00491-3 · Cited by 1,087 · see citing works
Neural responses during anticipation of a primary taste reward
O'Doherty, J. P., Deichmann, R., Critchley, H. D., & Dolan, R. J. (2002) · Neuron · doi:10.1016/s0896-6273(02)00603-7 · Cited by 1,076 · see citing works
Time Discounting for Primary Rewards
McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.4246-06.2007 · Cited by 971 · see citing works
Self-citationDolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977 · see citing works
Reward, Motivation, and Emotion Systems Associated With Early-Stage Intense Romantic Love
Aron, A., Fisher, H., Mashek, D. J., Strong, G., Li, H., & Brown, L. L. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00838.2004 · Cited by 963 · see citing works
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966 · see citing works
Self-citationTemporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917 · see citing works
Self-citationKang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T.-Y., & Camerer, C. F. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02402.x · Cited by 882 · see citing works
Self-citationThe tempted brain eats: Pleasure and desire circuits in obesity and eating disorders
Berridge, K. C., Ho, C.-Y., Richard, J. M., & DiFeliceantonio, A. G. (2010) · Brain Research · doi:10.1016/j.brainres.2010.04.003 · Cited by 873 · see citing works
Processing of Social and Monetary Rewards in the Human Striatum
Izuma, K., Saito, D. N., & Sadato, N. (2008) · Neuron · doi:10.1016/j.neuron.2008.03.020 · Cited by 855 · see citing works
Sescousse, G., Caldú, X., Segura, B., & Dreher, J.-C. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.002 · Cited by 782 · see citing works
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779 · see citing works
Stice, E., Spoor, S., Bohon, C., Veldhuizen, M. G., & Small, D. M. (2008) · Journal of Abnormal Psychology · doi:10.1037/a0013600 · Cited by 779 · see citing works
Winkielman, P., Berridge, K. C., & Wilbarger, J. L. (2005) · Personality and Social Psychology Bulletin · doi:10.1177/0146167204271309 · Cited by 708 · see citing works
Anterior insular cortex and emotional awareness
Gu, X., Hof, P. R., Friston, K. J., & Fan, J. (2013) · Journal of Comparative Neurology · doi:10.1002/cne.23368 · Cited by 712 · see citing works
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692 · see citing works
Ernst, M., Nelson, E. E., Jazbec, S., McClure, E. B., Monk, C. S., Leibenluft, E., Blair, J., & Pine, D. S. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.038 · Cited by 635 · see citing works
Reinforcement Learning Signal Predicts Social Conformity
Klucharev, V., Hytönen, K., Rijpkema, M., Smidts, A., & Fernández, G. (2009) · Neuron · doi:10.1016/j.neuron.2008.11.027 · Cited by 594 · see citing works
Intertemporal choice – toward an integrative framework
Berns, G. S., Laibson, D., & Loewenstein, G. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.08.011 · Cited by 580 · see citing works
Self-citationPostuma, R. B., & Dagher, A. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj088 · Cited by 579 · see citing works
Volkow, N. D., Wang, G.-J., Telang, F., Fowler, J. S., Thanos, P. K., Logan, J., Alexoff, D., Ding, Y.-S., Wong, C., Ma, Y., et al. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.06.002 · Cited by 573 · see citing works
Risky business: the neuroeconomics of decision making under uncertainty
Platt, M. L., & Huettel, S. A. (2008) · Nature Neuroscience · doi:10.1038/nn2062 · Cited by 556 · see citing works
Representations of Pleasant and Painful Touch in the Human Orbitofrontal and Cingulate Cortices
Rolls, E. T. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.3.308 · Cited by 535 · see citing works
Volkow, N. (2002) · Neurobiology of Learning and Memory · doi:10.1006/nlme.2002.4099 · Cited by 514 · see citing works
Us versus them: social identity shapes neural responses to intergroup competition and harm
Cikara, M., Botvinick, M. M., & Fiske, S. T. (2011) · Psychological Science · doi:10.1177/0956797610397667 · Cited by 494 · see citing works
The neural substrates of reward processing in humans: the modern role of FMRI
McClure, S. M., York, M. K., & Montague, P. R. (2004) · The Neuroscientist · doi:10.1177/1073858404263526 · Cited by 480 · see citing works
Self-citationDifferential neural responses evoked by orthonasal versus retronasal odorant perception in humans
Small, D. M., Gerber, J. C., Mak, Y. E., & Hummel, T. (2005) · Neuron · doi:10.1016/j.neuron.2005.07.022 · Cited by 463 · see citing works
Direct Activation of the Ventral Striatum in Anticipation of Aversive Stimuli
Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00724-4 · Cited by 455 · see citing works
Activity in human ventral striatum locked to errors of reward prediction
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002) · Nature Neuroscience · doi:10.1038/nn802 · Cited by 451 · see citing works
Self-citationHedonic Hot Spots in the Brain
Peciña, S., Smith, K. S., & Berridge, K. C. (2006) · The Neuroscientist · doi:10.1177/1073858406293154 · Cited by 441 · see citing works
The neuropsychology of ventral prefrontal cortex: Decision-making and reversal learning
Clark, L., Cools, R., & Robbins, T. W. (2004) · Brain and Cognition · doi:10.1016/s0278-2626(03)00284-7 · Cited by 439 · see citing works
Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations
DELGADO, M. R., LOCKE, H. M., STENGER, V. A., & FIEZ, J. A. (2003) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.3.1.27 · Cited by 431 · see citing works
Gambling near-misses enhance motivation to gamble and recruit win-related brain circuitry
Clark, L., Lawrence, A. J., Astley-Jones, F., & Gray, N. (2009) · Neuron · doi:10.1016/j.neuron.2008.12.031 · Cited by 410 · see citing works
Choice selection and reward anticipation: an fMRI study
Ernst, M., Nelson, E. E., McClure, E. B., Monk, C. S., Munson, S., Eshel, N., Zarahn, E., Leibenluft, E., Zametkin, A., Towbin, K., et al. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.05.011 · Cited by 377 · see citing works
Prediction error as a linear function of reward probability is coded in human nucleus accumbens
Abler, B., Walter, H., Erk, S., Kammerer, H., & Spitzer, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.001 · Cited by 376 · see citing works
Orbitofrontal cortex tracks positive mood in mothers viewing pictures of their newborn infants
Nitschke, J. B., Nelson, E. E., Rusch, B. D., Fox, A. S., Oakes, T. R., & Davidson, R. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.10.005 · Cited by 371 · see citing works
The origins of altruism in offspring care.
Preston, S. D. (2013) · Psychological Bulletin · doi:10.1037/a0031755 · Cited by 368 · see citing works
Social Influence Modulates the Neural Computation of Value
Zaki, J., Schirmer, J., & Mitchell, J. P. (2011) · Psychological Science · doi:10.1177/0956797611411057 · Cited by 359 · see citing works
Baby schema modulates the brain reward system in nulliparous women
Glocker, M. L., Langleben, D. D., Ruparel, K., Loughead, J. W., Valdez, J. N., Griffin, M. D., Sachser, N., & Gur, R. C. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0811620106 · Cited by 365 · see citing works
Social and monetary reward learning engage overlapping neural substrates
Lin, A., Adolphs, R., & Rangel, A. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr006 · Cited by 351 · see citing works
Dissociation of neural networks for anticipation and consumption of monetary and social rewards
Rademacher, L., Krach, S., Kohls, G., Irmak, A., Gründer, G., & Spreckelmeyer, K. N. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.10.089 · Cited by 347 · see citing works
How the Opinion of Others Affects Our Valuation of Objects
Campbell-Meiklejohn, D. K., Bach, D. R., Roepstorff, A., Dolan, R. J., & Frith, C. D. (2010) · Current Biology · doi:10.1016/j.cub.2010.04.055 · Cited by 339 · see citing works
Measuring macroscopic brain connections in vivo
Jbabdi, S., Sotiropoulos, S. N., Haber, S. N., Van Essen, D. C., & Behrens, T. E. (2015) · Nature Neuroscience · doi:10.1038/nn.4134 · Cited by 334 · see citing works
Mapping value based planning and extensively trained choice in the human brain
Wunderlich, K., Dayan, P., & Dolan, R. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3068 · Cited by 310 · see citing works
Functionally dissociable influences on learning rate in a dynamic environment
McGuire, J. T., Nassar, M. R., Gold, J. I., & Kable, J. W. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.013 · Cited by 299 · see citing works
Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Imamizu, H., & Kawato, M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3417-03.2004 · Cited by 300 · see citing works
“Human imaging studies have revealed that the activity in the ventral striatum and putamen (Berns et al., 2001; Breiter et al., 2001; McClure et al., 2003; O'Doherty et al., 2003) is correlated with the reward prediction errors in classical conditioning tasks.”
BackgroundVolkow, N. D., Wang, G.-J., Ma, Y., Fowler, J. S., Wong, C., Ding, Y.-S., Hitzemann, R., Swanson, J. M., & Kalivas, P. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0433-05.2005 · Cited by 304 · see citing works
Overlapping neural systems mediating extinction, reversal and regulation of fear
Schiller, D., & Delgado, M. R. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.04.002 · Cited by 294 · see citing works
Volkow, N. D., Wang, G.-J., Ma, Y., Fowler, J. S., Zhu, W., Maynard, L., Telang, F., Vaska, P., Ding, Y.-S., Wong, C., et al. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-36-11461.2003 · Cited by 302 · see citing works
Taste representation in the human insula
Small, D. M. (2010) · Brain Structure and Function · doi:10.1007/s00429-010-0266-9 · Cited by 300 · see citing works
Activity in human reward-sensitive brain areas is strongly context dependent
Nieuwenhuis, S., Heslenfeld, D. J., Alting von Geusau, N. J., Mars, R. B., Holroyd, C. B., & Yeung, N. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.043 · Cited by 289 · see citing works
Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation
Roesch, M. R., Taylor, A. R., & Schoenbaum, G. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.027 · Cited by 297 · see citing works
Embedding reward signals into perception and cognition
Pessoa, L. (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00017 · Cited by 279 · see citing works
Opposing BOLD responses to reciprocated and unreciprocated altruism in putative reward pathways
Rilling, J. K., Sanfey, A. G., Aronson, J. A., Nystrom, L. E., & Cohen, J. D. (2004) · NeuroReport · doi:10.1097/00001756-200411150-00022 · Cited by 281 · see citing works
Striatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277 · see citing works
Processing of the incentive for social approval in the ventral striatum during charitable donation
Izuma, K., Saito, D. N., & Sadato, N. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21228 · Cited by 276 · see citing works
Gilman, J. M., Ramchandani, V. A., Davis, M. B., Bjork, J. M., & Hommer, D. W. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.0086-08.2008 · Cited by 267 · see citing works
“A variety of primary rewards activate this circuit, including fruit juice and water (Berns et al., 2001; O’Doherty et al., 2002; Pagnoni et al., 2002; McClure et al., 2003), as well as secondary rewards such as praise and money (for review, see Knutson and Cooper, 2005).”
BackgroundExposure to the Taste of Alcohol Elicits Activation of the Mesocorticolimbic Neurocircuitry
Filbey, F. M., Claus, E., Audette, A. R., Niculescu, M., Banich, M. T., Tanabe, J., Du, Y. P., & Hutchison, K. E. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301513 · Cited by 270 · see citing works
Maternal neglect: oxytocin, dopamine and the neurobiology of attachment
Strathearn, L. (2011) · Journal of Neuroendocrinology · doi:10.1111/j.1365-2826.2011.02228.x · Cited by 268 · see citing works
Motivation-dependent responses in the human caudate nucleus.
Delgado, M. R. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh062 · Cited by 246 · see citing works
Pursey, K. M., Stanwell, P., Callister, R. J., Brain, K., Collins, C. E., & Burrows, T. L. (2014) · Frontiers in Nutrition · doi:10.3389/fnut.2014.00007 · Cited by 239 · see citing works
Neural systems underlying approach and avoidance in anxiety disorders
Robin L., A., & Martin, P. P. (2010) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2010.12.4/raupperle · Cited by 227 · see citing works
Food for thought: hedonic experience beyond homeostasis in the human brain
Kringelbach, M. L. (2004) · Neuroscience · doi:10.1016/j.neuroscience.2004.04.035 · Cited by 236 · see citing works
From prediction error to psychosis: Ketamine as a pharmacological model of delusions
Corlett, P. R., Honey, G. D., & Fletcher, P. C. (2007) · Journal of Psychopharmacology · doi:10.1177/0269881107077716 · Cited by 227 · see citing works
Striatal functional alteration in adolescents characterized by early childhood behavioral inhibition
Guyer, A. E., Nelson, E. E., Perez-Edgar, K., Hardin, M. G., Roberson-Nay, R., Monk, C. S., Bjork, J. M., Henderson, H. A., Pine, D. S., Fox, N. A., et al. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.0666-06.2006 · Cited by 211 · see citing works
The role of ventral frontostriatal circuitry in reward-based learning in humans.
Galvan, A., Hare, T. A., Davidson, M., Spicer, J., Glover, G., & Casey, B. J. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2431-05.2005 · Cited by 207 · see citing works
Relief as a reward: hedonic and neural responses to safety from pain
Leknes, S., Lee, M., Berna, C., Andersson, J., & Tracey, I. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017870 · Cited by 207 · see citing works
Behavioral and Neural Properties of Social Reinforcement Learning
Jones, R. M., Somerville, L. H., Li, J., Ruberry, E. J., Libby, V., Glover, G., Voss, H. U., Ballon, D. J., & Casey, B. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.2972-11.2011 · Cited by 191 · see citing works
Waltz, J. A., Schweitzer, J. B., Gold, J. M., Kurup, P. K., Ross, T. J., Jo Salmeron, B., Rose, E. J., McClure, S. M., & Stein, E. A. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2008.214 · Cited by 186 · see citing works
Self-citationAndrews, M. M., Meda, S. A., Thomas, A. D., Potenza, M. N., Krystal, J. H., Worhunsky, P., Stevens, M. C., O'Malley, S., Book, G. A., Reynolds, B., et al. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.09.049 · Cited by 181 · see citing works
Neural coding of distinct statistical properties of reward information in humans
Dreher, J.-C., Kohn, P., & Berman, K. F. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj004 · Cited by 180 · see citing works
Altered neural reward and loss processing and prediction error signalling in depression
Ubl, B., Kuehner, C., Kirsch, P., Ruttorf, M., Diener, C., & Flor, H. (2015) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu158 · Cited by 165 · see citing works
Neural reward processing is modulated by approach- and avoidance-related personality traits
Simon, J. J., Walther, S., Fiebach, C. J., Friederich, H.-C., Stippich, C., Weisbrod, M., & Kaiser, S. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.09.016 · Cited by 174 · see citing works
Cerebral blood flow in immediate and sustained anxiety
Hasler, G., Fromm, S., Alvarez, R. P., Luckenbaugh, D. A., Drevets, W. C., & Grillon, C. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.5369-06.2007 · Cited by 163 · see citing works
Medial frontal cortex activity and loss-related responses to errors
Taylor, S. F., Martis, B., Fitzgerald, K. D., Welsh, R. C., Abelson, J. L., Liberzon, I., Himle, J. A., & Gehring, W. J. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4709-05.2006 · Cited by 160 · see citing works
Neural mechanism of intertemporal choice: From discounting future gains to future losses
Xu, L., Liang, Z.-Y., Wang, K., Li, S., & Jiang, T. (2009) · Brain Research · doi:10.1016/j.brainres.2008.12.061 · Cited by 161 · see citing works
Striatal sensitivity to reward deliveries and omissions in substance dependent patients
Bjork, J. M., Smith, A. R., & Hommer, D. W. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.06.035 · Cited by 154 · see citing works
Disambiguating ventral striatum fMRI-related bold signal during reward prediction in schizophrenia
Morris, R. W., Vercammen, A., Lenroot, R., Moore, L., Langton, J. M., Short, B., Kulkarni, J., Curtis, J., O'Donnell, M., Weickert, C. S., et al. (2012) · Molecular Psychiatry · doi:10.1038/mp.2011.75 · Cited by 149 · see citing works
Reward-related processing in the human brain: developmental considerations
Fareri, D. S., Martin, L. N., & Delgado, M. R. (2008) · Development and Psychopathology · doi:10.1017/s0954579408000576 · Cited by 141 · see citing works
Ventral–striatal/nucleus–accumbens sensitivity to prediction errors during classification learning
Rodriguez, P. F., Aron, A. R., & Poldrack, R. A. (2006) · Human Brain Mapping · doi:10.1002/hbm.20186 · Cited by 122 · see citing works
Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
Metereau, E., & Dreher, J.-C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs037 · Cited by 114 · see citing works
Neurobehavioral markers of resilience to depression amongst adolescents exposed to child abuse
Dennison, M. J., Sheridan, M. A., Busso, D. S., Jenness, J. L., Peverill, M., Rosen, M. L., & McLaughlin, K. A. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000215 · Cited by 117 · see citing works
Unpredictable saccharin reinforcement enhances locomotor responding to amphetamine
Singer, B. F., Scott-Railton, J., & Vezina, P. (2012) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.09.003 · Cited by 117 · see citing works
Using fMRI to study reward processing in humans: past, present, and future
Wang, K. S., Smith, D. V., & Delgado, M. R. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00333.2015 · Cited by 105 · see citing works
Gilman, J. M., Ramchandani, V. A., Crouss, T., & Hommer, D. W. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2011.206 · Cited by 97 · see citing works
- Authors
- Berns, G. S., McClure, S. M., Pagnoni, G., & Montague, P. R.
- Affiliations
- Emory University (US)
- Baylor College of Medicine (US)
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2001-04-15
- Volume
- 21
- Issue
- 8
- Pages
- 2793-2798
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- PMC
- PMC6762527
- OpenAlex
- W2096684870
- Cited by
- 711
- References
- 48
- Citations by year
- 2026: 9 · 2025: 12 · 2024: 23 · 2023: 11 · 2022: 12 · 2021: 17 · 2020: 19 · 2019: 18 · 2018: 26 · 2017: 17 · 2016: 35 · 2015: 26 · 2014: 32 · 2013: 35 · 2012: 37
- FWCI
- 9.82
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Neuroscience (publishedVersion, cc-by-nc-sa)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by-nc-sa)
- VTechWorks (Virginia Tech) (submittedVersion)
- Funders
- National Institute on Drug Abuse (K08 DA00367, K08DA000367, R01-DA11723, R01DA011723)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- reward, predictability, nucleus accumbens, medial orbitofrontal cortex, sensorimotor cortex, subjective preference, food reward
- MeSH terms
- Adolescent, Adult, Brain, Brain Mapping, Computer Simulation, Corpus Striatum, Deglutition, Food Preferences, Frontal Lobe, Hippocampus, Humans, Magnetic Resonance Imaging, Nucleus Accumbens, Reward, Somatosensory Cortex, Stimulation, Chemical, Taste, Neural Networks, Computer, Prefrontal Cortex, Intuition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
