The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Neural Economics and the Biological Substrates of Valuation
Open accessAbstract
A recent flurry of neuroimaging and decision-making experiments in humans, when combined with single-unit data from orbitofrontal cortex, suggests major additions to current models of reward processing. We review these data and models and use them to develop a specific computational relationship between the value of a predictor and the future rewards or punishments that it promises. The resulting computational model, the predictor-valuation model (PVM), is shown to anticipate a class of single-unit neural responses in orbitofrontal and striatal neurons. The model also suggests how neural responses in the orbitofrontal-striatal circuit may support the conversion of disparate types of future rewards into a kind of internal currency, that is, a common scale used to compare the valuation of future behavioral acts or stimuli.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In contrast, risk taking is associated with an increase in accumbens activity (Kuhnen & Knutson 2005; Matthews et al. 2004; Montague & Berns 2002) that is exaggerated in adolescents, relative to both children and adults (Ernst et al. 2005; Galvan et al. 2006).”
From The Adolescent Brain (2008) · cites this paper as Montague & Berns 2002
In the citing paper
“A number of studies have shown increases in activity in the nucleus accumbens immediately prior to making risky choices on monetary-risk paradigms (Kuhnen & Knutson 2005; Matthews et al. 2004; Montague & Berns 2002)”
From The Adolescent Brain (2008) · cites this paper as Montague & Berns 2002
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
The pricing of options and corporate liabilities
Black, F., & Scholes, M. (1973) · Journal of Political Economy · doi:10.1086/260062 · Cited by 29,074
Golden eggs and hyperbolic discounting
Laibson, D. (1997) · The Quarterly Journal of Economics · doi:10.1162/003355397555253 · Cited by 6,122
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Dissociable Neural Responses in Human Reward Systems
Elliott, R., Friston, K. J., & Dolan, R. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-16-06159.2000 · Cited by 740
Activity in human ventral striatum locked to errors of reward prediction
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002) · Nature Neuroscience · doi:10.1038/nn802 · Cited by 451
Self-citationAnimal choice behavior and the evolution of cognitive architecture
Real, L. A. (1991) · Science · doi:10.1126/science.1887231 · Cited by 377
Romo, R., & Schultz, W. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.592 · Cited by 353
Research works printed but not linked: 38
- Aharon, 2001, Beautiful faces have variable reward value, Neuron, 32, 537, 10.1016/S0896-6273(01)00491-3 · DOI · Paper page
- Becerra, 2001, Reward circuitry activation by noxious thermal stimuli, Neuron, 32, 927, 10.1016/S0896-6273(01)00533-5 · DOI
- Berns, 1997, Brain regions responsive to novelty in the absence of awareness, Science, 276, 1272, 10.1126/science.276.5316.1272 · DOI
- Berns, 2001, Predictability modulates human brain response to reward, J. Neurosci., 21, 2793, 10.1523/JNEUROSCI.21-08-02793.2001 · DOI · Paper page
- Bischoff-Grethe, 2000, Conscious and unconscious processing of nonverbal predictability in Wernicke's area, J. Neurosci., 20, 1975, 10.1523/JNEUROSCI.20-05-01975.2000 · DOI
- Breiter, 1997, Acute effects of cocaine on human brain activity and emotion, Neuron, 19, 591, 10.1016/S0896-6273(00)80374-8 · DOI · Paper page
- Breiter, 2001, Functional imaging of neural responses to expectancy and experience of monetary gains and losses, Neuron, 30, 619, 10.1016/S0896-6273(01)00303-8 · DOI · Paper page
- Dayan, 2002, Reward, motivation, and reinforcement learning, Neuron, 36, 285, 10.1016/S0896-6273(02)00963-7 · DOI · Paper page
- Dayan, 2000, Learning and selective attention, Nat. Neurosci., 3, 1218, 10.1038/81504 · DOI · Paper page
- Delgado, 2000, Tracking the hemodynamic responses to reward and punishment in the striatum, J. Neurophysiol., 84, 3072, 10.1152/jn.2000.84.6.3072 · DOI · Paper page
- Egelman, 1998, A computational role for dopamine delivery in human decision-making, J. Cogn. Neurosci., 10, 623, 10.1162/089892998563022 · DOI
- Garris, 1999, Dissociation of dopamine release in the nucleus accumbens from intracranial self-stimulation, Nature, 398, 67, 10.1038/18019 · DOI · Paper page
- Hammer, 1993, An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees, Nature, 336, 59, 10.1038/366059a0 · DOI
- Herrnstein, 1961, Relative and absolute strength of response as a function of frequency of reinforcement, J. Exp. Anal. Behav., 4, 267, 10.1901/jeab.1961.4-267 · DOI · Paper page
- Herrnstein, 1990, Rational choice theory, Am. Psychol., 45, 356, 10.1037/0003-066X.45.3.356 · DOI
- Heyman, 2000, An economic approach to animal models of alcoholism, Alcohol Res. Health, 24, 132
- Hollerman, 1998, Dopamine neurons report an error in the temporal prediction of reward during learning, Nat. Neurosci., 1, 304, 10.1038/1124 · DOI
- Kilpatrick, 2000, Extracellular dopamine dynamics in rat caudate-putamen during experimenter-delivered and intracranial self-stimulation, Neuroscience, 96, 697, 10.1016/S0306-4522(99)00578-3 · DOI
- Knutson, 2000, FMRI visualization of brain activity during a monetary incentive delay task, Neuroimage, 12, 20, 10.1006/nimg.2000.0593 · DOI · Paper page
- Knutson, 2001, Anticipation of increasing monetary reward selectively recruits nucleus accumbens, J. Neurosci., 21, RC159, 10.1523/JNEUROSCI.21-16-j0002.2001 · DOI · Paper page
- Krimer, 1998, Dopaminergic regulation of cerebral cortical microcirculation, Nat. Neurosci., 1, 286, 10.1038/1099 · DOI
- Lowenstein, 1992, Anomalies in intertemporal choice, Quarterly Journal of Economics, 107, 573, 10.2307/2118482 · DOI · Paper page
- Mazur, 1988, Estimation of indifference points with an adjusting-delay procedure, J. Exp. Anal. Behav., 49, 37, 10.1901/jeab.1988.49-37 · DOI
- Montague, 1994, The predictive brain, Learn. Mem., 1, 1, 10.1101/lm.1.1.1 · DOI
- Montague, 1995, Bee foraging in uncertain environments using predictive Hebbian learning, Nature, 376, 725, 10.1038/377725a0 · DOI · Paper page
- Montague, 1996, A framework for mesencephalic dopamine systems based on predictive Hebbian learning, J. Neurosci., 16, 1936, 10.1523/JNEUROSCI.16-05-01936.1996 · DOI · Paper page
- O'Doherty, 2001, Representation of pleasant and aversive taste in the human brain, J. Neurophysiol., 85, 1315, 10.1152/jn.2001.85.3.1315 · DOI
- O'Doherty, 2002, Neural responses during anticipation of a primary taste reward, Neuron, 33, 815, 10.1016/S0896-6273(02)00603-7 · DOI · Paper page
- Rolls, 2000, The orbitofrontal cortex and reward, Cereb. Cortex, 10, 284, 10.1093/cercor/10.3.284 · DOI · Paper page
- Schultz, 1998, Predictive reward signal of dopamine neurons, J. Neurophysiol., 80, 1, 10.1152/jn.1998.80.1.1 · DOI · Paper page
- Schultz, 2002, Getting formal with dopamine and reward, Neuron, 36, 241, 10.1016/S0896-6273(02)00967-4 · DOI · Paper page
- Schultz, 2000, Neuronal coding of prediction errors, Annu. Rev. Neurosci., 23, 473, 10.1146/annurev.neuro.23.1.473 · DOI · Paper page
- Schultz, 1997, A neural substrate of prediction and reward, Science, 275, 1593, 10.1126/science.275.5306.1593 · DOI · Paper page
- Schultz, 2000, Reward processing in primate orbitofrontal cortex and basal ganglia, Cereb. Cortex, 10, 272, 10.1093/cercor/10.3.272 · DOI · Paper page
- Thaler, 1981, Some empirical evidence on dynamic inconsistency, Economic Letters, 8, 201, 10.1016/0165-1765(81)90067-7 · DOI
- Tremblay, 1999, Relative reward preference in primate orbitofrontal cortex, Nature, 398, 704, 10.1038/19525 · DOI · Paper page
- Waelti, 2001, Dopamine responses comply with basic assumptions of formal learning theory, Nature, 412, 43, 10.1038/35083500 · DOI · Paper page
- Zald, 2002, Neural correlates of tasting concentrated quinine and sugar solutions, J. Neurophysiol., 87, 1068, 10.1152/jn.00358.2001 · DOI
Cited by
Sorted by citations
Casey, B. J., Jones, R. M., & Hare, T. A. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1440.010 · Cited by 3,345
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
Decision making, impulse control and loss of willpower to resist drugs: a neurocognitive perspective
Bechara, A. (2005) · Nature Neuroscience · doi:10.1038/nn1584 · Cited by 2,149
Bartra, O., McGuire, J. T., & Kable, J. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.063 · Cited by 1,927
Metadata
- Authors
- Montague, P. R., & Berns, G. S.
- Affiliations
- Baylor College of Medicine (US)
- Emory University (US)
- Corresponding author
- Montague, P.Read
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2002-10
- Volume
- 36
- Issue
- 2
- Pages
- 265-284
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2117403214
- Cited by
- 994
- References
- 9
- Citations by year
- 2026: 7 · 2025: 17 · 2024: 66 · 2023: 23 · 2022: 20 · 2021: 21 · 2020: 24 · 2019: 43 · 2018: 36 · 2017: 25 · 2016: 32 · 2015: 35 · 2014: 45 · 2013: 54 · 2012: 66
- FWCI
- 2.75
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- National Institutes of Health (5r01mh061010-02)
- National Institute of Mental Health (R01 MH61010, R01MH52797, R01MH052797)
- National Institute on Drug Abuse (K08 DA00367, K08DA000367, R01-DA11723, R01DA011723)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- valuation, reward processing, orbitofrontal cortex, striatum, single-unit activity, computational model, prediction error, decision-making
- MeSH terms
- Animals, Brain, Choice Behavior, Forecasting, Humans, Models, Neurological, Neurons, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review