The problem with value
Open accessThe DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Neural correlates of value have been extensively reported in a diverse set of brain regions. However, in many cases it is difficult to determine whether a particular neural response pattern corresponds to a value-signal per se as opposed to an array of alternative non-value related processes, such as outcome-identity coding, informational coding, encoding of autonomic and skeletomotor consequences, alongside previously described “salience” or “attentional” effects. Here, I review a number of experimental manipulations that can be used to test for value, and I identify the challenges in ascertaining whether a particular neural response is or is not a value signal. Finally, I emphasize that some non-value related signals may be especially informative as a means of providing insight into the nature of the decision-making related computations that are being implemented in a particular brain region.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Insensitivity to future consequences following damage to human prefrontal cortex
Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994) · Cognition · doi:10.1016/0010-0277(94)90018-3 · Cited by 6,128
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Looking at pictures: Affective, facial, visceral, and behavioral reactions
LANG, P. J., GREENWALD, M. K., BRADLEY, M. M., & HAMM, A. O. (1993) · Psychophysiology · doi:10.1111/j.1469-8986.1993.tb03352.x · Cited by 3,190 · cited 2×
“However, other responses such as faciomotor reactions, consummatory reactions, and approach or avoidance behaviors are known to be much more specific to particular appetitive vs aversive situations, and may therefore be more difficult to fully differentiate from value per se (Kreibig, 2010; Lang et al., 1993).”
BackgroundAutonomic nervous system activity in emotion: a review
Kreibig, S. D. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.03.010 · Cited by 3,188
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 1×
“One type of salience-type mechanism that has received careful and specific definitional treatment is the notion that changes in uncertainty in the predictiveness of a cue during associative learning can be used to modulate the rate of learning involving that cue (see (Behrens et al., 2007; Mackintosh, 1975; Payzan-LeN…”
BackgroundA theory of attention: Variations in the associability of stimuli with reinforcement
Mackintosh, N. J. (1975) · Psychological Review · doi:10.1037/h0076778 · Cited by 2,733
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 2×
“Computational theories of goal-directed control such as model-based reinforcement-learning (Daw et al., 2005), also require outcome-identity to be represented within the cognitive model of the world, before the value of that outcome can be accessed and an action-value can be computed.”
BackgroundA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · cited 1×
“One approach is to define value as some function which pertains to the relative attractiveness of a particular good at the time of choice, and which is maximized as a result of the decision process (Rangel et al., 2008).”
BackgroundLearning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Abstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003 · cited 1×
“In a probabilistic instrumental reversal-learning task as used in a number of studies (Cools et al., 2002; Hampshire et al., 2012; O’Doherty et al., 2003; O’Doherty et al., 2001), there are two available options, one of which a subject can select on a given trial.”
MethodSelf-citation
Cited by
Berridge, K. C., & Kringelbach, M. L. (2015) · Neuron · doi:10.1016/j.neuron.2015.02.018 · Cited by 1,730
“These issues have been discussed elsewhere, and no doubt will be discussed further in the future, perhaps eventually producing clearer consensus on dopamine in reward learning (Berridge, 2012; Berridge and O'Doherty, 2014; Collins and Frank, 2014; Schultz, 2013 ).”
BackgroundWhat the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531
Learning, reward, and decision making
O'Doherty, J. P., Cockburn, J., & Pauli, W. M. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044216 · Cited by 475
“The idea that agents can compare options based on expected value has motivated a search for neural representations of value predictions in the brain, an endeavor that has been enormously fruitful (for some caveats, see O’Doherty 2014).”
BackgroundSelf-citationOrbitofrontal Cortex: A Neural Circuit for Economic Decisions
Padoa-Schioppa, C., & Conen, K. E. (2017) · Neuron · doi:10.1016/j.neuron.2017.09.031 · Cited by 306
Miller, K. J., Shenhav, A., & Ludvig, E. A. (2019) · Psychological Review · doi:10.1037/rev0000120 · Cited by 280
“Storage of such a common currency signal is typically required for model-free RL, but evidence for such signals in the brain remains weak (Morrison & Nicola, 2014; O’Doherty, 2014; Schoenbaum, Takahashi, Liu, & McDannald, 2011).”
BackgroundThe case against economic values in the orbitofrontal cortex (or anywhere else in the brain).
Hayden, B. Y., & Niv, Y. (2021) · Behavioral Neuroscience · doi:10.1037/bne0000448 · Cited by 127
Gong, L., Yin, Y., He, C., Ye, Q., Bai, F., Yuan, Y., Zhang, H., Lv, L., Zhang, H., Xie, C., et al. (2017) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.09.016 · Cited by 82
Human ventromedial prefrontal lesions alter incentivisation by reward
Manohar, S. G., & Husain, M. (2016) · Cortex · doi:10.1016/j.cortex.2016.01.005 · Cited by 62
Neural mechanisms of economic choices in mice
Kuwabara, M., Kang, N., Holy, T. E., & Padoa-Schioppa, C. (2020) · eLife · doi:10.7554/elife.49669 · Cited by 56
Striatal action-value neurons reconsidered
Elber-Dorozko, L., & Loewenstein, Y. (2018) · eLife · doi:10.7554/elife.34248 · Cited by 53
Sensitivity to value-driven attention is predicted by how we learn from value
Jahfari, S., & Theeuwes, J. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1106-6 · Cited by 28
Action sequence learning, habits, and automaticity in obsessive-compulsive disorder
Banca, P., Herrojo Ruiz, M., Gonzalez-Zalba, M. F., Biria, M., Marzuki, A. A., Piercy, T., Sule, A., Fineberg, N. A., & Robbins, T. W. (2024) · eLife · doi:10.7554/elife.87346 · Cited by 9
“However, once learned, we predicted OCD patients would reach automaticity faster, possibly due to a stronger tendency to form habitual/automatic actions (Gil-lan et al., 2016, 2014).”
Metadata
- Authors
- O’Doherty, J. P.
- Venue
- Neuroscience & Biobehavioral Reviews
- Publisher
- Elsevier BV
- Published
- 2014-06
- Volume
- 43
- Pages
- 259-268
- ISSN
- 0149-7634 (ISSN-L)
- OpenAlex
- W2100870913
- Cited by
- 129
- References
- 50
- FWCI
- 7.15
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.