Challenges of Interpreting Frontal Neurons during Value-Based Decision-Making
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
The frontal cortex is crucial to sound decision-making, and the activity of frontal neurons correlates with many aspects of a choice, including the reward value of options and outcomes. However, rewards are of high motivational significance and have widespread effects on neural activity. As such, many neural signals not directly involved in the decision process can correlate with reward value. With correlative techniques such as electrophysiological recording or functional neuroimaging, it can be challenging to distinguish neural signals underlying value-based decision-making from other perceptual, cognitive, and motor processes. In the first part of the paper, we examine how different value-related computations can potentially be confused. In particular, error-related signals in the anterior cingulate cortex, generated when one discovers the consequences of an action, might actually represent violations of outcome expectation, rather than errors per se. Also, signals generated at the time of choice are typically interpreted as reflecting predictions regarding the outcomes associated with the different choice alternatives. However, these signals could instead reflect comparisons between the presented choice options and previously presented choice alternatives. In the second part of the paper, we examine how value signals have been successfully dissociated from saliency-related signals, such as attention, arousal, and motor preparation in studies employing outcomes with both positive and negative valence. We hope that highlighting these issues will prove useful for future studies aimed at disambiguating the contribution of different neuronal populations to choice behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 3×
“A similar approach helped to delimit prediction errors in dopamine neurons (Fiorillo et al., 2003).”
BackgroundResultKRINGELBACH, M. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.03.006 · Cited by 1,977 · cited 3×
“…events appeared to be randomly interspersed with neurons that showed stronger responses to appetitive events (Morrison and Salzman, 2009), casting doubt on the theory that appetitive encoding is located more medially than aversive coding (Kringelbach and Rolls, 2004; Frank and Claus, 2006).”
BackgroundUncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 2×
“In contrast, signals from neurotransmitter systems appear more uniform, performing a single computation and broadcasting it to a large portion of the brain (Schultz, 1998; Yu and Dayan, 2005), although we note that recent studies have challenged whether signals from neurotransmitter systems are quite as homogenous as…”
BackgroundNeural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · cited 2×
“, 2000; Roesch and Olson, 2003) and indeed in parietal (Platt and Glimcher, 1999), temporal (Liu and Richmond, 2000), and occipital cortex (Shuler and Bear, 2006).”
BackgroundFalkenstein, M., Hohnsbein, J., Hoormann, J., & Blanke, L. (1991) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(91)90062-9 · Cited by 1,706 · cited 1×
“Human neurophysiology studies later reported a negative potential over ACC when subjects made errors (Gehring et al., 1990; Falkenstein et al., 1991; Ito et al., 2003), which became known as the error-related negativity (ERN).”
BackgroundNeurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487 · cited 1×
“A similar two-process theory has been postulated to underlie learning about rewards (Rescorla and Solomon, 1967).”
BackgroundFunctional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 2×
“…with activity recorded from dopamine neurons, where the vast majority of signals correlate with reward prediction errors (Fiorillo et al., 2003; Bayer and Glimcher, 2005; Bayer et al., 2007), encoding positive prediction errors with increased firing rates and negative prediction errors with…”
BackgroundLimbic connections of the orbital and medial prefrontal cortex in macaque monkeys
Carmichael, S. T., & Price, J. L. (1995) · Journal of Comparative Neurology · doi:10.1002/cne.903630408 · Cited by 1,197 · cited 2×
“Furthermore, there is no choice prediction error because each trial consists of the same two choice options. areas (Carmichael and Price, 1995b) as well as limbic structures responsible for processing rewards, such as the amygdala and hypothalamus (Carmichael and Price, 1995a).”
BackgroundBechara, A., Tranel, D., Damasio, H., & Damasio, A. R. (1996) · Cerebral Cortex · doi:10.1093/cercor/6.2.215 · Cited by 1,179 · cited 1×
“Rewards generate psychophysiological measures of arousal such as changes in galvanic skin conductance (Bechara et al., 1996) and heart rate and blood pressure (Braesicke et al., 2005).”
BackgroundDistributed Neural Representation of Expected Value
Knutson, B., Taylor, J., Kaufman, M., Peterson, R., & Glover, G. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0642-05.2005 · Cited by 955
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · cited 2×
“REVIEW ARTICLE published: 22 November 2011 doi: 10.3389/fnins.2011.00124 Challenges of interpreting frontal neurons during value-based decision-making”
BackgroundInfluentialThe orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836 · cited 2×
“…cingulate cortex (ACC) found neurons that were active to cues that predicted reward, neurons that fired immediately preceding and during an expected reward and neurons that responded to the omission of an expected reward (Niki and Watanabe, 1976; Rosenkilde et al., 1981; Thorpe et al., 1983).”
BackgroundHare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792 · cited 2×
“In humans, subjects have been required to bid on food items while simultaneously winning or losing money, thereby enabling prediction errors to be uncorrelated from value signals (Hare et al., 2008).”
BackgroundThe short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762
Reward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · cited 2×
“REVIEW ARTICLE published: 22 November 2011 doi: 10.3389/fnins.2011.00124 Challenges of interpreting frontal neurons during value-based decision-making”
BackgroundInfluentialRoesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597
Gustatory, olfactory, and visual convergence within the primate orbitofrontal cortex
Rolls, E., & Baylis, L. (1994) · The Journal of Neuroscience · doi:10.1523/jneurosci.14-09-05437.1994 · Cited by 587
Performance monitoring by the anterior cingulate cortex during saccade countermanding
Ito, S., Stuphorn, V., Brown, J. W., & Schall, J. D. (2003) · Science · doi:10.1126/science.1087847 · Cited by 581
Separate neural pathways process different decision costs
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1756 · Cited by 580 · cited 1×
“Indeed, several studies suggest that OFC may be responsible for integrating reward information with temporal costs (Roesch and Olson, 2005; Rudebeck et al., 2006; Kable and Glimcher, 2007).”
BackgroundNeural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532
Forward frontal fields: phylogeny and fundamental function
Wise, S. P. (2008) · Trends in Neurosciences · doi:10.1016/j.tins.2008.08.008 · Cited by 478 · cited 1×
“Most recordings from OFC in primates focus on areas 11 and 13, dysgranular cortex that may not have a homolog in rodents (Wise, 2008).”
BackgroundNeurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453 · cited 3×
“…for this lies in the fact among value encoding neurons, those that increase their firing rate as values increase are found in approximately equal numbers as those that increase their firing rate as values decrease (Kennerley and Wallis, 2009a; Kennerley et al., 2009; Padoa-Schioppa, 2009).”
BackgroundInfluentialSelf-citationLeon, M. I., & Shadlen, M. N. (1999) · Neuron · doi:10.1016/s0896-6273(00)80854-5 · Cited by 449 · cited 3×
“Larger rewards enhance preparation for response execution, so that motor responses are faster when more desirable outcomes are at stake (Kawagoe et al., 1998; Leon and Shadlen, 1999; Hassani et al., 2001; Kobayashi et al., 2002; Roesch and Olson, 2003).”
BackgroundHayden, B. Y., Heilbronner, S. R., Pearson, J. M., & Platt, M. L. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4652-10.2011 · Cited by 379 · cited 1×
“…delivered, particularly when the subject was expecting to receive a reward. was unexpected irrespective of whether it was better or worse than expected; Hayden et al., 2011) as well as “fictive” error signals, neuronal responses to outcomes for actions that one did not take (Hayden et al., 2009).”
BackgroundThe Architecture of Reward Value Coding in the Human Orbitofrontal Cortex
Sescousse, G., Redouté, J., & Dreher, J.-C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3501-10.2010 · Cited by 353 · cited 1×
“For example, monetary reward, a secondary reinforcer, activates more anterior regions of OFC than erotic pictures, a primary reinforcer (Sescousse et al., 2010).”
BackgroundFellows, L. K., & Farah, M. J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl176 · Cited by 337 · cited 2×
“REVIEW ARTICLE published: 22 November 2011 doi: 10.3389/fnins.2011.00124 Challenges of interpreting frontal neurons during value-based decision-making”
BackgroundInfluentialSeo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324 · cited 1×
“ACC neuronal activity has also been recorded during the performance of a competitive game (Seo and Lee, 2007).”
BackgroundWilliams, S. M., & Goldman-Rakic, P. S. (1993) · Cerebral Cortex · doi:10.1093/cercor/3.3.199 · Cited by 284 · cited 1×
“All areas of frontal cortex receive dopaminergic input, but it is particularly heavy in ACC (Williams and Goldman-Rakic, 1993).”
BackgroundRange-adapting representation of economic value in the orbitofrontal cortex
Padoa-Schioppa, C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3751-09.2009 · Cited by 276
Dissociating valuation and saliency signals during decision-making
Litt, A., Plassmann, H., Shiv, B., & Rangel, A. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq065 · Cited by 272
Single cell activity in ventral prefrontal cortex of behaving monkeys
Rosenkilde, C. E., Bauer, R. H., & Fuster, J. M. (1981) · Brain Research · doi:10.1016/0006-8993(81)90160-8 · Cited by 233 · cited 4×
“CONCLUSION It has been over 30 years since the first studies determined that frontal neurons showed responses that predicted reward outcomes (Niki and Watanabe, 1976; Rosenkilde et al., 1981).”
BackgroundInfluentialBouret, S., & Richmond, B. J. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0049-10.2010 · Cited by 192 · cited 1×
“However, neuronal representations of stimulus values might change for reasons other than learning, for example due to adaptation (Padoa-Schioppa, 2009) or satiation (Bouret and Richmond, 2010).”
BackgroundHeterogeneous reward signals in prefrontal cortex
Wallis, J. D., & Kennerley, S. W. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.009 · Cited by 186 · cited 2×
“Value signals can serve many different functions, including the reinforcement of behavior, the evaluation of alternative courses of action, and the prioritization of limited capacity behavioral and cognitive resources (Wallis and Kennerley, 2010).”
BackgroundSelf-citationNeural systems underlying aversive conditioning in humans with primary and secondary reinforcers
Delgado, M. R., Jou, R. L., & Phelps, E. A. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00071 · Cited by 141 · cited 2×
“…activate the amygdala, which is highly interconnected with OFC, while the same conditioning based on www.frontiersin.org November 2011 | Volume 5 | Article 124 | 9 electric shock does (Delgado et al., 2011), suggesting that OFC may also respond differentially to positive and negative punishment.”
BackgroundPleger, B., Blankenburg, F., Ruff, C. C., Driver, J., & Dolan, R. J. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1093-08.2008 · Cited by 120
Kennerley, S. W., & Wallis, J. D. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00273.2009 · Cited by 108
Self-citationAutonomic arousal in an appetitive context in primates: A behavioural and neural analysis
Braesicke, K., Parkinson, J. A., Reekie, Y., Man, M., Hopewell, L., Pears, A., Crofts, H., Schnell, C. R., & Roberts, A. C. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.03987.x · Cited by 78 · cited 2×
“, 1996) and heart rate and blood pressure (Braesicke et al., 2005).”
BackgroundBaxter, M. G., Gaffan, D., Kyriazis, D. A., & Mitchell, A. S. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06740.x · Cited by 65 · cited 1×
“For instance, neural representations of cognitive processes like working memory in ventrolateral PFC are influenced by reward magnitude (Kennerley and Wallis, 2009b) even though a lesion of lateral PFC has no effect on value-based decisions (Baxter et al., 2009).”
Background
Cited by
What the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531
Dorsal Anterior Cingulate Cortex: A Bottom-Up View
Heilbronner, S. R., & Hayden, B. Y. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-013952 · Cited by 455
Anterior cingulate is a source of valence-specific information about value and uncertainty
Monosov, I. E. (2017) · Nature Communications · doi:10.1038/s41467-017-00072-y · Cited by 163
Anterior Cingulate Cortex and the Control of Dynamic Behavior in Primates
Monosov, I. E., Haber, S. N., Leuthardt, E. C., & Jezzini, A. (2020) · Current Biology · doi:10.1016/j.cub.2020.10.009 · Cited by 118
“To summarize, ACC outcome or feedback signals are related to the specifics of contexts, actions, and tasks, and adjust behavior based on the uncertainty, value, and history of the environment or context [45,46,65,75,91,98].”
BackgroundThe case against economic values in the orbitofrontal cortex (or anywhere else in the brain).
Hayden, B. Y., & Niv, Y. (2021) · Behavioral Neuroscience · doi:10.1037/bne0000448 · Cited by 127
Metadata
- Authors
- Wallis, J. D., & Rich, E. L.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2011
- Volume
- 5
- Pages
- 124-124
- ISSN
- 1662-453X (ISSN-L)
- 1662-4548
- OpenAlex
- W2001090611
- Cited by
- 40
- References
- 42
- FWCI
- 1.21
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.