A simple solution for model comparison in bold imaging: the special case of reward prediction error and reward outcomes
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Conventional neuroimaging techniques provide information about condition-related changes of the BOLD (blood-oxygen-level dependent) signal, indicating only where and when the underlying cognitive processes occur. Recently, with the help of a new approach called "model-based" functional neuroimaging (fMRI), researchers are able to visualize changes in the internal variables of a time varying learning process, such as the reward prediction error or the predicted reward value of a conditional stimulus. However, despite being extremely beneficial to the imaging community in understanding the neural correlates of decision variables, a model-based approach to brain imaging data is also methodologically challenging due to the multicollinearity problem in statistical analysis. There are multiple sources of multicollinearity in functional neuroimaging including investigations of closely related variables and/or experimental designs that do not account for this. The source of multicollinearity discussed in this paper occurs due to correlation between different subjective variables that are calculated very close in time. Here, we review methodological approaches to analyzing such data by discussing the special case of separating the reward prediction error signal from reward outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 6×
“Since the initial publication of Schultz et al. (1997), numerous brain regions have been identified that code for RPEs; this has led to different neural circuit models for prediction error (PE) coding in the brain (this suggests that PE is coded either locally in the brain or in a distributed…”
BackgroundInfluentialA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · cited 1×
“Functional neuroimaging studies of reward and punishment learning have become an important research topic for understanding brain regions involved in decision-making and reinforcement learning (Montague et al., 2006; Rangel et al., 2008).”
BackgroundA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 2×
“the special case of reward prediction error and reward outcomes”
BackgroundKRINGELBACH, M. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.03.006 · Cited by 1,977
Bartra, O., McGuire, J. T., & Kable, J. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.063 · Cited by 1,927 · cited 1×
“Nevertheless, it has also been found that RPE activity is not limited to the mid-brain dopaminergic neurons but is also found in other parts of the brain such as the anterior cingulate cortex and medial-frontal cortex (Amiez et al., 2005; Matsumoto et al., 2007).”
BackgroundDopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 3×
“the special case of reward prediction error and reward outcomes”
BackgroundBayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423
The root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342 · cited 1×
“Moreover, many studies have been conducted to determine the neural correlates of a reward outcome (RO) and the predicted value (for meta-analytic reviews, see Kringelbach and Rolls, 2004; Grabenhorst and Rolls, 2011; Liu et al., 2011; Diekhof et al., 2012; Levy and Glimcher, 2012).”
BackgroundMidbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 1×
“Numerous electrophysiological studies in animals have reported that mid-brain dopamine neurons in the ventral tegmental area and substantia nigra perform computations that www.frontiersin.org July 2013 | Volume 7 | Article 116 | 1 are similar to RPEs (Schultz et al., 1997; Bayer and Glimcher, 2005).”
BackgroundEncoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165
Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis
Glimcher, P. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014269108 · Cited by 955 · cited 2×
“the special case of reward prediction error and reward outcomes”
BackgroundLiu, X., Hairston, J., Schrier, M., & Fan, J. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.12.012 · Cited by 916
Value, pleasure and choice in the ventral prefrontal cortex
Grabenhorst, F., & Rolls, E. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.12.004 · Cited by 766
Neural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532
Testing the Reward Prediction Error Hypothesis with an Axiomatic Model
Rutledge, R. B., Dean, M., Caplin, A., & Glimcher, P. W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1747-10.2010 · Cited by 244
Model-based approaches to neuroimaging: combining reinforcement learning theory with fMRI data
Gläscher, J. P., & O'Doherty, J. P. (2010) · WIREs Cognitive Science · doi:10.1002/wcs.57 · Cited by 104
Cited by
Multicollinearity in Regression Analyses Conducted in Epidemiologic Studies
P. Vatcheva, K., & Lee, M. (2016) · Epidemiology: Open Access · doi:10.4172/2161-1165.1000227 · Cited by 1,291
“The adverse impact of multicollinearity in regression analysis is very well recognized and much attention to its effect is documented in the literature [1-11].”
Changes in Data Sharing and Data Reuse Practices and Perceptions among Scientists Worldwide
Tenopir, C., Dalton, E. D., Allard, S., Frame, M., Pjesivac, I., Birch, B., Pollock, D., & Dorsett, K. (2015) · PLOS ONE · doi:10.1371/journal.pone.0134826 · Cited by 456
Wu, H., Zhang, X., Giraldo, J. P., & Shabala, S. (2018) · Plant and Soil · doi:10.1007/s11104-018-3770-y · Cited by 362
Wolfers, T., Buitelaar, J. K., Beckmann, C. F., Franke, B., & Marquand, A. F. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.08.001 · Cited by 290
Socioeconomic status, white matter, and executive function in children
Ursache, A., Noble, K. G., & the Pediatric Imaging, N. A. G. S. (2016) · Brain and Behavior · doi:10.1002/brb3.531 · Cited by 256
Metadata
- Authors
- Erdeniz, B., Rohe, T., Done, J., & Seidler, R. D.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2013
- Volume
- 7
- Pages
- 116-116
- ISSN
- 1662-453X (ISSN-L)
- OpenAlex
- W2114477876
- Cited by
- 214
- References
- 18
- FWCI
- 14.47
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.