A decade of decoding reward-related fMRI signals and where we go from here
The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Information about potential rewards in the environment is essential for guiding adaptive behavior, and understanding neural reward processes may provide insights into neuropsychiatric dysfunctions. Over the past 10 years, multivoxel pattern analysis (MVPA) techniques have been used to study brain areas encoding information about expected and experienced outcomes. These studies have identified reward signals throughout the brain, including the striatum, medial prefrontal cortex, orbitofrontal cortex, dorsolateral prefrontal cortex, and parietal cortex. This review article discusses some of the assumptions and models that are used to interpret results from these studies, and how they relate to findings from animal electrophysiology. The article reviews and summarizes some of the key findings from MVPA studies on reward. In particular, it first focuses on studies that, in addition to mapping out the brain areas that process rewards, have provided novel insights into the coding mechanisms of value and reward. Then, it discusses examples of how multivariate imaging approaches are being used more recently to decode features of expected rewards that go beyond value, such as the identity of an expected outcome or the action required to obtain it. The study of such complex and multifaceted reward representations highlights the key advantage of using representational methods, which are uniquely able to reveal these signals and may narrow the gap between animal and human research. Applied in a clinical context, MVPA may advance our understanding of neuropsychiatric disorders and the development of novel treatment strategies. HIGHLIGHTSMVPA has been used in recent years to study reward and decision making.Assumptions and models for interpreting these results are rarely discussed.This paper reviews selected MVPA studies on reward and what we have learned from them.It highlights questions about reward processing for which MVPA is particularly useful.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940 · cited 1×
“The advent of multivariate approaches to fMRI data analysis (Haxby et al., 2001; Haynes and Rees, 2005; Kamitani and Tong, 2005; Kriegeskorte et al., 2006) mitigated these limitations and enabled us to study brain regions in which neurons represent reward-related information heterogeneously across space and individual…”
BackgroundRepresentational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Abstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
Bartra, O., McGuire, J. T., & Kable, J. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.063 · Cited by 1,927 · cited 1×
“Although univariate fMRI studies have taught us a great deal about the brain regions involved in reward processing (Bartra et al., 2013; Clithero and Rangel, 2013), they are restricted to brain areas in which neuronal activity is relatively uniformly associated with reward across voxels and…”
BackgroundDecoding the visual and subjective contents of the human brain
Kamitani, Y., & Tong, F. (2005) · Nature Neuroscience · doi:10.1038/nn1444 · Cited by 1,829 · cited 2×
“The advent of multivariate approaches to fMRI data analysis (Haxby et al., 2001; Haynes and Rees, 2005; Kamitani and Tong, 2005; Kriegeskorte et al., 2006) mitigated these limitations and enabled us to study brain regions in which neurons represent reward-related information heterogeneously across space and individual…”
BackgroundNeural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · cited 1×
“These results suggest that value and salience can be encoded by heterogeneous neuronal populations within the same brain region (Leathers and Olson, 2012; Newsome et al., 2013; Platt and Glimcher, 1999), highlighting the importance of experimentally dissociating both variables and using multivariate methods to analyze…”
BackgroundNeurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598 · cited 2×
“, 2014) and primate OFC (Padoa-Schioppa and Assad, 2006), complementing evidence that lesions in the OFC impair the ability make choices based on and learn from the specific identity of outcomes (Burke et al.”
BackgroundFunctional imaging of neural responses to expectancy and experience of monetary gains and losses
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001) · Neuron · doi:10.1016/s0896-6273(01)00303-8 · Cited by 1,404
The root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · cited 3×
“, 2003), electrophysiology (Romo and Schultz, 1990; Schoenbaum et al., 1998; Tremblay and Schultz, 1999) and, more recently, optogenetics (Ferenczi et al.”
BackgroundEncoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165
Neural Economics and the Biological Substrates of Valuation
Montague, P. R., & Berns, G. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00974-1 · Cited by 994
Orbitofrontal Cortex Encodes Willingness to Pay in Everyday Economic Transactions
Plassmann, H., O'Doherty, J., & Rangel, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2131-07.2007 · Cited by 855
Decoding Neural Representational Spaces Using Multivariate Pattern Analysis
Haxby, J. V., Connolly, A. C., & Guntupalli, J. S. (2014) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062012-170325 · Cited by 717 · cited 1×
“RSA-type of analyses have been extremely fruitful in studying object encoding in high-level visual areas (Cichy et al., 2014; Haxby et al., 2014; Kriegeskorte et al., 2008), and have more recently been applied to study reward processing (Chikazoe et al.”
Chib, V. S., Rangel, A., Shimojo, S., & O'Doherty, J. P. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2575-09.2009 · Cited by 643 · cited 1×
“that in this region, fMRI signals in overlapping voxels correlate with the value of different rewards (Chib et al., 2009; Levy and Glimcher, 2011).”
BackgroundGremel, C. M., & Costa, R. M. (2013) · Nature Communications · doi:10.1038/ncomms3264 · Cited by 618 · cited 1×
“, 1998; Tremblay and Schultz, 1999) and, more recently, optogenetics (Ferenczi et al., 2016; Gremel and Costa, 2013; Steinberg et al., 2013).”
Neurobiology of economic choice: a good-based model
Padoa-Schioppa, C. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113648 · Cited by 600
Prefrontal cortical regulation of brainwide circuit dynamics and reward-related behavior
Ferenczi, E. A., Zalocusky, K. A., Liston, C., Grosenick, L., Warden, M. R., Amatya, D., Katovich, K., Mehta, H., Patenaude, B., Ramakrishnan, C., et al. (2016) · Science · doi:10.1126/science.aac9698 · Cited by 535 · cited 1×
“In addition, other studies found action-specific value signals in reward-related regions (FitzGerald et al., 2012), and reward signals in the parietal cortex have been shown to be specific for the task that subjects had to perform in order to obtain the reward (Wisniewski et al., 2015).”
BackgroundWhat the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531 · cited 1×
“This is in line with the idea that activity patterns in reward-coding regions such as the OFC encode a number of features that together make up a cognitive map of the task environment (Chan et al., 2016; Leong et al., 2017; Schuck et al., 2016; Stalnaker et al., 2015).”
BackgroundNeurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453 · cited 3×
“This heterogeneous coding of value could be expected to average out the signal of interest in individual fMRI voxels (Kennerley et al., 2009).”
BackgroundRudebeck, P. H., & Murray, E. A. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.049 · Cited by 405 · cited 1×
“Such signals are necessary to compute and independently update the value of different outcomes according to changes in the state of the organism or the environment (Howard et al., 2015; Rudebeck and Murray, 2014).”
BackgroundA Primer on Pattern-Based Approaches to fMRI: Principles, Pitfalls, and Perspectives
Haynes, J.-D. (2015) · Neuron · doi:10.1016/j.neuron.2015.05.025 · Cited by 402
Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating
Rudebeck, P. H., Saunders, R. C., Prescott, A. T., Chau, L. S., & Murray, E. A. (2013) · Nature Neuroscience · doi:10.1038/nn.3440 · Cited by 383
Romo, R., & Schultz, W. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.592 · Cited by 353 · cited 1×
“, 2003), electrophysiology (Romo and Schultz, 1990; Schoenbaum et al., 1998; Tremblay and Schultz, 1999) and, more recently, optogenetics (Ferenczi et al.”
Gottfried, J. A., & Dolan, R. J. (2004) · Nature Neuroscience · doi:10.1038/nn1314 · Cited by 353 · cited 1×
“, 2003), and within certain ranges, the value (pleasantness) of odors can be modulated by changing the concentration of the odor (Gottfried and Dolan, 2004; Moskowitz et al., 1976).”
BackgroundGeometry of orientation and ocular dominance columns in monkey striate cortex
Obermayer, K., & Blasdel, G. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-10-04114.1993 · Cited by 330 · cited 1×
“However, whereas the columnar architecture of the primary visual cortex, which may support such biased sampling (Haynes, 2015), is well established (Obermayer and Blasdel, 1993), the detailed topographic microarchitecture of the prefrontal cortex is poorly understood.”
BackgroundReward value comparison via mutual inhibition in ventromedial prefrontal cortex
Strait, C. E., Blanchard, T. C., & Hayden, B. Y. (2014) · Neuron · doi:10.1016/j.neuron.2014.04.032 · Cited by 294 · cited 1×
“Both increasing and decreasing responses to increases in reward size, probability, and value have been observed in the primate and rodent prefrontal cortex (Kennerley et al., 2009; Kobayashi et al., 2010; Morrison and Salzman, 2011; Padoa-Schioppa and Assad, 2006; Rudebeck et al., 2013a; Schoenbaum et al., 1998, 2007;…”
BackgroundThe neural code of reward anticipation in human orbitofrontal cortex
Kahnt, T., Heinzle, J., Park, S. Q., & Haynes, J.-D. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0912838107 · Cited by 274 · cited 4×
“In addition, neural pattern similarity was correlated with behavioral measures of learning, suggesting that pattern similarity between predictive events and outcomes can serve as a neural marker for associative learning (Kahnt et al., 2010).”
BackgroundMethodInfluentialSelf-citationDopamine prediction error responses integrate subjective value from different reward dimensions
Lak, A., Stauffer, W. R., & Schultz, W. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1321596111 · Cited by 257
A Distinct Role of the Temporal-Parietal Junction in Predicting Socially Guided Decisions
Carter, R. M., Bowling, D. L., Reeck, C., & Huettel, S. A. (2012) · Science · doi:10.1126/science.1219681 · Cited by 238
Tsuchida, A., Doll, B. B., & Fellows, L. K. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1958-10.2010 · Cited by 188 · cited 1×
“evidence from patients with lesions in circumscribed brain areas (Bechara et al., 1994; Tsuchida et al., 2010).”
BackgroundMeasuring neural representations with fMRI: practices and pitfalls
Davis, T., & Poldrack, R. A. (2013) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12156 · Cited by 132
Shmuel, A., Chaimow, D., Raddatz, G., Ugurbil, K., & Yacoub, E. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.08.040 · Cited by 111 · cited 1×
“This model assumes selectivity biases in how venous vessels sample neuronal patterns (Gardner, 2010; Shmuel et al., 2010) and makes predictions about how the temporal dynamics of the hemodynamic response contribute to the observed fMRI pattern.”
BackgroundCommon and unique representations in pFC for face and place attractiveness
Pegors, T. K., Kable, J. W., Chatterjee, A., & Epstein, R. A. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00777 · Cited by 82 · cited 1×
“Several studies have replicated category-independent value signals in the medial PFC using different reward categories (Chikazoe et al., 2014; Gross et al., 2014; Pegors et al., 2015; Pogoda et al., 2016), and similar approaches have been used to show that perceived and inferred emotional states share representations…”
MethodAction-specific value signals in reward-related regions of the human brain
FitzGerald, T. H. B., Friston, K. J., & Dolan, R. J. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3254-12.2012 · Cited by 68
The Role of the Parietal Cortex in the Representation of Task-Reward Associations
Wisniewski, D., Reverberi, C., Momennejad, I., Kahnt, T., & Haynes, J.-D. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.4882-14.2015 · Cited by 67
Self-citation
Cited by
Fouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176
Mind Reading and Writing: The Future of Neurotechnology
Roelfsema, P. R., Denys, D., & Klink, P. C. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.04.001 · Cited by 107
To be specific: The role of orbitofrontal cortex in signaling reward identity.
Howard, J. D., & Kahnt, T. (2021) · Behavioral Neuroscience · doi:10.1037/bne0000455 · Cited by 57
“Importantly, both fMRI adaptation (Barron, Garvert, & Behrens, 2016) and MVPA (Kahnt, 2018) techniques are attuned to detecting representations encoded in distributed patterns of activity, and thus serve as an alternative to univariate methods in which signals across relative large swaths of cortex…”
BackgroundMethodSelf-citation
Metadata
- Authors
- Kahnt, T.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2018-10
- Volume
- 180
- Issue
- Pt A
- Pages
- 324-333
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2620929997
- Cited by
- 75
- References
- 40
- FWCI
- 3.01
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.