Within- and cross-participant classifiers reveal different neural coding of information
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Analyzing distributed patterns of brain activation using multivariate pattern analysis (MVPA) has become a popular approach for using functional magnetic resonance imaging (fMRI) data to predict mental states. While the majority of studies currently build separate classifiers for each participant in the sample, in principle a single classifier can be derived from and tested on data from all participants. These two approaches, within- and cross-participant classification, rely on potentially different sources of variability and thus may provide distinct information about brain function. Here, we used both approaches to identify brain regions that contain information about passively-received monetary rewards (i.e., images of currency that influenced participant payment) and social rewards (i.e., images of human faces). Our within-participant analyses implicated regions in the ventral visual processing stream – including fusiform gyrus and primary visual cortex – and ventromedial prefrontal cortex (VMPFC). Two key results indicate these regions may contain statistically discriminable patterns that contain different informational representations. First, cross-participant analyses implicated additional brain regions, including striatum and anterior insula. The cross-participant analyses also revealed systematic changes in predictive power across brain regions, with the pattern of change consistent with the functional properties of regions. Second, individual differences in classifier performance in VMPFC were related to individual differences in preferences between our two reward modalities. We interpret these results as reflecting a distinction between patterns reflecting participant-specific functional organization and those indicating aspects of brain organization that generalize across individuals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · cited 1×
“The fact that VMPFC exhibited different patterns for these two types of rewards supports the conception that this region evaluates a range of rewarding stimuli (Rangel et al., 2008).”
BackgroundKRINGELBACH, M. (2004) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2004.03.006 · Cited by 1,977 · cited 1×
“Considerable prior neuroimaging and electrophysiological work has implicated VMPFC in the assignment of value to environmental stimuli (Kringelbach and Rolls, 2004; Rushworth and Behrens, 2008).”
BackgroundIntersubject synchronization of cortical activity during natural vision
Hasson, U., Nir, Y., Levy, I., Fuhrmann, G., & Malach, R. (2004) · Science · doi:10.1126/science.1089506 · Cited by 1,839 · cited 1×
“One provocative interpretation of our two analyses is that the crossparticipant model captures only the common representations in FFA, whereas the within-participant models capture both the common and idiosyncratic representations of faces (Hasson et al., 2004).”
BackgroundDecoding the visual and subjective contents of the human brain
Kamitani, Y., & Tong, F. (2005) · Nature Neuroscience · doi:10.1038/nn1444 · Cited by 1,829 · cited 2×
“The dotted line represents average decrease in CV across all searchlights (−4.0%). and Rees, 2005; Kamitani and Tong, 2005).”
BackgroundInfluentialUnconscious determinants of free decisions in the human brain
Soon, C. S., Brass, M., Heinze, H.-J., & Haynes, J.-D. (2008) · Nature Neuroscience · doi:10.1038/nn.2112 · Cited by 1,741 · cited 4×
“We then used PyMVPA to implement a linear SVM with a fixed regularization parameter of C = 1 (Haynes et al., 2007; Soon et al., 2008).”
BackgroundMethodInfluentialMachine learning classifiers and fMRI: A tutorial overview
Pereira, F., Mitchell, T., & Botvinick, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.007 · Cited by 1,624
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Decoding reveals the contents of visual working memory in early visual areas
Harrison, S. A., & Tong, F. (2009) · Nature · doi:10.1038/nature07832 · Cited by 1,347
Face-specific processing in the human fusiform gyrus
McCarthy, G., Puce, A., Gore, J. C., & Allison, T. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.5.605 · Cited by 1,127
Associative learning of social value
Behrens, T. E. J., Hunt, L. T., Woolrich, M. W., & Rushworth, M. F. S. (2008) · Nature · doi:10.1038/nature07538 · Cited by 925 · cited 3×
“The significance of VMPFC for reward-based decision making has been borne out in a growing number of recent studies (Behrens et al., 2008; Hare et al., 2008; Lebreton et al., 2009).”
BackgroundBeauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness
O’Doherty, J., Winston, J., Critchley, H., Perrett, D., Burt, D. M., & Dolan, R. J. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00145-8 · Cited by 898
Allison, T. (1999) · Cerebral Cortex · doi:10.1093/cercor/9.5.415 · Cited by 882 · cited 1×
“Neural activity relating to the representation of faces and objects does not occur within only a single short-latency interval, but is distributed over several distinct time periods with identifiable functional contributions (Allison et al., 1999).”
BackgroundChoice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866
Processing of Social and Monetary Rewards in the Human Striatum
Izuma, K., Saito, D. N., & Sadato, N. (2008) · Neuron · doi:10.1016/j.neuron.2008.03.020 · Cited by 855 · cited 2×
“, 2003a), and in comparison tomonetary rewards (Behrens et al., 2008; Izuma et al., 2008; Smith et al., 2010).”
BackgroundHare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1309-08.2008 · Cited by 792
Miyawaki, Y., Uchida, H., Yamashita, O., Sato, M.-A., Morito, Y., Tanabe, H. C., Sadato, N., & Kamitani, Y. (2008) · Neuron · doi:10.1016/j.neuron.2008.11.004 · Cited by 543 · cited 2×
“, 2008) and reconstructing the contents of visual experience (Miyawaki et al., 2008; Naselaris et al., 2009).”
BackgroundModalities, Modes, and Models in Functional Neuroimaging
Friston, K. J. (2009) · Science · doi:10.1126/science.1174521 · Cited by 489
An automatic valuation system in the human brain: Evidence from functional neuroimaging
Lebreton, M., Jorge, S., Michel, V., Thirion, B., & Pessiglione, M. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.040 · Cited by 455 · cited 2×
“The significance of VMPFC for reward-based decision making has been borne out in a growing number of recent studies (Behrens et al., 2008; Hare et al., 2008; Lebreton et al., 2009).”
BackgroundEconomic principles motivating social attention in humans
Hayden, B. Y., Parikh, P. C., Deaner, R. O., & Platt, M. L. (2007) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2007.0368 · Cited by 160 · cited 2×
“Here, we employed the " searchlight " method (Kriegeskorte et al., 2006) to extract local spatial information from small spheres of brain voxels while measuring fMRI activation in participants who passively received monetary and social rewards (Hayden et al., 2007; Smith et al., 2010).”
BackgroundMethodSun, D., van Erp, T. G. M., Thompson, P. M., Bearden, C. E., Daley, M., Kushan, L., Hardt, M. E., Nuechterlein, K. H., Toga, A. W., & Cannon, T. D. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.07.019 · Cited by 148 · cited 2×
“…et al., 2005), different object categories (Shinkareva et al., 2008), mental states that are consistent across a wide variety of tasks (Poldrack et al., 2009), attention (Mourao-Miranda et al., 2005), biomarkers for psychosis (Sun et al., 2009), and Alzheimer's disease (Vemuri et al., 2008).”
BackgroundSpatial smoothing hurts localization but not information: Pitfalls for brain mappers
Kamitani, Y., & Sawahata, Y. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.040 · Cited by 122
Cited by
CoSMoMVPA: Multi-Modal Multivariate Pattern Analysis of Neuroimaging Data in Matlab/GNU Octave
Oosterhof, N. N., Connolly, A. C., & Haxby, J. V. (2016) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2016.00027 · Cited by 658
Consumer Neuroscience: Applications, Challenges, and Possible Solutions
Plassmann, H., Venkatraman, V., Huettel, S., & Yoon, C. (2015) · Journal of Marketing Research · doi:10.1509/jmr.14.0048 · Cited by 485
Self-citationDeficient approaches to human neuroimaging
Stelzer, J., Lohmann, G., Mueller, K., Buschmann, T., & Turner, R. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00462 · Cited by 412
Distributed Representations in Memory: Insights from Functional Brain Imaging
Rissman, J., & Wagner, A. D. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100344 · Cited by 299
Mapping discrete and dimensional emotions onto the brain: controversies and consensus
Hamann, S. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.006 · Cited by 316
Metadata
- Authors
- Clithero, J. A., Smith, D. V., Carter, R. M., & Huettel, S. A.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2011-05
- Volume
- 56
- Issue
- 2
- Pages
- 699-708
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2165588015
- Cited by
- 59
- References
- 24
- FWCI
- 3.62
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.