The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
What do differences between multi-voxel and univariate analysis mean? How subject-, voxel-, and trial-level variance impact fMRI analysis
Open accessAbstract
Multi-voxel pattern analysis (MVPA) has led to major changes in how fMRI data are analyzed and interpreted. Many studies now report both MVPA results and results from standard univariate voxel-wise analysis, often with the goal of drawing different conclusions from each. Because MVPA results can be sensitive to latent multidimensional representations and processes whereas univariate voxel-wise analysis cannot, one conclusion that is often drawn when MVPA and univariate results differ is that the activation patterns underlying MVPA results contain a multidimensional code. In the current study, we conducted simulations to formally test this assumption. Our findings reveal that MVPA tests are sensitive to the magnitude of voxel-level variability in the effect of a condition within subjects, even when the same linear relationship is coded in all voxels. We also find that MVPA is insensitive to subject-level variability in mean activation across an ROI, which is the primary variance component of interest in many standard univariate tests. Together, these results illustrate that differences between MVPA and univariate tests do not afford conclusions about the nature or dimensionality of the neural code. Instead, targeted tests of the informational content and/or dimensionality of activation patterns are critical for drawing strong conclusions about the representational codes that are indicated by significant MVPA results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
Statistical parametric maps in functional imaging: A general linear approach
Friston, K. J., Holmes, A. P., Worsley, K. J., Poline, J. ‐., Frith, C. D., & Frackowiak, R. S. J. (1994) · Human Brain Mapping · doi:10.1002/hbm.460020402 · Cited by 9,688
Mixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271
Self-citationCan cognitive processes be inferred from neuroimaging data?
POLDRACK, R. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.12.004 · Cited by 2,249
Self-citationThe language-as-fixed-effect fallacy: A critique of language statistics in psychological research
Clark, H. H. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80014-3 · Cited by 2,222
Decoding the visual and subjective contents of the human brain
Kamitani, Y., & Tong, F. (2005) · Nature Neuroscience · doi:10.1038/nn1444 · Cited by 1,829 · cited 1×
“Contrastingly, MVPA allows researchers to test how distributed patterns of BOLD activation across multiple voxels relate to experimental variables (Cox and Savoy, 2003; Haxby et al., 2001; Haynes and Rees, 2006; Kamitani and Tong, 2005; Norman et al., 2006).”
BackgroundDecoding mental states from brain activity in humans
Haynes, J.-D., & Rees, G. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1931 · Cited by 1,817
Predicting Human Brain Activity Associated with the Meanings of Nouns
Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K.-M., Malave, V. L., Mason, R. A., & Just, M. A. (2008) · Science · doi:10.1126/science.1152876 · Cited by 1,180
Cox, D. D., & Savoy, R. L. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00049-1 · Cited by 1,053
Mixed-Effects Models in S and S-PLUS
(2000) · Statistics and Computing · doi:10.1007/b98882 · Cited by 930
Naselaris, T., Kay, K. N., Nishimoto, S., & Gallant, J. L. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.073 · Cited by 905
Handbook of Functional MRI Data Analysis
Poldrack, R. A., Mumford, J. A., & Nichols, T. E. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511895029 · Cited by 699
Self-citationFunctional analysis of primary visual cortex (V1) in humans
Tootell, R. B. H., Hadjikhani, N. K., Vanduffel, W., Liu, A. K., Mendola, J. D., Sereno, M. I., & Dale, A. M. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.3.811 · Cited by 488
Rouder, J. N., & Lu, J. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196750 · Cited by 419
ON THE CHARACTERISTICS OF FUNCTIONAL MAGNETIC RESONANCE IMAGING OF THE BRAIN
Ogawa, S., Menon, R. S., Kim, S.-G., & Ugurbil, K. (1998) · Annual Review of Biophysics and Biomolecular Structure · doi:10.1146/annurev.biophys.27.1.447 · Cited by 343
Localization of brain function using magnetic resonance imaging
COHEN, M., & BOOKHEIMER, S. (1994) · Trends in Neurosciences · doi:10.1016/0166-2236(94)90055-8 · Cited by 257
Global Similarity and Pattern Separation in the Human Medial Temporal Lobe Predict Subsequent Memory
LaRocque, K. F., Smith, M. E., Carr, V. A., Witthoft, N., Grill-Spector, K., & Wagner, A. D. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4293-12.2013 · Cited by 219
Self-citationConfounds in multivariate pattern analysis: Theory and rule representation case study
Todd, M. T., Nystrom, L. E., & Cohen, J. D. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.03.039 · Cited by 201
Jimura, K., & Poldrack, R. A. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2011.11.007 · Cited by 190
Self-citationIntensity coding of auditory stimuli: an fMRI study
JÄncke, L., Shah, N. J., Posse, S., Grosse-Ryuken, M., & MÜller-GÄrtner, H.-W. (1998) · Neuropsychologia · doi:10.1016/s0028-3932(98)00019-0 · Cited by 174
Different Spatial Scales of Shape Similarity Representation in Lateral and Ventral LOC
Drucker, P. D. D. M., & Aguirre, G. K. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn244 · Cited by 165
Detecting individual memories through the neural decoding of memory states and past experience
Rissman, J., Greely, H. T., & Wagner, A. D. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1001028107 · Cited by 164
Self-citationContent Representation in the Human Medial Temporal Lobe
Liang, J. C., Wagner, A. D., & Preston, A. R. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr379 · Cited by 136
Self-citationMeasuring neural representations with fMRI: practices and pitfalls
Davis, T., & Poldrack, R. A. (2013) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12156 · Cited by 132
Self-citationDistinguishing multi-voxel patterns and mean activation: Why, how, and what does it tell us?
Coutanche, M. N. (2013) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-013-0186-2 · Cited by 111
Eccleston, J. A. (1999) · Cited by 103
Predicting judged similarity of natural categories from their neural representations
Weber, M. J., Thompson‐Schill, S. L., Osherson, D. N., Haxby, J. V., & Parsons, L. M. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.12.029 · Cited by 99
Comparing the similarity and spatial structure of neural representations: A pattern-component model
Diedrichsen, J., Ridgway, G. R., Friston, K. J., & Wiestler, T. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.01.044 · Cited by 97
Determining the Dimensionality of Multidimensional Scaling Representations for Cognitive Modeling
Lee, M. D. (2001) · Journal of Mathematical Psychology · doi:10.1006/jmps.1999.1300 · Cited by 97
Quantifying the Internal Structure of Categories Using a Neural Typicality Measure
Davis, T. H., & Poldrack, R. A. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht014 · Cited by 62
Self-citationThe confounding effect of response amplitude on MVPA performance measures
Smith, A. T., Kosillo, P., & Williams, A. L. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.05.079 · Cited by 41
Diedrichsen, J., Wiestler, T., & Ejaz, N. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.062 · Cited by 40
Tong, F., Harrison, S. A., Dewey, J. A., & Kamitani, Y. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.08.005 · Cited by 40
Cited by
Lonsdorf, T. B., Menz, M. M., Andreatta, M., Fullana, M. A., Golkar, A., Haaker, J., Heitland, I., Hermann, A., Kuhn, M., Kruse, O., et al. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.026 · Cited by 837
Deconstructing multivariate decoding for the study of brain function
Hebart, M. N., & Baker, C. I. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.08.005 · Cited by 320
Progress and challenges in probing the human brain
Poldrack, R. A., & Farah, M. J. (2015) · Nature · doi:10.1038/nature15692 · Cited by 280
Self-citationRecruitment of the default mode network during a demanding act of executive control
Crittenden, B. M., Mitchell, D. J., & Duncan, J. (2015) · eLife · doi:10.7554/elife.06481 · Cited by 176
Wing, E. A., Ritchey, M., & Cabeza, R. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00740 · Cited by 174
Metadata
- Authors
- Davis, T., LaRocque, K. F., Mumford, J. A., Norman, K. A., Wagner, A. D., & Poldrack, R. A.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2014-08
- Volume
- 97
- Pages
- 271-283
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W1992707148
- Cited by
- 282
- References
- 37
- FWCI
- 13.45
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.