The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
The impact of study design on pattern estimation for single-trial multivariate pattern analysis
Abstract
A prerequisite for a pattern analysis using functional magnetic resonance imaging (fMRI) data is estimating the patterns from time series data, which then are input into the pattern analysis. Here we focus on how the combination of study design (order and spacing of trials) with pattern estimator impacts the Type I error rate of the subsequent pattern analysis. When Type I errors are inflated, the results are no longer valid, so this work serves as a guide for designing and analyzing MVPA studies with controlled false positive rates. The MVPA strategies examined are pattern classification and similarity, utilizing single trial activation patterns from the same functional run. Primarily focusing on the Least Squares Single and Least Square All pattern estimators, we show that collinearities in the models, along with temporal autocorrelation, can cause false positive correlations between activation pattern estimates that adversely impact the false positive rates of pattern similarity and classification analyses. It may seem intuitive that increasing the interstimulus interval (ISI) would alleviate this issue, but remaining weak correlations between activation patterns persist and have a strong influence in pattern similarity analyses. Pattern similarity analyses using only activation patterns estimated from the same functional run of data are susceptible to inflated false positives unless trials are randomly ordered, with a different randomization for each subject. In other cases, where there is any structure to trial order, valid pattern similarity analysis results can only be obtained if similarity computations are restricted to pairs of activation patterns from independent runs. Likewise, for pattern classification, false positives are minimized when the testing and training sets in cross validation do not contain patterns estimated from the same run.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“however, because trial sequences were randomly determined for each participant, temporal autocorrelation was unlikely to produce spurious pattern similarity effects at the group level (Mumford et al., 2014).”
From Delay-dependent contributions of medial temporal lobe regions to episodic memory retrieval (2015) · cites this paper as Mumford et al., 2014
Citations
Cites
Jenkinson, M., Bannister, P., Brady, M., & Smith, S. (2002) · NeuroImage · doi:10.1006/nimg.2002.1132 · Cited by 11,888
Fast robust automated brain extraction
Smith, S. M. (2002) · Human Brain Mapping · doi:10.1002/hbm.10062 · Cited by 10,496
A global optimisation method for robust affine registration of brain images
Jenkinson, M., & Smith, S. M. (2001) · Medical Image Analysis · doi:10.1016/s1361-8415(01)00036-6 · Cited by 7,018
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940
Accurate and robust brain image alignment using boundary-based registration
Greve, D. N., & Fischl, B. R. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.060 · Cited by 3,553
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271
Decoding mental states from brain activity in humans
Haynes, J., & Rees, G. E. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1931 · Cited by 1,868
Building Memories: Remembering and Forgetting of Verbal Experiences as Predicted by Brain Activity
Wagner, A. D., Schacter, D. L., Rotte, M., Koutstaal, W., Maril, A., Dale, A. M., Rosen, B. R., & Buckner, R. L. (1998) · Science · doi:10.1126/science.281.5380.1188 · Cited by 1,644
Flagged first, then by citations
Cited by
Sorted by citations
Items 201–238 of 238
Bressler, R. A., Ciarlo, A., Raible, S., Valente, G., Lührs, M., Tier, R., Linden, D. E. J., & Goebel, R. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.12.20.629827 · Cited by 2
Neural mechanisms of credit assignment for delayed outcomes during contingent learningPreprint
Witkowski, P. P., Rondot, L., Kurth-Nelson, Z. L., Garvert, M. M., Dolan, R. J., Behrens, T. E. J., & Boorman, E. D. (2025) · eLife · doi:10.7554/elife.101841.2 · Cited by 1
Task-specific representational spaces for memory formation in the medial temporal lobePreprint
Rau, E. M. B., Heinen, R. M., Herweg, N. A., Patai, E. Z., Kobelt, M., Ahmadi, K., & Axmacher, N. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.05.23.655754 · Cited by 1
Expecting the unexpected: Base-rate neglect is driven by neural activation of common cuesPreprint
O’Bryan, S. R. (2017) · OSF Preprints (OSF Preprints)
Using single subject manual independent component analysis on resting-state fMRI data
Parsons, N. (2019) · Minerva Access (University of Melbourne)
Saltzman, D., & Myers, E. B. (2020) · Neurobiology of Language · doi:10.1162/nol_a_00016
Zhang, Y., Lemarchand, R., Asyraff, A., & Hoffman, P. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.09.30.462531
Abrupt remapping in human CA3/dentate gyrus signals resolution of memory interferencePreprint
Guo, W., Favila, S. E., Kim, G., Molitor, R. J., & Kuhl, B. A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.02.11.430826
How Can I Avoid Circular Analysis (“Double Dipping”)?
Herweg, N. A. (2023) · Studies in neuroscience, psychology and behavioral economics · doi:10.1007/978-3-031-20910-9_37 · Cited by 1
Cortico-hippocampal representational similarity contributes to learning of multiple motor sequencesPreprint
Yoon, S., & Kim, S. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.08.28.555219
Palenciano, A. F., González‐García, C., Houwer, J. D., Liefooghe, B., & Braß, M. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.10.30.564708
Evidence for impaired hippocampal circuitry in schizophrenia and its link to memory dysfunctionPreprint
Zadbood, A., Tang, Y., Su, W., Hu, H., Capichioni, G., Yang, S., Wang, J., Gasser, C., Bein, O., Hui, L., et al. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.11.05.565219
Neural Representation Precision of Distance Predicts Arithmetic PerformancePreprint
Zhao, H., Wang, Q. J., Xu, J., Yao, Y., Lv, J., Yang, J., & Qin, S. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.08.01.605970
Statistical modeling of functional MRI data
Goebel, R., & Ciarlo, A. (2024) · Elsevier eBooks · doi:10.1016/b978-0-12-820480-1.00219-9
Neural mechanisms of credit assignment for delayed outcomes during contingent learningPreprint
Witkowski, P. P., Rondot, L., Kurth-Nelson, Z. L., Garvert, M. M., Dolan, R. J., Behrens, T. E. J., & Boorman, E. D. (2024) · eLife · doi:10.7554/elife.101841
Liu, Y., & Bedny, M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.01.08.631982
Characterizing semantic compositions in the brain: A model-driven fMRI re-analysisPreprint
Ciapparelli, M., Marelli, M., Graves, W. W., & Reverberi, C. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.04.25.650708
Schwarze, S. A., Bonati, S., Cichy, R. M., Lindenberger, U., Bunge, S. A., & Fandakova, Y. (2025) · Journal of Neuroscience · doi:10.1523/jneurosci.2358-23.2025
Dopaminergic processes predict temporal distortions in event memoryPreprint
Morrow, E., Huang, R., & Clewett, D. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.05.14.654133
Shiomi, Y., Izumika, R., Cho, M., Nouchi, R., & Tsukiura, T. (2025) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.a.48
Searchlight-based trial-wise fMRI decoding in the presence of trial-by-trial correlations
Soch, J. (2025) · Imaging Neuroscience · doi:10.1162/imag.a.131
Temporal confounds emulate multivariate fMRI measures of perceptual learningPreprint
Milne, G. A., Stäubli, K. E., Chow-Wing-Bom, H. T., Greenwood, J. A., Kok, P., Maimon-Mor, R. O., & Dekker, T. M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.08.12.669686
Social Decision Preferences for Close Others Are Embedded in Neural and Linguistic Representations
Moreira, J. F. G., Esparza, L. C., Silvers, J. A., & Parkinson, C. M. (2025) · Journal of Neuroscience · doi:10.1523/jneurosci.1696-24.2025
Accessing Meaning During Encoding Shapes Subsequent Memory Reactivation in the Brain
Qi, X., & Coutanche, M. N. (2026) · doi:10.21428/8e6ba8ef.46292a28
Neural Representations of Reward-Related Memories Shift across Development
Cohen, A. O., Benear, S. L., Phaneuf-Hadd, C. V., Davachi, L., & Hartley, C. A. (2026) · Journal of Neuroscience · doi:10.1523/jneurosci.1325-25.2026
The role of neural noise in explaining dyslexia and predicting reading achievement
Tan, Y. (2023) · theses.fr (ABES) · doi:10.70675/002343ffz1961z4d0ezbb2bz58c46b8b0be2
Ren, J., Konrad, B. N., Zhu, Y., Li, F. S., Czisch, M., Dresler, M., & Wagner, I. C. (2026) · eLife · doi:10.7554/elife.109943.1
Ren, J., Konrad, B. N., Zhu, Y., Li, F. S., Czisch, M., Dresler, M., & Wagner, I. C. (2026) · eLife · doi:10.7554/elife.109943
Dixon, M. L., Blevins, E., Dweck, C. S., Görgen, K., & Knutson, B. D. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2601231123
Rapid connectivity alterations of thalamic nuclei during initial learning of goal-directed behaviourPreprint
Jarrett, C. E., Fregni, S., von Kriegstein, K., & Ruge, H. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.05.15.725154
Okeke, D. E., & Chavez, R. S. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.01.728854
Ma, S., Coppola, A. M., Maresh, E. L., Beltrán, D. G., Rhodes, K. M., Allen, J. J. B., Sbarra, D. A., & Andrews‐Hanna, J. R. (2026) · Cerebral Cortex · doi:10.1093/cercor/bhag073
Takaaki, Y. (n.d.) · Institutional Repositories DataBase (IRDB)
Memory Traces Reflect How They Were Last Accessed
Qi, X., & Coutanche, M. N. (2026) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.a.2682
Bonar, A. S., Dai, J., Feldman, M. J., Capella, J., Prinstein, M. J., Telzer, E. H., & Lindquist, K. A. (2026) · Developmental Science · doi:10.1111/desc.70290
The role of contextual similarity on brain activity patterns for associated eventsPreprint
Gurguryan, L., Olivier, J. M., & Dimsdale-Zucker, H. R. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.19.760268
Yoon, S., Caraballo, A., & Kim, S. (2026) · iScience · doi:10.1016/j.isci.2026.117653
Guo, T., Wu, Y. J., Chen, J., Liu, X., Chen, S., Peng, P., Li, Y., Xie, X., Wen, R., & Guo, T. (2026) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-026-01511-4
Metadata
- Authors
- Mumford, J. A., Davis, T., & Poldrack, R. A.
- Affiliations
- University of Wisconsin–Madison (US)
- Texas Tech University (US)
- The University of Texas at Austin (US)
- Corresponding author
- Mumford, Jeanette A.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2014-12
- Volume
- 103
- Pages
- 130-138
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2015682160
- Cited by
- 237
- References
- 24
- Citations by year
- 2026: 20 · 2025: 36 · 2024: 20 · 2023: 29 · 2022: 25 · 2021: 29 · 2020: 23 · 2019: 15 · 2018: 17 · 2017: 10 · 2016: 8 · 2015: 5
- FWCI
- 4.28
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- NeuroImage (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- multivariate pattern analysis, single-trial analysis, research design, interstimulus interval, type I error rate, false positive rate, pattern similarity, pattern classification, least squares estimation, temporal autocorrelation, cross-validation, functional MRI
- MeSH terms
- Brain, Brain Mapping, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Research Design, Multivariate Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review