Post-hoc power estimation for topological inference in fMRI
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
When analyzing functional MRI data, several thresholding procedures are available to account for the huge number of volume units or features that are tested simultaneously. The main focus of these methods is to prevent an inflation of false positives. However, this comes with a serious decrease in power and leads to a problematic imbalance between type I and type II errors. In this paper, we show how estimating the number of activated peaks or clusters enables one to estimate post-hoc how powerful the selection procedure performs. This procedure can be used in real studies as a diagnostics tool, and raises awareness on how much activation is potentially missed. The method is evaluated and illustrated using simulations and a real data example. Our real data example illustrates the lack of power in current fMRI research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
SMITH, S., & NICHOLS, T. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.061 · Cited by 5,250
Self-citationThe Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
On the adaptive control of the false discovery rate in multiple testing with independent statistics
Benjamini, Y., & Hochberg, Y. (2000) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986025001060 · Cited by 2,015
Type I and Type II error concerns in fMRI research: re-balancing the scale
Lieberman, M. D., & Cunningham, W. A. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp052 · Cited by 1,342 · cited 3×
“One example is the biasing of results of metaanalyses of fMRI studies: type II error rates are never reported and will consequently not be considered in aggregate analyses (Lieberman and Cunningham, 2009).”
BackgroundInfluentialEstimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses
Desmond, J. E., & Glover, G. H. (2002) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(02)00121-8 · Cited by 716 · cited 2×
“For fMRI, such procedures are available for group-level analyses (Desmond and Glover, 2002; Hayasaka et al., 2007; Mumford and Nichols, 2008; Smith et al., 2007; Zarahn and Slifstein, 2001), but these mostly include an arbitrary standard error or effect size estimation.”
BackgroundMethodTopological FDR for neuroimaging
Chumbley, J., Worsley, K., Flandin, G., & Friston, K. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.10.090 · Cited by 492
Validating cluster size inference: random field and permutation methods
Hayasaka, S. (2003) · NeuroImage · doi:10.1016/j.neuroimage.2003.08.003 · Cited by 491
Unified univariate and multivariate random field theory
Worsley, K. J., Taylor, J. E., Tomaiuolo, F., & Lerch, J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.026 · Cited by 370
Mumford, J. A., & Nichols, T. E. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.061 · Cited by 252 · cited 3×
“For fMRI, such procedures are available for group-level analyses (Desmond and Glover, 2002; Hayasaka et al., 2007; Mumford and Nichols, 2008; Smith et al., 2007; Zarahn and Slifstein, 2001), but these mostly include an arbitrary standard error or effect size estimation.”
BackgroundMethodSelf-citationPersistent homology for random fields and complexes
Adler, R. J., Bobrowski, O., Borman, M. S., Subag, E., & Weinberger, S. (2010) · Institute of Mathematical Statistics Collections · doi:10.1214/10-imscoll609 · Cited by 91
Cited by
Cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates
Eklund, A., Nichols, T. E., & Knutsson, H. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1602413113 · Cited by 3,487
“In addition to unreliable statistical methods, the neuroimaging field also suffers from studies having low statistical power [42, 43].”
MethodSelf-citationBest practices in data analysis and sharing in neuroimaging using MRI
Nichols, T. E., Das, S., Eickhoff, S. B., Evans, A. C., Glatard, T., Hanke, M., Kriegeskorte, N., Milham, M. P., Poldrack, R. A., Poline, J.-B., et al. (2017) · Nature Neuroscience · doi:10.1038/nn.4500 · Cited by 714
Self-citationSmall sample sizes reduce the replicability of task-based fMRI studies
Turner, B. O., Paul, E. J., Miller, M. B., & Barbey, A. K. (2018) · Communications Biology · doi:10.1038/s42003-018-0073-z · Cited by 387
The relation between statistical power and inference in fMRI
Cremers, H. R., Wager, T. D., & Yarkoni, T. (2017) · PLOS ONE · doi:10.1371/journal.pone.0184923 · Cited by 349
Acar, F., Seurinck, R., Eickhoff, S. B., & Moerkerke, B. (2018) · PLOS ONE · doi:10.1371/journal.pone.0208177 · Cited by 154
“Furthermore, fMRI studies are relatively expensive which often limits the size of studies [2] leading to low statistical power to detect true activation [3].”
BackgroundSelf-citation
Metadata
- Authors
- Durnez, J., Moerkerke, B., & Nichols, T. E.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2014-01
- Volume
- 84
- Pages
- 45-64
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W1987580254
- Cited by
- 30
- References
- 12
- FWCI
- 1.18
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.