The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Faster permutation inference in brain imaging
Open accessAbstract
Permutation tests are increasingly being used as a reliable method for inference in neuroimaging analysis. However, they are computationally intensive. For small, non-imaging datasets, recomputing a model thousands of times is seldom a problem, but for large, complex models this can be prohibitively slow, even with the availability of inexpensive computing power. Here we exploit properties of statistics used with the general linear model (GLM) and their distributions to obtain accelerations irrespective of generic software or hardware improvements. We compare the following approaches: (i) performing a small number of permutations; (ii) estimating the p-value as a parameter of a negative binomial distribution; (iii) fitting a generalised Pareto distribution to the tail of the permutation distribution; (iv) computing p-values based on the expected moments of the permutation distribution, approximated from a gamma distribution; (v) direct fitting of a gamma distribution to the empirical permutation distribution; and (vi) permuting a reduced number of voxels, with completion of the remainder using low rank matrix theory. Using synthetic data we assessed the different methods in terms of their error rates, power, agreement with a reference result, and the risk of taking a different decision regarding the rejection of the null hypotheses (known as the resampling risk). We also conducted a re-analysis of a voxel-based morphometry study as a real-data example. All methods yielded exact error rates. Likewise, power was similar across methods. Resampling risk was higher for methods (i), (iii) and (v). For comparable resampling risks, the method in which no permutations are done (iv) was the absolute fastest. All methods produced visually similar maps for the real data, with stronger effects being detected in the family-wise error rate corrected maps by (iii) and (v), and generally similar to the results seen in the reference set. Overall, for uncorrected p-values, method (iv) was found the best as long as symmetric errors can be assumed. In all other settings, including for familywise error corrected p-values, we recommend the tail approximation (iii). The methods considered are freely available in the tool PALM - Permutation Analysis of Linear Models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630 · cited 2×
“, 2001) carried out with the fmrib Software Library (fsl; Smith et al., 2004).”
MethodSelf-citationCramming More Components onto Integrated Circuits (1965)
Moore, G. (2021) · Ideas That Created the Future · doi:10.7551/mitpress/12274.003.0027 · Cited by 6,241
SCHEFFE, H. (1960) · Soil Science · doi:10.1097/00010694-196006000-00016 · Cited by 5,516
SMITH, S., & NICHOLS, T. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.061 · Cited by 5,250
Self-citationTHE USE OF CONFIDENCE OR FIDUCIAL LIMITS ILLUSTRATED IN THE CASE OF THE BINOMIAL
CLOPPER, C. J., & PEARSON, E. S. (1934) · Biometrika · doi:10.1093/biomet/26.4.404 · Cited by 5,003
Thresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
Self-citationExact Matrix Completion via Convex Optimization
Candès, E. J., & Recht, B. (2009) · Foundations of Computational Mathematics · doi:10.1007/s10208-009-9045-5 · Cited by 4,877
A Voxel-Based Morphometric Study of Ageing in 465 Normal Adult Human Brains
Good, C. D., Johnsrude, I. S., Ashburner, J., Henson, R. N. A., Friston, K. J., & Frackowiak, R. S. J. (2001) · NeuroImage · doi:10.1006/nimg.2001.0786 · Cited by 4,561
Cited by
NetCoMi: network construction and comparison for microbiome data in R
Peschel, S., Müller, C. L., von Mutius, E., Boulesteix, A.-L., & Depner, M. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa290 · Cited by 604
Chen, X., Lu, B., & Yan, C. (2018) · Human Brain Mapping · doi:10.1002/hbm.23843 · Cited by 340
Statistical Challenges in “Big Data” Human Neuroimaging
Smith, S. M., & Nichols, T. E. (2018) · Neuron · doi:10.1016/j.neuron.2017.12.018 · Cited by 330
Self-citationRegional, circuit and network heterogeneity of brain abnormalities in psychiatric disorders
Segal, A., Parkes, L., Aquino, K., Kia, S. M., Wolfers, T., Franke, B., Hoogman, M., Beckmann, C. F., Westlye, L. T., Andreassen, O. A., et al. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01404-6 · Cited by 271
Brain Heterogeneity in Schizophrenia and Its Association With Polygenic Risk
Alnæs, D., Kaufmann, T., van der Meer, D., Córdova-Palomera, A., Rokicki, J., Moberget, T., Bettella, F., Agartz, I., Barch, D. M., Bertolino, A., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0257 · Cited by 264
Li, J., Duan, X., Cui, Q., Chen, H., & Liao, W. (2019) · Psychological Medicine · doi:10.1017/s0033291718001502 · Cited by 208
Serotonin regulation of behavior via large-scale neuromodulation of serotonin receptor networks
Salvan, P., Fonseca, M., Winkler, A. M., Beauchamp, A., Lerch, J. P., & Johansen-Berg, H. (2023) · Nature Neuroscience · doi:10.1038/s41593-022-01213-3 · Cited by 101
Self-citationDeficits in neurite density underlie white matter structure abnormalities in first-episode psychosis
Rae, C. L., Davies, G., Garfinkel, S. N., Gabel, M. C., Dowell, N. G., Cercignani, M., Seth, A. K., Greenwood, K. E., Medford, N., & Critchley, H. D. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.02.008 · Cited by 65
Bouts, M. J. R. J., Möller, C., Hafkemeijer, A., van Swieten, J. C., Dopper, E., van der Flier, W. M., Vrenken, H., Wink, A. M., Pijnenburg, Y. A. L., Scheltens, P., et al. (2018) · Journal of Alzheimer’s Disease · doi:10.3233/jad-170893 · Cited by 47
Rasmussen, I. D., Boayue, N. M., Mittner, M., Bystad, M., Grønli, O. K., Vangberg, T. R., Csifcsák, G., & Aslaksen, P. M. (2021) · Journal of Alzheimer's Disease · doi:10.3233/jad-210378 · Cited by 42
Sie, J.-H., Chen, Y.-H., Shiau, Y.-H., & Chu, W.-C. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00369 · Cited by 35
Zhao, R., Wang, F.-M., Cheng, C., Li, X., Wang, Y., Zhang, F., Li, S.-G., Huang, Y.-H., Zhao, Z.-Y., Wei, W., et al. (2025) · Sleep Medicine · doi:10.1016/j.sleep.2024.11.010 · Cited by 8
Metadata
- Authors
- Winkler, A. M., Ridgway, G. R., Douaud, G., Nichols, T. E., & Smith, S. M.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2016-11
- Volume
- 141
- Pages
- 502-516
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2418410189
- Cited by
- 329
- References
- 65
- FWCI
- 16.45
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.