The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
FMRI Clustering in AFNI: False-Positive Rates Redux
Open accessPublished version of a preprint
Abstract
Recent reports of inflated false-positive rates (FPRs) in FMRI group analysis tools by Eklund and associates in 2016 have become a large topic within (and outside) neuroimaging. They concluded that existing parametric methods for determining statistically significant clusters had greatly inflated FPRs ("up to 70%," mainly due to the faulty assumption that the noise spatial autocorrelation function is Gaussian shaped and stationary), calling into question potentially "countless" previous results; in contrast, nonparametric methods, such as their approach, accurately reflected nominal 5% FPRs. They also stated that AFNI showed "particularly high" FPRs compared to other software, largely due to a bug in 3dClustSim. We comment on these points using their own results and figures and by repeating some of their simulations. Briefly, while parametric methods show some FPR inflation in those tests (and assumptions of Gaussian-shaped spatial smoothness also appear to be generally incorrect), their emphasis on reporting the single worst result from thousands of simulation cases greatly exaggerated the scale of the problem. Importantly, FPR statistics depends on "task" paradigm and voxelwise p value threshold; as such, we show how results of their study provide useful suggestions for FMRI study design and analysis, rather than simply a catastrophic downgrading of the field's earlier results. Regarding AFNI (which we maintain), 3dClustSim's bug effect was greatly overstated-their own results show that AFNI results were not "particularly" worse than others. We describe further updates in AFNI for characterizing spatial smoothness more appropriately (greatly reducing FPRs, although some remain >5%); in addition, we outline two newly implemented permutation/randomization-based approaches producing FPRs clustered much more tightly about 5% for voxelwise p ≤ 0.01.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Type I and Type II error concerns in fMRI research: re-balancing the scale
Lieberman, M. D., & Cunningham, W. A. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp052 · Cited by 1,342
Research works printed but not linked: 4
- 10.1073/pnas.0911855107 · DOI · Paper page
- 10.1016/j.neuroimage.2013.01.047 · DOI · Paper page
- 10.1073/pnas.1602413113 · DOI · Paper page
- 10.1002/(SICI)1097-0193(1996)4:1<58::AID-HBM4>3.0.CO;2-O · doi:10.1002/(sici)1097-0193(1996)4:1<58::aid-hbm4>3.0.co;2-o
Cited by
Scanning the horizon: towards transparent and reproducible neuroimaging research
Poldrack, R. A., Baker, C. I., Durnez, J., Gorgolewski, K. J., Matthews, P. M., Munafò, M. R., Nichols, T. E., Poline, J.-B., Vul, E., & Yarkoni, T. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.167 · Cited by 1,410
Chen, X., Lu, B., & Yan, C. (2018) · Human Brain Mapping · doi:10.1002/hbm.23843 · Cited by 340
fMRI clustering and false-positive rates
Cox, R. W., Chen, G., Glen, D. R., Reynolds, R. C., & Taylor, P. A. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1614961114 · Cited by 219
Self-citationEarly childhood stress exposure, reward pathways, and adult decision making
Birn, R. M., Roeber, B. J., & Pollak, S. D. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708791114 · Cited by 197
The insular cortex dynamically maps changes in cardiorespiratory interoception
Hassanpour, M. S., Simmons, W. K., Feinstein, J. S., Luo, Q., Lapidus, R. C., Bodurka, J., Paulus, M. P., & Khalsa, S. S. (2018) · Neuropsychopharmacology · doi:10.1038/npp.2017.154 · Cited by 130
Young, K. D., Siegle, G. J., Misaki, M., Zotev, V., Phillips, R., Drevets, W. C., & Bodurka, J. (2018) · NeuroImage: Clinical · doi:10.1016/j.nicl.2017.12.004 · Cited by 118
Self-Other Representation in the Social Brain Reflects Social Connection
Courtney, A. L., & Meyer, M. L. (2020) · The Journal of Neuroscience · doi:10.1523/jneurosci.2826-19.2020 · Cited by 115
Harel, M., Perini, I., Kämpe, R., Alyagon, U., Shalev, H., Besser, I., Sommer, W. H., Heilig, M., & Zangen, A. (2022) · Biological Psychiatry · doi:10.1016/j.biopsych.2021.11.020 · Cited by 115
Han, H., & Park, J. (2018) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2018.00001 · Cited by 103
Price, R. B., Brown, V., & Siegle, G. J. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.09.022 · Cited by 84
Progress toward openness, transparency, and reproducibility in cognitive neuroscience
Gilmore, R. O., Diaz, M. T., Wyble, B. A., & Yarkoni, T. (2017) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13325 · Cited by 95
Eklund, A., Knutsson, H., & Nichols, T. E. (2019) · Human Brain Mapping · doi:10.1002/hbm.24350 · Cited by 82
Jankowski, K. F., Batres, J., Scott, H., Smyda, G., Pfeifer, J. H., & Quevedo, K. (2018) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsy055 · Cited by 80
Brain connectivity and socioeconomic status at birth and externalizing symptoms at age 2 years
Ramphal, B., Whalen, D. J., Kenley, J. K., Yu, Q., Smyser, C. D., Rogers, C. E., & Sylvester, C. M. (2020) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2020.100811 · Cited by 70
Social interaction recruits mentalizing and reward systems in middle childhood
Alkire, D., Levitas, D., Warnell, K. R., & Redcay, E. (2018) · Human Brain Mapping · doi:10.1002/hbm.24221 · Cited by 69
Ketamine normalizes brain activity during emotionally valenced attentional processing in depression
Reed, J. L., Nugent, A. C., Furey, M. L., Szczepanik, J. E., Evans, J. W., & Zarate, C. A. (2018) · NeuroImage: Clinical · doi:10.1016/j.nicl.2018.07.006 · Cited by 67
Changes in functional connectivity following treatment with emotion regulation therapy
Scult, M. A., Fresco, D. M., Gunning, F. M., Liston, C., Seeley, S. H., García, E., & Mennin, D. S. (2019) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2019.00010 · Cited by 57
Reed, J. L., Nugent, A. C., Furey, M. L., Szczepanik, J. E., Evans, J. W., & Zarate, C. A. (2019) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2019.01.005 · Cited by 56
Perini, I., Gustafsson, P. A., Hamilton, J. P., Kämpe, R., Mayo, L. M., Heilig, M., & Zetterqvist, M. (2019) · EClinicalMedicine · doi:10.1016/j.eclinm.2019.06.016 · Cited by 53
Ash, S., Nevler, N., Phillips, J., Irwin, D. J., McMillan, C. T., Rascovsky, K., & Grossman, M. (2019) · Brain and Language · doi:10.1016/j.bandl.2019.04.006 · Cited by 47
Hanson, J. L., Gillmore, A. D., Yu, T., Holmes, C. J., Hallowell, E. S., Barton, A. W., Beach, S. R. H., Galván, A., MacKillop, J., Windle, M., et al. (2019) · Child Development · doi:10.1111/cdev.13154 · Cited by 41
Stuttering severity modulates effects of non-invasive brain stimulation in adults who stutter
Garnett, E. O., Chow, H. M., Choo, A. L., & Chang, S.-E. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00411 · Cited by 39
Han, H., Glenn, A. L., & Dawson, K. J. (2019) · Brain Sciences · doi:10.3390/brainsci9080198 · Cited by 34
Gastric stimulation drives fast BOLD responses of neural origin
Cao, J., Lu, K.-H., Oleson, S. T., Phillips, R. J., Jaffey, D., Hendren, C. L., Powley, T. L., & Liu, Z. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.04.064 · Cited by 30
Neonatal brain response to deviant auditory stimuli and relation to maternal trait anxiety
Sylvester, C. M., Myers, M. J., Perino, M. T., Kaplan, S., Kenley, J. K., Smyser, T. A., Warner, B. B., Barch, D. M., Pine, D. S., Luby, J. L., et al. (2021) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20050672 · Cited by 28
High-dose ondansetron reduces activation of interoceptive and sensorimotor brain regions
Stern, E. R., Shahab, R., Grimaldi, S. J., Leibu, E., Murrough, J. W., Fleysher, L., Parides, M. K., Coffey, B. J., Burdick, K. E., & Goodman, W. K. (2019) · Neuropsychopharmacology · doi:10.1038/s41386-018-0174-x · Cited by 27
Callow, D. D., Won, J., Pena, G. S., Jordan, L. S., Arnold-Nedimala, N. A., Kommula, Y., Nielson, K. A., & Smith, J. C. (2021) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2021.645258 · Cited by 27
Neural vulnerability and hurricane-related media are associated with post-traumatic stress in youth
Dick, A. S., Silva, K., Gonzalez, R., Sutherland, M. T., Laird, A. R., Thompson, W. K., Tapert, S. F., Squeglia, L. M., Gray, K. M., Nixon, S. J., et al. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01216-3 · Cited by 27
Jollant, F., Perreira, F., Fiori, L. M., Richard-Devantoy, S., Lutz, P.-E., Belzeaux, R., & Turecki, G. (2020) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.109909 · Cited by 25
Gregory, M. D., Eisenberg, D. P., Hamborg, M., Kippenhan, J. S., Kohn, P., Kolachana, B., Dickinson, D., & Berman, K. F. (2021) · American Journal of Medical Genetics Part B: Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32872 · Cited by 24
Grief, Mindfulness and Neural Predictors of Improvement in Family Dementia Caregivers
Jain, F. A., Connolly, C. G., Moore, L. C., Leuchter, A. F., Abrams, M., Ben-Yelles, R. W., Chang, S. E., Ramirez Gomez, L. A., Huey, N., Lavretsky, H., et al. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00155 · Cited by 18
“For the regression analyses, the smoothing of the data was accounted for using the average of the spatial auto-correlation function (ACF) parameters from the individual subject’s data (Cox et al., 2017).”
MethodReward Processing in Psychiatric Inpatients With Depression
Oh, H., Lee, J., Patriquin, M. A., Oldham, J., & Salas, R. (2023) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2021.05.010 · Cited by 14
Time for a paradigm shift: the adolescent brain in addiction treatment
Mackiewicz Seghete, K. L., Filbey, F. M., Hudson, K. A., Hyun, B., & Feldstein Ewing, S. W. (2022) · NeuroImage: Clinical · doi:10.1016/j.nicl.2022.102960 · Cited by 8
“This selection represents the most contemporary recommended approach for nonparametric correction for multiple comparisons and utilizes the latest version of 3dClustsim to protect against Type 1 errors (Cox et al., 2017; Eklund et al., 2019).”
MethodIdentifying subgroups of urge suppression in Obsessive-Compulsive Disorder using machine learning
Eng, G. K., De Nadai, A. S., Collins, K. A., Recchia, N., Tobe, R. H., Bragdon, L. B., & Stern, E. R. (2024) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2024.06.052 · Cited by 6
Metadata
- Authors
- Cox, R. W., Chen, G., Glen, D. R., Reynolds, R. C., & Taylor, P. A.
- Venue
- Brain Connectivity
- Publisher
- SAGE Publications
- Published
- 2017-04
- Volume
- 7
- Issue
- 3
- Pages
- 152-171
- ISSN
- 2158-0014 (ISSN-L)
- 2158-0022
- OpenAlex
- W2588860206
- Cited by
- 862
- References
- 1
- FWCI
- 63.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.