The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Implementation errors in the GingerALE Software: Description and recommendations
Open accessAbstract
Neuroscience imaging is a burgeoning, highly sophisticated field the growth of which has been fostered by grant‐funded, freely distributed software libraries that perform voxel‐wise analyses in anatomically standardized three‐dimensional space on multi‐subject, whole‐brain, primary datasets. Despite the ongoing advances made using these non‐commercial computational tools, the replicability of individual studies is an acknowledged limitation. Coordinate‐based meta‐analysis offers a practical solution to this limitation and, consequently, plays an important role in filtering and consolidating the enormous corpus of functional and structural neuroimaging results reported in the peer‐reviewed literature. In both primary data and meta‐analytic neuroimaging analyses, correction for multiple comparisons is a complex but critical step for ensuring statistical rigor. Reports of errors in multiple‐comparison corrections in primary‐data analyses have recently appeared. Here, we report two such errors in GingerALE, a widely used, US National Institutes of Health (NIH)‐funded, freely distributed software package for coordinate‐based meta‐analysis. These errors have given rise to published reports with more liberal statistical inferences than were specified by the authors. The intent of this technical report is threefold. First, we inform authors who used GingerALE of these errors so that they can take appropriate actions including re‐analyses and corrective publications. Second, we seek to exemplify and promote an open approach to error management. Third, we discuss the implications of these and similar errors in a scientific environment dependent on third‐party software. Hum Brain Mapp 38:7–11, 2017. © 2016 Wiley Periodicals, Inc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Jenkinson, M., Beckmann, C. F., Behrens, T. E. J., Woolrich, M. W., & Smith, S. M. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.015 · Cited by 11,314
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515 · cited 1×
“…software to make inferences regarding the structural and functional organization of the human brain in development, in adulthood, in aging, and in a wide variety of neurologic, psychiatric and systemic conditions in an ongoing and programmatic manner [Bandettini, 2012; Rosen and Savoy, 2012].”
MethodPower failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“…variations between studies apparently reporting on the same effect in the same condition), and the indirect nature of the neuroimaging measures used vis-(cid:2) a-vis the inferred neuronal physiology and pathology [Button et al., 2013, Carp, 2012; Glatard et al., 2015; Rottschy et al., 2013].”
BackgroundThresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
Cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates
Eklund, A., Nichols, T. E., & Knutsson, H. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1602413113 · Cited by 3,487
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Eickhoff, S. B., Laird, A. R., Grefkes, C., Wang, L. E., Zilles, K., & Fox, P. T. (2009) · Human Brain Mapping · doi:10.1002/hbm.20718 · Cited by 1,924
Self-citationComparing Functional (PET) Images: The Assessment of Significant Change
Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1991.122 · Cited by 1,625
Meta-analysis of the functional neuroanatomy of single-word reading: method and validation
Turkeltaub, P. E., Eden, G. F., Jones, K. M., & Zeffiro, T. A. (2002) · NeuroImage · doi:10.1006/nimg.2002.1131 · Cited by 1,604
Activation likelihood estimation meta-analysis revisited
Eickhoff, S. B., Bzdok, D., Laird, A. R., Kurth, F., & Fox, P. T. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.017 · Cited by 1,443
Self-citationType I and Type II error concerns in fMRI research: re-balancing the scale
Lieberman, M. D., & Cunningham, W. A. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp052 · Cited by 1,342
Turkeltaub, P. E., Eickhoff, S. B., Laird, A. R., Fox, M., Wiener, M., & Fox, P. (2012) · Human Brain Mapping · doi:10.1002/hbm.21186 · Cited by 1,119
Self-citationALE meta-analysis: controlling the false discovery rate and performing statistical contrasts
Laird, A. R., Fox, P. M., Price, C. J., Glahn, D. C., Uecker, A. M., Lancaster, J. L., Turkeltaub, P. E., Kochunov, P., & Fox, P. T. (2005) · Human Brain Mapping · doi:10.1002/hbm.20136 · Cited by 868
Self-citationEickhoff, S. B., Nichols, T. E., Laird, A. R., Hoffstaedter, F., Amunts, K., Fox, P. T., Bzdok, D., & Eickhoff, C. R. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.04.072 · Cited by 683
Self-citationAshburner, J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.025 · Cited by 517
Fox, P. T., Mintun, M. A., Reiman, E. M., & Raichle, M. E. (1988) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1988.111 · Cited by 498
Self-citationMapping context and content: the BrainMap model
Fox, P. T., & Lancaster, J. L. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn789 · Cited by 486
Self-citationEickhoff, S. B., Bzdok, D., Laird, A. R., Roski, C., Caspers, S., Zilles, K., & Fox, P. T. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.021 · Cited by 484 · cited 2×
“In addition, algorithms have been provided for meta-analytic contrast analyses using fixed-effects [Laird et al., 2005] and random-effects [Eickhoff et al., 2011] models.”
MethodSelf-citationFalse discovery rate revisited: FDR and topological inference using Gaussian random fields
CHUMBLEY, J., & FRISTON, K. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.05.021 · Cited by 464
On the Plurality of (Methodological) Worlds: Estimating the Analytic Flexibility of fMRI Experiments
Carp, J. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00149 · Cited by 381
Laird, A. R. (2009) · Frontiers in Neuroinformatics · doi:10.3389/neuro.11.023.2009 · Cited by 372
Self-citationAFNI: What a long strange trip it's been
Cox, R. W. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.08.056 · Cited by 341
Fox, P. T., & Mintun, M. A. (1989) · PubMed · Cited by 335
Self-citationTwenty years of functional MRI: The science and the stories
Bandettini, P. A. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.026 · Cited by 265
The BrainMap strategy for standardization, sharing, and meta-analysis of neuroimaging data
Laird, A. R., Eickhoff, S. B., Fox, P. M., Uecker, A. M., Ray, K. L., Saenz, J. J., McKay, D. R., Bzdok, D., Laird, R. W., Robinson, J. L., et al. (2011) · BMC Research Notes · doi:10.1186/1756-0500-4-349 · Cited by 211
Self-citationCognitive neuroscience 2.0: building a cumulative science of human brain function
Yarkoni, T., Poldrack, R. A., Van Essen, D. C., & Wager, T. D. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.08.004 · Cited by 174
Finding the Elusive Psychiatric “Lesion” With 21st-Century Neuroanatomy: A Note of Caution
Weinberger, D. R., & Radulescu, E. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.15060753 · Cited by 173
Meta-Analysis in Human Neuroimaging: Computational Modeling of Large-Scale Databases
Fox, P. T., Lancaster, J. L., Laird, A. R., & Eickhoff, S. B. (2014) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062012-170320 · Cited by 173
Self-citationReproducibility of neuroimaging analyses across operating systems
Tristan Glatard, B., Lewis, L. B., da Silva, R. F., Adalat, R., Beck, N., Lepage, C., Rioux, P., Rousseau, M.-É., Sherif, T., Deelman, E., et al. (2015) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2015.00012 · Cited by 149
Beyond the single study: function/location metanalysis in cognitive neuroimaging
Fox, P. T., Parsons, L. M., & Lancaster, J. L. (1998) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(98)80138-4 · Cited by 136
Self-citationfMRI at 20: Has it changed the world?
Rosen, B. R., & Savoy, R. L. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.03.004 · Cited by 123
Sharing the wealth: Neuroimaging data repositories
Eickhoff, S. B., Nichols, T. E., Horn, J. D. V., et al. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.10.079 · Cited by 108
Self-citationDifferentiated parietal connectivity of frontal regions for “what” and “where” memory
Rottschy, C., Caspers, S., Roski, C., Reetz, K., Dogan, I., Schulz, J. B., Zilles, K., Laird, A. R., Fox, P. T., & Eickhoff, S. B. (2012) · Brain Structure and Function · doi:10.1007/s00429-012-0476-4 · Cited by 102
Self-citationSpatial normalization origins: Objectives, applications, and alternatives
Fox, P. T. (1995) · Human Brain Mapping · doi:10.1002/hbm.460030302 · Cited by 71
Self-citationMeta-connectomics: human brain network and connectivity meta-analyses
Crossley, N. A., Fox, P. T., & Bullmore, E. T. (2016) · Psychological Medicine · doi:10.1017/s0033291715002895 · Cited by 54
Self-citationGoing Beyond Finding the “Lesion”: A Path for Maturation of Neuroimaging
Eickhoff, S. B., & Etkin, A. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.15101350 · Cited by 14
Self-citation
Cited by
Ten simple rules for neuroimaging meta-analysis
Müller, V. I., Cieslik, E. C., Laird, A. R., Fox, P. T., Radua, J., Mataix-Cols, D., Tench, C. R., Yarkoni, T., Nichols, T. E., Turkeltaub, P. E., et al. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.11.012 · Cited by 805
Self-citationOldham, S., Murawski, C., Fornito, A., Youssef, G., Yücel, M., & Lorenzetti, V. (2018) · Human Brain Mapping · doi:10.1002/hbm.24184 · Cited by 425
Large-scale functional neural network correlates of response inhibition: an fMRI meta-analysis
Zhang, R., Geng, X., & Lee, T. M. C. (2017) · Brain Structure and Function · doi:10.1007/s00429-017-1443-x · Cited by 398
Altered Brain Activity in Unipolar Depression Revisited: Meta-analyses of Neuroimaging Studies
Müller, V. I., Cieslik, E. C., Serbanescu, I., Laird, A. R., Fox, P. T., & Eickhoff, S. B. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.2783 · Cited by 304
Self-citationThe neural correlates of semantic control revisited
Jackson, R. L. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2020.117444 · Cited by 316
Metadata
- Authors
- Eickhoff, S. B., Laird, A. R., Fox, P. M., Lancaster, J. L., & Fox, P. T.
- Venue
- Human Brain Mapping
- Publisher
- Wiley
- Published
- 2016-08-11
- Volume
- 38
- Issue
- 1
- Pages
- 7-11
- ISSN
- 1065-9471 (ISSN-L)
- 1097-0193
- OpenAlex
- W2516407199
- Cited by
- 269
- References
- 36
- FWCI
- 18.41
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.