Meta-analytic methods for neuroimaging data explained
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
The number of neuroimaging studies has grown exponentially in recent years and their results are not always consistent. Meta-analyses are helpful to summarize this vast literature and also offer insights that are not apparent from the individual studies. In this review, we describe the main methods used for meta-analyzing neuroimaging data, with special emphasis on their relative advantages and disadvantages. We describe and discuss meta-analytical methods for global brain volumes, methods based on regions of interest, label-based reviews, voxel-based meta-analytic methods and online databases. Regions of interest-based methods allow for optimal statistical analyses but are affected by a limited and potentially biased inclusion of brain regions, whilst voxel-based methods benefit from a more exhaustive and unbiased inclusion of studies but are statistically more limited. There are also relevant differences between the different available voxel-based meta-analytic methods, and the field is rapidly evolving to develop more accurate and robust methods. We suggest that in any meta-analysis of neuroimaging data, authors should aim to: only include studies exploring the whole brain; ensure that the same threshold throughout the whole brain is used within each included study; and explore the robustness of the findings via complementary analyses to minimize the risk of false positives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Large-scale automated synthesis of human functional neuroimaging data.
Yarkoni, T., Poldrack, R. A., Nichols, T. E., Van Essen, D. C., & Wager, T. D. (2011) · Nature Methods · doi:10.1038/nmeth.1635 · Cited by 3,686
Functional neuroanatomy of emotion: A meta-analysis of emotion activation studies in PET and fMRI
Phan, K. L., Wager, T., Taylor, S. F., & Liberzon, I. (2002) · NeuroImage · doi:10.1006/nimg.2002.1087 · Cited by 3,502
Etkin, A., & Wager, T. D. (2007) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.07030504 · Cited by 3,391 · cited 1×
“Another example from the anxiety disorders literature is a multilevel KDA meta-analysis, which found that patients showed hyperactivations in the amygdala and insula [37].”
BackgroundEickhoff, S. B., Laird, A. R., Grefkes, C., Wang, L. E., Zilles, K., & Fox, P. T. (2009) · Human Brain Mapping · doi:10.1002/hbm.20718 · Cited by 1,924
Bias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699 · cited 1×
“Indeed, there is agreement on always including the residual heterogeneity in the weighting of the calculations [5-8].”
BackgroundWager, T. D., Phan, K. L., Liberzon, I., & Taylor, S. F. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00078-8 · Cited by 1,150 · cited 6×
“ALE: activation likelihood estimation; ES: effect size; KDA: kernel density analysis; ROI: region of interest; SDM: signed differential mapping.”
MethodInfluentialKempton, M. J., Salvador, Z., Munafò, M. R., Geddes, J. R., Simmons, A., Frangou, S., & Williams, S. C. R. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.60 · Cited by 886 · cited 1×
“org) by Kempton and colleagues [41,42], as well as the series of peak-coordinate databases from SDM meta-analyses (http://www.”
BackgroundVoxel-wise meta-analysis of grey matter changes in obsessive-compulsive disorder
Radua, J., & Mataix-Cols, D. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.055046 · Cited by 863 · cited 24×
“Mixed image- and coordinate-based meta-analyses Recently, effect size SDM (ES-SDM) was designed to allow the combination of studies from which images (statistical parametric maps) are available with studies from which only peak coordinates are reported, thus allowing a more exhaustive inclusion of studies, as well as…”
BackgroundResultInfluentialSelf-citationRadua, J., Mataix-Cols, D., Phillips, M. L., El-Hage, W., Kronhaus, D. M., Cardoner, N., & Surguladze, S. (2012) · European Psychiatry · doi:10.1016/j.eurpsy.2011.04.001 · Cited by 765 · cited 6×
“An image-based meta-analysis should be understood as a voxel-based version of the standard meta-analysis, that is, it consists of thousands of standard meta-analyses, each of them applied to a different voxel [2,19].”
BackgroundMethodResultInfluentialSelf-citationBora, E., Fornito, A., Pantelis, C., & Yücel, M. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.03.049 · Cited by 763 · cited 5×
“Interestingly, these hyperactivations were more observed in phobias, whilst patients with post-traumatic stress disorder displayed a hypoactivation of the MF/ACC.”
ResultInfluential
Cited by
Ten simple rules for neuroimaging meta-analysis
Müller, V. I., Cieslik, E. C., Laird, A. R., Fox, P. T., Radua, J., Mataix-Cols, D., Tench, C. R., Yarkoni, T., Nichols, T. E., Turkeltaub, P. E., et al. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.11.012 · Cited by 805
“Furthermore, due to the large number of studies, it is challenging to keep track of the wealth of findings (Radua and Mataix-Cols, 2012).”
BackgroundSelf-citationEickhoff, S. B., Nichols, T. E., Laird, A. R., Hoffstaedter, F., Amunts, K., Fox, P. T., Bzdok, D., & Eickhoff, C. R. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.04.072 · Cited by 683
“…analysis (MKDA (Kober and Wager, 2010; Nee et al., 2007; Wager et al., 2009)) and signed difference map analysis (SDM (Palaniyappan et al., 2012; Radua and Mataix-Cols, 2012; Radua et al., 2010)) have likewise been frequently used to investigate convergence across functional and structural…”
InfluentialZhou, H.-X., Chen, X., Shen, Y.-Q., Li, L., Chen, N.-X., Zhu, Z.-C., Castellanos, F. X., & Yan, C.-G. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2019.116287 · Cited by 656
“The presumed null hypothesis was that the effect sizes (instead of the peaks alone) would conform to the random distribution across the whole brain (Radua and Mataix-Cols, 2012).”
Fusar-Poli, P., Smieskova, R., Kempton, M. J., Ho, B. C., Andreasen, N. C., & Borgwardt, S. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.06.001 · Cited by 512
Anisotropic kernels for coordinate-based meta-analyses of neuroimaging studies
Radua, J., Rubia, K., Canales-Rodríguez, E. J., Pomarol-Clotet, E., Fusar-Poli, P., & Mataix-Cols, D. (2014) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2014.00013 · Cited by 406
“(19)], but one characteristic they share is that all convolve an isotropic kernel with the peak.”
BackgroundRadua, J., Borgwardt, S., Crescini, A., Mataix-Cols, D., Meyer-Lindenberg, A., McGuire, P. K., & Fusar-Poli, P. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.07.012 · Cited by 335
Self-citationEvaluation of the Social Motivation Hypothesis of Autism: A Systematic Review and Meta-analysis
Clements, C. C., Zoltowski, A. R., Yankowitz, L. D., Yerys, B. E., Schultz, R. T., & Herrington, J. D. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.1100 · Cited by 316
Voxel-based meta-analysis via permutation of subject images (PSI): Theory and implementation for SDM
Albajes-Eizagirre, A., Solanes, A., Vieta, E., & Radua, J. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2018.10.077 · Cited by 302
Self-citationA Hitchhiker's Guide to Functional Magnetic Resonance Imaging
Soares, J. M., Magalhães, R., Moreira, P. S., Sousa, A., Ganz, E., Sampaio, A., Alves, V., Marques, P., & Sousa, N. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00515 · Cited by 272
Radua, J., Vieta, E., Shinohara, R., Kochunov, P., Quidé, Y., Green, M. J., Weickert, C. S., Weickert, T., Bruggemann, J., Kircher, T., et al. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116956 · Cited by 258
Self-citationMarwood, L., Wise, T., Perkins, A. M., & Cleare, A. J. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.09.022 · Cited by 251
Paquola, C., Bennett, M. R., & Lagopoulos, J. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.08.011 · Cited by 217
Widespread structural brain changes in OCD: a systematic review of voxel-based morphometry studies
Piras, F., Piras, F., Chiapponi, C., Girardi, P., Caltagirone, C., & Spalletta, G. (2015) · Cortex · doi:10.1016/j.cortex.2013.01.016 · Cited by 214
Wigton, R., Radua, J., Allen, P., Averbeck, B., Meyer-Lindenberg, A., McGuire, P., Shergill, S. S., & Fusar-Poli, P. (2015) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.130289 · Cited by 179
Acar, F., Seurinck, R., Eickhoff, S. B., & Moerkerke, B. (2018) · PLOS ONE · doi:10.1371/journal.pone.0208177 · Cited by 154
Mapping anhedonia-specific dysfunction in a transdiagnostic approach: an ALE meta-analysis
Zhang, B., Lin, P., Shi, H., Öngür, D., Auerbach, R. P., Wang, X., Yao, S., & Wang, X. (2016) · Brain Imaging and Behavior · doi:10.1007/s11682-015-9457-6 · Cited by 152
Potential Reporting Bias in fMRI Studies of the Brain
David, S. P., Ware, J. J., Chu, I. M., Loftus, P. D., Fusar-Poli, P., Radua, J., Munafò, M. R., & Ioannidis, J. P. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0070104 · Cited by 130
Practical recommendations to conduct a neuroimaging meta-analysis for neuropsychiatric disorders
Tahmasian, M., Sepehry, A. A., Samea, F., Khodadadifar, T., Soltaninejad, Z., Javaheripour, N., Khazaie, H., Zarei, M., Eickhoff, S. B., & Eickhoff, C. R. (2019) · Human Brain Mapping · doi:10.1002/hbm.24746 · Cited by 126
Grace, S. A., Rossell, S. L., Heinrichs, M., Kordsachia, C., & Labuschagne, I. (2018) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2018.05.031 · Cited by 120
Martins, D., Rademacher, L., Gabay, A. S., Taylor, R., Richey, J. A., Smith, D. V., Goerlich, K. S., Nawijn, L., Cremers, H. R., Wilson, R., et al. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.12.034 · Cited by 119
Radua, J., Romeo, M., Mataix-Cols, D., & Fusar-Poli, P. (2013) · Current Medicinal Chemistry · doi:10.2174/0929867311320030017 · Cited by 91
Self-citationNeural correlates during working memory processing in major depressive disorder
Wang, X.-L., Du, M.-Y., Chen, T.-L., Chen, Z.-Q., Huang, X.-Q., Luo, Y., Zhao, Y.-J., Kumar, P., & Gong, Q.-Y. (2015) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2014.08.011 · Cited by 89
Rocchetti, M., Radua, J., Paloyelis, Y., Xenaki, L., Frascarelli, M., Caverzasi, E., Politi, P., & Fusar‐Poli, P. (2014) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12185 · Cited by 83
Feng, C., Becker, B., Huang, W., Wu, X., Eickhoff, S. B., & Chen, T. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.02.023 · Cited by 58
Fusar-Poli, P., Radua, J., Frascarelli, M., Mechelli, A., Borgwardt, S., Di Fabio, F., Biondi, M., Ioannidis, J. P. A., & David, S. P. (2014) · Human Brain Mapping · doi:10.1002/hbm.22384 · Cited by 56
“This was achieved by focusing on available voxel-based meta-analyses of VBM studies, such those performed with Activation Likelihood Estimate [Laird et al., 2005] or Signed Differential Mapping [Radua and Mataix-Cols, 2009, 2012; Radua et al., 2010a,2012a].”
MethodPuberty and functional brain development in humans: convergence in findings?
Dai, J., & Scherf, K. S. (2019) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2019.100690 · Cited by 51
Autism spectrum disorders: Neuroimaging findings from systematic reviews
Pua, E. P. K., Bowden, S. C., & Seal, M. L. (2017) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2016.11.005 · Cited by 37
Kalsi, N., Altavilla, D., Tambelli, R., Aceto, P., Trentini, C., Di Giorgio, C., & Lai, C. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00927 · Cited by 26
The neural signature of reality‐monitoring: A meta‐analysis of functional neuroimaging studies
Lavallé, L., Brunelin, J., Jardri, R., Haesebaert, F., & Mondino, M. (2023) · Human Brain Mapping · doi:10.1002/hbm.26387 · Cited by 24
“…was mainly chosen in the current study because it offers the key advantages of accounting for effect sizes and analyzing both positive and negative peaks in the same map, to counteract the effects of studies reporting opposite activation findings in the same areas (Radua & Mataix-Cols, 2012).”
BackgroundMethodHalliday, A. R., Vucic, S. N., Georges, B., LaRoche, M., Mendoza Pardo, M. A., Swiggard, L. O., McDonald, K., Olofsson, M., Menon, S. N., Francis, S. M., et al. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1474003 · Cited by 20
Liloia, D., Rocca, P., Brasso, C., Tanaka, M., Manuello, J., Crocetta, A., Duca, S., Costa, T., & Cauda, F. (2026) · Psychological Medicine · doi:10.1017/s0033291726103511 · Cited by 4
“…design employed the anatomical ALE, the most widely used meta-analytic algorithm worldwide with demonstrated unbiased spatial reconstruction (Eickhoff et al., 2016; Manuello et al., 2022; Müller et al., 2018; Radua & Mataix-Cols, 2012; Tahmasian et al., 2019), this constraint remains inherent.”
Li, G., Liu, Y., & Chen, A. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02478-9 · Cited by 4
“15)toidentifybrainregionsshowingtask-relatedactivation changesfollowingCWMT 90 , following established SDM procedures 22,91 .”
Metadata
- Authors
- Radua, J., & Mataix-Cols, D.
- Venue
- Biology of Mood & Anxiety Disorders
- Published
- 2012-03-08
- Volume
- 2
- Issue
- 1
- Pages
- 6-6
- ISSN
- 2045-5380 (ISSN-L)
- OpenAlex
- W1996300356
- Cited by
- 244
- References
- 21
- FWCI
- 12.38
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.