Meta-analysis of functional neuroimaging data: current and future directions
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Meta-analysis is an increasingly popular and valuable tool for summarizing results across many neuroimaging studies. It can be used to establish consensus on the locations of functional regions, test hypotheses developed from patient and animal studies and develop new hypotheses on structure-function correspondence. It is particularly valuable in neuroimaging because most studies do not adequately correct for multiple comparisons; based on statistical thresholds used, we estimate that roughly 10-20% of reported activations in published studies are false positives. In this article, we briefly summarize some of the most popular meta-analytic approaches and their limitations, and we outline a revised multilevel approach with increased validity for establishing consistency across studies. We also discuss multivariate methods by which meta-analysis can be used to develop and test hypotheses about co-activity of brain regions. Finally, we argue that meta-analyses can make a uniquely valuable contribution to predicting psychological states from patterns of brain activity, and we briefly discuss some methods for making such predictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“individual neuroimaging studies are often underpowered and exhibit relatively high false positive rate2-4”
From Large-scale automated synthesis of human functional neuroimaging data. (2011) · cites this paper as [3]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Further, each contrast is weighted by the sample size and study quality (i.e.whether the study used fixed or random effects model; Wager et al., 2007;Kober and Wager, 2010).”
From The inhibition of automatic imitation: a meta-analysis and synthesis of fMRI studies (2018) · cites this paper as Wager et al., 2007
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Applied Linear Statistical Models
Ziegel, E. R., Neter, J., Wasserman, W., & Kutner, M. (1992) · Technometrics · doi:10.2307/1269588 · Cited by 9,907
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 1×
“Thus, if peak coordinates are used in meta-analysis, the problem of unreported activation coordinates (the ‘file drawer problem’) (Rosenthal, 1979) is greatly reduced, though not completely eliminated.”
BackgroundApplied Linear Statistical Models
(1997) · Technometrics · doi:10.1080/00401706.1997.10485141 · Cited by 7,185
Nonparametric permutation tests for functional neuroimaging: A primer with examples
Nichols, T. E., & Holmes, A. P. (2002) · Human Brain Mapping · doi:10.1002/hbm.1058 · Cited by 6,256
Talairach, J., Tournoux, P., & Rayport, M. (1988) · Thieme eBooks · Cited by 5,058
Thresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923 · cited 2×
“In recent implementations of the ALE approach (Laird et al., 2005), ALE statistics are subjected to false discovery rate (FDR) correction (Genovese et al., 2002), which ensures that at P 0.05 corrected, on average, 5% of the reported voxels are false positives (i.e. no peak truly falls within that…”
MethodInfluentialMeta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635 · cited 1×
“Meta-analyses in other research areas often combine effect sizes of a single effect to test for consistency (Rosenthal, 1991).”
BackgroundMeta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · The Statistician · doi:10.2307/2348600 · Cited by 4,249
Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910330508 · Cited by 3,202 · cited 2×
“005 with an eight-voxel extent that was reported to achieve ‘corrected’ false-positive control in simulations based on a single dataset (Forman et al., 1995).”
BackgroundInfluentialThe language-as-fixed-effect fallacy: A critique of language statistics in psychological research
Clark, H. H. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80014-3 · Cited by 2,222 · cited 2×
“The pitfalls of treating random effects as fixed effects have been widely discussed in statistics (Neter et al., 1996; Shayle et al., 2006) and in psychology (Clark, 1973).”
Background
Research works printed but not linked: 1
- Shayle, R., Searle, G.C., McCulloch, C.E. (2006). Variance Components. Hoboken, NJ: Wiley-Interscience.
Cited by
Items 201–300 of 453
Time is body: multimodal evidence of crosstalk between interoception and time estimation
Richter, F., & Ibáñez, A. (2021) · Biological Psychology · doi:10.1016/j.biopsycho.2021.108017 · Cited by 40
Brain activation elicited by acute stress: An ALE meta-analysis
Qiu, Y., Fan, Z., Zhong, M., Yang, J., Wu, K., Hu, H., Zhang, R., Guo, Y. Q., Lee, T. M. C., & Huang, R. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.11.020 · Cited by 40
Unpacking reappraisal: a systematic review of fMRI studies of distancing and reinterpretation
Denny, B. T., Jungles, M. L., Goodson, P. N., Dicker, E. E., Chavez, J., Jones, J. S., & Lopez, R. B. (2023) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsad050 · Cited by 42
“To perform the meta-analyses above, we used multilevel kernel density analysis (MKDA; Wager et al. , 2007).”
What are emotions and how are they created in the brain?
Lindquist, K., Wager, T., Bliss-Moreau, E., Kober, H., & Barrett, L. F. (2012) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1100183x · Cited by 40
“These analyses are standard for neuroimaging meta-analysis (see Wager et al. 2007) and are described in detail in the supplementary materials.”
Self-citationHuang, X., Rootes-Murdy, K., Bastidas, D. M., Nee, D. E., & Franklin, J. C. (2020) · Scientific Reports · doi:10.1038/s41598-020-59490-6 · Cited by 40
Social Psychology and Neuroscience: Strange Bedfellows or a Healthy Marriage?
Dovidio, J. F., Pearson, A. R., & Orr, P. T. (2008) · Group Processes & Intergroup Relations · doi:10.1177/1368430207088041 · Cited by 43
Body in mind training: mindful movement for the clinical setting *
Russell, T. A., & Tatton-Ramos, T. P. (2018) · Eastern Influences on Neuropsychotherapy · doi:10.4324/9780429466618-7 · Cited by 36
Ranzini, M., Scarpazza, C., Raduà, J., Cutini, S., Semenza, C., & Zorzi, M. (2022) · Cortex · doi:10.1016/j.cortex.2021.12.007 · Cited by 38
Cognitive and Motivational Functions of the Human Prefrontal Cortex
Van Snellenberg, J. X., & Wager, T. D. (2009) · Luria's Legacy in the 21st Century · doi:10.1093/acprof:oso/9780195176704.003.0004 · Cited by 36
“These methods are summarized in the individual papers and in a recent paper on meta-analysis methods (Wager, Lindquist, and Kaplan 2007), and we do not review them in detail here.”
MethodSelf-citationQiu, Y., Wu, Y., Liu, R., Wang, J., Huang, H., & Huang, R. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.06.012 · Cited by 36
The impact of sociality and affective valence on brain activation: A meta-analysis
Atzil, S., Satpute, A. B., Zhang, J., Parrish, M. H., Shablack, H., MacCormack, J. K., Leshin, J. C., Goel, S., Brooks, J. A., Kang, J., et al. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.119879 · Cited by 35
Gray matter atrophy in narcolepsy: An activation likelihood estimation meta-analysis
Weng, H., Chen, C., Tsai, Y., Wu, C., Lee, M., Lin, Y., Yang, C., Tsai, Y., & Yang, C. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.03.009 · Cited by 35
A research agenda for understanding how social inequality is linked to brain structure and function
Hatzenbuehler, M. L., McLaughlin, K. A., Weissman, D. G., & Cikara, M. (2024) · Nature Human Behaviour · doi:10.1038/s41562-023-01774-8 · Cited by 30
Hu, X., Zhang, L., Bu, X., Li, H., Gao, Y., Lu, L., Tang, S., Wang, Y., Huang, X., & Gong, Q. (2020) · Depression and Anxiety · doi:10.1002/da.23008 · Cited by 34
How gut hormones shape reward: A systematic review of the role of ghrelin and GLP-1 in human fMRI
Schulz, C., Vezzani, C., & Kroemer, N. B. (2023) · Physiology & Behavior · doi:10.1016/j.physbeh.2023.114111 · Cited by 33
Lau, W. K., Leung, M.-K., & Zhang, R. (2020) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.109986 · Cited by 37
“First, MKDA accounts for the fact that individual activation peaks are nested within contrast maps (i.e., maps of particular comparisons within studies), rendering these maps the units of analysis and modeling contrast maps as a random effect, and eliminating the possibility of one contrast map with many peaks dominat…”
InfluentialNeural systems underlying RDoC social constructs: An activation likelihood estimation meta-analysis
Lobo, R. P., Bottenhorn, K. L., Riedel, M. C., Toma, A. I., Hare, M. M., Smith, D. D., Moor, A. C., Cowan, I., Valdes, J. A., Bartley, J. E., et al. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104971 · Cited by 34
Gray Matter Deficits in Panic Disorder: A Pilot Study of Meta-Analysis
Lai, C.-H. (2011) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0b013e31821a1045 · Cited by 32
“kernel density analysis.(21) The reasons to choose SDM were as follows: 1.”
BackgroundA Meta-Analytic Study of the Neural Systems for Auditory Processing of Lexical Tones
Kwok, V. P. Y., Guo, D., Yakpo, K., Matthews, S., Fox, P. T., Li, P., & Tan, L. H. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00375 · Cited by 36
Burles, F., Umiltà, A. M., McFarlane, L. H., Potocki, K., & Iaria, G. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00190 · Cited by 33
“We then passed all coordinates from classified contrasts to aMultilevel Kernel Density Analysis (MKDA;Wager et al., 2007).”
MethodFede, S. J., & Kiehl, K. A. (2019) · Brain Imaging and Behavior · doi:10.1007/s11682-019-00035-5 · Cited by 39
“Additionally, treating the studies as a random effect instead of a fixed effect prevents individual studies from driving the results (Wager et al. 2007).”
BackgroundSip, K. E., Carmel, D., Agustus, J. L., Li, J., Petrović, P., Roepstorff, A., McGregor, W. B., & Frith, C. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00016 · Cited by 38
“Results are reported for clusters with at least 10 voxels and a significance threshold of p < 0.001 (uncorrected for multiple comparisons; Wager et al., 2007).”
BackgroundInfluentialMeta-analysis of functional neuroimaging data using Bayesian nonparametric binary regression
Yu, Y., Lindquist, M. A., & Loh, J. M. (2012) · The Annals of Applied Statistics · doi:10.1214/11-aoas523 · Cited by 33
Self-citationMeta-Analyses in Basic and Clinical Neuroscience: State of the Art and Perspective
Eickhoff, S. B., & Bzdok, D. (2013) · Springer eBooks · doi:10.1007/978-3-642-34342-1_7 · Cited by 30
Allaire‐Duquette, G., Bélanger, M., Grabner, R. H., Koschutnig, K., & Masson, S. (2019) · Journal of Neuroscience Research · doi:10.1002/jnr.24435 · Cited by 31
Zhou, C., Li, J., Dong, M., Ping, L., Lin, H., Wang, Y., Wang, S., Gao, S., Yu, G., Cheng, Y., et al. (2021) · Frontiers in Endocrinology · doi:10.3389/fendo.2021.658198 · Cited by 30
Manuello, J., Costa, T., Cauda, F., & Liloia, D. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104659 · Cited by 28
Sadigh‐Eteghad, S., Majdi, A., Farhoudi, M., Talebi, M., & Mahmoudi, J. (2014) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2014.05.066 · Cited by 32
“It can be used to establish consensus on the locations of functional regions, test hypotheses developed from patient and animal studies and develop new hypotheses on structure–function correspondence [54].”
BackgroundMacCormack, J. K., Stein, A. G., Kang, J., Giovanello, K. S., Satpute, A. B., & Lindquist, K. A. (2020) · Affective Science · doi:10.1007/s42761-020-00016-8 · Cited by 29
Quantifying the diversity of neural activations in individual brain regions
Anderson, M. L., & Pessoa, L. (2011) · eScholarship (California Digital Library) · Cited by 31
Salimi‐Khorshidi, G., Nichols, T. E., Smith, S. M., & Woolrich, M. W. (2011) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2011.2122341 · Cited by 30
“... neuroimaging studies rarely make public the full image data and instead only report the magnitude and coordinates of their activation peaks in the papers; a collection of such information can be found in databases such as BrainMap 1 [6].Withcoordinate-baseddata,therearetwowidelyusedmetaanalysis methods: activation…”
BackgroundMethodInfluentialSpatial Bayesian Latent Factor Regression Modeling of Coordinate-based Meta-analysis Data
Montagna, S., Wager, T. D., Barrett, L. F., Johnson, T. D., & Nichols, T. E. (2017) · Biometrics · doi:10.1111/biom.12713 · Cited by 27
Self-citationRESIDUAL ANALYSIS FOR DETECTING MIS-MODELING IN fMRI
Loh, J. M., Lindquist, M. A., & Wager, T. D. (2008) · Cited by 27
Self-citationXia, H., Hou, Y., Li, Q., & Chen, A. (2024) · Human Brain Mapping · doi:10.1002/hbm.70031 · Cited by 30
“Second, unlike the habit-based choice of kernel size in MKDA (Wager et al., 2007; Wager et al., 2009), this study used an adaptive approach to determine the kernel size, which allowed the maximum of statistical sensitivity for regions with different activation patterns in older adults.”
BackgroundMethodInfluentialLearning partially directed functional networks from meta-analysis imaging data
Neumann, J., Fox, P. T., Turner, R., & Lohmann, G. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.09.056 · Cited by 27
“…can be modelled using variants of kernel density estimation for fMRI meta-analysis data, such as activation likelihood estimation (ALE) (Turkeltaub et al., 2002; Chein et al., 2002; Laird et al., 2005a), kernel density analysis (KDA) (Wager et al., 2004) or multilevel KDA (Wager et al., 2007).”
Costa, C., Cristea, I. A., Bò, E. D., Melloni, C., & Gentili, C. (2021) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13412 · Cited by 26
Tang, T., Huang, L., Zhang, Y., Li, Z., & Liang, S. (2022) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2022.961344 · Cited by 26
“The method converges different studies and simulates the likelihood of coordinate distribution according to the algorithm (Laird et al., 2005; Wager et al., 2007; Costafreda, 2009; Tanasescu et al., 2016).”
MethodDomestic dogs as a comparative model for social neuroscience: Advances and challenges
Boch, M., Huber, L., & Lamm, C. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105700 · Cited by 28
“Thus, considering the insufficient data reporting and lack of data sharing practices, gathering cumulative evidence is currently challenging and prevents quantitative meta-analyses (see e.g., Salimi--Khorshidi et al., 2009; Wager et al., 2007 for review of image-and coordinate-based approaches).”
Localization and Intrinsic Function
Rathkopf, C. A. (2013) · Philosophy of Science · doi:10.1086/668878 · Cited by 31
“…motivation for imposing this condition is a body of empirical evidence from imaging meta-analyses that suggest that brain areas traditionally associated with one cognitive domain in fact participate in processes that span multiple domains ðCabeza and Nyberg 2000; Wager, Lindquist, and Kaplan 2007Þ.”
BackgroundCostafreda, S. G. (2012) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2012.07.016 · Cited by 26
Abdallah, M., Zanitti, G., Iovène, V., & Wassermann, D. (2022) · eLife · doi:10.7554/elife.76926 · Cited by 25
Yeung, A. W. K., Robertson, M., Uecker, A. M., Fox, P. T., & Eickhoff, S. B. (2022) · Human Brain Mapping · doi:10.1002/hbm.26177 · Cited by 26
“analysis (KDA), for which a significant result indicates that the density of peaks within r mm of a voxel is greater than that can be expected by chance (Wager et al., 2007).”
BackgroundKellermann, T. S., Caspers, S., Fox, P. T., Zilles, K., Roski, C., Laird, A. R., Turetsky, B. I., & Eickhoff, S. B. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.01.046 · Cited by 27
“In spite of its emerging success (cf. Cauda et al., 2011a; Eickhoff et al., 2011; Jakobs et al., 2012; Reetz et al., 2012; Wager et al., 2007), a few conceptual peculiarities and potential limitations should be considered.”
BackgroundAffective educational games: Utilizing emotions in game-based learning
Wilkinson, P. N. (2013) · International Conference on Games and Virtual Worlds for Serious Applications · doi:10.1109/vs-games.2013.6624219 · Cited by 28
Förster, K., Maliske, L., Schurz, M., Henneberg, P. M., Dannlowski, U., & Kanske, P. (2023) · Bipolar Disorders · doi:10.1111/bdi.13341 · Cited by 25
“Methodologically, SDM contains some features from other widely used methods for meta-analysis, such as Activation Likelihood Estimation (ALE 33 ), or Multilevel Kernel Density Analysis (MKDA 34 ), but extends them by allowing for an inclusion of effect sizes from the original studies.”
MethodCarp, J. (2013) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-013-0188-0 · Cited by 24
Coordinate based random effect size meta-analysis of neuroimaging studies
Tench, C. R., Tănăsescu, R., Constantinescu, C. S., Auer, D. P., & Cottam, W. J. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.04.002 · Cited by 26
“, 2012) and the multi-level kernel density (MKDA) algorithm (Wager et al., 2007).”
BackgroundFinding specificity in structural brain alterations through Bayesian reverse inference
Cauda, F., Nani, A., Liloia, D., Manuello, J., Premi, E., Duca, S., Fox, P. T., & Costa, T. (2020) · Human Brain Mapping · doi:10.1002/hbm.25105 · Cited by 26
Data-Driven Extraction of a Nested Model of Human Brain Function
Bolt, T., Nomi, J. S., Yeo, B. T. T., & Uddin, L. Q. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.0323-17.2017 · Cited by 24
“Coordinate-based analyses are inherently limited due to their reduction of full statistic images to peak-activation coordinates (SalimiKhorshidi et al., 2009; Poldrack and Yarkoni, 2016); and at present, there are no universal standards for reporting activation coordinates (Wager et al., 2007).”
BackgroundAlterations in Structural and Functional Connectivity in ADHD: Implications for Theories of ADHD
González-Madruga, K., Staginnus, M., & Fairchild, G. F. (2022) · Current topics in behavioral neurosciences · doi:10.1007/7854_2022_345 · Cited by 23
Samartsidis, P., Eickhoff, C. R., Eickhoff, S. B., Wager, T. D., Barrett, L. F., Atzil, S., Johnson, T. D., & Nichols, T. E. (2018) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/rssc.12295 · Cited by 25
Self-citationSinha, P., Joshi, H., & Ithal, D. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.616054 · Cited by 24
Frahm, L., Cieslik, E. C., Hoffstaedter, F., Satterthwaite, T. D., Fox, P. T., Langner, R., & Eickhoff, S. B. (2022) · Human Brain Mapping · doi:10.1002/hbm.25898 · Cited by 22
“…offering a synthesis of findings across paradigms and processing pipelines and thereby allowing more conclusive inference, even if the average power level of the included studies was questionable (Botvinik-Nezer et al., 2020; Cremers et al., 2017; Eickhoff et al., 2016; Wager et al., 2007).”
BackgroundHiew, S., Roothans, J., Eldebakey, H., Volkmann, J., Zeller, D., & Reich, M. M. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105187 · Cited by 24
Xiao, Y., Zhang, W., Lui, S., Li, Y., & Gong, Q. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00150 · Cited by 23
Neurobiological correlates of post-traumatic stress disorder: A focus on cerebellum role
Carletto, S., & Borsato, T. (2017) · European Journal of Trauma & Dissociation · doi:10.1016/j.ejtd.2017.03.012 · Cited by 24
Verbal and nominal agreement: An fMRI study
Carreiras, M., Quiñones, I., Mancini, S., Hernandez-Cabrera, J. A., & Barber, H. A. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.06.075 · Cited by 25
“such as response inhibition, task switching and attentional interference control (Aron et al., 2003; Aron and Poldrack, 2006; 2004; Levy and Wagner, 2011; Michael et al., 2006; see also Wager and Barrett, 2004; Wager et al., 2007; 2005).”
BackgroundBossier, H., Seurinck, R., Kühn, S., Banaschewski, T., Barker, G. J., Bokde, A. L. W., Martinot, J. L., Lemaître, H., Paus, T., Millenet, S., et al. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00745 · Cited by 22
Tench, C. R., Tănăsescu, R., Auer, D. P., Cottam, W. J., & Constantinescu, C. S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0106735 · Cited by 20
“Statistical significance in the ALE method is judged relative to a null distribution of ALEs, generated by permutation of the foci throughout a grey matter (GM) mask [2,7].”
MethodBrain Connections – Resting State fMRI Functional Connectivity
de la Iglesia-Vayá, M., Molina‐Mateo, J., Jose, M., Ahmad, S., & Martí‐Bonmatí, L. (2013) · InTech eBooks · doi:10.5772/52273 · Cited by 22
“The goal of this analysis is to locate regions consistently activated (if any) on a set of diverse and independent studies, which are related to the same psychological state [26].”
BackgroundSubject‐specific segregation of functional territories based on deep phenotyping
Pinho, A. L., Amadon, A., Fabre, M., Dohmatob, E., Denghien, I., Torre, J. J., Ginisty, C., Becuwe-Desmidt, S., Roger, S., Laurier, L., et al. (2020) · Human Brain Mapping · doi:10.1002/hbm.25189 · Cited by 18
Effects of Exercise on Parkinson’s Disease: A Meta-Analysis of Brain Imaging Studies
Li, J., Guo, J., Sun, W., Mei, J., Wang, Y., Zhang, L., Zhang, J., Gao, J., Su, K., Lv, Z., et al. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.796712 · Cited by 22
“The basic principle of ALE is to calculate the probability that each voxel is activated under certain conditions in each experiment and to statistically analyze these data (Wager et al., 2007).”
BackgroundImaging depletion: fMRI provides new insights into the processes underlying ego depletion*
Berkman, E. T., & Miller-Ziegler, J. S. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss111 · Cited by 20
Label-based meta-analysis of functional brain dysconnectivity across mood and psychotic disorders
Grot, S., Smine, S., Potvin, S., Darcey, M., Pavlov, V., Genon, S., Nguyen, H. D., & Orban, P. (2024) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2024.110950 · Cited by 19
Alhazmi, F. H., Beaton, D., & Abdi, H. (2018) · Human Brain Mapping · doi:10.1002/hbm.24038 · Cited by 17
“In general, the aims of such analyses are to (1) test or refute findings and hypotheses (Wager et al. 2007), (2) build a consensus around particular models, hypotheses, or theories (Salimi-Khorshidi et al. 2009), (3) estimate consistency of findings (Wager et al. 2009), (4) help define related…”
BackgroundUniversality and language specificity of brain Reading networks: A developmental perspective
Zhang, J., Chen, J., & Ding, G. (2024) · Developmental Science · doi:10.1111/desc.13379 · Cited by 16
Methods for decoding cortical gradients of functional connectivity
Peraza, J. A., Salo, T., Riedel, M. C., Bottenhorn, K. L., Poline, J., Dockès, J., Kent, J. D., Bartley, J. E., Flannery, J. S., Hill-Bowen, L. D., et al. (2024) · Imaging Neuroscience · doi:10.1162/imag_a_00081 · Cited by 17
Silver, H., & Bilker, W. B. (2015) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2015.1080157 · Cited by 16
Meditation and the Brain in Health and Disease
Fox, K. C. R., & Cahn, B. R. (2020) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198808640.013.23 · Cited by 17
Coordinate based meta-analysis does not show grey matter atrophy in narcolepsy
Tănăsescu, R., Tench, C. R., Cottam, W. J., Constantinescu, C. S., & Auer, D. P. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.07.016 · Cited by 17
Activation Likelihood Estimation Neuroimaging Meta-Analysis: a Powerful Tool for Emotion Research
Costa, T., Ferraro, M., Manuello, J., Camasio, A., Nani, A., Mancuso, L., Cauda, F., Fox, P. M., & Liloia, D. (2024) · Psychology Research and Behavior Management · doi:10.2147/prbm.s453035 · Cited by 15
“25 Moreover, differences in experimental protocols 27 and fMRI data processing pipelines 28 additional sources of heterogeneity.”
BackgroundMao, Y., Fan, L., Feng, C., & Dai, Z. (2025) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2025.106120 · Cited by 16
Standardized Effect Sizes and Image-Based Meta-Analytical Approaches for fMRI Data
Bossier, H., Nichols, T. E., & Moerkerke, B. (2019) · doi:10.1101/865881 · Cited by 14
“Scientifically, this can be done using different meta-analytical techniques (Wager et al., 2007; Costafreda, 2009).”
MethodA Cortical Surface-Based Meta-Analysis of Human Reasoning
Shin, M., & Jeon, H. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab174 · Cited by 15
“The 2 well-known methods for coordinate-based meta-analysis are a multilevel kernel density analysis (MKDA) (Wager et al. 2007) and an activation likelihood estimation (ALE) (Turkeltaub et al. 2002).”
Nilsson, M., & Kalckert, A. (2021) · European Journal of Neuroscience · doi:10.1111/ejn.15534 · Cited by 14
“…2013; Carp, 2012b), low reproducibility (e.g., Botvinik-Nezer et al., 2020; Carp, 2012a) and increased false-positive rates (Eklund et al., 2016; Wager et al., 2007), meta-analysis provides an approach for overcoming these limitations, facilitates cumulative science (Lakens et al., 2016) and is…”
BackgroundTench, C. R., Tănăsescu, R., Auer, D. P., & Constantinescu, C. S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0070143 · Cited by 15
“In common with the most recent versions of the ALE and MKDA methods, we recognise that within study overlapping foci can form meaningful clusters that should be preserved under randomisation [5,9]; the aim being to preserve the distribution of MA values.”
BackgroundMethodResultInfluentialZuo, N., Yang, Z., Liu, Y., Li, J., & Jiang, T. (2017) · Brain and Behavior · doi:10.1002/brb3.893 · Cited by 15
McKenna, R., Rushe, T., & Woodcock, K. A. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00154 · Cited by 13
“The ALE method calculates the number of activation peaks across each brain region and compares this to a uniform activation distribution representative of a null hypothesis (which is when there are not enough peaks in a voxel to indicate that at least one peak truly activates in that voxel; Wager et al., 2007).”
MethodLong, J., Song, X., Wang, Y., Wang, C., Huang, R., & Zhang, R. (2022) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2022.938789 · Cited by 13
“Meta-analyses were performed using the Multilevel kernel density analysis (MKDA) (Wager et al., 2007) toolbox 1 to identify the brain regions activated during inhibitory control.”
InfluentialSynchrony and subjective experience: the neural correlates of the stream of consciousness
Lieberman, M. D. (2025) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2025.04.007 · Cited by 14
“To assess the reliability of these effects, a multi-level kernel density analysis (MKDA) [55] was performed on these studies (Figure 1).”
Langner, R., & Camilleri, J. A. (2021) · Springer eBooks · doi:10.1007/978-3-030-59797-9_5 · Cited by 17
Clustering the Brain With “CluB”: A New Toolbox for Quantitative Meta-Analysis of Neuroimaging Data
Berlingeri, M., Devoto, F., Gasparini, F., Saibene, A., Corchs, S., Clemente, L., Danelli, L., Gallucci, M., Borgoni, R., Borghese, N. A., et al. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.01037 · Cited by 13
Qi, L., Xu, C., Wang, X., Du, J., He, Q., Wu, D., Wang, X., Jin, G., Wang, Q., Chen, J., et al. (2022) · Communications Biology · doi:10.1038/s42003-022-04084-3 · Cited by 13
Meditation and the brain in health and diseasePreprint
Fox, K. C. R., & Cahn, B. R. (2018) · MindRxiv (OSF Preprints) · doi:10.31231/osf.io/m2sez · Cited by 15
Zhang, Y., Lu, H., Ren, X., Zhang, J., Wang, Y., Zhang, C., & Zhao, X. (2024) · Frontiers in Neuroscience · doi:10.3389/fnins.2024.1392002 · Cited by 12
Mansueto, S. P., Romeo, Z., Angrilli, A., & Spironelli, C. (2024) · NeuroImage · doi:10.1016/j.neuroimage.2024.120986 · Cited by 13
Neurosynth Compose: A web-based platform for flexible and reproducible neuroimaging meta-analysis
Kent, J. D., Lee, N., Laird, A. R., Salo, T., Peraza, J., Bottenhorn, K. L., Oudyk, K., Nichols, T. E., Poline, J., & de la Vega, A. (2026) · Imaging Neuroscience · doi:10.1162/imag.a.1114 · Cited by 14
“Quantitative meta-analysis has emerged as a crucial tool for aggregating findings, identifying consensus, and generating novel hypotheses ( Wager et al., 2007).”
Neural Correlates Associated With Novices Correcting Errors in Electricity and Mechanics
Nenciovici, L., Foisy, L. B., Allaire‐Duquette, G., Potvin, P., Riopel, M., & Masson, S. (2018) · Mind Brain and Education · doi:10.1111/mbe.12183 · Cited by 13
Regional abnormalities of spontaneous brain activity in migraine: A coordinate‐based meta‐analysis
Wen, J., Gao, Y., Li, M., Hu, S., Zhao, M., Su, C., Wáng, Q., Xi, H., Zhan, L., Lv, Y., et al. (2023) · Journal of Neuroscience Research · doi:10.1002/jnr.25191 · Cited by 14
“The meta- analytic approach could pool the existing results from several studies to obtain consistent results (Eickhoff et al., 2009; Radua et al., 2012, 2014; Wager et al., 2007; Walker et al., 2008).”
MethodResultInfluentialKlugah‐Brown, B., Bore, M. C., Liu, X., Gan, X., Biswal, B. B., Kendrick, K. M., Chang, D. H. F., Zhou, B., & Becker, B. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.05.016 · Cited by 12
Coordinate based meta-analysis of networks in neuroimaging studies
Tench, C. R., Tănăsescu, R., Constantinescu, C. S., Cottam, W. J., & Auer, D. P. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.116259 · Cited by 13
Begnoche, J. P., Schilling, K. G., Boyd, B. D., Cai, L. Y., Taylor, W. D., & Landman, B. A. (2022) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2022.05.016 · Cited by 13
Hazra, S., Sahu, S., Nayak, P., Sarkar, K., Srikumar, V., & Handa, G. (2022) · Neurology India · doi:10.4103/0028-3886.355137 · Cited by 12
A Minimum Bayes Factor Based Threshold for Activation Likelihood Estimation
Costa, T., Liloia, D., Cauda, F., Fox, P. T., Mutta, F. D., Duca, S., & Manuello, J. (2023) · Neuroinformatics · doi:10.1007/s12021-023-09626-6 · Cited by 11
“This issue can be overcome by means of coordinate-based meta-analysis (CBMA), a technique allowing to pool results from different experiments that investigated similar questions (Wager et al., 2007, 2009).”
MethodChu, C., Fan, L., Eickhoff, C. R., Liu, Y., Yang, Y., Eickhoff, S. B., & Jiang, T. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.05.069 · Cited by 11
“…likelihood estimation (ALE; (Eickhoff 70 et al., 2012; Eickhoff et al., 2009; Turkeltaub et al., 2002)) and related NeuroImage xxx (2015) xxx–xxx U N C O R R E C T E D P R O O F 71 techniques, such as (multilevel) kernel density analysis (KDA and 72 MKDA; (Wager et al., 2004; Wager et al., 2007)).”
InfluentialA novel meta-analytic approach: Mining frequent co-activation patterns in neuroimaging databases
Caspers, J., Zilles, K., Beierle, C., Rottschy, C., & Eickhoff, S. B. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.12.024 · Cited by 13
“The most common previous CBMA techniques are Activation Likelihood Estimation (ALE: Eickhoff et al., 2009, 2012; Turkeltaub et al., 2002) and (Multilevel) Kernel Density Analysis (KDA and MKDA: Wager et al., 2004; Wager et al., 2007).”
MethodProgress toward openness, transparency, and reproducibility in cognitive neurosciencePreprint
Gilmore, R. O., Diaz, M. T., Wyble, B., & Yarkoni, T. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/5veew · Cited by 11
He, D., Hao, Z., Zhao, M., Li, M., Hou, N., Yu, Y., Cheng, L. L., & Jia, X. (2025) · Translational Psychiatry · doi:10.1038/s41398-025-03488-z · Cited by 13
“The other is MKDA analysis using a multilevel kernel density analysis toolbox [76] in MATLAB2017b.”
Lakhani, N. V., Souther, M. K., Boateng, B., & Kable, J. W. (2026) · Imaging Neuroscience · doi:10.1162/imag.a.1170 · Cited by 11
“In the present meta-analysis, we primarily employ an alternative method used in a previous meta-analysis from our group ( Bartra et al., 2013) based on multilevel kernel density analysis (MKDA; Wager et al., 2007).”
InfluentialNeurobiological Impact of EMDR in Cancer
Carletto, S., & Pagani, M. (2016) · Journal of EMDR Practice and Research · doi:10.1891/1933-3196.10.3.153 · Cited by 12
Metadata
- Authors
- Wager, T. D., Lindquist, M., & Kaplan, L.
- Affiliations
- Columbia University (US)
- Venue
- Social Cognitive and Affective Neuroscience
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-06-01
- Volume
- 2
- Issue
- 2
- Pages
- 150-158
- ISSN
- 1749-5016 (ISSN-L)
- 1749-5024
- PMC
- PMC2555451
- OpenAlex
- W2137449272
- Cited by
- 434
- References
- 31
- Citations by year
- 2026: 12 · 2025: 25 · 2024: 22 · 2023: 18 · 2022: 34 · 2021: 23 · 2020: 28 · 2019: 28 · 2018: 27 · 2017: 29 · 2016: 19 · 2015: 24 · 2014: 19 · 2013: 27 · 2012: 22
- FWCI
- 1.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Social Cognitive and Affective Neuroscience (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- false positives, multiple testing correction, multilevel meta-analysis, multivariate meta-analysis, functional brain regions
- MeSH terms
- Forecasting, Humans, Magnetic Resonance Imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.