Meta-analysis of functional neuroimaging data: current and future directions
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Meta-analysis is an increasingly popular and valuable tool for summarizing results across many neuroimaging studies. It can be used to establish consensus on the locations of functional regions, test hypotheses developed from patient and animal studies and develop new hypotheses on structure-function correspondence. It is particularly valuable in neuroimaging because most studies do not adequately correct for multiple comparisons; based on statistical thresholds used, we estimate that roughly 10-20% of reported activations in published studies are false positives. In this article, we briefly summarize some of the most popular meta-analytic approaches and their limitations, and we outline a revised multilevel approach with increased validity for establishing consistency across studies. We also discuss multivariate methods by which meta-analysis can be used to develop and test hypotheses about co-activity of brain regions. Finally, we argue that meta-analyses can make a uniquely valuable contribution to predicting psychological states from patterns of brain activity, and we briefly discuss some methods for making such predictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“individual neuroimaging studies are often underpowered and exhibit relatively high false positive rate2-4”
From Large-scale automated synthesis of human functional neuroimaging data. (2011) · cites this paper as [3]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Further, each contrast is weighted by the sample size and study quality (i.e.whether the study used fixed or random effects model; Wager et al., 2007;Kober and Wager, 2010).”
From The inhibition of automatic imitation: a meta-analysis and synthesis of fMRI studies (2018) · cites this paper as Wager et al., 2007
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Applied Linear Statistical Models
Ziegel, E. R., Neter, J., Wasserman, W., & Kutner, M. (1992) · Technometrics · doi:10.2307/1269588 · Cited by 9,907
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 1×
“Thus, if peak coordinates are used in meta-analysis, the problem of unreported activation coordinates (the ‘file drawer problem’) (Rosenthal, 1979) is greatly reduced, though not completely eliminated.”
BackgroundApplied Linear Statistical Models
(1997) · Technometrics · doi:10.1080/00401706.1997.10485141 · Cited by 7,185
Nonparametric permutation tests for functional neuroimaging: A primer with examples
Nichols, T. E., & Holmes, A. P. (2002) · Human Brain Mapping · doi:10.1002/hbm.1058 · Cited by 6,256
Talairach, J., Tournoux, P., & Rayport, M. (1988) · Thieme eBooks · Cited by 5,058
Thresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923 · cited 2×
“In recent implementations of the ALE approach (Laird et al., 2005), ALE statistics are subjected to false discovery rate (FDR) correction (Genovese et al., 2002), which ensures that at P 0.05 corrected, on average, 5% of the reported voxels are false positives (i.e. no peak truly falls within that…”
MethodInfluentialMeta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635 · cited 1×
“Meta-analyses in other research areas often combine effect sizes of a single effect to test for consistency (Rosenthal, 1991).”
BackgroundMeta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · The Statistician · doi:10.2307/2348600 · Cited by 4,249
Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910330508 · Cited by 3,202 · cited 2×
“005 with an eight-voxel extent that was reported to achieve ‘corrected’ false-positive control in simulations based on a single dataset (Forman et al., 1995).”
BackgroundInfluentialThe language-as-fixed-effect fallacy: A critique of language statistics in psychological research
Clark, H. H. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80014-3 · Cited by 2,222 · cited 2×
“The pitfalls of treating random effects as fixed effects have been widely discussed in statistics (Neter et al., 1996; Shayle et al., 2006) and in psychology (Clark, 1973).”
Background
Research works printed but not linked: 1
- Shayle, R., Searle, G.C., McCulloch, C.E. (2006). Variance Components. Hoboken, NJ: Wiley-Interscience.
Cited by
Large-scale automated synthesis of human functional neuroimaging data.
Yarkoni, T., Poldrack, R. A., Nichols, T. E., Van Essen, D. C., & Wager, T. D. (2011) · Nature Methods · doi:10.1038/nmeth.1635 · Cited by 3,686
“Because individual neuroimaging studies are often underpowered and have relatively high false positive rate”
Self-citationEtkin, A., & Wager, T. D. (2007) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.07030504 · Cited by 3,391
“Furthermore, unlike other methods that rely on z-score weighting, our meta-analysis approach is better suited to assess the replicability of activation across studies (63).”
MethodInfluentialSelf-citationThayer, J. F., Åhs, F., Fredrikson, M., Sollers, J. J., & Wager, T. D. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.11.009 · Cited by 3,224
“Unlike some methods based only on reported activation coordinates, MKDA treats contrast maps (not peaks) as the unit of analysis, and therefore is suitable for evaluating the consistency of activation across studies (Kober et al., 2008; Wager et al., 2007; Wager et al., 2009a).”
MethodSelf-citationDysfunction of the prefrontal cortex in addiction: neuroimaging findings and clinical implications
Goldstein, R. Z., & Volkow, N. D. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3119 · Cited by 2,749
The brain basis of emotion: a meta-analytic review
Lindquist, K. A., Wager, T. D., Kober, H., Bliss-Moreau, E., & Barrett, L. F. (2012) · Behavioral and Brain Sciences · doi:10.1017/s0140525x11000446 · Cited by 2,320
“First, metaanalysis can weed out false positives (which are frequent in neuroimaging studies; see Wager et al. 2007; Yarkoni 2009) and focus interpretation on the activations that are consistently observed.”
Self-citationKaiser, R. H., Andrews-Hanna, J. R., Wager, T. D., & Pizzagalli, D. A. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.0071 · Cited by 2,281
Self-citationSpreng, R. N., Mar, R. A., & Kim, A. S. N. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.21029 · Cited by 2,143
“Anatomical labels were then applied to the resultant clusters using the Talairach Daemon and visual inspection (for greater detail on the ALE method, see Laird, Fox, et al, 2005 ; Turkeltaub et al, 2002 ; for a discussion of meta-analytic approaches to neuroimaging data, see Wager, Lindquist, & Kaplan, 2007 ).”
MethodThe integration of negative affect, pain and cognitive control in the cingulate cortex
Shackman, A. J., Salomons, T. V., Slagter, H. A., Fox, A. S., Winter, J. J., & Davidson, R. J. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn2994 · Cited by 2,082
Bartra, O., McGuire, J. T., & Kable, J. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.063 · Cited by 1,927
“The importance of this consideration is widely recognized in the literature on CBMA methods (Turkeltaub et al., 2012; Wager et al., 2007).”
InfluentialEickhoff, S. B., Laird, A. R., Grefkes, C., Wang, L. E., Zilles, K., & Fox, P. T. (2009) · Human Brain Mapping · doi:10.1002/hbm.20718 · Cited by 1,924
“In line with previous approaches [Laird et al., 2005; Turkeltaub et al., 2002; Wager et al., 2007], the null-distribution for inference on the ALE scores is computed nonparametrically by a permutation procedure.”
BackgroundMethodResultCognitive Reappraisal of Emotion: A Meta-Analysis of Human Neuroimaging Studies
Buhle, J. T., Silvers, J. A., Wager, T. D., Lopez, R., Onyemekwu, C., Kober, H., Weber, J., & Ochsner, K. N. (2014) · Cerebral Cortex · doi:10.1093/cercor/bht154 · Cited by 1,896
“Next, we assessed the spatial density of reported peak coordinates using the Multilevel Kernel Density Analysis (MKDA) approach developed by Wager and colleagues (Wager et al. 2007; Kober et al. 2008; Kober and Wager 2010).”
BackgroundMethodSelf-citationPrefrontal-Subcortical Pathways Mediating Successful Emotion Regulation
Wager, T. D., Davidson, M. L., Hughes, B. L., Lindquist, M. A., & Ochsner, K. N. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.006 · Cited by 1,761
“We applied nonmetric multidimensional scaling (NMDS) analysis to the resulting dissimilarity matrix using stress as the error metric (details in (Wager et al., 2007b)), retaining four dimensions.”
InfluentialSelf-citationFractionating theory of mind: a meta-analysis of functional brain imaging studies
Schurz, M., Radua, J., Aichhorn, M., Richlan, F., & Perner, J. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.01.009 · Cited by 1,656
Activation likelihood estimation meta-analysis revisited
Eickhoff, S. B., Bzdok, D., Laird, A. R., Kurth, F., & Fox, P. T. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.017 · Cited by 1,443
“…experiment, generation of summary images per experiment and quantification of the convergence across these may empirically provide a good estimation on the distribution of statistical features of interest such as cluster size above a given threshold or maximum peak height (Wager et al., 2007b).”
BackgroundMethodResultInfluentialScanning the horizon: towards transparent and reproducible neuroimaging research
Poldrack, R. A., Baker, C. I., Durnez, J., Gorgolewski, K. J., Matthews, P. M., Munafò, M. R., Nichols, T. E., Poline, J.-B., Vul, E., & Yarkoni, T. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.167 · Cited by 1,410
Cluster-extent based thresholding in fMRI analyses: Pitfalls and recommendations
Woo, C.-W., Krishnan, A., & Wager, T. D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.12.058 · Cited by 1,253
“Second, cluster-extent based thresholding accounts for the fact that individual voxel activations are not independent of the activations of their neighboring voxels, especiallywhen the data are spatially smoothed (Friston, 2000; Heller et al., 2006;Wager et al., 2007).”
BackgroundSelf-citationKober, H., Barrett, L. F., Joseph, J., Bliss-Moreau, E., Lindquist, K., & Wager, T. D. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.059 · Cited by 1,144
Self-citationTurkeltaub, P. E., Eickhoff, S. B., Laird, A. R., Fox, M., Wiener, M., & Fox, P. (2012) · Human Brain Mapping · doi:10.1002/hbm.21186 · Cited by 1,119
“In MKDA, overlapping spheres from the same experiment are not additive, such that the count at each voxel represents the number of overlapping experiments.”
BackgroundMethodInfluentialNeural network of cognitive emotion regulation—an ALE meta-analysis and MACM analysis
Kohn, N., Eickhoff, S. B., Scheller, M., Laird, A. R., Fox, P. T., & Habel, U. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.001 · Cited by 956
“Multilevel kernel density analysis (MKDA; Wager et al., 2007) is a second prominent approach, which relies on the proportion of reported foci within a certain radius of a voxel.”
BackgroundThe Neural Bases of Social Cognition and Story Comprehension
Mar, R. A. (2011) · Annual Review of Psychology · doi:10.1146/annurev-psych-120709-145406 · Cited by 950
“…PF = prefrontal r = right TPJ = temporoparietal junction b = bilateral reliable and objective identification of the mentalizing network can be achieved only through the application of a quantitative, systematic, and statistical meta-analytic approach (Costafreda 2009, Wager et al. 2007).”
MethodIs there a core neural network in empathy? an fMRI based quantitative meta-analysis
Fan, Y., Duncan, N. W., de Greck, M., & Northoff, G. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.10.009 · Cited by 902
Voxel-wise meta-analysis of grey matter changes in obsessive-compulsive disorder
Radua, J., & Mataix-Cols, D. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.055046 · Cited by 863
Denny, B. T., Kober, H., Wager, T. D., & Ochsner, K. N. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00233 · Cited by 830
“Height (i.e., activation proportion) and extent thresholds varied for each MKDA, but all were significant at p < .05, FWE corrected.”
MethodInfluentialSelf-citationBest practice guidance for linear mixed-effects models in psychological science
Meteyard, L., & Davies, R. A. I. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2020.104092 · Cited by 698
Ten simple rules for neuroimaging meta-analysis
Müller, V. I., Cieslik, E. C., Laird, A. R., Fox, P. T., Radua, J., Mataix-Cols, D., Tench, C. R., Yarkoni, T., Nichols, T. E., Turkeltaub, P. E., et al. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.11.012 · Cited by 805
“There are different approaches to coordinate based meta-analysis, including (multilevel) kernel density analysis (KDA, MKDA; e.g., Wager et al., 2004; Wager et al., 2007; Pauli et al., 2016), gaussian-process regression (GPR; Salimi-Khorshidi et al.”
BackgroundMethodInfluentialSelf-citationRadua, J., Mataix-Cols, D., Phillips, M. L., El-Hage, W., Kronhaus, D. M., Cardoner, N., & Surguladze, S. (2012) · European Psychiatry · doi:10.1016/j.eurpsy.2011.04.001 · Cited by 765
“Ingenious peak-probability methods such as activation likelihood estimation (ALE), the first coordinate-based method to be developed [8,23], or multilevel kernel density analysis (MKDA), which first introduced the weighting by sample size [26,27], are (exclusively) based on the regional likelihood or frequency of repo…”
MethodLindquist, K. A., Satpute, A. B., Wager, T. D., Weber, J., & Barrett, L. F. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv001 · Cited by 713
“As in the MKDA, indicator maps were generated by diluting peak coordinates froma contrastwith a 12-mm binary sphere.”
MethodResultInfluentialSelf-citationInformatic parcellation of the network involved in the computation of subjective value
Clithero, J. A., & Rangel, A. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst106 · Cited by 706
“However, both ALE and KDA are based on aggregating foci reported for any given study into a single MA map, which are then combined across studies to identify spatial convergence.”
MethodSchurz, M., Radua, J., Tholen, M. G., Maliske, L., Margulies, D. S., Mars, R. B., Sallet, J., & Kanske, P. (2021) · Psychological Bulletin · doi:10.1037/bul0000303 · Cited by 619
Fox, K. C. R., Spreng, R. N., Ellamil, M., Andrews-Hanna, J. R., & Christoff, K. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.02.039 · Cited by 690
“Collapsing across numerous different baselines or control conditions is a common, indeed inevitable, practice in any large meta-analysis of functional neuroimaging studies (Salimi-Khorshidi et al., 2009; Svoboda et al., 2006; Wager et al., 2007, 2009).”
Eickhoff, S. B., Nichols, T. E., Laird, A. R., Hoffstaedter, F., Amunts, K., Fox, P. T., Bzdok, D., & Eickhoff, C. R. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.04.072 · Cited by 683
“Empirically, it has repeatedly been noted that significant effects may be largely driven by even a single experiment if the total number of experiments is relatively low (Bzdok et al., 2011; Raemaekers et al., 2007; Turkeltaub et al., 2012; Wager et al., 2007).”
InfluentialFox, K. C. R., Dixon, M. L., Nijeboer, S., Girn, M., Floman, J. L., Lifshitz, M., Ellamil, M., Sedlmeier, P., & Christoff, K. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.03.021 · Cited by 656
Jardri, R., Pouchet, A., Pins, D., & Thomas, P. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09101522 · Cited by 651
Neural activity that predicts subsequent memory and forgetting: A meta-analysis of 74 fMRI studies
Kim, H. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.045 · Cited by 605
“A primary use for meta-analyses in neuroimaging is identifying significant concordances in brain activity patterns across a set of independent studies using a specific paradigm (Wager et al., 2007).”
BackgroundA Review of Feature Reduction Techniques in Neuroimaging
Mwangi, B., Tian, T. S., & Soares, J. C. (2014) · Neuroinformatics · doi:10.1007/s12021-013-9204-3 · Cited by 559
“may improve a-posteriori certainty, increase statistical power and therefore make neuroimaging studies less susceptible to type II errors (Wager et al. 2007).”
InfluentialSocial cognition and the cerebellum: A meta-analysis of over 350 fMRI studies
Van Overwalle, F., Baetens, K., Mariën, P., & Vandekerckhove, M. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.09.033 · Cited by 474
Dong, D., Wang, Y., Chang, X., Luo, C., & Yao, D. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx034 · Cited by 486
Grounding emotion in situated conceptualization
Wilson-Mendenhall, C. D., Barrett, L. F., Simmons, W. K., & Barsalou, L. W. (2011) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.12.032 · Cited by 431
Functional Specialization and Flexibility in Human Association Cortex
Yeo, B. T. T., Krienen, F. M., Eickhoff, S. B., Yaakub, S. N., Fox, P. T., Buckner, R. L., Asplund, C. L., & Chee, M. W. L. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu217 · Cited by 413
“First, generalizing from individual studies that infer function from a limited number of behavioral tasks can be difficult (Fox and Lancaster 2002; Wager et al. 2007).”
BackgroundMethodInfluentialNeural representation of abstract and concrete concepts: A meta‐analysis of neuroimaging studies
Wang, J., Conder, J. A., Blitzer, D. N., & Shinkareva, S. V. (2010) · Human Brain Mapping · doi:10.1002/hbm.20950 · Cited by 433
“The multilevel kernel density analysis (MKDA) is a coordinate-based meta-analysis method where the statistical indicator is the probability of activation of a given voxel in the brain [Kober et al., 2008; Wager et al., 2007, 2009].”
MethodA meta-analysis of neurofunctional imaging studies of emotion and cognition in major depression
Diener, C., Kuehner, C., Brusniak, W., Ubl, B., Wessa, M., & Flor, H. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.005 · Cited by 422
“Furthermore, stable alterations across studies during cognitive–emotional challenge should reflect a reliable picture of altered neural activation patterns in MDD. Due to their higher power, meta-analyses are more likely to reveal consistent activations than individual studies (Wager et al., 2007).”
InfluentialTillisch, K., Mayer, E. A., & Labus, J. S. (2011) · Gastroenterology · doi:10.1053/j.gastro.2010.07.053 · Cited by 412
Radua, J., van den Heuvel, O. A., Surguladze, S., & Mataix-Cols, D. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.70 · Cited by 400
“Regional differences in gray matter volume between patients and controls were analyzed using Signed Differential Mapping (SDM)(http://www.sdmproject.com), anovelvoxel-basedmeta-analyticapproachthatisbasedonandimprovesonotherex-istingmethods 23,24 and also incorporates several novel features.”
MethodLarge-scale functional neural network correlates of response inhibition: an fMRI meta-analysis
Zhang, R., Geng, X., & Lee, T. M. C. (2017) · Brain Structure and Function · doi:10.1007/s00429-017-1443-x · Cited by 398
“We conducted meta-analyses using the MKDA (Wager et al. 2007) toolbox (http://wagerlab.”
MethodA meta-analysis of instructed fear studies: implications for conscious appraisal of threat
Mechias, M.-L., Etkin, A., & Kalisch, R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.09.040 · Cited by 392
“Further, random between-study variance can be taken into account (Wager et al., 2007).”
BackgroundMethodInfluentialBrain mediators of predictive cue effects on perceived pain
Atlas, L. Y., Bolger, N., Lindquist, M. A., & Wager, T. D. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0057-10.2010 · Cited by 389
Self-citationSalimi-Khorshidi, G., Smith, S. M., Keltner, J. R., Wager, T. D., & Nichols, T. E. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.039 · Cited by 388
“MKDA, or multi-level KDA (Wager et al., 2007), does not treat each focus independently, and instead creates a binary map for each study, showing where there is one or more foci within a given radius; these study binary maps are then averaged, giving the proportion of studies having any foci within…”
BackgroundMethodInfluentialSelf-citationVoxelwise Meta-Analysis of Gray Matter Abnormalities in Bipolar Disorder
Bora, E., Fornito, A., Yücel, M., & Pantelis, C. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.01.020 · Cited by 378
Spreng, R. N., Wojtowicz, M., & Grady, C. L. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.01.009 · Cited by 356
From Brain Maps to Cognitive Ontologies: Informatics and the Search for Mental Structure
Poldrack, R. A., & Yarkoni, T. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033729 · Cited by 365
“…surrounding which cognitive process deserves credit for the effect of a particular experimental task on brain activity is attributable to the impracticality of using dozens of different tasks in every study in order to isolate a specific process by converging operations (Garner et al. 1956).”
BackgroundThe functional neuroanatomy of reappraisal: Time matters
Kalisch, R. (2009) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.06.003 · Cited by 379
“Meta-analysis was performed using an established method (multilevel kernel density analysis, MKDA (Wager et al., 2007)).”
BackgroundMethodInfluentialLaird, A. R. (2009) · Frontiers in Neuroinformatics · doi:10.3389/neuro.11.023.2009 · Cited by 372
“…constrained, leading to some modeled activation in white matter, and (3) the analysis tested for above-chance clustering of individual coordinates (a fi xed-effects analysis), preventing the generalization of results that is possible in a random-effects analysis (Wager et al., 2007, 2009).”
Wager, T. D., Atlas, L. Y., Leotti, L. A., & Rilling, J. K. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3420-10.2011 · Cited by 328
“2B), and has been shown to positively relate to anticipatory anxiety in other settings (Wager et al., 2009a,b), placebo-induced opioid release (Wager et al., 2007b; Eippert et al., 2009b), and placebo-related increases during pain (Petrovic et al., 2002; Bingel et al., 2006; Eippert et al., 2009b).”
BackgroundMethodResultInfluentialSelf-citationVoxel-based meta-analysis via permutation of subject images (PSI): Theory and implementation for SDM
Albajes-Eizagirre, A., Solanes, A., Vieta, E., & Radua, J. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2018.10.077 · Cited by 302
“For MKDA-PSI, it could mean impute many times whether a voxel was part of or not, and the more likely a voxel is to have been part of the cluster in the raw study image, the more times MKDA-PSI would impute it as part of the cluster.”
MethodInfluentialScientific and Pragmatic Challenges for Bridging Education and Neuroscience
Varma, S., McCandliss, B. D., & Schwartz, D. L. (2008) · Educational Researcher · doi:10.3102/0013189x08317687 · Cited by 291
A Hitchhiker's Guide to Functional Magnetic Resonance Imaging
Soares, J. M., Magalhães, R., Moreira, P. S., Sousa, A., Ganz, E., Sampaio, A., Alves, V., Marques, P., & Sousa, N. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00515 · Cited by 272
“However, optimizing certain parameters can significantly improve the study efficiency and reliability of the final results.”
BackgroundKim, H. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.01.051 · Cited by 297
“A primary use for metaanalysis in neuroimaging is to identify significant concordances in patterns of brain activity across a set of independent studies using a specific task/paradigm (Wager et al., 2007).”
BackgroundKompus, K., Westerhausen, R., & Hugdahl, K. (2011) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2011.08.010 · Cited by 278
“Meta-analytical methods are gaining rapid popularity in the field of functional neuroimaging, providing a powerful tool for detecting consistent patterns across several different studies(Wager et al., 2007).”
MethodConnectivity‐based parcellation: Critique and implications
Eickhoff, S. B., Thirion, B., Varoquaux, G., & Bzdok, D. (2015) · Human Brain Mapping · doi:10.1002/hbm.22933 · Cited by 273
“, 2008] or coordinate-based [i.e., using peak activation information; Eickhoff et al., 2009; Radua and Mataix-Cols, 2009; Wager et al., 2007] metaanalysis.”
MethodNeuroQuery, comprehensive meta-analysis of human brain mapping
Dockès, J., Poldrack, R. A., Primet, R., Gözükan, H., Yarkoni, T., Suchanek, F., Thirion, B., & Varoquaux, G. (2020) · eLife · doi:10.7554/elife.53385 · Cited by 258
“Coordinate-Based Meta-Analysis (CBMA) methods [Laird et al., 2005, Wager et al., 2007, Eickhoff et al., 2009] assess the consistency of results across studies, comparing the observed spatial density of reported brain stereotactic coordinates to the null hypothesis of a uniform distribution.”
BackgroundMethodInfluentialHow Acute Total Sleep Loss Affects the Attending Brain: A Meta-Analysis of Neuroimaging Studies
Ma, N., Dinges, D. F., Basner, M., & Rao, H. (2015) · Sleep · doi:10.5665/sleep.4404 · Cited by 248
Meta-analytic methods for neuroimaging data explained
Radua, J., & Mataix-Cols, D. (2012) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-2-6 · Cited by 244
“For this reason, thresholds based on uncorrected P-values and clustersize are usually preferred [1,19,20].”
BackgroundWang, S., Celebi, M. E., Zhang, Y.-D., Yu, X., Lu, S., Yao, X., Zhou, Q., Miguel, M.-G., Tian, Y., Gorriz, J. M., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.07.001 · Cited by 241
Evaluating the consistency and specificity of neuroimaging data using meta-analysis
Wager, T. D., Lindquist, M. A., Nichols, T. E., Kober, H., & Van Snellenberg, J. X. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.061 · Cited by 242
Self-citationAdolfi, F., Couto, B., Richter, F., Decety, J., Lopez, J., Sigman, M., Manes, F., & Ibáñez, A. (2017) · Cortex · doi:10.1016/j.cortex.2016.12.019 · Cited by 238
“For further details about MKDA (Kober & Wager, 2010; Wager et al., 2008; Wager et al., 2007) and its relationship to other meta-analytical approaches, see Supplementary Material.”
Meta-analytic evidence for neuroimaging models of depression: State or trait?
Graham, J., Salimi-Khorshidi, G., Hagan, C., Walsh, N., Goodyer, I., Lennox, B., & Suckling, J. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.07.002 · Cited by 231
“Thus, its significant result at a voxel can be interpreted as “one or more peaks lie at this voxel” (Turkeltaub et al., 2002; Wager et al., 2007).”
BackgroundGürsel, D. A., Avram, M., Sorg, C., Brandl, F., & Koch, K. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.01.016 · Cited by 231
Meta-analysis of functional neuroimaging of major depressive disorder in youth
Miller, C. H., Hamilton, J. P., Sacchet, M. D., & Gotlib, I. H. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.1376 · Cited by 229
Paulesu, E., Danelli, L., & Berlingeri, M. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00830 · Cited by 199
“These analyses were performed only on clusters that showed a spatial congruence in the HC and ALE procedures.”
MethodLi, S., Hu, N., Zhang, W., Tao, B., Dai, J., Gong, Y., Tan, Y., Cai, D., & Lui, S. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00482 · Cited by 211
“Second, the proportion of the study comparison maps (activation maps) that indicated hyperconnectivity or hypoconnectivity for each network within a 15-mm radius of each voxel was produced by averaging the CIMs weighted by sample size and a discounting factor (30).”
BackgroundMethodInfluentialSchulz, S. M. (2016) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2016.0018 · Cited by 205
Thomas, C., & Baker, C. I. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.03.069 · Cited by 204
“One of the difficulties for assessing replication of spatial location is the paucity of reliable methods to assess the variability of spatial estimates (for reviews see, Lazar et al., 2002; Wager et al., 2007).”
MethodGrasping language – A short story on embodiment
Jirak, D., Menz, M. M., Buccino, G., Borghi, A. M., & Binkofski, F. (2010) · Consciousness and Cognition · doi:10.1016/j.concog.2010.06.020 · Cited by 178
Gray matter volume in major depressive disorder: A meta-analysis of voxel-based morphometry studies
Lai, C.-H. (2013) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2012.06.006 · Cited by 191
Zen and the Art of Multiple Comparisons
Lindquist, M. A., & Mejia, A. (2015) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000148 · Cited by 176
“Because achieving sufficient power is often not possible in most neuroimaging studies, it does sometimes make sense to report results at an uncorrected threshold and use meta-analysis or a comparable replication strategy to identify consistent results across studies (12), with the caveat that uncorrected results from…”
BackgroundSelf-citationSprooten, E., Rasgon, A., Goodman, M., Carlin, A., Leibu, E., Lee, W. H., & Frangou, S. (2017) · Human Brain Mapping · doi:10.1002/hbm.23486 · Cited by 179
“Because of this reporting convention, quantitative synthesis of taskfMRI data utilizes coordinate-based analyses that are concerned with the consistency and specificity of the spatial convergence of the results of the primary studies [Fox et al., 1998; Wager et al., 2007].”
MethodVia, E., Radua, J., Cardoner, N., Happé, F., & Mataix-Cols, D. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.27 · Cited by 185
“Regional differences in gray matter volume between participants with ASD and controls were analyzed using SDM,(23) a novel voxel-based meta-analytic approach that is based on and improves on other existing methods.(25,26) The method has been described in detail elsewhere(27,28) and is briefly summarized herein.”
MethodComputing the Social Brain Connectome Across Systems and States
Alcalá-López, D., Smallwood, J., Jefferies, E., Van Overwalle, F., Vogeley, K., Mars, R. B., Turetsky, B. I., Laird, A. R., Fox, P. T., Eickhoff, S. B., et al. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhx121 · Cited by 180
“2012), Kernel Density Estimation (Wager et al. 2007), or Signed Differential Mapping (Radua and Mataix-Cols 2009).”
MethodResting-state network dysconnectivity in ADHD: A system-neuroscience-based meta-analysis
Sutcubasi, B., Metin, B., Kurban, M. K., Metin, Z. E., Beser, B., & Sonuga-Barke, E. (2020) · The World Journal of Biological Psychiatry · doi:10.1080/15622975.2020.1775889 · Cited by 168
“The current meta-analysis was coordinate-based (Wager et al. 2007; Wager et al. 2009; Salimi-Khorshidi et al. 2009) and identified coordinates showing significant differences in resting state functional connectivity between ADHD and control groups.”
MethodALE meta-analysis on facial judgments of trustworthiness and attractiveness
Bzdok, D., Langner, R., Caspers, S., Kurth, F., Habel, U., Zilles, K., Laird, A., & Eickhoff, S. B. (2011) · Brain Structure and Function · doi:10.1007/s00429-010-0287-4 · Cited by 183
Radua, J., Via, E., Catani, M., & Mataix-Cols, D. (2011) · Psychological Medicine · doi:10.1017/s0033291710002187 · Cited by 183
“Regional differences in white-matter volume between patients and controls were also analyzed using SDM, a novel voxel-based meta-analytic approach that improves upon other existing methods (Turkeltaub et al. 2002 ; Wager et al. 2007) and has been used in previous meta-analyses of VBM studies (Radua & Mataix-Cols, 2009…”
MethodInfluentialSubspecialization in the human posterior medial cortex
Bzdok, D., Heeger, A., Langner, R., Laird, A. R., Fox, P. T., Palomero-Gallagher, N., Vogt, B. A., Zilles, K., & Eickhoff, S. B. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.11.009 · Cited by 178
“MACM is based on coordinate-based meta-analysis (Eickhoff et al., 2012; Radua and Mataix-Cols, 2009; Wager et al., 2007).”
McNorgan, C. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00285 · Cited by 178
“Techniques such as Activation Likelihood Estimation (ALE) (Chein et al., 2002; Turkeltaub et al., 2002) and Multilevel Kernel Density Analysis (MKDA) (Wager et al., 2007) allow the application of statistical measures to the literature to assess the reliability with which an effect is demonstrated in a particular brain…”
BackgroundInfluentialDissociable Influences of Opiates and Expectations on Pain
Atlas, L. Y., Whittington, R. A., Lindquist, M. A., Wielgosz, J., Sonty, N., & Wager, T. D. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.0383-12.2012 · Cited by 176
Self-citationDiekhof, E. K., Falkai, P., & Gruber, O. (2008) · Brain Research Reviews · doi:10.1016/j.brainresrev.2008.07.004 · Cited by 165
Cognitive neuroscience 2.0: building a cumulative science of human brain function
Yarkoni, T., Poldrack, R. A., Van Essen, D. C., & Wager, T. D. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.08.004 · Cited by 174
“From an analytical standpoint, image-based analyses are unquestionably superior to foci-based analyses, as the former preserve the full range of effect sizes in the data, providing a substantial power boost while minimizing selection bias [6,49].”
BackgroundMethodSelf-citationSchweizer, S., Satpute, A. B., Atzil, S., Field, A. P., Hitchcock, C., Black, M., Barrett, L. F., & Dalgleish, T. (2019) · Psychological Bulletin · doi:10.1037/bul0000193 · Cited by 183
Pooling fMRI data: meta-analysis, mega-analysis and multi-center studies
Costafreda, S. (2009) · Frontiers in Neuroinformatics · doi:10.3389/neuro.11.033.2009 · Cited by 157
“Recent years have seen the development of several voxel-based meta-analysis methods (Chein et al., 2002; Turkeltaub et al., 2002; Wager et al., 2004, 2007; Laird et al., 2005a; Neumann et al., 2005; Costafreda et al., 2009a; Eickhoff et al., 2009).”
InfluentialKraynak, T. E., Marsland, A. L., Wager, T. D., & Gianaros, P. J. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.07.013 · Cited by 165
“Finally, to examine the network organization of reported regions, we tested how patterns of reported co-activation across different brain regions in the sample of 24 neuroimaging studies (37 CIMs) may form functional groupings (Etkin and Wager, 2007; Kober et al., 2008).”
BackgroundSelf-citationBrandl, F., Weise, B., Mulej Bratec, S., Jassim, N., Hoffmann Ayala, D., Bertram, T., Ploner, M., & Sorg, C. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-022-01271-y · Cited by 146
“Meta-analysis MKDA meta-analysis of both GMV and network-iFC was conducted [11, 40] following our previous work on transdiagnostic multimodal meta-analysis of structural and resting-state fMRI-studies across psychiatric disorders [38].”
MethodInfluentialAtlas, L. Y., & Wager, T. D. (2014) · Handbook of Experimental Pharmacology · doi:10.1007/978-3-662-44519-8_3 · Cited by 162
“…contrast maps rather than the distribution of peak coordinates alone, which ensures that studies that report many peaks in a location are not overrepresented (see Wager et al. (2007a) for a more thorough discussion of the relationship between MKDA and other meta-analytic approaches, including ALE).”
InfluentialSelf-citationDevelopmental Meta-analyses of the Functional Neural Correlates of Bipolar Disorder
Wegbreit, E., Cushman, G. K., Puzia, M. E., Weissman, A. B., Kim, K. L., Laird, A. R., & Dickstein, D. P. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.660 · Cited by 158
Kim, H. (2013) · Human Brain Mapping · doi:10.1002/hbm.21474 · Cited by 159
“Meta-analysis has played an increasingly important role in identifying significant concordances in brain activity patterns across many neuroimaging studies [Wager et al., 2007].”
BackgroundAcar, F., Seurinck, R., Eickhoff, S. B., & Moerkerke, B. (2018) · PLOS ONE · doi:10.1371/journal.pone.0208177 · Cited by 154
“Using correlated data by reporting multiple experiments on the same set of subjects is problematic and induces bias [39,40].”
BackgroundMapping anhedonia-specific dysfunction in a transdiagnostic approach: an ALE meta-analysis
Zhang, B., Lin, P., Shi, H., Öngür, D., Auerbach, R. P., Wang, X., Yao, S., & Wang, X. (2016) · Brain Imaging and Behavior · doi:10.1007/s11682-015-9457-6 · Cited by 152
“…instead of labels, weighting the foci by the number of participants in each study, yielding a quantitative estimate of the probability of activation, identifying common activations across different studies (Laird et al. 2005; Wager et al. 2007; Eickhoff et al. 2009; Eickhoff et al. 2012).”
BackgroundMethodTervo‐Clemmens, B., Quach, A., Calabro, F. J., Foran, W., & Luna, B. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.116476 · Cited by 153
“This improves generalization of MKDA results to new studies and has the advantage of reducing potential bias from a single study that reports many foci or uses a more liberal statistical threshold (Wager et al., 2007).”
InfluentialEng, G. K., Sim, K., & Chen, S.-H. A. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.03.002 · Cited by 148
A comparative fMRI meta-analysis of altruistic and strategic decisions to give
Cutler, J., & Campbell-Meiklejohn, D. K. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.09.009 · Cited by 162
Brain grey matter volume alterations in late-life depression
Du, M., Liu, J., Chen, Z., Huang, X., Li, J., Kuang, W., Yang, Y., Zhang, W., Zhou, D., Bi, F., et al. (2014) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.130275 · Cited by 140
“R inferior occipital gyrus, BA 17,18 (20) R fusiform gyrus, BA 18 (18) R cuneus, BA 17,18 (25) R declive (28)”
BackgroundRethinking Measures of Functional Connectivity via Feature Extraction
Mohanty, R., Sethares, W. A., Nair, V. A., & Prabhakaran, V. (2020) · Scientific Reports · doi:10.1038/s41598-020-57915-w · Cited by 133
Metadata
- Authors
- Wager, T. D., Lindquist, M., & Kaplan, L.
- Affiliations
- Columbia University (US)
- Venue
- Social Cognitive and Affective Neuroscience
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-06-01
- Volume
- 2
- Issue
- 2
- Pages
- 150-158
- ISSN
- 1749-5016 (ISSN-L)
- 1749-5024
- PMC
- PMC2555451
- OpenAlex
- W2137449272
- Cited by
- 434
- References
- 31
- Citations by year
- 2026: 12 · 2025: 25 · 2024: 22 · 2023: 18 · 2022: 34 · 2021: 23 · 2020: 28 · 2019: 28 · 2018: 27 · 2017: 29 · 2016: 19 · 2015: 24 · 2014: 19 · 2013: 27 · 2012: 22
- FWCI
- 1.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Social Cognitive and Affective Neuroscience (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- false positives, multiple testing correction, multilevel meta-analysis, multivariate meta-analysis, functional brain regions
- MeSH terms
- Forecasting, Humans, Magnetic Resonance Imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.