Meta-analysis of functional neuroimaging data: current and future directions
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Meta-analysis is an increasingly popular and valuable tool for summarizing results across many neuroimaging studies. It can be used to establish consensus on the locations of functional regions, test hypotheses developed from patient and animal studies and develop new hypotheses on structure-function correspondence. It is particularly valuable in neuroimaging because most studies do not adequately correct for multiple comparisons; based on statistical thresholds used, we estimate that roughly 10-20% of reported activations in published studies are false positives. In this article, we briefly summarize some of the most popular meta-analytic approaches and their limitations, and we outline a revised multilevel approach with increased validity for establishing consistency across studies. We also discuss multivariate methods by which meta-analysis can be used to develop and test hypotheses about co-activity of brain regions. Finally, we argue that meta-analyses can make a uniquely valuable contribution to predicting psychological states from patterns of brain activity, and we briefly discuss some methods for making such predictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“individual neuroimaging studies are often underpowered and exhibit relatively high false positive rate2-4”
From Large-scale automated synthesis of human functional neuroimaging data. (2011) · cites this paper as [3]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Further, each contrast is weighted by the sample size and study quality (i.e.whether the study used fixed or random effects model; Wager et al., 2007;Kober and Wager, 2010).”
From The inhibition of automatic imitation: a meta-analysis and synthesis of fMRI studies (2018) · cites this paper as Wager et al., 2007
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Applied Linear Statistical Models
Ziegel, E. R., Neter, J., Wasserman, W., & Kutner, M. (1992) · Technometrics · doi:10.2307/1269588 · Cited by 9,907
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 1×
“Thus, if peak coordinates are used in meta-analysis, the problem of unreported activation coordinates (the ‘file drawer problem’) (Rosenthal, 1979) is greatly reduced, though not completely eliminated.”
BackgroundApplied Linear Statistical Models
(1997) · Technometrics · doi:10.1080/00401706.1997.10485141 · Cited by 7,185
Nonparametric permutation tests for functional neuroimaging: A primer with examples
Nichols, T. E., & Holmes, A. P. (2002) · Human Brain Mapping · doi:10.1002/hbm.1058 · Cited by 6,256
Talairach, J., Tournoux, P., & Rayport, M. (1988) · Thieme eBooks · Cited by 5,058
Thresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923 · cited 2×
“In recent implementations of the ALE approach (Laird et al., 2005), ALE statistics are subjected to false discovery rate (FDR) correction (Genovese et al., 2002), which ensures that at P 0.05 corrected, on average, 5% of the reported voxels are false positives (i.e. no peak truly falls within that…”
MethodInfluentialMeta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635 · cited 1×
“Meta-analyses in other research areas often combine effect sizes of a single effect to test for consistency (Rosenthal, 1991).”
BackgroundMeta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · The Statistician · doi:10.2307/2348600 · Cited by 4,249
Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910330508 · Cited by 3,202 · cited 2×
“005 with an eight-voxel extent that was reported to achieve ‘corrected’ false-positive control in simulations based on a single dataset (Forman et al., 1995).”
BackgroundInfluentialThe language-as-fixed-effect fallacy: A critique of language statistics in psychological research
Clark, H. H. (1973) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(73)80014-3 · Cited by 2,222 · cited 2×
“The pitfalls of treating random effects as fixed effects have been widely discussed in statistics (Neter et al., 1996; Shayle et al., 2006) and in psychology (Clark, 1973).”
Background
Research works printed but not linked: 1
- Shayle, R., Searle, G.C., McCulloch, C.E. (2006). Variance Components. Hoboken, NJ: Wiley-Interscience.
Cited by
Items 101–200 of 453
Brandl, F., Avram, M., Weise, B., Shang, J., Simões, B., Bertram, T., Hoffmann Ayala, D., Penzel, N., Gürsel, D. A., Bäuml, J., et al. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.12.003 · Cited by 133
Localizing Pain Matrix and Theory of Mind networks with both verbal and non-verbal stimuli
Jacoby, N., Bruneau, E., Koster-Hale, J., & Saxe, R. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.11.025 · Cited by 141
“The most common approach, in social cognitive neuroscience, is to compare results via meta-analyses (Costafreda, 2009; Mar, 2011; Wager et al., 2007).”
BackgroundThe role of language in the experience and perception of emotion: a neuroimaging meta-analysis
Brooks, J. A., Shablack, H., Gendron, M., Satpute, A. B., Parrish, M. H., & Lindquist, K. A. (2016) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsw121 · Cited by 131
“Multilevel kernel density analysis The present meta-analysis used a Multi-level Kernel Density Analysis (MKDA) (Wager et al., 2007) implemented in NeuroElf (http://neuroelf.net).”
MethodInfluentialLong, Z., Du, L., Zhao, J., Wu, S., Zheng, Q., & Lei, X. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.06.072 · Cited by 136
Common and distinct brain networks underlying explicit emotional evaluation: a meta-analytic study
Lee, K. H., & Siegle, G. J. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp001 · Cited by 127
“However, one should interpret such findings with caution because this method to control for confound variables is useful when many studies reported activation in brain regions (Wager et al., 2007).”
BrainStat: A toolbox for brain-wide statistics and multimodal feature associations
Larivière, S., Bayrak, Ş., de Wael, R. V., Benkarim, O. M., Herholz, P., Rodríguez‐Cruces, R., Paquola, C., Hong, S., Mišić, B., Evans, A. C., et al. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119807 · Cited by 146
Albajes-Eizagirre, A., Solanes, A., Fullana, M. A., Ioannidis, J. P. A., Fusar-Poli, P., Torrent, C., Solé, B., Bonnín, C. M., Vieta, E., Mataix-Cols, D., et al. (2019) · Journal of Visualized Experiments · doi:10.3791/59841 · Cited by 103
A review of fMRI studies during visual emotive processing in major depressive disorder
Jaworska, N., Yang, X.-R., Knott, V., & MacQueen, G. (2015) · The World Journal of Biological Psychiatry · doi:10.3109/15622975.2014.885659 · Cited by 133
“Second, neuroimaging meta-analyses and reviews, including ours, are affected by publication biases, which favor the increased probability of published studies reporting signifi cant (versus null) results (Wager et al. 2007).”
BackgroundA supramodal role of the basal ganglia in memory and motor inhibition: meta-analytic evidence
Guo, Y., Schmitz, T. W., Mur, M., Ferreira, C. S., & Anderson, M. C. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.11.033 · Cited by 133
“For example, Wager et al. (2007) discussed a few limitations in Activation Likelihood Estimation (ALE).”
BackgroundSchraa-Tam, C. K. L., Rietdijk, W. J. R., Verbeke, W. J. M. I., Dietvorst, R. C., van den Berg, W. E., Bagozzi, R. P., & De Zeeuw, C. I. (2012) · The Cerebellum · doi:10.1007/s12311-011-0301-2 · Cited by 134
“Such stimuli are known to evoke activities in several different neural networks involved in emotion, such as the mirror neuron system and the limbic system [11–14].”
Practical recommendations to conduct a neuroimaging meta-analysis for neuropsychiatric disorders
Tahmasian, M., Sepehry, A. A., Samea, F., Khodadadifar, T., Soltaninejad, Z., Javaheripour, N., Khazaie, H., Zarei, M., Eickhoff, S. B., & Eickhoff, C. R. (2019) · Human Brain Mapping · doi:10.1002/hbm.24746 · Cited by 126
Suarez‐Jimenez, B., Albajes‐Eizagirre, A., Lazarov, A., Zhu, X., Harrison, B. J., Raduà, J., Neria, Y., & Fullana, M. A. (2019) · Psychological Medicine · doi:10.1017/s0033291719001387 · Cited by 130
“…brain maps (e.g. SPM, AFNI) and which improves upon the positive features of existing peak probability methods for meta-analysis, such as Activation Likelihood Estimation (ALE; Eickhoff et al., 2009; Laird et al., 2009) or Multilevel Kernel Density Analysis (MKDA; Wager et al., 2007, 2009).”
MethodThe narcissistic self and its psychological and neural correlates: an exploratory fMRI study
Fan, Y., Wonneberger, C., Enzi, B., de Greck, M., Ulrich, C., Tempelmann, C., Bogerts, B., Doering, S., & Northoff, G. (2011) · Psychological Medicine · doi:10.1017/s003329171000228x · Cited by 115
Psychoinformatics: New Horizons at the Interface of the Psychological and Computing Sciences
Yarkoni, T. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412457362 · Cited by 112
“…a custom text parser is then used to automatically extract all reported brain activations from all articles, and the results are subjected to a standard fMRI meta-analysis (Wager, Lindquist, & Kaplan, 2007). overly optimistic effect-size estimates (Kriegeskorte, Simmons, Bellgowan, & Baker, 2009).”
MethodEmotion recognition and theory of mind in schizophrenia: A meta-analysis of neuroimaging studies
Jáni, M., & Kašpárek, T. (2017) · The World Journal of Biological Psychiatry · doi:10.1080/15622975.2017.1324176 · Cited by 122
“SDM builds on positive features from other meta-analytic methods, such as Activation Likelihood Estimation (ALE) (Eickhoff et al. 2009) and Multilevel Kernel Density Analysis (Wager et al. 2007), and adds some novel features.”
BackgroundBrain network dysfunctions in addiction: a meta-analysis of resting-state functional connectivity
Tolomeo, S., & Yu, R. (2022) · Translational Psychiatry · doi:10.1038/s41398-022-01792-6 · Cited by 130
“net/) consistently with MKDA neuroimaging meta-analytic procedures [35, 36].”
BackgroundDissociating contributions of ACC and vmPFC in reward prediction, outcome, and choice
Vassena, E., Krebs, R. M., Silvetti, M., Fias, W., & Verguts, T. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.04.019 · Cited by 118
Liu, J., Li, Y., Zhang, W., Xiao, Y., Liu, L., Gao, X., Shah, C., Li, S., Bo, T., Gong, Q., et al. (2017) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-017-0964-4 · Cited by 120
Weng, H., Tsai, Y., Chen, C., Lin, Y., Yang, C., Tsai, Y., & Yang, C. (2014) · SLEEP · doi:10.5665/sleep.3330 · Cited by 113
Tracking Replicability as a Method of Post-Publication Open Evaluation
Hartshorne, J. K., & Schachner, A. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00008 · Cited by 107
“In this case, collective action motivated widespread adoption of an improved method of analysis.”
MethodRahrig, H., Vago, D. R., Passarelli, M. A., Auten, A., Lynn, N. A., & Brown, K. W. (2022) · Scientific Reports · doi:10.1038/s41598-022-15195-6 · Cited by 84
Convergence of semantics and emotional expression within the IFG pars orbitalis
Belyk, M., Brown, S., Lim, J., & Kotz, S. A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.04.020 · Cited by 119
“This approach is conceptually similar to Kernel Density Analysis (KDA) and to the more commonly used Activation Likelihood Estimation (ALE), which also create smooth estimates of the local abundance of peak activations (Eickhoff et al., 2012; Turkeltaub et al., 2002; Wager et al., 2007).”
Nakao, T., Ohira, H., & Northoff, G. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00031 · Cited by 98
“Finally, the results from MKDA provide a straightforward interpretation as a weighted proportion of activated contrasts within a kernel around (typically 10 mm of) each voxel (Kober et al., 2008).”
BackgroundMethodResultInfluentialSalvato, G., Richter, F., Sedeño, L., Bottini, G., & Paulesu, E. (2020) · Human Brain Mapping · doi:10.1002/hbm.24810 · Cited by 95
“Additionally, CIMs are weighted with 0.75 for fixed-effects versus 1.00 for random effects analysis to reduce the impact of fixed-effect studies (Wager et al., 2007, 2009; see also Supporting Information).”
MethodInfluentialHerringshaw, A. J., Ammons, C. J., DeRamus, T. P., & Kana, R. K. (2016) · Autism Research · doi:10.1002/aur.1599 · Cited by 102
Gilbert, S. J., Gonen-Yaacovi, G., Benoit, R. G., Volle, E., & Burgess, P. W. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.032 · Cited by 113
“Data were analyzed using an approach based on Activation Likelihood Estimation, a common technique for meta-analyses of neuroimaging results (Laird et al., 2005; Turkeltaub et al., 2002; Wager et al., 2007), modified here to allow statistical comparisons between two sets of results.”
MethodBellucci, G., Feng, C., Camilleri, J. A., Eickhoff, S. B., & Krüeger, F. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.06.024 · Cited by 101
“, 2007), a coordinatebased meta-analysis increases the population sample for better generalization by integrating data across several studies (Eickhoff et al., 2006; Price et al., 2005; Wager et al., 2007).”
Mapping migraine to a common brain network
Burke, M. J., Joutsa, J., Cohen, A. L., Soussand, L., Cooke, D., Burstein, R., & Fox, M. (2019) · Brain · doi:10.1093/brain/awz405 · Cited by 104
Business Ethics and the Brain:Rommel Salvador and Robert G. Folger
Salvador, R. O., & Folger, R. G. (2009) · Business Ethics Quarterly · doi:10.5840/beq20091911 · Cited by 110
“Wager et al. (2007) estimate that between 10 and 20 percent of results reporting activation of brain areas based on neuroimaging are false positives.”
BackgroundFunctional Specialization and Flexibility in Human Association Cortex
Yeo, B. T. T., Krienen, F. M., Eickhoff, S. B., Yaakub, S. N., Fox, P. T., Buckner, R. L., Asplund, C. L., & Chee, M. W. L. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv260 · Cited by 99
“First, generalizing from individual studies that infer function from a limited number of behavioral tasks can be difficult (Fox and Lancaster 2002; Wager et al. 2007).”
BackgroundMethodProgress toward openness, transparency, and reproducibility in cognitive neuroscience
Gilmore, R. O., Diaz, M. T., Wyble, B. A., & Yarkoni, T. (2017) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13325 · Cited by 95
Tănăsescu, R., Cottam, W. J., Condon, L. A., Tench, C. R., & Auer, D. P. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.04.001 · Cited by 101
Developmental Meta-Analysis of the Functional Neural Correlates of Autism Spectrum Disorders
Dickstein, D. P., Pescosolido, M. F., Reidy, B. L., Galvan, T., Kim, K. L., Seymour, K. E., Laird, A. R., Di Martino, A., & Barrett, R. P. (2013) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2012.12.012 · Cited by 87
Neural correlates during working memory processing in major depressive disorder
Wang, X.-L., Du, M.-Y., Chen, T.-L., Chen, Z.-Q., Huang, X.-Q., Luo, Y., Zhao, Y.-J., Kumar, P., & Gong, Q.-Y. (2015) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2014.08.011 · Cited by 89
Chen, T., Becker, B., Camilleri, J. A., Wang, L., Yu, S., Eickhoff, S. B., & Feng, C. (2018) · Brain Structure and Function · doi:10.1007/s00429-018-1727-9 · Cited by 92
Functional neural correlates of psychopathy: a meta-analysis of MRI data
Deming, P., & Koenigs, M. R. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-0816-8 · Cited by 94
Zamorano, A. M., Cifré, I., Montoya, P., Riquelme, I., & Kleber, B. (2017) · Human Brain Mapping · doi:10.1002/hbm.23682 · Cited by 86
“Cluster-extent based methods account for the fact that individual voxel activations are not independent of the activations of their neighboring voxels in spatially smoothed data [Friston et al., 2000; Heller et al., 2006; Wager et al., 2007] and effectively reduces the possibility of obtaining false positive clusters…”
BackgroundFabro, L. D., Schmidt, A., Fortea, L., Delvecchio, G., D’Agostino, A., Raduà, J., Borgwardt, S., & Brambilla, P. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.06.020 · Cited by 86
Hosseini‐Kamkar, N., Farahani, M. V., Nikolic, M., Stewart, K., Goldsmith, S. F., Soltaninejad, M., Rajabli, R., Lowe, C. J., Nicholson, A. A., Morton, J. B., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.40018 · Cited by 83
Neuroimaging and Biomarkers in Addiction Treatment
Garrison, K. A., & Potenza, M. N. (2014) · Current Psychiatry Reports · doi:10.1007/s11920-014-0513-5 · Cited by 88
An Integrative Way for Studying Neural Basis of Basic Emotions With fMRI
Gu, S., Wang, F., Cao, C., Wu, E., Tang, Y., & Huang, J. H. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00628 · Cited by 86
The empirical replicability of task-based fMRI as a function of sample size
Bossier, H., Roels, S. P., Seurinck, R., Banaschewski, T., Barker, G. J., Bokde, A. L. W., Quinlan, E. B., Desrivières, S., Flor, H., Grigis, A., et al. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116601 · Cited by 86
“Finally, if increasing the sample size is infeasible, it is possible to complement statistical analyses with sensitivity analyses (Wilke, 2012).”
Is obesity related to enhanced neural reactivity to visual food cues? A review and meta-analysis
Morys, F., García‐García, I., & Dagher, A. (2020) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsaa113 · Cited by 84
Considering PTSD from the perspective of brain processes: A psychological construction approach
Suvak, M. K., & Barrett, L. F. (2011) · Journal of Traumatic Stress · doi:10.1002/jts.20618 · Cited by 77
“…literature on emotion that summarizes published articles from 1993 to 2007 (Lindquist, Wager, Kober, Bliss-Moreau, & Barrett, in press) using the Wager et al. (2007) method, we found that the amygdala is not consistently activated during fearful experiences at a level greater than what would be…”
BackgroundMethodInfluentialChen, Z., & Ma, L. (2010) · Amyotrophic Lateral Sclerosis · doi:10.3109/17482968.2010.516265 · Cited by 86
Social anxiety disorder: a critical overview of neurocognitive research
Cremers, H. R., & Roelofs, K. (2016) · WIREs Cognitive Science · doi:10.1002/wcs.1390 · Cited by 69
“005) is used which renders the false positive rate uncertain and variable across studies.(138) In addition, the use of the program AlphaSim to determine a clusterlevel threshold may generate lenient thresholds if the spread (smoothness) of the data is underestimated.”
MethodSpecific maternal brain responses to their own child’s face: An fMRI meta-analysis
Rigo, P., Kim, P., Esposito, G., Putnick, D. L., Venuti, P., & Bornstein, M. H. (2018) · Developmental Review · doi:10.1016/j.dr.2018.12.001 · Cited by 82
van Hoorn, J., Shablack, H., Lindquist, K. A., & Telzer, E. H. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.12.024 · Cited by 73
“We conducted a coordinate-based meta-analysis using the Multilevel peak Kernel Density Analysis (MKDA) method to test the hypothesis that brain regions involved in affect, cognitive control, and social information processing support adolescent decision-making in social contexts (N = 21 functional neuroimaging studies;…”
BackgroundMethodInfluentialHu, X., Du, M., Chen, L., Li, L., Zhou, M., Zhang, L., Liu, Q., Lu, L., Mreedha, K., Huang, X., et al. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.04.012 · Cited by 75
“, 2002) and multilevel kernel density analysis (Wager et al., 2007).”
BackgroundMethodMeta-analysis of neuroimaging data
Kober, H., & Wager, T. D. (2010) · WIREs Cognitive Science · doi:10.1002/wcs.41 · Cited by 74
Self-citationWu, T., Chen, C., Spagna, A., Wu, X., Mackie, M., Russell‐Giller, S., Xu, P., Luo, Y., Liu, X., Hof, P. R., et al. (2019) · The Journal of Comparative Neurology · doi:10.1002/cne.24804 · Cited by 75
Scanning the Horizon: Towards transparent and reproducible neuroimaging researchPreprint
Poldrack, R. A., Baker, C. I., Durnez, J., Gorgolewski, K. J., Matthews, P. M., Munafo, M. R., Nichols, T. E., Poline, J., Vul, E., & Yarkoni, T. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/059188 · Cited by 74
Gong, J., Wang, J., Chen, P., Qi, Z., Luo, Z., Wang, J., Huang, L., & Wang, Y. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.05.052 · Cited by 73
Mental health in the UK Biobank: A roadmap to self‐report measures and neuroimaging correlates
Dutt, R., Hannon, K., Easley, T. O., Griffis, J. C., Zhang, W., & Bijsterbosch, J. D. (2021) · Human Brain Mapping · doi:10.1002/hbm.25690 · Cited by 76
“Whilst these meta-analyses aid to establish consensus on brain correlates of mental health [Wager et al., 2007], they can be limited in their scope.”
MethodBrain activity in mindfulness depends on experience: a meta-analysis of fMRI studies
Falcone, G., & Jerram, M. (2018) · Mindfulness · doi:10.1007/s12671-018-0884-5 · Cited by 71
“Meta-analysis is the best tool for combining and summarizing neuroimaging results across a variety of studies because of its ability to control for the spurious activations that are often observed in single fMRI studies (Wager et al. 2007).”
MethodXu, M., Xu, G., & Yang, Y. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00220 · Cited by 71
“Although functional neuroimaging studies have provided ample information about the brain systems for interference processing, there are limitations, such as small sample size and low reliability (Raemaekers et al., 2007; Wager et al., 2007; Eickhoff et al., 2012).”
BackgroundBrain activity associated with pain, hyperalgesia and allodynia: an ALE meta-analysis
Lanz, S., Seifert, F. C., & Maihöfner, C. (2011) · Journal of Neural Transmission · doi:10.1007/s00702-011-0606-9 · Cited by 73
“Other available CBMA methods are kernel density analysis (KDA) (Wager et al. 2004a) and multilevel kernel density analysis (MKDA) ( Wager et al. 2007, 2009 ).”
MethodNaghibi, N., Jahangiri, N., Khosrowabadi, R., Eickhoff, C. R., Eickhoff, S. B., Coull, J. T., & Tahmasian, M. (2024) · Neuropsychology Review · doi:10.1007/s11065-023-09588-1 · Cited by 69
“…al., 2019), the question of whether the obtained results depend on the meta-analysis technique we used requires future studies to compare our results with that of other available CBMA tecniques, such as (ES)SDM (Radua et al., 2012), KDA (Wager et al., 2007), and GPR (Salimi-Khorshidi et al., 2009).”
ResultLess head motion during MRI under task than resting-state conditions
Huijbers, W., Dijk, K. R. A. V., Boenniger, M. M., Stirnberg, R., & Breteler, M. M. B. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.12.002 · Cited by 69
“MARK during resting-state conditions and several cognitive task conditions typically used in functional MRI experiments (e.g. Barch et al., 2013; Krienen et al., 2014; Poldrack and Gorgolewski, 2015; 2014; Wager et al., 2007).”
MethodWhat do results from coordinate-based meta-analyses tell us?
Albajes-Eizagirre, A., & Radua, J. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.04.065 · Cited by 68
“Examples of these methods are Activation Likelihood Estimation (ALE) and Seed-based d Mapping (SDM), among others [1-16].”
MethodThe Coordinate-Based Meta-Analysis of Neuroimaging Data
Samartsidis, P., Montagna, S., Johnson, T. D., & Nichols, T. E. (2017) · Statistical Science · doi:10.1214/17-sts624 · Cited by 69
“The magnetic resonance signature, or susceptibility, of oxygenated and de-oxygenated blood differs, and thus a MRI scanner can capture changes in local oxygenation.”
InfluentialAn Updated Survey on Statistical Thresholding and Sample Size of fMRI Studies
Yeung, A. W. K. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00016 · Cited by 57
“Meanwhile, conducting meta-analysis of functional neuroimaging data can also establish consensus on the locations of brain activation to confirm or refute hypothesis (Wager et al., 2007; Zmigrod et al., 2016; Yeung et al., 2017b,d, 2018).”
MethodSmith, D. V., Gseir, M., Speer, M. E., & Delgado, M. R. (2016) · Human Brain Mapping · doi:10.1002/hbm.23216 · Cited by 61
“Previous work has addressed this issue by permuting voxel locations to collect the empirical null distributions [Turkeltaub et al., 2002; Wager et al., 2007].”
Wang, H., Zhang, X., Si, C., Xu, Y., Liu, Q., Bian, H., Zhang, B.-W., Li, X., & Yan, Z. (2018) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s165677 · Cited by 62
“24 On the other, small and heterogeneous samples and substantial methodological differences between studies are likely to generate false positive results, 25 while consistent results obtained by independent studies from different research groups are relatively robust.”
Yan, H., Li, Q., Yu, K., & Zhao, G. (2021) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2021.110242 · Cited by 62
Meta Analysis of Functional Neuroimaging Data via Bayesian Spatial Point Processes
Kang, J., Johnson, T. D., Nichols, T. E., & Wager, T. D. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.ap09735 · Cited by 62
Self-citationNiMARE: Neuroimaging Meta-Analysis Research Environment
Salo, T., Yarkoni, T., Nichols, T. E., Poline, J., Bilgel, M., Bottenhorn, K. L., Eickhoff, S. B., Jarecka, D., Kent, J. D., Kimbler, A., et al. (2023) · Aperture Neuro · doi:10.52294/001c.87681 · Cited by 63
The canonical semantic network supports residual language function in chronic post‐stroke aphasia
Griffis, J. C., Nenert, R. E., Allendorfer, J. B., Vannest, J. J., Holland, S. K., Dietz, A. R., & Szaflarski, J. P. (2016) · Human Brain Mapping · doi:10.1002/hbm.23476 · Cited by 63
“…studies, meta-analytic methods such as activation likelihood estimation (ALE) provide a means for identifying consistent effects in the literature [Wager et al., 2007]. r 1637 r However, we are aware of only one such published metaanalysis of the functional neuroimaging of aphasia recovery…”
MethodA Multimodal Meta-Analysis of Structural and Functional Changes in the Brain of Tinnitus
Cheng, S., Xu, G., Zhou, J., Qu, Y., Li, Z., He, Z., Yin, T., Ma, P., Sun, R., & Liang, F. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00028 · Cited by 60
Estimating the prevalence of missing experiments in a neuroimaging meta‐analysis
Samartsidis, P., Montagna, S., Laird, A. R., Fox, P. T., Johnson, T. D., & Nichols, T. E. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1448 · Cited by 56
Dahlgren, K., Ferris, C. S., & Hamann, S. B. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2020.107495 · Cited by 58
MRI predictors of pharmacotherapy response in major depressive disorder
Gerlach, A. R., Karim, H. T., Peciña, M., Ajilore, O., Taylor, W. D., Butters, M. A., & Andreescu, C. (2022) · NeuroImage: Clinical · doi:10.1016/j.nicl.2022.103157 · Cited by 57
“Meta-analyses make a valiant attempt to fill this gap but are faced with the unenviable task of post hoc data synthesis (Wager et al., 2007).”
BackgroundGan, X., Zhou, X., Li, J., Jiao, G., Jiang, X., Biswal, B. B., Yao, S., Klugah‐Brown, B., & Becker, B. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104553 · Cited by 61
“…allowed to overcome these limitations by capitalizing on the results from previously published studies (Eickhoff et al., 2012; Laird et al., 2005; Wager et al., 2007), thus allowing to determine the convergent and robust neurofunctional basis of emotional and cognitive processes as well as to…”
Silver, H., Bilker, W. B., & Goodman, C. (2009) · Psychiatry Research · doi:10.1016/j.psychres.2008.11.017 · Cited by 62
“, 2004) and contribute to inconsistencies found in neuroimaging studies (Wager et al., 2007).”
BackgroundHow reliable are amygdala findings in psychopathy? A systematic review of MRI studies
Deming, P., Heilicher, M. O., & Koenigs, M. R. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104875 · Cited by 97
“However, we note that peak coordinates serve as the unit of analysis for other common neuroimaging meta-analyses (Wager et al., 2007; Eickhoff et al., 2016).”
Han, Y. M. Y., Chan, M. M. Y., Choi, C. X. T., Law, M. C. H., Ahorsu, D. K., & Tsang, H. W. H. (2023) · Scientific Reports · doi:10.1038/s41598-023-37309-4 · Cited by 59
Lotter, L. D., Kohl, S. H., Gerloff, C., Bell, L., Niephaus, A., Kruppa, J. A., Dukart, J., Schulte‐Rüther, M., Reindl, V., & Konrad, K. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105042 · Cited by 56
Chuan-Peng, H., Huang, Y., Eickhoff, S. B., Peng, K., & Sui, J. (2020) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-020-00827-z · Cited by 55
Puberty and functional brain development in humans: convergence in findings?
Dai, J., & Scherf, K. S. (2019) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2019.100690 · Cited by 51
Salihu, A. T., Hill, K., & Jaberzadeh, S. (2022) · Reviews in the Neurosciences · doi:10.1515/revneuro-2022-0023 · Cited by 59
Brain structural damage networks at different stages of schizophrenia
Xu, R., Zhang, X., Zhou, S., Guo, L., Mo, F., Ma, H., Zhu, J., & Qian, Y. (2024) · Psychological Medicine · doi:10.1017/s0033291724003088 · Cited by 56
“…these concerns is to perform a coordinate-based meta-analysis, which is able to synthesize the multitude of results from different neuroimaging studies and identify more consistently affected anatomical regions in psychiatric disorders (Eickhoff et al., 2009; Wager, Lindquist, & Kaplan, 2007).”
The neural underpinnings of intergroup social cognition: an fMRI meta-analysis
Merritt, C., MacCormack, J. K., Stein, A. G., Lindquist, K. A., & Muscatell, K. A. (2021) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsab034 · Cited by 50
“These inconsistencies are further complicated by the fact that individual neuroimaging studies are more prone to Type I errors due to small sample sizes and insufficient statistical corrections (Wager et al., 2007).”
BackgroundMethodWhat if I Get Busted? Deception, Choice, and Decision-Making in Social Interaction
Sip, K. E., Skewes, J., Agustus, J. L., McGregor, W. B., Roepstorff, A., & Frith, C. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00058 · Cited by 50
Robinson, L., Atlas, L. Y., & Wager, T. D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.12.034 · Cited by 50
“…experimental details such as fMRI field strength, study population, study location, etc. Details of these methods have been described in detail in previous work (Wager et al., 2007; Costafreda, 2009; Salimi-Khorshidi et al., 2009; Wager and Smith, 2003; Kober et al., 2008; Atlas et al., 2010).”
Self-citationSong, X., Long, J., Wang, C., Zhang, R., & Lee, T. M. C. (2022) · Psychoradiology · doi:10.1093/psyrad/kkac002 · Cited by 50
“First, we used MKDA, a coordinated meta-analytic technology identifying brain regions that are consistently activated in multiple studies (Wager et al. , 2007), to identify the neural activation patterns of rumination and inhibitory control (Fig.”
InfluentialfMRI activation in late‐life anxious depression: a potential biomarker
Andreescu, C., Butters, M., Lenze, E. J., Venkatraman, V. K., Nable, M., Reynolds, C. F., & Aizenstein, H. J. (2009) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.2327 · Cited by 44
“Thus, our results require further validation on larger samples and with stringent cluster-size threshold (Wager et al., 2007).”
Jassim, N., Baron‐Cohen, S., & Suckling, J. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.04.014 · Cited by 50
“We were limited by whole-brain analyses as the inclusion of region-specific analyses would violate the assumptions of the coordinate-based voxel-wise meta-analysis (Radua and Mataix-Cols, 2009; Wager et al., 2007; Eickhoff et al., 2012).”
MethodAn fMRI study of scientists with a Ph.D. in physics confronted with naive ideas in science
Allaire‐Duquette, G., Foisy, L. B., Potvin, P., Riopel, M., Larose, M., & Masson, S. (2021) · npj Science of Learning · doi:10.1038/s41539-021-00091-x · Cited by 49
An ALE meta-analytical review of the neural correlates of abstract and concrete words
Bucur, M., & Papagno, C. (2021) · Scientific Reports · doi:10.1038/s41598-021-94506-9 · Cited by 48
Meta-analytic Comparison Between PIB-PET and FDG-PET Results in Alzheimer’s Disease and MCI
He, W., Liu, D., Raduà, J., Li, G., Han, B., & Sun, Z. (2014) · Cell Biochemistry and Biophysics · doi:10.1007/s12013-014-0138-7 · Cited by 56
“For this purpose, we used a recently developed voxel-based meta-analytical method, signed differential mapping (SDM) [6, 7], which improves upon other existing methods by considering signed differences [8, 9].”
Moral Violations and the Experience of Disgust and Anger
Oaten, M., Stevenson, R. J., Williams, M., Rich, A. N., Butko, M., & Case, T. I. (2018) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2018.00179 · Cited by 51
“Moreover, our findings are also consistent with a meta-analysis of imaging studies that found the anterior insula to be no more active during disgust than other emotions (Wager et al., 2007).”
ResultBrandl, F., Corbi, Z. L. H., Bratec, S. M., & Sorg, C. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.07.008 · Cited by 46
Pinho, A. L., Amadon, A., Gauthier, B., Clairis, N., Knops, A., Genon, S., Dohmatob, E., Torre, J. J., Ginisty, C., Becuwe-Desmidt, S., et al. (2020) · Scientific Data · doi:10.1038/s41597-020-00670-4 · Cited by 47
A parametric approach to voxel-based meta-analysis
Costafreda, S. G., David, A. S., & Brammer, M. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.01.031 · Cited by 48
“, 2005a) and MKDA (Wager et al., 2007) meta-analysis are interpreted as fixed and random-effects statistics, respectively, in agreement with an earlier characterisation (Wager et al.”
InfluentialLi, H., Zhang, J., & Ding, G. (2021) · Bilingualism Language and Cognition · doi:10.1017/s136672892000070x · Cited by 45
The inhibition of automatic imitation: a meta-analysis and synthesis of fMRI studies
Darda, K. M., & Ramsey, R. (2018) · bioRxiv · doi:10.1101/334938 · Cited by 43
“More specifically, as recommended by Wager and colleagues (Wager et al., 2007), this density map was weighted by the square root of the sample size of the study, and then multiplied by an adjustment factor of 1 for random effects analysis, and 0.”
Nikolic, M., Pezzoli, P., Jaworska, N., & Seto, M. C. (2022) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2022.110596 · Cited by 49
ANIMA: A data-sharing initiative for neuroimaging meta-analyses
Reid, A., Bzdok, D., Genon, S., Langner, R., Müller, V. I., Eickhoff, C. R., Hoffstaedter, F., Cieslik, E. C., Fox, P. T., Laird, A. R., et al. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.07.060 · Cited by 46
“…, these platforms have facilitated a growing number of metaanalytic studies of the neural correlates of specific cognitive functions, using methods such as multilevel kernel density analysis (MKDA; Wager et al., 2007) and activation likelihood estimation (ALE; Eickhoff et al., 2009, 2012).”
Estimating and testing variance components in a multi-level GLM
Lindquist, M. A., Spicer, J., Asllani, I., & Wager, T. D. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.077 · Cited by 39
“, 2009; Lindquist and Gelman, 2009), and violations of assumptions often result in high false positive rates, even for relatively large samples (Wager et al., 2005; Wager et al., 2007; Loh et al., 2008).”
Self-citationInter-subject Registration of Functional Images: Do We Need Anatomical Images?
Dohmatob, E., Varoquaux, G. P., & Thirion, B. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00064 · Cited by 44
“In addition, the use of a standard space opens the possibility to share results in a consistent fashion, hence the comparison of experiments and meta-analysis (Wager et al., 2007; Gorgolewski et al., 2015).”
Background
Metadata
- Authors
- Wager, T. D., Lindquist, M., & Kaplan, L.
- Affiliations
- Columbia University (US)
- Venue
- Social Cognitive and Affective Neuroscience
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-06-01
- Volume
- 2
- Issue
- 2
- Pages
- 150-158
- ISSN
- 1749-5016 (ISSN-L)
- 1749-5024
- PMC
- PMC2555451
- OpenAlex
- W2137449272
- Cited by
- 434
- References
- 31
- Citations by year
- 2026: 12 · 2025: 25 · 2024: 22 · 2023: 18 · 2022: 34 · 2021: 23 · 2020: 28 · 2019: 28 · 2018: 27 · 2017: 29 · 2016: 19 · 2015: 24 · 2014: 19 · 2013: 27 · 2012: 22
- FWCI
- 1.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Social Cognitive and Affective Neuroscience (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- false positives, multiple testing correction, multilevel meta-analysis, multivariate meta-analysis, functional brain regions
- MeSH terms
- Forecasting, Humans, Magnetic Resonance Imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.