Meta-analysis and the science of research synthesis
Open accessThe DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index; 9 of the 69 sources its claims cite were checked for support.
Abstract
Meta-analysis is the quantitative, scientific synthesis of research results. Since the term and modern approaches to research synthesis were first introduced in the 1970s, meta-analysis has had a revolutionary effect in many scientific fields, helping to establish evidence-based practice and to resolve seemingly contradictory research outcomes. At the same time, its implementation has engendered criticism and controversy, in some cases general and others specific to particular disciplines. Here we take the opportunity provided by the recent fortieth anniversary of meta-analysis to reflect on the accomplishments, limitations, recent advances and directions for future developments in the field of research synthesis.
Overview
CoChat Summary
TL;DR
This review reflects on meta-analysis as quantitative research synthesis since the 1970s, its contributions to evidence-based practice, and its methodological development across medicine, social sciences, and ecology/evolution/conservation. It argues that meta-analysis has resolved contradictory evidence and enabled broad generalizations, but faces a “midlife crisis” from poor-quality applications, publication/research bias, and misuse of the term.
Key findings
- Meta-analysis was first introduced in the 1970s; the term was coined by Gene Glass in 1976, and the paper marks its 40th anniversary. It has helped establish evidence-based practice, resolve seemingly contradictory results, and spread across many scientific fields.
- In medicine, a meta-analysis of 20 clinical studies found maternal obesity associated with increased neural tube defect risk: a 1.7-fold rise for moderately obese women and over a 3-fold risk for severely obese women. In social science, a meta-analysis of 35 studies found no significant differences between multisystemic therapy and conventional social services for serious juvenile offenders.
- In ecology, evolution and conservation, meta-analysis was adopted in the early 1990s. Parmesan and Yohe used data on over 1,700 species to show significant range shifts and advancement of spring events; Benayas and colleagues found ecological restoration increased biodiversity and ecosystem services, though values remained lower in restored versus intact reference ecosystems.
- Methodological advances include fixed- and random-effects models, meta-regression, heterogeneity quantification (τ and I²), publication-bias tools, network meta-analysis, phylogenetic meta-analysis, and software such as MetaWin and OpenMEE. PRISMA includes a 27-item checklist for systematic review reporting.
Methods
- Design: narrative review/commentary on meta-analysis and research synthesis, not a new meta-analysis. The authors state they highlight principles, limitations, utility, and future developments.
- Data or sample: draws on published literature and illustrative examples across medicine, social sciences, and ecology/evolution/conservation; includes Box 1 on meta-analytic models and Table 1 on EEC milestones.
- Main analysis: conceptual and methodological synthesis; no primary data collection, systematic search protocol, or quantitative pooling is reported in the paper.
Limitations
- The paper states that meta-analysis and systematic reviews can highlight evidence deficiencies but cannot overcome them; publication bias and research bias may be suspected and sometimes estimated but cannot truly be corrected; selective or incomplete reporting can constrain synthesis.
- The paper states that too many published meta-analyses are of low quality, the term “meta-analysis” is frequently misapplied, and vote-counting persists despite being discredited; it also notes concerns about academic inequality and the “research parasites” controversy.
- The text makes evident that, as a narrative review, it does not provide a systematic search strategy, formal inclusion criteria, or a quantitative synthesis; its examples are illustrative rather than exhaustive.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 4 Not valid · 37 Not checked · 33 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly, a synthesis may be constrained by either selective or incomplete reporting 66,67 .”
What the sources say
- Not checked yetcites [66] Stewart, L. A . et al. Preferred reporting items for a systematic review and meta-analysis of individual participant data: the PRISMA-IPD statement. J. Am. Med. Assoc. 313, 1657–1665 (2015) source
- Partly supportedcites [67] Saldanha, I. J . et al. Evaluating Data Abstraction Assistant, a novel software application for data abstraction during systematic reviews: protocol for a randomized controlled trial. Syst. Rev. 5, 196 (2016) sourceExperimental — accuracy not yet measured
The Background (page unavailable) reports that omissions and errors during data abstraction changed summary meta-analytic results, supporting the general point that a synthesis can be affected by missing information. It describes information present in articles but omitted by abstractors, not selective or incomplete reporting by the studies themselves; that specific mechanism is unsupported. (LLM, conf=0.78)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“When the number of studies is an order of magnitude greater than that, the inability of narrative processes to adequately summarize the outcomes increases exponentially 2,3 .”
What the sources say
- Not checked yetcites [2] Roberts, P. D ., Stewart, G. B. & Pullin, A. S. Are review articles a reliable source of evidence to support conservation and environmental management? A comparison with medicine. Biol. Conserv. 132, 409–423 (2006) source
- Partly supportedcites [3] Bastian, H ., Glasziou, P . & Chalmers, I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med. 7, e1000326 (2010) sourceExperimental — accuracy not yet measured
Our copy supports the qualitative half of the claim: the 'How Close Are We to Archie Cochrane's Goal?' section cites Goldschmidt and Mulrow for 'how great the potential is for error in reviews of health literature that were not conducted systematically' and states that 'the staple of medical literature synthesis remains the non-systematic narrative review', while the same section (Figure 4 discussion) and 'Where to Now?' document the growth from ~14 trials a day in 1979 to 75 trials and 11 systematic reviews a day, with 'the task keeps increasing in size and complexity' ('Where Are We Now?'). What the source does NOT support is the quantitative assertion attributed to it: nowhere does our copy say the inability of narrative processes to summarise outcomes 'increases exponentially', nor tie it to study counts an order of magnitude beyond a dozen — the only dozen-scale figure in the paper is the median number of trials per systematic review (six to 16, Cochrane reviews averaging over 12), which is offered as a measure of reviewing workload and coverage, not of narrative-review failure. The exponential scaling is therefore the citing authors' characterisation, not this paper's. (LLM, conf=0.72)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, as the number of publications and research results has mushroomed across scientific fields, the difficulties encountered in carrying out narrative reviews to identify and summarize evidence in a transparent manner has become increasingly apparent 1 .”
What the sources say
- Not checked yetcites [1] Jennions, M. D ., Lortie, C. J. & Koricheva, J. in The Handbook of Meta-analysis in Ecology and Evolution (eds Koricheva, J . et al.) Ch. 23, 364–380 (Princeton Univ. Press, 2013) source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, in many cases of the resolution of scientific problems, when the results of an individual study are combined with those of other studies, the resulting synthesis provides a more general and complete picture of the questions being addressed.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A statement the paper makes itself — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Sometimes, the striking results of initial studies are not confirmed by those of subsequent studies or by syntheses of a body of research.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
15 more claims
Create a free account to see all 78 claims and to verify the 60 references still open.
- It may state two separate claims as one. 32
- Probably not a substantial claim. 48
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The trade-off with our method is that it does not allow for determining the magnitude of the effect of the practices33–36 but only the proportion of impacts33,37 as positive, negative or neutral.”
From Farming practices to enhance biodiversity across biomes: a systematic review (2024) · cites this paper as [36]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Besides, publication biases that have been documented in several scientific fields90,91 can also affect ML-based science.92,93”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [91]
Experimental — accuracy not yet measuredIn the citing paper
“Moreover, since a meta-analysis can be conducted only when sufficient and appropriate quantitative data from original studies are available, the number of published meta-analyses about a certain topic is an indicator of the overall understanding of the subject, allowing us to reveal research gaps (25, 26).”
From Agricultural diversification promotes multiple ecosystem services without compromising yield (2020) · cites this paper as [25]
In the citing paper
“Meta-analysis optimises statistical power for detecting treatment effects by combining data from multiple similar studies [22, 23].”
From Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize? A systematic review (2022) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“𝜀 is the within-study sampling error (solid black lines), the deviation from the study-specific mean.”
§ Box 1: Meta-analytic models and heterogeneity
“the solid black lines are deviations from the overall mean (panels a,b) or slope (panels c,d)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“The assumption of the fixed-effect meta-regression is that a moderator(s) can explain all between-study heterogeneity”
§ Box 1: Meta-analytic models and heterogeneity
“the blue distributions the between-study variance (panels a-d).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“Two basic models of meta-analysis are the fixed-effect model (Fig 1a) and the random-effects model (Fig 1b) 6 .”
§ Box 1: Meta-analytic models and heterogeneity
“Figure 1. A variety of charts and plots common in meta-analysis. a. PRISMA diagram 20 , b. a forest plot showing overall means based on a fixed-effect model and random-effects model”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“Procedural protocols for systematic reviews are well established especially in the medical and social sciences (Preferred Reporting Items for Systematic Reviews, or PRISMA; www.prisma-statement.org) 20 .”
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 1×
“…the use of machine learning to screen studies 82 for inclusion in systematic reviews and meta-analyses for large reviews, increasingly sophisticated software and models for complex meta-regression 53,83 , and integration of meta-analysis with decision support in medicine and other domains 84 .”
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Research works printed but not linked: 3
- Hedges, L. & Olkin, I. Statistical Methods for Meta-analysis (Academic Press, 1985)
- Higgins, J. P. T . & Green, S. (eds) Cochrane Handbook for Systematic Reviews of Interventions: Version 5.1.0 (Wiley, 2011).This large collaborative work provides definitive guidance for the production of systematic reviews in medicine and is of broad interest for methods development outside the medical field.
- Cooper, H. M ., Hedges, L. V . & Valentine, J. C. (eds) The Handbook of Research Synthesis and Meta-analysis 2nd edn (Russell Sage Foundation, 2009).This book is an important compilation that builds on the ground-breaking first edition to set the standard for best practice in meta-analysis, primarily in the social sciences but with applications to medicine and other fields.
Cited by
Items 301–400 of 1,000
Gong, H., Meng, F., Wang, G., Hartmann, T. E., Feng, G., Wu, J., Jiao, X., & Zhang, F. S. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.150183 · Cited by 52
Adams, E. M., Gulka, J. E., & Williams, K. A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0256382 · Cited by 60
“Meta-analysis provides a method to account for multiple types of uncertainty and use predictor variables to explain patterns across studies [14].”
MethodAnalysis of biodiversity data suggests that mammal species are hidden in predictable places
Parsons, D. J., Pelletier, T. A., Wieringa, J. G., Duckett, D. J., & Carstens, B. C. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2103400119 · Cited by 52
A systematic review and meta-analysis of risk factors for intensive care unit acquired weakness
Yang, Z., Wang, X., Wang, F., Peng, Z., & Fan, Y. (2022) · Medicine · doi:10.1097/md.0000000000031405 · Cited by 62
“Since the term research synthesis and modern methods were first introduced in the 1970s, meta-analysis has a revolutionary impact in many areas of science, helping to establish evidence-based practice and resolve seemingly contradictory research findings.[25] Acquired muscle weakness – a serious and costly medical com…”
MethodSoil N 2 O emissions from specialty crop systems: A global estimation and meta‐analysis
Li, L., Hong, M., Zhang, Y., & Paustian, K. H. (2024) · Global Change Biology · doi:10.1111/gcb.17233 · Cited by 60
“The effect size synthe - sizes the outcomes of different studies on the same scale (Gurevitch et al., 2018 ) so that the outcomes of different studies are comparable.”
BackgroundKotchoubey, B., & Pavlov, Y. G. (2018) · Frontiers in Neurology · doi:10.3389/fneur.2018.00315 · Cited by 59
“Do studies of statistical power have an effect on the power of studies? Psychol Bull (1989) 105(2):309–16.”
BackgroundMethodInfluentialUnderstorey removal effects on tree regeneration in temperate forests: A meta‐analysis
Lombaerde, E. D., Baeten, L., Verheyen, K., Perring, M. P., Ma, S., & Landuyt, D. (2020) · Journal of Applied Ecology · doi:10.1111/1365-2664.13792 · Cited by 63
Global pattern and associated drivers of grassland productivity sensitivity to precipitation change
Wang, C., Vera-Vélez, R., Lamb, E. G., Wu, J., & Ren, F. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.151224 · Cited by 51
The Cooperation Databank: Machine-Readable Science Accelerates Research Synthesis
Spadaro, G., Tiddi, I., Columbus, S., Jin, S., ten Teije, A., CoDa Team, & Balliet, D. P. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211053319 · Cited by 86
“…is co-occurring with an awareness that research is not always reproducible and replicable (Baker, 2016; Open Science Collaboration, 2015), which further stresses the importance of comparing study results and surveying the entire body of evidence (Gurevitch et al., 2018; Murad & Montori, 2013).”
BackgroundResultCrop rotations synergize yield, nutrition, and revenue: a meta-analysis
Mudare, S., Jing, J., Makowski, D., He, X., Liang, Z., Sims, Z., Wanger, T. C., Tilman, D. G., Zhang, F. S., & Cong, W. (2025) · Nature Communications · doi:10.1038/s41467-025-64567-9 · Cited by 65
How to do meta-analysis of open datasets
Čulina, A., Crowther, T. W., Ramakers, J. J. C., Gienapp, P., & Visser, M. E. (2018) · Nature Ecology & Evolution · doi:10.1038/s41559-018-0579-2 · Cited by 53
Biases in studies of spatial patterns in insect herbivory
Zvereva, E. L., & Kozlov, M. V. (2019) · Ecological Monographs · doi:10.1002/ecm.1361 · Cited by 51
Co-benefits of nutrient management tailored to smallholder agriculture
Chivenge, P. P., Saito, K., Bunquin, M. A., Sharma, S., & Dobermann, A. (2021) · Global Food Security · doi:10.1016/j.gfs.2021.100570 · Cited by 58
“This can lead to misleading conclusions, if analytical techniques to overcome publication bias are not used (Borenstein et al., 2009; Gurevitch et al., 2018).”
BackgroundRevegetation through seeding or planting: A worldwide systematic map
Lázaro‐González, A., Andivia, E., Hampe, A., Hasegawa, S., Marzano, R., Santos, A. M. C., Castro, J., & Leverkus, A. B. (2023) · Journal of Environmental Management · doi:10.1016/j.jenvman.2023.117713 · Cited by 60
“As increasingly recognised, the value of ecological case studies is leveraged when they are collated and research findings are summarised in a broader context (Gurevitch et al., 2018).”
Li, Y., Hu, Y., Zhan, X., Song, Y., Xu, M., Wang, S., Huang, X., & Xu, Z. Z. (2023) · Gut Microbes · doi:10.1080/19490976.2023.2197835 · Cited by 58
“Meta-analysis addresses these discrepancies in an unbiased manner and identifies consistencies across studies.(30,31) Here, we presented an integrative meta-analysis on nine publicly available 16S rRNA datasets to characterize consistent alterations of the gastric microbiome associated with histological stages of gast…”
MethodMycorrhization enhances plant growth and stabilizes biomass allocation under drought
Tang, B., Man, J., Romero, F., Bergmann, J., Lehmann, A., & Rillig, M. C. (2024) · Global Change Biology · doi:10.1111/gcb.17438 · Cited by 54
“Therefore, meta-analysis has been widely employed to improve our comprehensive understanding of scientific issues across numerous independent studies and to identify knowledge gaps (Gurevitch et al., 2018).”
Bioinformatics for Marine Products: An Overview of Resources, Bottlenecks, and Perspectives
Ambrosino, L., Tangherlini, M., Colantuono, C., Esposito, A., Sangiovanni, M., Miralto, M., Sansone, C., & Chiusano, M. L. (2019) · Marine Drugs · doi:10.3390/md17100576 · Cited by 57
“Another interesting perspective is the meta-analytical approach [286].”
BackgroundHybrid test for publication bias in meta-analysis
Lin, L. (2020) · Statistical Methods in Medical Research · doi:10.1177/0962280220910172 · Cited by 58
“To generate standardized mean differences, we first sampled the study-specific true standard deviations ri of the subjects’ outcome measures from U(1, 5) in the N studies in a simulated meta-analysis, and this set of ri was used for all replications under each simulation setting.”
BackgroundMethodInfluentialMéndez‐Rojas, D. M., Cultid‐Medina, C., & Escobar, F. (2020) · Ecological Indicators · doi:10.1016/j.ecolind.2020.107239 · Cited by 54
Abduljabbar, R. L., Liyanage, S., & Dia, H. (2022) · Cities · doi:10.1016/j.cities.2022.103770 · Cited by 61
“Cognitive control in media multitaskers” ten years on: A meta-analysis
Parry, D. A., & Le Roux, D. B. (2021) · Cyberpsychology: Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp2021-2-7 · Cited by 49
Ma, C., Du, J., Dou, Y., Chen, R., Li, Y., Zhao, L., Liu, H., & Zhang, K. (2021) · Reproductive Sciences · doi:10.1007/s43032-020-00399-w · Cited by 51
“Meta-analysis is considered a multi-center study with large sample size, thus becoming an effective tool for establishing the relationships between exposures and health outcomes [75].”
BackgroundMeta-analysis in management and quality sciences
Dźwigoł, H. (2021) · Marketing and Management of Innovations · doi:10.21272/mmi.2021.1-25 · Cited by 61
Mucha, S., Tortereau, F., Doeschl-Wilson, A. B., Rupp, R., & Conington, J. (2022) · animal · doi:10.1016/j.animal.2022.100456 · Cited by 49
Serrão, C. P., Ortega, J. C. G., Rodrigues, P. C., & de Souza, C. R. B. (2024) · World Journal of Microbiology and Biotechnology · doi:10.1007/s11274-024-03935-x · Cited by 65
“…this approach provides a broad overview of the science field under study, based on a synthesis of multiple scientific reports with transparent search protocols, repro - ducible exclusion criteria and statistical tests to weigh the quality of studies (Borenstein et al. 2009; Gurevitch et al. 2018).”
Noble, D. W. A., Pottier, P., Lagisz, M., Burke, S., Drobniak, S. M., O’Dea, R. E., & Nakagawa, S. (2022) · Journal of Experimental Biology · doi:10.1242/jeb.243225 · Cited by 60
Self-citationYang, Y.-F., Macleod, M., Pan, J.-M., Lagisz, M., & Nakagawa, S. (2022) · Neuroscience and Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.105016 · Cited by 42
Self-citationAnantapantula, S. S., & Wilson, A. E. (2023) · Water Research · doi:10.1016/j.watres.2023.120342 · Cited by 52
Spartina alterniflora invasion benefits blue carbon sequestration in China
Zhang, J., Mao, D., Liu, J., Chen, Y., Kirwan, M. L., Sanders, C. J., Zhou, J., Lu, Z., Qin, G., Huang, X., et al. (2024) · 中国科学通报:英文版 · doi:10.1016/j.scib.2024.04.049 · Cited by 51
Wang, C., Sun, Y., Chen, H. Y. H., & Ruan, H. (2021) · CATENA · doi:10.1016/j.catena.2021.105219 · Cited by 50
Wu, H., Wang, J., Xiang, Y., Li, L., Qie, H., Ren, M., Lin, A., & Qi, F. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.146745 · Cited by 53
Willmott, T., Pang, B., Rundle-Thiele, S., & Badejo, A. (2019) · Health Psychology Review · doi:10.1080/17437199.2019.1625280 · Cited by 47
“…to incorporate quantitative meta-analyses to assess the magnitude of outcome(s) across relevant primary studies, and to analyse the sources of variation among study outcomes, sufficient and appropriate quantitative data is needed from the studies that are being summarised (Gurevitch et al., 2018).”
BackgroundVenier, L., Walton, R., & Brandt, J. P. (2020) · Environmental Reviews · doi:10.1139/er-2019-0072 · Cited by 49
Dynamic meta-analysis: a method of using global evidence for local decision making
Shackelford, G. E., Martin, P. A., Hood, A. S. C., Christie, A. P., Kulinskaya, E., & Sutherland, W. J. (2021) · BMC Biology · doi:10.1186/s12915-021-00974-w · Cited by 52
Hew, K. F., Bai, S., Huang, W., Dawson, P., Du, J., Huang, G., Jia, C., & Thankrit, K. (2021) · Australasian Journal of Educational Technology · doi:10.14742/ajet.6475 · Cited by 46
“The primary goal of these first-order meta-analyses (hereafter called primary meta-analyses) is to estimate an overall mean effect from individual empirical studies and to identify possible factors that moderate that effect (Gurevitch et al., 2018).”
BackgroundZhao, M., Wang, G., Wang, A., Cheng, L. J., & Lau, Y. (2022) · Neurological Sciences · doi:10.1007/s10072-022-05913-3 · Cited by 49
“An incomplete rate of over 20% without using missing data management was considered high attrition bias [27].”
BackgroundInteraction, Feedback and Task Research in Second Language Learning: Methods and Design
Mackey, A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108589284 · Cited by 83
The EICA is dead? Long live the EICA !
Callaway, R. M., Lucero, J. E., Hierro, J. L., & Lortie, C. J. (2022) · Ecology Letters · doi:10.1111/ele.14088 · Cited by 50
A meta-regression analysis of environmental sustainability practices and firm performance
Nogueira, E., Gomes, S., & Lopes, J. M. (2023) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2023.139048 · Cited by 60
Fu, X., Huang, Y., Fu, Q., Qiu, Y., Zhao, J., Li, J., Wu, X., Yang, Y., Liu, H., Yang, X., et al. (2023) · Frontiers in Plant Science · doi:10.3389/fpls.2023.1252821 · Cited by 63
Pervasive soil phosphorus losses in terrestrial ecosystems in China
Song, X., Alewell, C., Borrelli, P., Panagos, P., Huang, Y., Wang, Y., Wu, H., Yang, F., Yang, S., Sui, Y., et al. (2024) · Global Change Biology · doi:10.1111/gcb.17108 · Cited by 47
López‐Cortés, A., Paz‐y‐Miño, C., Cabrera‐Andrade, A., Barigye, S. J., Munteanu, C. R., González‐Díaz, H., Pazos, A., Pérez‐Castillo, Y., & Tejera, E. (2018) · Scientific Reports · doi:10.1038/s41598-018-35149-1 · Cited by 46
Poleward shift in large‐river fish communities detected with a novel meta‐analysis framework
Maire, A., Thierry, E., Viechtbauer, W., & Daufresne, M. (2019) · Freshwater Biology · doi:10.1111/fwb.13291 · Cited by 58
Fardet, A., Richonnet, C., & Mazur, A. (2019) · Nutrition Reviews · doi:10.1093/nutrit/nuz004 · Cited by 55
“Since the beginning of the year 2000, the number of published systematic reviews and meta-analyses has increased dramatically.(39) At this time, the number of studies on the association between consumption of fruit-based foods and the risk of chronic diseases is sufficient to perform a systematic review of meta-analys…”
Klinges, D. H., & Scheffers, B. R. (2020) · The American Naturalist · doi:10.1086/711873 · Cited by 51
Tolsá-García, M. J., Wehmeyer, M. L., Lühken, R., & Roiz, D. (2023) · Scientific Reports · doi:10.1038/s41598-022-27236-1 · Cited by 52
Liu, Z.-J., Panfilova, E. E., Mikhaylov, A. Y., & Kurilova, A. (2022) · Journal of Global Information Management · doi:10.4018/jgim.297905 · Cited by 49
“As can be seen in Figure 2, a systematic review derives the most relevant quantitative data from project reports that provide general information (Gurevitch et al., 2018).”
BackgroundAn overview of malarial Anopheles mosquito survival estimates in relation to methodology
Matthews, J., Bethel, A. C., & Osei, G. (2020) · Parasites & Vectors · doi:10.1186/s13071-020-04092-4 · Cited by 53
Social incentive factors in interventions promoting sustainable behaviors: A meta-analysis
Nguyen-Van, P., Stenger, A., & Tiet, T. T. (2021) · PLoS ONE · doi:10.1371/journal.pone.0260932 · Cited by 67
Floral resources predict the local bee community: Implications for conservation
Hyjazie, B. F., & Sargent, R. D. (2022) · Biological Conservation · doi:10.1016/j.biocon.2022.109679 · Cited by 53
Effects of climate on salmonid productivity: A global meta‐analysis across freshwater ecosystems
Gallagher, B. K., Geargeoura, S., & Fraser, D. J. (2022) · Global Change Biology · doi:10.1111/gcb.16446 · Cited by 58
“Similarly, temporal publication bias was explored by relating residuals from each best- fit model to publication year (Gurevitch et al., 2018).”
MethodInterventions for academically underachieving students: A systematic review and meta-analysis
Snyder, K. E., Fong, C. J., Painter, J. K., Pittard, C. M., Barr, S. M., & Patall, E. A. (2019) · Educational Research Review · doi:10.1016/j.edurev.2019.100294 · Cited by 70
Cochlear implant and tinnitus–a meta-analysis
Borges, A. L. D. F., Duarte, P. L. E. S., de Almeida, R. B. S., Ledesma, A. L. L., de Azevedo, Y. J., Pereira, L. V., & Bahmad, F. (2020) · Brazilian Journal of Otorhinolaryngology · doi:10.1016/j.bjorl.2020.11.006 · Cited by 39
Critical Infrastructures Overview: Past, Present and Future
Felice, F. D., Baffo, I., & Petrillo, A. (2022) · Sustainability · doi:10.3390/su14042233 · Cited by 60
“The PRISMA statement, developed by a group of experts in 2005, is based on the awareness that an accurate drafting of a literature analysis requires a rigorous standardized work [11].”
MethodBarcelos, S. S., Nascimento, K. B., da Silva, T. É., Mezzomo, R., Alves, K. S., Duarte, M. D. S., & Gionbelli, M. P. (2022) · Animals · doi:10.3390/ani12162145 · Cited by 54
“For these purposes, a systematic review associated with a meta-analysis is a powerful tool to aggregate results from a variety of studies, potentially providing new findings and indicating new paths to perform further studies [15].”
BackgroundDing, J., Travers, S. K., Delgado‐Baquerizo, M., & Eldridge, D. J. (2019) · Global Change Biology · doi:10.1111/gcb.14839 · Cited by 51
Impacts of tree mixtures on understory plant diversity in China
Gong, C., Tan, Q., Liu, G., & Xu, M. (2021) · Forest Ecology and Management · doi:10.1016/j.foreco.2021.119545 · Cited by 43
Zhang, G., Zhang, Y., Zhao, D., Liu, S., Wen, X., Han, J., & Liao, Y. (2022) · Field Crops Research · doi:10.1016/j.fcr.2022.108787 · Cited by 44
Zhang, W., Xu, M., Lu, J., Ren, T., Cong, R., Lu, Z., & Li, X. (2023) · Field Crops Research · doi:10.1016/j.fcr.2023.108970 · Cited by 43
Illustrating the importance of meta‐analysing variances alongside means in ecology and evolution
Sánchez‐Tójar, A., Moran, N. P., O’Dea, R. E., Reinhold, K., & Nakagawa, S. (2020) · Journal of Evolutionary Biology · doi:10.1111/jeb.13661 · Cited by 50
“Despite the exponential increase in the use of meta-analysis in recent years (Gurevitch et al., 2018; Stewart, 2009) almost all meta-analyses have exclusively focused on the study of mean effects (using effect sizes such as response ratios and standardized mean differences between two groups; Koricheva”
Self-citationIshihara, B. P., Farah, D., Fonseca, M. C. M., & Nazário, A. C. P. (2020) · Surgery for Obesity and Related Diseases · doi:10.1016/j.soard.2020.06.008 · Cited by 44
Conceptual and methodological issues in estimating the success of ecological restoration
Marchand, L., Castagneyrol, B., Jiménez, J. J., Beñayas, J. M. R., Benot, M., Martínez‐Ruiz, C., Alday, J. G., Jaunatre, R., Dutoit, T., Buisson, É., et al. (2021) · Ecological Indicators · doi:10.1016/j.ecolind.2021.107362 · Cited by 55
Asymmetric responses of terrestrial C:N:P stoichiometry to precipitation change
Sun, Y., Wang, C., Chen, H. Y. H., Luo, X., Qiu, N., & Ruan, H. (2021) · Global Ecology and Biogeography · doi:10.1111/geb.13343 · Cited by 44
Carbon Export Buffering and CO 2 Drawdown by Flexible Phytoplankton C:N:P Under Glacial Conditions
Matsumoto, K., Rickaby, R. E. M., & Tanioka, T. (2020) · Paleoceanography and Paleoclimatology · doi:10.1029/2019pa003823 · Cited by 46
“Meta‐analysis is a powerful statistical framework for synthesizing multiple, independent studies and uncovering trends, and it follows rigorous formal protocols to ensure reproducibility and reduce bias (Gurevitch et al., 2018).”
BackgroundImpact of human capital on technical efficiency in sustainable food crop production: a meta-analysis
Lich, H. K., Tiet, T. T., To‐The, N., & Nguyen‐Anh, T. (2021) · International Journal of Agricultural Sustainability · doi:10.1080/14735903.2021.1949880 · Cited by 52
Zhan, J., Sun, T., Wang, X., Wu, H., & Yu, J. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.160164 · Cited by 44
Wan, W., Li, Y., & Li, H. (2022) · Frontiers in Plant Science · doi:10.3389/fpls.2022.1051725 · Cited by 56
Devesa-Peiró, A., Sebastián-León, P., Garcia‐García, F., Arnau, V., Alemán, A., Pellicer, A., & Díaz-Gimeno, P. (2020) · Fertility and Sterility · doi:10.1016/j.fertnstert.2020.01.025 · Cited by 46
Irreproducibility in searches of scientific literature: A comparative analysis
Pozsgai, G., Löveï, G. L., Vasseur, L., Gurr, G. M., Batáry, P., Korponai, J. L., Littlewood, N. A., Liu, J., Móra, A., Obrycki, J. J., et al. (2021) · Ecology and Evolution · doi:10.1002/ece3.8154 · Cited by 50
“Thus the importance of systematic reviews continues to increase (Gurevitch et al., 2018).”
Zheng, H., Phillips, R. P., Rousk, J., Yue, K., Schmidt, I. K., Peng, Y., Wang, S., & Vesterdal, L. (2023) · Functional Ecology · doi:10.1111/1365-2435.14311 · Cited by 43
Yang, J., Mattoo, A. K., Liu, Y., Zvomuya, F., & He, H. (2023) · European Journal of Agronomy · doi:10.1016/j.eja.2023.126985 · Cited by 49
Feng, Y., Ge, J., Show, P.-L., Song, C. W., Wu, L., Ma, Z., & Gao, G. (2024) · Aquaculture · doi:10.1016/j.aquaculture.2024.741386 · Cited by 46
McKeown, S., & Ross‐White, A. (2019) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2019.443 · Cited by 55
“As publication of systematic reviews continue to rise every year [1, 2], librarians continue to define their roles [3] and develop service models [4–7] for supporting these research activities.”
BackgroundLiu, B., Zhao, X., Li, S., Zhang, X., Virk, A. L., Qi, J., Kan, Z., Wang, X., Ma, S., & Zhang, H. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.119632 · Cited by 41
A practical guide to preclinical systematic review and meta-analysis
Soliman, N., Rice, A. S. C., & Vollert, J. (2020) · Pain · doi:10.1097/j.pain.0000000000001974 · Cited by 44
“The work cannot be changed in any way or used commercially without permission from the journal. http://dx.doi.org/10.1097/j.pain.0000000000001974 September 2020·Volume 161·Number 9 www.painjournalonline.com 1949 limitations that persist, for example, SRs and MAs cannot overcome deficiency in evidence, nor do they corr…”
BackgroundInfluentialPinho, A. L., Amadon, A., Gauthier, B., Clairis, N., Knops, A., Genon, S., Dohmatob, E., Torre, J. J., Ginisty, C., Becuwe-Desmidt, S., et al. (2020) · Scientific Data · doi:10.1038/s41597-020-00670-4 · Cited by 47
Meissle, M., Naranjo, S. E., & Romeis, J. (2022) · Environmental Evidence · doi:10.1186/s13750-022-00272-0 · Cited by 41
“Meta-analysis optimises statistical power for detecting treatment effects by combining data from multiple similar studies [22, 23].”
Li, L., Liu, H., & Zhang, P. (2022) · Aquaculture Nutrition · doi:10.1155/2022/8517733 · Cited by 40
“Meta-analysis is a statistically analytical technique to quantitatively combine the results of independent experiments on the same topic, to overall comprehend a problem, determine variation sources, or construct a meta-regression model describing the relationship between variables [21].”
MethodMotivating factors of farmers’ adaptation behaviors to climate change in China: A meta-analysis
Huang, Y., Long, H., Jiang, Y., Feng, D., Ma, Z., & Mumtaz, F. (2024) · Journal of Environmental Management · doi:10.1016/j.jenvman.2024.121105 · Cited by 42
Bore, M. C., Liu, X., Huang, X., Kendrick, K. M., Zhou, B., Zhang, J., Klugah‐Brown, B., & Becker, B. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105835 · Cited by 44
Cancer phenotype in myotonic dystrophy patients: Results from a meta‐analysis
Emparanza, J. I., de Munaín, A. L., Greene, M. H., Matheu, A., Fernández‐Torrón, R., & Gadalla, S. M. (2018) · Muscle & Nerve · doi:10.1002/mus.26194 · Cited by 40
“In addition, it is prone to the effect of publication bias.(25) The small number of included studies limited our ability to effectively study such bias.”
BackgroundFlow states in exercise: A systematic review
Jackman, P. C., Hawkins, R. M., Crust, L., & Swann, C. (2019) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2019.101546 · Cited by 61
Wasson, K., Raposa, K. B., Almeida, M., Beheshti, K. M., Crooks, J. A., Deck, A. K., Dix, N., Garvey, C., Goldstein, J. S., Johnson, D. S., et al. (2019) · Ecology · doi:10.1002/ecy.2813 · Cited by 43
“Meta-analyses offer one effective tool for quantifying generality, by standardizing and analyzing groups of similar studies (Gurevitch et al. 2018).”
MethodDesign and engineering of artificial microbial consortia for biohydrogen production
Ergal, İ., Bochmann, G., Fuchs, W., & Rittmann, S. K. ‐. R. (2021) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2021.07.010 · Cited by 41
LeBlanc, N. (2021) · BioControl · doi:10.1007/s10526-021-10123-5 · Cited by 46
Euryhalinity of Ponto-Caspian invaders in their native and introduced regions
Pauli, N., & Briski, E. (2018) · Aquatic Invasions · doi:10.3391/ai.2018.13.4.02 · Cited by 42
“These findings could further support the notion of a freshwater euryhaline ancestry of Ponto-Caspian invaders (Gurevitch et al. 2018).”
ResultA meta-analysis of the relationship between climate change experience and climate change perception
Xia, Z., Ye, J., Zhou, Y., Howe, P. D., Xu, M., Tan, X., Tian, X., & Zhang, C. (2022) · Environmental Research Communications · doi:10.1088/2515-7620/ac9bd9 · Cited by 52
Devane, D., Burke, N. N., Treweek, S., Clarke, M., Thomas, J., Booth, A., Tricco, A. C., & Saif‐Ur‐Rahman, K. M. (2022) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12505 · Cited by 39
The importance of wetland habitat area for waterbird species‐richness
Cerda‐Peña, C., & Rau, J. R. (2023) · Ibis · doi:10.1111/ibi.13205 · Cited by 48
Fu, X., Sun, J., Tian, K., Liu, Y., & Zhang, H. J. (2025) · Environmental Science & Technology · doi:10.1021/acs.est.4c11313 · Cited by 45
A Meta‐Analysis of the Impact of Generative Artificial Intelligence on Learning Outcomes
Ma, N., & Zhong, Z. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70117 · Cited by 76
Tax compliance and non-deterrence approach: a systematic review
Dularif, M., & Rustiarini, N. W. (2021) · International Journal of Sociology and Social Policy · doi:10.1108/ijssp-04-2021-0108 · Cited by 100
Øen, M., Leknes, K. N., Lund, B. K., & Bunæs, D. F. (2021) · BMC Oral Health · doi:10.1186/s12903-021-02020-1 · Cited by 50
Wan, X., Holyoak, M., Yan, C., Maho, Y. L., Dirzo, R., Krebs, C. J., Stenseth, N. C., & Zhang, Z. (2022) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.12888 · Cited by 42
Interplay of higher plants with lithium pollution: Global trends, meta-analysis, and perspectives
Shakoor, N., Adeel, M., Azeem, I., Ahmad, M. A., Zain, M., Abbas, A., Hussain, M., Jiang, Y., Zhou, P., Li, Y., et al. (2022) · Chemosphere · doi:10.1016/j.chemosphere.2022.136663 · Cited by 42
Effects of land clearing for agriculture on soil organic carbon stocks in drylands: A meta‐analysis
Wang, Y., Luo, G., Li, C., Ye, H., Shi, H., Fan, B., Zhang, W., Zhang, C., Xie, M., & Zhang, Y. (2022) · Global Change Biology · doi:10.1111/gcb.16481 · Cited by 46
“Meta- analysis can help forward an overall understanding of the drivers of SOC stocks and concentrations while accounting for the variation in conditions among the original studies (de Souza Medeiros et al., 2020; Gurevitch et al., 2018).”
BackgroundMeta-analysis in finance research: Opportunities, challenges, and contemporary applications
Geyer‐Klingeberg, J., Hang, M., & Rathgeber, A. (2020) · International Review of Financial Analysis · doi:10.1016/j.irfa.2020.101524 · Cited by 50
Meta-analysis shows non-uniform responses of above- and belowground productivity to drought
Wang, C., Sun, Y., Chen, H. Y. H., Yang, J., & Ruan, H. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.146901 · Cited by 43
Nyfoudi, M., Shipton, H. J., Theodorakopoulos, N., & Budhwar, P. S. (2022) · Human Resource Management Journal · doi:10.1111/1748-8583.12443 · Cited by 64
Priorities in Bioeconomy Strategies: A Systematic Literature Review
Papadopoulou, C.-I., Loizou, E., & Chatzitheodoridis, F. (2022) · Energies · doi:10.3390/en15197258 · Cited by 50
“As a systematic review can be used by a variety of users such as citizens, researchers, and policy makers, it must be transparent, comprehensive, and accurate [22].”
Background
Metadata
- Authors
- Gurevitch, J., Koricheva, J., Nakagawa, S., & Stewart, G.
- Affiliations
- Stony Brook University (US)
- Royal Holloway University of London (GB)
- Garvan Institute of Medical Research (AU)
- Newcastle University (GB)
- Corresponding author
- Gurevitch, Jessica
- Koricheva, Julia
- Nakagawa, Shinichi
- Stewart, Gavin
- Venue
- Nature
- Published
- 2018-03
- Volume
- 555
- Issue
- 7695
- Pages
- 175-182
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2791681873
- Semantic Scholar
- ac5ad1932e31c3ea141366e8e073d6d95869c4ef
- Cited by
- 1,709
- References
- 101
- Citations by year
- 2026: 177 · 2025: 230 · 2024: 231 · 2023: 199 · 2022: 234 · 2021: 235 · 2020: 204 · 2019: 130 · 2018: 64
- FWCI
- 31.20
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- UNSWorks (UNSW Sydney) (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- National Science Foundation (1262402)
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- meta-analysis, evidence synthesis, history of meta-analysis, evolutionary biology, conservation biology, artificial intelligence, evidence-based practice
- MeSH terms
- Animals, Biological Science Disciplines, Ecology, Biological Evolution, Research, Meta-Analysis as Topic, History, 20th Century, History, 21st Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.