Meta-analysis and the science of research synthesis
Open accessThe DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index; 9 of the 69 sources its claims cite were checked for support.
Abstract
Meta-analysis is the quantitative, scientific synthesis of research results. Since the term and modern approaches to research synthesis were first introduced in the 1970s, meta-analysis has had a revolutionary effect in many scientific fields, helping to establish evidence-based practice and to resolve seemingly contradictory research outcomes. At the same time, its implementation has engendered criticism and controversy, in some cases general and others specific to particular disciplines. Here we take the opportunity provided by the recent fortieth anniversary of meta-analysis to reflect on the accomplishments, limitations, recent advances and directions for future developments in the field of research synthesis.
Overview
CoChat Summary
TL;DR
This review reflects on meta-analysis as quantitative research synthesis since the 1970s, its contributions to evidence-based practice, and its methodological development across medicine, social sciences, and ecology/evolution/conservation. It argues that meta-analysis has resolved contradictory evidence and enabled broad generalizations, but faces a “midlife crisis” from poor-quality applications, publication/research bias, and misuse of the term.
Key findings
- Meta-analysis was first introduced in the 1970s; the term was coined by Gene Glass in 1976, and the paper marks its 40th anniversary. It has helped establish evidence-based practice, resolve seemingly contradictory results, and spread across many scientific fields.
- In medicine, a meta-analysis of 20 clinical studies found maternal obesity associated with increased neural tube defect risk: a 1.7-fold rise for moderately obese women and over a 3-fold risk for severely obese women. In social science, a meta-analysis of 35 studies found no significant differences between multisystemic therapy and conventional social services for serious juvenile offenders.
- In ecology, evolution and conservation, meta-analysis was adopted in the early 1990s. Parmesan and Yohe used data on over 1,700 species to show significant range shifts and advancement of spring events; Benayas and colleagues found ecological restoration increased biodiversity and ecosystem services, though values remained lower in restored versus intact reference ecosystems.
- Methodological advances include fixed- and random-effects models, meta-regression, heterogeneity quantification (τ and I²), publication-bias tools, network meta-analysis, phylogenetic meta-analysis, and software such as MetaWin and OpenMEE. PRISMA includes a 27-item checklist for systematic review reporting.
Methods
- Design: narrative review/commentary on meta-analysis and research synthesis, not a new meta-analysis. The authors state they highlight principles, limitations, utility, and future developments.
- Data or sample: draws on published literature and illustrative examples across medicine, social sciences, and ecology/evolution/conservation; includes Box 1 on meta-analytic models and Table 1 on EEC milestones.
- Main analysis: conceptual and methodological synthesis; no primary data collection, systematic search protocol, or quantitative pooling is reported in the paper.
Limitations
- The paper states that meta-analysis and systematic reviews can highlight evidence deficiencies but cannot overcome them; publication bias and research bias may be suspected and sometimes estimated but cannot truly be corrected; selective or incomplete reporting can constrain synthesis.
- The paper states that too many published meta-analyses are of low quality, the term “meta-analysis” is frequently misapplied, and vote-counting persists despite being discredited; it also notes concerns about academic inequality and the “research parasites” controversy.
- The text makes evident that, as a narrative review, it does not provide a systematic search strategy, formal inclusion criteria, or a quantitative synthesis; its examples are illustrative rather than exhaustive.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 4 Not valid · 37 Not checked · 33 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly, a synthesis may be constrained by either selective or incomplete reporting 66,67 .”
What the sources say
- Not checked yetcites [66] Stewart, L. A . et al. Preferred reporting items for a systematic review and meta-analysis of individual participant data: the PRISMA-IPD statement. J. Am. Med. Assoc. 313, 1657–1665 (2015) source
- Partly supportedcites [67] Saldanha, I. J . et al. Evaluating Data Abstraction Assistant, a novel software application for data abstraction during systematic reviews: protocol for a randomized controlled trial. Syst. Rev. 5, 196 (2016) sourceExperimental — accuracy not yet measured
The Background (page unavailable) reports that omissions and errors during data abstraction changed summary meta-analytic results, supporting the general point that a synthesis can be affected by missing information. It describes information present in articles but omitted by abstractors, not selective or incomplete reporting by the studies themselves; that specific mechanism is unsupported. (LLM, conf=0.78)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“When the number of studies is an order of magnitude greater than that, the inability of narrative processes to adequately summarize the outcomes increases exponentially 2,3 .”
What the sources say
- Not checked yetcites [2] Roberts, P. D ., Stewart, G. B. & Pullin, A. S. Are review articles a reliable source of evidence to support conservation and environmental management? A comparison with medicine. Biol. Conserv. 132, 409–423 (2006) source
- Partly supportedcites [3] Bastian, H ., Glasziou, P . & Chalmers, I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med. 7, e1000326 (2010) sourceExperimental — accuracy not yet measured
Our copy supports the qualitative half of the claim: the 'How Close Are We to Archie Cochrane's Goal?' section cites Goldschmidt and Mulrow for 'how great the potential is for error in reviews of health literature that were not conducted systematically' and states that 'the staple of medical literature synthesis remains the non-systematic narrative review', while the same section (Figure 4 discussion) and 'Where to Now?' document the growth from ~14 trials a day in 1979 to 75 trials and 11 systematic reviews a day, with 'the task keeps increasing in size and complexity' ('Where Are We Now?'). What the source does NOT support is the quantitative assertion attributed to it: nowhere does our copy say the inability of narrative processes to summarise outcomes 'increases exponentially', nor tie it to study counts an order of magnitude beyond a dozen — the only dozen-scale figure in the paper is the median number of trials per systematic review (six to 16, Cochrane reviews averaging over 12), which is offered as a measure of reviewing workload and coverage, not of narrative-review failure. The exponential scaling is therefore the citing authors' characterisation, not this paper's. (LLM, conf=0.72)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, as the number of publications and research results has mushroomed across scientific fields, the difficulties encountered in carrying out narrative reviews to identify and summarize evidence in a transparent manner has become increasingly apparent 1 .”
What the sources say
- Not checked yetcites [1] Jennions, M. D ., Lortie, C. J. & Koricheva, J. in The Handbook of Meta-analysis in Ecology and Evolution (eds Koricheva, J . et al.) Ch. 23, 364–380 (Princeton Univ. Press, 2013) source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, in many cases of the resolution of scientific problems, when the results of an individual study are combined with those of other studies, the resulting synthesis provides a more general and complete picture of the questions being addressed.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A statement the paper makes itself — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Sometimes, the striking results of initial studies are not confirmed by those of subsequent studies or by syntheses of a body of research.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
15 more claims
Create a free account to see all 78 claims and to verify the 60 references still open.
- It may state two separate claims as one. 32
- Probably not a substantial claim. 48
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The trade-off with our method is that it does not allow for determining the magnitude of the effect of the practices33–36 but only the proportion of impacts33,37 as positive, negative or neutral.”
From Farming practices to enhance biodiversity across biomes: a systematic review (2024) · cites this paper as [36]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Besides, publication biases that have been documented in several scientific fields90,91 can also affect ML-based science.92,93”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [91]
Experimental — accuracy not yet measuredIn the citing paper
“Moreover, since a meta-analysis can be conducted only when sufficient and appropriate quantitative data from original studies are available, the number of published meta-analyses about a certain topic is an indicator of the overall understanding of the subject, allowing us to reveal research gaps (25, 26).”
From Agricultural diversification promotes multiple ecosystem services without compromising yield (2020) · cites this paper as [25]
In the citing paper
“Meta-analysis optimises statistical power for detecting treatment effects by combining data from multiple similar studies [22, 23].”
From Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize? A systematic review (2022) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“𝜀 is the within-study sampling error (solid black lines), the deviation from the study-specific mean.”
§ Box 1: Meta-analytic models and heterogeneity
“the solid black lines are deviations from the overall mean (panels a,b) or slope (panels c,d)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“The assumption of the fixed-effect meta-regression is that a moderator(s) can explain all between-study heterogeneity”
§ Box 1: Meta-analytic models and heterogeneity
“the blue distributions the between-study variance (panels a-d).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“Two basic models of meta-analysis are the fixed-effect model (Fig 1a) and the random-effects model (Fig 1b) 6 .”
§ Box 1: Meta-analytic models and heterogeneity
“Figure 1. A variety of charts and plots common in meta-analysis. a. PRISMA diagram 20 , b. a forest plot showing overall means based on a fixed-effect model and random-effects model”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“Procedural protocols for systematic reviews are well established especially in the medical and social sciences (Preferred Reporting Items for Systematic Reviews, or PRISMA; www.prisma-statement.org) 20 .”
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 1×
“…the use of machine learning to screen studies 82 for inclusion in systematic reviews and meta-analyses for large reviews, increasingly sophisticated software and models for complex meta-regression 53,83 , and integration of meta-analysis with decision support in medicine and other domains 84 .”
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Research works printed but not linked: 3
- Hedges, L. & Olkin, I. Statistical Methods for Meta-analysis (Academic Press, 1985)
- Higgins, J. P. T . & Green, S. (eds) Cochrane Handbook for Systematic Reviews of Interventions: Version 5.1.0 (Wiley, 2011).This large collaborative work provides definitive guidance for the production of systematic reviews in medicine and is of broad interest for methods development outside the medical field.
- Cooper, H. M ., Hedges, L. V . & Valentine, J. C. (eds) The Handbook of Research Synthesis and Meta-analysis 2nd edn (Russell Sage Foundation, 2009).This book is an important compilation that builds on the ground-breaking first edition to set the standard for best practice in meta-analysis, primarily in the social sciences but with applications to medicine and other fields.
Cited by
Items 701–800 of 1,000
An, H.-Y., Han, J.-J., He, Q.-N., Zhu, Y.-L., Wu, P., Wang, Y., Gao, Z., Du, T., & Xue, J. (2024) · Agronomy · doi:10.3390/agronomy14061164 · Cited by 25
Li, Z., Li, Y., & Fan, B. (2024) · Forest Ecology and Management · doi:10.1016/j.foreco.2024.122446 · Cited by 21
Braga, M. P., Niza, I. L., & Broday, E. E. (2025) · Building and Environment · doi:10.1016/j.buildenv.2025.112983 · Cited by 22
Ecosystem functions supported by soil bacterivorous nematodes
Trap, J., Brondani, M., Plassard, C., Hedde, M., & Puissant, J. (2025) · Geoderma · doi:10.1016/j.geoderma.2025.117575 · Cited by 18
Monaco, T. A., & Gunnell, K. L. (2020) · Plants · doi:10.3390/plants9091113 · Cited by 16
“To do this, we evaluated the relationships among pretreatment vegetation components and calculated effect-sizes for eight vegetation and soil surface variables to uncover the contingence of posttreatment vegetation change on plant community type for three common mechanical P–J reduction treatments using meta-analysis;…”
MethodFu, C., Shuang, Q., Liu, Y., Zeng, L., & Su, W. (2022) · ACS Chemical Neuroscience · doi:10.1021/acschemneuro.1c00439 · Cited by 15
Limited evidence for phenological differences between non-native and native species
Zettlemoyer, M. A., Ellis, S. L., Hale, C. W., Horne, E. C., Thoen, R. D., & DeMarche, M. L. (2022) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2022.983172 · Cited by 16
Zhang, Y., Li, D., Gómez-Ruano, M.-Á., Memmert, D., Li, C., & Fu, M. (2023) · Frontiers in Physiology · doi:10.3389/fphys.2023.1072798 · Cited by 35
“Consequently, a meta-analytic synthesis is useful for identifying potentially incongruent research findings and promoting evidence-based practice due to its comprehensiveness, quantifiable evidence, and practice-specific recommendations (Gurevitch et al., 2018).”
BackgroundGrassland stability decreases with increasing number of global change factors: A meta-analysis
Song, Z., Hautier, Y., & Wang, C. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.165651 · Cited by 16
“…to assess the effects of GCFs on community stability and its underlying mechanisms (species richness, species asynchrony and species stability, temporal mean and SD of productivity) under various GCF numbers, we used the techniques described by (Hedges et al., 2018) and (Gurevitch et al., 2018).”
Revisiting the Income Inequality-Crime Puzzle
Pazzona, M. (2024) · World Development · doi:10.1016/j.worlddev.2023.106520 · Cited by 21
“Meta-analysis techniques are currently applied in many different fields, such as medicine, biology and political science (Borenstein, Hedges, Higgins, & Rothstein, 2021; Gurevitch, Koricheva, Nakagawa, & Stewart, 2018).”
MethodKuhar, E., Chander, N., Stewart, D. J., Jahandideh, F., Zhang, H., Kristof, A. S., Bastarache, J. A., Schmidt, E. P., Taljaard, M., Thébaud, B., et al. (2024) · American Journal of Physiology-Lung Cellular and Molecular Physiology · doi:10.1152/ajplung.00336.2023 · Cited by 17
Research on Digital Transformation in Higher Education: Present Concerns and Future Endeavours
Rahmadi, I. F. (2024) · TechTrends · doi:10.1007/s11528-024-00971-0 · Cited by 34
“Respecting the functions of a structured overview, namely for understanding the state of a field (Gurevitch et al., 2018; Kraus et al., 2020; Linnenluecke et al., 2020), recommending the enhancement of current praxises and pinpointing next studies (Newman & Gough, 2020; Xiao & Watson, 2019).”
Synthesis of sexual selection: a systematic map of meta‐analyses with bibliometric analysis
Pollo, P., Lagisz, M., Yang, Y., Čulina, A., & Nakagawa, S. (2024) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.13117 · Cited by 21
“…additionally provide quantitative measures related to the average and dispersion of studies ’ outcomes by standardising (effect sizes) and weighting them by their precision coupled with solid statistical techniques (Jennions et al ., 2012; Gurevitch et al ., 2018; Borenstein et al ., 2021).”
Self-citationEvaluating GPT Models for Automated Literature Screening in Wastewater-Based Epidemiology
Chibwe, K., Mantilla‐Calderon, D., & Ling, F. (2024) · ACS Environmental Au · doi:10.1021/acsenvironau.4c00042 · Cited by 17
The social costs of pesticides: a meta-analysis of the experimental and stated preference literature
Rufo, E., Brouwer, R., & van Beukering, P. J. H. (2024) · Scientific Reports · doi:10.1038/s41598-024-83298-3 · Cited by 22
Meta-synthesis reveals interconnections among apparent drivers of insect biodiversity loss
Halsch, C. A., Elphick, C. S., Bahlai, C. A., Forister, M. L., Wagner, D. L., Ware, J. L., & Grames, E. M. (2025) · BioScience · doi:10.1093/biosci/biaf034 · Cited by 21
“…literature indicates the dominant foci of a field (Anderson et al. 2021 ), this metric contains biases that are also potentially responsible for the com-monness of a hypothesis and should not be treated as a direct index of biological importance (Gurevitch et al. 2018 , Mupepele et al. 2019b ).”
Habtewold, T. D., Alemu, S. M., Mohammed, S. H., Endalamaw, A., Akibu, M., Teferra, A. A., Tura, A. K., Asefa, N. G., & Tegegne, B. S. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.01.011 · Cited by 16
Muoka, M. O., & Lhussier, M. (2020) · Journal of Poverty and Social Justice · doi:10.1332/175982720x15971673526089 · Cited by 14
Subject‐specific segregation of functional territories based on deep phenotyping
Pinho, A. L., Amadon, A., Fabre, M., Dohmatob, E., Denghien, I., Torre, J. J., Ginisty, C., Becuwe-Desmidt, S., Roger, S., Laurier, L., et al. (2020) · Human Brain Mapping · doi:10.1002/hbm.25189 · Cited by 18
“Meta-analysis is a way to generalize across different implementations of tasks (Wager et al., 2007; Costafreda, 2011; Müller et al., 2018; Gurevitch et al., 2018).”
MethodBakdash, J. Z., Marusich, L. R., Kenworthy, J. B., Twedt, E., & Zaroukian, E. G. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.609647 · Cited by 16
Mass‐effect: Understanding the relationship between age and otolith weight in fishes
Pacheco, C., Bustamante, C., & Araya, M. (2021) · Fish and Fisheries · doi:10.1111/faf.12542 · Cited by 14
Recommendations for Advancing FAIR and Open Data Standards in the Water Treatment Community
Quay, A. N., Fiske, P. S., & Mauter, M. S. (2021) · ACS ES&T Engineering · doi:10.1021/acsestengg.1c00245 · Cited by 14
Decline effects are rare in ecology: Comment
Yang, Y., Lagisz, M., & Nakagawa, S. (2023) · Ecology · doi:10.1002/ecy.4069 · Cited by 14
“However, we point out that for their test, Costello and Fox (2022) employed a procedure akin to vote-counting, which is not a preferred method for assessing cumulative evidence in any discipline (Freemantle and Geddes 1998, Combs et al. 2011, Harrison 2011, Gurevitch et al. 2018).”
MethodSelf-citationJin, X., Antony, B., Wang, X., Persson, M. S. M., McAlindon, T. E., Arden, N., Srivastava, S. R., Srivastava, R. N., van Middelkoop, M., Bierma‐Zeinstra, S., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-035302 · Cited by 19
Interaction, Feedback and Task Research in Second Language Learning : Methods and Design
Mackey, A. (2020) · Cited by 15
Albert, G., Gallegos, S. C., Greig, K., Hanisch, M., de la Fuente, D. L., Föst, S., Maier, S. D., Sarathchandra, C., Phillips, H. R. P., & Kambach, S. (2021) · Forest Ecology and Management · doi:10.1016/j.foreco.2021.119201 · Cited by 21
Cover crops do increase soil organic carbon stocks—A critical comment on Chaplot and Smith (2023)
Poeplau, C., Liang, Z., Don, A., Seitz, D., Notaris, C. D., Angers, D. A., Barré, P., Beillouin, D., Cardinael, R., Ceschia, É., et al. (2024) · Global Change Biology · doi:10.1111/gcb.17128 · Cited by 15
“Obviously, international standards to carry out systematic reviews and meta-analyses (Gurevitch et al., 2018) were not followed by Chaplot and Smith (2023), which is a major shortcoming of this paper.”
BackgroundDong, J., Chi, J., & Wang, D. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1432510 · Cited by 14
A Systematic Review and Meta-Analysis of Research on Goals for Behavior Change
Zhu, J., Lolla, S., Agnihotri, M., Tappeh, S. A., Guluzade, L., Agapie, E., & Sas, C. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714072 · Cited by 29
“For this, we run a meta-analysis whose aim is to explore the synthesis of the effectiveness across different interventions [92].”
Pollinator‐Promoting Interventions in European Urban Habitats—A Synthesis
Süle, G., Báldí, A., Kleijn, D., Steffan-Dewenter, I. D., Venn, S., Goulson, D., Dietzel, S., Muratet, A., Cole, L. J., Öckinger, E., et al. (2025) · Ecology Letters · doi:10.1111/ele.70189 · Cited by 20
“Classical meta-analysis combines and analyses the results of multiple independent studies (Gurevitch et al. 2018).”
Frandsen, T. F., Nielsen, M. F. B., & Eriksen, M. B. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.05.015 · Cited by 14
Designing a Needs-Oriented Psychological Intervention for Chinese Women Undergoing an Abortion
Wang, N., Creedy, D. K., Zhang, M., Lu, H. S., Elder, E. G., Allen, J., Guo, L., Xiao, Q., & Gamble, J. A. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20010782 · Cited by 15
“The considerable heterogeneity and methodological limitations across studies contributed to conflicting outcomes, making it impossible to conclude which intervention optimized health outcomes [21].”
BackgroundRealising respiratory microbiomic meta-analyses: time for a standardised framework
Broderick, D. T. J., Marsh, R. L., Waite, D. W., Pillarisetti, N., Chang, A. B., & Taylor, M. W. (2023) · Microbiome · doi:10.1186/s40168-023-01499-w · Cited by 16
“Although often regarded as the highest level of evidence in clinical research [8], the utility of meta-analyses becomes limited where the underlying data are complicated by clinical, technical and/or analytic heterogeneity among the primary studies [9, 10].”
BackgroundA standard protocol to report discrete stage‐structured demographic information
Gascoigne, S. J. L., Rolph, S., Sankey, D., Nidadavolu, N., Pičman, A. S. S., Hernández, C. M., Philpott, M. E. R., Salam, A., Bernard, C., Fenollosa, E., et al. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14164 · Cited by 22
Shahraki-Mohammadi, A., Keikha, L., & Zahedi, R. (2024) · Systematic Reviews · doi:10.1186/s13643-023-02439-3 · Cited by 17
“SRs are widely used in many fields of medicine, especially in evidence-based practice [3, 4], and are at the highest level of the pyramid of studies for evidence-based decision-making [5].”
BackgroundWinner and loser effects: a meta-analysis
Yan, J. L., Smith, N. M. T., Filice, D. C. S., & Dukas, R. (2024) · Animal Behaviour · doi:10.1016/j.anbehav.2024.07.014 · Cited by 23
“We followed the PRISMA guidelines for conducting and presenting meta-analyses (Gurevitch et al., 2018; Moher et al., 2015; Siddaway et al., 2018).”
MethodJiang, L., Li, S., zheng, H., Zhang, T., Li, J., Tian, B., & Ma, J. (2024) · Field Crops Research · doi:10.1016/j.fcr.2024.109686 · Cited by 14
Dualities of the vitamin D in systemic sclerosis: a systematic literature review
Schneider, L., Hax, V., Monticielo, O. A., Macedo, T. F., Barreto, R. K. M., Marcondes, N. A., & Chakr, R. M. D. S. (2021) · Revista Brasileira de Reumatologia · doi:10.1186/s42358-021-00192-6 · Cited by 14
A comprehensive review of the analysis and integration of omics data for SARS-CoV-2 and COVID-19
Zhu, Z., Zhang, S., Wang, P., Chen, X., Bi, J., Cheng, L., & Zhang, X. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab446 · Cited by 14
“Meta-analysis is a standard method for studying omics data of COVID-19, which is the quantitative and scientific synthesis of research results [117].”
MethodRyo, M., Jeschke, J. M., Rillig, M. C., & Heger, T. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1363 · Cited by 15
“19,20,23 While these limitations are recognized and cannot be denied, policy-makers and practitioners need evidence synthesis by any means to comprehend and solve urgent real-world problems that are highly complex and usually lack mechanistic explanations.”
BackgroundMethodBiases in global effects of exotic species on local invertebrates: a systematic review
Florencio, M., Lobo, J. M., & Bini, L. M. (2019) · Biological Invasions · doi:10.1007/s10530-019-02062-1 · Cited by 14
A Guide to Conducting a Meta-Analysis with Non-Independent Effect SizesPreprint
Cheung, M. W. ‐. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5p7dj · Cited by 16
Yang, Y., Sánchez‐Tójar, A., O’Dea, R. E., Noble, D. W. A., Koricheva, J., Jennions, M. D., Parker, T., Lagisz, M., & Nakagawa, S. (2022) · doi:10.32942/osf.io/97nv6 · Cited by 14
Self-citationAdvancing Meta‐Analytic Methods in L2 Research
Plonsky, L., Hu, Y., Sudina, E., & Oswald, F. L. (2023) · Wiley eBooks · doi:10.1002/9781394259670.ch14 · Cited by 20
Meta-Analysis of the Impact of Far-Red Light on Vegetable Crop Growth and Quality
Zhang, M., Ju, J., Hu, Y., He, R., Song, J., & Liu, H. (2024) · Plants · doi:10.3390/plants13172508 · Cited by 16
“Meta-analysis is a method that integrates results from multiple independent studies by systematically collecting, synthesizing, and analyzing existing research to derive more comprehensive and reliable conclusions [22].”
BackgroundMethodCai, Y., Yang, Y., Jiang, J., Long, T., Gu, X., Guo, Y., Li, M., & Xie, Y. (2025) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2025.178481 · Cited by 22
Forero, D. A., Abreu, S. E., Tovar, B. E., & Oermann, M. H. (2025) · Journal of Medical Systems · doi:10.1007/s10916-025-02212-0 · Cited by 13
“In this context, Systematic Reviews (SRs) and Meta-Analyses (MAs) have become cornerstones for the synthesis of research findings (for different types of primary studies) [2–4], being among the most highly cited articles [5] and are major inputs for clinical guidelines [6].”
Lu, D., Liu, L., Bai, Y., An, Q., Cheng, Y., & Huang, G. (2025) · Agricultural Water Management · doi:10.1016/j.agwat.2025.109872 · Cited by 13
Why we waste: A meta-analysis of food waste behavior using the Theory of Planned Behavior (TPB)
Malau, L. R. E., Khaliqi, M., Yulni, T., Rambe, K. R., Novanda, R. R., & Wibowo, R. P. (2025) · Sustainable Futures · doi:10.1016/j.sftr.2025.101421 · Cited by 20
Guijarro-Belmar, A., Varone, A., Baltzer, M. R., Kataria, S., Tanriver-Ayder, E., Watzlawick, R., Sena, E. S., Cunningham, C. J., Rajnicek, A. M., Macleod, M. R., et al. (2022) · Spinal Cord · doi:10.1038/s41393-022-00811-z · Cited by 15
do Prado, P. R., Silveira, R. C. D. C. P., Vettore, M. V., Fossum, M., Vabo, G. L., & Gimenes, F. R. E. (2023) · Intensive and Critical Care Nursing · doi:10.1016/j.iccn.2023.103447 · Cited by 13
Review of Critical Factors Affecting the Failure of Water Pipeline Infrastructure
Almheiri, Z., Meguid, M. A., & Zayed, T. M. (2023) · Journal of Water Resources Planning and Management · doi:10.1061/jwrmd5.wreng-5896 · Cited by 13
Synthesising results of meta-analyses to inform policy: a comparison of fast-track methods
Makowski, D., Catarino, R., Chen, M., Bosco, S., Montero‐Castaño, A., Pérez‐Soba, M., Schievano, A., & Tamburini, G. (2023) · Environmental Evidence · doi:10.1186/s13750-023-00309-y · Cited by 20
“As the number of published MAs is increasing exponentially [2, 12], multiple MAs are now often available on a specific topic, reporting a broad range of results with sometimes conflicting conclusions.”
BackgroundPhosphorus fertilization enhances terrestrial carbon cycling in phosphorus-deficient ecosystems
Sun, Y., & Chen, X. (2023) · Journal of Environmental Management · doi:10.1016/j.jenvman.2023.119941 · Cited by 13
Miner, G. L., Stewart, C. E., Delgado, J. A., Ippolito, J. A., Mason, R. E., Haley, S. D., Guttieri, M. J., Ainsworth, E. A., McGrath, J. M., & Beebout, S. J. (2024) · Field Crops Research · doi:10.1016/j.fcr.2024.109338 · Cited by 16
Li, H., Zhang, J., & Huang, K. (2024) · Public Performance & Management Review · doi:10.1080/15309576.2024.2405839 · Cited by 27
“Meta-analysis is a quantitative and scientific approach that involves synthesizing research results to comprehensively understand a particular problem or hypothesized causal associations (Gerrish, 2016; Gurevitch et al., 2018).”
Watkins, S., & Collins, A. (2024) · Journal of Flood Risk Management · doi:10.1111/jfr3.13042 · Cited by 24
“Scholars identify the need for data analysis and extraction processes for environmental reviews such as this one to develop a priori rules to extract data in a repeatable, standardised manner (Gurevitch et al., 2018; Pullin & Stewart, 2006).”
MethodSamarasinghe, G., Lagisz, M., Santamouris, M., Yenneti, K., Upadhyay, A. K., Suarez, F. D. L. P., Taunk, B., & Nakagawa, S. (2019) · Solar Energy · doi:10.1016/j.solener.2019.04.062 · Cited by 17
Self-citationThe relationship between socioeconomic development, renewable energies and the innovative process
Sousa, S. R. D. O., da Silva, W. V., Kaczam, F., da Cruz, N. J. T., da Veiga, C. P., & Zanini, R. R. (2022) · International Journal of Energy Sector Management · doi:10.1108/ijesm-05-2021-0020 · Cited by 17
Hooijmans, C. R., Donders, R., Magnuson, K., Wever, K. E., Ergün, M., Rooney, A. A., Walker, V. R., & Langendam, M. W. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1578 · Cited by 13
Li, J., Li, S., Liu, C., Guo, D., & Zhang, Q. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.162428 · Cited by 12
Biofloc technology and immune response of penaeid shrimp: A meta-analysis and meta-regression
Ríos, L. D. M., Monteagudo, E. B., Barrios, Y. C., González, L. L., Vaillant, Y. D. L. C. V., Bossier, P., & Arenal, A. (2023) · Fish & Shellfish Immunology · doi:10.1016/j.fsi.2023.108805 · Cited by 13
Cuff, J. P., Barrett, M., Gray, H., Fox, C. W., Watt, A. D., & Aimé, E. (2024) · Agricultural and Forest Entomology · doi:10.1111/afe.12617 · Cited by 14
“Meta-analysis has the potential to synthesize evidence based on multiple sometimes contradictory sources (Gurevitch et al., 2018), which is particularly powerful in resolving global patterns.”
Partially systematic thoughts on the history of systematic reviews
Clarke, M. J. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0833-3 · Cited by 15
A web-based tool for synthesis assessments of the impacts of climate change on water resources
de Amorim, P. B., de Souza, K. I. S., & Chaffe, P. L. B. (2020) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2020.104848 · Cited by 15
Smaïl‐Faugeron, V., Tan, A. L., Caille, A., Yordanov, Y., Hajage, D., Tubach, F., Martin, G. L., & Dechartres, A. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.01.023 · Cited by 15
“All these changes may limit the generalizability of older trial results(8) and may affect the intervention effect itself(9, 10).”
Infodemiological study on COVID-19 epidemic and COVID-19 infodemic (Preprint)Preprint
Zhi, H., Yang, Z., Li, Q., Zhang, A., & Huang, Y. (2020) · doi:10.2196/preprints.19135 · Cited by 13
p-Hacking and Publication Bias Interact to Distort Meta-Analytic Effect Size EstimatesPreprint
Friese, M., & Frankenbach, J. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/bvm58 · Cited by 15
Nakagawa, S., Yang, Y., Macartney, E. L., Spake, R., & Lagisz, M. (2023) · doi:10.32942/x2kk5n · Cited by 13
Self-citationSpurious Precision in Meta-Analysis of Observational ResearchPreprint
Iršová, Z., Bom, P. R. D., Havránek, T., & Rachinger, H. J. (2023) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/3qp2w · Cited by 21
Al-Emran, M., Sarker, A., Adib, S. S., Nayem, M. J., Sultana, T., Sadat, M. A., & Shahjahan, M. (2025) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2025.180620 · Cited by 12
Wang, W., Wang, Y., Chen, J., Wang, X., Zhang, H., Chunli, G., & Peng, Y. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251410020 · Cited by 30
“Meta-analysis serves as a powerful tool for synthesizing fi ndings from multiple studies, offering deeper insights into the impact of AI-supported personalized feedback across various educational contexts (Gurevitch et al., 2018; Panic et al., 2013; Wang & Lyu, 2025).”
Fostering Scientific Meta-analyses with Knowledge Graphs: A Case-Study
Tiddi, I., Balliet, D. P., & ten Teije, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49461-2_17 · Cited by 12
Quality of meta‐analyses in freshwater ecology: A systematic review
Lodi, S., Godoy, B. S., Ortega, J. C. G., & Bini, L. M. (2021) · Freshwater Biology · doi:10.1111/fwb.13695 · Cited by 14
“Narrative reviews are useful to explore perspectives, conceptual frameworks, and historical advances, and to provide a broader interpretation of topics (Collins & Fauser, 2005; Gurevitch et al., 2018).”
BackgroundMethodInfluentialMantilla‐Calderon, D., Huang, K.-Y., Li, A., Chibwe, K., Yu, X. A., Ye, Y., Liu, L., & Ling, F. (2022) · Environmental Science Water Research & Technology · doi:10.1039/d2ew00084a · Cited by 11
Dang, Q., Ma, F., Yuan, Q., Fu, Y., Chen, K., Zhang, Z., Lu, C., & Guo, T. (2023) · Cerebral Cortex · doi:10.1093/cercor/bhad121 · Cited by 16
Yan, Z., Feng, C., Jin, X., Qiao, Y., Wang, J., Huang, N., & Bai, Y. (2023) · Reviews of Environmental Contamination and Toxicology · doi:10.1007/s44169-023-00041-1 · Cited by 12
“Subsequently, a systematically review and meta-analysis were carried out in April 2022, both of which were conducted according to the guidelines outline in Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) (Gurevitch et al. 2018; Moher et al. 2009).”
MethodManchanda, P., Chaudhary, P., & Deswal, R. (2023) · Physiology and Molecular Biology of Plants · doi:10.1007/s12298-023-01367-9 · Cited by 12
“The conclusions are made by drawing parallels from various categories of datasets and establishing them through different statistical analysis (Gurevitch et al. 2018).”
BackgroundZhou, S., & Chi, G. (2024) · Demographic Research · doi:10.4054/demres.2024.50.2 · Cited by 19
“Meta-analysis is a powerful method to establish evidence-based knowledge by reviewing numerous studies addressing the same research question and comparing their results (Gheasi et al. 2019; Gurevitch et al. 2018).”
MethodMukube, P., Hitzman, M. W., Machogo-Phao, L., & Syampungani, S. (2024) · Minerals · doi:10.3390/min14030294 · Cited by 12
Fan, C., Li, C., & Song, X. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1365877 · Cited by 26
Autonomous Ships: A Thematic Review
Abudu, R., & Bridgelall, R. (2024) · World · doi:10.3390/world5020015 · Cited by 22
“This process helps in identifying research gaps and offering insights for theoretical development and future studies [10].”
BackgroundSun, J., Caputo, V., & Taylor, H. (2024) · Applied Economic Perspectives and Policy · doi:10.1002/aepp.13446 · Cited by 18
Native plants do not benefit from arriving early, but invasives pay to arrive late
Singh, K., Sobuj, N., & Byun, C. (2024) · Ecological Indicators · doi:10.1016/j.ecolind.2024.112453 · Cited by 14
Examining the dietary effect of insect meals on the innate immune response of fish: A meta-analysis
Chen, Y., Ellis, J. L., & Huyben, D. C. (2024) · Comparative Immunology Reports · doi:10.1016/j.cirep.2024.200169 · Cited by 17
Niu, K., Xiao, H., Wang, Y., Cui, T., & Zhao, C. (2024) · Ecotoxicology and Environmental Safety · doi:10.1016/j.ecoenv.2024.117439 · Cited by 14
Liu, X., Xu, Y., Ameen, A., Gull, N., Fan, S., & Liu, G. (2025) · Plant and Soil · doi:10.1007/s11104-025-07556-7 · Cited by 13
“Meta-analyses serve as a valuable tool for synthesizing data from individual studies with diverse experimental conditions and for drawing more gener-alizable conclusions based on effect sizes (Gurevitch et al. 2018).”
Meta-analysis in the production chain of aquaculture: A review
Yu, G., Liu, C., Zheng, Y., Chen, Y., Li, D., & Qin, W. (2021) · Information Processing in Agriculture · doi:10.1016/j.inpa.2021.04.002 · Cited by 12
A penalization approach to random‐effects meta‐analysis
Wang, Y., Lin, L., Thompson, C. G., & Chu, H. (2021) · Statistics in Medicine · doi:10.1002/sim.9261 · Cited by 14
“Using the technique of profile likelihood by taking the target function’s derivative in Equation (2) with respect to 𝜇 for a given 𝜏2,45 the optimization is achieved at ?”
MethodInfluentialMeta-analysis of chromatic properties of heat-treated wood
Zhan, T., Zhu, J., Liu, Z., Li, T., Peng, H., Jiang, J., & Lyu, J. (2022) · European Journal of Wood and Wood Products · doi:10.1007/s00107-022-01831-5 · Cited by 13
Pérez, J. F. R., Torres, V. G. L., & Valdés, M. M. (2021) · Journal of Administrative Science · doi:10.29057/jas.v2i4.6750 · Cited by 12
“A meta-analysis was performed, as a summary mechanism of multiple studies related to a specific issue, which follows the procedure established by Gurevitch and collaborators, where it must be [20]:”
MethodImplementasi Pendekatan Saintifik dalam Pembelajaran IPA di Indonesia : Suatu Meta-Analisis
Elvianasti, M., Lufri, L., Asrizal, A., & Rikizaputra, R. (2021) · EDUKATIF JURNAL ILMU PENDIDIKAN · doi:10.31004/edukatif.v4i1.1819 · Cited by 17
Ras, J., Kengne, A. P., Smith, D. L., Soteriades, E. S., & Leach, L. L. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-061435 · Cited by 17
Infodemiological study on COVID-19 epidemic and COVID-19 infodemicPreprint
Zhi, H., Yang, Z., Li, Q., Zhang, A., & Huang, Y. (2020) · doi:10.21203/rs.3.rs-18591/v1 · Cited by 14
Yang, Y., Noble, D. W. A., Spake, R., Senior, A. M., Lagisz, M., & Nakagawa, S. (2023) · EcoEvoRxiv · doi:10.32942/x2rg7x · Cited by 12
Self-citationRuan, M., Fan, J., Liu, M., Meng, Z., Zhang, X., & Zhang, C. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02644-9 · Cited by 12
“Evidence synthesis, often referred to as research synthesis, is an essential methodology for aggregating evidence from existing studies to inform healthcare decision-making [1].”
Peng, Z., Wu, X., Qin, Z., Doi, S. A. R., Furuya‐Kanamori, L., Hong, Y., Lin, L., Chu, H., Xu, C., & Liu, M. (2025) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2025.102192 · Cited by 16
Tang, W., Yu, G., Fu, Q., Zhou, S., Hao, Y., Xiao, M., Lv, G., & Chen, C. (2025) · Agricultural Water Management · doi:10.1016/j.agwat.2025.109982 · Cited by 11
Steegmans, P. A. J., Bipat, S., & Reynders, R. M. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1000-1 · Cited by 12
Zhou, S., Wu, B., Liu, Z., & Zhang, T. (2021) · Journal of Animal and Feed Sciences · doi:10.22358/jafs/138774/2021 · Cited by 11
Metadata
- Authors
- Gurevitch, J., Koricheva, J., Nakagawa, S., & Stewart, G.
- Affiliations
- Stony Brook University (US)
- Royal Holloway University of London (GB)
- Garvan Institute of Medical Research (AU)
- Newcastle University (GB)
- Corresponding author
- Gurevitch, Jessica
- Koricheva, Julia
- Nakagawa, Shinichi
- Stewart, Gavin
- Venue
- Nature
- Published
- 2018-03
- Volume
- 555
- Issue
- 7695
- Pages
- 175-182
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2791681873
- Semantic Scholar
- ac5ad1932e31c3ea141366e8e073d6d95869c4ef
- Cited by
- 1,709
- References
- 101
- Citations by year
- 2026: 177 · 2025: 230 · 2024: 231 · 2023: 199 · 2022: 234 · 2021: 235 · 2020: 204 · 2019: 130 · 2018: 64
- FWCI
- 31.20
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- UNSWorks (UNSW Sydney) (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- National Science Foundation (1262402)
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- meta-analysis, evidence synthesis, history of meta-analysis, evolutionary biology, conservation biology, artificial intelligence, evidence-based practice
- MeSH terms
- Animals, Biological Science Disciplines, Ecology, Biological Evolution, Research, Meta-Analysis as Topic, History, 20th Century, History, 21st Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.