Meta-analysis and the science of research synthesis
Open accessThe DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index; 9 of the 69 sources its claims cite were checked for support.
Abstract
Meta-analysis is the quantitative, scientific synthesis of research results. Since the term and modern approaches to research synthesis were first introduced in the 1970s, meta-analysis has had a revolutionary effect in many scientific fields, helping to establish evidence-based practice and to resolve seemingly contradictory research outcomes. At the same time, its implementation has engendered criticism and controversy, in some cases general and others specific to particular disciplines. Here we take the opportunity provided by the recent fortieth anniversary of meta-analysis to reflect on the accomplishments, limitations, recent advances and directions for future developments in the field of research synthesis.
Overview
CoChat Summary
TL;DR
This review reflects on meta-analysis as quantitative research synthesis since the 1970s, its contributions to evidence-based practice, and its methodological development across medicine, social sciences, and ecology/evolution/conservation. It argues that meta-analysis has resolved contradictory evidence and enabled broad generalizations, but faces a “midlife crisis” from poor-quality applications, publication/research bias, and misuse of the term.
Key findings
- Meta-analysis was first introduced in the 1970s; the term was coined by Gene Glass in 1976, and the paper marks its 40th anniversary. It has helped establish evidence-based practice, resolve seemingly contradictory results, and spread across many scientific fields.
- In medicine, a meta-analysis of 20 clinical studies found maternal obesity associated with increased neural tube defect risk: a 1.7-fold rise for moderately obese women and over a 3-fold risk for severely obese women. In social science, a meta-analysis of 35 studies found no significant differences between multisystemic therapy and conventional social services for serious juvenile offenders.
- In ecology, evolution and conservation, meta-analysis was adopted in the early 1990s. Parmesan and Yohe used data on over 1,700 species to show significant range shifts and advancement of spring events; Benayas and colleagues found ecological restoration increased biodiversity and ecosystem services, though values remained lower in restored versus intact reference ecosystems.
- Methodological advances include fixed- and random-effects models, meta-regression, heterogeneity quantification (τ and I²), publication-bias tools, network meta-analysis, phylogenetic meta-analysis, and software such as MetaWin and OpenMEE. PRISMA includes a 27-item checklist for systematic review reporting.
Methods
- Design: narrative review/commentary on meta-analysis and research synthesis, not a new meta-analysis. The authors state they highlight principles, limitations, utility, and future developments.
- Data or sample: draws on published literature and illustrative examples across medicine, social sciences, and ecology/evolution/conservation; includes Box 1 on meta-analytic models and Table 1 on EEC milestones.
- Main analysis: conceptual and methodological synthesis; no primary data collection, systematic search protocol, or quantitative pooling is reported in the paper.
Limitations
- The paper states that meta-analysis and systematic reviews can highlight evidence deficiencies but cannot overcome them; publication bias and research bias may be suspected and sometimes estimated but cannot truly be corrected; selective or incomplete reporting can constrain synthesis.
- The paper states that too many published meta-analyses are of low quality, the term “meta-analysis” is frequently misapplied, and vote-counting persists despite being discredited; it also notes concerns about academic inequality and the “research parasites” controversy.
- The text makes evident that, as a narrative review, it does not provide a systematic search strategy, formal inclusion criteria, or a quantitative synthesis; its examples are illustrative rather than exhaustive.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 4 Not valid · 37 Not checked · 33 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly, a synthesis may be constrained by either selective or incomplete reporting 66,67 .”
What the sources say
- Not checked yetcites [66] Stewart, L. A . et al. Preferred reporting items for a systematic review and meta-analysis of individual participant data: the PRISMA-IPD statement. J. Am. Med. Assoc. 313, 1657–1665 (2015) source
- Partly supportedcites [67] Saldanha, I. J . et al. Evaluating Data Abstraction Assistant, a novel software application for data abstraction during systematic reviews: protocol for a randomized controlled trial. Syst. Rev. 5, 196 (2016) sourceExperimental — accuracy not yet measured
The Background (page unavailable) reports that omissions and errors during data abstraction changed summary meta-analytic results, supporting the general point that a synthesis can be affected by missing information. It describes information present in articles but omitted by abstractors, not selective or incomplete reporting by the studies themselves; that specific mechanism is unsupported. (LLM, conf=0.78)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“When the number of studies is an order of magnitude greater than that, the inability of narrative processes to adequately summarize the outcomes increases exponentially 2,3 .”
What the sources say
- Not checked yetcites [2] Roberts, P. D ., Stewart, G. B. & Pullin, A. S. Are review articles a reliable source of evidence to support conservation and environmental management? A comparison with medicine. Biol. Conserv. 132, 409–423 (2006) source
- Partly supportedcites [3] Bastian, H ., Glasziou, P . & Chalmers, I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med. 7, e1000326 (2010) sourceExperimental — accuracy not yet measured
Our copy supports the qualitative half of the claim: the 'How Close Are We to Archie Cochrane's Goal?' section cites Goldschmidt and Mulrow for 'how great the potential is for error in reviews of health literature that were not conducted systematically' and states that 'the staple of medical literature synthesis remains the non-systematic narrative review', while the same section (Figure 4 discussion) and 'Where to Now?' document the growth from ~14 trials a day in 1979 to 75 trials and 11 systematic reviews a day, with 'the task keeps increasing in size and complexity' ('Where Are We Now?'). What the source does NOT support is the quantitative assertion attributed to it: nowhere does our copy say the inability of narrative processes to summarise outcomes 'increases exponentially', nor tie it to study counts an order of magnitude beyond a dozen — the only dozen-scale figure in the paper is the median number of trials per systematic review (six to 16, Cochrane reviews averaging over 12), which is offered as a measure of reviewing workload and coverage, not of narrative-review failure. The exponential scaling is therefore the citing authors' characterisation, not this paper's. (LLM, conf=0.72)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, as the number of publications and research results has mushroomed across scientific fields, the difficulties encountered in carrying out narrative reviews to identify and summarize evidence in a transparent manner has become increasingly apparent 1 .”
What the sources say
- Not checked yetcites [1] Jennions, M. D ., Lortie, C. J. & Koricheva, J. in The Handbook of Meta-analysis in Ecology and Evolution (eds Koricheva, J . et al.) Ch. 23, 364–380 (Princeton Univ. Press, 2013) source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, in many cases of the resolution of scientific problems, when the results of an individual study are combined with those of other studies, the resulting synthesis provides a more general and complete picture of the questions being addressed.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A statement the paper makes itself — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Sometimes, the striking results of initial studies are not confirmed by those of subsequent studies or by syntheses of a body of research.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
15 more claims
Create a free account to see all 78 claims and to verify the 60 references still open.
- It may state two separate claims as one. 32
- Probably not a substantial claim. 48
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The trade-off with our method is that it does not allow for determining the magnitude of the effect of the practices33–36 but only the proportion of impacts33,37 as positive, negative or neutral.”
From Farming practices to enhance biodiversity across biomes: a systematic review (2024) · cites this paper as [36]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Besides, publication biases that have been documented in several scientific fields90,91 can also affect ML-based science.92,93”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [91]
Experimental — accuracy not yet measuredIn the citing paper
“Moreover, since a meta-analysis can be conducted only when sufficient and appropriate quantitative data from original studies are available, the number of published meta-analyses about a certain topic is an indicator of the overall understanding of the subject, allowing us to reveal research gaps (25, 26).”
From Agricultural diversification promotes multiple ecosystem services without compromising yield (2020) · cites this paper as [25]
In the citing paper
“Meta-analysis optimises statistical power for detecting treatment effects by combining data from multiple similar studies [22, 23].”
From Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize? A systematic review (2022) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“𝜀 is the within-study sampling error (solid black lines), the deviation from the study-specific mean.”
§ Box 1: Meta-analytic models and heterogeneity
“the solid black lines are deviations from the overall mean (panels a,b) or slope (panels c,d)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“The assumption of the fixed-effect meta-regression is that a moderator(s) can explain all between-study heterogeneity”
§ Box 1: Meta-analytic models and heterogeneity
“the blue distributions the between-study variance (panels a-d).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“Two basic models of meta-analysis are the fixed-effect model (Fig 1a) and the random-effects model (Fig 1b) 6 .”
§ Box 1: Meta-analytic models and heterogeneity
“Figure 1. A variety of charts and plots common in meta-analysis. a. PRISMA diagram 20 , b. a forest plot showing overall means based on a fixed-effect model and random-effects model”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“Procedural protocols for systematic reviews are well established especially in the medical and social sciences (Preferred Reporting Items for Systematic Reviews, or PRISMA; www.prisma-statement.org) 20 .”
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 1×
“…the use of machine learning to screen studies 82 for inclusion in systematic reviews and meta-analyses for large reviews, increasingly sophisticated software and models for complex meta-regression 53,83 , and integration of meta-analysis with decision support in medicine and other domains 84 .”
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Research works printed but not linked: 3
- Hedges, L. & Olkin, I. Statistical Methods for Meta-analysis (Academic Press, 1985)
- Higgins, J. P. T . & Green, S. (eds) Cochrane Handbook for Systematic Reviews of Interventions: Version 5.1.0 (Wiley, 2011).This large collaborative work provides definitive guidance for the production of systematic reviews in medicine and is of broad interest for methods development outside the medical field.
- Cooper, H. M ., Hedges, L. V . & Valentine, J. C. (eds) The Handbook of Research Synthesis and Meta-analysis 2nd edn (Russell Sage Foundation, 2009).This book is an important compilation that builds on the ground-breaking first edition to set the standard for best practice in meta-analysis, primarily in the social sciences but with applications to medicine and other fields.
Cited by
Items 801–900 of 1,000
Yang, X., Li, X., Wang, X., Ding, F., Chen, F., Wang, J., Zhang, X., & Zhang, Y. (2022) · Ecological Indicators · doi:10.1016/j.ecolind.2022.109269 · Cited by 11
Ren, G., & Chen, Y. (2023) · Frontiers in Environmental Science · doi:10.3389/fenvs.2022.1038607 · Cited by 15
“existing relevant empirical research results in a certain field or topic to conclude the research topic, it has become amore systematic, rigorous, and reproducible method of accumulating evidence (Gurevitch et al., 2018).”
BackgroundDing, J., & Eldridge, D. J. (2023) · Journal of Applied Ecology · doi:10.1111/1365-2664.14551 · Cited by 11
Young, G., Grogan, H. M., Walsh, L. E., Noble, R., Tracy, S., & Schmidt, O. (2024) · Cleaner and Circular Bioeconomy · doi:10.1016/j.clcb.2024.100100 · Cited by 17
Scientific land greening under climate change: Theory, modeling, and challenges
Chen, J., Zhu, Z., Cao, S., Zhao, P.-J., Liu, P., Li, D., Wang, W., & Chen, Y. (2024) · Advances in Climate Change Research · doi:10.1016/j.accre.2024.08.003 · Cited by 11
The impact of financial inclusion initiatives: Evidence from meta‐analysis
Biru, A. G., Molla, A., Ferraro, S., & Navon, Y. (2024) · Journal of International Development · doi:10.1002/jid.3943 · Cited by 19
Okoh, P., Olusanya, D. A., Erinne, O. C., Achara, K. E., Aboaba, A. O., Abiodun, R. F., Gbigbi-Jackson, G. A., Abiodun, R. F., Oredugba, A., Dieba, R., et al. (2024) · Cureus · doi:10.7759/cureus.72443 · Cited by 25
“…while simultaneously promoting atherosclerosis [13] Insulin resistance further exacerbates cardiovascular risk by promoting dyslipidemia and HTN. Insulin-resistant states are associated with increased free fatty acid flux, contributing to lipid abnormalities and endothelial cell damage [10].”
Almangush, A., Alabi, R. O., Pirinen, M., Mäkitie, A. A., & Leivo, I. V. V. (2024) · BMC Cancer · doi:10.1186/s12885-024-13317-z · Cited by 11
Habitat preference contributes to explaining the varied sensitivity of bats to anthropogenic noise
Li, A., Tian, X., Ma, N., & Luo, J. (2025) · Biological Conservation · doi:10.1016/j.biocon.2025.110974 · Cited by 13
Stronger tree size-mortality association with increasing droughts and basal areas: A meta-analysis
Nixon, B., Hammond, W. M., Zou, C. B., & Zhai, L. (2025) · Ecological Indicators · doi:10.1016/j.ecolind.2025.113326 · Cited by 17
Evidence-Based Decision Making 4: Clinical Practice Guidelines
Yi, T. W., Donnellan, S., & Levin, A. (2021) · Methods in molecular biology · doi:10.1007/978-1-0716-1138-8_24 · Cited by 15
A global meta-analysis of the effects of plant diversity on biomass partitioning in grasslands
Wang, C., Zhang, W., Li, X., Hou, Y., & Wu, J. (2021) · Environmental Research Letters · doi:10.1088/1748-9326/ac0747 · Cited by 12
Data-driven quantification of nitrogen enrichment impact on Northern Hemisphere plant biomass
Liu, Y., Piao, S. L., Makowski, D., Ciais, P., Gasser, T., Song, J., Wan, S., Peñuelas, J., & Janssens, I. A. (2022) · Environmental Research Letters · doi:10.1088/1748-9326/ac7b38 · Cited by 12
Marine gastropods at higher trophic level show stronger tolerance to ocean acidification
Hu, N., Brönmark, C., Bourdeau, P. E., & Hollander, J. (2022) · Oikos · doi:10.1111/oik.08890 · Cited by 13
THE EFFECT DIRECTION SHOULD BE TAKEN INTO ACCOUNT WHEN ASSESSING SMALL-STUDY EFFECTS
Meng, Z., Wu, C., & Lin, L. (2022) · Journal of Evidence Based Dental Practice · doi:10.1016/j.jebdp.2022.101830 · Cited by 11
Macartney, E. L., Drobniak, S. M., Nakagawa, S., & Lagisz, M. (2023) · Environmental Evidence · doi:10.1186/s13750-022-00290-y · Cited by 12
“Also, given recent advances in systematic techniques, particularly in meta-analysis and for disciplines beyond biomedical science [33, 54–57], as well as a general increase in the number of articles published per year across fields [58] it is apt that the evidence syntheses of the non-genetic…”
BackgroundSelf-citationPathogen load predicts host functional disruption: A meta‐analysis of an amphibian fungal panzootic
Wu, N. C. (2023) · Functional Ecology · doi:10.1111/1365-2435.14245 · Cited by 11
FAIR and Open Data requires proper incentives and a shift in academic culture
Verbeke, R. (2023) · Nature Water · doi:10.1038/s44221-022-00012-1 · Cited by 11
Effects of goal orientation on online learning: A meta-analysis of differences in Korea and US
Beik, A.-R., & Cho, Y. (2023) · Current Psychology · doi:10.1007/s12144-023-04389-4 · Cited by 25
Meta-analysis of new technologies in post-harvest of tropical flowers
Neto, A. R. D. C., Paiva, P. D. D. O., Ponce, M. M., Calvelli, J. V. B., & Barbosa, S. (2023) · Ornamental Horticulture · doi:10.1590/2447-536x.v29i2.2643 · Cited by 11
Taxonomy-based differences in feeding guilds of fish
Sánchez‐Hernández, J. (2019) · Current Zoology · doi:10.1093/cz/zoz015 · Cited by 11
“It should be kept in mind that with the current growing sophistication of analytical approaches available and meta-analytical opportunities (e.g., Zuur et al. 2009; Gurevitch et al. 2018), researchers need to be cognizant of the limitations posed by lumping of data to overcome heterogeneity, publication bias and inher…”
BackgroundTravers, M. J., Murphy, M., Debenham, J. R., Chivers, P., Bulsara, M. K., Bagg, M. K., Palsson, T. S., & Gibson, W. (2019) · British Journal of Sports Medicine · doi:10.1136/bjsports-2018-099958 · Cited by 13
Kotta, J., Lenz, M., Barboza, F. R., Jänes, H., Grande, P. A. D., Beck, A. J., Colen, C. V., Hamm, T., Javidpour, J., Kaasik, A., et al. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.156610 · Cited by 14
Diet Induces Reproducible Alterations in the Mouse and Human Gut MicrobiomePreprint
Bisanz, J. E., Upadhyay, V., Turnbaugh, J. A., Ly, K., & Turnbaugh, P. J. (2019) · SSRN Electronic Journal · doi:10.1101/541797 · Cited by 11
Beillouin, D., Ari, T. B., & Makowski, D. (2020) · Environmental Research Letters · doi:10.1088/1748-9326/ab5ffb · Cited by 11
“In these unweighted analyses, within-and between-study variations are not easily disentangled and heterogeneity may be difficult to analyze properly (Gurevitch et al 2018).”
BackgroundLewis, M. L., Mathur, M. B., VanderWeele, T. J., & Frank, M. C. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/pbrdk · Cited by 16
Bohoussou, N. Y., Zheng, G., Zhang, S., Wu, W., Ju, F., Ayenikafo, O. M., Boboua, S. Y. B., & Dang, Y. P. (2025) · European Journal of Agronomy · doi:10.1016/j.eja.2025.127911 · Cited by 12
Interpretation of meta-analyses
Clephas, P. R. D., & Heesen, M. A. (2022) · Interventional Pain Medicine · doi:10.1016/j.inpm.2022.100120 · Cited by 17
“SRs and MAs can be challenging, especially given the advances in methodology that have been evolved in this fi eld over the years [4].”
BackgroundConsumer preferences towards goat milk and goat milk products: a mini review
Zulkifli, T. I. N. T. M., Syahlan, S., Saili, A. R., Pahang, J. T., Ruslan, N. A., & Suyanto, A. (2023) · Food Research · doi:10.26656/fr.2017.7(s2).15 · Cited by 10
“Authors can create systematic reviews from many areas of information using PRISMA for various audiences, including respondents, researchers and policymakers (Gurevitch et al ., 2018).”
Zhang, X., Kumar, A., Sathe, A. A., Mootha, V. V., & Xing, C. (2023) · PLoS ONE · doi:10.1371/journal.pone.0295542 · Cited by 11
“Meta-analysis synthesizes data from multiple independent studies by quantitative methods to reach conclusions [53, 54].”
MethodToward a more credible assessment of the credibility of science by many-analyst studies
Auspurg, K., & Brüderl, J. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2404035121 · Cited by 16
“Typically, some function of the precision of the estimates is used as the weight (22, 40, 41).”
MethodCo-culture of rice and aquatic animals enhances soil organic carbon: A meta-analysis
Li, S., Li, W., Ding, K., Shi, X., Kalkhajeh, Y. K., Wei, Z., Zhang, Z., & Ma, C. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.176819 · Cited by 12
da Silva, O. N., Bandeira, R. D. S., & de Souza, C. R. B. (2025) · World Journal of Microbiology and Biotechnology · doi:10.1007/s11274-025-04300-2 · Cited by 10
“…and meta-analysis have been particularly relevant in approaches that explore the complexity of endophytic inter - actions in the agronomic context (Gurevitch et al. 2018; Tufail et al. 2022 ; Riva et al. 2022; Serrão et al. 2024), where the data to be evaluated may be dispersed and fragmented.”
Nakagawa, S., Mizuno, A., Morrison, K., Ricolfi, L., Williams, C., Drobniak, S. M., Lagisz, M., & Yang, Y. (2025) · Global Change Biology · doi:10.1111/gcb.70204 · Cited by 15
“These approaches recognize that effect sizes are not identical and that moderators—such as climate gradients, habitat types, taxonomic groups, or methodological factors— may help explain some of the variance (Gurevitch et al. 2018; Nakagawa, Yang, et al. 2023; Nakagawa et al. 2017).”
Self-citationSolà, J., & Griffin, J. N. (2025) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2024.2723 · Cited by 10
“To ensure transparency and robustness, model structures were pre-specified, covariate testing was applied consistently, and sample sizes, effect sizes, confidence intervals and sensitivity results were fully reported ([51]; electronic supplementary material, S11 and S12).”
Beneficial plants-Trichoderma interactions on host tolerance to abiotic stresses: a meta-analysis
dos Santos, L. B. P. R., Santos, N. O., de Novais, D. P. S., Cruz‐Magalhães, V., & Loguercio, L. L. (2025) · Frontiers in Plant Physiology · doi:10.3389/fphgy.2025.1569221 · Cited by 15
Linguistic Synesthesia: A Meta-analysis
Winter, B., & Lievers, F. S. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009519182 · Cited by 15
A pluralistic framework for measuring, interpreting and decomposing heterogeneity in meta‐analysis
Yang, Y., Noble, D. W. A., Spake, R., Senior, A. M., Lagisz, M., & Nakagawa, S. (2025) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.70155 · Cited by 25
“In ecological and evolutionary datasets, complexity often arises from the inclusion of diverse species, temporal and spatial variations (Gurevitch et al., 2018).”
Self-citationSpurious precision in meta-analysis of observational research
Iršová, Z., Bom, P. R. D., Havránek, T., & Rachinger, H. J. (2025) · Nature Communications · doi:10.1038/s41467-025-63261-0 · Cited by 26
“Inverse-variance weighting reigns in meta-analysis 1 .”
Effects of surgical implantation of electronic tags in fishes: a review and meta-analysis
Shorgan, M. B., Raby, G. D., Fedus, A. L., Howell, B. E., Haniford, L. S. E., Howitt, L. C., Klinard, N. V., Matley, J. K., Brownscombe, J. W., Cooke, S. J., et al. (2025) · Reviews in Fish Biology and Fisheries · doi:10.1007/s11160-025-10020-5 · Cited by 18
“Evidence syntheses, especially those that include meta-analyses, represent arguably the most rigorous form of scientific evidence (Gurevitch et al. 2018; Murad et al. 2016).”
Zero tillage and water productivity: A review
Phogat, M., Dahiya, R., Sangwan, P. S., & Goyal, V. (2020) · International Journal of Chemical Studies · doi:10.22271/chemi.2020.v8.i5ai.10698 · Cited by 12
“A study cumulates and summarises all the available literature on a given subject in order to quantitatively determine the outcome through similar primary studies and the source of variance between these findings (Gurevitch et al., 2018) [18].”
BackgroundMindfulness and PERMA Well-Being: Intervention Effects and Mechanism of Change
Liu, B., Ye, G., Jing, H., Hofmann, S. G., & Liu, X. (2022) · Psychology · doi:10.4236/psych.2022.135046 · Cited by 11
Ecomorphosis in European Collembola: A review in the context of trait-based ecology
Bonfanti, J., Krogh, P. H., Hedde, M., & Cortet, J. (2022) · Applied Soil Ecology · doi:10.1016/j.apsoil.2022.104692 · Cited by 12
Climatic impact, future biomass production, and local adaptation of four switchgrass cultivars
Zhang, L., Juenger, T., Lowry, D. B., & Behrman, K. D. (2019) · GCB Bioenergy · doi:10.1111/gcbb.12609 · Cited by 13
Effects of treatment classifications in network meta-analysis
Xing, A., & Lin, L. (2020) · Research Methods in Medicine & Health Sciences · doi:10.1177/2632084320932756 · Cited by 12
“Methods for metaanalysis have been rapidly developed over the recent forty years.(1) In this era of big data, researchers continue to be enthusiastic about looking for evidence from all possible sources and combining them together in a more informative form.”
BackgroundPelone, F., Jacklin, P., Francis, J. M., & Purchase, B. (2021) · International Psychogeriatrics · doi:10.1017/s1041610220004111 · Cited by 9
COVID-19 meta-analyses: a scoping review and quality assessment
Pires, G. N., Bezerra, A. G., de Oliveira, T. B., Chen, S. F. I., Malfatti, V. D. A., de Mello, V. F. F., Niyama, A., Pinto, V. L. S., Andersen, M. L., & Tufik, S. B. (2021) · Einstein (São Paulo) · doi:10.31744/einstein_journal/2021ao6002 · Cited by 10
“O número total de metanálises aumentou consideravelmente nos últimos anos,(21) e essa publicação em massa tem sido fortemente criticada.”
BackgroundMeta‐analysis of anti‐swelling efficiency (ASE) of heat‐treated wood
Zhan, T., Liu, Z., Peng, H., Jiang, J., Zhang, Y., & Lyu, J. (2021) · European Journal of Wood and Wood Products · doi:10.1007/s00107-021-01691-5 · Cited by 10
Cornito, C. M. (2021) · Innovation journal of social sciences and economic review. · doi:10.36923/ijsser.v3i3.122 · Cited by 22
Akbari, M., Sabouri, H., Sajadi, S. J., Yarahmadi, S., Ahangar, L., Abedi, A., & Katouzi, M. (2022) · Genes · doi:10.3390/genes13112087 · Cited by 11
An Intellectual Framework for Drug Administration Methods in Anesthesia: Three Practice Domains
Egan, T. D. (2018) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000003601 · Cited by 10
Seki, T., & Kurnaz, M. F. (2021) · Educational Academic Research · doi:10.33418/ataunikkefd.991723 · Cited by 16
Response of Growth-Related Traits of Submerged Macrophytes to Light Reduction: A Meta-Analysis
Gao, J., Hu, W. W., Wang, J., Cui, Y., & Li, L. (2023) · Sustainability · doi:10.3390/su15075918 · Cited by 9
Do citizen perceptual measures align with archival performance measures: a meta-analysis
Hsu, H., & Lu, J. (2023) · International Public Management Journal · doi:10.1080/10967494.2023.2204085 · Cited by 11
“They enable meta-analysts to put results from different studies on the same scale and then combine them for synthesis purposes (Gurevitch et al. 2018).”
Ponte, E. M. D., Barro, J. P., & Madden, L. V. (2024) · Plant Disease · doi:10.1094/pdis-10-23-2180-fe · Cited by 12
Wang, L., Li, T., Gu, R., & Feng, C. (2024) · NeuroImage · doi:10.1016/j.neuroimage.2024.120824 · Cited by 15
“This approach quantitatively examines the convergence across studies, offering a comprehensive overview of the research field while addressing the heterogeneity and discrepancies seen in previous results due to limited sample sizes (Fox, 2018; Gurevitch et al., 2018).”
Mohamed, T. H., Alexander, R. N., Davidson, B., Klamer, B. G., Gehred, A. P., Starr, M. C., Slagle, C. L., Krawczeski, C. D., & Harer, M. W. (2024) · American Journal of Perinatology · doi:10.1055/a-2417-4087 · Cited by 9
TetraDENSITY 2.0—A Database of Population Density Estimates in Tetrapods
Santini, L., Angarita, V. Y. M., Karoulis, C., Fundaro', D., Pranzini, N., Vivaldi, C., Zhang, T., Zampetti, A., Gargano, S., Mirante, D., et al. (2024) · Global Ecology and Biogeography · doi:10.1111/geb.13929 · Cited by 9
Wei, Y., Jing, X., Chen, Y., Sun, W., Zhang, Y., & Zhu, R. (2024) · Toxics · doi:10.3390/toxics12110787 · Cited by 9
“Literature quality assessment was conducted using criteria based on a meta-analysis [116].”
A meta-analysis of influencing factors on soil pollution around copper smelting sites
Li, M., Li, X., Hartley, W., Luo, X., Xiang, C., Liu, J., Guo, J., & Xue, S. (2024) · Journal of Environmental Management · doi:10.1016/j.jenvman.2024.123083 · Cited by 13
Dong, J., Sun, S., Zhan, G., Sun, J., Tang, Y., & Wang, Y. (2024) · Environmental Research Letters · doi:10.1088/1748-9326/ad9d60 · Cited by 9
“All statistical analyses regarding meta-analysis calculations were performed using OpenMEE, an open source software for meta-analysis of ecology (Gurevitch et al 2018).”
Climate factors dominate the spatial variation of forest soil nutrients: a meta analysis
Du, X.-X., Li, X., Wang, J., Xu, J., & Gao, J. (2025) · Frontiers in Forests and Global Change · doi:10.3389/ffgc.2024.1525250 · Cited by 9
“This analysis was conducted using the R package “lme4” (Gurevitch et al., 2018).”
Poorter, H., Pons, T. L., & Reichgelt, T. (2025) · Plant Ecophysiology · doi:10.53941/plantecophys.2025.100001 · Cited by 11
“A standard meta-analysis typically categorizes the levels of an environmental factor or treatment in each experiment as ‘high’ and ‘low’, and then calculates the relative response by comparing the ratio of the phenotypic variable of interest between these two categories (Gurevitch et al .”
A keyword-based approach to analyzing scientific research trends: ReRAM present and future
Kim, H. C., Kim, S. H., Kim, J., Kim, E. H., Gu, J. H., & Lee, D. (2025) · Scientific Reports · doi:10.1038/s41598-025-93423-5 · Cited by 15
Xiao, Z., Wu, J., Li, X., Cao, X., Wang, Y., Zhao, X., Wu, F., Wang, Z., & Xing, B. (2025) · Chemical Engineering Journal · doi:10.1016/j.cej.2025.162557 · Cited by 10
Fire differentially affects soil properties of forests and grasslands: A global meta-analysis
Cheng, G., Lou, J., Zhu, M., Zhang, X., Wang, H., Tang, Z., & Wang, W. (2025) · CATENA · doi:10.1016/j.catena.2025.109031 · Cited by 17
Liu, L., Li, Q., Chu, M., Guo, W., & Tang, L. (2025) · Policy Studies · doi:10.1080/01442872.2025.2501031 · Cited by 10
“The meta-analysis approach offers distinct methodological advantages for addressing persistent empirical contradictions in the literature, enabling the quantitative, scientific synthesis of research results across a diverse array of studies (Gurevitch et al. 2018).”
Embracing large language model (LLM) technologies in hydrology research
Ma, Z., Peng, B., Yue, Z., Zeng, H., Pan, M., Wu, X., Yang, J., Mai, L., & Guan, K. (2025) · Environmental Research Water · doi:10.1088/3033-4942/addd43 · Cited by 18
“For instance, this is particularly valuable for conducting meta-analyses, which provide comprehensive insights by synthesizing findings across numerous studies (Gurevitch et al., 2018).”
Microplastic Pollution in Freshwater Sediments: Spatial–Temporal Patterns
Sforzi, L., Santini, S., Sarti, C., Scopetani, C., Martellini, T., Mumtaz, A., Randazzo, D., & Cincinelli, A. (2025) · Current Pollution Reports · doi:10.1007/s40726-025-00373-7 · Cited by 10
“Since freshwater sediments are an integral part of nutrient cycling and serve as habitats for diverse aquatic species, their contamination has broader ecological implications [25].”
Babanoğlu, M. P. (2025) · Language Teaching Research · doi:10.1177/13621688251345726 · Cited by 15
Liu, L., Kang, F., Xu, J., Liu, Z., Gong, H., He, Z., & Fa, K. (2025) · Field Crops Research · doi:10.1016/j.fcr.2025.110195 · Cited by 9
Behavioural ecology in the twenty-first century
West, S. A., Dall, S. R. X., Cunningham, J. P., Alonzo, S. H., & Griffin, A. S. (2025) · Nature Ecology & Evolution · doi:10.1038/s41559-025-02912-3 · Cited by 13
Liao, J., Dai, Y., Hang, J., Xu, Y., An, L., & Yuan, H. (2025) · Sustainable Cities and Society · doi:10.1016/j.scs.2025.106998 · Cited by 11
Responses of soil enzyme activities to increasing salinity: A quantitative meta-analysis
Hu, Y., Zhang, H., Cui, L., Zhou, W., & Zhang, M. (2026) · Journal of Environmental Management · doi:10.1016/j.jenvman.2026.128578 · Cited by 10
Impact of risk perception on emergency information seeking behavior: a meta-analysis
Gong, W., Li, Z., & Tang, J. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1646584 · Cited by 13
“A meta-analysis has high statistical power and can detect small effects by combining research results, which can reveal the diversity of research results and explain differences between studies (Barends and Rousseau, 2018; Gurevitch et al., 2018; Li et al., 2020; Tang and Li, 2025).”
Organic amendments reshaped the chemical composition of soil organic matter: A meta-analysis
Ma, S., Zhang, Y. E. L., Beillouin, D., Lu, J., Ren, T., Zhu, J. F., Kuzyakov, Y. V., & Li, X. (2026) · Geoderma · doi:10.1016/j.geoderma.2026.117762 · Cited by 10
Cazzola, M., Calzetta, L., Rogliani, P., & Matera, M. G. (2019) · Pulmonary Therapy · doi:10.1007/s41030-019-00102-8 · Cited by 9
Staton, T., Girling, R. D., Redak, R. A., Smith, S. M., & Allison, J. D. (2023) · Ecological Applications · doi:10.1002/eap.2838 · Cited by 11
Benefit-Cost Analysis of Air Pollution, Energy, and Climate Regulations
Krutilla, K., & Graham, J. D. (2023) · Cambridge University Press eBooks · doi:10.1017/9781009189460 · Cited by 15
Dragoumani, K., Troumbis, A. Y., Bacopoulou, F., & Chrousos, G. P. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13091322 · Cited by 14
Green Energy, Blue Economy: Integrating Renewable Energy and Sustainable Development for Bangladesh
Ahmad, H., Jose, F., Islam, M. S., & Jhara, S. I. (2023) · Marine Technology Society Journal · doi:10.4031/mtsj.57.4.4 · Cited by 10
Ge, Z., Dai, S., Yu, H., Zhao, J., Yang, W., Tan, W., Sun, J., Gan, Q., Liu, L., & Wang, Z. (2024) · ACS Nano · doi:10.1021/acsnano.3c02285 · Cited by 9
Exploring the Impact of Meta-Analysis in Scientific Research: A Review
Patial, R., & Sobti, R. C. (2024) · Medinformatics · doi:10.47852/bonviewmedin42022447 · Cited by 14
An international modified Delphi process supported updating the web-based "right review" tool
Clyne, B., Sharp, M. K., Neill, M. O., Pollock, D., Lynch, R., Amog, K., Ryan, M., Smith, S. M., Mahtani, K. R., Booth, A., et al. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111333 · Cited by 10
Macnaughton, C. J., Deslauriers, D., Ipsen, E., Corey, E., & Enders, E. C. (2019) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-2018-0436 · Cited by 10
“311 Meta-analyses remain a powerful research-synthesis tool, combining different studies or 312 data to assess the magnitude of the outcome across primary studies and summarize results across 313 studies (Gurevitch et al. 2018).”
MethodChronic Kidney Disease Cohort Studies: A Guide to Metabolome Analyses
Schultheiß, U. T., Kosch, R., Kotsis, F., Altenbuchinger, M., & Zacharias, H. U. (2021) · Metabolites · doi:10.3390/metabo11070460 · Cited by 8
“meta-analysis combining p-values for creatinine and eGFR metabolite associations across multiple studies [35] regression model fixed-effects model metafor [172], meta [173] [174]”
MethodApplying a sequential evidence hierarchy, with caveats, to support prudent fisheries bycatch policy
Gilman, E. L., & Chaloupka, M. Y. (2022) · Reviews in Fish Biology and Fisheries · doi:10.1007/s11160-022-09745-4 · Cited by 13
Travers, M. J., Murphy, M., Debenham, J. R., Chivers, P., Bulsara, M. K., Bagg, M. K., Palsson, T. S., & Gibson, W. (2019) · British Journal of Sports Medicine · doi:10.1136/bjsports-2018-099959 · Cited by 9
Vo, T., Porcher, R., & Vansteelandt, S. (2020) · Research Methods in Medicine & Health Sciences · doi:10.1177/2632084320957207 · Cited by 18
“(4) where the outcome prediction b PrðYi 1⁄4 1jXi 1⁄4 x;Li;Si 1⁄4 kÞ for x1⁄4 0, 1 are estimated based on a canonical generalized linear model, using the data of 14 Research Methods in Medicine & Health Sciences 2(1)”
BackgroundMethodInfluentialStrengths and Weaknesses of Meta-AnalysesPreprint
Corker, K. S. (2018) · doi:10.31234/osf.io/6gcnm · Cited by 10
Introducing our series: research synthesis and meta-research in biology
Nakagawa, S., Koricheva, J., Macleod, M. R., & Viechtbauer, W. (2020) · BMC Biology · doi:10.1186/s12915-020-0755-0 · Cited by 12
Self-citationA systematic review and meta-analysis of the relationship between flow states and performancePreprint
Harris, D., Allen, K., Vine, S. J., & Wilson, M. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qg852 · Cited by 12
Dynameta: A dynamic platform for ecological meta-analyses in R Shiny
Skinner, G., Cooke, R., Keum, J., Purvis, A., Raw, C., Woodcock, B. A., & Millard, J. W. (2023) · SoftwareX · doi:10.1016/j.softx.2023.101439 · Cited by 8
“To investigate the effect of anthropogenic threats to biodiversity, the researcher can run meta-analytic models to quantitatively summarise results across studies in a replicable process [3, 19].”
Meta-Analysis of Social Science Research: A Practitioner’s GuidePreprint
Iršová, Z., Doucouliagos, H., Havránek, T., & Stanley, T. D. (2023) · doi:10.31222/osf.io/3t7jb · Cited by 9
Dong, K., Jeong, G.-Y., & Chun, B. (2022) · Applied Sciences · doi:10.3390/app13010446 · Cited by 12
“At the same time, the adjustment variable will also have an impact on the training effect [62].”
Bai, Z., Yin, J., Cheng, L., Song, L., Zhang, Y., & Wang, M. (2024) · Environmental Science & Technology · doi:10.1021/acs.est.3c09112 · Cited by 9
A meta-analysis for effects of pretreatments on corn straw for methane production
Xu, J., Wang, L., Song, C., Jin, Y., Chen, C., & Liu, G. (2024) · Industrial Crops and Products · doi:10.1016/j.indcrop.2024.118895 · Cited by 8
Dalmonte, T., Andreani, G., Rudelli, C., & Isani, G. (2024) · Phytotherapy Research · doi:10.1002/ptr.8336 · Cited by 11
Response of rice production to rising CO2 and its adaptive cultivation strategies
Zhang, H., Wang, Z., Yan, Y., Shi, Z., Jiang, Y., Ding, Y., & Wang, S. (2024) · Fundamental Research · doi:10.1016/j.fmre.2024.11.025 · Cited by 8
“By synthesizing the findings from multiple previous independent studies on a similar topic, meta-analysis offers as an effective way to investigate the CO 2 impacts on rice yield from the foliar, canopy to regional and global scales [ 50 ].”
Karaköse, T., Tülübaş, T., Kanadlı, S., & Gurr, D. M. (2024) · Journal of Educational Administration · doi:10.1108/jea-05-2024-0160 · Cited by 11
Metadata
- Authors
- Gurevitch, J., Koricheva, J., Nakagawa, S., & Stewart, G.
- Affiliations
- Stony Brook University (US)
- Royal Holloway University of London (GB)
- Garvan Institute of Medical Research (AU)
- Newcastle University (GB)
- Corresponding author
- Gurevitch, Jessica
- Koricheva, Julia
- Nakagawa, Shinichi
- Stewart, Gavin
- Venue
- Nature
- Published
- 2018-03
- Volume
- 555
- Issue
- 7695
- Pages
- 175-182
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2791681873
- Semantic Scholar
- ac5ad1932e31c3ea141366e8e073d6d95869c4ef
- Cited by
- 1,709
- References
- 101
- Citations by year
- 2026: 177 · 2025: 230 · 2024: 231 · 2023: 199 · 2022: 234 · 2021: 235 · 2020: 204 · 2019: 130 · 2018: 64
- FWCI
- 31.20
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- UNSWorks (UNSW Sydney) (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- National Science Foundation (1262402)
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- meta-analysis, evidence synthesis, history of meta-analysis, evolutionary biology, conservation biology, artificial intelligence, evidence-based practice
- MeSH terms
- Animals, Biological Science Disciplines, Ecology, Biological Evolution, Research, Meta-Analysis as Topic, History, 20th Century, History, 21st Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.