Meta-analysis and the science of research synthesis
Open accessThe DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index; 9 of the 69 sources its claims cite were checked for support.
Abstract
Meta-analysis is the quantitative, scientific synthesis of research results. Since the term and modern approaches to research synthesis were first introduced in the 1970s, meta-analysis has had a revolutionary effect in many scientific fields, helping to establish evidence-based practice and to resolve seemingly contradictory research outcomes. At the same time, its implementation has engendered criticism and controversy, in some cases general and others specific to particular disciplines. Here we take the opportunity provided by the recent fortieth anniversary of meta-analysis to reflect on the accomplishments, limitations, recent advances and directions for future developments in the field of research synthesis.
Overview
CoChat Summary
TL;DR
This review reflects on meta-analysis as quantitative research synthesis since the 1970s, its contributions to evidence-based practice, and its methodological development across medicine, social sciences, and ecology/evolution/conservation. It argues that meta-analysis has resolved contradictory evidence and enabled broad generalizations, but faces a “midlife crisis” from poor-quality applications, publication/research bias, and misuse of the term.
Key findings
- Meta-analysis was first introduced in the 1970s; the term was coined by Gene Glass in 1976, and the paper marks its 40th anniversary. It has helped establish evidence-based practice, resolve seemingly contradictory results, and spread across many scientific fields.
- In medicine, a meta-analysis of 20 clinical studies found maternal obesity associated with increased neural tube defect risk: a 1.7-fold rise for moderately obese women and over a 3-fold risk for severely obese women. In social science, a meta-analysis of 35 studies found no significant differences between multisystemic therapy and conventional social services for serious juvenile offenders.
- In ecology, evolution and conservation, meta-analysis was adopted in the early 1990s. Parmesan and Yohe used data on over 1,700 species to show significant range shifts and advancement of spring events; Benayas and colleagues found ecological restoration increased biodiversity and ecosystem services, though values remained lower in restored versus intact reference ecosystems.
- Methodological advances include fixed- and random-effects models, meta-regression, heterogeneity quantification (τ and I²), publication-bias tools, network meta-analysis, phylogenetic meta-analysis, and software such as MetaWin and OpenMEE. PRISMA includes a 27-item checklist for systematic review reporting.
Methods
- Design: narrative review/commentary on meta-analysis and research synthesis, not a new meta-analysis. The authors state they highlight principles, limitations, utility, and future developments.
- Data or sample: draws on published literature and illustrative examples across medicine, social sciences, and ecology/evolution/conservation; includes Box 1 on meta-analytic models and Table 1 on EEC milestones.
- Main analysis: conceptual and methodological synthesis; no primary data collection, systematic search protocol, or quantitative pooling is reported in the paper.
Limitations
- The paper states that meta-analysis and systematic reviews can highlight evidence deficiencies but cannot overcome them; publication bias and research bias may be suspected and sometimes estimated but cannot truly be corrected; selective or incomplete reporting can constrain synthesis.
- The paper states that too many published meta-analyses are of low quality, the term “meta-analysis” is frequently misapplied, and vote-counting persists despite being discredited; it also notes concerns about academic inequality and the “research parasites” controversy.
- The text makes evident that, as a narrative review, it does not provide a systematic search strategy, formal inclusion criteria, or a quantitative synthesis; its examples are illustrative rather than exhaustive.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 4 Not valid · 37 Not checked · 33 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly, a synthesis may be constrained by either selective or incomplete reporting 66,67 .”
What the sources say
- Not checked yetcites [66] Stewart, L. A . et al. Preferred reporting items for a systematic review and meta-analysis of individual participant data: the PRISMA-IPD statement. J. Am. Med. Assoc. 313, 1657–1665 (2015) source
- Partly supportedcites [67] Saldanha, I. J . et al. Evaluating Data Abstraction Assistant, a novel software application for data abstraction during systematic reviews: protocol for a randomized controlled trial. Syst. Rev. 5, 196 (2016) sourceExperimental — accuracy not yet measured
The Background (page unavailable) reports that omissions and errors during data abstraction changed summary meta-analytic results, supporting the general point that a synthesis can be affected by missing information. It describes information present in articles but omitted by abstractors, not selective or incomplete reporting by the studies themselves; that specific mechanism is unsupported. (LLM, conf=0.78)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“When the number of studies is an order of magnitude greater than that, the inability of narrative processes to adequately summarize the outcomes increases exponentially 2,3 .”
What the sources say
- Not checked yetcites [2] Roberts, P. D ., Stewart, G. B. & Pullin, A. S. Are review articles a reliable source of evidence to support conservation and environmental management? A comparison with medicine. Biol. Conserv. 132, 409–423 (2006) source
- Partly supportedcites [3] Bastian, H ., Glasziou, P . & Chalmers, I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med. 7, e1000326 (2010) sourceExperimental — accuracy not yet measured
Our copy supports the qualitative half of the claim: the 'How Close Are We to Archie Cochrane's Goal?' section cites Goldschmidt and Mulrow for 'how great the potential is for error in reviews of health literature that were not conducted systematically' and states that 'the staple of medical literature synthesis remains the non-systematic narrative review', while the same section (Figure 4 discussion) and 'Where to Now?' document the growth from ~14 trials a day in 1979 to 75 trials and 11 systematic reviews a day, with 'the task keeps increasing in size and complexity' ('Where Are We Now?'). What the source does NOT support is the quantitative assertion attributed to it: nowhere does our copy say the inability of narrative processes to summarise outcomes 'increases exponentially', nor tie it to study counts an order of magnitude beyond a dozen — the only dozen-scale figure in the paper is the median number of trials per systematic review (six to 16, Cochrane reviews averaging over 12), which is offered as a measure of reviewing workload and coverage, not of narrative-review failure. The exponential scaling is therefore the citing authors' characterisation, not this paper's. (LLM, conf=0.72)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, as the number of publications and research results has mushroomed across scientific fields, the difficulties encountered in carrying out narrative reviews to identify and summarize evidence in a transparent manner has become increasingly apparent 1 .”
What the sources say
- Not checked yetcites [1] Jennions, M. D ., Lortie, C. J. & Koricheva, J. in The Handbook of Meta-analysis in Ecology and Evolution (eds Koricheva, J . et al.) Ch. 23, 364–380 (Princeton Univ. Press, 2013) source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, in many cases of the resolution of scientific problems, when the results of an individual study are combined with those of other studies, the resulting synthesis provides a more general and complete picture of the questions being addressed.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A statement the paper makes itself — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Sometimes, the striking results of initial studies are not confirmed by those of subsequent studies or by syntheses of a body of research.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
15 more claims
Create a free account to see all 78 claims and to verify the 60 references still open.
- It may state two separate claims as one. 32
- Probably not a substantial claim. 48
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The trade-off with our method is that it does not allow for determining the magnitude of the effect of the practices33–36 but only the proportion of impacts33,37 as positive, negative or neutral.”
From Farming practices to enhance biodiversity across biomes: a systematic review (2024) · cites this paper as [36]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Besides, publication biases that have been documented in several scientific fields90,91 can also affect ML-based science.92,93”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [91]
Experimental — accuracy not yet measuredIn the citing paper
“Moreover, since a meta-analysis can be conducted only when sufficient and appropriate quantitative data from original studies are available, the number of published meta-analyses about a certain topic is an indicator of the overall understanding of the subject, allowing us to reveal research gaps (25, 26).”
From Agricultural diversification promotes multiple ecosystem services without compromising yield (2020) · cites this paper as [25]
In the citing paper
“Meta-analysis optimises statistical power for detecting treatment effects by combining data from multiple similar studies [22, 23].”
From Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize? A systematic review (2022) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“𝜀 is the within-study sampling error (solid black lines), the deviation from the study-specific mean.”
§ Box 1: Meta-analytic models and heterogeneity
“the solid black lines are deviations from the overall mean (panels a,b) or slope (panels c,d)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“The assumption of the fixed-effect meta-regression is that a moderator(s) can explain all between-study heterogeneity”
§ Box 1: Meta-analytic models and heterogeneity
“the blue distributions the between-study variance (panels a-d).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“Two basic models of meta-analysis are the fixed-effect model (Fig 1a) and the random-effects model (Fig 1b) 6 .”
§ Box 1: Meta-analytic models and heterogeneity
“Figure 1. A variety of charts and plots common in meta-analysis. a. PRISMA diagram 20 , b. a forest plot showing overall means based on a fixed-effect model and random-effects model”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“Procedural protocols for systematic reviews are well established especially in the medical and social sciences (Preferred Reporting Items for Systematic Reviews, or PRISMA; www.prisma-statement.org) 20 .”
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 1×
“…the use of machine learning to screen studies 82 for inclusion in systematic reviews and meta-analyses for large reviews, increasingly sophisticated software and models for complex meta-regression 53,83 , and integration of meta-analysis with decision support in medicine and other domains 84 .”
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Research works printed but not linked: 3
- Hedges, L. & Olkin, I. Statistical Methods for Meta-analysis (Academic Press, 1985)
- Higgins, J. P. T . & Green, S. (eds) Cochrane Handbook for Systematic Reviews of Interventions: Version 5.1.0 (Wiley, 2011).This large collaborative work provides definitive guidance for the production of systematic reviews in medicine and is of broad interest for methods development outside the medical field.
- Cooper, H. M ., Hedges, L. V . & Valentine, J. C. (eds) The Handbook of Research Synthesis and Meta-analysis 2nd edn (Russell Sage Foundation, 2009).This book is an important compilation that builds on the ground-breaking first edition to set the standard for best practice in meta-analysis, primarily in the social sciences but with applications to medicine and other fields.
Cited by
Items 901–1,000 of 1,000
Morrison, K., Melhado, G., Bose, A. P. H., Eastment, R. V., Lagisz, M., Manera, J. L., Michelangeli, M., Ozeki, S., Wong, B. B. M., Yang, Y., et al. (2025) · Environmental Pollution · doi:10.1016/j.envpol.2025.126353 · Cited by 13
Self-citationZhang, Y., Li, W., Wang, T., & Li, Y. (2025) · Physiologia Plantarum · doi:10.1111/ppl.70337 · Cited by 9
“Meta-analysis is a quantitative and scientific synthesis of research results that identifies patterns or unique relationships not observable in single studies (Gurevitch et al. 2018).”
Heshmati, B., Omidi, S., & Mohammadi, Y. (2025) · Systematic Reviews · doi:10.1186/s13643-025-02888-y · Cited by 12
“By pooling effect sizes from various studies, a meta-analysis can provide a more robust and precise estimate of the overall relationship between these factors and treatment failure [16].”
A global perspective on soil microplastic research: status, challenges, and suggestions
Fan, C., Song, J., Wang, C., Liang, Z., & Li, G. (2025) · Frontiers of Environmental Science & Engineering · doi:10.1007/s11783-025-2053-0 · Cited by 14
“The inconsistent descriptions of MPs and soil properties complicate large-scale analyses, impede the application of meta-analysis and machine learning approaches, and limit our understanding of MP environmental behavior and risks in soils (Gurevitch et al., 2018; Liakos et al., 2018).”
Izlal, S., Arif, M. S., Rahman, S., & Rhidoy, M. O. I. (2025) · Environmental Monitoring and Assessment · doi:10.1007/s10661-025-14433-4 · Cited by 9
“The method outlined by Gurevitch et al. (2018) and Koricheva and Gurevitch (2014), was followed to eliminate the duplicates and irrelevant publications from the initially identified publications.”
Warming Amplifies Responses of Soil Organic Carbon to Multiple Global Change Drivers
Sun, Y., Chen, X., Chen, C., Zou, X., Wang, C., Terrer, C., Chen, H. Y. H., Delgado‐Baquerizo, M., & Ruan, H. (2025) · Global Change Biology · doi:10.1111/gcb.70612 · Cited by 10
“Similar to preceding studies (Basche and Delonge 2019), we also conducted a leave- one- study-out sensitivity analysis (Gurevitch et al. 2018), and confirmed stable effect estimates across all iterations, which indicated no undue influence from any single study (Figures S3 and S4).”
Abbasi, E. (2025) · Journal of Urban Ecology · doi:10.1093/jue/juaf019 · Cited by 13
Karaman, E., ERAVCI, D. B., Sanin, S. L., & Türksoy, V. A. (2025) · Toxics · doi:10.3390/toxics14010028 · Cited by 8
“At this point, the meta-analysis method is an effective tool for bringing together quantitative data obtained from different studies and revealing general trends [38].”
Belland, B. R., Lee, E., Zhang, A. Y., & Kim, C. (2022) · Computer Applications in Engineering Education · doi:10.1002/cae.22556 · Cited by 21
“But that is simply the nature of meta ‐ analysis [16, 23].”
BackgroundQuality assessment of African herbal medicine: A systematic review and the way forward
Orman, E., Bekoe, S. O., Jato, J., Spiegler, V., Asare–Nkansah, S., Agyare, C., Hensel, A., & Bekoe, E. O. (2022) · Fitoterapia · doi:10.1016/j.fitote.2022.105287 · Cited by 13
Meta-analysis methods for risk difference: A comparison of different models
Guo, J., Xiao, M., Chu, H., & Lin, L. (2022) · Statistical Methods in Medical Research · doi:10.1177/09622802221125913 · Cited by 8
“Meta-analysis is a set of statistical tools commonly used in biomedical research and other disciplines to combine and contrast the information from multiple independent studies on the same question, with the aim to synthesize evidence that can be used to underpin guidelines, patient decision aids, and other products t…”
MethodComplex temperature dependence of vehicular emissions: Evidence from a global meta-analysis
Liu, X., Wang, Y., Zhu, R., Wei, Y., & Hu, J. (2023) · Environmental Research · doi:10.1016/j.envres.2023.116890 · Cited by 8
Science Mapping of Meta-Analysis in Agricultural Science
Ding, W., Li, J., Ma, H., Wu, Y., & He, H. (2023) · Information · doi:10.3390/info14110611 · Cited by 9
“With the number of subjects increasing, large differences between subjects, or cumulative effects and results, the conclusions of the meta-analysis are statistically stronger than those of any single study [7,8].”
ResultGarnica, V. C., Shah, D. A., Esker, P. D., & Ojiambo, P. S. (2024) · Plant Disease · doi:10.1094/pdis-11-23-2519-sr · Cited by 8
Meta‐analysis and machine learning reveal the antiobesity effects of melatonin on obese rodents
Li, Y., Sun, X., Wang, M., Jiang, Y., Ge, Q., Li, Y., Hou, Z., Shi, P., Kang, Y., & Yin, J. (2024) · Obesity Reviews · doi:10.1111/obr.13701 · Cited by 8
Intercropping can accelerate the phytoremediation of Cd-contaminated soil
Wang, S., Liu, C. X., Yang, G., Ma, S., & Shao, D. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.177350 · Cited by 9
Nanomaterials effectively alleviate cadmium hazards in soil-plant systems: A meta-analysis
Yang, J., & Yan, Y. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.178207 · Cited by 8
Poor hypotheses and research waste in biology: learning from a theory crisis in psychology
Nakagawa, S., Armitage, D. W., Froese, T., Yang, Y., & Lagisz, M. (2025) · BMC Biology · doi:10.1186/s12915-025-02134-w · Cited by 15
Self-citationHew, K. F., Bai, S., Huang, W., Du, J., Huang, G., Jia, C., & Khongjan, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-51968-1_22 · Cited by 12
Shin, I., & Rim, C. H. (2021) · Journal of Medical Internet Research · doi:10.2196/29642 · Cited by 8
Basu, D., Adhya, D. G., Sinha, R., & Chakravorty, N. (2021) · Advances in Redox Research · doi:10.1016/j.arres.2021.100017 · Cited by 8
Bomfim, B., Walker, A. P., McDowell, W. H., Zimmerman, J. K., Feng, Y., & Kueppers, L. M. (2022) · Global Change Biology · doi:10.1111/gcb.16223 · Cited by 9
An exploration of the antecedents and mechanisms causing athletes’ stress and twisties symptom
Yu, G., Chang, K., & Shih, I.-T. (2022) · Heliyon · doi:10.1016/j.heliyon.2022.e11040 · Cited by 13
Angry scientists, angry analysts and angry novelists
Doi, S. A. R., & Abdulmajeed, J. (2023) · Diabetologia · doi:10.1007/s00125-023-05917-4 · Cited by 8
Sun, Y., Gao, L., Meng, X., Huang, J., Guo, J., Zhou, X., Fu, G., Yang, X., Firbank, L. G., Wang, M., et al. (2023) · Global Change Biology · doi:10.1111/gcb.16873 · Cited by 9
Systematic Reviews and Meta‐Analysis
Crombie, I. (2021) · Wiley eBooks · doi:10.1002/9781394322183.ch5 · Cited by 9
Hekkala, A., & Roberge, J. (2018) · Biodiversity and Conservation · doi:10.1007/s10531-018-1583-1 · Cited by 11
Evidence inconsistency degrees of freedom in Bayesian network meta-analysis
Lin, L. (2020) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2020.1852247 · Cited by 8
“It has been widely used to produce high-quality overall evidence for treatment comparisons that can help underpin guidelines and make decisions (Gurevitch et al. 2018; Niforatos et al. 2019).”
BackgroundDurg, S., Lobo, M., Venkatachalam, L., Rao, G., & Bhate, J. (2018) · Pharmacological Reports · doi:10.1016/j.pharep.2018.12.010 · Cited by 8
Sensever, F. D. A., Alves, C. P. D. L., Lima, G. D. S., Loomans, B. A. C., Opdam, N. J. M., & Pereira‐Cenci, T. (2022) · Journal of Dentistry · doi:10.1016/j.jdent.2022.104282 · Cited by 9
A Systematic Review of Factors Influencing Signage Salience in Indoor Environments
Li, C., Guo, H., Yin, M., Zhou, X., Zhang, X., & Ji, Q. (2023) · Sustainability · doi:10.3390/su151813658 · Cited by 7
Managing Global Forests in View of Multiple Goals: An Evidence-Based Perspective
Vizzarri, M. (2024) · Land · doi:10.3390/land13122169 · Cited by 8
Effect size as a measure of biological relevance for offshore wind impact studies
Methratta, E. T. (2025) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsaf022 · Cited by 8
Do Egg Hormones Have Fitness Consequences in Wild Birds? A Systematic Review and Meta‐Analysis
Mentesana, L., Hau, M., D'Amelio, P. B., Adreani, N. M., & Sánchez‐Tójar, A. (2025) · Ecology Letters · doi:10.1111/ele.70100 · Cited by 8
“This approach places less focus on dichot-omising the results (discussed by e.g., Amrhein, Greenland, and McShane 2019) and provides crucial insights into the variance across effect sizes, helping assess the generalisability of our findings (discussed by e.g., Gurevitch et al. 2018).”
Nana, A., Bawack, R. E., Bris, G. Y.-L., & Daniellou, R. (2025) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2025.146162 · Cited by 8
Shi, X., Zhao, W., Chen, T., Yang, C., & Du, J. (2025) · Nature Communications · doi:10.1038/s41467-025-62783-x · Cited by 17
“Since its introduction in the 1970s, meta-analysis has had a signi fi cant impact on various fi elds such as medicine, economics, sociology, and environmental science 6 .”
Mapping meta-analyses on organochlorine pesticides reveals low methodological quality
Morrison, K., Yang, Y., Williams, C., Ricolfi, L., Lagisz, M., & Nakagawa, S. (2025) · Nature Sustainability · doi:10.1038/s41893-025-01634-5 · Cited by 12
“This secondary research often took the form of meta-analyses: that is, the quantitative syntheses of research results 2 .”
Self-citationPeng, S., Zhang, Y., & Chen, H. Y. H. (2025) · New Phytologist · doi:10.1111/nph.70711 · Cited by 10
“Obser-vation weights were taken as the inverse of the sampling variance (Gurevitch et al ., 2018).”
Jánová, V., Herntrei, M., & Fialová, D. (2025) · Frontiers in Sustainable Tourism · doi:10.3389/frsut.2025.1693707 · Cited by 13
Medrano, L., Ros, M., Sáez‐Sandino, T., Zhou, G., Tao, D., Zhai, K., Yin, Y., Zhou, T., Revillini, D., Pascual, J. A., et al. (2025) · Ecology Letters · doi:10.1111/ele.70276 · Cited by 9
“Given the exploratory aim, we did not correct for multiple comparisons, following standard ecological synthesis practices (e.g., Gurevitch et al. 2018) that prioritise trend interpretation over strict hypothesis testing.”
Ecological meta‐analyses often produce unwarranted results
Peacor, S. D., Song, C., Bence, J. R., Briggs, A. A., Hamman, E. A., & Osenberg, C. W. (2025) · Ecology · doi:10.1002/ecy.70269 · Cited by 8
Regionally distinct threats from polycyclic aromatic hydrocarbons in global reservoirs
Guo, Z.-F., Boeing, W. J., Xu, Y., Borgomeo, E., Al‐Mashaqbeh, O., Liu, D., & Yang, X.-R. (2026) · Nature Geoscience · doi:10.1038/s41561-025-01872-4 · Cited by 15
“Unlike conventional meta-analytical efforts that primarily synthesize published effect sizes 21,22 , CAS framework reprocesses original datasets, accounting for cross-study variability in spatio-temporal scales and enabling robust cross-system comparisons.”
Fan, X., Kong, H., Zhao, Y., Hu, H., Jiang, Z., & Wang, X. (2026) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2026.147529 · Cited by 9
An automated process for supporting decisions in clustering-based data analysis
Bernabé-Díaz, J. A., Franco, M., Vivo, J.-M., Quesada-Martínez, M., & Fernández‐Breis, J. T. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106765 · Cited by 7
Strengths and Weaknesses of Meta-Analyses
Corker, K. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190938550.003.0006 · Cited by 18
Pintér, H., Gál, F., & Molnár, P. (2022) · Heliyon · doi:10.1016/j.heliyon.2022.e09718 · Cited by 11
Sistematik Derleme Metodolojisi ve Yazımı
Cinar, N. D., & Suzan, Ö. K. (2022) · Akademisyen Kitabevi eBooks · doi:10.37609/akya.2053 · Cited by 7
Wang, N., Feng, S., Ma, X., Chen, Q., Liu, C., & Qi, Z. (2023) · Journal of Agricultural and Food Chemistry · doi:10.1021/acs.jafc.3c03950 · Cited by 6
Harnessing meta-analyses’ insights in ecology and evolution research
Pollo, P., Martinig, A. R., Mizuno, A., Morrison, K., Pottier, P., Ricolfi, L., Tam, J., Williams, C., Yang, Y., Drobniak, S. M., et al. (2025) · Royal Society Open Science · doi:10.1098/rsos.250759 · Cited by 10
“Thus, it is no surprise that syntheses of the primary literature, such as systematic reviews and meta-analyses, have become common in this field [3].”
Self-citationThe quality movement's three operational paradigms: a text mining venture
Carnerud, D. (2020) · The TQM Journal · doi:10.1108/tqm-05-2019-0134 · Cited by 10
Nuevos escenarios y desafíos para la ciencia abierta. Entre el optimismo y la incertidumbre
Fressoli, M., & Filippo, D. D. (2021) · Arbor · doi:10.3989/arbor.2021.799001 · Cited by 16
Qian, H., Liu, J., Xu, C., Zhu, W., & Chen, L. (2021) · Europe PMC (PubMed Central) · Cited by 7
Zhou, X., Li, L., Lin, L., Ju, K., Kwong, J. S., & Xu, C. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01423-6 · Cited by 9
“By quantitatively or qualitatively synthesizing all available findings, systematic reviews and meta-analyses are expected to provide the most comprehensive and informative evidence for employing optimal healthcare interventions [3].”
BackgroundThe Effect of Impulsivity on Addition and Addictive Tendencies: A Meta-analysis
Dezhkam, N., Bahri, M. R. Z., & Keshi, A. K. (2022) · Journal of Health Reports and Technology · doi:10.5812/jhrt-120846 · Cited by 9
“Meta-analyses provide a meta-evaluation of independent analyses through secondary convergence analysis of research findings based on the effect size index as a fundamental element of meta-analysis (18).”
MethodMeta-Analysis for Nonprofit Research: Synthesizing Quantitative Evidence for Knowledge Advancement
Hung, C., & Lu, J. (2023) · VOLUNTAS International Journal of Voluntary and Nonprofit Organizations · doi:10.1007/s11266-022-00505-3 · Cited by 7
Copeland, L. K. F., Stockwell, B., & Piovano, S. (2023) · Diversity · doi:10.3390/d15070825 · Cited by 7
Li, L., Tan, L., Yang, W., Xu, X., Shen, Y., & Li, J. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.148645 · Cited by 7
Larkin, D. J., Buck, R. J., Fieberg, J., & Galatowitsch, S. M. (2019) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2018.2928 · Cited by 11
Effect of allelopathy on plant performancePreprint
Zhang, Z., Liu, Y., Yuan, L., Weber, E., & van Kleunen, M. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.14.095190 · Cited by 7
Novelty at second glance: A critical appraisal of the novel-object paradigm based on meta-analysisPreprint
Takola, E., Krause, E. T., Müller, C., & Schielzeth, H. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.12.10.419457 · Cited by 7
Peters, K., & König‐Ries, B. (2022) · Scientific Data · doi:10.1038/s41597-022-01691-x · Cited by 8
Sovereign ESG Integration: A Bibliometric and Systematic Literature Review
Pascoal, F. B., Juwana, H., Karuniasa, M., & Djojokusumo, H. H. (2023) · Studies in Business and Economics · doi:10.2478/sbe-2023-0013 · Cited by 10
“In practice, Gurevitch, Koricheva, Nakagawa, & Stewart (2018) call for a systematic review process that involves the use of formal methodological guidelines for conducting literature search queries, screening study results (which include a comprehensive assessment of relevant articles following…”
Kiflee, A. K. R., Hasbullah, N. N., Idris, N. H., Harun, H., Bakar, M. H., & Anwar, S. (2024) · Journal of Lifestyle and SDGs Review · doi:10.47172/2965-730x.sdgsreview.v4.n02.pe01977 · Cited by 11
“In practice, SLRs are detailed methodological tools that are also used to conduct literature searches, evaluate research results (comprehensive evaluation of articles based on pre-agreed criteria), data collection, coding and detailed statistics (Gurevitch et al., 2018).”
MethodYang, C., Jiang, P., Qian, Z., Sun, J., Wu, T., Yang, Z., Sun, Y., & Huang, X. (2025) · Plant and Soil · doi:10.1007/s11104-024-07197-2 · Cited by 8
“…the common method of meta-analysis, the natural logarithm (RR) of the response ratio was also employed to quantify the effect of mixed tree species (Gurevitch et al. 2018), as follows: where x t refered to the mean soil nutrient content of treatment (i.e., mixed forest), and x c to the control…”
Dang, Q., Ma, F., Chen, J., & Guo, T. (2025) · Brain Structure and Function · doi:10.1007/s00429-025-02955-z · Cited by 8
“Combining related findings from multiple studies, meta-analysis provides an effective means to reveal more consistent and reliable results across studies (Gurevitch et al. 2018).”
Dai, H., Luo, M., Jiang, X., Li, X., Zhang, P., & Niu, Y. (2025) · Sustainability · doi:10.3390/su17125489 · Cited by 7
Kabir, R., Syed, H. Z., Hayhoe, R. P. G., Parsa, A. D., Sivasubramanian, M., Mohammadnezhad, M., Sathian, B., Rahna, K., Jain, M., Gandhi, A. P., et al. (2024) · The Evidence · doi:10.61505/evidence.2024.2.1.25 · Cited by 14
Oduro, C., Geng, Y., Dalu, T., Okrah, A., Kyei–Nuamah, D., Khan, S., Chen, J., Mu, H., & Wu, N. (2025) · Environmental Sciences Europe · doi:10.1186/s12302-025-01227-1 · Cited by 9
“To investigate this, the study employs a systematic review and meta-analysis [32] to synthesize existing literature and evaluate how these dual stressors influence key physiological and ecological processes in freshwater invertebrates, including growth, reproduction, mortality, and stress responses.”
InfluentialKurnaz, M. (2026) · Frontiers in Physiology · doi:10.3389/fphys.2026.1785483 · Cited by 9
“Instead, a structured methodological quality appraisal was applied to all 169 included primary sources using four evaluative criteria adapted from frameworks recommended for ecological and physiological integrative reviews (Nakagawa and Poulin, 2012; Gurevitch et al., 2018).”
Teaching Quality and Student Outcomes in TIMSS and PISA
Klieme, E., & Nilsen, T. (2022) · Springer international handbooks of education · doi:10.1007/978-3-030-38298-8_37-1 · Cited by 6
Bhandare, J. V., Mahale, S. A., Abullais, S. S., Katkurwar, A., AlQahtani, S. M., Algarni, Y. A., & Asif, S. M. (2023) · International Journal of Medical Sciences · doi:10.7150/ijms.86720 · Cited by 6
Chen, C., Peng, C., Hu, Z., & Ge, L. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e25050 · Cited by 8
“In the clinical field, systematic reviews and meta-analyses comprise the gold standard for objectively and thoroughly studying interventions [15,16].”
BackgroundReproducibility of Published Meta-Analyses on Clinical-Psychological Interventions
López‐Nicolás, R., Lakens, D., López-López, J. A., Rubio‐Aparicio, M., Sandoval‐Lentisco, A., López‐Ibáñez, C., Blázquez-Rincón, D., & Sánchez‐Meca, J. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231202929 · Cited by 6
Ahmad, R., Lone, S. A., Rashid, I., & Khuroo, A. A. (2024) · Oikos · doi:10.1111/oik.10102 · Cited by 6
Artificial aquatic habitats: a systematic literature review and new perspectives
Frehse, F. D. A., Derviche, P., Pereira, F. W., Hostim‐Silva, M., & Vitule, J. R. S. (2024) · Hydrobiologia · doi:10.1007/s10750-024-05589-0 · Cited by 7
“Systematic reviews have been increasingly used in ecology to answer well-defined questions through a transparent, replicable, and updatable method (Gurevitch et al., 2018).”
Li, H., Li, J., Hu, J., Chen, J., & Zhou, W. (2024) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2024.1393108 · Cited by 6
A metanalytic study: does water deficit always increase soybean proline concentration?
Schneider, J. R., Wurlitzer, W. B., Ferla, N. J., Huzar‐Novakowiski, J., & Chavarria, G. (2024) · Theoretical and Experimental Plant Physiology · doi:10.1007/s40626-024-00346-z · Cited by 6
Performance of native tree species in plantations: a synthesis for the Guineo-Congolian region
Ilunga‐Mulala, C., Doucet, J., Biwôlé, A. B., Bourland, N., & Ligot, G. (2025) · Journal of Forestry Research · doi:10.1007/s11676-024-01817-4 · Cited by 9
“However, it is difficult to estimate the effect size of the planting methods (Lajeunesse 2011, 2015; Lortie et al. 2015; Gurevitch et al. 2018; Kawamura et al. 2021).”
L’efficacité de la formation à distance au niveau postsecondaire : une méga-analyse
Simard, Y., Gauthier, C., & Richard, M. (2019) · Canadian Journal of Higher Education · doi:10.7202/1063777ar · Cited by 18
Hartman, M., & Jeffrey, S. R. (2020) · Canadian Journal of Plant Science · doi:10.1139/cjps-2020-0162 · Cited by 6
“Although the adoption of herbicide resistance and hybrids contributed to higher yields and economic returns (O’Donovan et al. 2006; Mahli et al. 2007; Gusta et al. 2011; Morrison et al. 2016), these technologies increased seed costs for growers.”
BackgroundExploring the Potentials of Robotics in Supporting Children with Autism Spectrum Disorder
Mostajo, S., Legaspi, O. M., Camarse, M. G., & Salva, R. A. (2021) · IAFOR Journal of Education · doi:10.22492/ije.9.1.05 · Cited by 6
“Typically, a humanoid robot has a physical appearance that is very appealing to children as it resembles the features of a small child and is also attentive to children (Ismail et al., 2019). Furthermore, Pennazio and Fedeli (2019) emphasized that humanoid robots with favorably interactive features can elicit more res…”
BackgroundInfluentialde Madrid, U. C. I., Carretero, A. B., Treré, E., & de Cardiff, U. (2021) · Chasqui Revista Latinoamericana de Comunicación · doi:10.16921/chasqui.v1i146.4390 · Cited by 9
“Este ejercicio meta-analítico (Gurevitch et al., 2018) intenta ofrecer un recuento de los orígenes, referentes teóricos y principales tendencias de la investigación en comunicación alternativa en contextos de investigación del Norte del planeta, asumiendo, no obstante, que su carácter sumario…”
BackgroundThe Effects of Interventions on Motor Skills in Individuals with Down Syndrome: A Meta-Analysis
Ku, B., & Sung, M. (2021) · Journal of Developmental and Physical Disabilities · doi:10.1007/s10882-021-09827-4 · Cited by 9
“Meta-analysis is a statistical technique to quantify and synthesize existing data, which may help to establish evidence-based practice and resolve contradictory research findings (Gurevitch et al., 2018).”
MethodZhu, J., Gosnell, J. S., Akallal, L., & Goltsman, M. (2022) · Restoration Ecology · doi:10.1111/rec.13674 · Cited by 7
Nemati, M., Zare, N., Hedayat‐Evrigh, N., & Zakaria, R. A. (2022) · Molecular Biotechnology · doi:10.1007/s12033-022-00541-w · Cited by 7
“The availability and accessibility of transcriptome datasets generated from dozens of individual studies have created an opportunity to benefit from meta-analysis approaches and obtain more valid and comprehensive information about key genes and molecular mechanisms under specific conditions [13].”
BackgroundAji, A. I., Suyatma, N. E., Arpah, M., & Jayanegara, A. (2022) · International Journal of Food Science & Technology · doi:10.1111/ijfs.16226 · Cited by 8
Community theory: Testing environmental stress models
Menge, B. A. (2023) · Ecology Letters · doi:10.1111/ele.14240 · Cited by 7
“The gold standard for conducting literature surveys in contemporary ecology is to employ meta- analysis (Cadotte et al., 2012; Gurevitch et al., 2018).”
BackgroundYim, A., & Passalacqua, N. V. (2023) · Humans · doi:10.3390/humans3030017 · Cited by 9
Xie, W., & Yan, X. (2023) · Sustainability · doi:10.3390/su151914204 · Cited by 11
Open reproducible scientometric research with Alexandria3k
Spinellis, D. D. (2023) · PLoS ONE · doi:10.1371/journal.pone.0294946 · Cited by 14
Bagg, M. K., Hicks, A. J., Hellewell, S. C., Ponsford, J. L., Lannin, N. A., O'Brien, T. J., Cameron, P. A., Cooper, D. J., Rushworth, N., Gabbe, B. J., et al. (2024) · Neurotrauma Reports · doi:10.1089/neur.2023.0116 · Cited by 9
DEPO: A Platform for Safe DEployment of POlicy in a Software Defined Infrastructure
Syed, A., Anwer, B., Gopalakrishnan, V., & der Merwe, J. V. (2019) · Symposium on SDN Research · doi:10.1145/3314148.3314358 · Cited by 8
“We use Fisher’s method [20, 24] of combining p-values when we update existing facts with new results.”
MethodVelho, J. P., Zardin, P. B., Jobim, C. C., Haygert-Velho, I. M. P., Alessio, D. R. M., Giotto, Ê., Menegazzi, G., & Gehrke, C. R. (2019) · Semina Ciências Agrárias · doi:10.5433/1679-0359.2020v41n1p239 · Cited by 9
“The importance of scientific progression and the determination of public policies were verified using a meta-analysis (Gurevitch et al., 2018).”
MethodA New Forum for Advancing Understanding of Research Methods and Practice
Lee, B. (2018) · European Management Review · doi:10.1111/emre.12316 · Cited by 6
Meta-analysis of RDX biotransformation rate by bacteria and fungi
Sheehan, P. L., Sadovnik, R., Kukor, J. J., & Bennett, J. W. (2019) · International Biodeterioration & Biodegradation · doi:10.1016/j.ibiod.2019.104814 · Cited by 6
Comparing Meta-Analyses and Pre-Registered Multiple Labs Replication ProjectsPreprint
Kvarven, A., Strømland, E., & Johannesson, M. (2019) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/brzwt · Cited by 6
Feast and famine in agricultural research
(2020) · Nature Plants · doi:10.1038/s41477-020-00795-9 · Cited by 6
Why “vote-counting” is never acceptable in evidence synthesisPreprint
Grainger, M., Stewart, G. B., & Haddaway, N. (2022) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/c49uh · Cited by 7
Self-citationAssessing Risk of Bias Using ChatGPT-4 and Cochrane ROB2 Tool
Treviño-Juarez, A. S. (2024) · Medical Science Educator · doi:10.1007/s40670-024-02034-8 · Cited by 8
“Systematic reviews hold a pivotal position in medicine and healthcare, serving as the bedrock of evidence-based decision-making [1].”
Yang, Y., Lagisz, M., Williams, C., Pan, J., Noble, D., & Nakagawa, S. (2023) · doi:10.32942/x20g6q · Cited by 2
Self-citation
Metadata
- Authors
- Gurevitch, J., Koricheva, J., Nakagawa, S., & Stewart, G.
- Affiliations
- Stony Brook University (US)
- Royal Holloway University of London (GB)
- Garvan Institute of Medical Research (AU)
- Newcastle University (GB)
- Corresponding author
- Gurevitch, Jessica
- Koricheva, Julia
- Nakagawa, Shinichi
- Stewart, Gavin
- Venue
- Nature
- Published
- 2018-03
- Volume
- 555
- Issue
- 7695
- Pages
- 175-182
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2791681873
- Semantic Scholar
- ac5ad1932e31c3ea141366e8e073d6d95869c4ef
- Cited by
- 1,709
- References
- 101
- Citations by year
- 2026: 177 · 2025: 230 · 2024: 231 · 2023: 199 · 2022: 234 · 2021: 235 · 2020: 204 · 2019: 130 · 2018: 64
- FWCI
- 31.20
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- UNSWorks (UNSW Sydney) (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- National Science Foundation (1262402)
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- meta-analysis, evidence synthesis, history of meta-analysis, evolutionary biology, conservation biology, artificial intelligence, evidence-based practice
- MeSH terms
- Animals, Biological Science Disciplines, Ecology, Biological Evolution, Research, Meta-Analysis as Topic, History, 20th Century, History, 21st Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.