Meta-analysis and the science of research synthesis
Open accessThe DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index; 9 of the 69 sources its claims cite were checked for support.
Abstract
Meta-analysis is the quantitative, scientific synthesis of research results. Since the term and modern approaches to research synthesis were first introduced in the 1970s, meta-analysis has had a revolutionary effect in many scientific fields, helping to establish evidence-based practice and to resolve seemingly contradictory research outcomes. At the same time, its implementation has engendered criticism and controversy, in some cases general and others specific to particular disciplines. Here we take the opportunity provided by the recent fortieth anniversary of meta-analysis to reflect on the accomplishments, limitations, recent advances and directions for future developments in the field of research synthesis.
Overview
CoChat Summary
TL;DR
This review reflects on meta-analysis as quantitative research synthesis since the 1970s, its contributions to evidence-based practice, and its methodological development across medicine, social sciences, and ecology/evolution/conservation. It argues that meta-analysis has resolved contradictory evidence and enabled broad generalizations, but faces a “midlife crisis” from poor-quality applications, publication/research bias, and misuse of the term.
Key findings
- Meta-analysis was first introduced in the 1970s; the term was coined by Gene Glass in 1976, and the paper marks its 40th anniversary. It has helped establish evidence-based practice, resolve seemingly contradictory results, and spread across many scientific fields.
- In medicine, a meta-analysis of 20 clinical studies found maternal obesity associated with increased neural tube defect risk: a 1.7-fold rise for moderately obese women and over a 3-fold risk for severely obese women. In social science, a meta-analysis of 35 studies found no significant differences between multisystemic therapy and conventional social services for serious juvenile offenders.
- In ecology, evolution and conservation, meta-analysis was adopted in the early 1990s. Parmesan and Yohe used data on over 1,700 species to show significant range shifts and advancement of spring events; Benayas and colleagues found ecological restoration increased biodiversity and ecosystem services, though values remained lower in restored versus intact reference ecosystems.
- Methodological advances include fixed- and random-effects models, meta-regression, heterogeneity quantification (τ and I²), publication-bias tools, network meta-analysis, phylogenetic meta-analysis, and software such as MetaWin and OpenMEE. PRISMA includes a 27-item checklist for systematic review reporting.
Methods
- Design: narrative review/commentary on meta-analysis and research synthesis, not a new meta-analysis. The authors state they highlight principles, limitations, utility, and future developments.
- Data or sample: draws on published literature and illustrative examples across medicine, social sciences, and ecology/evolution/conservation; includes Box 1 on meta-analytic models and Table 1 on EEC milestones.
- Main analysis: conceptual and methodological synthesis; no primary data collection, systematic search protocol, or quantitative pooling is reported in the paper.
Limitations
- The paper states that meta-analysis and systematic reviews can highlight evidence deficiencies but cannot overcome them; publication bias and research bias may be suspected and sometimes estimated but cannot truly be corrected; selective or incomplete reporting can constrain synthesis.
- The paper states that too many published meta-analyses are of low quality, the term “meta-analysis” is frequently misapplied, and vote-counting persists despite being discredited; it also notes concerns about academic inequality and the “research parasites” controversy.
- The text makes evident that, as a narrative review, it does not provide a systematic search strategy, formal inclusion criteria, or a quantitative synthesis; its examples are illustrative rather than exhaustive.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 4 Not valid · 37 Not checked · 33 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly, a synthesis may be constrained by either selective or incomplete reporting 66,67 .”
What the sources say
- Not checked yetcites [66] Stewart, L. A . et al. Preferred reporting items for a systematic review and meta-analysis of individual participant data: the PRISMA-IPD statement. J. Am. Med. Assoc. 313, 1657–1665 (2015) source
- Partly supportedcites [67] Saldanha, I. J . et al. Evaluating Data Abstraction Assistant, a novel software application for data abstraction during systematic reviews: protocol for a randomized controlled trial. Syst. Rev. 5, 196 (2016) sourceExperimental — accuracy not yet measured
The Background (page unavailable) reports that omissions and errors during data abstraction changed summary meta-analytic results, supporting the general point that a synthesis can be affected by missing information. It describes information present in articles but omitted by abstractors, not selective or incomplete reporting by the studies themselves; that specific mechanism is unsupported. (LLM, conf=0.78)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“When the number of studies is an order of magnitude greater than that, the inability of narrative processes to adequately summarize the outcomes increases exponentially 2,3 .”
What the sources say
- Not checked yetcites [2] Roberts, P. D ., Stewart, G. B. & Pullin, A. S. Are review articles a reliable source of evidence to support conservation and environmental management? A comparison with medicine. Biol. Conserv. 132, 409–423 (2006) source
- Partly supportedcites [3] Bastian, H ., Glasziou, P . & Chalmers, I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med. 7, e1000326 (2010) sourceExperimental — accuracy not yet measured
Our copy supports the qualitative half of the claim: the 'How Close Are We to Archie Cochrane's Goal?' section cites Goldschmidt and Mulrow for 'how great the potential is for error in reviews of health literature that were not conducted systematically' and states that 'the staple of medical literature synthesis remains the non-systematic narrative review', while the same section (Figure 4 discussion) and 'Where to Now?' document the growth from ~14 trials a day in 1979 to 75 trials and 11 systematic reviews a day, with 'the task keeps increasing in size and complexity' ('Where Are We Now?'). What the source does NOT support is the quantitative assertion attributed to it: nowhere does our copy say the inability of narrative processes to summarise outcomes 'increases exponentially', nor tie it to study counts an order of magnitude beyond a dozen — the only dozen-scale figure in the paper is the median number of trials per systematic review (six to 16, Cochrane reviews averaging over 12), which is offered as a measure of reviewing workload and coverage, not of narrative-review failure. The exponential scaling is therefore the citing authors' characterisation, not this paper's. (LLM, conf=0.72)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, as the number of publications and research results has mushroomed across scientific fields, the difficulties encountered in carrying out narrative reviews to identify and summarize evidence in a transparent manner has become increasingly apparent 1 .”
What the sources say
- Not checked yetcites [1] Jennions, M. D ., Lortie, C. J. & Koricheva, J. in The Handbook of Meta-analysis in Ecology and Evolution (eds Koricheva, J . et al.) Ch. 23, 364–380 (Princeton Univ. Press, 2013) source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, in many cases of the resolution of scientific problems, when the results of an individual study are combined with those of other studies, the resulting synthesis provides a more general and complete picture of the questions being addressed.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A statement the paper makes itself — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Sometimes, the striking results of initial studies are not confirmed by those of subsequent studies or by syntheses of a body of research.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
15 more claims
Create a free account to see all 78 claims and to verify the 60 references still open.
- It may state two separate claims as one. 32
- Probably not a substantial claim. 48
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The trade-off with our method is that it does not allow for determining the magnitude of the effect of the practices33–36 but only the proportion of impacts33,37 as positive, negative or neutral.”
From Farming practices to enhance biodiversity across biomes: a systematic review (2024) · cites this paper as [36]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Besides, publication biases that have been documented in several scientific fields90,91 can also affect ML-based science.92,93”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [91]
Experimental — accuracy not yet measuredIn the citing paper
“Moreover, since a meta-analysis can be conducted only when sufficient and appropriate quantitative data from original studies are available, the number of published meta-analyses about a certain topic is an indicator of the overall understanding of the subject, allowing us to reveal research gaps (25, 26).”
From Agricultural diversification promotes multiple ecosystem services without compromising yield (2020) · cites this paper as [25]
In the citing paper
“Meta-analysis optimises statistical power for detecting treatment effects by combining data from multiple similar studies [22, 23].”
From Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize? A systematic review (2022) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“𝜀 is the within-study sampling error (solid black lines), the deviation from the study-specific mean.”
§ Box 1: Meta-analytic models and heterogeneity
“the solid black lines are deviations from the overall mean (panels a,b) or slope (panels c,d)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“The assumption of the fixed-effect meta-regression is that a moderator(s) can explain all between-study heterogeneity”
§ Box 1: Meta-analytic models and heterogeneity
“the blue distributions the between-study variance (panels a-d).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“Two basic models of meta-analysis are the fixed-effect model (Fig 1a) and the random-effects model (Fig 1b) 6 .”
§ Box 1: Meta-analytic models and heterogeneity
“Figure 1. A variety of charts and plots common in meta-analysis. a. PRISMA diagram 20 , b. a forest plot showing overall means based on a fixed-effect model and random-effects model”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“Procedural protocols for systematic reviews are well established especially in the medical and social sciences (Preferred Reporting Items for Systematic Reviews, or PRISMA; www.prisma-statement.org) 20 .”
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 1×
“…the use of machine learning to screen studies 82 for inclusion in systematic reviews and meta-analyses for large reviews, increasingly sophisticated software and models for complex meta-regression 53,83 , and integration of meta-analysis with decision support in medicine and other domains 84 .”
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Research works printed but not linked: 3
- Hedges, L. & Olkin, I. Statistical Methods for Meta-analysis (Academic Press, 1985)
- Higgins, J. P. T . & Green, S. (eds) Cochrane Handbook for Systematic Reviews of Interventions: Version 5.1.0 (Wiley, 2011).This large collaborative work provides definitive guidance for the production of systematic reviews in medicine and is of broad interest for methods development outside the medical field.
- Cooper, H. M ., Hedges, L. V . & Valentine, J. C. (eds) The Handbook of Research Synthesis and Meta-analysis 2nd edn (Russell Sage Foundation, 2009).This book is an important compilation that builds on the ground-breaking first edition to set the standard for best practice in meta-analysis, primarily in the social sciences but with applications to medicine and other fields.
Cited by
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01626-4 · Cited by 13,874
The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · International Journal of Surgery · doi:10.1016/j.ijsu.2021.105906 · Cited by 11,748
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · PLoS Medicine · doi:10.1371/journal.pmed.1003583 · Cited by 5,148
“Systematic reviews therefore generate various types of knowledge for different users of reviews (such as patients, healthcare providers, researchers, and policy makers).[1,2]To ensure a systematic review is valuable to users, authors should prepare a transparent, complete, and accurate account of why the review was do…”
BackgroundThe PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/v7gm2 · Cited by 5,177
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.001 · Cited by 4,265
Declaración PRISMA 2020: una guía actualizada para la publicación de revisiones sistemáticas
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Revista Española de Cardiología · doi:10.1016/j.recesp.2021.06.016 · Cited by 2,095
A tale of two databases: the use of Web of Science and Scopus in academic papers
Zhu, J., & Liu, W. (2020) · Scientometrics · doi:10.1007/s11192-020-03387-8 · Cited by 1,556
Declaración PRISMA 2020: una guía actualizada para la publicación de revisiones sistemáticas
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Revista Española de Cardiología (English Edition) · doi:10.1016/j.rec.2021.07.010 · Cited by 1,313
“Systematic reviews therefore generate various types of knowledge for different users of reviews (such as patients, healthcare providers, researchers, and policy makers) [1 , 2] .”
BackgroundLeakage and the reproducibility crisis in machine-learning-based science
Kapoor, S., & Narayanan, A. (2023) · Patterns · doi:10.1016/j.patter.2023.100804 · Cited by 1,387
Agricultural diversification promotes multiple ecosystem services without compromising yield
Tamburini, G., Bommarco, R., Wanger, T. C., Kremen, C., van der Heijden, M. G. A., Liebman, M., & Hallin, S. (2020) · Science Advances · doi:10.1126/sciadv.aba1715 · Cited by 1,110
“Carbon sequestration (29,16) Soil fertility (65,25) Pest control (14,7) Pollination (4,3) Biodiversity (10,7)”
BackgroundMethodInfluentialGlobal buffering of temperatures under forest canopies
De Frenne, P., Zellweger, F., Rodríguez-Sánchez, F., Scheffers, B. R., Hylander, K., Luoto, M., Vellend, M., Verheyen, K., & Lenoir, J. (2019) · Nature Ecology & Evolution · doi:10.1038/s41559-019-0842-1 · Cited by 787
Shi, L., & Lin, L. (2019) · Medicine · doi:10.1097/md.0000000000015987 · Cited by 818
Soil erosion modelling: A global review and statistical analysis
Borrelli, P., Alewell, C., Alvarez, P., Anache, J. A. A., Baartman, J., Ballabio, C., Bezak, N., Biddoccu, M., Cerdà, A., Chalise, D., et al. (2021) · Science of The Total Environment · doi:10.1016/j.scitotenv.2021.146494 · Cited by 777
Is habitat fragmentation good for biodiversity?
Fletcher, R. J., Didham, R. K., Banks-Leite, C., Barlow, J., Ewers, R. M., Rosindell, J., Holt, R. D., Gonzalez, A., Pardini, R., Damschen, E. I., et al. (2018) · Biological Conservation · doi:10.1016/j.biocon.2018.07.022 · Cited by 760
“Second, vote counting approaches have well-known limitations in drawing inference across studies due to bias generation, low statistical power, and inability to provide relevant information to appropriately summarize results from a set of studies (Gurevitch et al., 2018; Koricheva et al., 2013).”
BackgroundHou, E., Luo, Y., Kuang, Y., Chen, C., Lu, X., Jiang, L., Luo, X., & Wen, D. (2020) · Nature Communications · doi:10.1038/s41467-020-14492-w · Cited by 760
Connecting climate action with other Sustainable Development Goals
Fuso Nerini, F., Sovacool, B., Hughes, N., Cozzi, L., Cosgrave, E., Howells, M., Tavoni, M., Tomei, J., Zerriffi, H., & Milligan, B. (2019) · Nature Sustainability · doi:10.1038/s41893-019-0334-y · Cited by 721
O'Dea, R. E., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Gurevitch, J., Page, M. J., Stewart, G., Moher, D., et al. (2021) · Biological Reviews · doi:10.1111/brv.12721 · Cited by 697
“The conclusions drawn from systematic reviews and metaanalyses are only as strong as the studies that comprise them (Gurevitch et al., 2018).”
BackgroundMethodResultInfluentialSelf-citationA solution to minimum sample size for regressions
Jenkins, D. G., & Quintana-Ascencio, P. F. (2020) · PLOS ONE · doi:10.1371/journal.pone.0229345 · Cited by 665
Muka, T., Glisic, M., Milic, J., Verhoog, S., Bohlius, J., Bramer, W., Chowdhury, R., & Franco, O. H. (2020) · European Journal of Epidemiology · doi:10.1007/s10654-019-00576-5 · Cited by 660
“However, several studies assessing the quality of published systematic reviews have shown that not all systematic reviews are truly systematic and that their quality is highly variable [5, 6].”
BackgroundLu, Y., Zhou, G., Ewald, J., Pang, Z., Shiri, T., & Xia, J. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkad407 · Cited by 623
A Guide to Conducting a Meta-Analysis with Non-Independent Effect Sizes
Cheung, M. W.-L. (2019) · Neuropsychology Review · doi:10.1007/s11065-019-09415-6 · Cited by 610
Ainsworth, E. A., & Long, S. P. (2021) · Global Change Biology · doi:10.1111/gcb.15375 · Cited by 592
“…et al. (2018) (Continues) Meta-analysis is the quantitative synthesis of research results, and we used the approach to broadly generalize crop responses to elevated [CO2] in order to gain a more comprehensive understanding, a common goal for ecological meta-analyses (Gurevitch et al., 2018).”
BackgroundMethodAquaculture at the crossroads of global warming and antimicrobial resistance
Reverter, M., Sarter, S., Caruso, D., Avarre, J.-C., Combe, M., Pepey, E., Pouyaud, L., Vega-Heredía, S., de Verdal, H., & Gozlan, R. E. (2020) · Nature Communications · doi:10.1038/s41467-020-15735-6 · Cited by 558
“We performed two independent literature searches for each of the subjects following the PRISMA (preferred reporting items for systematic reviews and meta-analyses) guidelines and research synthesis norms 73,74 (Supplementary Figs.”
MethodHummel, D., & Maedche, A. (2019) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2019.03.005 · Cited by 543
“This problem of incomplete data reporting is common in many primary publications (Gurevitch et al., 2018).”
BackgroundHallegraeff, G. M., Anderson, D. M., Belin, C., Bottein, M.-Y. D., Bresnan, E., Chinain, M., Enevoldsen, H., Iwataki, M., Karlson, B., McKenzie, C. H., et al. (2021) · Communications Earth & Environment · doi:10.1038/s43247-021-00178-8 · Cited by 524
Ecosystem decay exacerbates biodiversity loss with habitat loss
Chase, J. M., Blowes, S. A., Knight, T. M., Gerstner, K., & May, F. (2020) · Nature · doi:10.1038/s41586-020-2531-2 · Cited by 504
The effect of characteristics of source credibility on consumer behaviour: A meta-analysis
Ismagilova, E., Slade, E., Rana, N. P., & Dwivedi, Y. K. (2020) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2019.01.005 · Cited by 504
“Meta-analysis is a statistical procedure which includes combining data from multiple studies (Dwivedi et al., 2017; Gurevitch et al., 2018; Rana et al., 2015; Zhao et al., 2018).”
MethodBiochar in agriculture – A systematic review of 26 global meta‐analyses
Schmidt, H., Kammann, C., Hagemann, N., Leifeld, J., Bucheli, T. D., Sánchez Monedero, M. A., & Cayuela, M. L. (2021) · GCB Bioenergy · doi:10.1111/gcbb.12889 · Cited by 490
“From those, we excluded 10 studies that did not use proper meta- analytical tools (Gurevitch et al., 2018) but carried out other statistical methods instead (e.g. paired t- tests, analysis of co- variance).”
MethodMeta-analysis of the impact of Augmented Reality on students’ learning gains
Garzón, J., & Acevedo, J. (2019) · Educational Research Review · doi:10.1016/j.edurev.2019.04.001 · Cited by 491
Su, W., Han, X., Yu, H., Wu, Y., & Potenza, M. N. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106480 · Cited by 476
Methods for testing publication bias in ecological and evolutionary meta‐analyses
Nakagawa, S., Lagisz, M., Jennions, M. D., Koricheva, J., Noble, D. W. A., Parker, T. H., Sánchez‐Tójar, A., Yang, Y., & O'Dea, R. E. (2022) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13724 · Cited by 399
Self-citationA declaração PRISMA 2020: diretriz atualizada para relatar revisões sistemáticas
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2022) · Revista Panamericana de Salud Pública · doi:10.26633/rpsp.2022.112 · Cited by 433
Li, S., Harris, S., Anandhi, A., & Chen, G. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.01.106 · Cited by 415
Yin, S., & Yu, Y. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.132608 · Cited by 370
Effect of land‐use and land‐cover change on mangrove blue carbon: A systematic review
Sasmito, S. D., Taillardat, P., Clendenning, J. N., Cameron, C., Friess, D. A., Murdiyarso, D., & Hutley, L. B. (2019) · Global Change Biology · doi:10.1111/gcb.14774 · Cited by 349
Zheng, D., Yin, G., Liu, M., Chen, C., Jiang, Y., Hou, L., & Zheng, Y. (2021) · Science of The Total Environment · doi:10.1016/j.scitotenv.2021.146009 · Cited by 348
Bias caused by sampling error in meta-analysis with small sample sizes
Lin, L. (2018) · PLOS ONE · doi:10.1371/journal.pone.0204056 · Cited by 335
Meta-Analysis Reveals Reproducible Gut Microbiome Alterations in Response to a High-Fat Diet
Bisanz, J. E., Upadhyay, V., Turnbaugh, J. A., Ly, K., & Turnbaugh, P. J. (2019) · Cell Host & Microbe · doi:10.1016/j.chom.2019.06.013 · Cited by 333
“Also, published research is biased towards those studies with positive results (Gurevitch et al., 2018), termed the “file drawer problem”.”
BackgroundEffect of allelopathy on plant performance: a meta‐analysis
Zhang, Z., Liu, Y., Yuan, L., Weber, E., & van Kleunen, M. (2021) · Ecology Letters · doi:10.1111/ele.13627 · Cited by 303
Biological soil health indicators respond to tillage intensity: A US meta-analysis
Nunes, M. R., Karlen, D. L., Veum, K. S., Moorman, T. B., & Cambardella, C. A. (2020) · Geoderma · doi:10.1016/j.geoderma.2020.114335 · Cited by 298
Evaluation of various estimators for standardized mean difference in meta‐analysis
Lin, L., & Aloe, A. M. (2021) · Statistics in Medicine · doi:10.1002/sim.8781 · Cited by 297
“Book Glass’ Δ in Equation (15) Cohen’s d in Equation (1) Cohen’s d′ in Equation (16) Hedges’ g in Equation (7) Hedges and Olkin15 g′ g δ d Hunter and Schmidt81 dG d NA d Stangl and Berry31 NA z NA NA Egger et al27 Δ d NA g Lipsey and Wilson34 NA ESsm NA ESsm ′”
BackgroundMethodHigher yields and more biodiversity on smaller farms
Ricciardi, V., Mehrabi, Z., Wittman, H., James, D., & Ramankutty, N. (2021) · Nature Sustainability · doi:10.1038/s41893-021-00699-2 · Cited by 292
Challenges in meta-analyses with observational studies
Metelli, S., & Chaimani, A. (2020) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300129 · Cited by 290
Does crop rotation yield more in China? A meta-analysis
Zhao, J., Yang, Y., Zhang, K., Jeong, J., Zeng, Z., & Zang, H. (2020) · Field Crops Research · doi:10.1016/j.fcr.2019.107659 · Cited by 267
Comparing meta-analyses and preregistered multiple-laboratory replication projects
Kvarven, A., Strømland, E., & Johannesson, M. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0787-z · Cited by 271
Growth mindsets and psychological distress: A meta-analysis
Burnette, J. L., Knouse, L. E., Vavra, D. T., O'Boyle, E., & Brooks, M. A. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101816 · Cited by 271
A Large-Scale Genome-Wide Association Study in U.S. Holstein Cattle
Jiang, J., Ma, L., Prakapenka, D., VanRaden, P. M., Cole, J. B., & Da, Y. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2019.00412 · Cited by 267
Research Weaving: Visualizing the Future of Research Synthesis
Nakagawa, S., Samarasinghe, G., Haddaway, N. R., Westgate, M. J., O’Dea, R. E., Noble, D. W. A., & Lagisz, M. (2019) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2018.11.007 · Cited by 261
Self-citationA balance of winners and losers in the Anthropocene
Dornelas, M., Gotelli, N. J., Shimadzu, H., Moyes, F., Magurran, A. E., & McGill, B. J. (2019) · Ecology Letters · doi:10.1111/ele.13242 · Cited by 258
“An assessment of species trends across the UK also concluded that 60% of 3148 studied species had declined (Hayhow et al. 2016).”
BackgroundPick, J. L., Nakagawa, S., & Noble, D. W. A. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13118 · Cited by 257
Self-citationBeillouin, D., Cardinael, R., Berre, D., Boyer, A., Corbeels, M., Fallot, A., Feder, F., & Demenois, J. (2022) · Global Change Biology · doi:10.1111/gcb.15998 · Cited by 255
“Therefore, a critical element in advancing and improving meta- analytical methods is training in research synthesis methods (Gurevitch et al., 2018).”
BackgroundMethodDoes diversifying crop rotations suppress weeds? A meta-analysis
Weisberger, D., Nichols, V., & Liebman, M. (2019) · PLOS ONE · doi:10.1371/journal.pone.0219847 · Cited by 256
“To ensure the robustness of our results, we tested the sensitivity of mean effect sizes to included studies by performing a leave-one-out analysis [30, 39], using the same procedure described above to estimate means and confidence intervals for each subset of data.”
MethodArtificial intelligence in systematic reviews: promising when appropriately used
van Dijk, S. H. B., Brusse-Keizer, M. G. J., Bucsán, C. C., van der Palen, J., Doggen, C. J. M., & Lenferink, A. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-072254 · Cited by 256
Effects of plant diversity on soil carbon in diverse ecosystems: a global meta‐analysis
Chen, X., Chen, H. Y. H., Chen, C., Ma, Z., Searle, E. B., Yu, Z., & Huang, Z. (2020) · Biological Reviews · doi:10.1111/brv.12554 · Cited by 251
“A quantitative synthesis of results across multiple studies is needed, therefore, to assist in determining the overall effects of plant species diversity and identifying sources of variation (Gurevitch et al., 2018).”
BackgroundThe effects of landscape patterns on ecosystem services: meta-analyses of landscape services
Duarte, G. T., Santos, P. M., Cornelissen, T. G., Ribeiro, M. C., & Paglia, A. P. (2018) · Landscape Ecology · doi:10.1007/s10980-018-0673-5 · Cited by 251
“Meta-analysis is the quantitative, scientific synthesis of research results aiming to achieve broad generalizations across a large number of study outcomes (Gurevitch et al. 2018).”
BackgroundZhou, G., Zhou, X., Nie, Y., Bai, S. H., Zhou, L., Shao, J., Cheng, W., Wang, J., Hu, F., & Fu, Y. (2018) · Plant, Cell & Environment · doi:10.1111/pce.13356 · Cited by 247
“meta-analysis, which is a quantitative, scientific synthesis tool to provide reliable conclusion (Gurevitch et al., 2018), was conducted from 128 studies from field-based experiments with 17 root traits and responses to evaluate the responses of root traits to drought.”
MethodIgnoring non‐English‐language studies may bias ecological meta‐analyses
Konno, K., Akasaka, M., Koshida, C., Katayama, N., Osada, N., Spake, R., & Amano, T. (2020) · Ecology and Evolution · doi:10.1002/ece3.6368 · Cited by 242
“The number of effectsize estimates in each language is also shown in each bar used to inform decision-making in conservation policy and practice across a range of contexts (Gurevitch et al., 2018).”
BackgroundEstimates of fishing gear loss rates at a global scale: A literature review and meta‐analysis
Richardson, K., Hardesty, B. D., & Wilcox, C. (2019) · Fish and Fisheries · doi:10.1111/faf.12407 · Cited by 240
Systematic review of the outcomes and trade-offs of ten types of decarbonization policy instruments
Peñasco, C., Anadón, L. D., & Verdolini, E. (2021) · Nature Climate Change · doi:10.1038/s41558-020-00971-x · Cited by 235
The orchard plot: Cultivating a forest plot for use in ecology, evolution, and beyond
Nakagawa, S., Lagisz, M., O'Dea, R. E., Rutkowska, J., Yang, Y., Noble, D. W. A., & Senior, A. M. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1424 · Cited by 228
Self-citationImpact of manure on soil biochemical properties: A global synthesis
Liu, S., Wang, J., Pu, S., Blagodatskaya, E., Kuzyakov, Y., & Razavi, B. S. (2020) · Science of The Total Environment · doi:10.1016/j.scitotenv.2020.141003 · Cited by 224
Response of Plants to Water Stress: A Meta-Analysis
Sun, Y., Wang, C., Chen, H. Y. H., & Ruan, H. (2020) · Frontiers in Plant Science · doi:10.3389/fpls.2020.00978 · Cited by 220
Palmer, C. A., Bower, J. L., Cho, K. W., Clementi, M. A., Lau, S., Oosterhoff, B., & Alfano, C. A. (2024) · Psychological Bulletin · doi:10.1037/bul0000410 · Cited by 212
How to conduct a meta-analysis in eight steps: A practical guide
Hansen, C., Steinmetz, H., & Block, J. (2022) · Management Review Quarterly · doi:10.1007/s11301-021-00247-4 · Cited by 218
“However, going beyond a narrative summary of key findings, a meta-analysis adds value in providing a quantitative assessment of the relationship between two target variables or the effectiveness of an intervention (Gurevitch et al. 2018).”
BackgroundMethodEffects of soil conservation techniques on water erosion control: A global analysis
Xiong, M., Sun, R., & Chen, L. (2018) · Science of The Total Environment · doi:10.1016/j.scitotenv.2018.07.124 · Cited by 217
Nakagawa, S., Yang, Y., Macartney, E. L., Spake, R., & Lagisz, M. (2023) · Environmental Evidence · doi:10.1186/s13750-023-00301-6 · Cited by 210
Self-citationThe island rule explains consistent patterns of body size evolution in terrestrial vertebrates
Benítez-López, A., Santini, L., Gallego-Zamorano, J., Milá, B., Walkden, P., Huijbregts, M. A. J., & Tobias, J. A. (2021) · Nature Ecology & Evolution · doi:10.1038/s41559-021-01426-y · Cited by 197
Psychology's Replication Crisis and Clinical Psychological Science
Tackett, J. L., Brandes, C. M., King, K. M., & Markon, K. E. (2019) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050718-095710 · Cited by 198
“…of results from multiple studies is much older (Pearson 1904), but more recent work by Glass and colleagues, as well as others (Shadish & Lecy 2015), has helped spark modern meta-analysis by leveraging effect sizes to integrate findings across heterogenous research designs (Gurevitch et al. 2018).”
Yu, L., Zhao, X., Gao, X., & Siddique, K. H. M. (2020) · Agricultural Water Management · doi:10.1016/j.agwat.2019.105906 · Cited by 194
Li, D., Quan, C., Song, Z., Li, X., Yu, G., Li, C., & Muhammad, A. (2021) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2020.623705 · Cited by 194
“As an effective analytical method of quantitative, scientific synthesis of research results (Gurevitch et al., 2018), meta-analysis may prove especially fruitful in the near future.”
MethodMeta analysis of heavy metal pollution and sources in surface sediments of Lake Taihu, China
Niu, Y., Jiang, X., Wang, K., Xia, J., Jiao, W., Niu, Y., & Yu, H. (2020) · Science of The Total Environment · doi:10.1016/j.scitotenv.2019.134509 · Cited by 194
Wang, Z., Yue, L., Dhankher, O. P., & Xing, B. (2020) · Environment International · doi:10.1016/j.envint.2020.105831 · Cited by 195
Evidence map of crop diversification strategies at the global scale
Beillouin, D., Ben-Ari, T., & Makowski, D. (2019) · Environmental Research Letters · doi:10.1088/1748-9326/ab4449 · Cited by 192
“In these unweighted analyses, within-and between-study variations are not easily disentangled and heterogeneity may be difficult to analyze properly (Gurevitch et al 2018).”
BackgroundSubcontinental heat wave triggers terrestrial and marine, multi-taxa responses
Ruthrof, K. X., Breshears, D. D., Fontaine, J. B., Froend, R. H., Matusick, G., Kala, J., Miller, B. P., Mitchell, P. J., Wilson, S. K., van Keulen, M., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-31236-5 · Cited by 186
Tamario, C., Sunde, J., Petersson, E., Tibblin, P., & Forsman, A. (2019) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2019.00271 · Cited by 182
“Tagging studies suggest that low attraction is often a limiting factor (Dodd et al., 2017), partly because fish rely on water flow dynamics as a cue to initiate upstream migration and to find the fishways (Hall, 2018).”
BackgroundComparison of four heterogeneity measures for meta‐analysis
Lin, L. (2020) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13159 · Cited by 184
“Meta‐analysis has been a popular statistical method to synthesize evidence from different studies in clinical research.(1,2) Assessing heterogeneity between the collected studies in a meta‐analysis plays a critical role in examining whether the studies may be properly combined and the synthesized results are reliable.”
MethodEffectiveness of post-fire soil erosion mitigation treatments: A systematic review and meta-analysis
Girona-García, A., Vieira, D. C. S., Silva, J., Fernández, C., Robichaud, P. R., & Keizer, J. J. (2021) · Earth-Science Reviews · doi:10.1016/j.earscirev.2021.103611 · Cited by 186
Vergallito, A., Feroldi, S., Pisoni, A., & Romero Lauro, L. J. (2022) · Brain Sciences · doi:10.3390/brainsci12050522 · Cited by 179
“However, cautions concerning the use of meta-analyses in brain stimulation studies have been previously highlighted by prominent scholars due to the small sample sizes tested and the lack of clarity concerning inclusion and exclusion criteria ([19,20]; see [21] for a general discussion of these issues in meta-analyses…”
BackgroundGlobal synthesis of effects of plant species diversity on trophic groups and interactions
Wan, N.-F., Zheng, X.-R., Fu, L.-W., Kiær, L. P., Zhang, Z., Chaplin-Kramer, R., Dainese, M., Tan, J., Qiu, S.-Y., Hu, Y.-Q., et al. (2020) · Nature Plants · doi:10.1038/s41477-020-0654-y · Cited by 181
Young, M. D., Ros, G. H., & de Vries, W. (2021) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2021.107551 · Cited by 180
Algae response to engineered nanoparticles: current understanding, mechanisms and implications
Chen, F., Xiao, Z., Yue, L., Wang, J., Feng, Y., Zhu, X., Wang, Z., & Xing, B. (2019) · Environmental Science: Nano · doi:10.1039/c8en01368c · Cited by 178
The effects of anthropogenic noise on animals: a meta-analysis
Kunc, H. P., & Schmidt, R. (2019) · Biology Letters · doi:10.1098/rsbl.2019.0649 · Cited by 175
“Meta-analysis usually summarizes the effects of an experimental treatment on a single response variable [8], which not only allows us to test whether there is an effect, but also to quantify the direction of an effect.”
BackgroundRole of carbonate burial in Blue Carbon budgets
Saderne, V., Geraldi, N. R., Macreadie, P. I., Maher, D. T., Middelburg, J. J., Serrano, O., Almahasheer, H., Arias-Ortiz, A., Cusack, M., Eyre, B. D., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-08842-6 · Cited by 176
A global meta‐analysis of the impacts of tree plantations on biodiversity
Wang, C., Zhang, W., Li, X., & Wu, J. (2022) · Global Ecology and Biogeography · doi:10.1111/geb.13440 · Cited by 171
Effects of anthropogenic disturbances on bird functional diversity: A global meta-analysis
Matuoka, M. A., Benchimol, M., Almeida-Rocha, J. M. D., & Morante-Filho, J. C. (2020) · Ecological Indicators · doi:10.1016/j.ecolind.2020.106471 · Cited by 169
A meta-analysis on global change drivers and the risk of infectious disease
Mahon, M. B., Sack, A., Aleuy, O. A., Barbera, C., Brown, E., Buelow, H., Civitello, D. J., Cohen, J. M., de Wit, L. A., Forstchen, M., et al. (2024) · Nature · doi:10.1038/s41586-024-07380-6 · Cited by 164
Pravila PRISMA 2020.: ažurirane smjernice za izvještavanje u sustavnim pregledima
Page, M. J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McGuinness, L., McDonald, S., Stewart, L. A., et al. (2021) · Medicina Fluminensis · doi:10.21860/medflum2021_264903 · Cited by 163
Chen, H., Dai, Z., Veach, A. M., Zheng, J., Xu, J., & Schadt, C. W. (2020) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2020.106841 · Cited by 158
“05 level when 95 % CIs did not overlap zero (Gurevitch et al., 2018; Hedges et al., 1999).”
BackgroundorchaRd 2.0: An R package for visualising meta‐analyses with orchard plots
Nakagawa, S., Lagisz, M., O’Dea, R. E., Pottier, P., Rutkowska, J., Senior, A. M., Yang, Y., & Noble, D. W. A. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14152 · Cited by 244
“However, in ecology and evo - lution, forest plots are infrequently used because meta-analyses in this field often include > 100 effect sizes, making a traditional forest plot impractical (Gurevitch et al., 2018; Senior et al., 2016 ).”
MethodSelf-citationGlobal meta-analysis shows action is needed to halt genetic diversity loss
Shaw, R. E., Farquharson, K. A., Bruford, M. W., Coates, D. J., Elliott, C. P., Mergeay, J., Ottewell, K. M., Segelbacher, G., Hoban, S., Hvilsom, C., et al. (2025) · Nature · doi:10.1038/s41586-024-08458-x · Cited by 231
“Alternatively, a comprehensive and robust assessment of the primary literature, targeting patterns and processes rather than absolute measures of population genetic diversity per se, can be conducted through statistical meta-analysis 29 .”
Michelson, M., & Reuter, K. (2019) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2019.100443 · Cited by 152
A meta-analysis of bovine viral diarrhoea virus (BVDV) prevalences in the global cattle population
Scharnböck, B., Roch, F., Richter, V., Funke, C., Firth, C. L., Obritzhauser, W., Baumgartner, W., Käsbohrer, A., & Conrady, B. (2018) · Scientific Reports · doi:10.1038/s41598-018-32831-2 · Cited by 152
Imburgio, M. J., & Orr, J. M. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.04.022 · Cited by 150
Geange, S. R., Arnold, P. A., Catling, A., Coast, O., Cook, A. M., Gowland, K. M., Leigh, A., Notarnicola, R. F., Posch, B. C., Venn, S., et al. (2020) · New Phytologist · doi:10.1111/nph.17052 · Cited by 161
“Ours is an era of evidence synthesis and meta-analyses (Gurevitch et al., 2018), in which new analytical tools are released frequently.”
BackgroundMethodPottier, P., Burke, S., Zhang, R. Y., Noble, D. W. A., Schwanz, L. E., Drobniak, S. M., & Nakagawa, S. (2022) · Ecology Letters · doi:10.1111/ele.14083 · Cited by 173
Self-citationPeng, S., Kinlock, N. L., Gurevitch, J., & Peng, S. (2019) · Ecology · doi:10.1002/ecy.2552 · Cited by 152
“…populations are purposefully included so that broad generalizations can be found, and where the goal, as is ours here, is to find the factors of commonality among studies and identify broad patterns rather than achieve a clear accounting of all variation among studies (Gurevitch et al. 2018).”
BackgroundSelf-citationQuantification of the global impact of agricultural practices on soil nematodes: A meta-analysis
Puissant, J., Villenave, C., Chauvin, C., Plassard, C., Blanchart, É., & Trap, J. (2021) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2021.108383 · Cited by 164
“In this study, we conducted a meta-analysis that meets the required statistical criteria (Vetter et al., 2013; Gurevitch et al., 2018).”
MethodA global meta-analyses of the response of multi-taxa diversity to grazing intensity in grasslands
Wang, C., & Tang, Y. (2019) · Environmental Research Letters · doi:10.1088/1748-9326/ab4932 · Cited by 154
“We followed the methods of Hedges et al (1999) and Gurevitch et al (2018) to evaluate the effects of grazing on the diversity indices of plants, arthropods, and microbes.”
MethodMeta-analysis of Empirical Estimates of Loss Aversion
Brown, A. L., Imai, T., Vieider, F. M., & Camerer, C. F. (2024) · Journal of Economic Literature · doi:10.1257/jel.20221698 · Cited by 220
Metadata
- Authors
- Gurevitch, J., Koricheva, J., Nakagawa, S., & Stewart, G.
- Affiliations
- Stony Brook University (US)
- Royal Holloway University of London (GB)
- Garvan Institute of Medical Research (AU)
- Newcastle University (GB)
- Corresponding author
- Gurevitch, Jessica
- Koricheva, Julia
- Nakagawa, Shinichi
- Stewart, Gavin
- Venue
- Nature
- Published
- 2018-03
- Volume
- 555
- Issue
- 7695
- Pages
- 175-182
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2791681873
- Semantic Scholar
- ac5ad1932e31c3ea141366e8e073d6d95869c4ef
- Cited by
- 1,709
- References
- 101
- Citations by year
- 2026: 177 · 2025: 230 · 2024: 231 · 2023: 199 · 2022: 234 · 2021: 235 · 2020: 204 · 2019: 130 · 2018: 64
- FWCI
- 31.20
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- UNSWorks (UNSW Sydney) (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- National Science Foundation (1262402)
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- meta-analysis, evidence synthesis, history of meta-analysis, evolutionary biology, conservation biology, artificial intelligence, evidence-based practice
- MeSH terms
- Animals, Biological Science Disciplines, Ecology, Biological Evolution, Research, Meta-Analysis as Topic, History, 20th Century, History, 21st Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.