Meta-analysis and the science of research synthesis
Open accessThe DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index; 9 of the 69 sources its claims cite were checked for support.
Abstract
Meta-analysis is the quantitative, scientific synthesis of research results. Since the term and modern approaches to research synthesis were first introduced in the 1970s, meta-analysis has had a revolutionary effect in many scientific fields, helping to establish evidence-based practice and to resolve seemingly contradictory research outcomes. At the same time, its implementation has engendered criticism and controversy, in some cases general and others specific to particular disciplines. Here we take the opportunity provided by the recent fortieth anniversary of meta-analysis to reflect on the accomplishments, limitations, recent advances and directions for future developments in the field of research synthesis.
Overview
CoChat Summary
TL;DR
This review reflects on meta-analysis as quantitative research synthesis since the 1970s, its contributions to evidence-based practice, and its methodological development across medicine, social sciences, and ecology/evolution/conservation. It argues that meta-analysis has resolved contradictory evidence and enabled broad generalizations, but faces a “midlife crisis” from poor-quality applications, publication/research bias, and misuse of the term.
Key findings
- Meta-analysis was first introduced in the 1970s; the term was coined by Gene Glass in 1976, and the paper marks its 40th anniversary. It has helped establish evidence-based practice, resolve seemingly contradictory results, and spread across many scientific fields.
- In medicine, a meta-analysis of 20 clinical studies found maternal obesity associated with increased neural tube defect risk: a 1.7-fold rise for moderately obese women and over a 3-fold risk for severely obese women. In social science, a meta-analysis of 35 studies found no significant differences between multisystemic therapy and conventional social services for serious juvenile offenders.
- In ecology, evolution and conservation, meta-analysis was adopted in the early 1990s. Parmesan and Yohe used data on over 1,700 species to show significant range shifts and advancement of spring events; Benayas and colleagues found ecological restoration increased biodiversity and ecosystem services, though values remained lower in restored versus intact reference ecosystems.
- Methodological advances include fixed- and random-effects models, meta-regression, heterogeneity quantification (τ and I²), publication-bias tools, network meta-analysis, phylogenetic meta-analysis, and software such as MetaWin and OpenMEE. PRISMA includes a 27-item checklist for systematic review reporting.
Methods
- Design: narrative review/commentary on meta-analysis and research synthesis, not a new meta-analysis. The authors state they highlight principles, limitations, utility, and future developments.
- Data or sample: draws on published literature and illustrative examples across medicine, social sciences, and ecology/evolution/conservation; includes Box 1 on meta-analytic models and Table 1 on EEC milestones.
- Main analysis: conceptual and methodological synthesis; no primary data collection, systematic search protocol, or quantitative pooling is reported in the paper.
Limitations
- The paper states that meta-analysis and systematic reviews can highlight evidence deficiencies but cannot overcome them; publication bias and research bias may be suspected and sometimes estimated but cannot truly be corrected; selective or incomplete reporting can constrain synthesis.
- The paper states that too many published meta-analyses are of low quality, the term “meta-analysis” is frequently misapplied, and vote-counting persists despite being discredited; it also notes concerns about academic inequality and the “research parasites” controversy.
- The text makes evident that, as a narrative review, it does not provide a systematic search strategy, formal inclusion criteria, or a quantitative synthesis; its examples are illustrative rather than exhaustive.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 4 Not valid · 37 Not checked · 33 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similarly, a synthesis may be constrained by either selective or incomplete reporting 66,67 .”
What the sources say
- Not checked yetcites [66] Stewart, L. A . et al. Preferred reporting items for a systematic review and meta-analysis of individual participant data: the PRISMA-IPD statement. J. Am. Med. Assoc. 313, 1657–1665 (2015) source
- Partly supportedcites [67] Saldanha, I. J . et al. Evaluating Data Abstraction Assistant, a novel software application for data abstraction during systematic reviews: protocol for a randomized controlled trial. Syst. Rev. 5, 196 (2016) sourceExperimental — accuracy not yet measured
The Background (page unavailable) reports that omissions and errors during data abstraction changed summary meta-analytic results, supporting the general point that a synthesis can be affected by missing information. It describes information present in articles but omitted by abstractors, not selective or incomplete reporting by the studies themselves; that specific mechanism is unsupported. (LLM, conf=0.78)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“When the number of studies is an order of magnitude greater than that, the inability of narrative processes to adequately summarize the outcomes increases exponentially 2,3 .”
What the sources say
- Not checked yetcites [2] Roberts, P. D ., Stewart, G. B. & Pullin, A. S. Are review articles a reliable source of evidence to support conservation and environmental management? A comparison with medicine. Biol. Conserv. 132, 409–423 (2006) source
- Partly supportedcites [3] Bastian, H ., Glasziou, P . & Chalmers, I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med. 7, e1000326 (2010) sourceExperimental — accuracy not yet measured
Our copy supports the qualitative half of the claim: the 'How Close Are We to Archie Cochrane's Goal?' section cites Goldschmidt and Mulrow for 'how great the potential is for error in reviews of health literature that were not conducted systematically' and states that 'the staple of medical literature synthesis remains the non-systematic narrative review', while the same section (Figure 4 discussion) and 'Where to Now?' document the growth from ~14 trials a day in 1979 to 75 trials and 11 systematic reviews a day, with 'the task keeps increasing in size and complexity' ('Where Are We Now?'). What the source does NOT support is the quantitative assertion attributed to it: nowhere does our copy say the inability of narrative processes to summarise outcomes 'increases exponentially', nor tie it to study counts an order of magnitude beyond a dozen — the only dozen-scale figure in the paper is the median number of trials per systematic review (six to 16, Cochrane reviews averaging over 12), which is offered as a measure of reviewing workload and coverage, not of narrative-review failure. The exponential scaling is therefore the citing authors' characterisation, not this paper's. (LLM, conf=0.72)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“However, as the number of publications and research results has mushroomed across scientific fields, the difficulties encountered in carrying out narrative reviews to identify and summarize evidence in a transparent manner has become increasingly apparent 1 .”
What the sources say
- Not checked yetcites [1] Jennions, M. D ., Lortie, C. J. & Koricheva, J. in The Handbook of Meta-analysis in Ecology and Evolution (eds Koricheva, J . et al.) Ch. 23, 364–380 (Princeton Univ. Press, 2013) source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, in many cases of the resolution of scientific problems, when the results of an individual study are combined with those of other studies, the resulting synthesis provides a more general and complete picture of the questions being addressed.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A statement the paper makes itself — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Sometimes, the striking results of initial studies are not confirmed by those of subsequent studies or by syntheses of a body of research.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
15 more claims
Create a free account to see all 78 claims and to verify the 60 references still open.
- It may state two separate claims as one. 32
- Probably not a substantial claim. 48
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The trade-off with our method is that it does not allow for determining the magnitude of the effect of the practices33–36 but only the proportion of impacts33,37 as positive, negative or neutral.”
From Farming practices to enhance biodiversity across biomes: a systematic review (2024) · cites this paper as [36]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Besides, publication biases that have been documented in several scientific fields90,91 can also affect ML-based science.92,93”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [91]
Experimental — accuracy not yet measuredIn the citing paper
“Moreover, since a meta-analysis can be conducted only when sufficient and appropriate quantitative data from original studies are available, the number of published meta-analyses about a certain topic is an indicator of the overall understanding of the subject, allowing us to reveal research gaps (25, 26).”
From Agricultural diversification promotes multiple ecosystem services without compromising yield (2020) · cites this paper as [25]
In the citing paper
“Meta-analysis optimises statistical power for detecting treatment effects by combining data from multiple similar studies [22, 23].”
From Does the growing of Bt maize change abundance or ecological function of non-target animals compared to the growing of non-GM maize? A systematic review (2022) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“𝜀 is the within-study sampling error (solid black lines), the deviation from the study-specific mean.”
§ Box 1: Meta-analytic models and heterogeneity
“the solid black lines are deviations from the overall mean (panels a,b) or slope (panels c,d)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“The assumption of the fixed-effect meta-regression is that a moderator(s) can explain all between-study heterogeneity”
§ Box 1: Meta-analytic models and heterogeneity
“the blue distributions the between-study variance (panels a-d).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Box 1: Meta-analytic models and heterogeneity
“Two basic models of meta-analysis are the fixed-effect model (Fig 1a) and the random-effects model (Fig 1b) 6 .”
§ Box 1: Meta-analytic models and heterogeneity
“Figure 1. A variety of charts and plots common in meta-analysis. a. PRISMA diagram 20 , b. a forest plot showing overall means based on a fixed-effect model and random-effects model”
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“Procedural protocols for systematic reviews are well established especially in the medical and social sciences (Preferred Reporting Items for Systematic Reviews, or PRISMA; www.prisma-statement.org) 20 .”
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 1×
“…the use of machine learning to screen studies 82 for inclusion in systematic reviews and meta-analyses for large reviews, increasingly sophisticated software and models for complex meta-regression 53,83 , and integration of meta-analysis with decision support in medicine and other domains 84 .”
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Research works printed but not linked: 3
- Hedges, L. & Olkin, I. Statistical Methods for Meta-analysis (Academic Press, 1985)
- Higgins, J. P. T . & Green, S. (eds) Cochrane Handbook for Systematic Reviews of Interventions: Version 5.1.0 (Wiley, 2011).This large collaborative work provides definitive guidance for the production of systematic reviews in medicine and is of broad interest for methods development outside the medical field.
- Cooper, H. M ., Hedges, L. V . & Valentine, J. C. (eds) The Handbook of Research Synthesis and Meta-analysis 2nd edn (Russell Sage Foundation, 2009).This book is an important compilation that builds on the ground-breaking first edition to set the standard for best practice in meta-analysis, primarily in the social sciences but with applications to medicine and other fields.
Cited by
Items 401–500 of 1,000
Shokouhifar, M., Sohrabi, M., Rabbani, M., Molana, S. M. H., & Werner, F. M. (2023) · Agronomy · doi:10.3390/agronomy13020565 · Cited by 38
Morris, K. A., Hornum, S., Crystal‐Ornelas, R., Pennington, S., & Bond‐Lamberty, B. (2022) · Journal of Geophysical Research Biogeosciences · doi:10.1029/2022jg006887 · Cited by 37
“As such, this approach constitutes an important cornerstone of evidence synthesis research and can help summarize evidence as it accumulates in the published literature (Gurevitch et al., 2018).”
BackgroundImpacts of pastures and forestry plantations on herpetofauna: A global meta‐analysis
López‐Bedoya, P. A., Cardona‐Galvis, E. A., Urbina-Cardona, N., Edwards, F. A., & Edwards, D. P. (2022) · Journal of Applied Ecology · doi:10.1111/1365-2664.14299 · Cited by 41
Understanding Anaerobic Co-digestion of Organic Wastes through Meta-Analysis
Chuenchart, W., Surendra, K. C., & Khanal, S. K. (2024) · ACS ES&T Engineering · doi:10.1021/acsestengg.3c00598 · Cited by 40
Sun, W., Zhang, Y., Guo, R., Sha, S., Chen, C., Ullah, H., Zhang, Y., Ma, J., You, W., Meng, J., et al. (2024) · npj Biofilms and Microbiomes · doi:10.1038/s41522-024-00567-9 · Cited by 51
From living systematic reviews to meta-analytical research domains
Cuijpers, P. J., Miguel, C., Papola, D., Harrer, M., & Karyotaki, E. (2022) · Evidence-Based Mental Health · doi:10.1136/ebmental-2022-300509 · Cited by 40
Greater evolutionary divergence of thermal limits within marine than terrestrial species
Sasaki, M., Barley, J. M., Gignoux‐Wolfsohn, S., Hays, C. G., Kelly, M. W., Putnam, A. B., Sheth, S. N., Villeneuve, A. R., & Cheng, B. S. (2022) · Nature Climate Change · doi:10.1038/s41558-022-01534-y · Cited by 48
Quality assessment of meta-analyses on soil organic carbon
Fohrafellner, J., Zechmeister‐Boltenstern, S., Murugan, R., & Valkama, E. (2023) · SOIL · doi:10.5194/soil-9-117-2023 · Cited by 52
The faunal Ponto-Caspianization of central and western European waterways
Soto, I., Cuthbert, R. N., Ricciardi, A. P., Ahmed, D. A., Altermatt, F., Archambaud‐Suard, G., Bonada, N., Cañedo‐Argüelles, M., Csabai, Z., Datry, T., et al. (2023) · Biological Invasions · doi:10.1007/s10530-023-03060-0 · Cited by 46
Childhood trauma and schizotypy in non-clinical samples: A systematic review and meta-analysis
Toutountzidis, D., Gale, T. M., Irvine, K., Sharma, S., & Laws, K. R. (2022) · PLoS ONE · doi:10.1371/journal.pone.0270494 · Cited by 48
Faridah, D. N., Silitonga, R. F., Indrasti, D., Afandi, F. A., Jayanegara, A., & Anugerah, M. P. (2022) · Frontiers in Nutrition · doi:10.3389/fnut.2022.904700 · Cited by 53
“The purpose of effect sizes is to put the results of a large number of research on the same scale by employing a number of metrics such as oddity and risk ratios, standardized mean differences, transformed correlation coefficients and logarithmic response ratios (17, 18).”
BackgroundEffect of potassium fertilizer on tea yield and quality: A meta-analysis
Xi, S., Chu, H., Zhou, Z., Li, T., Zhang, S., Xu, X., Pu, Y., Wang, G., Jia, Y., & Liu, X. (2023) · European Journal of Agronomy · doi:10.1016/j.eja.2023.126767 · Cited by 40
Free amino acids in response to salinity changes in fishes: relationships to osmoregulation
Huang, M. H., Gao, Q., Yang, X., Jiang, W., Hao, L., Yu, Y., & Tian, Y. (2023) · Fish Physiology and Biochemistry · doi:10.1007/s10695-023-01244-y · Cited by 36
“As known, meta-analyses are useful for establishing the evidence-based practices and solving seemingly contradictory research results (Gurevitch et al. 2018).”
BackgroundThe fitness consequences of wildlife conservation translocations: a meta‐analysis
Gross, I. P., Wilson, A. E., & Wolak, M. E. (2023) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.13025 · Cited by 45
“Meta-analysis is a quantitative tool that integrates the fi ndings of published papers to examine broader patterns and draw more powerful conclusions about a focal topic (Glass, 1976; Stewart, 2010; Gurevitch et al ., 2018).”
MethodYang, Y., Liu, Q., Pan, C., Chen, J., Xu, B., Liu, K., Pan, J., Lagisz, M., & Nakagawa, S. (2024) · Ecology Letters · doi:10.1111/ele.14387 · Cited by 45
“Evidence syntheses using meta-analytic techniques increase the sample size and reduce the effects of individual study bias, allowing for a more robust and quantitative understanding of the effects of ALAN (Gurevitch et al., 2018).”
Self-citationFire-driven disruptions of global soil biochemical relationships
Zhou, G., Eisenhauer, N., Du, Z., Lucas‐Borja, M. E., Zhai, K., Berdugo, M., Duan, H., Wu, H., Liu, S., Revillini, D., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-56598-z · Cited by 46
“To analyze the direction and magnitude of the changes in soil bio-geochemistry under fi re disturbance, a meta ‐ analysis was conducted, which is a quantitative, scienti fi c synthesis tool to provide reliable, broad scale conclusions 48 .”
Neto, A. R. D. C., Ambrósio, A. D. S., Wolowski, M., Westin, T. B., Govêa, K. P., Carvalho, M., & Barbosa, S. (2020) · CERNE · doi:10.1590/01047760202026022711 · Cited by 36
Baier, C., Modersohn, A., Jalowy, F., Glaser, B., & Groß, A. (2022) · Scientific Reports · doi:10.1038/s41598-022-22937-z · Cited by 41
Gusenbauer, M. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1520 · Cited by 43
Wang, H., Li, J., Chen, H., Liu, H., & Nie, M. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.150197 · Cited by 34
Nitrogen availability determines ecosystem productivity in response to climate warming
Liu, Y., Men, M., Peng, Z., Houx, J. H., & Peng, Y. (2022) · Ecology · doi:10.1002/ecy.3823 · Cited by 38
Wilson, L. A. B., Zajitschek, S. R. K., Lagisz, M., Mason, J., Haselimashhadi, H., & Nakagawa, S. (2022) · Nature Communications · doi:10.1038/s41467-022-35266-6 · Cited by 38
“Wewereawarethatourclassi fi cationapproachusing p valuesisakinto vote counting, which has limitations 103 .”
Self-citationWang, N., Yang, J., Han, W., Han, M., Liu, X., Jiang, L., Cao, H., Jing, M., Sun, T., & Xu, J. (2022) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2022.1029905 · Cited by 38
“Meta-analysis serves as a useful research tool owing to its informative and unbiased nature, which helps reduce the effect of biological and technological differences across multiple studies and provide stabilized and accurate results (Gurevitch et al., 2018).”
BackgroundThe psychology of mountaineering: a systematic review
Jackman, P. C., Hawkins, R. M., Burke, S. M., Swann, C., & Crust, L. (2020) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2020.1824242 · Cited by 38
“Finally, given that systematic reviews are valuable for identifying research gaps and aid future research planning (Gurevitch et al., 2018), a systematic review could highlight directions for further research in this area.”
BackgroundCumulative meta‐analysis: What works
Kulinskaya, E., & Mah, E. Y. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1522 · Cited by 35
“If the evidence changes over time, the conclusions of meta-analysis will strongly depend on when the review was conducted, and any policy-relevant recommendations derived from it will quickly go out of date.(1,2) Numerous studies have shown that substantial changes over time in the magnitude, the statistical significa…”
BackgroundMethodA meta-analysis of entrepreneurial ecosystem elements and entrepreneurial activity
Queissner, M., Stolz, L., & Weiß, M. (2024) · Small Business Economics · doi:10.1007/s11187-024-00953-9 · Cited by 63
“…can help take stock of the existing evidence (e.g., to look at the “true” effect of an independent variable on a dependent variable), identify sources of variation and heterogeneity among studies, and assess the quality and reliability of the findings (Gurevitch et al., 2018; Schwab, 2015).”
InfluentialIslam, T., & Cheng, H. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.176163 · Cited by 34
Usability evaluation for geographic information systems: a systematic literature review
Unrau, R., & Kray, C. (2018) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2018.1554813 · Cited by 34
“Although our approach is not a meta-analysis in the strictest sense (Gurevitch et al .”
MethodSynthesis of evidence from zero‐events studies: A comparison of one‐stage framework methods
Xu, C., Furuya‐Kanamori, L., & Lin, L. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1521 · Cited by 33
“, inverse variance).(36,37) For the “one-stage” methods, there is no need to obtain the study-specific effect sizes; instead, each study is treated as a stratum or cluster, and the overall effect size is directly obtained by either a generalized linear model or population-averaged method.”
MethodYunitasari, F., Jayanegara, A., & Ulupi, N. (2022) · Food Science of Animal Resources · doi:10.5851/kosfa.2022.e76 · Cited by 44
Genetic parameters for resistance to gastrointestinal nematodes in sheep: a meta-analysis
Hayward, A. D. (2022) · International Journal for Parasitology · doi:10.1016/j.ijpara.2022.09.004 · Cited by 35
Systematic reviews as a metaknowledge tool: caveats and a review of available options
Avenali, A., Daraio, C. C., Leo, S. D., Matteucci, G., & Nepomuceno, T. C. C. (2023) · International Transactions in Operational Research · doi:10.1111/itor.13309 · Cited by 44
Elliott‐Graves, A. (2023) · Cambridge University Press eBooks · doi:10.1017/9781108900010 · Cited by 36
Stable isotopes infer the value of Australia’s coastal vegetated ecosystems from fisheries
Jänes, H., Macreadie, P. I., Nicholson, E., Ierodiaconou, D. A., Reeves, S. E., Taylor, M. D., & Carnell, P. E. (2019) · Fish and Fisheries · doi:10.1111/faf.12416 · Cited by 36
Implications of the open science era for educational psychology research syntheses
Patall, E. A. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1897009 · Cited by 38
Bregaglio, S., Mongiano, G., Ferrara, R. M., Ginaldi, F., Lagomarsino, A., & Rana, G. (2022) · International Soil and Water Conservation Research · doi:10.1016/j.iswcr.2022.05.003 · Cited by 37
Zhang, Q., Qin, W., Cao, W., Jiao, J., Yin, Z., & Xu, H. (2022) · International Soil and Water Conservation Research · doi:10.1016/j.iswcr.2022.10.005 · Cited by 33
A family of experiments on test-driven development
Santos, A., Vegas, S., Dieste, O., Uyaguari, F., Tosun, A., Fucci, D., Turhan, B., Scanniello, G., Romano, S., Karac, I., et al. (2021) · Empirical Software Engineering · doi:10.1007/s10664-020-09895-8 · Cited by 30
Exogenous nitric oxide promotes salinity tolerance in plants: A meta-analysis
Tahjib‐Ul‐Arif, M., Wei, X., Jahan, I., Hasanuzzaman, M., Sabuj, Z. H., Zulfiqar, F., Chen, J., Iqbal, R., Dastogeer, K. M. G., Sohag, A. A. M., et al. (2022) · Frontiers in Plant Science · doi:10.3389/fpls.2022.957735 · Cited by 36
“, plant ecology and evolutionary biology, and has become more prevalent in recent years (Lau et al., 2013; Koricheva and Gurevitch, 2014; Gerstner et al., 2017; Gurevitch et al., 2018).”
BackgroundTadiello, T., Acutis, M., Perego, A., Schillaci, C., & Valkama, E. (2022) · European Journal of Soil Science · doi:10.1111/ejss.13338 · Cited by 39
“Since two experimental groups have been compared, the response ratio (r) was computed for the response variables as an index of the effect size (Gurevitch et al., 2018): r1⁄4XCA=XC ð1Þ”
MethodA Guide for Accounting Researchers to Conduct and Report Systematic Literature Reviews
Hardies, K., Ohlrogge, F., Mentens, J., & Vandennieuwenhuysen, J. (2023) · Behavioral Research in Accounting · doi:10.2308/bria-2022-042 · Cited by 57
Liu, X., Ma, Q., Yu, H., Li, Y., Zhou, L., He, Q., Xu, Z., & Zhou, G. (2020) · Planta · doi:10.1007/s00425-020-03495-y · Cited by 37
Evidence map: topics, trends, and policy in the energy transitions literature
Lu, J., & Nemet, G. F. (2020) · Environmental Research Letters · doi:10.1088/1748-9326/abc195 · Cited by 37
The economic and ecological benefits of saving ecosystems to protect services
Campos, F. S., David, J., Lourenço‐de‐Moraes, R., Rodrigues, P., da Silva, B. H. F., da Silva, C. V., & Cabral, P. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2021.127551 · Cited by 36
Decline effects are rare in ecology
Costello, L., & Fox, J. W. (2022) · Ecology · doi:10.1002/ecy.3680 · Cited by 34
Conservation interventions can benefit species impacted by climate change
Bowgen, K. M., Kettel, E. F., Butchart, S. H. M., Carr, J., Foden, W., Magin, G., Morecroft, M. D., Smith, R. K., Stein, B. A., Sutherland, W. J., et al. (2022) · Biological Conservation · doi:10.1016/j.biocon.2022.109524 · Cited by 42
Queiroz, A. C. M., Marques, T., Ribas, C. R., Cornelissen, T., Nogueira, A., Schmidt, F. A., Feitosa, R. M., Sobrinho, T. G., Quinet, Y., Baccaro, F. B., et al. (2022) · Biotropica · doi:10.1111/btp.13158 · Cited by 32
“Effect sizes describe the magnitude of the ecological effects (Gurevitch et al., 2018).”
BackgroundUnveiling the environmental drivers of intraspecific body size variation in terrestrial vertebrates
Henry, E., Santini, L., Huijbregts, M. A. J., & Benítez‐López, A. (2022) · Global Ecology and Biogeography · doi:10.1111/geb.13621 · Cited by 36
“…is expected to be more robust than previous studies that used vote-counting approaches (Ashton, 2002; Meiri & Dayan, 2003; Meiri et al., 2004), as vote-counting tends to overweight the effect of species (or studies) with small sample sizes, ignoring statistical uncertainty (Gurevitch et al., 2018).”
ResultNicholson, B., Dinsdale, A., Jones, B. L., & Till, K. (2021) · Sports Medicine · doi:10.1007/s40279-021-01552-4 · Cited by 40
“0 software (Biostat, Englewood, NJ, USA) to assess the magnitude of change in the outcomes across the relevant primary studies and to explore the effect of moderator variables on the variation among study outcomes [57].”
Elliott, T., Thompson, A., Klein, A., Albert, C., Eisenhauer, N., Jansen, F., Schneider, A. K., Sommer, M., Straka, T. M., Settele, J., et al. (2023) · Conservation Science and Practice · doi:10.1111/csp2.13008 · Cited by 39
Zhang, Q., Yang, Y., Liu, B., Lu, L., Sauquet, H., Li, D.-Z., & Chen, Z. (2024) · New Phytologist · doi:10.1111/nph.19524 · Cited by 31
“Large datasets, including numerous lineages, are considered necessary for a more detailed description of temporal patterns of biome biodiversity and may help us solve conflicts concerning the temporal evolution of EAEBLF biodiversity (Gurevitch et al ., 2018).”
Jiang, Z., Wu, Y., Miao, Y., Deng, K., Yang, F., Xu, S. J., Wang, Y., You, R., Zhang, L., Fan, Y., et al. (2024) · Genomics Proteomics & Bioinformatics · doi:10.1093/gpbjnl/qzae011 · Cited by 40
Technology effectiveness in the mathematics classroom: a systematic review of meta-analytic research
Young, J., Gorumek, F., & Hamilton, C. (2018) · Journal of Computers in Education · doi:10.1007/s40692-018-0104-2 · Cited by 38
“…across a multitude of disciplines and contexts (Chang et al. 2018; Fu and Hwang 2018; Wang et al. 2017), however few studies have systematically reviewed prior meta-analyses to synthesize the results across first-order meta-analysis (Young et al. 2018; Gurevitch et al. 2018; Tamim et al. 2011).”
BackgroundCheng, L. J., Kumar, P. A., Wong, S. N., & Lau, Y. (2019) · AIDS and Behavior · doi:10.1007/s10461-019-02691-6 · Cited by 30
Oijen, M. A. V., Barcza, Z., Confalonieri, R., Korhonen, P., Kröel‐Dulay, G., Lellei‐Kovács, E., Louarn, G., Louault, F., Martin, R., Moulin, T., et al. (2020) · Agronomy · doi:10.3390/agronomy10020259 · Cited by 39
“A Bayesian hierarchical approach to meta-analysis could be used to account for the interactions [141], which would prepare the data for use in model development.”
MethodLi, L., Liu, H., Xie, S.-Q., Zhang, P., & Yang, Z. (2022) · Aquaculture · doi:10.1016/j.aquaculture.2022.737896 · Cited by 38
Silva, A. R., Padilha, M. I., Petry, S., Silva, V. S. E., Woo, K., Galica, J., Wilson, R., & Luctkar‐Flude, M. (2022) · Advances in Nursing Science · doi:10.1097/ans.0000000000000418 · Cited by 42
A meta-analytical review of intervention experiments to reduce food waste
Tian, X., Xia, Z., Xie, J., Zhang, C., Liu, Y., & Xu, M. (2022) · Environmental Research Letters · doi:10.1088/1748-9326/ac72b6 · Cited by 44
A multidimensional framework to quantify the effects of urbanization on avian breeding fitness
Chen, S., Liu, Y., Patrick, S. C., Goodale, E. B., Safran, R. J., & Pagani‐Núñez, E. (2023) · Ecology and Evolution · doi:10.1002/ece3.10259 · Cited by 37
“We used a systematic review approach instead of a meta- analysis because we found that there was little data available for some factors like UHI, noise pollution, and ALAN, and their interactions (Gurevitch et al., 2018).”
MethodMéndez, G. M., & Velázquez, F. D. C. (2024) · Applied Sciences · doi:10.3390/app14114564 · Cited by 46
A typology of systematic reviews for synthesising evidence on health care
MacEntee, M. I. (2019) · Gerodontology · doi:10.1111/ger.12439 · Cited by 32
Reliability of evidence‐review methods in restoration ecology
Romanelli, J. P., Meli, P., Naves, R. P., Alves, M. C., & Rodrigues, R. R. (2020) · Conservation Biology · doi:10.1111/cobi.13661 · Cited by 31
“…review terminology in restoration ecology, given that several studies (e.g., Côté & Reynolds 2012; Vetter et al. 2013; Koricheva & Gurevitch 2014; Gurevitch et al. 2018; Reid et al. 2018; Grames & Elphick 2020) have reported inconsistencies related to methods and usage of review terminology in…”
BackgroundMethodInfluentialXu, C., Furuya‐Kanamori, L., Kwong, J. S. W., Li, S., Liu, Y., & Doi, S. A. R. (2021) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2021.101434 · Cited by 30
“Systematic review and meta-analysis (SRMA) serves as an important source of evidence to support decision-making [2].”
Rietra, R. P. J. J., Heinen, M., & Oenema, O. (2022) · Land · doi:10.3390/land11020255 · Cited by 35
Lin, L., & Chu, H. (2022) · PLoS ONE · doi:10.1371/journal.pone.0268754 · Cited by 36
“Publications of MAs have been rapidly increasing in the past few decades, because they offer a powerful tool for synthesizing and contrasting existing findings and producing more precise effect estimates [34, 35].”
MethodShi, Y., Wang, S., Guo, J., Xu, Z., Wang, S., & Sang, Y. (2022) · Chemosphere · doi:10.1016/j.chemosphere.2022.136033 · Cited by 30
Mathew, A., Isbanner, S., Xi, Y., Rundle-Thiele, S. R., David, P., Li, G., & Lee, D. (2023) · Journal of Environmental Management · doi:10.1016/j.jenvman.2023.117582 · Cited by 36
Hung, C., Hager, M. A., & Tian, Y. (2022) · Nonprofit and Voluntary Sector Quarterly · doi:10.1177/08997640221138260 · Cited by 29
“Meta-analyses that consider a broad or holistic concept (such as “performance”) might include hundreds of studies (Gurevitch et al., 2018), while meta-analyses that focus on specific relationships between variables (such as government grants and donations) are somewhat smaller, limited to those…”
BackgroundTürk, S., Korfmacher, A.-K., Gerger, H., der Oord, S. V., & Christiansen, H. (2023) · Clinical Psychology Review · doi:10.1016/j.cpr.2023.102271 · Cited by 37
Large language models reveal big disparities in current wildfire research
Lin, Z., Chen, A., Wang, X., Liu, Z., & Piao, S. L. (2024) · Communications Earth & Environment · doi:10.1038/s43247-024-01341-7 · Cited by 37
“Traditional expert-based methods, such as literature reviews and meta-analyses 1 – 3 , are often constrained to a limited number of publications, typically a few hundred.”
The effect of biochar types on carbon cycles in farmland soils: A meta analysis
Meng, X., Zheng, E., Hou, D., Qin, M., Meng, F., Chen, P., & Qi, Z. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.172623 · Cited by 31
Abbasi, E. (2025) · Environmental Toxicology and Chemistry · doi:10.1093/etojnl/vgaf209 · Cited by 33
Eshetu, S., Molla, E., & Feleke, T. G. (2025) · Climate Resilience and Sustainability · doi:10.1002/cli2.70018 · Cited by 56
Rarity of Size-Assortative Mating in Animals: Assessing the Evidence with Anuran Amphibians
Green, D. M. (2018) · The American Naturalist · doi:10.1086/701124 · Cited by 30
“Meta-analysis is now firmly established as a powerful statistical tool for analyzing the scientific literature, both to generalize results among comparable studies and to recognize sources of reporting and analytical bias (Lipsey and Wilson 2001; Borenstein et al. 2009; Gurevitch et al. 2018).”
BackgroundMethodMeta-analytic evidence for the anti-aging effect of hormesis on Caenorhabditis elegans
Sun, T., Wu, H., Cong, M., Zhan, J., & Li, F. (2020) · Aging · doi:10.18632/aging.102773 · Cited by 30
Assessing the risk of bias in choice of search sources for environmental meta‐analyses
Konno, K., & Pullin, A. S. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1433 · Cited by 34
“The contributions of meta-analysis are not limited to enabling quantitative assessment of effect of interest and its variation, but also represent a cultural change in the use of scientific evidence, as well as raising the standard of reporting, and therefore meta-analysis is recognized as an essential contributor to…”
BackgroundVasquez, M. J. R., Benoist, A., Roda, J., & Fortin, M. (2020) · Global Biogeochemical Cycles · doi:10.1029/2019gb006218 · Cited by 33
“This approach has been widely used in many fields of study (Cooper et al., 2019; Gurevitch et al., 2018) and allows for more accurate parameter estimates.”
MethodThe validity of situation awareness for performance: a meta-analysis
Bakdash, J. Z., Marusich, L. R., Cox, K. R., Geuss, M. N., Zaroukian, E. G., & Morris, K. (2021) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2021.1921310 · Cited by 31
The effectiveness of using targeted grazing for vegetation management: a meta‐analysis
Marchetto, K. M., Wolf, T. M., & Larkin, D. J. (2021) · Restoration Ecology · doi:10.1111/rec.13422 · Cited by 35
“This is advantageous for cases where it is not possible to extract estimates of variance for each July 2021 Restoration Ecology 3 of 12 observation in a meta-analysis (Larkin et al. 2019), which complicates separation of within- and between-study variation (Gurevitch et al. 2018).”
BackgroundChallenges of evidence synthesis during the 2020 COVID pandemic: a scoping review
Khalil, H., Lotfi, T., Gabriel Rada, G., & Akl, E. A. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.10.017 · Cited by 32
Lunny, C., Reid, E. K., Neelakant, T., Chen, A., Zhang, J. H., Shinger, G., Stevens, A., Tasnim, S., Sadeghipouya, S., Adams, S., et al. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1542 · Cited by 31
“Overviews with narrowly focused questions can be completed more quickly as compared with broad questions, but may have limited generalizability to different populations and settings.(18) Research is needed to establish if and how overviews overlap in content.”
BackgroundSaqr, M., Jovanović, J., Viberg, O., & Gašević, D. (2022) · Studies in Higher Education · doi:10.1080/03075079.2022.2061450 · Cited by 41
“…of e ff ect size allow for better theory testing, motivates decomposition of the e ff ects to investigate alternative explanations; furthermore, the estimation of heterogeneity can suggest the presence of moderators that were unaccounted for (Gurevitch et al. 2018; McShane and Böckenholt 2017).”
BackgroundMethodInfluentialSystematic Reviews in Health Research
Egger, M., Higgins, J. P. T., & Smith, G. D. (2022) · Wiley eBooks · doi:10.1002/9781119099369.ch1 · Cited by 43
Critical Appraisal of a Systematic Review: A Concise Review
Patel, J. J., Hill, A., Lee, Z., Heyland, D. K., & Stoppe, C. (2022) · Critical Care Medicine · doi:10.1097/ccm.0000000000005602 · Cited by 53
“Iain Chalmers (7) was instrumental in asking “how can we summarize the evidence” and along with Archie Cochrane, advocated systematically reviewing, aggregating, and analyzing existing evidence, and launched the Cochrane collaboration.”
BackgroundMethodSex, age and cyber-victimization: A meta-analysis.
Lozano-Blasco, R., Quílez-Robres, A., & Cosculluela, C. L. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107491 · Cited by 40
Prediction of Grassland Biodiversity Using Measures of Spectral Variance: A Meta-Analytical Review
Thornley, R., Gerard, F., White, K. H., & Verhoef, A. (2023) · Remote Sensing · doi:10.3390/rs15030668 · Cited by 36
orchaRd 2.0: An R package for visualizing meta-analyses with orchard plotsPreprint
Nakagawa, S., Lagisz, M., O’Dea, R. E., Pottier, P., Rutkowska, J., Senior, A. M., Yang, Y., & Noble, D. W. A. (2023) · doi:10.32942/x2qc7k · Cited by 29
Self-citationCopper slag in cementitious composites: A systematic review
Casagrande, C. A., Roque, J. S., Jochem, L. F., Corrêa, J. N., & Medeiros, A. (2023) · Journal of Building Engineering · doi:10.1016/j.jobe.2023.107725 · Cited by 38
Jing, Y., & Lin, L. (2024) · JBI Evidence Synthesis · doi:10.11124/jbies-23-00368 · Cited by 38
Effect of high temperature on maize yield and grain components: A meta-analysis
Niu, S., Yu, L., Li, J., Qu, L., Wang, Z., Li, G., Guo, J. P., & Lu, D. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.175898 · Cited by 28
Ecosystem type shapes trophic position and omnivory in fishes
Sánchez‐Hernández, J., & Amundsen, P. (2018) · Fish and Fisheries · doi:10.1111/faf.12308 · Cited by 31
Meta-Analysis of Present-Bias Estimation Using Convex Time Budgets
Imai, T., Rutter, T., & Camerer, C. F. (2019) · Open access LMU (Ludwid Maxmilian's Universitat Munchen) · doi:10.5282/ubm/epub.69188 · Cited by 30
Limited Usefulness of Meta-Analysis for Informing Patient Care
Concato, J., & Horwitz, R. I. (2019) · Psychotherapy and Psychosomatics · doi:10.1159/000502530 · Cited by 28
Modeling Landscape Use for Ungulates: Forgotten Tenets of Ecology, Management, and Inference
Wisdom, M. J., Nielson, R. M., Rowland, M. M., & Proffitt, K. M. (2020) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2020.00211 · Cited by 31
“However, it is not always clear how well landscape-use models can be developed opportunistically a posteriori, with data from multiple replicate areas, as a form of spatially explicit metaanalysis (Gurevitch et al., 2018).”
BackgroundInfluentialYoung, M. D., Ros, G. H., & VRIES, W. D. (2020) · European Journal of Soil Science · doi:10.1111/ejss.13024 · Cited by 32
Biological invasions alter environmental microbiomes: A meta-analysis
Malacrinò, A., Sadowski, V. A., Martin, T. K., de Oliveira, N. C., Brackett, I. J., Feller, J. D., Harris, K. J., Cómbita-Heredia, O., Vescio, R., & Bennett, A. E. (2020) · PLoS ONE · doi:10.1371/journal.pone.0240996 · Cited by 31
Meta-analytic evidence for quantitative honesty in aposematic signals
White, T. E., & Umbers, K. D. L. (2021) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2021.0679 · Cited by 29
Jia, C., & Hew, K. F. (2021) · Educational Research Review · doi:10.1016/j.edurev.2021.100392 · Cited by 54
An assessment of statistical methods for nonindependent data in ecological meta‐analyses: Comment
Nakagawa, S., Senior, A. M., Viechtbauer, W., & Noble, D. W. A. (2021) · Ecology · doi:10.1002/ecy.3490 · Cited by 24
“In many cases, meta-regression models are likely to be more useful and informative in ecology than simple meta-analytic models (Gurevitch et al. 2018).”
BackgroundSelf-citationEX-TRACT: An excel tool for the estimation of standard deviations from published articles
Acutis, M., Tadiello, T., Perego, A., Guardo, A. D., Schillaci, C., & Valkama, E. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2021.105236 · Cited by 31
Metadata
- Authors
- Gurevitch, J., Koricheva, J., Nakagawa, S., & Stewart, G.
- Affiliations
- Stony Brook University (US)
- Royal Holloway University of London (GB)
- Garvan Institute of Medical Research (AU)
- Newcastle University (GB)
- Corresponding author
- Gurevitch, Jessica
- Koricheva, Julia
- Nakagawa, Shinichi
- Stewart, Gavin
- Venue
- Nature
- Published
- 2018-03
- Volume
- 555
- Issue
- 7695
- Pages
- 175-182
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2791681873
- Semantic Scholar
- ac5ad1932e31c3ea141366e8e073d6d95869c4ef
- Cited by
- 1,709
- References
- 101
- Citations by year
- 2026: 177 · 2025: 230 · 2024: 231 · 2023: 199 · 2022: 234 · 2021: 235 · 2020: 204 · 2019: 130 · 2018: 64
- FWCI
- 31.20
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- UNSWorks (UNSW Sydney) (submittedVersion, cc-by-nc-nd)
- RePEc: Research Papers in Economics (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- National Science Foundation (1262402)
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- meta-analysis, evidence synthesis, history of meta-analysis, evolutionary biology, conservation biology, artificial intelligence, evidence-based practice
- MeSH terms
- Animals, Biological Science Disciplines, Ecology, Biological Evolution, Research, Meta-Analysis as Topic, History, 20th Century, History, 21st Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.