The DOI matches its Crossref record; 106 of the 106 references it cites were found in a registry or an index.
What contributions do languages other than English make on the results of meta-analyses?
Abstract
Including only a portion of all available evidence may introduce systematic errors into the meta-analytic process and threaten its validity. We set out to examine whether language restricted meta-analyses, compared to language inclusive meta-analyses, provide different estimates of the effectiveness of interventions evaluated in randomized trials. We identified and retrieved all 79 meta-analyses from several disease areas in which explicit eligibility criteria regarding trial selection were reported. General characteristics and quality of reporting of the meta-analyses were assessed using a validated instrument. We explored the effects of language of publication of the randomized trials on the quantitative results using logistic regression analyses. Language restricted meta-analyses, compared to language inclusive meta-analyses, did not differ with respect to the estimate of benefit of the effectiveness of an intervention (ROR = 0.98; 95% CI: 0.81-1.17). These results were also robust after a series of sensitivity analyses. This study provides no evidence that language restricted meta-analyses lead to biased estimates of intervention effectiveness. We encourage others to replicate this study using different sampling frames, clinical topics and interventions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Therefore, language-restricted metaanalyses do not appear to lead to biased estimates of intervention effectiveness.112,113”
From Effectiveness of Manual Therapy and Therapeutic Exercise for Temporomandibular Disorders: Systematic Review and Meta-Analysis (2016) · cites this paper as [113]
In the citing paper
“Over the last two decades, empirical evidence has accumulated from studies investigating different sources of bias related to specific SR tasks.”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [30]
In the citing paper
“However, the evidence whether or not the exclusion of non-English language study publications of conventional healthcare interventions introduces bias has been inconsistent, some authors showing meta-analyses of only English language studies yielding more conservative estimates [29], and others not demonstrating the presence of any difference [30, 32, 47].”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [30]
Citations
Cites
2 retracted
Nutritional advice in pregnancy
Kramer, M. S. (1996) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000149 · Cited by 34
RetractedAndrogens versus placebo or no treatment for idiopathic oligo/asthenospermia
Vandekerckhove, P., Lilford, R. J., Vail, A., & Hughes, E. G. (1996) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000150 · Cited by 30
RetractedThe Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
Self-citationSchulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Self-citationMoher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Self-citationThe Design and Analysis of Clinical Experiments
Fleiss, J. L. (1999) · Wiley eBooks · doi:10.1002/9781118032923 · Cited by 4,819
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Self-citationThe Design and Analysis of Clinical Experiments.
Hills, M., & Fleiss, J. L. (1987) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2982050 · Cited by 3,261
Beta blockade during and after myocardial infarction: An overview of the randomized trials
Yusuf, S., Peto, R., Lewis, J., Collins, R., & Sleight, P. (1985) · Progress in Cardiovascular Diseases · doi:10.1016/s0033-0620(85)80003-7 · Cited by 3,205
Research works printed but not linked: 2
- Moher, 1999, Assessing the quality of randomized controlled trials, Health Technology Assessment, 3, 1
- Shea B, Dubé C, Moher D. Assessing the quality of reports of meta-analyses: a systematic review of scales and checklists. In: Egger M, Altman D, Smith GD, editors. Systematic Reviews in Health Care, 2nd edition. London, UK: BMJ Publishing Group, In press.
Cited by
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Self-citationDevelopment of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Self-citation
Metadata
- Authors
- Moher, D., Pham, Klassen, T. P., Schulz, K. F., Berlin, J. A., Jadad, A. R., & Liberati, A.
- Affiliations
- University of Ottawa (CA)
- Children's Hospital of Eastern Ontario (CA)
- University of North Carolina at Chapel Hill (US)
- University of Pennsylvania (US)
- McMaster University (CA)
- Mario Negri Institute for Pharmacological Research (IT)
- Corresponding author
- Moher, David
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2000-09
- Volume
- 53
- Issue
- 9
- Pages
- 964-972
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W1991118253
- Cited by
- 453
- References
- 103
- Citations by year
- 2026: 3 · 2025: 7 · 2024: 6 · 2023: 10 · 2022: 15 · 2021: 32 · 2020: 26 · 2019: 16 · 2018: 16 · 2017: 17 · 2016: 22 · 2015: 42 · 2014: 21 · 2013: 26 · 2012: 20
- FWCI
- 18.45
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Medical Research Council
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- language of publication, eligibility criteria, reporting quality, intervention effectiveness
- MeSH terms
- Humans, Language, Meta-Analysis as Topic, Selection Bias, Logistic Models, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What contributions do languages other than English make on the results of meta-analyses? https://app.cochat.ai/papers/10.1016/s0895-4356(00)00188-8
- The paper
- Moher, D., Pham, Klassen, T. P., Schulz, K. F., Berlin, J. A., Jadad, A. R., & Liberati, A. (2000). What contributions do languages other than English make on the results of meta-analyses? Journal of Clinical Epidemiology. https://doi.org/10.1016/s0895-4356(00)00188-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.