Language bias in randomised controlled trials published in English and German
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
Background Some randomised controlled trials (RCTs) done in German-speaking Europe are published in international English-language journals and others in national German-language journals. We assessed whether authors are more likely to report trials with statistically significant results in English than in German. Methods We studied pairs of RCT reports, matched for first author and time of publication, with one report published in German and the other in English. Pairs were identified from reports round in a manual search of five leading German-language journals and from reports published by the same authors in English found on Medline. Quality of methods and reporting were assessed with two different scales by two investigators who were unaware of authors' identities, affiliations, and other characteristics of trial reports. Main study endpoints were selected by two investigators who were unaware of trial results. Our main outcome was the number of pairs of studies in which the levels of significance (shown by p values) were discordant. Findings 62 eligible pairs of reports were identified but 19 (31%) were excluded because they were duplicate publications. A further three pairs (5%) were excluded because no p values were given. The remaining 40 pairs were analysed. Design characteristics and quality features were similar for reports in both languages. Only 35% of German-language articles, compared with 62% of English-language articles, reported significant (p Interpretatio…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One of the most important ways they achieve this reduction in bias is by searching beyond literature databases, which are skewed towards English-language publications with positive results [63, 64].”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [64]
In the citing paper
“One of the most important ways they achieve this reduction in bias is by searching beyond literature databases, which are skewed towards English-language publications with positive results [63, 64].”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [64]
In the citing paper
“It is important for transparency and reproducibility that any database limits applied when running the search are reported accurately, as their use has high potential for introducing bias into a search [1, 64, 100, 101].”
From PRISMA-S: an extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews (2021) · cites this paper as [64]
In the citing paper
“It was previously reported that negative trials are published more often in the native authors' language [19].”
From Citation indexes do not reflect methodological quality in lung cancer randomised trials. (2003) · cites this paper as [19]
In the citing paper
“positive outcomes are more likely to be published in English-language journals (Egger, Zellweger-Zähner et al., 1997), which could lead to selection bias in systematic reviews and meta-analyses.”
From The effects of physical activity on cortisol and sleep: A systematic review and meta-analysis. (2022) · cites this paper as Egger, Zellweger-Zähner et al., 1997
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Systematic Reviews: Rationale for systematic reviews
Mulrow, C. D. (1994) · BMJ · doi:10.1136/bmj.309.6954.597 · Cited by 1,677
meta-analysis bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374
Self-citationMoher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Publication bias and clinical trials
Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90155-3 · Cited by 715
Clinical trials of homoeopathy.
Kleijnen, J., Knipschild, P., & ter Riet, G. (1991) · BMJ · doi:10.1136/bmj.302.6772.316 · Cited by 604
Mh, L. T. (1996) · Cited by 599
Moher, D., Fortin, P., Jadad, A. R., Jüni, P., Klassen, T., Le Lorier, J., Liberati, A., Penna, A., & Linde, K. (1996) · The Lancet · doi:10.1016/s0140-6736(96)90538-3 · Cited by 537
Grégoire, G., Derderian, F., & Le Lorier, J. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00098-b · Cited by 526
Kleijnen, J., & Knipschild, P. (1992) · The Lancet · doi:10.1016/0140-6736(92)93158-j · Cited by 461
Getting to grips with Archie Cochrane's agenda.
Chalmers, I., Dickersin, K., & Chalmers, T. C. (1992) · BMJ · doi:10.1136/bmj.305.6857.786 · Cited by 375
Reference bias in reports of drug trials.
Gotzsche, P. C. (1987) · BMJ · doi:10.1136/bmj.295.6599.654 · Cited by 222
Confronting publication bias: A cohort design for meta‐analysis
Simes, R. J. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060104 · Cited by 216
A Cohort Study of Summary Reports of Controlled Trials
Chalmers, L. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100117017 · Cited by 202
Redundancy, disaggregation, and the integrity of medical research
Huston, P., & Moher, D. (1996) · The Lancet · doi:10.1016/s0140-6736(96)90153-1 · Cited by 194
Evidence-based medicine, in its place
(1995) · The Lancet · doi:10.1016/s0140-6736(95)91610-5 · Cited by 145
Uniform Requirements for Manuscripts Submitted to Biomedical Journals
International Committee of Medical Journal Editors (1991) · New England Journal of Medicine · doi:10.1056/nejm199102073240624 · Cited by 92
Kleijnen, J., & Knipschild, P. (1992) · Pharmaceutisch Weekblad Scientific Edition · doi:10.1007/bf01977620 · Cited by 89
Garfield, E. (1982) · Medical Entomology and Zoology · Cited by 74
Ärzte, G. D. N. U. (1992) · Springer eBooks · Cited by 60
(1992) · The Lancet · doi:10.1016/0140-6736(92)93154-f · Cited by 39
Bayerdörffer, E., Kasper, G., Pirlet, T., Sommer, A., & Ottenjann, R. (2008) · DMW - Deutsche Medizinische Wochenschrift · doi:10.1055/s-2008-1068260 · Cited by 38
Kleijnen, J., & Knipschild, P. G. (1992) · Cited by 31
Randomised trials in German-language journals
Egger, M., Zellweger-Zähner, T., & Antes, G. (1996) · The Lancet · doi:10.1016/s0140-6736(96)90188-9 · Cited by 17
Self-citationGastel, B., & Weng, Y. (1990) · Annals of Internal Medicine · doi:10.7326/0003-4819-112-1-70 · Cited by 10
The Journal of Molecular Medicine: tradition, continuity, and renaissance
Ganten, D. (1995) · Journal of Molecular Medicine · doi:10.1007/bf00203612 · Cited by 6
Lemmel, E. ‐., Bach, G. L., Bolten, W. W., Brackertz, D., Fahrny, Z., Mattern, H., Stroehmann, I., & Wittenborg, A. (2008) · DMW - Deutsche Medizinische Wochenschrift · doi:10.1055/s-2008-1067614 · Cited by 6
Flamm, J., & Fischer, M. (1988) · PubMed · Cited by 6
Z�llner, N. (1992) · Journal of Molecular Medicine · doi:10.1007/bf00422929 · Cited by 3
Research works printed but not linked: 3
- Anon, 1984, Manuscript guideline, Diabetologia, 25, 4A
- Jurincic-Winkler, 1994, Adjuvante Immuntherapie mit Keyhole Limpet Hemocyanin (KLH) beim Nierenzellkarzinom der Kategorie PT2 N+ und PT3-4, No-N+, Mo, Wien Klin Wochenschr, 14, 455
- Flamm, 1988, Komplette Androgenblockade (Orchiektomie+Flutamid) versus Androgenblockade mit Zytostase (Orchiektomie+Estramustin) in der Behandlung des virginellen fortgeschrittenen Prostatakarzinoms, Wien Klin Wochenschr, 100, 589
Cited by
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Self-citationLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
“Apart from the keywords used to identify or exclude records, they should report any additional limitations relevant to the search, such as language and date restrictions (see also eligibility criteria, Item 6) [51].”
Background
Metadata
- Authors
- Egger, M., Zellweger-Zähner, T., Schneider, M., Junker, C., Lengeler, C., & Antes, G.
- Affiliations
- University of Bristol (GB)
- University of Bern (CH)
- Swiss Tropical and Public Health Institute (CH)
- University of Freiburg (DE)
- Corresponding author
- Egger, Matthias
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 1997-08
- Volume
- 350
- Issue
- 9074
- Pages
- 326-329
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2101299963
- Cited by
- 1,028
- References
- 33
- Citations by year
- 2026: 18 · 2025: 22 · 2024: 33 · 2023: 29 · 2022: 30 · 2021: 38 · 2020: 36 · 2019: 31 · 2018: 34 · 2017: 39 · 2016: 33 · 2015: 48 · 2014: 45 · 2013: 59 · 2012: 29
- FWCI
- 44.85
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- The Lancet (publishedVersion)
- PubMed (publishedVersion)
- FreiDok plus (Universitätsbibliothek Freiburg) (submittedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Funders
- Academy of Medical Sciences
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
- Akademie der Naturwissenschaften
- Schweizerische Akademie der Medizinischen Wissenschaften
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- language bias, English-language journals, German periodicals, randomized controlled trials, publication bias, statistical significance, p-values, trial reporting quality, meta-analysis bias, Cochrane Collaboration, language of publication
- MeSH terms
- Communication Barriers, Germany, Humans, Language, Periodicals as Topic, Publishing, United States, Bias, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.