The demise of the randomised controlled trial: bibliometric study of the German-language health care literature, 1948 to 2004
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
BACKGROUND: In order to reduce systematic errors (such as language bias) and increase the precision of the summary treatment effect estimate, a comprehensive identification of randomised controlled trials (RCT), irrespective of publication language, is crucial in systematic reviews and meta-analyses. We identified trials in the German general health care literature. METHODS: Eight German language general health care journals were searched for randomised controlled trials and analysed with respect to the number of published RCTs each year and the size of trials. RESULTS: A total of 1618 trials were identified with a median total number of 43 patients per trial. Between 1970 and 2004 a small but constant rise in sample size from a median number of 30 to 60 patients per trial can be observed. The number of published trials was very low between 1948 and 1970, but increased between 1970 and 1986 to a maximum of 11.2 RCTs per journal and year. In the following time period a striking decline of the number of RCTs was observed. Between 1999 and 2001 only 0.8 RCTs per journal and year were published, in the next three years, the number of published trials increased to 1.7 RCTs per journal and year. CONCLUSION: German language general health care journals no longer have a role in the dissemination of trial results. The slight rise in the number of published RCTs in the last three years can be explained by a change of publication language from German to English of three of the analysed journals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In general, given the recent trend showing increased rates of publications in English, the language bias may not have as strong effect as before [48].”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [48]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Clinical Trial Registration: A Statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejme048225 · Cited by 1,241
Language bias in randomised controlled trials published in English and German
Egger, M., Zellweger-Zähner, T., Schneider, M., Junker, C., Lengeler, C., & Antes, G. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02419-7 · Cited by 1,028 · cited 1×
“als, a significant trend towards publication of statistically significant results in English-language journals was identified [1].”
Self-citationDirection and impact of language bias in meta-analyses of controlled trials: empirical study
Jüni, P., Holenstein, F., Sterne, J., Bartlett, C., & Egger, M. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.115 · Cited by 892 · cited 1×
“In complementary medicine several meta-analyses resulted in significantly smaller summary result estimates when excluding non-English language trials [2-4].”
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512
What contributions do languages other than English make on the results of meta-analyses?
Moher, D., Pham, Klassen, T. P., Schulz, K. F., Berlin, J. A., Jadad, A. R., & Liberati, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00188-8 · Cited by 453 · cited 1×
“In complementary medicine several meta-analyses resulted in significantly smaller summary result estimates when excluding non-English language trials [2-4].”
Content and quality of 2000 controlled trials in schizophrenia over 50 years
Thornley, B., & Adams, C. (1998) · BMJ · doi:10.1136/bmj.317.7167.1181 · Cited by 364 · cited 2×
“This observation confirms developments in other general health care journals, but is in clear contrast to high impact international general and specialist journals where a constant number of RCTs has been observed over past decades [5-7].”
Pham, B., Klassen, T. P., Lawson, M. L., & Moher, D. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.08.021 · Cited by 206 · cited 1×
“In complementary medicine several meta-analyses resulted in significantly smaller summary result estimates when excluding non-English language trials [2-4].”
Registering clinical trials: an essential role for WHO
Evans, T. W., Gülmezoglu, M., & Pang, T. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16136-9 · Cited by 48 · cited 2×
“In this initiative WHO has taken the lead to establish a standardized, global framework for the prospective registration of clinical trials as e.g. required by the International Committee of Medical Journal Editors (ICMJE) to reduce biases in the reporting and publication process of clinical trials and thus improve th…”
Number and size of randomized trials reported in general health care journals from 1948 to 1997
McDonald, S., Westby, M., Clarke, M., & Lefebvre, C. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.125 · Cited by 24
McDonald, S., Lefebvre, C., Antes, G., Galandi, D., Gøtzsche, P., Hammarquist, C., Haugh, M., Jensen, K. L., Kleijnen, J., Loep, M., et al. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001005 · Cited by 22 · cited 1×
“This observation confirms developments in other general health care journals, but is in clear contrast to high impact international general and specialist journals where a constant number of RCTs has been observed over past decades [5-7].”
Self-citation
Cited by
Chapter 10: Addressing reporting biases
Egger, M., & Moher, D. (2011) · Cited by 997
Arcsine test for publication bias in meta‐analyses with binary outcomes
Rücker, G., Schwarzer, G., & Carpenter, J. (2008) · Statistics in Medicine · doi:10.1002/sim.2971 · Cited by 444
Self-citationNussbaumer-Streit, B., Klerings, I., Dobrescu, A. I., Persad, E., Stevens, A., Garritty, C., Kamel, C., Affengruber, L., King, V. J., & Gartlehner, G. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.10.011 · Cited by 440
Effectiveness of manual therapies: the UK evidence report
Bronfort, G., Haas, M., Evans, R., Leininger, B., & Triano, J. (2010) · Chiropractic & Osteopathy · doi:10.1186/1746-1340-18-3 · Cited by 434
Non-steroidal anti-inflammatory drugs for chronic low back pain
Enthoven, W. T., Roelofs, P. D., Deyo, R. A., van Tulder, M. W., & Koes, B. W. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012087 · Cited by 399
Metadata
- Authors
- Galandi, D., Schwarzer, G., & Antes, G.
- Affiliations
- University Medical Center Freiburg (DE)
- Corresponding author
- Galandi, Daniel
- ORCID
- Schwarzer, Guido
- Venue
- BMC Medical Research Methodology
- Published
- 2006-07-06
- Volume
- 6
- Issue
- 1
- Pages
- 30-30
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC1533847
- OpenAlex
- W1792981497
- Cited by
- 59
- References
- 10
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 1 · 2022: 4 · 2021: 2 · 2020: 7 · 2019: 3 · 2018: 4 · 2017: 3 · 2016: 1 · 2015: 3 · 2013: 4 · 2012: 2
- FWCI
- 4.57
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- randomized controlled trials, trial size, language bias, dissemination of trial results, systematic reviews, meta-analysis
- MeSH terms
- Germany, Humans, Language, Periodicals as Topic, Publishing, Bibliometrics, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The demise of the randomised controlled trial: bibliometric study of the German-language health care literature, 1948 to 2004. https://app.cochat.ai/papers/10.1186/1471-2288-6-30
- The paper
- Galandi, D., Schwarzer, G., & Antes, G. (2006). The demise of the randomised controlled trial: bibliometric study of the German-language health care literature, 1948 to 2004. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-6-30
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
