The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Randomized trials published in some Chinese journals: how many are randomized?
Open accessAbstract
BACKGROUND: The approximately 1100 medical journals now active in China are publishing a rapidly increasing number of research reports, including many studies identified by their authors as randomized controlled trials. It has been noticed that these reports mostly present positive results, and their quality and authenticity have consequently been called into question. We investigated the adequacy of randomization of clinical trials published in recent years in China to determine how many of them met acceptable standards for allocating participants to treatment groups. METHODS: The China National Knowledge Infrastructure electronic database was searched for reports of randomized controlled trials on 20 common diseases published from January 1994 to June 2005. From this sample, a subset of trials that appeared to have used randomization methods was selected. Twenty-one investigators trained in the relevant knowledge, communication skills and quality control issues interviewed the original authors of these trials about the participant randomization methods and related quality-control features of their trials. RESULTS: From an initial sample of 37,313 articles identified in the China National Knowledge Infrastructure database, we found 3137 apparent randomized controlled trials. Of these, 1452 were studies of conventional medicine (published in 411 journals) and 1685 were studies of traditional Chinese medicine (published in 352 journals). Interviews with the authors of 2235 of these reports revealed that only 207 studies adhered to accepted methodology for randomization and could on those grounds be deemed authentic randomized controlled trials (6.8%, 95% confidence interval 5.9-7.7). There was no statistically significant difference in the rate of authenticity between randomized controlled trials of traditional interventions and those of conventional interventions. Randomized controlled trials conducted at hospitals affiliated to medical universities were more likely to be authentic than trials conducted at level 3 and level 2 hospitals (relative risk 1.58, 95% confidence interval 1.18-2.13, and relative risk 14.42, 95% confidence interval 9.40-22.10, respectively). The likelihood of authenticity was higher in level 3 hospitals than in level 2 hospitals (relative risk 9.32, 95% confidence interval 5.83-14.89). All randomized controlled trials of pre-market drug clinical trial were authentic by our criteria. Of the trials conducted at university-affiliated hospitals, 56.3% were authentic (95% confidence interval 32.0-81.0). CONCLUSION: Most reports of randomized controlled trials published in some Chinese journals lacked an adequate description of randomization. Similarly, most so called 'randomized controlled trials' were not real randomized controlled trials owing to a lack of adequate understanding on the part of the authors of rigorous clinical trial design. All randomized controlled trials of pre-market drug clinical trial included in this research were authentic. Randomized controlled trials conducted by authors in high level hospitals, especially in hospitals affiliated to medical universities had a higher rate of authenticity. That so many non-randomized controlled trials were published as randomized controlled trials reflected the fact that peer review needs to be improved and a good practice guide for peer review including how to identify the authenticity of the study urgently needs to be developed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Our estimate for the proportion of RCTs at low risk of bias in random allocation is similar to that of the previous study, which examined trials published between 1994 and 2005 and found 6.8% (95% CI: 5.9% to 7.7%) to be such RCTs [9].”
The cited source says what the claim attributes to it.
In the citing paper
“This investigation is the only study to conduct telephone interviews of authors to investigate the quality of RCTs recently published in China since the previous study conducted more than 10 years ago [9].”
The cited source says what the claim attributes to it.
In the citing paper
“The main difference was the refusal rate of 37.0% versus the previous study’s 2.8%.”
In the citing paper
“A survey of authors of 2,235 reports of RCTs published in Chinese medical journals showed that only about 7% met the methodological criteria for authentic randomization; 93% were falsely reported as RCTs (15).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [15]
In the citing paper
“Use of terms such as randomisation without further elaboration in the protocol is not sufficient to describe the allocation process, as these terms have been used inappropriately to describe non-random, deterministic allocation methods such as alternation or allocation by date of birth.322”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [322]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634 · cited 1×
“It has been shown that inadequate randomization approaches result in estimates of treatment effects that are more favorable than those derived from properly randomized trials [2,3].”
BackgroundMoher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545
Self-citationDo Certain Countries Produce Only Positive Results? A Systematic Review of Controlled Trials
Vickers, A., Goyal, N., Harland, R., & Rees, R. (1998) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00150-5 · Cited by 683 · cited 1×
“Background A systematic review has found that some countries, including China, report unusually high proportions of positive results in published randomized controlled trials (RCTs) [1].”
BackgroundSchulz, K. F. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520020051014 · Cited by 512 · cited 1×
“Discussion Unethical incomplete reporting of research methods and process providing a misleading explanation of randomization by referring to a non-randomized study as an RCT is a worldwide problem [6-12].”
BackgroundPeto, R. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060306 · Cited by 409 · cited 1×
“It has been shown that inadequate randomization approaches result in estimates of treatment effects that are more favorable than those derived from properly randomized trials [2,3].”
BackgroundReview of randomised controlled trials of traditional Chinese medicine
Tang, J.-L., Zhan, S.-Y., & Ernst, E. (1999) · BMJ · doi:10.1136/bmj.319.7203.160 · Cited by 249
Reporting standards and research strategies for controlled trials
Mosteller, F., Gilbert, J. P., & McPeek, B. (1980) · Controlled Clinical Trials · doi:10.1016/s0197-2456(80)80006-7 · Cited by 206
Collins, R., Gray, R., Godwin, J., & Peto, R. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060308 · Cited by 178
R2: a useful measure of model performance when predicting a dichotomous outcome
Ash, A. S., & Shwartz, M. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990228)18:4<397::aid-sim24>3.0.co;2-# · Cited by 138
Chalmers, I. (2001) · International Journal of Epidemiology · doi:10.1093/ije/30.5.1156 · Cited by 126 · cited 1×
“Discussion Unethical incomplete reporting of research methods and process providing a misleading explanation of randomization by referring to a non-randomized study as an RCT is a worldwide problem [6-12].”
Background
Research works printed but not linked: 11
- Xu L, Chen J, Wang J, Liao X, Kang D: Discussion for problems of randomisation methods in treatment and preventing trials published in some of Chinese national level journals. Nat J China. 1999, 79: 97-98.
- Li T, Mao B, Chang J, Yang X, Wang L, Zhang Y: An evaluation of clinical research literatures in core journals of traditional Chinese medicine integrated with conventional medicine or traditional Chinese medicine. West China Med J. 2000, 15: 266-269.
- Mao B, Li T, Chang J, Wang G, Yang X, Wang L: Evaluation for diseases variety in clinical trials published in traditional Chinese medicine and integrated TCM and CM key journals. Chinese Journal of Evidence-Based Medicine. 2001, 1: 174-176.
- Wang G, Wang L, L Ti: Methodological evaluation for clinical research literatures for regulating the immune function of GOPD. Chinese Journal of Evidence-Based Medicine. 2001, 1: 95-98.
- Duan X, Zhou L, Wu T, Liu G: Quality analysis of literatures on clinical controlled trial of coronary heart diseases treated with TCM. Chinese Journal of Integrated Traditional Chinese and Conventional Medicine. 2003, 23: 164-167.
- Wang Q, Wu T, Liu G: Quality assessment for articles of the traditional Chinese medicine in the treatment of unstable angina pectoris. Journal of Chengdu University of Traditional Chinese Medicine. 2003, 26: 52-55.
- Ni J, Chen X, Zheng J, Wu T, Liu G: Quality assessment for clinical trials of traditional Chinese medicine in the treatment of acute myocardial infarction published in China. Journal of Guangzhou Traditional Chinese Medicine. 2003, 20: 82-85.
- Wen Z, Lai S, Liang W, Guo X, Wang Q: Advance to improve report quality of traditional Chinese medicine clinical trials. Chinese Journal of Integrated Traditional Chinese and Conventional Medicine. 2004, 24: 1022-1025.
- Duan N, Wang W: Evaluating for Chinese traditional medicine in the treatment of recurrent aphthous ulcer (RAU) based on the evidence-based medicine methods. Jiangsu Journal of Chinese Traditional Medicine. 2005, 25: 50-52.
- Liu X, Lai S, Liu P: Quality analysis of literature of traditional Chinese medicine or integrated traditional and conventional medicines on breast cancer. Chinese Journal of Evidence-Based Medicine. 2005, 5: 26-29.
- Han L, Huang X: Evaluation for literatures quality of traditional Chinese medicine in the treatment of depression diseases. Journal of Yunnan College of Traditional Chinese Medicine. 2005, 28: 8-11.
Cited by
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
Self-citationIncreasing value and reducing waste: addressing inaccessible research
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62296-5 · Cited by 887
Exercise for sarcopenia in older people: A systematic review and network meta‐analysis
Shen, Y., Shi, Q., Nong, K., Li, S., Yue, J., Huang, J., Dong, B., Beauchamp, M., & Hao, Q. (2023) · Journal of Cachexia, Sarcopenia and Muscle · doi:10.1002/jcsm.13225 · Cited by 464
“The fi nding is consistent with single RCTs.”
InfluentialStem cell treatment for acute myocardial infarction
Fisher, S. A., Zhang, H., Doree, C., Mathur, A., & Martin-Rendon, E. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006536.pub4 · Cited by 445
Cheng, C.-W., Wu, T.-X., Shang, H.-C., Li, Y.-P., Altman, D. G., Moher, D., Bian, Z.-X., & for the CONSORT-CHM Formulas 2017 Group* (2017) · Annals of Internal Medicine · doi:10.7326/m16-2977 · Cited by 323
Self-citation
Metadata
- Authors
- Wu, T., Li, Y., Bian, Z., Liu, G., & Moher, D.
- Affiliations
- Sichuan University (CN)
- Hong Kong Baptist University (HK)
- Ottawa Hospital (CA)
- Corresponding author
- Wu, Taixiang
- Venue
- Trials
- Published
- 2009-07-02
- Volume
- 10
- Issue
- 1
- Pages
- 46-46
- ISSN
- 1745-6215 (ISSN-L)
- PMC
- PMC2716312
- OpenAlex
- W2086972635
- Semantic Scholar
- 0cad565d38f798da06845ca9c07153c6e546af15
- Cited by
- 229
- References
- 22
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 8 · 2023: 14 · 2022: 9 · 2021: 8 · 2020: 15 · 2019: 16 · 2018: 13 · 2017: 10 · 2016: 12 · 2015: 13 · 2014: 13 · 2013: 17 · 2012: 29
- FWCI
- 23.89
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- Trials (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- HKBU Institutional Repository (Hong Kong Baptist University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- University of Ottawa
- Bond University
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- randomized controlled trials, publication bias, Chinese medical journals, traditional Chinese medicine, Western medicine, hospital affiliation, CNKI, university-affiliated hospitals
- MeSH terms
- Academic Medical Centers, China, Hospitals, Community, Humans, Medicine, Chinese Traditional, Peer Review, Periodicals as Topic, Quality Control, Randomized Controlled Trials as Topic, Databases, Factual
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Randomized trials published in some Chinese journals: how many are randomized? https://app.cochat.ai/papers/10.1186/1745-6215-10-46
- The paper
- Wu, T., Li, Y., Bian, Z., Liu, G., & Moher, D. (2009). Randomized trials published in some Chinese journals: how many are randomized? Trials. https://doi.org/10.1186/1745-6215-10-46
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.