Impact of the Consolidated Standards of Reporting Trials (CONSORT) checklist on reporting of randomized clinical trials in traditional Chinese medicine
Abstract
Objective: To examine the reporting characteristics and key methodological factors of randomized controlled trials (RCTs) in the field of traditional Chinese medicine and assess whether use of the Consolidated Standards of Reporting Trials (CONSORT) statement is associated with improvement in the quality of reports of RCTs. Method: RCTs published in two major traditional Chinese medicine journals were retrieved and were systematically reviewed. Of those journals, one adopted the CONSORT statement (Journal of Chinese Integrative Medicine (JCIM)) and one did not (Chinese Journal of Integrative Medicine (CJIM)). Items within the CONSORT 2001 and the CONSORT 2010 statements were taken to develop a 63‐item coding manual. The Jadad scale was also used to assess methodological quality of RCTs. Two observers assessed the reporting of reports and extracted data independently. P < 0.05 was considered statistically significant. SPSS was used for all analyses. Results: A total of 76 RCTs were included for the analysis (38 from JCIM and 38 from CJIM). S ignificant improvements both in the overall quality of reporting (CONSORT score) and reporting of methodological items (Jadad scale) over time were observed in adopter journal (JCIM) (P = 0.001). Overall CONSORT score of studies published during 2010 to 2011 (post‐CONSORT) increased 15.30 averagely with 95%CI 8.34 to 22.26 (P = 0.001). Of those, items addressed on reporting of methodological quality were different significantly too. JCIM had more 1.30 items addressed than CJIM in average (95% CI 0.52 to 2.08, P = 0.003). In the multivariate analysis regression, the page length and CONSORT‐promoting status have statistically significant associated with the (P = 0.001 and P = 0.040, respectively). Conclusion: Although a large room needs to improve the reporting of randomized clinical trials in traditional Chinese medicine, the impact for improvement of reporting of TCM RCTs has been proven in some extent.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Recent investigations into the quality of Chinese clinical trials have been based only on the published reports.
“However, recent investigations into the quality of Chinese clinical trials have been based only on the published reports [1–4, 16, 17], which may not always accurately reflect the actual conduct of the trials because of poor reporting [11, 16, 17].”
Published reports may not always accurately reflect the actual conduct of trials because of poor reporting.
“However, recent investigations into the quality of Chinese clinical trials have been based only on the published reports [1–4, 16, 17], which may not always accurately reflect the actual conduct of the trials because of poor reporting [11, 16, 17].”
Cites
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582 · see citing works
(1963) · Medical Entomology and Zoology · Cited by 15,085 · see citing works
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634 · see citing works
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835 · see citing works
CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group* (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-11-201006010-00232 · Cited by 3,824 · see citing works
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · see citing works
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127 · see citing works
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538 · see citing works
Moher, D., Jones, A., Lepage, L., & for the CONSORT Group (2001) · JAMA · doi:10.1001/jama.285.15.1992 · Cited by 1,027 · see citing works
Plint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872 · see citing works
Statistical Power, Sample Size, and Their Reporting in Randomized Controlled Trials
Moher, D. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520020048013 · Cited by 608 · see citing works
Reporting Randomized, Controlled Trials of Herbal Interventions: An Elaborated CONSORT Statement
Gagnier, J. J., Boon, H., Rochon, P., Moher, D., Barnes, J., Bombardier, C., & for the CONSORT Group* (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-5-200603070-00013 · Cited by 608 · see citing works
Better reporting of randomised controlled trials: the CONSORT statement
Altman, D. G. (1996) · BMJ · doi:10.1136/bmj.313.7057.570 · Cited by 605 · see citing works
Reporting on Methods in Clinical Trials
DerSimonian, R., Charette, L. J., McPeek, B., & Mosteller, F. C. (1982) · New England Journal of Medicine · doi:10.1056/nejm198206033062204 · Cited by 509 · see citing works
Epidemiology and reporting of randomised trials published in PubMed journals
Chan, A.-W., & Altman, D. G. (2005) · The Lancet · doi:10.1016/s0140-6736(05)71879-1 · Cited by 474 · see citing works
Quality of Reporting of Randomized Trials as a Measure of Methodologic Quality
Huwiler-Müntener, K. (2002) · JAMA · doi:10.1001/jama.287.21.2801 · Cited by 397 · see citing works
Large-scale randomized evidence: Large, simple trials and overviews of trials
Peto, R., Collins, R., & Gray, R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00150-o · Cited by 365 · see citing works
Value of Flow Diagrams in Reports of Randomized Controlled Trials
Egger, M. (2001) · JAMA · doi:10.1001/jama.285.15.1996 · Cited by 317 · see citing works
Soares, H. P., Daniels, S., Kumar, A., Clarke, M. J., Scott, C., Swann, S., & Djulbegović, B. (2004) · BMJ · doi:10.1136/bmj.328.7430.22 · Cited by 310 · see citing works
A Proposal for Structured Reporting of Randomized Controlled Trials
Andrew, E. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520240054041 · Cited by 309 · see citing works
Reporting Number Needed to Treat and Absolute Risk Reduction in Randomized Controlled Trials
Nuovo, J. (2002) · JAMA · doi:10.1001/jama.287.21.2813 · Cited by 241 · see citing works
Hopewell, S., Altman, D. G., Moher, D., & Schulz, K. F. (2008) · Trials · doi:10.1186/1745-6215-9-20 · Cited by 241 · see citing works
Reporting in randomized clinical trials improved after adoption of the CONSORT statement
Kane, R. L., Wang, J., & Garrard, J. M. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.06.016 · Cited by 226 · see citing works
MacPherson, H., White, A. R., Cummings, M., Jobst, K., Rose, K., & Niemtzow, R. C. (2001) · Complementary Therapies in Medicine · doi:10.1054/ctim.2001.0488 · Cited by 217 · see citing works
Mills, E. J., Wu, P., Gagnier, J., & Devereaux, P. J. (2005) · Contemporary Clinical Trials · doi:10.1016/j.cct.2005.02.008 · Cited by 216 · see citing works
Devereaux, P. J., Choi, P. T.-L., El-Dika, S., Bhandari, M., Montori, V. M., Schünemann, H. J., Garg, A. X., Busse, J. W., Heels-Ansdell, D., Ghali, W. A., et al. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.03.017 · Cited by 209 · see citing works
Pildal, J., Chan, A.-W., Hróbjartsson, A., Forfang, E., Altman, D. G., & Gøtzsche, P. C. (2005) · BMJ · doi:10.1136/bmj.38414.422650.8f · Cited by 209 · see citing works
Chan, A.-W., Hrobjartsson, A., Jorgensen, K. J., Gotzsche, P. C., & Altman, D. G. (2008) · BMJ · doi:10.1136/bmj.a2299 · Cited by 202 · see citing works
Moher, D., Schulz, K. F., & Altman, D. G. (2005) · EXPLORE · doi:10.1016/j.explore.2004.11.001 · Cited by 198 · see citing works
A quality assessment of randomized control trials of primary treatment of breast cancer.
Liberati, A., Himel, H. N., & Chalmers, T. C. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.6.942 · Cited by 195 · see citing works
Altman, D. G. (2005) · BMJ · doi:10.1136/bmj.330.7499.1056 · Cited by 174 · see citing works
Devereaux, P. J., Manns, B., Ghali, W. A., Quan, H., & Guyatt, G. H. (2002) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00214-3 · Cited by 168 · see citing works
Discussion Sections in Reports of Controlled Trials Published in General Medical Journals
Clarke, M. J., & Chalmers, I. (1998) · JAMA · doi:10.1001/jama.280.3.280 · Cited by 167 · see citing works
The reporting quality of randomised controlled trials in surgery: A systematic review
Agha, R., Cooper, D., & Muir, G. (2007) · International Journal of Surgery · doi:10.1016/j.ijsu.2007.06.002 · Cited by 142 · see citing works
Wang, G., Mao, B., Xiong, Z., Fan, T., Chen, X.-D., Wang, L., Liu, G., Liu, J., Guo, J., Chang, J., et al. (2007) · Clinical Therapeutics · doi:10.1016/j.clinthera.2007.07.023 · Cited by 140 · see citing works
The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals
Berwanger, O., Ribeiro, R. A., Finkelsztejn, A., Watanabe, M., Suzumura, E. A., Duncan, B. B., Devereaux, P. J., & Cook, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.05.013 · Cited by 133 · see citing works
How Well Are Randomized Controlled Trials Reported in the Dermatology Literature?
Adetugbo, K., & Williams, H. C. (2000) · Archives of Dermatology · doi:10.1001/archderm.136.3.381 · Cited by 127 · see citing works
Discussion Sections in Reports of Controlled Trials Published in General Medical Journals
Clarke, M. J. (2002) · JAMA · doi:10.1001/jama.287.21.2799 · Cited by 123 · see citing works
Quality of Reporting of Randomized Controlled Trials in General Endocrinology Literature
Rios, L. P., Odueyungbo, A. O., Moitri, M. O., Rahman, M. O., & Thabane, L. (2008) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2008-0817 · Cited by 86 · see citing works
Reporting Randomized Controlled Trials: An Experiment and a Call for Responses From Readers
Rennie, D. (1995) · JAMA · doi:10.1001/jama.1995.03520370096044 · Cited by 81 · see citing works
Call for Comments on a Proposal To Improve Reporting of Clinical Trials in the Biomedical Literature
Working Group on Recommendations for Reporting of Clinical Trials in the Biomedical Literature. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-11-199412010-00015 · Cited by 78 · see citing works
Quality of Reporting of Randomized Controlled Trials of Herbal Medicine Interventions
Gagnier, J. J., DeMelo, J., Boon, H. S., Rochon, P. A., & Bombardier, C. (2006) · The American Journal of Medicine · doi:10.1016/j.amjmed.2006.02.006 · Cited by 77 · see citing works
How to Report Randomized Controlled Trials: The CONSORT Statement
Rennie, D. (1996) · JAMA · doi:10.1001/jama.1996.03540080071033 · Cited by 77 · see citing works
Lai, T. Y. Y., Wong, V. W. Y., Lam, R. F., Cheng, A. C. O., Lam, D. S. C., & Leung, G. M. (2007) · Ophthalmic Epidemiology · doi:10.1080/09286580701344399 · Cited by 62 · see citing works
When can a clinical trial be called 'randomized'?
Berger, V., & Bears, J. D. (2003) · Vaccine · doi:10.1016/s0264-410x(02)00475-9 · Cited by 57 · see citing works
Bhandari, M., Guyatt, G. H., Lochner, H. V., Sprague, S., & Tornetta, P. (2002) · Journal of Bone and Joint Surgery · doi:10.2106/00004623-200203000-00023 · Cited by 56 · see citing works
Determining the reporting quality of RCTs in clinical pharmacology
Mills, E. J., Loke, Y. K., Wu, P., Montori, V. M., Perri, D., Moher, D., & Guyatt, G. H. (2004) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.2004.2092.x · Cited by 56 · see citing works
Quality of Reporting of Randomized, Controlled Trials in Cerebral Palsy
Anttila, H., Malmivaara, A., Kunz, R., Autti-Rämö, I., & Mäkelä, M. (2006) · Pediatrics · doi:10.1542/peds.2005-1630 · Cited by 52 · see citing works
Li, J.-N., Liu, Z., Chen, R., Hu, D., Li, W., Li, X., Chen, X., Huang, B., & Liao, L. (2014) · BMC Complementary and Alternative Medicine · doi:10.1186/1472-6882-14-362 · Cited by 51 · see citing works
Piggott, M., McGee, H. M., & Feuer, D. J. (2004) · Palliative Medicine · doi:10.1191/0269216304pm857oa · Cited by 51 · see citing works
Lies, damn lies, and reports of RCTs
McNamee, D., & Horton, R. C. (1996) · The Lancet · doi:10.1016/s0140-6736(05)64795-2 · Cited by 37 · see citing works
How to report randomized controlled trials. The CONSORT statement.
Rennie, D. (1996) · PubMed · Cited by 36 · see citing works
Heald, A. H., Kärvestedt, L., Anderson, S. G., McLaughlin, J., Knowles, A., Wong, L., Grill, V., Cruickshank, J. K., White, A. E., Gibson, M., et al. (2006) · The American Journal of Medicine · doi:10.1016/j.amjmed.2005.08.001 · Cited by 35 · see citing works
Scales, C. D., Norris, R. D., Preminger, G. M., Vieweg, J., Peterson, B. L., & Dahm, P. (2008) · The Journal of Urology · doi:10.1016/j.juro.2008.06.026 · Cited by 32 · see citing works
Greenfield, M. L. V. H., Mhyre, J. M., Mashour, G. A., Blum, J. M., Yen, E. C., & Rosenberg, A. L. (2009) · Anesthesia & Analgesia · doi:10.1213/ane.0b013e31819fe6d7 · Cited by 28 · see citing works
Claraco, A. E., Hanna, S., & Fargas-Babjak, A. M. (2003) · The Journal of Alternative and Complementary Medicine · doi:10.1089/107555303321223026 · Cited by 21 · see citing works
Faunce, T., & Buckley, N. A. (2003) · Journal of Toxicology Clinical Toxicology · doi:10.1081/clt-120019120 · Cited by 15 · see citing works
Hu, J., Qiao, J., Kang, D., & Liu, B. (2011) · Frontiers of Medicine · doi:10.1007/s11684-011-0138-6 · Cited by 15 · see citing works
Self-citationRandomized Controlled Trials in Long-Term Care Residents with Dementia: A Systematic Review
Mills, E. J., & Chow, T. W. (2003) · Journal of the American Medical Directors Association · doi:10.1016/s1525-8610(04)70388-6 · Cited by 9 · see citing works
Randomised trials in the South African Medical Journal, 1948-1997.
Pienaar, E. D., Volmink, J. A., Zwarenstein, M., & Swingler, G. H. (2002) · PubMed · Cited by 6 · see citing works
Flagged first, then by citations
3 of the 64 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Jin, Y., Sanger, N., Shams, I., Luo, C., Shahid, H., Li, G., Bhatt, M., Zielinski, L., Bantoto, B., Wang, M., et al. (2018) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s155103 · Cited by 134 · see citing works
Tong, Z., Li, F., Ogawa, Y., Watanabe, N., & Furukawa, T. A. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0554-2 · Cited by 61 · see citing works
Xiao, M., Ying, J., Zhao, Y., Li, Q., Zhao, Y.-P., Gao, R., & Lu, F. Y. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.673729 · Cited by 21 · see citing works
Jia, P., Tang, L., Yu, J., Liu, J., Kang, D., & Sun, X. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195652 · Cited by 18 · see citing works
Self-citationZeng, N., Zou, C., He, Z., Ma, H., Ou, X., You, H., Kong, Y., & Jia, J. (2017) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2017.11.011 · Cited by 14 · see citing works
A tool to make reporting checklists work
Marušić, A. (2015) · BMC Medicine · doi:10.1186/s12916-015-0476-3 · Cited by 10 · see citing works
Zhang, J., Deng, J., Wang, N., Wang, P., Li, J., Wang, Y., Cui, W., Liang, F., Chen, P., Wang, J., et al. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02402-2 · Cited by 9 · see citing works
Self-citationZanoni, G., Girolomoni, G., Bonetto, C., Trotta, F., Häusermann, P., Opri, R., & Bonhoeffer, J. (2016) · Vaccine · doi:10.1016/j.vaccine.2016.09.032 · Cited by 9 · see citing works
Chen, M., Cui, J., Zhang, A. L., Sze, D., Xue, C. C., & May, B. H. (2017) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2017.0065 · Cited by 8 · see citing works
Jia, Y., & Leung, S.-W. (2024) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2024.117925 · Cited by 7 · see citing works
Ming, L., Zhou, B., Zhou, L., & Li, L. (2020) · Evidence-based Complementary and Alternative Medicine · doi:10.1155/2020/2949125 · Cited by 5 · see citing works
Duan, Y.-S., Wang, Y., Li, B.-Y., Fu, Z., Tu, J., Zhou, H., Wang, Y., Wang, Y., & Liu, C. (2024) · Journal of Pain Research · doi:10.2147/jpr.s477000 · Cited by 5 · see citing works
Zhou, H., Zhu, H., & Jia, Y. (2023) · Phytomedicine · doi:10.1016/j.phymed.2023.155038 · Cited by 4 · see citing works
Pai, L., Hung, C., Chen, L.-L., Lin, R.-L., & Lockwood, C. S. (2024) · Primary care diabetes · doi:10.1016/j.pcd.2024.08.003 · Cited by 4 · see citing works
Reporting Guidelines for Imaging Research
McInnes, M. D. F., Lim, C. S., van der Pol, C. B., Salameh, J., McGrath, T. A., & Frank, R. A. (2018) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2018.11.008 · Cited by 4 · see citing works
Habibi, A., Salehi, A., & Vardanjani, H. M. (2019) · European Journal of Integrative Medicine · doi:10.1016/j.eujim.2019.101040 · Cited by 4 · see citing works
Liu, Y., Hu, C., Zhou, K., Zhang, Y., Kang, J., Wen, Y., Yuan, R., Li, J., Zhao, Q., Zhang, L., et al. (2024) · Frontiers in Pharmacology · doi:10.3389/fphar.2024.1288479 · Cited by 2 · see citing works
Hui, X., Wang, S., Lu, S., Liu, Y., Zhang, Z. P., Lian, W.-J., Zhang, H., Zhou, S. Y., Zhang, J., & Wang, J. (2023) · Pharmacological Research - Modern Chinese Medicine · doi:10.1016/j.prmcm.2023.100270 · Cited by 1 · see citing works
Reporting Quality of Controlled-trial Abstracts from Chicken Research
Sukon, P., Kongpechr, S., Bubpahou, S., Boonpian, N., & Manasrisureeyun, N. (2018) · International Journal of Poultry Science · doi:10.3923/ijps.2018.431.442
Aghdash, S. A., Azar, F. P., Nouri, M., Mohseni, M., & Aghaei, M. H. (2023) · Journal of Holistic Nursing and Midwifery · doi:10.32598/jhnm.34.1.2510
Norouzi, M., Haghdoost, A. A., & Kkarimiafshar, M. (2024) · Current Traditional Medicine · doi:10.2174/0122150838283438240405062310
Zhang, J., Deng, J., Wang, N., Wang, P., Li, J., Wang, Y., Cui, W., Liang, F., Chen, P., Wang, J., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26651172
Self-citation
- Authors
- Liu, X., Zhang, X., Wen, S., Peng, L., Hong, Q., & Kang, D.
- Affiliations
- Sichuan University (CN)
- Department of Evidence‐based Medicine and Clinical Epidemiology, West China Hospital Sichuan University Chengdu China
- Corresponding author
- Kang, Deying
- ORCID
- Venue
- Journal of Evidence-Based Medicine
- Publisher
- Wiley
- Published
- 2015-11
- Volume
- 8
- Issue
- 4
- Pages
- 192-208
- ISSN
- 1756-5383 (ISSN-L)
- 1756-5391
- OpenAlex
- W1902675027
- Cited by
- 22
- References
- 64
- Citations by year
- 2024: 6 · 2023: 4 · 2021: 1 · 2020: 1 · 2019: 1 · 2018: 5 · 2017: 2 · 2016: 1 · 2015: 1
- FWCI
- 2.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Evidence-Based Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Keywords
- CONSORT statement, reporting quality, randomized controlled trials, traditional Chinese medicine, trial reporting guidelines, methodological quality, Jadad scale
- MeSH terms
- Humans, Medicine, Chinese Traditional, Research Design, Randomized Controlled Trials as Topic, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review