The quality of reporting of randomised controlled trials in asthma: a systematic review
Open accessAbstract
BACKGROUND: There are concerns about the reporting quality of asthma trials. AIMS: To describe the reporting of contemporary asthma trials and to identify factors associated with better reporting quality. METHODS: Two reviewers independently searched MEDLINE for randomised controlled trials (RCTs) of asthma published between January 2010 and July 2012 in leading generalist and specialist journals. We calculated the proportion of trials that adequately reported each Consolidated Standards of Reporting Trials (CONSORT) checklist item and an overall quality score for each trial. Factors associated with better reporting quality were investigated. RESULTS: Thirty-five RCTs satisfied our eligibility criteria. Four trials adequately reported <50% of the items, 15 adequately reported 50-60% of items, and 16 adequately reported >60% of items. Seventeen of the 38 CONSORT items were consistently well reported in more than two-thirds of the articles. In contrast, nine items were poorly reported in more than half the trials - namely, identification as a randomised trial in the title (40.0%), an adequate structured summary/abstract (48.6%), details of eligibility criteria (34.3%), recruitment (48.6%), randomisation procedures (22.9%), intervention (38.5%), harms (34.3%), the funding source (45.7%), and access to the full trial protocol (17.1%). Studies led by teams in high-income country settings were associated with better quality of reporting (relative risk=1.33, 95% CI 1.09 to 1.64). CONCLUSIONS: The quality of reporting in contemporary asthma literature remains suboptimal. We have identified important areas in which reporting quality needs to be improved.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Adherence of authors to the CONSORT guidelines is low and the quality of reporting remains insufficient.
“However, the adherence of authors to these guidelines is low and the quality of reporting remains insufficient [9–21].”
From Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial (2015) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Improving the reporting of pragmatic trials: An extension of the CONSORT statement
Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D., Moher, D., & groups, F. T. C. A. P. T. I. H. (. (2008) · BMJ · doi:10.1136/bmj.a2390 · Cited by 1,813 · see citing works
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308 · see citing works
Reporting of Noninferiority and Equivalence Randomized Trials: An Extension of the CONSORT Statement
Piaggio, G., Elbourne, D. R., Altman, D. G., Pocock, S. J., Evans, S. J. W., & CONSORT Group, F. T. (2006) · JAMA · doi:10.1001/jama.295.10.1152 · Cited by 1,153 · see citing works
Publishing Protocols of Systematic Reviews: Comparing What Was Done to What Was Planned
Silagy, C. A., Middleton, P., & Hopewell, S. (2002) · JAMA · doi:10.1001/jama.287.21.2831 · Cited by 188 · see citing works
Quality of Reporting of Randomized, Controlled Trials in Cerebral Palsy
Anttila, H., Malmivaara, A., Kunz, R., Autti-Rämö, I., & Mäkelä, M. (2006) · Pediatrics · doi:10.1542/peds.2005-1630 · Cited by 52 · see citing works
Flagged first, then by citations
Research works printed but not linked: 32
- Travers J, Marsh S, Williams M, et al. External validity of randomised controlled trials in asthma: to whom do the results of the trials apply? Thorax 2007; 62(3): 219–23. http://dx.doi.org/10.1136/thx.2006.066837 17105779 PMC2117157 · DOI
- Juni P, Altman DG, Egger M. Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ 2001; 323(7303): 42–6. http://dx.doi.org/10.1136/bmj.323.7303.42 11440947 PMC1120670 · DOI · Paper page
- Rios LP, Odueyungbo A, Moitri MO, Rahman MO, Thabane L. Quality of reporting of randomized controlled trials in general endocrinology literature. J Clin Endocrinol Metab 2008; 93(10): 3810–16. http://dx.doi.org/10.1210/jc.2008-0817 18583463 · DOI
- Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. Int J Surg 2012; 10(1): 28–55. http://dx.doi.org/10.1016/j.ijsu.2011.10.001 22036893 · DOI · Paper page
- Begg C, Cho M, Eastwood S, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA 1996; 276(8): 637–9. http://dx.doi.org/10.1001/jama.276.8.637 8773637 · DOI · Paper page
- Campbell MK, Elbourne DR, Altman DG. CONSORT statement: extension to cluster randomised trials. BMJ 2004; 328(7441): 702–08. http://dx.doi.org/10.1136/bmj.328.7441.702 15031246 PMC381234 · DOI · Paper page
- Ioannidis JP, Evans SJ, Gotzsche PC, et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med 2004; 141(10): 781–8. http://dx.doi.org/10.7326/0003-4819-141-10-200411160-00009 15545678 · DOI · Paper page
- Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med 2008; 148(4): 295–309. http://dx.doi.org/10.7326/0003-4819-148-4-200802190-00008 18283207 · DOI · Paper page
- Gagnier JJ, Boon H, Rochon P, Moher D, Barnes J, Bombardier C. Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement. Ann Intern Med 2006; 144(5): 364–7. http://dx.doi.org/10.7326/0003-4819-144-5-200603070-00013 16520478 · DOI · Paper page
- Hopewell S, Clarke M, Moher D, et al. CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med 2008; 5(1): e20. http://dx.doi.org/10.1371/journal.pmed.0050020 18215107 PMC2211558 · DOI · Paper page
- Lai R, Chu R, Fraumeni M, Thabane L. Quality of randomized controlled trials reporting in the primary treatment of brain tumors. J Clin Oncol 2006; 24(7): 1136–44. http://dx.doi.org/10.1200/JCO.2005.03.1179 16505433 · DOI
- Bhandari M, Richards RR, Sprague S, Schemitsch EH. The quality of reporting of randomized trials in the Journal of Bone and Joint Surgery from 1988 through 2000. J Bone Joint Surg Am 2002; 84-A(3): 388–96. 11886908
- Nojomi M, Ramezani M, Ghafari-Anvar A. Quality of reports on randomized controlled trials published in Iranian journals: application of the new version of consolidated standards of reporting trials (CONSORT). Arch Iran Med 2013; 16(1): 20–2. doi: 013161/AIM.007. 23273230
- DeMauro SB, Giaccone A, Kirpalani H, Schmidt B. Quality of reporting of neonatal and infant trials in high-impact journals. Pediatrics 2011; 128(3): e639–44. http://dx.doi.org/10.1542/peds.2011-0377 21859916 PMC9923787 · DOI
- Quinones D, Llorca J, Dierssen T, Delgado-Rodriguez M. Quality of published clinical trials on asthma. J Asthma 2003; 40(6): 709–19. http://dx.doi.org/10.1081/JAS-120023494 14580003 · DOI
- Quinones D, Llorca J, Prieto-Salceda D, Delgado-Rodriguez M. [Quality of clinical trials published in Spain on asthma in comparison to trials in English language journals]. Arch Bronconeumol 2002; 38(12): 574–9. http://dx.doi.org/10.1016/S0300-2896(02)75293-9 12568702 · DOI
- Ntala C, Birmpili P, Worth A, Anderson NH, Sheikh A. The quality of reporting of randomised controlled trials in asthma: systematic review protocol. Prim Care Respir J 2013; 22(1): PS1–PS8. http://dx.doi.org/10.4104/pcrj.2013.00003 PMC6442771 23344780 · DOI
- Wilson E. Probable inference, the law of succession, and statistical inference. J Am Stat Assoc 1927; 22(158): 209–12. http://dx.doi.org/10.2307/2276774 · DOI · Paper page
- Camm CF, Chen Y, Sunderland N, Nagendran M, Maruthappu M, Camm AJ. An assessment of the reporting quality of randomised controlled trials relating to anti-arrhythmic agents (2002-2011). Int J Cardiol 2013; 168(2): 1393–6. http://dx.doi.org/10.1016/j.ijcard.2012.12.020 23298560 · DOI
- Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG. The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ 2010; 340: c723. http://dx.doi.org/10.1136/bmj.c723 20332510 PMC2844941 · DOI · Paper page
- Farrokhyar F, Chu R, Whitlock R, Thabane L. A systematic review of the quality of publications reporting coronary artery bypass grafting (CABG) trials. Ann Epidemiol 2005; 15(8): 645. http://dx.doi.org/10.1016/j.annepidem.2005.06.042 PMC2386171 17897515 · DOI
- Peron J, Pond GR, Gan HK, et al. Quality of reporting of modern randomized controlled trials in medical oncology: a systematic review. J Natl Cancer Inst 2012; 104(13): 982–9. http://dx.doi.org/10.1093/jnci/djs259 22761273 · DOI
- Bausch B, Spaar A, Kleijnen J, Puhan MA. Quality of randomised trials in COPD. Eur Respir J 2009; 34(5): 1060–5. http://dx.doi.org/10.1183/09031936.00159108 19574328 · DOI
- Glasziou P, Meats E, Heneghan C, Shepperd S. What is missing from descriptions of treatment in trials and reviews? BMJ 2008; 336(7659): 1472–4. http://dx.doi.org/10.1136/bmj.39590.732037.47 18583680 PMC2440840 · DOI · Paper page
- Ioannidis JP, Lau J. Completeness of safety reporting in randomized trials: an evaluation of 7 medical areas. JAMA 2001; 285(4): 437–43. http://dx.doi.org/10.1001/jama.285.4.437 11242428 · DOI · Paper page
- Krimsky S, Rothenberg LS. Financial interest and its disclosure in scientific publications. JAMA 1998; 280(3): 225–6. http://dx.doi.org/10.1001/jama.280.3.225 9676662 · DOI
- Devereaux PJ, Choi PT, El-Dika S, et al. An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol 2004; 57(12): 1232–6. http://dx.doi.org/10.1016/j.jclinepi.2004.03.017 15617948 · DOI · Paper page
- Pildal J, Chan AW, Hrobjartsson A, Forfang E, Altman DG, Gotzsche PC. Comparison of descriptions of allocation concealment in trial protocols and the published reports: cohort study. BMJ 2005; 330(7499): 1049. http://dx.doi.org/10.1136/bmj.38414.422650.8F 15817527 PMC557221 · DOI · Paper page
- Soares HP, Daniels S, Kumar A, et al. Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ 2004; 328(7430): 22–4. http://dx.doi.org/10.1136/bmj.328.7430.22 14703540 PMC313900 · DOI
- Toulmonde M, Bellera C, Mathoulin-Pelissier S, Debled M, Bui B, Italiano A. Quality of randomized controlled trials reporting in the treatment of sarcomas. J Clin Oncol 2011; 29(9): 1204–9. http://dx.doi.org/10.1200/JCO.2010.30.9369 21321290 · DOI
- Moher D, Pham B, Jones A, et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet 1998; 352(9128): 609–13. http://dx.doi.org/10.1016/S0140-6736(98)01085-X 9746022 · DOI · Paper page
- Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995; 273(5): 408–12. http://dx.doi.org/10.1001/jama.1995.03520290060030 7823387 · DOI
Cited by
Sorted by citations
Barnes, C., Boutron, I., Giraudeau, B., Porcher, R., Altman, D. G., & Ravaud, P. (2015) · BMC Medicine · doi:10.1186/s12916-015-0460-y · Cited by 142 · see citing works
Jin, Y., Sanger, N., Shams, I., Luo, C., Shahid, H., Li, G., Bhatt, M., Zielinski, L., Bantoto, B., Wang, M., et al. (2018) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s155103 · Cited by 134 · see citing works
Lambert, S. D., Duncan, L. R., Kapellas, S., Bruson, A.-M., Myrand, M., Santa Mina, D., Culos-Reed, N., & Lambrou, A. (2016) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9819-3 · Cited by 98 · see citing works
Transparency and reporting characteristics of COVID-19 randomized controlled trials
Kapp, P., Esmail, L., Ghosn, L., Ravaud, P., & Boutron, I. (2022) · BMC Medicine · doi:10.1186/s12916-022-02567-y · Cited by 25 · see citing works
- Authors
- Ntala, C., Birmpili, P., Worth, A., Anderson, N. H., & Sheikh, A.
- Affiliations
- University of Patras (GR)
- University of Edinburgh (GB)
- Brigham and Women's Hospital (US)
- Corresponding author
- Ntala, Chara
- Venue
- Primary Care Respiratory Journal
- Published
- 2013-11-18
- Volume
- 22
- Issue
- 4
- Pages
- 417-424
- ISSN
- 1471-4418 (ISSN-L)
- 1475-1534
- PMC
- PMC6442856
- OpenAlex
- W2033818270
- Cited by
- 15
- References
- 5
- Citations by year
- 2024: 3 · 2022: 2 · 2021: 1 · 2020: 2 · 2019: 1 · 2018: 2 · 2017: 1 · 2016: 1 · 2015: 1 · 2013: 1
- FWCI
- 0.20
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- other-oa
- Locations
- Primary Care Respiratory Journal (publishedVersion, other-oa)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Keywords
- asthma, randomized controlled trials, reporting quality, CONSORT checklist, funding disclosure, inclusion and exclusion criteria
- MeSH terms
- Asthma, Humans, Publishing, Randomized Controlled Trials as Topic, Guideline Adherence, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review