Cited by 15Meta-analysis and systematic reviewsClinical practice guidelines implementationAcademic Publishing and Open Access

The quality of reporting of randomised controlled trials in asthma: a systematic review

Open access
Ntala, Chara, Birmpili, Panagiota, Worth, Allison, Anderson, Niall H, Sheikh, Aziz·2013·Primary Care Respiratory Journal

Abstract

BACKGROUND: There are concerns about the reporting quality of asthma trials. AIMS: To describe the reporting of contemporary asthma trials and to identify factors associated with better reporting quality. METHODS: Two reviewers independently searched MEDLINE for randomised controlled trials (RCTs) of asthma published between January 2010 and July 2012 in leading generalist and specialist journals. We calculated the proportion of trials that adequately reported each Consolidated Standards of Reporting Trials (CONSORT) checklist item and an overall quality score for each trial. Factors associated with better reporting quality were investigated. RESULTS: Thirty-five RCTs satisfied our eligibility criteria. Four trials adequately reported <50% of the items, 15 adequately reported 50-60% of items, and 16 adequately reported >60% of items. Seventeen of the 38 CONSORT items were consistently well reported in more than two-thirds of the articles. In contrast, nine items were poorly reported in more than half the trials - namely, identification as a randomised trial in the title (40.0%), an adequate structured summary/abstract (48.6%), details of eligibility criteria (34.3%), recruitment (48.6%), randomisation procedures (22.9%), intervention (38.5%), harms (34.3%), the funding source (45.7%), and access to the full trial protocol (17.1%). Studies led by teams in high-income country settings were associated with better quality of reporting (relative risk=1.33, 95% CI 1.09 to 1.64). CONCLUSIONS: The quality of reporting in contemporary asthma literature remains suboptimal. We have identified important areas in which reporting quality needs to be improved.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.4104/pcrj.2013.00089

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 32

  1. Travers J, Marsh S, Williams M, et al. External validity of randomised controlled trials in asthma: to whom do the results of the trials apply? Thorax 2007; 62(3): 219–23. http://dx.doi.org/10.1136/thx.2006.066837 17105779 PMC2117157 · DOI
  2. Juni P, Altman DG, Egger M. Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ 2001; 323(7303): 42–6. http://dx.doi.org/10.1136/bmj.323.7303.42 11440947 PMC1120670 · DOI · Paper page
  3. Rios LP, Odueyungbo A, Moitri MO, Rahman MO, Thabane L. Quality of reporting of randomized controlled trials in general endocrinology literature. J Clin Endocrinol Metab 2008; 93(10): 3810–16. http://dx.doi.org/10.1210/jc.2008-0817 18583463 · DOI
  4. Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. Int J Surg 2012; 10(1): 28–55. http://dx.doi.org/10.1016/j.ijsu.2011.10.001 22036893 · DOI · Paper page
  5. Begg C, Cho M, Eastwood S, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA 1996; 276(8): 637–9. http://dx.doi.org/10.1001/jama.276.8.637 8773637 · DOI · Paper page
  6. Campbell MK, Elbourne DR, Altman DG. CONSORT statement: extension to cluster randomised trials. BMJ 2004; 328(7441): 702–08. http://dx.doi.org/10.1136/bmj.328.7441.702 15031246 PMC381234 · DOI · Paper page
  7. Ioannidis JP, Evans SJ, Gotzsche PC, et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med 2004; 141(10): 781–8. http://dx.doi.org/10.7326/0003-4819-141-10-200411160-00009 15545678 · DOI · Paper page
  8. Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med 2008; 148(4): 295–309. http://dx.doi.org/10.7326/0003-4819-148-4-200802190-00008 18283207 · DOI · Paper page
  9. Gagnier JJ, Boon H, Rochon P, Moher D, Barnes J, Bombardier C. Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement. Ann Intern Med 2006; 144(5): 364–7. http://dx.doi.org/10.7326/0003-4819-144-5-200603070-00013 16520478 · DOI · Paper page
  10. Hopewell S, Clarke M, Moher D, et al. CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med 2008; 5(1): e20. http://dx.doi.org/10.1371/journal.pmed.0050020 18215107 PMC2211558 · DOI · Paper page
  11. Lai R, Chu R, Fraumeni M, Thabane L. Quality of randomized controlled trials reporting in the primary treatment of brain tumors. J Clin Oncol 2006; 24(7): 1136–44. http://dx.doi.org/10.1200/JCO.2005.03.1179 16505433 · DOI
  12. Bhandari M, Richards RR, Sprague S, Schemitsch EH. The quality of reporting of randomized trials in the Journal of Bone and Joint Surgery from 1988 through 2000. J Bone Joint Surg Am 2002; 84-A(3): 388–96. 11886908
  13. Nojomi M, Ramezani M, Ghafari-Anvar A. Quality of reports on randomized controlled trials published in Iranian journals: application of the new version of consolidated standards of reporting trials (CONSORT). Arch Iran Med 2013; 16(1): 20–2. doi: 013161/AIM.007. 23273230
  14. DeMauro SB, Giaccone A, Kirpalani H, Schmidt B. Quality of reporting of neonatal and infant trials in high-impact journals. Pediatrics 2011; 128(3): e639–44. http://dx.doi.org/10.1542/peds.2011-0377 21859916 PMC9923787 · DOI
  15. Quinones D, Llorca J, Dierssen T, Delgado-Rodriguez M. Quality of published clinical trials on asthma. J Asthma 2003; 40(6): 709–19. http://dx.doi.org/10.1081/JAS-120023494 14580003 · DOI
  16. Quinones D, Llorca J, Prieto-Salceda D, Delgado-Rodriguez M. [Quality of clinical trials published in Spain on asthma in comparison to trials in English language journals]. Arch Bronconeumol 2002; 38(12): 574–9. http://dx.doi.org/10.1016/S0300-2896(02)75293-9 12568702 · DOI
  17. Ntala C, Birmpili P, Worth A, Anderson NH, Sheikh A. The quality of reporting of randomised controlled trials in asthma: systematic review protocol. Prim Care Respir J 2013; 22(1): PS1–PS8. http://dx.doi.org/10.4104/pcrj.2013.00003 PMC6442771 23344780 · DOI
  18. Wilson E. Probable inference, the law of succession, and statistical inference. J Am Stat Assoc 1927; 22(158): 209–12. http://dx.doi.org/10.2307/2276774 · DOI · Paper page
  19. Camm CF, Chen Y, Sunderland N, Nagendran M, Maruthappu M, Camm AJ. An assessment of the reporting quality of randomised controlled trials relating to anti-arrhythmic agents (2002-2011). Int J Cardiol 2013; 168(2): 1393–6. http://dx.doi.org/10.1016/j.ijcard.2012.12.020 23298560 · DOI
  20. Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG. The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ 2010; 340: c723. http://dx.doi.org/10.1136/bmj.c723 20332510 PMC2844941 · DOI · Paper page
  21. Farrokhyar F, Chu R, Whitlock R, Thabane L. A systematic review of the quality of publications reporting coronary artery bypass grafting (CABG) trials. Ann Epidemiol 2005; 15(8): 645. http://dx.doi.org/10.1016/j.annepidem.2005.06.042 PMC2386171 17897515 · DOI
  22. Peron J, Pond GR, Gan HK, et al. Quality of reporting of modern randomized controlled trials in medical oncology: a systematic review. J Natl Cancer Inst 2012; 104(13): 982–9. http://dx.doi.org/10.1093/jnci/djs259 22761273 · DOI
  23. Bausch B, Spaar A, Kleijnen J, Puhan MA. Quality of randomised trials in COPD. Eur Respir J 2009; 34(5): 1060–5. http://dx.doi.org/10.1183/09031936.00159108 19574328 · DOI
  24. Glasziou P, Meats E, Heneghan C, Shepperd S. What is missing from descriptions of treatment in trials and reviews? BMJ 2008; 336(7659): 1472–4. http://dx.doi.org/10.1136/bmj.39590.732037.47 18583680 PMC2440840 · DOI · Paper page
  25. Ioannidis JP, Lau J. Completeness of safety reporting in randomized trials: an evaluation of 7 medical areas. JAMA 2001; 285(4): 437–43. http://dx.doi.org/10.1001/jama.285.4.437 11242428 · DOI · Paper page
  26. Krimsky S, Rothenberg LS. Financial interest and its disclosure in scientific publications. JAMA 1998; 280(3): 225–6. http://dx.doi.org/10.1001/jama.280.3.225 9676662 · DOI
  27. Devereaux PJ, Choi PT, El-Dika S, et al. An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol 2004; 57(12): 1232–6. http://dx.doi.org/10.1016/j.jclinepi.2004.03.017 15617948 · DOI · Paper page
  28. Pildal J, Chan AW, Hrobjartsson A, Forfang E, Altman DG, Gotzsche PC. Comparison of descriptions of allocation concealment in trial protocols and the published reports: cohort study. BMJ 2005; 330(7499): 1049. http://dx.doi.org/10.1136/bmj.38414.422650.8F 15817527 PMC557221 · DOI · Paper page
  29. Soares HP, Daniels S, Kumar A, et al. Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ 2004; 328(7430): 22–4. http://dx.doi.org/10.1136/bmj.328.7430.22 14703540 PMC313900 · DOI
  30. Toulmonde M, Bellera C, Mathoulin-Pelissier S, Debled M, Bui B, Italiano A. Quality of randomized controlled trials reporting in the treatment of sarcomas. J Clin Oncol 2011; 29(9): 1204–9. http://dx.doi.org/10.1200/JCO.2010.30.9369 21321290 · DOI
  31. Moher D, Pham B, Jones A, et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet 1998; 352(9128): 609–13. http://dx.doi.org/10.1016/S0140-6736(98)01085-X 9746022 · DOI · Paper page
  32. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995; 273(5): 408–12. http://dx.doi.org/10.1001/jama.1995.03520290060030 7823387 · DOI

Cited by

Sorted by citations

Authors
Ntala, C., Birmpili, P., Worth, A., Anderson, N. H., & Sheikh, A.
Affiliations
  • University of Patras (GR)
  • University of Edinburgh (GB)
  • Brigham and Women's Hospital (US)
Corresponding author
Ntala, Chara
Venue
Primary Care Respiratory Journal
Published
2013-11-18
Volume
22
Issue
4
Pages
417-424
ISSN
  • 1471-4418 (ISSN-L)
  • 1475-1534
OpenAlex
W2033818270
Cited by
15
References
5
Citations by year
2024: 3 · 2022: 2 · 2021: 1 · 2020: 2 · 2019: 1 · 2018: 2 · 2017: 1 · 2016: 1 · 2015: 1 · 2013: 1
FWCI
0.20
Type
journal article
Language
en
Open access
Licence
other-oa
Locations
  • Primary Care Respiratory Journal (publishedVersion, other-oa)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
  • Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
Keywords
asthma, randomized controlled trials, reporting quality, CONSORT checklist, funding disclosure, inclusion and exclusion criteria
MeSH terms
Asthma, Humans, Publishing, Randomized Controlled Trials as Topic, Guideline Adherence, Research Report

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review