Intention-to-treat and transparency of related practices in randomized, controlled trials of anti-infectives
Open accessAbstract
BACKGROUND: Intention-to-treat (ITT) analysis is commonly recommended for use, due to its benefits on external validity, in randomized, controlled trials (RCTs). No published reports describe how ITT analysis, as well as alternative approaches, are used in anti-infective RCTs. The purpose of this study is to describe the extent to which ITT analysis and alternative data approaches are used, the practices used to handle missing subject data, and whether non-inferiority trials present both ITT and per protocol (PP) analyses. Results of this analysis will help guide end users of infectious diseases primary drug literature. METHODS: A cross-sectional study of RCTs of anti-infectives published from January 1, 2013 through December 31, 2014 was conducted. A PubMed search identified relevant articles published in five specialty infectious diseases journals and four general medical journals. Each article was reviewed by two independent investigators with discrepancies resolved by consensus. Descriptive statistics were used to quantify results. RESULTS: One hundred four articles met study criteria. The most common medication classes represented in the RCTs were hepatitis C antivirals (26 %), antibacterials (25 %), and antiretrovirals (21 %). Thirty studies (29 %) were non-inferiority trials. Most studies (77 %) described use of ITT or modified ITT (mITT) in their methods. Of the ITT and mITT studies, most (73 %) did not describe practices used to handle missing data. Most (97 %) non-inferiority trials described use of ITT, mITT, or both; however, only 15 (50 %) also described use of PP. CONCLUSIONS: RCTs of anti-infectives commonly employ ITT and mITT. Most do not describe how missing data were addressed. Non-inferiority trials of anti-infectives do not consistently employ both ITT and PP populations.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A per protocol approach will be used as a complement to ITT to facilitate interpretation of findings.
“To manage the issue of missing data, a per protocol approach will be used as a complement to ITT to facilitate interpretation of the findings (Beckett et al., 2016).”
From Internet-based treatment for vulvodynia (EMBLA) – Study protocol for a randomised controlled study (2021) · cites this paper as Beckett et al., 2016
The Background recommends presenting both ITT and per-protocol (PP) results for non-inferiority trials, supporting PP as a complement to ITT for interpretation in that setting. It discusses missing-data methods separately, naming approaches such as last observation carried forward and assuming treatment failure; it does not recommend PP as a way to manage missing data. (LLM, conf=0.86)
Experimental — accuracy not yet measuredITT analysis has the advantage of preserving balance afforded by randomisation, minimising risk of type I error, and resembling clinical practice.
“Whilst ITT analysis has the advantage to preserve the balance afforded by randomisation, minimising the risk of for type I error and resembling clinical practice (Beckett et al., 2016; McCoy, 2017), a per-protocol approach may provide the true efficacy of an intervention among completers.”
From Internet-based treatment for vulvodynia (EMBLA) – Study protocol for a randomised controlled study (2021) · cites this paper as Beckett et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877 · see citing works
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883 · see citing works
Piaggio, G., Elbourne, D. R., Pocock, S. J., Evans, S. J. W., Altman, D. G., & CONSORT Group, F. T. (2012) · JAMA · doi:10.1001/jama.2012.87802 · Cited by 2,428 · see citing works
Intention-to-treat concept: A review
Gupta, S. (2011) · Perspectives in Clinical Research · doi:10.4103/2229-3485.83221 · Cited by 1,921 · see citing works
The prevention and treatment of missing data in clinical trials
Little, R. J., D'Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., Frangakis, C., Hogan, J. W., Molenberghs, G., Murphy, S. A., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1203730 · Cited by 1,884 · see citing works
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858 · see citing works
Moher, D., Hopewell, S., Schulz, K. F., Montori, V. M., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D. R., Egger, M., & Altman, D. G. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.10.006 · Cited by 414 · see citing works
Including all individuals is not enough: lessons for intention-to-treat analysis
White, I., Carpenter, J., & Horton, N. (2012) · Clinical Trials · doi:10.1177/1740774512450098 · Cited by 299 · see citing works
Good Enough: A Primer on the Analysis and Interpretation of Noninferiority Trials
Kaul, S., & Diamond, G. A. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-1-200607040-00011 · Cited by 272 · see citing works
Modified intention to treat reporting in randomised controlled trials: systematic review
Abraha, I., & Montedori, A. (2010) · BMJ · doi:10.1136/bmj.c2697 · Cited by 257 · see citing works
Discordance between reported intention-to-treat and per protocol analyses
Porta, N., Bonet, C., & Cobo, E. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.09.013 · Cited by 187 · see citing works
Alshurafa, M., Briel, M., Akl, E. A., Haines, T., Moayyedi, P., Gentles, S. J., Rios, L., Tran, C., Bhatnagar, N., Lamontagne, F., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049163 · Cited by 126 · see citing works
Drug Information: A Guide for Pharmacists
Guenette, A. J. (1997) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/54.1.106 · Cited by 108 · see citing works
A comparison of intent-to-treat and per-protocol results in antibiotic non-inferiority trials
Brittain, E., & Lin, D. (2004) · Statistics in Medicine · doi:10.1002/sim.1934 · Cited by 90 · see citing works
Equivalence and noninferiority trials
Siegel, J. P. (2000) · American Heart Journal · doi:10.1016/s0002-8703(00)90066-8 · Cited by 88 · see citing works
(2002) · PubMed · Cited by 74 · see citing works
Joseph, R., Sim, J., Ogollah, R., & Lewis, M. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.09.002 · Cited by 50 · see citing works
Evaluating equivalence and noninferiority trials
Dasgupta, A., Lawson, K. A., & Wilson, J. P. (2010) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp090507 · Cited by 45 · see citing works
Reporting of Noninferiority Trials in ClinicalTrials.gov and Corresponding Publications
Gopal, A. D., Desai, N. R., Tse, T., & Ross, J. S. (2015) · JAMA · doi:10.1001/jama.2015.1697 · Cited by 22 · see citing works
Secondary tracheo‐oesophageal fistula creation without rigid oesophagoscopy: how we do it
Lorenz, K., & Maier, H. (2010) · Clinical Otolaryngology · doi:10.1111/j.1749-4486.2009.02032.x · Cited by 7 · see citing works
Intention to treat analysis: how frequently is it used in ENT randomised controlled trials?
Achar, P., Mitra, I., Duvvi, S. K., & Kumar, B. N. (2010) · Clinical Otolaryngology · doi:10.1111/j.1749-4486.2009.02073.x · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- [10]American Society for Microbiology. About: Antimicrobial Agents and Chemotherapy. 2016. http://aac.asm.org/site/misc/about.xhtml (Accessed 2 Aug 2016).
- [11]Elsevier Limited. About the Lancet Infectious Diseases medical journal. 2016. http://www.thelancet.com/laninf/about. Accessed 2 Aug 2016.
- [12]BMJ Publishing Group. About the BMJ. 2016. http://www.bmj.com/about-bmj. Accessed 2 Aug 2016.
- [13]Massachusetts Medical Society. New England Journal of Medicine. Media center fact sheet. 2016. http://www.nejm.org/page/media-center/fact-sheet. Accessed 2 Aug 2016.
Cited by
Sorted by citations
Bai, A. D., Komorowski, A. S., Lo, C. K. L., Tandon, P., Li, X. X., Mokashi, V., Cvetkovic, A., Findlater, A. R., Liang, L., TOMLINSON, G. A., et al. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01260-7 · Cited by 34 · see citing works
Bai, A. D., Komorowski, A. S., Lo, C. K. L., Tandon, P., Li, X. X., Mokashi, V., Cvetkovic, A., Kay, V. R., Findlater, A. R., Liang, L., et al. (2020) · Clinical Infectious Diseases · doi:10.1093/cid/ciaa1353 · Cited by 23 · see citing works
Clinical Trials in Veterinary Medicine: A New Era Brings New Challenges
Oyama, M. A., Ellenberg, S. S., & Shaw, P. A. (2017) · Journal of Veterinary Internal Medicine · doi:10.1111/jvim.14744 · Cited by 23 · see citing works
Pássaro, A. L., Olegário, I. C., Laux, C. M., Oliveira, R. D. C., Tedesco, T. K., & Raggio, D. P. (2021) · Australian Dental Journal · doi:10.1111/adj.12894 · Cited by 14 · see citing works
Biswas, I., Nalbant, G., Lewis, S., & Chattopadhyay, K. (2024) · Rheumatology International · doi:10.1007/s00296-024-05652-y · Cited by 12 · see citing works
Regorafenib in advanced solitary fibrous tumour: Results from an exploratory phase II clinical study
Stacchiotti, S., Baldi, G. G., Frezza, A. M., Morosi, C., Greco, F. G., Collini, P., Barisella, M., Dagrada, G. P., Zaffaroni, N., Pasquali, S., et al. (2023) · European Journal of Cancer · doi:10.1016/j.ejca.2023.113391 · Cited by 12 · see citing works
Zhang, Y., Liu, Y., Liao, Q., & Liu, Z. (2020) · Clinical Drug Investigation · doi:10.1007/s40261-020-00975-7 · Cited by 9 · see citing works
Intention-to-Treat Analysis in Clinical Research
Armijo-Olivo, S. L., da Silva, J. B., de Castro‐Carletti, E. M., de Oliveira‐Souza, A. I. S., Pelai, E. B., Mohamad, N., Baghbaninaghadehi, F., Dennett, L., Steen, J. P., Kumbhare, D. A., et al. (2024) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000002444 · Cited by 8 · see citing works
Internet-based treatment for vulvodynia (EMBLA) – Study protocol for a randomised controlled study
Hess Engström, A., Kullinger, M., Jawad, I., Hesselman, S., Buhrman, M., Högberg, U., & Skalkidou, A. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100396 · Cited by 7 · see citing works
“…effects of CBT for patients with vulvodynia and found positive results on pain, sexual function, psychological adjustment, and treatment satisfaction for patients with vulvodynia (Bergeron et al., 2001; Bergeron et al., 2016; Goldfinger et al., 2016; Lindstrom and Kvist, 2015; Masheb et al., 2009).”
BackgroundBiswas, I., Lewis, S., & Chattopadhyay, K. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19105806 · Cited by 5 · see citing works
Biswas, I., Lewis, S., & Chattopadhyay, K. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19106102 · Cited by 3 · see citing works
Gorbunova, M. V., Babak, S. L., Adasheva, T. V., & Георгиевич, М. А. (2019) · The Russian Archives of Internal Medicine · doi:10.20514/2226-6704-2019-9-4-280-289 · Cited by 1 · see citing works
How to read a published clinical trial: a practical guide for clinicians
Sonbol, M. B., Firwana, B., Hilal, T., & Murad, M. H. (2020) · Avicenna Journal of Medicine · doi:10.4103/ajm.ajm_186_19
Bai, A. D., Komorowski, A. S., Lo, C. K. L., Tandon, P., Li, X. X., Mokashi, V., Cvetkovic, A., Findlater, A. R., Liang, L., Tomlinson, G., et al. (2021) · Figshare · doi:10.6084/m9.figshare.14451051
- Authors
- Beckett, R. D., Loeser, K. C., Bowman, K. R., & Towne, T. G.
- Affiliations
- Manchester University (US)
- Columbus Regional Healthcare System (US)
- CVS Health (United States) (US)
- Corresponding author
- Beckett, Robert D.
- Loeser, Kathryn C.
- Bowman, Kathryn R.
- Towne, Trent G.
- ORCID
- Beckett, Robert D.
- Venue
- BMC Medical Research Methodology
- Published
- 2016-08-24
- Volume
- 16
- Issue
- 1
- Pages
- 106-106
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC4997732
- OpenAlex
- W2510802190
- Cited by
- 15
- References
- 21
- Citations by year
- 2024: 2 · 2023: 1 · 2022: 3 · 2021: 4 · 2020: 3 · 2019: 1 · 2017: 1
- FWCI
- 0.68
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- No funding was provided for the conduction of this study.
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmaceutical industry and healthcare
- Keywords
- intention-to-treat analysis, anti-infective agents, randomized controlled trials, missing data handling, per-protocol analysis, antibacterial agents, antiretroviral drugs, reporting practices, generalizability
- MeSH terms
- Anti-Infective Agents, Cross-Sectional Studies, Humans, Research Design, Randomized Controlled Trials as Topic, Treatment Outcome, Disclosure, PubMed, Intention to Treat Analysis, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review