The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Including all individuals is not enough: Lessons for intention-to-treat analysis
Open accessAbstract
Background: Intention-to-treat (ITT) analysis requires all randomised individuals to be included in the analysis in the groups to which they were randomised. However, there is confusion about how ITT analysis should be performed in the presence of missing outcome data. Purposes: To explain, justify, and illustrate an ITT analysis strategy for randomised trials with incomplete outcome data. Methods: We consider several methods of analysis and compare their underlying assumptions, plausibility, and numbers of individuals included. We illustrate the ITT analysis strategy using data from the UK700 trial in the management of severe mental illness. Results: Depending on the assumptions made about the missing data, some methods of analysis that include all randomised individuals may be less valid than methods that do not include all randomised individuals. Furthermore, some methods of analysis that include all randomised individuals are essentially equivalent to methods that do not include all randomised individuals. Limitations: This work assumes that the aim of analysis is to obtain an accurate estimate of the difference in outcome between randomised groups and not to obtain a conservative estimate with bias against the experimental intervention. Conclusions: Clinical trials should employ an ITT analysis strategy, comprising a design that attempts to follow up all randomised individuals, a main analysis that is valid under a stated plausible assumption about the missing data, and sensitivity analyses that include all randomised individuals in order to explore the impact of departures from the assumption underlying the main analysis. Following this strategy recognises the extra uncertainty arising from missing outcomes and increases the incentive for researchers to minimise the extent of missing data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299
Self-citationModels for Longitudinal Data: A Generalized Estimating Equation Approach
Zeger, S. L., Liang, K.-Y., & Albert, P. S. (1988) · Biometrics · doi:10.2307/2531734 · Cited by 4,505
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Multiple Imputation of Missing Values
Royston, P. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400301 · Cited by 2,340 · cited 1×
“MI is implemented by the multivariate imputation by chained equations (MICE) algorithm [28,61,62].”
MethodWhat is meant by intention to treat analysis? Survey of published randomised controlled trials
Hollis, S., & Campbell, F. (1999) · BMJ · doi:10.1136/bmj.319.7211.670 · Cited by 2,160
Flexible Imputation of Missing Data
van Buuren, S. (2012) · doi:10.1201/b11826 · Cited by 2,022
The prevention and treatment of missing data in clinical trials
Little, R. J., D'Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., Frangakis, C., Hogan, J. W., Molenberghs, G., Murphy, S. A., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1203730 · Cited by 1,884
A critical look at methods for handling missing covariates in epidemiologic regression analyses.
Greenland, S., & Finkle, W. D. (1995) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117592 · Cited by 891 · cited 1×
“Thus, mean imputation methods, which are inappropriate for missing covariates in nonrandomised studies [59], are appropriate for missing baseline values in randomised trials, provided that the imputed values respect the independence of the baseline values and randomised group [55].”
MethodStrategy for intention to treat analysis in randomised trials with missing outcome data
White, I. R., Horton, N. J., Carpenter, J., statistics, R. I. M. A. S., & Pocock, S. J. (2011) · BMJ · doi:10.1136/bmj.d40 · Cited by 849
Self-citationMissing Data: A Gentle Introduction
McKnight, P. E., McKnight, K., Sidani, S., & Figueredo, A. J. (2007) · Cited by 782
Multiple-Imputation Inferences with Uncongenial Sources of Input
Meng, X.-L. (1994) · Statistical Science · doi:10.1214/ss/1177010269 · Cited by 756
Multiple Imputation of Missing Values: Update
Royston, P. (2005) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0500500204 · Cited by 754
Intention-to-Treat Analysis: Implications for Quantitative and Qualitative Research
NEWELL, D. J. (1992) · International Journal of Epidemiology · doi:10.1093/ije/21.5.837 · Cited by 715 · cited 1×
“Intention-to-treat (ITT) analysis is essential in avoiding bias in the analysis of randomised trials [1].”
MethodStatistical Considerations in the Intent-to-Treat Principle
Lachin, J. M. (2000) · Controlled Clinical Trials · doi:10.1016/s0197-2456(00)00046-5 · Cited by 652 · cited 1×
“Fourth, even if it introduces no bias, it can reduce the power of the trial if treatment effects are long-lasting [38].”
BackgroundLinear Mixed Models in Practice
Verbeke, G., & Molenberghs, G. (1997) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2294-1 · Cited by 555
Wood, A. M., White, I. R., & Thompson, S. G. (2004) · Clinical Trials · doi:10.1191/1740774504cn032oa · Cited by 543
Self-citationAnalyzing incomplete longitudinal clinical trial data
Molenberghs, G. (2004) · Biostatistics · doi:10.1093/biostatistics/5.3.445 · Cited by 463
Semiparametric Regression for Repeated Outcomes with Nonignorable Nonresponse
Rotnitzky, A., Robins, J. M., & Scharfstein, D. O. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473795 · Cited by 445
Committee for Proprietary Medicinal Products (CPMP)
Nahler, G. (2009) · Dictionary of Pharmaceutical Medicine · doi:10.1007/978-3-211-89836-9_243 · Cited by 441
The Prevention and Treatment of Missing Data in Clinical Trials
(2010) · National Academies Press eBooks · doi:10.17226/12955 · Cited by 438
Royston, P. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900308 · Cited by 428
Intent-to-Treat Analysis for Longitudinal Studies with Drop-Outs
Little, R., & Yau, L. (1996) · Biometrics · doi:10.2307/2532847 · Cited by 380
Adjusting for partially missing baseline measurements in randomized trials
White, I. R., & Thompson, S. G. (2005) · Statistics in Medicine · doi:10.1002/sim.1981 · Cited by 378
Self-citationIntensive versus standard case management for severe psychotic illness: a randomised trial
Burns, T., Creed, F., Fahy, T., Thompson, S., & Tyrer, P. (1999) · The Lancet · doi:10.1016/s0140-6736(98)12191-8 · Cited by 330
MMRM vs. LOCF: A Comprehensive Comparison Based on Simulation Study and 25 NDA Datasets
Siddiqui, O., Hung, H. M. J., & O'Neill, R. (2009) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400802609797 · Cited by 301 · cited 2×
“LOCF is also sometimes defended as being conservative: for conditions that tend to improve over time, it is indeed likely to be conservative for arm-specific mean outcomes, but its bias for the estimated treatment effect is not necessarily in a conservative direction [20].”
BackgroundStata multiple-imputation reference manual
StataCorp (2011) · Stata Press/StataCorp eBooks · Cited by 284
Last observation carry‐forward and last observation analysis
Shao, J., & Zhong, B. (2003) · Statistics in Medicine · doi:10.1002/sim.1519 · Cited by 279
Inference for imputation estimators
Robins, J. (2000) · Biometrika · doi:10.1093/biomet/87.1.113 · Cited by 276
Web‐based self‐help for problem drinkers: a pragmatic randomized trial
Riper, H., Kramer, J., Smit, F., Conijn, B., Schippers, G., & Cuijpers, P. (2008) · Addiction · doi:10.1111/j.1360-0443.2007.02063.x · Cited by 267
Handling drop‐out in longitudinal clinical trials: a comparison of the LOCF and MMRM approaches
Lane, P. (2008) · Pharmaceutical Statistics · doi:10.1002/pst.267 · Cited by 262 · cited 1×
“LOCF does not require the data to be MCAR, although some authors claim that it does [17,18]: MCAR would instead require the missing data to be equal to the observed data in expectation at the final time point [5].”
BackgroundLiu, G. F., Lu, K., Mogg, R., Mallick, M., & Mehrotra, D. V. (2009) · Statistics in Medicine · doi:10.1002/sim.3639 · Cited by 254
Statistical handling of drop‐outs in longitudinal clinical trials
Heyting, A., Tolboom, J. T. B. M., & Essers, J. G. A. (1992) · Statistics in Medicine · doi:10.1002/sim.4780111603 · Cited by 238
Marley, E. (1962) · Psychopharmacologia · doi:10.1007/bf00411372 · Cited by 218
Multiple Imputation of Missing Values: New Features for Mim
Royston, P., Carlin, J. B., & White, I. R. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900205 · Cited by 216
Self-citationMissing outcomes in randomized trials: addressing the dilemma.
Altman, D. G. (2009) · PubMed Central · Cited by 192
Problems in dealing with missing data and informative censoring in clinical trials
Shih, W. J. (2002) · Current Controlled Trials in Cardiovascular Medicine · doi:10.1186/1468-6708-3-4 · Cited by 170
Multivariate Imputation by Chained Equations: Mice V1.0 User's manual
van Buuren, S., & Groothuis‐Oudshoorn, C. G. M. (2000) · Cited by 167
Handling “Don't Know” Survey Responses: The Case of the Slovenian Plebiscite
Rubin, D. B., Stern, H. S., & Vehovar, V. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476580 · Cited by 160
Clinical trials in psychiatry: should protocol deviation censor patient data?
Lavori, P. W. (1992) · PubMed · Cited by 158
(2004) · Statistics in Medicine · doi:10.1002/sim.1647 · Cited by 143
Can one assess whether missing data are missing at random in medical studies?
Potthoff, R. F., Tudor, G. E., Pieper, K. S., & Hasselblad, V. (2006) · Statistical Methods in Medical Research · doi:10.1191/0962280206sm448oa · Cited by 141
Uses and limitations of randomization-based efficacy estimators
White, I. R. (2005) · Statistical Methods in Medical Research · doi:10.1191/0962280205sm406oa · Cited by 113
Self-citationLast Observation Carried Forward: A Crystal Ball?
Kenward, M. G., & Molenberghs, G. (2009) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400903105406 · Cited by 108
Sensitivity Analysis for Incomplete Contingency Tables: The Slovenian Plebiscite Case
Molenberghs, G., Kenward, M. G., & Goetghebeur, E. J. T. (2001) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/1467-9876.00217 · Cited by 97
Wood, A. (2004) · International Journal of Epidemiology · doi:10.1093/ije/dyh297 · Cited by 96
Eliciting and using expert opinions about dropout bias in randomized controlled trials
White, I. R., Carpenter, J. R., Evans, S. J. W., & Schroter, S. (2007) · Clinical Trials · doi:10.1177/1740774507077849 · Cited by 91
Self-citationReparameterizing the Pattern Mixture Model for Sensitivity Analyses Under Informative Dropout
Daniels, M. J., & Hogan, J. W. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.01241.x · Cited by 90
Sensitivity analysis for incomplete categorical data
Kenward, M. G., Goetghebeur, E. J. T., & Molenberghs, G. (2001) · Statistical Modelling · doi:10.1177/1471082x0100100104 · Cited by 77
White, I. R., Kalaitzaki, E., & Thompson, S. G. (2011) · Statistics in Medicine · doi:10.1002/sim.4360 · Cited by 67
Self-citationMissing data in clinical trials - a practical guide
Carpenter, J. R. (2007) · Cited by 66
Self-citationSutton, S. R., & Gilbert, H. M. (2007) · Addiction · doi:10.1111/j.1360-0443.2007.01831.x · Cited by 53
A graphical sensitivity analysis for clinical trials with non‐ignorable missing binary outcome
Hollis, S. (2002) · Statistics in Medicine · doi:10.1002/sim.1276 · Cited by 50
Last observation carry‐forward and last observation analysis
Carpenter, J. R., Kenward, M., Evans, S. J. W., & White, I. R. (2004) · Statistics in Medicine · doi:10.1002/sim.1891 · Cited by 35
Self-citationMissing data: Discussion points from the PSI missing data expert group
Burzykowski, T., Carpenter, J. R., Coens, C., Evans, D., France, L., Kenward, M., Lane, P. W., Matcham, J., Morgan, D., Phillips, A., et al. (2009) · Pharmaceutical Statistics · doi:10.1002/pst.391 · Cited by 30
Self-citationA modelling strategy for the analysis of clinical trials with partly missing longitudinal data
White, I. R., Moodie, E. E. M., Thompson, S. G., & Croudace, T. J. (2003) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.150 · Cited by 25
Self-citationA Practical Guide to Applying the Intention-to-Treat Principle to Clinical Trials in HIV Infection
Sabin, C. A., Cozzi‐Lepri, A., & Phillips, A. N. (2000) · HIV Clinical Trials · doi:10.1310/e9yd-7caa-p7a0-g1j7 · Cited by 22
Kenward, M. G., White, I. R., & Carpenter, J. R. (2010) · Statistics in Medicine · doi:10.1002/sim.3868 · Cited by 21
Self-citationMatts, J. P., Launer, C. A., Nelson, E. T., Miller, C., & Dain, B. J. (1997) · Statistics in Medicine · Cited by 13
Lavori, P. W., & Dawson, R. (2001) · Drug Information Journal · doi:10.1177/009286150103500405 · Cited by 13
Cited by
Oral versus Intravenous Antibiotics for Bone and Joint Infection
Li, H.-K., Rombach, I., Zambellas, R., Walker, A. S., McNally, M. A., Atkins, B. L., Lipsky, B. A., Hughes, H. C., Bose, D., Kümin, M., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1710926 · Cited by 938
Handling missing data in RCTs; a review of the top medical journals
Bell, M. L., Fiero, M., Horton, N. J., & Hsu, C.-H. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-118 · Cited by 395
“Researchers in the field of missing data, including the Panel on Handling Missing Data in Clinical Trials commissioned recently by the National Research Council, have made calls for the use of improved methods for handling missing data including sensitivity analyses, and for more rigorous approaches to ITT analysis wh…”
BackgroundMethodSelf-citationHunt, K., Wyke, S., Gray, C. M., Anderson, A. S., Brady, A., Bunn, C., Donnan, P. T., Fenwick, E., Grieve, E., Leishman, J., et al. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62420-4 · Cited by 394
“29 We tested distributions for normality and applied logarithmic transformations as appropriate.”
Sivaprasad, S., Prevost, A. T., Vasconcelos, J. C., Riddell, A., Murphy, C., Kelly, J., Bainbridge, J., Tudor-Edwards, R., Hopkins, D., Hykin, P., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31193-5 · Cited by 390
Should multiple imputation be the method of choice for handling missing data in randomized trials?
Sullivan, T. R., White, I. R., Salter, A. B., Ryan, P., & Lee, K. J. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280216683570 · Cited by 308
Self-citation
Metadata
- Authors
- White, I. R., Carpenter, J., & Horton, N. J.
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2012-07-02
- Volume
- 9
- Issue
- 4
- Pages
- 396-407
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- OpenAlex
- W1988301094
- Cited by
- 305
- References
- 64
- FWCI
- 14.98
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.