Allowing for missing outcome data and incomplete uptake of randomised interventions, with application to an Internet‐based alcohol trial
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Missing outcome data and incomplete uptake of randomised interventions are common problems, which complicate the analysis and interpretation of randomised controlled trials, and are rarely addressed well in practice. To promote the implementation of recent methodological developments, we describe sequences of randomisation‐based analyses that can be used to explore both issues. We illustrate these in an Internet‐based trial evaluating the use of a new interactive website for those seeking help to reduce their alcohol consumption, in which the primary outcome was available for less than half of the participants and uptake of the intervention was limited. For missing outcome data, we first employ data on intermediate outcomes and intervention use to make a missing at random assumption more plausible, with analyses based on general estimating equations, mixed models and multiple imputation. We then use data on the ease of obtaining outcome data and sensitivity analyses to explore departures from the missing at random assumption. For incomplete uptake of randomised interventions, we estimate structural mean models by using instrumental variable methods. In the alcohol trial, there is no evidence of benefit unless rather extreme assumptions are made about the missing data nor an important benefit in more extensive users of the intervention. These findings considerably aid the interpretation of the trial's results. More generally, the analyses proposed are applicable to many trials with missing outcome data or incomplete intervention uptake. To facilitate use by others, Stata code is provided for all methods. Copyright © 2011 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792 · cited 3×
“It is often sensible to draw imputations separately for each trial arm, because interactions between randomised group and baseline covariates may be of interest [31].”
BackgroundMethodInfluentialSelf-citationMarginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Multiple Imputation of Missing Values
Royston, P. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400301 · Cited by 2,340 · cited 1×
“Multiple imputations were drawn separately for each arm by using the chained equations approach [40] implemented in Stata [41,42].”
MethodWhat is meant by intention to treat analysis? Survey of published randomised controlled trials
Hollis, S., & Campbell, F. (1999) · BMJ · doi:10.1136/bmj.319.7211.670 · Cited by 2,160
The prevention and treatment of missing data in clinical trials
Little, R. J., D'Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., Frangakis, C., Hogan, J. W., Molenberghs, G., Murphy, S. A., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1203730 · Cited by 1,884
Modeling the Drop-Out Mechanism in Repeated-Measures Studies
Little, R. J. A. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476615 · Cited by 1,522 · cited 1×
“It is valid if the model is correctly specified and the data are ‘covariate-dependent missing completely at random’ [24]: that is, if the missing data mechanism depends only on the baseline covariates included in the model.”
BackgroundMoyer, A., Finney, J. W., Swearingen, C. E., & Vergun, P. (2002) · Addiction · doi:10.1046/j.1360-0443.2002.00018.x · Cited by 1,092 · cited 1×
“Brief interventions are effective [14] but hard to implement.”
BackgroundBayesian inference for causal effects in randomized experiments with noncompliance
Imbens, G. W., & Rubin, D. B. (1997) · The Annals of Statistics · doi:10.1214/aos/1034276631 · Cited by 538 · cited 1×
“One such method is principal stratification [10], which leads to estimation of the complier-average causal effect (CACE) [11] in problems where intervention uptake is dichotomous.”
MethodRobins, J. M., & Tsiatis, A. A. (1991) · Communications in Statistics - Theory and Methods · doi:10.1080/03610929108830654 · Cited by 423
Cited by
Pickard, R., Starr, K., MacLennan, G., Lam, T., Thomas, R., Burr, J., McPherson, G., McDonald, A., Anson, K., N'Dow, J., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60933-3 · Cited by 351
Including all individuals is not enough: Lessons for intention-to-treat analysis
White, I. R., Carpenter, J., & Horton, N. J. (2012) · Clinical Trials · doi:10.1177/1740774512450098 · Cited by 305
Self-citationBennell, K. L., Nelligan, R., Dobson, F., Rini, C., Keefe, F., Kasza, J., French, S., Bryant, C., Dalwood, A., Abbott, J. H., et al. (2017) · Annals of Internal Medicine · doi:10.7326/m16-1714 · Cited by 284
The estimands framework: a primer on the ICH E9(R1) addendum
Kahan, B. C., Hindley, J., Edwards, M., Cro, S., & Morris, T. P. (2024) · BMJ · doi:10.1136/bmj-2023-076316 · Cited by 180
Parks, A. C., Williams, A. L., Tugade, M. M., Hokes, K. E., Honomichl, R. D., & Zilca, R. D. (2018) · International Journal of Wellbeing · doi:10.5502/ijw.v8i2.745 · Cited by 87
Hardy, C., Griffiths, A., Norton, S., & Hunter, M. S. (2018) · Menopause · doi:10.1097/gme.0000000000001048 · Cited by 86
Merkouris, S. S., Rodda, S. N., Austin, D., Lubman, D. I., Harvey, P., Battersby, M., Cunningham, J., Lavis, T., Smith, D., & Dowling, N. A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-014226 · Cited by 21
“Mixed models will be used to account for this unbalanced design and time will be entered into models as a continuous covariate from the date of first intervention (baseline) to date of each follow-up measurement; (3) the main analysis performed will be valid under a plausible assumption about the missing data and use…”
MethodA pragmatic randomised controlled trial of the fostering changes programme
Moody, G., Coulman, E., Brookes-Howell, L., Cannings-John, R., Channon, S., Lau, M., Rees, A., Segrott, J., Scourfield, J., & Robling, M. (2020) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2020.104646 · Cited by 20
Metadata
- Authors
- White, I. R., Kalaitzaki, E., & Thompson, S. G.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2011-09-21
- Volume
- 30
- Issue
- 27
- Pages
- 3192-3207
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2032010130
- Cited by
- 64
- References
- 16
- FWCI
- 3.34
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.