Sensitivity analysis for clinical trials with missing continuous outcome data using controlled multiple imputation: A practical guide
Open accessAbstract
Missing data due to loss to follow-up or intercurrent events are unintended, but unfortunately inevitable in clinical trials. Since the true values of missing data are never known, it is necessary to assess the impact of untestable and unavoidable assumptions about any unobserved data in sensitivity analysis. This tutorial provides an overview of controlled multiple imputation (MI) techniques and a practical guide to their use for sensitivity analysis of trials with missing continuous outcome data. These include δ- and reference-based MI procedures. In δ-based imputation, an offset term, δ, is typically added to the expected value of the missing data to assess the impact of unobserved participants having a worse or better response than those observed. Reference-based imputation draws imputed values with some reference to observed data in other groups of the trial, typically in other treatment arms. We illustrate the accessibility of these methods using data from a pediatric eczema trial and a chronic headache trial and provide Stata code to facilitate adoption. We discuss issues surrounding the choice of δ in δ-based sensitivity analysis. We also review the debate on variance estimation within reference-based analysis and justify the use of Rubin's variance estimator in this setting, since as we further elaborate on within, it provides information anchored inference.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Sensitivity analyses using delta adjustments assessed robustness to deviations from the missing at random assumption.
“To assess the robustness to deviations of the missing at random (MAR) assumption, we applied sensitivity analyses through delta adjustments [52].”
From Effects of a self-guided digital mental health self-help intervention for Syrian refugees in Egypt: A pragmatic randomized controlled trial (2024) · cites this paper as [52]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701 · see citing works
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925 · see citing works
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792 · see citing works
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012 · see citing works
Statistical Analysis With Missing Data
Ghosh, S., Little, R. J. A., & Rubin, D. B. (1988) · Technometrics · doi:10.2307/1269814 · Cited by 4,730 · see citing works
Multiple imputation after 18+ years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476908 · Cited by 4,072 · see citing works
Multiple imputation of discrete and continuous data by fully conditional specification
van Buuren, S. (2007) · Statistical Methods in Medical Research · doi:10.1177/0962280206074463 · Cited by 2,827 · see citing works
Pattern-Mixture Models for Multivariate Incomplete Data
Little, R. J. A. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10594302 · Cited by 1,026 · see citing works
Missing Data in Clinical Studies
Molenberghs, G., & Kenward, M. G. (2007) · Wiley eBooks · doi:10.1002/9780470510445 · Cited by 969 · see citing works
Multiple Imputation and its Application
Carpenter, J. R., & Kenward, M. G. (2013) · doi:10.1002/9781119942283 · Cited by 913 · see citing works
Strategy for intention to treat analysis in randomised trials with missing outcome data
White, I. R., Horton, N. J., Carpenter, J. R., statistics, R. I. M. A. S., & Pocock, S. (2011) · BMJ · doi:10.1136/bmj.d40 · Cited by 849 · see citing works
Multiple-Imputation Inferences with Uncongenial Sources of Input
Meng, X. (1994) · Statistical Science · doi:10.1214/ss/1177010269 · Cited by 761 · see citing works
How Many Imputations Do You Need? A Two-stage Calculation Using a Quadratic Rule
von Hippel, P. T. (2018) · Sociological Methods & Research · doi:10.1177/0049124117747303 · Cited by 532 · see citing works
Handling missing data in RCTs; a review of the top medical journals
Bell, M. L., Fiero, M., Horton, N. J., & Hsu, C.-H. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-118 · Cited by 395 · see citing works
Intent-to-Treat Analysis for Longitudinal Studies with Drop-Outs
Little, R. J. A., & Yau, L. (1996) · Biometrics · doi:10.2307/2532847 · Cited by 380 · see citing works
Adjusting for partially missing baseline measurements in randomized trials
White, I. R., & Thompson, S. G. (2005) · Statistics in Medicine · doi:10.1002/sim.1981 · Cited by 378 · see citing works
Missing Data in Longitudinal Studies
Daniels, M. J., & Hogan, J. W. (2008) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420011180 · Cited by 357 · see citing works
Handbook of Missing Data Methodology
Molenberghs, G., Fitzmaurice, G. M., Kenward, M. G., Tsiatis, A. A., & Verbeke, G. N. (2014) · Chapman & Hall/CRC eBooks · doi:10.1201/b17622 · Cited by 354 · see citing works
Acupuncture for chronic headache in primary care: large, pragmatic, randomised trial
Vickers, A. J., Rees, R. W., Zollman, C., McCarney, R., Smith, C. M., Ellis, N., Fisher, P., & van Haselen, R. A. (2004) · BMJ · doi:10.1136/bmj.38029.421863.eb · Cited by 320 · see citing works
Carpenter, J. R., Roger, J. H., & Kenward, M. G. (2013) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2013.834911 · Cited by 286 · see citing works
Effects of training on quality of peer review: randomised controlled trial
Schroter, S., Black, N. A., Evans, S. J. W., Carpenter, J. R., Godlee, F., & Smith, R. W. (2004) · BMJ · doi:10.1136/bmj.38023.700775.ae · Cited by 268 · see citing works
Multiple Imputation of Missing Values: New Features for Mim
Royston, P. J., Carlin, J. B., & White, I. R. (2009) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900205 · Cited by 217 · see citing works
Billings, L. K., Doshi, A., Gouet, D., Oviedo, A., Rodbard, H. W., Tentolouris, N., Grøn, R., Halladin, N., & Jódar, E. (2018) · Diabetes Care · doi:10.2337/dc17-1114 · Cited by 196 · see citing works
Philipsen, A., Jans, T., Graf, E., Matthies, S., Borel, P., Colla, M., Gentschow, L., Langner, D., Jacob, C., Groß-Lesch, S., et al. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.2146 · Cited by 175 · see citing works
Guideline on missing data in confirmatory clinical trials
Zhang, J. (2012) · Zhongguo xin yao zazhi · Cited by 171 · see citing works
Atri, A., Frölich, L., Ballard, C. G., Tariot, P. N., Molinuevo, J. L., Boneva, N., Windfeld, K., Rakêt, L. L., & Cummings, J. L. (2018) · JAMA · doi:10.1001/jama.2017.20373 · Cited by 167 · see citing works
Ratitch, B., O'Kelly, M., & Tosiello, R. (2013) · Pharmaceutical Statistics · doi:10.1002/pst.1549 · Cited by 155 · see citing works
Whose data set is it anyway? Sharing raw data from randomized trials
Vickers, A. J. (2006) · Trials · doi:10.1186/1745-6215-7-15 · Cited by 149 · see citing works
Chan, S., Cornelius, V., Cro, S., Harper, J. I., & Lack, G. (2020) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2019.4476 · Cited by 130 · see citing works
Self-citationWilson, E., Free, C., Morris, T. P., Syred, J., Ahamed, I., Menon-Johansson, A. S., Palmer, M. J., Barnard, S., Rezel‐Potts, E., & Baraitser, P. (2017) · PLoS Medicine · doi:10.1371/journal.pmed.1002479 · Cited by 127 · see citing works
Missing Data Handling Methods in Medical Device Clinical Trials
Yan, X., Lee, S., & Li, N. (2009) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400903243009 · Cited by 104 · see citing works
Jackson, D., White, I. R., Seaman, S. R., Evans, H., Baisley, K. J., & Carpenter, J. R. (2014) · Statistics in Medicine · doi:10.1002/sim.6274 · Cited by 91 · see citing works
A review of the handling of missing longitudinal outcome data in clinical trials
Powney, M., Williamson, P. R., Kirkham, J. J., & Kolamunnage‐Dona, R. (2014) · Trials · doi:10.1186/1745-6215-15-237 · Cited by 88 · see citing works
Eliciting and using expert opinions about dropout bias in randomized controlled trials
White, I. R., Carpenter, J. R., Evans, S. J. W., & Schroter, S. (2007) · Clinical Trials · doi:10.1177/1740774507077849 · Cited by 85 · see citing works
Choosing sensitivity analyses for randomised trials: principles
Morris, T. P., Kahan, B. C., & White, I. R. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-11 · Cited by 75 · see citing works
Self-citationCro, S., Morris, T. P., Kenward, M. G., & Carpenter, J. R. (2016) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x1601600211 · Cited by 67 · see citing works
Self-citationHow Many Imputations Do You Need? A Two-stage Calculation Using a Quadratic Rule
Hippel, P. T. V. (2020) · Sage Journals Data · doi:10.25384/sage.c.5070020 · Cited by 66 · see citing works
Preventing and Treating Missing Data in Longitudinal Clinical Trials
Mallinckrodt, C. H. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9781139381666 · Cited by 64 · see citing works
Jans, T., Jacob, C., Warnke, A., Zwanzger, U., Groß‐Lesch, S., Matthies, S., Borel, P., Hennighausen, K., Haack‐Dees, B., Rösler, M., et al. (2015) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12443 · Cited by 56 · see citing works
Ayele, B. T., Lipkovich, I. A., Molenberghs, G., & Mallinckrodt, C. H. (2014) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2013.859148 · Cited by 52 · see citing works
Sensitivity to censored‐at‐random assumption in the analysis of time‐to‐event endpoints
Lipkovich, I. A., Ratitch, B., & O’Kelly, M. (2016) · Pharmaceutical Statistics · doi:10.1002/pst.1738 · Cited by 48 · see citing works
Missing data sensitivity analysis for recurrent event data using controlled imputation
Keene, O. N., Roger, J., Hartley, B. F., & Kenward, M. G. (2014) · Pharmaceutical Statistics · doi:10.1002/pst.1624 · Cited by 47 · see citing works
Information-Anchored Sensitivity Analysis: Theory and Application
Cro, S., Carpenter, J. R., & Kenward, M. G. (2018) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/rssa.12423 · Cited by 47 · see citing works
Self-citationMason, A. J., Gomes, M., Grieve, R., Ulug, P., Powell, J. T., & Carpenter, J. R. (2017) · Clinical Trials · doi:10.1177/1740774517711442 · Cited by 44 · see citing works
An analytic method for the placebo‐based pattern‐mixture model
Lu, K. (2013) · Statistics in Medicine · doi:10.1002/sim.6008 · Cited by 42 · see citing works
Recent Developments in the Prevention and Treatment of Missing Data
Mallinckrodt, C. H., Roger, J., Chuang‐Stein, C., Molenberghs, G., O’Kelly, M., Ratitch, B., Janssens, M., & Bunouf, P. (2013) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479013501310 · Cited by 40 · see citing works
Reference‐based sensitivity analysis for time‐to‐event data
Atkinson, A., Kenward, M. G., Clayton, T. C., & Carpenter, J. R. (2019) · Pharmaceutical Statistics · doi:10.1002/pst.1954 · Cited by 32 · see citing works
Seaman, S. R., White, I. R., & Leacy, F. P. (2014) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2014.928306 · Cited by 28 · see citing works
Lu, K., Li, D., & Koch, G. G. (2015) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2015.1053572 · Cited by 27 · see citing works
White, I. R., Joseph, R., & Best, N. (2019) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2019.1684308 · Cited by 27 · see citing works
Chan, S., Cornelius, V. R., Chen, T., Radulović, S., Wan, M., Jahan, R., & Lack, G. (2017) · Trials · doi:10.1186/s13063-017-1809-7 · Cited by 26 · see citing works
Kenward, M. G. (2015) · Clinical Investigation · doi:10.4155/cli.14.132 · Cited by 25 · see citing works
Tang, Y. (2018) · Statistics in Medicine · doi:10.1002/sim.7583 · Cited by 21 · see citing works
Sensitivity analyses for partially observed recurrent event data
Akacha, M., & Ogundimu, E. (2015) · Pharmaceutical Statistics · doi:10.1002/pst.1720 · Cited by 19 · see citing works
Carpenter, J. R., Roger, J., Cro, S., & Kenward, M. G. (2014) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2014.960085 · Cited by 16 · see citing works
Self-citationChen, T., Chan, S., Lack, G., Cro, S., & Cornelius, V. R. (2017) · Trials · doi:10.1186/s13063-017-1976-6 · Cited by 14 · see citing works
Self-citationControl‐based imputation for sensitivity analyses in informative censoring for recurrent event data
Gao, F., Liu, G., Zeng, D., Xu, L., Lin, B., Diao, G.-Q., Golm, G., Heyse, J., & Ibrahim, J. (2017) · Pharmaceutical statistics · doi:10.1002/pst.1821 · Cited by 14 · see citing works
Multiple imputation of missing blood pressure covariates in survival analysis
van Buuren, S., Boshuizen, H. C., & Knook, D. L. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990330)18:6
Flagged first, then by citations
Research works printed but not linked: 8
- National Research Council. The prevention and treatment of missing data in clinical trials. panel on handling missing data in clinical trials. Committee on National Statistics, Division of Behavioural and Social Sciences Education. Washington, DC: The National Academies Press; 2010.
- Ich, C. H. M. P. ICH E9 (R1) addendum on estimands and sensitivity analysis in clinical trials to the guideline on statistical princi- ples for clinical trials. Proceedings of the International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use; 2019.
- O'Kelly M, Ratitch B. Multiple Imputation. New York, NY: John Wiley & Sons Ltd; 2014:284-319.
- Ayele BT, Lipkovich I, Molenberghs G, Mallinckrodt CH. A multiple-imputation-based approach to sensitivity analyses and effectiveness assessments in longitudinal clinical trials. J Biopharmaceut Stat. 2014;24(2):211-228.
- Rubin DB. Multiple imputations in sample surveys -a phenomenological Bayesian approach to nonresponse. Paper presented at: Proceedings of the Survey Research Methods Section of the American Statistical Association; 1978:20-28.
- Carpenter JR, Roger JH, Cro S, Kenward MG. Response to comments by seaman et al. on analysis of longitudinal trials with protocol devia- tion, a framework for relevant, accessible assumptions, and inference via multiple imputation. J Biopharmaceut Stat. 2014;24(6):1363-1369.
- Rehal S. Implications of Missing Data in Tuberculosis Non-inferiority Clinical Trials (PhD Thesis). London, UK: University College London, University of London; 2018.
- Atkinson A. Reference Based Sensitivity Analysis for Time-to-Event Data (PhD thesis). London, UK: Department of Medical Statistics, London School of Hygiene & Tropical Medicine, University of London; 2018.
Cited by
Sorted by citations
Li, J., Xia, W., Zhan, C., Liu, S., Yin, Z., Wang, J., Chong, Y., Zheng, C., Fang, X., Cheng, W., et al. (2021) · Thorax · doi:10.1136/thoraxjnl-2021-217382 · Cited by 272 · see citing works
Tesfaye, S. H., SLOAN, G. P., Petrie, J., White, D. A., Bradburn, M. J., Julious, S. A., Rajbhandari, S. M., Sharma, S., Rayman, G. A., Gouni, R., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(22)01472-6 · Cited by 227 · see citing works
Missing data: A statistical framework for practice
Carpenter, J. R., & Smuk, M. (2021) · Biometrical Journal · doi:10.1002/bimj.202000196 · Cited by 198 · see citing works
Self-citationHe, Y., Yang, L., Zhu, X., Wu, B., Zhang, S., Qian, C., & Tian, T. (2022) · Journal of Medical Internet Research · doi:10.2196/40719 · Cited by 178 · see citing works
Intermittently scanned continuous glucose monitoring for type 1 diabetes
Leelarathna, L., Evans, M. L., Neupane, S., Rayman, G., Lumley, S., Cranston, I., Narendran, P., Barnard-Kelly, K., Sutton, C. J., Elliott, R. A., et al. (2022) · New England Journal of Medicine · doi:10.1056/nejmoa2205650 · Cited by 174 · see citing works
The estimands framework: a primer on the ICH E9(R1) addendum
Kahan, B. C., Hindley, J., Edwards, M., Cro, S., & Morris, T. P. (2024) · BMJ · doi:10.1136/bmj-2023-076316 · Cited by 180 · see citing works
Self-citationPlanning a method for covariate adjustment in individually randomised trials: a practical guide
Morris, T. P., Walker, A. S., Williamson, E. J., & White, I. R. (2022) · Trials · doi:10.1186/s13063-022-06097-z · Cited by 97 · see citing works
Self-citationA four-step strategy for handling missing outcome data in randomised trials affected by a pandemic
Cro, S., Morris, T. P., Kahan, B. C., Cornelius, V. R., & Carpenter, J. R. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01089-6 · Cited by 57 · see citing works
Self-citationCarter, M. J., Frykberg, R. G., Oropallo, A., Sen, C. K., Armstrong, D. G., Nair, H. K. R., & Serena, T. E. (2023) · Advances in Wound Care · doi:10.1089/wound.2022.0041 · Cited by 55 · see citing works
Low-Dose Triple-Pill vs Standard-Care Protocols for Hypertension Treatment in Nigeria
Ojji, D. B., Salam, A., Sani, M. U., Ogah, O. S., Schutte, A. E., Huffman, M. D., Pant, R., Ghosh, A., Dhurjati, R., Lakshmi, J. K., et al. (2024) · JAMA · doi:10.1001/jama.2024.18080 · Cited by 43 · see citing works
Tan, P.-T., Cro, S., Vogt, E. V., Szigeti, M., & Cornelius, V. R. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01261-6 · Cited by 43 · see citing works
Self-citationPigeon, W. R., Crean, H. F., Cerulli, C., Gallegos, A. M., Bishop, T. M., & Heffner, K. L. (2021) · Psychotherapy and Psychosomatics · doi:10.1159/000517862 · Cited by 43 · see citing works
Takazawa, T., Horiuchi, T., Orihara, M., Nagumo, K., Tomioka, A., Ideno, Y., Hayashi, K., Yashima, H., Araki, T., Hatayama, K., et al. (2022) · Anesthesiology · doi:10.1097/aln.0000000000004439 · Cited by 41 · see citing works
Crooks, M. G., Elkes, J., Storrar, W., Roy, K. C., North, M., Blythin, A. M., Watson, A., Cornelius, V. R., & Wilkinson, T. M. A. (2020) · ERJ Open Research · doi:10.1183/23120541.00460-2020 · Cited by 41 · see citing works
Standard and reference‐based conditional mean imputation
Wolbers, M., Noci, A., Delmar, P., Gower‐Page, C., Yiu, S., & Bartlett, J. W. (2022) · Pharmaceutical Statistics · doi:10.1002/pst.2234 · Cited by 41 · see citing works
Gilligan, C. J., Volschenk, W., Russo, M. A., Green, M., Gilmore, C. A., Mehta, V., Deckers, K., Smedt, K. D., Latif, U., Sayed, D., et al. (2024) · Neuromodulation Technology at the Neural Interface · doi:10.1016/j.neurom.2024.01.006 · Cited by 41 · see citing works
Evaluation of randomized controlled trials: a primer and tutorial for mental health researchers
Harrer, M., Cuijpers, P. J., Schuurmans, L., Kaiser, T., Buntrock, C., van Straten, A., & Ebert, D. D. (2023) · Trials · doi:10.1186/s13063-023-07596-3 · Cited by 37 · see citing works
Cro, S., Cornelius, V. R., Pink, A., Wilson, R., Pushpa‐Rajah, A., Patel, P., Abdul‐Wahab, A., August, S., Azad, J., Becher, G., et al. (2021) · British Journal of Dermatology · doi:10.1111/bjd.20653 · Cited by 35 · see citing works
Self-citationBrown, C. H., Lewis, A., Probert, J. M., Parish, M., Tian, J., Mandal, K., Everett, A. D., Colantuoni, E., Kamath, V. J., Hogue, C. W. J., et al. (2022) · Anesthesiology · doi:10.1097/aln.0000000000004327 · Cited by 35 · see citing works
Dhillon, S. K., Ganggayah, M. D., Sinnadurai, S., Lió, P., & Taib, N. A. M. (2022) · Diagnostics · doi:10.3390/diagnostics12102526 · Cited by 41 · see citing works
Cooper, K. G., Bhattacharya, S., DANIELS, J. P., Horne, A. W., Clark, T. J., Sarıdoğan, E., Cheed, V., Pirie, D., Melyda, M., Monahan, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-079006 · Cited by 33 · see citing works
Missing repeated measures data in clinical trials
Pugh, S. L., Brown, P. D., & Enserro, D. M. (2021) · Neuro-Oncology Practice · doi:10.1093/nop/npab043 · Cited by 33 · see citing works
Sankaranarayanan, S., Balan, J., Walsh, J. R., Wu, Y., Minnich, S., Piazza, A. L., Osborne, C., Oliver, G. R., Lesko, J., Bates, K. L., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/30157 · Cited by 31 · see citing works
Saltbæk, L., Bidstrup, P. E., Karlsen, R. V., Høeg, B. L., Horsbøl, T. A., Belmonte, F., Andersen, E. W., Zoffmann, V., Friberg, A. S., Svendsen, M. N., et al. (2024) · Journal of Clinical Oncology · doi:10.1200/jco.23.01447 · Cited by 28 · see citing works
Addressing missing outcome data in randomised controlled trials: A methodological scoping review
Medcalf, E., Turner, R. M., Espinoza, D., He, V., & Bell, K. (2024) · Contemporary Clinical Trials · doi:10.1016/j.cct.2024.107602 · Cited by 29 · see citing works
Jamison, R. N., Edwards, R. R., Curran, S., Wan, L., Ross, E. L., Gilligan, C. J., & Gozani, S. N. (2021) · Journal of Pain Research · doi:10.2147/jpr.s316371 · Cited by 29 · see citing works
The importance of long-term follow-up in clinical trials
Norrie, J. D. (2023) · The Lancet Global Health · doi:10.1016/s2214-109x(23)00244-9 · Cited by 27 · see citing works
A framework for handling missing accelerometer outcome data in trials
Tackney, M. S., Cook, D. G., Stahl, D. R., Ismail, K., Williamson, E., & Carpenter, J. R. (2021) · Trials · doi:10.1186/s13063-021-05284-8 · Cited by 27 · see citing works
Missing Data in Clinical Studies
Chowdhry, A. K., Gondi, V., & Pugh, S. L. (2021) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2021.02.042 · Cited by 27 · see citing works
Missing data: Issues, concepts, methods
Pham, T. M., Pandis, N., & White, I. R. (2024) · Seminars in Orthodontics · doi:10.1053/j.sodo.2024.01.007 · Cited by 25 · see citing works
Curnow, E., Carpenter, J. R., Heron, J., Cornish, R., Rach, S., Didelez, V., Langeheine, M., & Tilling, K. M. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.06.011 · Cited by 24 · see citing works
Impute the missing data using retrieved dropouts
Wang, S., & Hu, H. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01509-9 · Cited by 24 · see citing works
Defining estimands using a mix of strategies to handle intercurrent events in clinical trials
Qu, Y., Shurzinske, L., & Sethuraman, S. (2020) · Pharmaceutical Statistics · doi:10.1002/pst.2078 · Cited by 23 · see citing works
Kvale, G., Frisk, B., Jürgensen, M., Børtveit, T., Ødegaard-Olsen, Ø. T., Wilhelmsen‐Langeland, A., Aarli, B. B., Sandnes, K., Rykken, S., Haugstvedt, A., et al. (2021) · JMIR Research Protocols · doi:10.2196/32216 · Cited by 22 · see citing works
Comparative Impact of Depressive Symptoms and FEV1% on Chronic Obstructive Pulmonary Disease
O’Toole, J., Woo, H., Putcha, N., Cooper, C. B., Woodruff, P. G., Kanner, R. E., Paine, R., Bowler, R. P., Comellas, A. P., Hoth, K. F., et al. (2021) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202009-1187oc · Cited by 21 · see citing works
Mental Health Care Support in Rural India
Maulik, P. K., Daniel, M., Devarapalli, S., Kallakuri, S., Kaur, A., Ghosh, A., Billot, L., Mukherjee, A., Sagar, R., Kant, S., et al. (2024) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2024.2305 · Cited by 21 · see citing works
Scientific Fact-Checking: A Survey of Resources and Approaches
Vladika, J., & Matthes, F. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.387 · Cited by 24 · see citing works
Burchert, S., Alkneme, M. S., Alsaod, A., Cuijpers, P., Heim, E., Hessling, J., Hosny, N., Sijbrandij, M., van’t Hof, E., Ventevogel, P., et al. (2024) · PLoS Medicine · doi:10.1371/journal.pmed.1004460 · Cited by 18 · see citing works
Lancker, K. V., Tarima, S. S., Bartlett, J. W., Bauer, M., Dharan, B., Bretz, F., Flournoy, N., Michiels, H., Parra, C. O., Rosenberger, J. L., et al. (2022) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2022.2094459 · Cited by 18 · see citing works
Self-citationrbmi: A R package for standard and reference-based multiple imputation methods
Gower‐Page, C., Noci, A., & Wolbers, M. (2022) · The Journal of Open Source Software · doi:10.21105/joss.04251 · Cited by 17 · see citing works
Tesfaye, S. H., SLOAN, G. P., Petrie, J., White, D. A., Bradburn, M. J., Young, T. A., Rajbhandari, S. M., Sharma, S., Rayman, G. A., Gouni, R., et al. (2022) · Health Technology Assessment · doi:10.3310/rxuo6757 · Cited by 17 · see citing works
Harvey, L. A., Glinsky, J. V., Chu, J., Herbert, R., Liu, H., Jan, S., Billot, L., Scivoletto, G., Spooren, A. I. F., Seelen, H. A. M., et al. (2023) · Spinal Cord · doi:10.1038/s41393-023-00908-z · Cited by 16 · see citing works
Digital Self-Management Platform for Adult Asthma: Randomized Attention-Placebo Controlled Trial
Kandola, A. A., Edwards, K., Straatman, J., Dührkoop, B., Hein, B., & Hayes, J. (2024) · Journal of Medical Internet Research · doi:10.2196/50855 · Cited by 16 · see citing works
Advancing the Surgical Treatment of Intracerebral Hemorrhage: Study Design and Research Directions
Dammers, R., Beck, J., Volovici, V., Anderson, C. S., & Klijn, C. J. M. (2022) · World Neurosurgery · doi:10.1016/j.wneu.2022.01.084 · Cited by 16 · see citing works
A Comparison of Estimand and Estimation Strategies for Clinical Trials in Early Parkinson’s Disease
Noci, A., Wolbers, M., Abt, M., Baayen, C., Burger, H. U., Jin, M., & Robieson, W. (2022) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2022.2116476 · Cited by 15 · see citing works
Fladeboe, K., Scott, S., Comiskey, L., Zhou, C., Yi‐Frazier, J. P., & Rosenberg, A. R. (2022) · BMC Palliative Care · doi:10.1186/s12904-022-00966-9 · Cited by 16 · see citing works
Mooney, K. H., Coombs, L. A., Whisenant, M., Wilson, C. M., Moraitis, A. M., Steinbach, M. N., Sloss, E. A., Lloyd, J. L. E., Alekhina, N., Berry, P. H., et al. (2023) · Cancer · doi:10.1002/cncr.35131 · Cited by 15 · see citing works
Marini, C. F., Tadger, P., Chávez-Guevara, I. A., Tipton, E., Meucci, M., Николовски, З., Amaro‐Gahete, F. J., & Peric, R. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20010453 · Cited by 15 · see citing works
Rehal, S., Cro, S., Phillips, P. P. J., Fielding, K., & Carpenter, J. R. (2023) · Clinical Trials · doi:10.1177/17407745231176773 · Cited by 14 · see citing works
Self-citationOperationalization of Cochrane’s Risk of Bias 2 Tool (RoB 2) in the Context of Psychotherapy TrialsPreprint
Miguel, C., Harrer, M., Karyotaki, E., Sakher, E., Sakata, M., Furukawa, T. A., & Cuijpers, P. J. (2025) · medRxiv · doi:10.1101/2025.06.26.25330349 · Cited by 14 · see citing works
Nelson, L. D., Magnus, B. E., Yue, J. K., Balsis, S. M., Patrick, C. J., Temkin, N., Yuh, E. L., Diaz-Arrastia, R. R., Ryu, E., Maas, A. I. R., et al. (2025) · EBioMedicine · doi:10.1016/j.ebiom.2025.106001 · Cited by 13 · see citing works
Multiple imputation approaches for epoch-level accelerometer data in trials
Tackney, M. S., Williamson, E., Cook, D. G., Limb, E. S., Harris, T. J., & Carpenter, J. R. (2023) · Statistical Methods in Medical Research · doi:10.1177/09622802231188518 · Cited by 12 · see citing works
Missing Outcome Data in Recent Perinatal and Neonatal Clinical Trials
Li, G., Liu, Y., Zhang, J., DeMauro, S. B., Meng, Q., Mbuagbaw, L. C. E., Schmidt, B. K., Kirpalani, H. M., & Thabane, L. (2024) · PEDIATRICS · doi:10.1542/peds.2023-063101 · Cited by 12 · see citing works
Sadiq, S., Noor, R., & Akram, R. (2025) · JMIR mhealth and uhealth · doi:10.2196/64643 · Cited by 12 · see citing works
Gorst‐Rasmussen, A., & Tarp-Johansen, M. J. (2022) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2022.2058525 · Cited by 12 · see citing works
Substantive model compatible multilevel multiple imputation: A joint modeling approach
Quartagno, M., & Carpenter, J. R. (2022) · Statistics in Medicine · doi:10.1002/sim.9549 · Cited by 12 · see citing works
Schadler, P. W., Lohberger, B., Thauerer, B., Faschingbauer, M., Kullich, W., Stradner, M. H., Leithner, A., Ritschl, V., Omara, M., & Steinecker-Frohnwieser, B. (2022) · Cartilage · doi:10.1177/19476035211069251 · Cited by 12 · see citing works
Rahman, E., Rao, P., Nassif, A. D., Webb, W. R., Wu, W. T. L., & CARRUTHERS, J. D. A. (2025) · European Journal of Plastic Surgery · doi:10.1007/s00238-025-02331-4 · Cited by 11 · see citing works
Ali, M. K., Singh, K., Kondal, D., Devarajan, R., Patel, S. A., Menon, V. U., Varthakavi, P. K., Vishwanathan, V., Dharmalingam, M., Bantwal, G., et al. (2024) · PLOS Medicine · doi:10.1371/journal.pmed.1004335 · Cited by 10 · see citing works
Mainzer, R., Moreno‐Betancur, M., Nguyen, C. D., Simpson, J. A., Carlin, J. B., & Lee, K. J. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-065576 · Cited by 10 · see citing works
Demnitz‐King, H., Adeleke, M., Barber, J., Poppe, M., Budgett, J., Alberts, S., Duffy, L., Minihane, A. M., Gillings, R., Chapman, H., et al. (2025) · The Lancet Healthy Longevity · doi:10.1016/j.lanhl.2025.100777 · Cited by 10 · see citing works
Khan, N. A., Torralba, K. D., & Aslam, F. (2021) · RMD Open · doi:10.1136/rmdopen-2021-001708 · Cited by 10 · see citing works
Mackay, E., Zulch, H., & Mills, D. (2023) · Animals · doi:10.3390/ani13050859 · Cited by 6 · see citing works
Kawabata, E., Major‐Smith, D., Clayton, G., Shapland, C. Y., Morris, T. P., Carter, A. R., Fernández‐Sanlés, A., Borges, M. C., Tilling, K. M., Griffith, G. J., et al. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02382-4 · Cited by 9 · see citing works
Comparison of dual therapies for hypertension treatment in India: a randomized clinical trial
Prabhakaran, D., Roy, A., Chandrasekaran, A. M., Kondal, D., Mukherjee, S., Kiru, G., Singh, K., Salwa, H., Christa, E., Lobo, A. S., et al. (2025) · Nature Medicine · doi:10.1038/s41591-025-03854-w · Cited by 9 · see citing works
Stockton, B., Strange, C. C., & Harel, O. (2023) · Journal of Quantitative Criminology · doi:10.1007/s10940-023-09577-w · Cited by 9 · see citing works
Rapaport, P., Amador, S., Adeleke, M., Banerjee, S., Barber, J., Charlesworth, G. M., Clarke, C., Connell, C., Espie, C. A., Gonzalez, L., et al. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-075273 · Cited by 9 · see citing works
Taye, B. A., Weldearegay, B. Y., Yirsaw, B. G., Demsie, M. E., Asfaw, F. F., Teka, A. B., & Belete, A. K. (2025) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-025-07287-8 · Cited by 8 · see citing works
Sensitivity analyses in longitudinal clinical trials via distributional imputation
Liu, S., Yang, S., Zhang, Y., & Liu, G. F. (2022) · Statistical Methods in Medical Research · doi:10.1177/09622802221135251 · Cited by 8 · see citing works
Emollient application from birth to prevent eczema in high-risk children: the BEEP RCT
Bradshaw, L. E., Wyatt, L. A., Brown, S., Haines, R., Montgomery, A. A., Perkin, M. R., Sach, T., Lawton, S., Flohr, C., Ridd, M. J., et al. (2024) · Health Technology Assessment · doi:10.3310/rhdn9613 · Cited by 8 · see citing works
Lyman, K. S., Athinarayanan, S. J., McKenzie, A. L., Pearson, C. L., Adams, R. N., Hallberg, S. J., McCarter, J. P., Volek, J. S., Phinney, S. D., & Andrawis, J. P. (2022) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-022-05258-0 · Cited by 8 · see citing works
Li, J., Xia, W., Zhan, C., Liu, S., Yin, Z., Wang, J., Chong, Y., Zheng, C., Fang, X., Cheng, W., et al. (2021) · medRxiv · doi:10.1101/2021.03.08.21253007 · Cited by 8 · see citing works
A Tutorial for Handling Suspected Missing Not at Random Data in Longitudinal Clinical Trials
Peugh, J., Toland, M. D., & Harrison, H. (2023) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.19.4.p347 · Cited by 7 · see citing works
Kiru, G., Roy, A., Kondal, D., Chandrasekaran, A. M., Mukherjee, S., Mohan, B., Singh, K., Salwa, H., Christa, E., Lobo, A. S., et al. (2024) · International Journal of Cardiology Cardiovascular Risk and Prevention · doi:10.1016/j.ijcrp.2024.200346 · Cited by 7 · see citing works
Westrupp, E. M., Bates, M., Bufton, K., Berkowitz, T. B., Popple, M., King, G., Jones, S., Stone, J., Kupper, J. J. C. F., Toumbourou, J., et al. (2025) · BMC Psychology · doi:10.1186/s40359-025-03018-y · Cited by 9 · see citing works
Imputation methods for informative censoring in survival analysis with time dependent covariates
Jin, M. (2023) · Contemporary Clinical Trials · doi:10.1016/j.cct.2023.107401 · Cited by 7 · see citing works
Malta, F. A. P. S., & Gonçalves, D. C. (2024) · Frontiers in Endocrinology · doi:10.3389/fendo.2023.1146479 · Cited by 7 · see citing works
Yanling, Z., Hong, L., Wang, C., Nie, Y., Xiong, Y., Zheng, Z., & Zhu, J. (2024) · Journal of Integrative and Complementary Medicine · doi:10.1089/jicm.2023.0490 · Cited by 7 · see citing works
Hazewinkel, A., Bowden, J., Wade, K. H., Palmer, T., Wiles, N., & Tilling, K. M. (2022) · Statistics in Medicine · doi:10.1002/sim.9299 · Cited by 7 · see citing works
Zarama, V., Revelo‐Noguera, J., Quintero, J., Manzano-Núñez, R., Uribe‐Buriticá, F. L., Carvajal, D. F., Ochoa, L. M., Valencia‐Orozco, A., Sánchez, Á., & Ospina-Tascón, G. A. (2023) · Academic Emergency Medicine · doi:10.1111/acem.14651 · Cited by 7 · see citing works
Ssewamala, F. M., Sauceda, J. A., Brathwaite, R., Neilands, T. B., Nabunya, P., Brown, D. S., Bahar, O. S., Namuwonge, F., Nakasujja, N., Mugarura, A., et al. (2023) · BMC Public Health · doi:10.1186/s12889-023-15564-4 · Cited by 7 · see citing works
Schuster, N. M., Wallace, M. S., Marcotte, T. D., Buse, D. C., Lee, E., Liu, L., & Sexton, M. (2025) · Headache The Journal of Head and Face Pain · doi:10.1111/head.70025 · Cited by 7 · see citing works
Evolution of Investigating Informed Assent Discussions about CPR in Seriously Ill Patients
Stapleton, R. D., Ford, D. W., Sterba, K. R., Nadig, N. R., Ades, S., Back, A. L., Carson, S. S., Cheung, K. L., Ely, J., Kross, E. K., et al. (2022) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2022.03.009 · Cited by 6 · see citing works
Yang, S., Yu, B., Liao, K., Qiao, X., Fan, Y., Li, M., Hu, Y., Chen, J., Ye, T., Cai, C., et al. (2024) · BMC Public Health · doi:10.1186/s12889-023-17073-w · Cited by 6 · see citing works
Bissonnette, R., Eichenfield, L. F., Simpson, E. L., Thaçi, D., Kabashima, K., Thyssen, J. P., Guttman‐Yassky, E., Nunes, F. P., Gamalo, M., Ahmad, F., et al. (2023) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.18881 · Cited by 6 · see citing works
Digitally managing depression: A fully remote randomised attention-placebo controlled trial
Kandola, A. A., Edwards, K., Mueller, M. A. E., Dührkoop, B., Hein, B., Straatman, J., & Hayes, J. (2024) · Digital Health · doi:10.1177/20552076241260409 · Cited by 5 · see citing works
Cooper, K. G., Bhattacharya, S., DANIELS, J. P., Cheed, V., Gennard, L., Leighton, L., Pirie, D., Melyda, M., Monahan, M., Weckesser, A., et al. (2024) · Health Technology Assessment · doi:10.3310/sqwy6998 · Cited by 8 · see citing works
Döpfner, M., Görtz‐Dorten, A., Häge, A., Handermann, F., Sulprizio, L., Hellmich, M., Vogel, D., Ruhmann, M., Althen, H., Karus, M., et al. (2025) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-025-02799-2 · Cited by 5 · see citing works
Lau, M., Lowe, J., Pickles, T., Hood, K., Kotecha, S., & Gillespie, D. (2022) · Trials · doi:10.1186/s13063-022-06604-2 · Cited by 5 · see citing works
Baek, W.-J., Pohl, C., Pelcz, P., Kröger, T., & Asfour, T. (2022) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids53995.2022.10000206 · Cited by 5 · see citing works
Parker, R. A., Weir, C. J., Pham, T. M., White, I. R., Stallard, N., Parmar, M., Swingler, R. J., Dakin, R. S., Pal, S., & Chandran, S. (2023) · Trials · doi:10.1186/s13063-022-07007-z · Cited by 5 · see citing works
Compton, M. T., Kelley, M. E., Anderson, S., Ellis, S., Graves, J., Broussard, B., Pauselli, L., Zern, A., Pope, L. G., Johnson, M., et al. (2023) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.22m14498 · Cited by 5 · see citing works
Methods for Informative Censoring in Time-to-Event Data Analysis
Jin, M., & Fang, Y. (2023) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2023.2182355 · Cited by 5 · see citing works
Cro, S., Morris, T. P., Roger, J., & Carpenter, J. R. (2024) · Pharmaceutical Statistics · doi:10.1002/pst.2373 · Cited by 5 · see citing works
Self-citationGarcía‐Hernandez, A., Pérez, T., Pardo, M. D. C., & Rizopoulos, D. (2022) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2022.2151506 · Cited by 5 · see citing works
Missing data, part 3. How to explore missing data
Pham, T. M., Pandis, N., & White, I. R. (2022) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2022.05.002 · Cited by 5 · see citing works
Unraveling large-scale spatial patterns and key drivers of heavy metals uptake by plants
Zhou, N., Hu, T., Wu, M., Qi, C., Chai, L., & Lin, Z. (2026) · Ecological Indicators · doi:10.1016/j.ecolind.2025.114576 · Cited by 4 · see citing works
Welch, C., Förster, M., Ronaldson, S. J., Keding, A., Corbacho, B., & Tharmanathan, P. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02248-9 · Cited by 4 · see citing works
Goudman, L., Molenberghs, G., Duarte, R. V., & Moens, M. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10214897 · Cited by 4 · see citing works
Marr, C., McDowell, B., Holmes, C., Edwards, C. J., Cardwell, C. R., McHenry, M., Meenagh, G., Teeling, J. L., & McGuinness, B. (2024) · Journal of Alzheimer s Disease · doi:10.3233/jad-231329 · Cited by 4 · see citing works
- Authors
- Cro, S., Morris, T. P., Kenward, M. G., & Carpenter, J. R.
- Affiliations
- Imperial College London (GB)
- London School of Hygiene & Tropical Medicine (GB)
- Ashkirk Scotland UK
- Corresponding author
- Cro, Suzie
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2020-05-17
- Volume
- 39
- Issue
- 21
- Pages
- 2815-2842
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W3026799785
- Cited by
- 203
- References
- 58
- Citations by year
- 2026: 29 · 2025: 45 · 2024: 36 · 2023: 30 · 2022: 39 · 2021: 21 · 2020: 3
- FWCI
- 16.40
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Statistics in Medicine (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Spiral (Imperial College London) (submittedVersion, other-oa)
- Funders
- Medical Research Council (MC_UU_12023/21, MC_UU_12023/29, grant numbers MC_UU_12023/21 and MC_UU_12023/29)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- missing data, sensitivity analysis, loss to follow-up, intercurrent events, Stata code
- MeSH terms
- Child, Data Interpretation, Statistical, Humans
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review