A four-step strategy for handling missing outcome data in randomised trials affected by a pandemic
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Background: The coronavirus pandemic (Covid-19) presents a variety of challenges for ongoing clinical trials, including an inevitably higher rate of missing outcome data, with new and non-standard reasons for missingness. International drug trial guidelines recommend trialists review plans for handling missing data in the conduct and statistical analysis, but clear recommendations are lacking. Methods: We present a four-step strategy for handling missing outcome data in the analysis of randomised trials that are ongoing during a pandemic. We consider handling missing data arising due to (i) participant infection, (ii) treatment disruptions and (iii) loss to follow-up. We consider both settings where treatment effects for a ‘pandemic-free world’ and ‘world including a pandemic’ are of interest. Results: In any trial, investigators should; (1) Clarify the treatment estimand of interest with respect to the occurrence of the pandemic; (2) Establish what data are missing for the chosen estimand; (3) Perform primary analysis under the most plausible missing data assumptions followed by; (4) Sensitivity analysis under alternative plausible assumptions. To obtain an estimate of the treatment effect in a ‘pandemic-free world’, participant data that are clinically affected by the pandemic (directly due to infection or indirectly via treatment disruptions) are not relevant and can be set to missing. For primary analysis, a missing-at-random assumption that conditions on all observed data that are expected to be associated with both the outcome and missingness may be most plausible. For the treatment effect in the ‘world including a pandemic’, all participant data is relevant and should be included in the analysis. For primary analysis, a missing-at-random assumption – potentially incorporating a pandemic time-period indicator and participant infection status – or a missing-not-at-random assumption with a poorer response may be most relevant, depending on the setting. In all scenarios, sensitivity analysis under credible missing-not-at-random assumptions should be used to evaluate the robustness of results. We highlight controlled multiple imputation as an accessible tool for conducting sensitivity analyses. Conclusions: Missing data problems will be exacerbated for trials active during the Covid-19 pandemic. This four-step strategy will facilitate clear thinking about the appropriate analysis for relevant questions of interest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The prevention and treatment of missing data in clinical trials
Little, R. J., D'Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., Frangakis, C., Hogan, J. W., Molenberghs, G., Murphy, S. A., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1203730 · Cited by 1,884
Instruments for Causal Inference: An Epidemiologist's Dream?
Hernán, M. A., & Robins, J. M. (2006) · Epidemiology · doi:10.1097/01.ede.0000222409.00878.37 · Cited by 961
Carpenter, J. R., Roger, J. H., & Kenward, M. G. (2013) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2013.834911 · Cited by 286 · cited 2×
“tiple imputation methods can been implemented with continuous [7, 17, 18], binary [21, 22], ordinal [23],”
MethodSelf-citationCro, S., Morris, T. P., Kenward, M. G., & Carpenter, J. R. (2020) · Statistics in Medicine · doi:10.1002/sim.8569 · Cited by 203
Self-citationChoosing sensitivity analyses for randomised trials: principles
Morris, T. P., Kahan, B. C., & White, I. R. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-11 · Cited by 75 · cited 1×
“Sensitivity analysis should address the same question as the primary analysis [32].”
BackgroundSelf-citation
Cited by
Orkin, A. M., Gill, P. J., Ghersi, D., Campbell, L., Sugarman, J., Emsley, R., Steg, P. G., Weijer, C., Simes, J., Rombey, T., et al. (2021) · JAMA · doi:10.1001/jama.2021.9941 · Cited by 299
The estimands framework: a primer on the ICH E9(R1) addendum
Kahan, B. C., Hindley, J., Edwards, M., Cro, S., & Morris, T. P. (2024) · BMJ · doi:10.1136/bmj-2023-076316 · Cited by 180
Self-citationLi, D., Jovanovski, E., Zurbau, A., Sievenpiper, J., Milicic, D., El-Sohemy, A., & Vuksan, V. (2024) · Nutrients · doi:10.3390/nu16173018 · Cited by 3
Metadata
- Authors
- Cro, S., Morris, T. P., Kahan, B. C., Cornelius, V. R., & Carpenter, J. R.
- Venue
- BMC Medical Research Methodology
- Published
- 2020-08-12
- Volume
- 20
- Issue
- 1
- Pages
- 208-208
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W3046271428
- Cited by
- 56
- References
- 5
- FWCI
- 4.84
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A four-step strategy for handling missing outcome data in randomised trials affected by a pandemic. https://app.cochat.ai/papers/10.1186/s12874-020-01089-6
- The paper
- Cro, S., Morris, T. P., Kahan, B. C., Cornelius, V. R., & Carpenter, J. R. (2020). A four-step strategy for handling missing outcome data in randomised trials affected by a pandemic. BMC Medical Research Methodology. https://doi.org/10.1186/s12874-020-01089-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.