Addressing Dichotomous Data for Participants Excluded from Trial Analysis: A Guide for Systematic Reviewers
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
INTRODUCTION: Systematic reviewer authors intending to include all randomized participants in their meta-analyses need to make assumptions about the outcomes of participants with missing data. OBJECTIVE: The objective of this paper is to provide systematic reviewer authors with a relatively simple guidance for addressing dichotomous data for participants excluded from analyses of randomized trials. METHODS: This guide is based on a review of the Cochrane handbook and published methodological research. The guide deals with participants excluded from the analysis who were considered 'non-adherent to the protocol' but for whom data are available, and participants with missing data. RESULTS: Systematic reviewer authors should include data from 'non-adherent' participants excluded from the primary study authors' analysis but for whom data are available. For missing, unavailable participant data, authors may conduct a complete case analysis (excluding those with missing data) as the primary analysis. Alternatively, they may conduct a primary analysis that makes plausible assumptions about the outcomes of participants with missing data. When the primary analysis suggests important benefit, sensitivity meta-analyses using relatively extreme assumptions that may vary in plausibility can inform the extent to which risk of bias impacts the confidence in the results of the primary analysis. The more plausible assumptions draw on the outcome event rates within the trial or in all trials included in the meta-analysis. The proposed guide does not take into account the uncertainty associated with assumed events. CONCLUSIONS: This guide proposes methods for handling participants excluded from analyses of randomized trials. These methods can help in establishing the extent to which risk of bias impacts meta-analysis results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Self-citationRahman, A., Malik, A., Sikander, S., Roberts, C., & Creed, F. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61400-2 · Cited by 993
Post-randomisation exclusions: the intention to treat principle and excluding patients from analysis
Fergusson, D., Aaron, S. D., Guyatt, G., & Hébert, P. (2002) · BMJ · doi:10.1136/bmj.325.7365.652 · Cited by 708 · cited 1×
“[13].”
Self-citationJohnston, B. C., Ma, S. S. Y., Goldenberg, J. Z., Thorlund, K., Vandvik, P. O., Loeb, M., & Guyatt, G. H. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-12-201212180-00563 · Cited by 367
Self-citationAkl, E. A., Briel, M., You, J. J., Sun, X., Johnston, B. C., Busse, J. W., Mulla, S., Lamontagne, F., Bassler, D., Vera, C., et al. (2012) · BMJ · doi:10.1136/bmj.e2809 · Cited by 350 · cited 4×
“[2] The group developed a draft guide for handling missing participant data for continuous outcomes and refined it through an iterative process of discussion and revisions.”
BackgroundMethodResultInfluentialSelf-citationInterpreting Incomplete Data in Studies of Diet and Weight Loss
Ware, J. H. (2003) · New England Journal of Medicine · doi:10.1056/nejme030054 · Cited by 205 · cited 1×
“These single imputation techniques make an unlikely assumption that outcomes stay constant and ignore uncertainty in imputed estimates resulting in spuriously narrow confidence intervals (CIs) [4,5].”
Backgroundde Graaf, L. E., Gerhards, S. A. H., Arntz, A., Riper, H., Metsemakers, J. F. M., Evers, S. M. A. A., Severens, J. L., Widdershoven, G., & Huibers, M. J. H. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.054429 · Cited by 190
Alshurafa, M., Briel, M., Akl, E. A., Haines, T., Moayyedi, P., Gentles, S. J., Rios, L., Tran, C., Bhatnagar, N., Lamontagne, F., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049163 · Cited by 126 · cited 2×
“[7] While some methodologists suggest that ITT requires complete follow-up, others offer specific strategies for dealing with loss to follow-up under the ITT label.”
BackgroundMethodSelf-citationNeumann, I., Rada, G., Claro, J. C., Carrasco-Labra, A., Thorlund, K., Akl, E. A., Bates, S. M., & Guyatt, G. H. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-10-201205150-00421 · Cited by 94
Self-citation
Research works printed but not linked: 12
- D Moher, 2010, CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials, BMJ, 340, c869, 10.1136/bmj.c869 · DOI · Paper page
- JP Higgins, 2008, Imputation methods for missing outcome data in meta-analysis of clinical trials, Clin Trials, 5, 225, 10.1177/1740774508091600 · DOI · Paper page
- LS Magder, 2003, Simple approaches to assess the possible impact of missing outcome information on estimates of risk ratios, odds ratios, and risk differences, Controlled clinical trials, 24, 411, 10.1016/S0197-2456(03)00021-7 · DOI
- EA Akl, 2009, LOST to follow-up Information in Trials (LOST-IT): a protocol on the potential impact, Trials, 10, 40, 10.1186/1745-6215-10-40 · DOI · Paper page
- A Marshall, 2009, Combining estimates of interest in prognostic modelling studies after multiple imputation: current practice and guidelines, BMC medical research methodology, 9, 57, 10.1186/1471-2288-9-57 · DOI · Paper page
- VM Montori, 2001, Intention-to-treat principle, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne, 165, 1339
- YJ Lee, 1991, Analysis of clinical trials by treatment actually received: is it really an option?, Statistics in medicine, 10, 1595, 10.1002/sim.4780101011 · DOI · Paper page
- E Vervolgyi, 2011, Reporting of loss to follow-up information in randomised controlled trials with time-to-event outcomes: a literature survey, BMC medical research methodology, 11, 130, 10.1186/1471-2288-11-130 · DOI
- EH Geng, 2008, Sampling-Based Approach to Determining Outcomes of Patients Lost to Follow-Up in Antiretroviral Therapy Scale-Up Programs in Africa, JAMA, 300, 506, 10.1001/jama.300.5.506 · DOI · Paper page
- WW te Riele, 2010, Long-term results of laparoscopic adjustable gastric banding in patients lost to follow-up, The British journal of surgery, 97, 1535, 10.1002/bjs.7130 · DOI · Paper page
- K Unnebrink, 2001, Intention-to-treat: methods for dealing with missing values in clinical trials of progressively deteriorating diseases, Statistics in medicine, 20, 3931, 10.1002/sim.1149 · DOI · Paper page
- IR White, 2011, Strategy for intention to treat analysis in randomised trials with missing outcome data, BMJ, 342, d40, 10.1136/bmj.d40 · DOI · Paper page
Cited by
Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021
Evans, L., Rhodes, A., Alhazzani, W., Antonelli, M., Coopersmith, C. M., French, C., Machado, F. R., Mcintyre, L., Ostermann, M., Prescott, H. C., et al. (2021) · Intensive Care Medicine · doi:10.1007/s00134-021-06506-y · Cited by 5,082
Surviving Sepsis Campaign: International Guidelines for Management of Sepsis and Septic Shock 2021.
Evans, L., Rhodes, A., Alhazzani, W., Antonelli, M., Coopersmith, C. M., French, C., Machado, F. R., Mcintyre, L., Ostermann, M., Prescott, H. C., et al. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000005337 · Cited by 2,935
Alhazzani, W., Møller, M. H., Arabi, Y. M., Loeb, M., Gong, M. N., Fan, E., Oczkowski, S., Levy, M. M., Derde, L., Dzierba, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-06022-5 · Cited by 2,105
“We obtained intention-to-treat data whenever available; otherwise we used complete case data, i.e. ignoring missing data [6].”
Alhazzani, W., Møller, M. H., Arabi, Y. M., Loeb, M., Gong, M. N., Fan, E., Oczkowski, S., Levy, M. M., Derde, L., Dzierba, A., et al. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004363 · Cited by 1,565
Chu, D. K., Kim, L. H.-Y., Young, P. J., Zamiri, N., Almenawer, S. A., Jaeschke, R., Szczeklik, W., Schünemann, H. J., Neary, J. D., & Alhazzani, W. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30479-3 · Cited by 778
Metadata
- Authors
- Akl, E. A., Johnston, B. C., Alonso-Coello, P., Neumann, I., Ebrahim, S., Briel, M., Cook, D. J., & Guyatt, G. H.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-02-25
- Volume
- 8
- Issue
- 2
- Pages
- e57132
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2083815143
- Cited by
- 156
- References
- 9
- FWCI
- 4.42
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Addressing Dichotomous Data for Participants Excluded from Trial Analysis: A Guide for Systematic Reviewers. https://app.cochat.ai/papers/10.1371/journal.pone.0057132
- The paper
- Akl, E. A., Johnston, B. C., Alonso-Coello, P., Neumann, I., Ebrahim, S., Briel, M., Cook, D. J., & Guyatt, G. H. (2013). Addressing Dichotomous Data for Participants Excluded from Trial Analysis: A Guide for Systematic Reviewers. PLoS ONE. https://doi.org/10.1371/journal.pone.0057132
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.