Reporting of missing data and methods used to accommodate them in recent analgesic clinical trials: ACTTION systematic review and recommendations
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Missing data in clinical trials can bias estimates of treatment effects. Statisticians and government agencies recommend making every effort to minimize missing data. Although statistical methods are available to accommodate missing data, their validity depends on often untestable assumptions about why the data are missing. The objective of this study was to assess the frequency with which randomized clinical trials published in 3 major pain journals (ie, European Journal of Pain, Journal of Pain, and Pain) reported strategies to prevent missing data, the number of participants who completed the study (ie, completers), and statistical methods to accommodate missing data. A total of 161 randomized clinical trials investigating treatments for pain, published between 2006 and 2012, were included. Approximately two-thirds of the trials reported at least 1 method that could potentially minimize missing data, the most common being allowance of concomitant medications. Only 61% of the articles explicitly reported the number of patients who were randomized and completed the trial. Although only 14 articles reported that all randomized participants completed the study, fewer than 50% of the articles reported a statistical method to accommodate missing data. Last observation carried forward imputation was used most commonly (42%). Thirteen articles reported more than 1 method to accommodate missing data; however, the majority of methods, including last observation carried forward, were not methods currently recommended by statisticians. Authors, reviewers, and editors should prioritize proper reporting of missing data and appropriate use of methods to accommodate them so as to improve the deficiencies identified in this systematic review.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group* (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-11-201006010-00232 · Cited by 3,824
The prevention and treatment of missing data in clinical trials
Little, R. J., D'Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., Frangakis, C., Hogan, J. W., Molenberghs, G., Murphy, S. A., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1203730 · Cited by 1,884 · cited 8×
“‘‘Implies that recorded characteristics do not account for differences in the distribution of the missing variables for observed and missing cases’’ [17].”
BackgroundMethodInfluentialSelf-citationMultiple Imputation and its Application
Carpenter, J. R., & Kenward, M. G. (2013) · doi:10.1002/9781119942283 · Cited by 913
MMRM vs. LOCF: A Comprehensive Comparison Based on Simulation Study and 25 NDA Datasets
Siddiqui, O., Hung, H. M. J., & O'Neill, R. (2009) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400802609797 · Cited by 301
Handling drop‐out in longitudinal clinical trials: a comparison of the LOCF and MMRM approaches
Lane, P. (2008) · Pharmaceutical Statistics · doi:10.1002/pst.267 · Cited by 262
Elobeid, M. A., Padilla, M. A., McVie, T., Thomas, O., Brock, D. W., Musser, B., Lu, K., Coffey, C. S., Desmond, R. A., St-Onge, M.-P., et al. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006624 · Cited by 158 · cited 1×
“Few systematic studies have assessed the quality or clarity of reporting of methods to accommodate missing data in randomized clinical trials (RCTs) [2,6,11,31,32], and none of these studies has specifically investigated pain trials.”
BackgroundMMRM versus MI in Dealing with Missing Data—A Comparison Based on 25 NDA Data Sets
Siddiqui, O. (2011) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543401003777995 · Cited by 63 · cited 1×
“One simulation study showed that MMRM may better control type I error than multiple imputation (MI), another recommended method [28].”
Method
Cited by
Haroutounian, S., Ratz, Y., Ginosar, Y., Furmanov, K., Saifi, F., Meidan, R., & Davidson, E. (2016) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000364 · Cited by 234
Akl, E. A., Shawwa, K., Kahale, L. A., Agoritsas, T., Brignardello-Petersen, R., Busse, J. W., Carrasco–Labra, A., Ebrahim, S., Johnston, B. C., Neumann, I., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008431 · Cited by 52
Gewandter, J. S., McKeown, A., McDermott, M. P., Dworkin, J. D., Smith, S. M., Gross, R. A., Hunsinger, M., Lin, A. H., Rappaport, B. A., Rice, A. S. C., et al. (2015) · The Journal of Pain · doi:10.1016/j.jpain.2014.10.003 · Cited by 47
Self-citation
Metadata
- Authors
- Gewandter, J. S., McDermott, M. P., McKeown, A., Smith, S. M., Williams, M. R., Hunsinger, M., Farrar, J., Turk, D. C., & Dworkin, R. H.
- Venue
- Pain
- Published
- 2014-09
- Volume
- 155
- Issue
- 9
- Pages
- 1871-1877
- ISSN
- 0304-3959 (ISSN-L)
- OpenAlex
- W1991556223
- Cited by
- 39
- References
- 7
- FWCI
- 0.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.