Missing Data in Randomized Clinical Trials for Weight Loss: Scope of the Problem, State of the Field, and Performance of Statistical Methods
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Dropouts and missing data are nearly-ubiquitous in obesity randomized controlled trails, threatening validity and generalizability of conclusions. Herein, we meta-analytically evaluate the extent of missing data, the frequency with which various analytic methods are employed to accommodate dropouts, and the performance of multiple statistical methods. METHODOLOGY/PRINCIPAL FINDINGS: We searched PubMed and Cochrane databases (2000-2006) for articles published in English and manually searched bibliographic references. Articles of pharmaceutical randomized controlled trials with weight loss or weight gain prevention as major endpoints were included. Two authors independently reviewed each publication for inclusion. 121 articles met the inclusion criteria. Two authors independently extracted treatment, sample size, drop-out rates, study duration, and statistical method used to handle missing data from all articles and resolved disagreements by consensus. In the meta-analysis, drop-out rates were substantial with the survival (non-dropout) rates being approximated by an exponential decay curve (e(-lambdat)) where lambda was estimated to be .0088 (95% bootstrap confidence interval: .0076 to .0100) and t represents time in weeks. The estimated drop-out rate at 1 year was 37%. Most studies used last observation carried forward as the primary analytic method to handle missing data. We also obtained 12 raw obesity randomized controlled trial datasets for empirical analyses. Analyses of raw randomized controlled trial data suggested that both mixed models and multiple imputation performed well, but that multiple imputation may be more robust when missing data are extensive. CONCLUSION/SIGNIFICANCE: Our analysis offers an equation for predictions of dropout rates useful for future study planning. Our raw data analyses suggests that multiple imputation is better than other methods for handling missing data in obesity randomized controlled trials, followed closely by mixed models. We suggest these methods supplant last observation carried forward as the primary method of analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Dropout during lifestyle intervention studies is unfortunately a common phenomenon, and general weight loss programmes have reported discontinuation rates of around 40% (Elobeid et al., 2009).”
From Improvements in PCOS characteristics and phenotype severity during a randomized controlled lifestyle intervention (2021) · cites this paper as Elobeid et al., 2009
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Whenever appropriate, we are going to use multiple imputation methods [71].”
In the citing paper
“With a ratio of 1:1:1, the required sample was 42 in each group. With an expected drop-out proportion of 40% [40], 60 participants in each group were needed for the study.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Prevalence of Overweight and Obesity in the United States, 1999-2004
Ogden, C. L., Carroll, M. D., Curtin, L. R., McDowell, M. A., Tabak, C. J., & Flegal, K. M. (2006) · JAMA · doi:10.1001/jama.295.13.1549 · Cited by 8,720
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627 · cited 3×
“Lastly, even if the MI model is incorrect, inferences made from the model of interest tend to remain valid [9].”
BackgroundMethodLittell, R. C., Milliken, G. A., Stroup, W. W., Wolfinger, R. D., & Schabenberger, O. (2006) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,924
Years of Life Lost Due to Obesity
Fontaine, K. R., Redden, D. T., Wang, C., Westfall, A. O., & Allison, D. B. (2003) · JAMA · doi:10.1001/jama.289.2.187 · Cited by 2,495 · cited 1×
“Obesity is associated with and believed to cause adverse conditions such as cardiovascular disease, stroke, type 2 diabetes mellitus, certain forms of cancer [2], and decreased longevity [3].”
BackgroundSelf-citationMiscellanea. Small-sample degrees of freedom with multiple imputation
Barnard, J. (1999) · Biometrika · doi:10.1093/biomet/86.4.948 · Cited by 829 · cited 2×
“The data were then imputed by assuming a monotone missing data pattern using the regression method proposed by Rubin [11].”
MethodRandomized Trial of Lifestyle Modification and Pharmacotherapy for Obesity
Wadden, T. A., Berkowitz, R. I., Womble, L. G., Sarwer, D. B., Phelan, S., Cato, R. K., Hesson, L. A., Osei, S. Y., Kaplan, R., & Stunkard, A. J. (2005) · New England Journal of Medicine · doi:10.1056/nejmoa050156 · Cited by 794 · cited 2×
“10 DPP [6] 2103 242 48 months Metformin 9 11 NPY-1 [26] 206 159 12 Neuropeptide Y5R 5”
BackgroundCalle, E. E., & Thun, M. J. (2004) · Oncogene · doi:10.1038/sj.onc.1207751 · Cited by 769
Heymsfield, S. B., Allison, D. B., Vasselli, J. R., Pietrobelli, A., Greenfield, D., & Nunez, C. (1998) · JAMA · doi:10.1001/jama.280.18.1596 · Cited by 342
Self-citationZonisamide for Weight Loss in Obese Adults: A Randomized Controlled Trial
Gadde, K. M., Franciscy, D. M., Wagner, H. R., & Krishnan, K. R. R. (2003) · JAMA · doi:10.1001/jama.289.14.1820 · Cited by 276
Self-citationA general plasmode (No. 30-10-5-2) for factor analytic exercises and research.
Cattell, R. B., & Jaspers, J. (1967) · Cited by 242
Erondu, N., Gantz, I., Musser, B., Suryawanshi, S., Mallick, M., Addy, C., Cote, J., Bray, G., Fujioka, K., Bays, H., et al. (2006) · Cell Metabolism · doi:10.1016/j.cmet.2006.08.002 · Cited by 183
Self-citationGadbury, G. L., Coffey, C. S., & Allison, D. B. (2003) · Obesity Reviews · doi:10.1046/j.1467-789x.2003.00109.x · Cited by 181 · cited 1×
“[7]).”
Self-citationAllison, D. B., Gadbury, G., Schwartz, L. G., Murugesan, R., Kraker, J. L., Heshka, S., Fontaine, K. R., & Heymsfield, S. B. (2003) · European Journal of Clinical Nutrition · doi:10.1038/sj.ejcn.1601587 · Cited by 159
Self-citationAnalysis of unbalanced mixed model data: A case study comparison of ANOVA versus REML/GLS
Littell, R. C. (2002) · Journal of Agricultural Biological and Environmental Statistics · doi:10.1198/108571102816 · Cited by 116
Obesity Research—Limitations of Methods, Measurements, and Medications
Simons-Morton, D. G. (2006) · JAMA · doi:10.1001/jama.295.7.826 · Cited by 70 · cited 1×
“In interpreting our results, several limiting factors should be kept in mind. First, we only examined the performance of tests at alpha (type 1 error rate) levels of 0.05. This is a sensible choice because it seems to be the most commonly used alpha level in obesity RCTs. However, it is well known that statistical tes…”
BackgroundInfluentialCoffey, C. S., Steiner, D., Baker, B. A., & Allison, D. B. (2004) · International Journal of Obesity · doi:10.1038/sj.ijo.0802784 · Cited by 68 · cited 1×
“1 RCT 1[17] 186 154 12 Herbal Supplement contain Ephedrine 6”
BackgroundSelf-citationAtomoxetine for weight reduction in obese women: a preliminary randomised controlled trial
Gadde, K. M., Yonish, G. M., Wagner, H. R., Foust, M. S., & Allison, D. B. (2006) · International Journal of Obesity · doi:10.1038/sj.ijo.0803223 · Cited by 56
Self-citationAre standardized mortality ratios valid for public health data analysis?
Goldman, D. A., & Brender, J. D. (2000) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(20000430)19:8<1081::aid-sim406>3.0.co;2-a · Cited by 49
Supplementation with Soy-Protein−Rich Foods Does Not Enhance Weight Loss
St‐Onge, M., Claps, N., Wolper, C., & Heymsfield, S. B. (2007) · Journal of the American Dietetic Association · doi:10.1016/j.jada.2006.12.002 · Cited by 37 · cited 1×
“6 RCT 6 [22] 75 47 12 Meal Replacement (Soy) 6 7 RCT 7 [23] 135 84 12 Herbal Supplement Contain Garcinia Cambogia 7”
Self-citationA randomised placebo-controlled clinical trial of an acupressure device for weight loss.
Allison, D. B., Kreibich, K., Heshka, S., & Heymsfield, S. B. (1995) · PubMed · Cited by 33
Self-citationTests for Gaussian repeated measures with missing data in small samples
Catellier, D., & Muller, K. E. (2000) · Statistics in Medicine · Cited by 33
Fontaine, K. R., Yang, D., Gadbury, G. L., Heshka, S., Schwartz, L. G., Murugesan, R., Kraker, J. L., Heo, M., Heymsfield, S. B., & Allison, D. B. (2003) · Nutrition Journal · doi:10.1186/1475-2891-2-14 · Cited by 31
Self-citationSurvival analysis of dropout patterns in dieting clinical trials
Landers, P. S., & Landers, T. L. (2004) · Journal of the American Dietetic Association · doi:10.1016/j.jada.2004.07.030 · Cited by 14 · cited 1×
“The overall probability of completing that trial was 60% [16].”
Background
Research works printed but not linked: 1
- CS Coffey, 2002, Safety of an herbal formulation including ephedra alkaloids dosed intermittently or continuously for weight control., FASEB, 16(4), A649
Cited by
Fuller, N. R., Colagiuri, S., Schofield, D., Olson, A. D., Shrestha, R., Holzapfel, C., Wolfenstetter, S. B., Holle, R., Ahern, A. L., Hauner, H., et al. (2013) · International Journal of Obesity · doi:10.1038/ijo.2012.139 · Cited by 2,117
Abed, H. S., Wittert, G. A., Leong, D. P., Shirazi, M. G., Bahrami, B., Middeldorp, M. E., Lorimer, M. F., Lau, D. H., Antic, N. A., Brooks, A. G., et al. (2013) · JAMA · doi:10.1001/jama.2013.280521 · Cited by 776
Allison, D. B., Gadde, K. M., Garvey, W. T., Peterson, C. A., Schwiers, M. L., Najarian, T., Tam, P. Y., Troupin, B., & Day, W. W. (2012) · Obesity · doi:10.1038/oby.2011.330 · Cited by 711
“This dropout rate is consistent with what one would expect at 56 weeks in obesity trials based on a published meta-analytic prediction equation (24) and lower than the 50% dropout recently reported with two other phase 3 obesity RCTs (33,34).”
ResultSelf-citationMultiple Imputation: A Flexible Tool for Handling Missing Data
Li, P., Stuart, E. A., & Allison, D. B. (2015) · JAMA · doi:10.1001/jama.2015.15281 · Cited by 621
Self-citationScreening and brief intervention for obesity in primary care: a parallel, two-arm, randomised trial
Aveyard, P., Lewis, A., Tearne, S., Hood, K., Christian-Brown, A., Adab, P., Begh, R., Jolly, K., Daley, A., Farley, A., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31893-1 · Cited by 297
Metadata
- Authors
- Elobeid, M. A., Padilla, M. A., McVie, T., Thomas, O., Brock, D. W., Musser, B., Lu, K., Coffey, C. S., Desmond, R. A., St-Onge, M.-P., Gadde, K. M., Heymsfield, S. B., & Allison, D. B.
- Affiliations
- University of Alabama at Birmingham (US)
- Merck & Co., Inc., Rahway, NJ, USA (United States) (US)
- Duke University (US)
- Corresponding author
- Allison, David B.
- ORCID
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2009-08-13
- Volume
- 4
- Issue
- 8
- Pages
- e6624
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC2720539
- OpenAlex
- W2086313861
- Cited by
- 158
- References
- 25
- Citations by year
- 2026: 7 · 2025: 7 · 2024: 9 · 2023: 3 · 2022: 8 · 2021: 9 · 2020: 10 · 2019: 15 · 2018: 10 · 2017: 10 · 2016: 11 · 2015: 13 · 2014: 8 · 2013: 11 · 2012: 12
- FWCI
- 7.47
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- DukeSpace (Duke University) (submittedVersion, cc-by-nc-nd)
- Funders
- National Institutes of Health
- National Heart, Lung, and Blood Institute (T32HL007457)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK056336)
- National Institute of Arthritis and Musculoskeletal and Skin Diseases (R01AR052658)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- missing data, dropout, obesity, weight loss, weight gain prevention, randomized controlled trials, last observation carried forward, multiple imputation, mixed models, exponential decay model
- MeSH terms
- Data Interpretation, Statistical, Humans, Obesity, Weight Loss, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.