The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
A comparison of imputation techniques for handling missing predictor values in a risk model with a binary outcome
Abstract
Risk models that aim to predict the future course and outcome of disease processes are increasingly used in health research, and it is important that they are accurate and reliable. Most of these risk models are fitted using routinely collected data in hospitals or general practices. Clinical outcomes such as short-term mortality will be near-complete, but many of the predictors may have missing values. A common approach to dealing with this is to perform a complete-case analysis. However, this may lead to overfitted models and biased estimates if entire patient subgroups are excluded. The aim of this paper is to investigate a number of methods for imputing missing data to evaluate their effect on risk model estimation and the reliability of the predictions. Multiple imputation methods, including hotdecking and multiple imputation by chained equations (MICE), were investigated along with several single imputation methods. A large national cardiac surgery database was used to create simulated yet realistic datasets. The results suggest that complete case analysis may produce unreliable risk predictions and should be avoided. Conditional mean imputation performed well in our scenario, but may not be appropriate if using variable selection methods. MICE was amongst the best performing multiple imputation methods with regards to the quality of the predictions. Additionally, it produced the least biased estimates, with good coverage, and hence is recommended for use in practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We examined missing data bias using multiple imputation (37) and whether correcting random measurement error in health behaviors increased their capacity to explain observed SES/ personality risks, using simulation extrapolation (38).”
From Personality, Socioeconomic Status, and All-Cause Mortality in the United States (2010) · cites this paper as [37]
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
A simulation study of the number of events per variable in logistic regression analysis
Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00236-3 · Cited by 9,655
Prediction of coronary heart disease using risk factor categories
Wilson, P. W. F., D’Agostino, R. B., Levy, D., Belanger, A. M., Silbershatz, H., & Kannel, W. B. (1998) · Circulation · doi:10.1161/01.cir.97.18.1837 · Cited by 9,581
Regression Modeling Strategies
Harrell, F. E. (2001) · Springer series in statistics · doi:10.1007/978-1-4757-3462-1 · Cited by 9,270
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Harrell (2015) · Springer Series in Statistics · doi:10.1007/978-3-319-19425-7 · Cited by 6,878
Journal of The American Statistical Association
Fienberg, S. E. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,289
The APACHE III Prognostic System
Knaus, W. A., Wagner, D. P., Draper, E. A., Zimmerman, J. E., Bergner, M., BASTOS, P. G., Sirio, C., Murphy, D. J., Lotring, T., Damiano, A., et al. (1991) · CHEST Journal · doi:10.1378/chest.100.6.1619 · Cited by 3,539
European system for cardiac operative risk evaluation (EuroSCORE)
Nashef, S. A. M., Roques, F., Michel, P., Gauducheau, E., Lemeshow, S., & Salamon, R. (1999) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/s1010-7940(99)00134-7 · Cited by 3,362
The APACHE III Prognostic System
Teres, D., & Lemeshow, S. A. (1992) · CHEST Journal · doi:10.1378/chest.102.6.1919b · Cited by 2,896
Research works printed but not linked: 7
- Rosen AK, 2003, Insights, 4, 1
- Mander A., 2000, Stata Technical Bulletin, 9, 199
- Allison PD, 2001, Missing data
- Fay RE, Proceedings of the Survey Research Methods Sections
- Keogh B., 2002, Systems
- Berrisford R., 2005, Surgery, 28, 306
- O'Sullivan C., 2005, British Journal of General Practice, 55, 529
Cited by
Sorted by citations
Items 201–233 of 233
Using multiple imputation to classify potential outcomes subgroups
Li, Y., Bondarenko, I., Elliott, M. R., Hofer, T. P., & Taylor, J. M. G. (2021) · Statistical Methods in Medical Research · doi:10.1177/09622802211002866 · Cited by 1
An approximate probability graphical modelling method for complex industrial fermentation processes
Wang, H., Chen, B., Lu, Z., & Khan, F. I. (2015) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2015.09.629 · Cited by 1
Hoh, J. W. T., & Feng, Q. (2021) · China Population and Development Studies · doi:10.1007/s42379-021-00097-3 · Cited by 1
Worm, M. S., Valentin, J. B., Johnsen, S. P., Nielsen, J. F., & Svendsen, S. W. (2022) · Brain Injury · doi:10.1080/02699052.2022.2158221 · Cited by 2
Harpin, S. B. (2010) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 1
Discrimination of Inconsistencies in Medical Data
Gilchrist, J., Townsend, D. I., Ennett, C. M., Frize, M., & Bariciak, E. (2008) · IEEE International Symposium on Medical Measurements and Applications (MeMeA) · doi:10.1109/memea.2008.4543004 · Cited by 1
ABSTRACT Internal Migration and Life Satisfaction: Well-Being Effects of Moving as a Young Adult *Preprint
Switek, M. (2012) · SSRN Electronic Journal · Cited by 1
Model selection and model averaging in the presence of missing values
Pillay, K. G. (2015) · Enlighten: Theses (The University of Glasgow) · Cited by 1
Investigating the effects of missing data treatments on item response theory vertical scaling
Shin, A.-Y., Lee, W., Brennan, R. L., Kolen, M. J., Welch, C. J., & Tan, A. (2016) · doi:10.17077/etd.g0o7zsk9 · Cited by 1
Patel, N. (2010) · Digital Commons @ UNT Health Science Center
Home or home-like hospital birth for low-risk nulliparae : does it matter?
Hendrix, M. J. C. (2010) · doi:10.26481/dis.20100616mh
The Methodology of Human Diseases Risk Prediction Tools
Mannan, H., Ahmed, R., Sanagou, M., Ivory, S., & Wolfe, R. S. (2013) · Majalah Kedokteran Andalas · doi:10.25077/mka.v46.i4.p764-771.2023
Research in acute decompensated heart failure: challenges and opportunities
Hiestand, B. C. (2011) · Clinical Investigation · doi:10.4155/cli.11.129
Regularised iterative multiple correspondence analysis in multiple imputation
Nienkemper-Swanepoel, J. (2013)
Bordalejo, M. M. (2011) · Dialnet (Universidad de la Rioja)
RECURRENCE/PROGRESSION AND BREAST CANCER-SPECIFIC DEATH
Tosevski, C. (2010)
Survival analysis for breast cancer
Liu, Y. (2010) · UVic’s Research and Learning Repository (University of Victoria)
Examining Race and Sexual Assault Kit Submission: A Test of Black's Behavior of Law Theory
Ylang, N. (2016) · Arizona State University Library Digital Repository (Arizona State University)
Replicate Engineered Virtual Patient Populations as Surrogates for Real Patient-Level DataPreprint
Alenghat, F. J. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/308403
Chronic disease treatment seeking and depression
Lorincz‐Comi, N. J., Bah, S., Welser, H. T., & Maduka, J. (2019) · Journal of Public Mental Health · doi:10.1108/jpmh-01-2019-0007
Lavanya, K., V, Reddy, L. S. S., & Reddy, B. E. (2021) · IGI Global eBooks · doi:10.4018/978-1-7998-5339-8.ch124
Kobayashi, T., Matsue, Y., Fujimoto, Y., Maeda, D., Kida, K., Kitai, T., Kagiyama, N., Yamaguchi, T., Okumura, T., Mizuno, A., et al. (2024) · Journal of Cardiac Failure · doi:10.1016/j.cardfail.2024.08.043
Georgiadis, S., Giuseppe, D. D., Scherer, A., Hetland, M. L., Jones, G. T., Glintborg, B., Loft, A. G., Wallman, J. K., Michelsen, B., Kristianslund, E. K., et al. (2025) · BMC Rheumatology · doi:10.1186/s41927-025-00527-6
Cardiovascular risk prediction in Central and Eastern Europe and former Soviet Union
Vikhireva, O. (2012) · UCL Discovery (University College London)
Gade, G. V., Jørgensen, M. G., Ryg, J., Masud, T., Jakobsen, L. H., & Andersen, S. (2021) · Figshare · doi:10.6084/m9.figshare.14889895
Taka, T. M., Cabrera, A., Bouterse, A., Avetisian, H., Shin, D., Oyoyo, U. E., & Danisa, O. (2026) · North American Spine Society Journal (NASSJ) · doi:10.1016/j.xnsj.2026.100909
Mao, Z., Grant, H., Costacou, T., Ding, Y., Dashti, H. S., Newman, A. B., & Farsijani, S. (2026) · European Journal of Nutrition · doi:10.1007/s00394-026-04020-9
Moss, J. W. E., Hansell, N., Barker, E., Butler, K., & Taylor, M. (2026) · Health Economics and Policy · doi:10.3390/hep1010005
Metadata
- Authors
- Ambler, G., Omar, R. Z., & Royston, P.
- Affiliations
- UCL Biomedical Research Centre (GB)
- MRC Clinical Trials Unit at UCL (GB)
- Corresponding author
- Ambler, Gareth
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 2007-06
- Volume
- 16
- Issue
- 3
- Pages
- 277-298
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- OpenAlex
- W1965973862
- Cited by
- 233
- References
- 39
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 9 · 2023: 10 · 2022: 6 · 2021: 15 · 2020: 12 · 2019: 13 · 2018: 11 · 2017: 8 · 2016: 11 · 2015: 14 · 2014: 14 · 2013: 12 · 2012: 19
- FWCI
- 15.72
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistical Methods in Medical Research (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- missing data imputation, risk prediction model, binary outcomes, multiple imputation, multiple imputation by chained equations, single imputation, complete case analysis, cardiac surgery, mortality prediction, forecast reliability, estimation bias
- MeSH terms
- Aged, Female, United Kingdom, Humans, Male, Middle Aged, Thoracic Surgery, Models, Statistical, Bias, Risk Assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review