The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Strategies for Handling Missing Data in Electronic Health Record Derived Data
Open accessAbstract
Electronic health records (EHRs) present a wealth of data that are vital for improving patient-centered outcomes, although the data can present significant statistical challenges. In particular, EHR data contains substantial missing information that if left unaddressed could reduce the validity of conclusions drawn. Properly addressing the missing data issue in EHR data is complicated by the fact that it is sometimes difficult to differentiate between missing data and a negative value. For example, a patient without a documented history of heart failure may truly not have disease or the clinician may have simply not documented the condition. Approaches for reducing missing data in EHR systems come from multiple angles, including: increasing structured data documentation, reducing data input errors, and utilization of text parsing / natural language processing. This paper focuses on the analytical approaches for handling missing data, primarily multiple imputation. The broad range of variables available in typical EHR systems provide a wealth of information for mitigating potential biases caused by missing data. The probability of missing data may be linked to disease severity and healthcare utilization since unhealthier patients are more likely to have comorbidities and each interaction with the health care system provides an opportunity for documentation. Therefore, any imputation routine should include predictor variables that assess overall health status (e.g. Charlson Comorbidity Index) and healthcare utilization (e.g. number of encounters) even when these comorbidities and patient encounters are unrelated to the disease of interest. Linking the EHR data with other sources of information (e.g. National Death Index and census data) can also provide less biased variables for imputation. Additional methodological research with EHR data and improved epidemiological training of clinical investigators is warranted.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data
Quan, H., Sundararajan, V., Halfon, P., Fong, A., Burnand, B., Luthi, J.-C., Saunders, L. D., Beck, C. A., Feasby, T. E., & Ghali, W. A. (2005) · Medical Care · doi:10.1097/01.mlr.0000182534.19832.83 · Cited by 10,669
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792
(2010) · University of Twente Research Information · Cited by 6,037
A comparison of inclusive and restrictive strategies in modern missing data procedures.
Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.330 · Cited by 2,389
Multiple Imputation of Missing Values
Royston, P. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400301 · Cited by 2,340
Using the outcome for imputation of missing predictor values was preferred
Moons, K. G. M., Donders, R. A. R. T., Stijnen, T., & Harrell, F. E. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.009 · Cited by 994
Rubin, D. B. (1976) · Biometrika · doi:10.2307/2335739 · Cited by 885
Blumenthal, D. (2010) · New England Journal of Medicine · doi:10.1056/nejmp0912825 · Cited by 714
Ammenwerth, E., Schnell-Inderst, P., Machan, C., & Siebert, U. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2667 · Cited by 668
A Primer and Comparative Review of Major U.S. Mortality Databases
Cowper, D. C., Kubal, J. D., Maynard, C., & Hynes, D. M. (2002) · Annals of Epidemiology · doi:10.1016/s1047-2797(01)00285-x · Cited by 486
Electronic Health Record Use and the Quality of Ambulatory Care in the United States
Linder, J. A., Ma, J., Bates, D. W., Middleton, B., & Stafford, R. S. (2007) · Archives of Internal Medicine · doi:10.1001/archinte.167.13.1400 · Cited by 438
Electronic Health Records and Quality of Diabetes Care
Cebul, R. D., Love, T. E., Jain, A. K., & Hebert, C. J. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1102519 · Cited by 332
Prevalence of multiple chronic conditions in the United States' Medicare population
Schneider, K. M., O'Donnell, B. E., & Dean, D. (2009) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-7-82 · Cited by 315
Romano, M. J., & Stafford, R. S. (2011) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.527 · Cited by 297
Vargas, C. M., Burt, V. L., Gillum, R. F., & Pamuk, E. R. (1997) · Preventive Medicine · doi:10.1006/pmed.1997.0190 · Cited by 269
Devine, E. B., Hansen, R. N., Wilson-Norton, J. L., Lawless, N. M., Fisk, A. W., Blough, D. K., Martin, D. P., & Sullivan, S. D. (2010) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3285 · Cited by 176
Handling “Don't Know” Survey Responses: The Case of the Slovenian Plebiscite
Rubin, D. B., Stern, H. S., & Vehovar, V. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476580 · Cited by 160
Exploiting missing clinical data in Bayesian network modeling for predicting medical problems
Lin, J.-H., & Haug, P. J. (2007) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2007.06.001 · Cited by 146
Electronic Health Records and Ambulatory Quality of Care
with the HITEC Investigators, Kern, L. M., Barrón, Y., Dhopeshwarkar, R. V., Edwards, A. M., & Kaushal, R. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2237-8 · Cited by 142
Development and Validation of an Electronic Health Record–Based Chronic Kidney Disease Registry
Navaneethan, S. D., Jolly, S. E., Schold, J. D., Arrigain, S., Saupe, W., Sharp, J. W., Lyons, J., Simon, J. F., Schreiber, M. J., Jain, A., et al. (2010) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.04230510 · Cited by 136
Wright, A. T., Pang, J. E., Feblowitz, J. C., Maloney, F. L., Wilcox, A. R., Ramelson, H. Z., Schneider, L. I., & Bates, D. W. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000121 · Cited by 108
Pantalone, K. M., Kattan, M. W., Cheng, Y., Wells, B. J., Arrigain, S., Jain, A., Atreja, A., & Zimmerman, R. S. (2012) · Diabetes Obesity and Metabolism · doi:10.1111/j.1463-1326.2012.01604.x · Cited by 105
Self-citationUse of electronic medical records differs by specialty and office settings
Kokkonen, E. W. J., Davis, S., Lin, H., Dabade, T. S., Feldman, S. R., & Fleischer, A. B. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001609 · Cited by 82
Handling "Don't Know" Survey Responses: The Case of the Slovenian Plebiscite
Rubin, D. B., Stern, H. S., & Vehovar, V. (1995) · Journal of the American Statistical Association · doi:10.2307/2291315 · Cited by 77
A new approach to making your doctor-nurse team more productive.
Anderson, P., & Halley, M. D. (2008) · PubMed · Cited by 46
Electronic Health Records and Quality of Diabetes Care
Koppel, R., Majumdar, S. R., & Soumerai, S. B. (2011) · New England Journal of Medicine · doi:10.1056/nejmc1111722 · Cited by 42
Electronic health records: a new tool to combat chronic kidney disease?
Navaneethan, S. D., Jolly, S. E., Sharp, J. W., Jain, A., Schold, J. D., Schreiber, M. J., & Nally, J. V. (2013) · Clinical Nephrology · doi:10.5414/cn107757 · Cited by 42
Pantalone, K. M., Kattan, M. W., Cheng, Y., Wells, B. J., Arrigain, S., Nutter, B., Jain, A., Atreja, A., & Zimmerman, R. S. (2012) · Diabetic Medicine · doi:10.1111/j.1464-5491.2012.03577.x · Cited by 26
Self-citationPrediction of morbidity and mortality in patients with type 2 diabetes
Wells, B. J., Roth, R., Nowacki, A. S., Arrigain, S., Yu, C., Rosenkrans, W. A., & Kattan, M. W. (2013) · PeerJ · doi:10.7717/peerj.87 · Cited by 18
Self-citationKumbhani, D. J., Wells, B. J., Lincoff, A. M., Jain, A., Arrigain, S., Yu, C., Goormastic, M., Ellis, S. G., Blackstone, E. H., & Kattan, M. W. (2013) · Europe PMC (PubMed Central) · Cited by 9
Self-citation
Cited by
Recurrent Neural Networks for Multivariate Time Series with Missing Values
Che, Z., Purushotham, S., Cho, K., Sontag, D., & Liu, Y. (2018) · Scientific Reports · doi:10.1038/s41598-018-24271-9 · Cited by 2,370
Ethical Machine Learning in Healthcare
Chen, I. Y., Pierson, E., Rose, S., Joshi, S., Ferryman, K., & Ghassemi, M. (2021) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-092820-114757 · Cited by 645
Cui, Z., Ke, R., Pu, Z., & Wang, Y. (2020) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2020.102674 · Cited by 486
Clinical features of COVID-19 mortality: development and validation of a clinical prediction model
Yadaw, A. S., Li, Y.-C., Bose, S., Iyengar, R., Bunyavanich, S., & Pandey, G. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30217-x · Cited by 308
Unravelling the human genome–phenome relationship using phenome-wide association studies
Bush, W. S., Oetjens, M. T., & Crawford, D. C. (2016) · Nature Reviews Genetics · doi:10.1038/nrg.2015.36 · Cited by 274
Metadata
- Authors
- Wells, B. J., Nowacki, A. S., Chagin, K., & Kattan, M. W.
- Venue
- eGEMs (Generating Evidence & Methods to improve patient outcomes)
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2013-12-17
- Volume
- 1
- Issue
- 3
- Pages
- 7
- ISSN
- 2327-9214 (ISSN-L)
- OpenAlex
- W2072604363
- Cited by
- 407
- References
- 34
- FWCI
- 4.59
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.