Electronic medical record-based multicondition models to predict the risk of 30 day readmission or death among adult medicine patients: validation and comparison to existing models
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
BACKGROUND: There is increasing interest in using prediction models to identify patients at risk of readmission or death after hospital discharge, but existing models have significant limitations. Electronic medical record (EMR) based models that can be used to predict risk on multiple disease conditions among a wide range of patient demographics early in the hospitalization are needed. The objective of this study was to evaluate the degree to which EMR-based risk models for 30-day readmission or mortality accurately identify high risk patients and to compare these models with published claims-based models. METHODS: Data were analyzed from all consecutive adult patients admitted to internal medicine services at 7 large hospitals belonging to 3 health systems in Dallas/Fort Worth between November 2009 and October 2010 and split randomly into derivation and validation cohorts. Performance of the model was evaluated against the Canadian LACE mortality or readmission model and the Centers for Medicare and Medicaid Services (CMS) Hospital Wide Readmission model. RESULTS: Among the 39,604 adults hospitalized for a broad range of medical reasons, 2.8% of patients died, 12.7% were readmitted, and 14.7% were readmitted or died within 30 days after discharge. The electronic multicondition models for the composite outcome of 30-day mortality or readmission had good discrimination using data available within 24 h of admission (C statistic 0.69; 95% CI, 0.68-0.70), or at discharge (0.71; 95% CI, 0.70-0.72), and were significantly better than the LACE model (0.65; 95% CI, 0.64-0.66; P =0.02) with significant NRI (0.16) and IDI (0.039, 95% CI, 0.035-0.044). The electronic multicondition model for 30-day readmission alone had good discrimination using data available within 24 h of admission (C statistic 0.66; 95% CI, 0.65-0.67) or at discharge (0.68; 95% CI, 0.67-0.69), and performed significantly better than the CMS model (0.61; 95% CI, 0.59-0.62; P < 0.01) with significant NRI (0.20) and IDI (0.037, 95% CI, 0.033-0.041). CONCLUSIONS: A new electronic multicondition model based on information derived from the EMR predicted mortality and readmission at 30 days, and was superior to previously published claims-based models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No adjustments are needed for multiple comparisons.
Rothman, K. J. (1990) · Epidemiology · doi:10.1097/00001648-199001000-00010 · Cited by 5,965
Rehospitalizations among Patients in the Medicare Fee-for-Service Program
Jencks, S. F., Williams, M. V., & Coleman, E. A. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0803563 · Cited by 5,164
Kramer, A. A., & Zimmerman, J. E. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000275267.64078.b0 · Cited by 886 · cited 4×
“Figure S3.”
MethodInfluentialDonzé, J., Aujesky, D., Williams, D., & Schnipper, J. L. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.3023 · Cited by 553 · cited 1×
“More recent models, such as the HOSPITAL [9] model and the PREADM [10] model, included the entire adult populations or used EHR data (the PREADM model), and showed promising discriminatory power.”
Method
Cited by
Big data analytics to improve cardiovascular care: promise and challenges
Rumsfeld, J. S., Joynt, K. E., & Maddox, T. M. (2016) · Nature Reviews Cardiology · doi:10.1038/nrcardio.2016.42 · Cited by 398
Possible Sources of Bias in Primary Care Electronic Health Record Data Use and Reuse
Verheij, R. A., Curcin, V., Delaney, B. C., & McGilchrist, M. M. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9134 · Cited by 290
A Path for Translation of Machine Learning Products into Healthcare Delivery
(2020) · EMJ Innovations · doi:10.33590/emjinnov/19-00172 · Cited by 172
Nguyen, O. K., Makam, A. N., Clark, C., Zhang, S., Xie, B., Velasco, F., Amarasingham, R., & Halm, E. A. (2016) · Journal of Hospital Medicine · doi:10.1002/jhm.2568 · Cited by 76
Self-citationEarly prediction of ICU readmissions using classification algorithms
Loreto, M., Lisboa, T., & Moreira, V. P. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103636 · Cited by 53
Metadata
- Authors
- Amarasingham, R., Velasco, F., Xie, B., Clark, C., Ma, Y., Zhang, S., Bhat, D., Lucena, B., Huesch, M., & Halm, E. A.
- Venue
- BMC Medical Informatics and Decision Making
- Published
- 2015-05-20
- Volume
- 15
- Issue
- 1
- Pages
- 39-39
- ISSN
- 1472-6947 (ISSN-L)
- OpenAlex
- W1855722232
- Cited by
- 71
- References
- 4
- FWCI
- 8.76
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Electronic medical record-based multicondition models to predict the risk of 30 day readmission or death among adult medicine patients: validation and comparison to existing models. https://app.cochat.ai/papers/10.1186/s12911-015-0162-6
- The paper
- Amarasingham, R., Velasco, F., Xie, B., Clark, C., Ma, Y., Zhang, S., Bhat, D., Lucena, B., Huesch, M., & Halm, E. A. (2015). Electronic medical record-based multicondition models to predict the risk of 30 day readmission or death among adult medicine patients: validation and comparison to existing models. BMC Medical Informatics and Decision Making. https://doi.org/10.1186/s12911-015-0162-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.