Using Electronic Health Record Data to Develop and Validate a Prediction Model for Adverse Outcomes in the Wards*
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Over 200,000 in-hospital cardiac arrests occur in the United States each year and many of these events may be preventable. Current vital sign-based risk scores for ward patients have demonstrated limited accuracy, which leads to missed opportunities to identify those patients most likely to suffer cardiac arrest and inefficient resource utilization. We derived and validated a prediction model for cardiac arrest while treating ICU transfer as a competing risk using electronic health record data. DESIGN: A retrospective cohort study. SETTING: An academic medical center in the United States with approximately 500 inpatient beds. PATIENTS: Adult patients hospitalized from November 2008 until August 2011 who had documented ward vital signs. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Vital sign, demographic, location, and laboratory data were extracted from the electronic health record and investigated as potential predictor variables. A person-time multinomial logistic regression model was used to simultaneously predict cardiac arrest and ICU transfer. The prediction model was compared to the VitalPAC Early Warning Score using the area under the receiver operating characteristic curve and was validated using three-fold cross-validation. A total of 56,649 controls, 109 cardiac arrest patients, and 2,543 ICU transfers were included. The derived model more accurately detected cardiac arrest (area under the receiver operating characteristic curve, 0.88 vs 0.78; p < 0.001) and ICU transfer (area under the receiver operating characteristic curve, 0.77 vs 0.73; p < 0.001) than the VitalPAC Early Warning Score, and accuracy was similar with cross-validation. At a specificity of 93%, our model had a higher sensitivity than the VitalPAC Early Warning Score for cardiac arrest patients (65% vs 41%). CONCLUSIONS: We developed and validated a prediction tool for ward patients that can simultaneously predict the risk of cardiac arrest and ICU transfer. Our model was more accurate than the VitalPAC Early Warning Score and could be implemented in the electronic health record to alert caregivers with real-time information regarding patient deterioration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Internal validation of predictive models
Steyerberg, E. W., Harrell, F. E., Borsboom, G. J. J. M., Eijkemans, M. J. C., Vergouwe, Y., & Habbema, J. D. F. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00341-9 · Cited by 2,746
Logistic regression, survival analysis, and the Kaplan-Meier curve.
Efron, B. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478612 · Cited by 1,065 · cited 1×
“It has been shown to provide similar results to a Cox proportional hazards model, especially when the time intervals are short (14, 15).”
ResultHodgetts, T. J., Kenward, G., Vlachonikolis, I. G., Payne, S., & Castle, N. (2002) · Resuscitation · doi:10.1016/s0300-9572(02)00100-4 · Cited by 355
Cited by
Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw042 · Cited by 936
Big data analytics to improve cardiovascular care: promise and challenges
Rumsfeld, J. S., Joynt, K. E., & Maddox, T. M. (2016) · Nature Reviews Cardiology · doi:10.1038/nrcardio.2016.42 · Cited by 398
Early Warning System Scores for Clinical Deterioration in Hospitalized Patients: A Systematic Review
Smith, M. E. B., Chiovaro, J. C., O’Neil, M., Kansagara, D., Quiñones, A. R., Freeman, M., Motu’apuaka, M. L., & Slatore, C. G. (2014) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201403-102oc · Cited by 387
Gerry, S., Bonnici, T., Birks, J., Kirtley, S., Virdee, P. S., Watkinson, P. J., & Collins, G. S. (2020) · BMJ · doi:10.1136/bmj.m1501 · Cited by 383
Multicenter Development and Validation of a Risk Stratification Tool for Ward Patients
Churpek, M. M., Yuen, T. C., Winslow, C., Robicsek, A. A., Meltzer, D. O., Gibbons, R. D., & Edelson, D. P. (2014) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201406-1022oc · Cited by 259
Self-citation
Metadata
- Authors
- Churpek, M. M., Yuen, T. C., Park, S. Y., Gibbons, R., & Edelson, D. P.
- Venue
- Critical Care Medicine
- Published
- 2014-04
- Volume
- 42
- Issue
- 4
- Pages
- 841-848
- ISSN
- 0090-3493 (ISSN-L)
- OpenAlex
- W2090051863
- Cited by
- 138
- References
- 3
- FWCI
- 9.94
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using Electronic Health Record Data to Develop and Validate a Prediction Model for Adverse Outcomes in the Wards*. https://app.cochat.ai/papers/10.1097/ccm.0000000000000038
- The paper
- Churpek, M. M., Yuen, T. C., Park, S. Y., Gibbons, R., & Edelson, D. P. (2014). Using Electronic Health Record Data to Develop and Validate a Prediction Model for Adverse Outcomes in the Wards*. Critical Care Medicine. https://doi.org/10.1097/ccm.0000000000000038
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.