Survival prediction in intensive-care units based on aggregation of long-term disease history and acute physiology: a retrospective study of the Danish National Patient Registry and electronic patient records
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Intensive-care units (ICUs) treat the most critically ill patients, which is complicated by the heterogeneity of the diseases that they encounter. Severity scores based mainly on acute physiology measures collected at ICU admission are used to predict mortality, but are non-specific, and predictions for individual patients can be inaccurate. We investigated whether inclusion of long-term disease history before ICU admission improves mortality predictions. METHODS: Registry data for long-term disease histories for more than 230 000 Danish ICU patients were used in a neural network to develop an ICU mortality prediction model. Long-term disease histories and acute physiology measures were aggregated to predict mortality risk for patients for whom both registry and ICU electronic patient record data were available. We compared mortality predictions with admission scores on the Simplified Acute Physiology Score (SAPS) II, the Acute Physiologic Assessment and Chronic Health Evaluation (APACHE) II, and the best available multimorbidity score, the Multimorbidity Index. An external validation set from an additional hospital was acquired after model construction to confirm the validity of our model. During initial model development data were split into a training set (85%) and an independent test set (15%), and a five-fold cross-validation was done during training to avoid overfitting. Neural networks were trained for datasets with disease history of 1 month, 3 months, 6 months, 1 year, 2·5 years, 5 years, 7·5 years, 10 years, and 23 years before ICU admission. FINDINGS: Mortality predictions with a model based solely on disease history outperformed the Multimorbidity Index (Matthews correlation coefficient 0·265 vs 0·065), and performed similarly to SAPS II and APACHE II (Matthews correlation coefficient with disease history, age, and sex 0·326 vs 0·347 and 0·300 for SAPS II and APACHE II, respectively). Diagnoses up to 10 years before ICU admission affected current mortality prediction. Aggregation of previous disease history and acute physiology measures in a neural network yielded the most precise predictions of in-hospital mortality (Matthews correlation coefficient 0·391 for in-hospital mortality compared with 0·347 with SAPS II and 0·300 with APACHE II). These results for the aggregated model were validated in an external independent dataset of 1528 patients (Matthews correlation coefficient for prediction of in-hospital mortality 0·341). INTERPRETATION: Longitudinal disease-spectrum-wide data available before ICU admission are useful for mortality prediction. Disease history can be used to differentiate mortality risk between patients with similar vital signs with more precision than SAPS II and APACHE II scores. Machine learning models can be deconvoluted to generate novel understandings of how ICU patient features from long-term and short-term events interact with each other. Explainable machine learning models are key in clinical settings, and our results emphasise how to progress towards the transformation of advanced models into actionable, transparent, and trustworthy clinical tools. FUNDING: Novo Nordisk Foundation and Innovation Fund Denmark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Comorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921 · cited 1×
“The predictive value of comorbidity categories as defined by Charlson and colleagues 6 (ten diagnoses) and Elixhauser and colleagues 7 (30 diagnoses) has been studied repeatedly in relation to prediction of mortality in the ICU.”
BackgroundLow Moments for Small Samples: A Comparative Study of Order Statistics
Hastings, C., Mosteller, F., Tukey, J. W., & Winsor, C. P. (1947) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177730388 · Cited by 366 · cited 1×
“We used a combination of Tukey’s and Winsor’s methods 18,19 to normalise data for the continuous variables.”
MethodKim, S., Kim, W., & Park, R. W. (2011) · Healthcare Informatics Research · doi:10.4258/hir.2011.17.4.232 · Cited by 132 · cited 1×
“29,38,39 However, interpretation of the feature interaction effects modelled here has not been previously reported.”
BackgroundChen, J. H., Alagappan, M., Goldstein, M. K., Asch, S. M., & Altman, R. B. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.03.006 · Cited by 101 · cited 1×
“31 In our study, the accuracy of mortality risk prediction was improved by the inclusion of increasingly long disease histories despite changes in clinical practice over the years.”
Background
Cited by
A deep learning algorithm to predict risk of pancreatic cancer from disease trajectories
Placido, D., Yuan, B., Hjaltelin, J. X., Zheng, C., Haue, A. D., Chmura, P. J., Yuan, C., Kim, J., Umeton, R., Antell, G., et al. (2023) · Nature Medicine · doi:10.1038/s41591-023-02332-5 · Cited by 349
Self-citationThorsen-Meyer, H.-C., Nielsen, A. B., Nielsen, A. P., Kaas-Hansen, B. S., Toft, P., Schierbeck, J., Strøm, T., Chmura, P. J., Heimann, M., Dybdahl, L., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30018-2 · Cited by 336
Self-citationArtificial Intelligence and Early Detection of Pancreatic Cancer: 2020 Summative Review
Kenner, B., Chari, S. T., Kelsen, D., Klimstra, D. S., Pandol, S. J., Rosenthal, M., Rustgi, A. K., Taylor, J. A., Yala, A., Abul-Husn, N., et al. (2021) · Pancreas · doi:10.1097/mpa.0000000000001762 · Cited by 158
Self-citationBourcier, S., Klug, J., & Nguyen, L. S. (2021) · World Journal of Gastroenterology · doi:10.3748/wjg.v27.i26.4088 · Cited by 65
Chance of live birth: a nationwide, registry-based cohort study
Kolte, A. M., Westergaard, D., Lidegaard, Ø., Brunak, S., & Nielsen, H. S. (2021) · Human Reproduction · doi:10.1093/humrep/deaa326 · Cited by 61
Self-citation
Metadata
- Authors
- Nielsen, A. B., Thorsen-Meyer, H.-C., Belling, K., Nielsen, A. P., Thomas, C. E., Chmura, P. J., Lademann, M., Moseley, P. L., Heimann, M., Dybdahl, L., Spangsege, L., Hulsen, P., Perner, A., & Brunak, S.
- Venue
- The Lancet Digital Health
- Publisher
- Elsevier BV
- Published
- 2019-06
- Volume
- 1
- Issue
- 2
- Pages
- e78-e89
- ISSN
- 2589-7500 (ISSN-L)
- OpenAlex
- W2945850853
- Cited by
- 109
- References
- 4
- FWCI
- 7.25
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Survival prediction in intensive-care units based on aggregation of long-term disease history and acute physiology: a retrospective study of the Danish National Patient Registry and electronic patient records. https://app.cochat.ai/papers/10.1016/s2589-7500(19)30024-x
- The paper
- Nielsen, A. B., Thorsen-Meyer, H.-C., Belling, K., Nielsen, A. P., Thomas, C. E., Chmura, P. J., Lademann, M., Moseley, P. L., Heimann, M., Dybdahl, L., Spangsege, L., Hulsen, P., Perner, A., & Brunak, S. (2019). Survival prediction in intensive-care units based on aggregation of long-term disease history and acute physiology: a retrospective study of the Danish National Patient Registry and electronic patient records. The Lancet Digital Health. https://doi.org/10.1016/s2589-7500(19)30024-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.