Temporal pointwise convolutional networks for length of stay prediction in the intensive care unit
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
The pressure of ever-increasing patient demand and budget restrictions make hospital bed management a daily challenge for clinical staff. Most critical is the efficient allocation of resource-heavy Intensive Care Unit (ICU) beds to the patients who need life support. Central to solving this problem is knowing for how long the current set of ICU patients are likely to stay in the unit. In this work, we propose a new deep learning model based on the combination of temporal convolution and pointwise (1x1) convolution, to solve the length of stay prediction task on the eICU and MIMIC-IV critical care datasets. The model - which we refer to as Temporal Pointwise Convolution (TPC) - is specifically designed to mitigate common challenges with Electronic Health Records, such as skewness, irregular sampling and missing data. In doing so, we have achieved significant performance benefits of 18-68% (metric and dataset dependent) over the commonly used Long-Short Term Memory (LSTM) network, and the multi-head self-attention network known as the Transformer. By adding mortality prediction as a side-task, we can improve performance further still, resulting in a mean absolute deviation of 1.55 days (eICU) and 2.28 days (MIMIC-IV) on predicting remaining length of stay.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759 · cited 1×
“oral trends and inter-feature relationships using a novel combination of techniques. Temporal Convolution Temporal Convolution Networks (TCNs) [26, 55] are a subclass of convolutional neural networks [13] that convolve over the time dimension. They operate on two key principles: the output is the same length as the in…”
MethodModel Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
Scalable and accurate deep learning with electronic health records
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0029-1 · Cited by 2,648 · cited 2×
“Firstly, prospective trials are needed to the prove real-world impact of sophisticated bed management systems (Rajkomar et al., 2018).”
BackgroundPollard, T. J., Johnson, A. E. W., Raffa, J. D., Celi, L. A., Mark, R. G., & Badawi, O. (2018) · Scientific Data · doi:10.1038/sdata.2018.178 · Cited by 1,993
Zimmerman, J. E., Kramer, A. A., McNair, D. S., & Malila, F. M. (2006) · Critical Care Medicine · doi:10.1097/01.ccm.0000215112.84523.f0 · Cited by 1,764
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461
A clinically applicable approach to continuous prediction of future acute kidney injury
Tomašev, N., Glorot, X., Rae, J. W., Zielinski, M., Askham, H., Saraiva, A., Mottram, A., Meyer, C., Ravuri, S., Protsyuk, I., et al. (2019) · Nature · doi:10.1038/s41586-019-1390-1 · Cited by 1,086 · cited 1×
“e-art results [20, 41, 46]. This reflects the prominence of LSTMs in other clinical prediction tasks such as predicting in-hospital adverse events including cardiac arrest [54] and acute kidney injury [53], forecasting diagnoses and medication codes [6, 31] and clinical interventions [51], missing-data imputation [4],…”
BackgroundMultitask learning and benchmarking with clinical time series data
Harutyunyan, H., Khachatrian, H., Kale, D. C., Ver Steeg, G., & Galstyan, A. (2019) · Scientific Data · doi:10.1038/s41597-019-0103-9 · Cited by 958 · cited 5×
“Owing to the centrality of time series in the EHR, LSTMs have been by far the most popular model for predicting LoS and have achieved state-of-the-art results (Harutyunyan et al., 2019; Sheikhalishahi et al., 2019; Rajkomar et al., 2018).”
BackgroundMethodResultInfluentialLearning to Diagnose with LSTM Recurrent Neural Networks
Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015) · arXiv · doi:10.48550/arxiv.1511.03677 · Cited by 879
Cited by
Bednarski, B. P., Singh, A. D., Zhang, W., Jones, W. M., Naeim, A., & Ramezani, R. (2022) · Scientific Reports · doi:10.1038/s41598-022-25472-z · Cited by 41
“Rocheteau et. al . demonstrate that these methods are compatible with the TPC/TCN model architecture and are useful for clinical phenotyping and feature reduction before deployment 26 .”
BackgroundMethodInfluentialPredicting Patient Outcomes with Graph Representation Learning
Tong, C., Rocheteau, E., Veličković, P., Lane, N., & Liò, P. (2022) · Studies in Computational Intelligence · doi:10.1007/978-3-030-93080-6_20 · Cited by 38
Self-citationA cross-modal clinical prediction system for intensive care unit patient outcome
Sun, M., Yang, X., Niu, J., Gu, Y., Wang, C., & Zhang, W. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111160 · Cited by 18
Multimodal fusion network for ICU patient outcome prediction
Wang, C., Yang, X., Sun, M., Gu, Y., Niu, J., & Zhang, W. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106672 · Cited by 16
XAI for Better Exploitation of Text in Medical Decision Support
Ravichandran, A. M., Grune, J., Feldhus, N., Burchardt, A., Roller, R., & Möller, S. (2024) · Proceedings of the 23rd Workshop on Biomedical Natural Language Processing · doi:10.18653/v1/2024.bionlp-1.41 · Cited by 5
Metadata
- Authors
- Rocheteau, E., Liò, P., & Hyland, S.
- Venue
- Proceedings of the Conference on Health, Inference, and Learning
- Publisher
- ACM
- Published
- 2021-04-08
- Pages
- 58-68
- OpenAlex
- W3042777221
- Cited by
- 56
- References
- 18
- FWCI
- 3.95
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Temporal pointwise convolutional networks for length of stay prediction in the intensive care unit. https://app.cochat.ai/papers/10.1145/3450439.3451860
- The paper
- Rocheteau, E., Liò, P., & Hyland, S. (2021). Temporal pointwise convolutional networks for length of stay prediction in the intensive care unit. Proceedings of the Conference on Health, Inference, and Learning. https://doi.org/10.1145/3450439.3451860
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.