The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
RAIM: Recurrent Attentive and Intensive Model of Multimodal Patient Monitoring Data
Abstract
With the improvement of medical data capturing, vast amount of continuous patient monitoring data, e.g., electrocardiogram (ECG), real-time vital signs and medications, become available for clinical decision support at intensive care units (ICUs). However, it becomes increasingly challenging to model such data, due to high density of the monitoring data, heterogeneous data types and the requirement for interpretable models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“All of these studies have shown that multimodal models outperform single-modality models in predictive performance.”
From Multimodal Artificial Intelligence for Precision Critical Care: A Scoping Review (2026) · cites this paper as [18]
In the citing paper
“Intermediate fusion methods modeled each modality separately over time before integrating learned representations using concatenation [57,58] or attention [18,59], but most relied on retrospective alignment within relatively coarse time windows.”
From Multimodal Artificial Intelligence for Precision Critical Care: A Scoping Review (2026) · cites this paper as [18]
In the citing paper
“To improve performance and provide a degree of interpretability to the model, an attention mechanism is adopted in 13 studies [6,14,27,31,43,57,64,72,76–78,80,88].”
From Deep representation learning of patient data from Electronic Health Records (EHR): A systematic review (2021) · cites this paper as [14]
In the citing paper
“On the contrary, for those outcomes that happen in hospital, such as inpatient mortality [14,57,61,65], length-of-stay [14,83], and intervention prediction [32,55,65], observation windows at hour level are developed.”
From Deep representation learning of patient data from Electronic Health Records (EHR): A systematic review (2021) · cites this paper as [14]
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 1×
“Extensive attention-based deep models have been developed for images [14, 21, 36, 48], audios and videos [23, 49], machine translations [1, 30, 46].”
BackgroundHochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · cited 1×
“For the multiclass prediction task of forecasting length of stay, we evaluate the models in terms of Cohen’s Kappa [10] and Accuracy.”
Method(2008) · Journal of Machine Learning Research · Cited by 33,051
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · cited 3×
“Intervention-based guidance Gt[1] For predicting output yt”
BackgroundBatch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
(2017) · Cited by 11,625
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382 · cited 1×
“Extensive attention-based deep models have been developed for images [14, 21, 36, 48], audios and videos [23, 49], machine translations [1, 30, 46].”
BackgroundShow, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248 · cited 1×
“Extensive attention-based deep models have been developed for images [14, 21, 36, 48], audios and videos [23, 49], machine translations [1, 30, 46].”
Background
Flagged first, then by citations
Research works printed but not linked: 16
- Choi Edward, 2016, Elizabeth Searles, Catherine Coffey, and Jimeng Sun . 2016 b. Multi-layer Representation Learning for Medical Concepts. arXiv preprint arXiv:1602.05568 · arXiv
- Erhan Dumitru, 2009, Visualizing higher-layer features of a deep network, University of Montreal, 1341, 1
- Jagannatha Abhyuday N, 2016, Association for Computational Linguistics. North American Chapter. Meeting, 2016
- Jagannatha Abhyuday N, 2016, Conference on Empirical Methods in Natural Language Processing, 2016
- Johnson Alistair EW, 2016, Leo Anthony Celi, and Roger G Mark
- Kim Suyoun, 2015, Recurrent models for auditory attention in multi-microphone distance speech recognition. arXiv preprint arXiv:1511.06407 · arXiv
- Kim You Jin, 2017, Jin Joo Park, Borim Ryu, and Jung-Woo Ha .
- Kingma Diederik, 2014, Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 · arXiv
- Le Quoc V, 2013, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 8595--8598
- Lipton Zachary C, 2015, Learning to diagnose with LSTM recurrent neural networks. arXiv preprint arXiv:1511.03677 · arXiv
- Mnih Volodymyr, 2014, et almbox
- Nguyen Phuoc, 2017, Deep Learning to Attend to Risk in ICU. arXiv preprint arXiv:1707.05010 · arXiv
- Shickel Benjamin, 2017, Azra Bihorac, and Parisa Rashidi .
- Sun Yan, 2005, Kap Luk Chan, and Shankar Muthu Krishnan
- Suresh Harini, 2017, Clinical Intervention Prediction and Understanding with Deep Neural Networks Machine Learning for Healthcare Conference. 322--337
- Williams B, 2012, et almbox
Cited by
Sorted by citations
Items 101–143 of 143
Ullah, M. A., Chatterjee, S., Fagundes, C. P., Lam, C. Y., Nahum-Shani, I. B., Rehg, J. M., Wetter, D. W., & Kumar, S. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3550308 · Cited by 2
“Research on Predicting the Risk of Adverse Events: Several works have been done on predicting the risk of adverse clinical/health events such as mortality [5, 19, 20, 71], ICU admission[79, 82], disease diagnosis [2, 13, 18, 28, 78], clinical sepsis [17, 62], property fire hazards [43, 69, 73], flood [47], road accide…”
BackgroundMethodAircraft Behavior Recognition on Trajectory Data with a Multimodal Approach
Zhang, M., Zhang, L., & Liu, T. (2024) · Electronics · doi:10.3390/electronics13020367 · Cited by 2
Yue, J., Wang, J., Zhang, S., Ma, Z., Shi, Y., & Lin, Y. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106896 · Cited by 2
AI-based models to predict decompensation on traumatic brain injury patients
Ribeiro, R., Neves, I., Oliveira, H. P., & Pereira, T. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109634 · Cited by 2
MBLSTM is a contextual interaction refined method for time series prediction
Qiu, W., Zhu, F., Hao, T., Wang, M., & Huang, R. (2025) · Scientific Reports · doi:10.1038/s41598-025-03243-w · Cited by 3
A Method for Decompensation Prediction in Emergency and Harsh Situations
Rao, G., Zhao, S., Zhang, L., Cong, Q., & Feng, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60290-1_6 · Cited by 2
Lequertier, V., Wang, T., Fondrevelle, J., Augusto, V., Polazzi, S., & Duclos, A. (2021) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case49439.2021.9551429 · Cited by 2
“This skew was reported in other studies [1, 3, 6] as well.”
BackgroundResultSelf-explaining Hierarchical Model for Intraoperative Time Series
Li, D., Xue, B., King, C., Fritz, B. A., Avidan, M. S., Abraham, J., & Lu, C. (2022) · Proceedings · doi:10.1109/icdm54844.2022.00128 · Cited by 2
Interpretation Attacks and Defenses on Predictive Models Using Electronic Health Records
Razmi, F., Lou, J., Hong, Y., & Xiong, L. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43418-1_27 · Cited by 2
“They generally use BERT models [10,16,18] or multi-layer RNNs [9,12,13,25] as the baseline to obtain the attentions.”
MethodGraph-Based Patient Representation for Multimodal Clinical Data: Addressing Data HeterogeneityPreprint
Ghanvatkar, S., & Rajan, V. (2023) · medRxiv · doi:10.1101/2023.12.07.23299673 · Cited by 2
“While high-frequency time series like ECG have been studied independently for risk prediction, very few works integrate them with sparse EHR time series like lab tests (e.g., Xu et al. [2018]).”
BackgroundInfluentialMultivariate Sequential Analytics for Treatment Trajectory Forecasting
Hsu, W. W. Y., Warren, J., & Riddle, P. (2019) · Australasian Computer Science Week Multiconference (ACSW) · doi:10.1145/3290688.3290724 · Cited by 1
“These studies include [16] where LSTM is used to model multivariate pediatric intensive care time series to predict diagnoses and [33] where LSTM is used to to jointly analyse episodic clinical events and continuous monitoring data in the ICU settings to predict deterioration of patient conditions…”
MethodCLEAR: Addressing Representation Contamination in Multimodal Healthcare Analytics
Su, G., Zheng, K., Zhao, T., & Yin, J. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3690624.3709164 · Cited by 1
AI-Assisted Diagnosis and Treatment of Septic Shock
Yu, X., & Liu, Y. (2025) · IntechOpen eBooks · doi:10.5772/intechopen.1008885 · Cited by 1
Drift Detection Methods on Machine Learning Systems: a Discussion over Discrete Live Data
Rocha, A. C., de Oliveira, M. I. P., Saito, L. A. M., de Lima, B. L. S., & da Silva, L. A. (2025) · Anais do Simpósio Brasileiro de Sistemas de Informação (SBSI) · doi:10.5753/sbsi.2025.246657 · Cited by 1
MTM: A Multi-Scale Token Mixing Transformer for Irregular Multivariate Time Series Classification
Zhong, S., Zhuo, W., Song, S., Li, G., Yu, Z., & Chan, S.-H. G. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737058 · Cited by 2
HeteroMed: a heterogeneous graph knowledge-enhanced model for medication recommendation
Yin, X., Liu, M., Dong, Z., Wan, Y., Li, Y., & Ju, S. (2026) · Health Information Science and Systems · doi:10.1007/s13755-026-00430-5 · Cited by 1
“With the widespread adoption of Electronic Health Records, EHRs [1–3], data-driven clinical decision support systems have demonstrated significant potential in medication recommendation tasks [4–6].”
XAI for In-Hospital Mortality Prediction via Multimodal ICU Data
Li, X., Gu, J., Wang, Z., Yuan, Y., He, F., & Du, B. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11356415 · Cited by 1
Wang, Z., Hu, Y., Hu, Q., & Bai, D. (2026) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2026.3673947 · Cited by 1
Causality-Preserving Domain Generalization via Adaptive Fourier Mixup for RUL Prediction
Zhu, Y., Chen, W., Cheng, Z., Zhang, F., & Ye, Z. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3688520 · Cited by 1
“T IME-SERIES, characterized by sequential structure and temporal dependencies, are ubiquitous in many real-word scenarios [1], [2], including finance [3], healthcare [4], and industrial settings [5].”
Lin, W.-L., Fang, S.-S., & Chen, S.-H. (2026) · International Urology and Nephrology · doi:10.1007/s11255-026-05241-x · Cited by 1
Automatic Sleep Staging based on Curriculum Learning Approach
Wang, X., & Xu, Z. (2019) · International Conference on Biomedical Signal and Image Processing (ICBIP) · doi:10.1145/3354031.3354033 · Cited by 1
Instance Explainable Temporal Network For Multivariate TimeseriesPreprint
Madiraju, N. S., & Karimabadi, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.13037 · Cited by 1
“Previously, [17] and [16] proposed attention based architectures to perform classification and to also gain some insights into the inner workings of the network.”
Xu, Y., Xiao, C., & Sun, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.15028 · Cited by 1
“[Xu et al. 2018] Yanbo Xu, Siddharth Biswal, Shriprasad R Deshpande, Kevin O Maher, and Jimeng Sun.”
BackgroundSelf-citationFeng, Y., Lin, S. M., Lin, E.-J. D., Farley, L., Huang, Y., & Liu, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32962-4_5
Free-text and Structured Clinical Time Series for Patient Outcome Predictions
Apostolova, E., Morales, J., Koutroulis, I., & Tom, T. (2020) · doi:10.5121/csit.2020.100511
“Nguyen et al. [29] built a CNN model using coded EMR data, combined with coded time separators, such as [1-3 months], [6-12 months], etc. Xu et al. [30] developed a recurrent multi-channel attention model combining various clinical sources of time-series records including waveform and numeric data.”
MethodEnsemble of Deep Learning Models for In-Hospital Mortality Prediction
Nguyen, Q. H., & Le, Q. V. (2020) · Lecture notes in networks and systems · doi:10.1007/978-3-030-64719-3_44
Vega, R. M. C., Hurtado, E. G., Aceves-Fernández, M. A., & Arreguín, J. M. R. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-89586-0_8
An Early Warning System for Evaluating Effects of Medical Treatment using Machine Learning
Yimer, M. A., Aktaş, Ö., & Sevinç, S. (2021) · International Conference on Information and Communication Technology for Development for Africa (ICT4DA) · doi:10.1109/ict4da53266.2021.9672218
Li, T., Yin, N., Gao, P., Li, D., & Lü, W. (2022) · Communications in computer and information science · doi:10.1007/978-981-19-9297-1_29
Multi-Cause Learning for Diagnosis Prediction
Wang, L., Liu, Q., Ma, H., Wu, S., & Wang, L. (2022) · Communications in computer and information science · doi:10.1007/978-981-19-9297-1_23
Time Series Prediction Models for Assisting the Diagnosis and Treatment of Gouty Arthritis
Chen, T., Qiu, W., Zhu, F., Zhu, H., Li, S., Wang, M., & Hao, T. (2024) · Communications in computer and information science · doi:10.1007/978-981-99-9864-7_26
Liu, G., Ye, J., & Wang, B. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-2238-9_24
MedDiTPro: A Prompt-Guided Diffusion Transformer for Multimodal Longitudinal Medical Data Synthesis
Zhong, Y., Wang, X., Wang, J., Zhang, X., & Ma, F. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737045 · Cited by 1
Multimorbidity measurement strategies for predicting hospital visits
Neves, B. D., Moreira, J. M., Gonçalves, S., Cerejo, J., Mota, I., Silva, N. A., Leite, F., & Silva, M. J. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13817-z
Xia, H., Long, C., Wang, Y. W., Wen, Z., Wang, S., Sun, B., & Jin, S. (2025) · IEEE International Conference on Control, Electronics and Computer Technology (ICCECT) · doi:10.1109/iccect64621.2025.11339727
“Most existing methods for irregular time series address missing values through interpolation, discretizing time into non-overlapping intervals—either manually or learned—to convert the data into equal intervals [3]–[5].”
RHealth: A R Toolkit for Deep Learning in Healthcare
Song, J., Ren, Z., Wu, Z., Wu, J., Yang, C. Y., Zhu, Y., Tang, W., Sun, J., Harrison, E. M., Ma, L., et al. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11356917
Self-citationTowards Personalized Context-aware Bedside Patient Monitoring
Wu, K., & Burschka, D. (2026) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii64115.2026.11404604
“By incorporating a multi-channel attention layer, their model highlights segments of the temporal data that receive greater attention, which can potentially aid clinicians in verifying and understanding critical patterns[13].”
Li, B., Gong, Y., Du, B., Ye, J., & Xu, L. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7141-3_26
Contrastive Learning for Multimodal Anomaly Detection in IoT Systems
Sidhu, M. K., Prasad, G. V. S. N. R. V., Firdouse, F., Soni, S., & Batra, N. (2026) · International Conference Big Data and Machine Learning · doi:10.1109/icbdml68582.2026.11544167
Wang, T., Cai, G., Guo, L., Chen, X., Tang, Y., & An, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3719-7_7
Ali, H., Zhang, J., Tao, X., Gururajan, R., Zhou, X., Gan, Y., & Ying, J. J.-C. (2026) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70115
Xiao, X., Wang, L., Peng, Z., Yin, Z., Zhang, Y., He, X., Li, Z., & Mao, G. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3730882
“…is compared with representative statistical, recurrent, graph-based, and early prediction baselines, including HA [25], ARIMA [26], LSTM [10], DCRNN [11], Graph WaveNet [17], ASTGCN [18], MTGNN [21], EARLIEST [12], RAIM [23], STEMO [13], ASTER [27], and Graph WaveNet with early exit (GWN-EE).”
Biaosheng, H., Liu, J., Tian, X., Tuerhong, A., Lv, X., Li, H., Hu, Z., Li, M., & Ding, X. (2026) · Electronics · doi:10.3390/electronics15204599
Metadata
- Authors
- Xu, Y., Biswal, S., Deshpande, S. R., Maher, K. O., & Sun, J.
- Affiliations
- Georgia Institute of Technology (US)
- Emory University (US)
- Venue
- Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
- Publisher
- ACM
- Published
- 2018-07-19
- Pages
- 2565-2573
- OpenAlex
- W2884555939
- Cited by
- 144
- References
- 43
- Citations by year
- 2026: 13 · 2025: 18 · 2024: 15 · 2023: 11 · 2022: 15 · 2021: 26 · 2020: 31 · 2019: 14 · 2018: 1
- FWCI
- 7.16
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- Funders
- National Institutes of Health (1R01MD011682-01, R56HL138415)
- National Science Foundation (IIS-#1418511, CCF-#1533768)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Surgery › Healthcare Technology and Patient Monitoring
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › ECG Monitoring and Analysis
- Keywords
- clinical decision support, intensive care unit, continuous patient monitoring, electrocardiogram, vital signs, drug information, interpretable models, heterogeneous data types
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
