The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Estimating Missing Data in Temporal Data Streams Using Multi-Directional Recurrent Neural Networks
Open accessAbstract
Missing data is a ubiquitous problem. It is especially challenging in medical settings because many streams of measurements are collected at different-and often irregular-times. Accurate estimation of the missing measurements is critical for many reasons, including diagnosis, prognosis, and treatment. Existing methods address this estimation problem by interpolating within data streams or imputing across data streams (both of which ignore important information) or ignoring the temporal aspect of the data and imposing strong assumptions about the nature of the data-generating process and/or the pattern of missing data (both of which are especially problematic for medical data). We propose a new approach, based on a novel deep learning architecture that we call a Multi-directional Recurrent Neural Network that interpolates within data streams and imputes across data streams. We demonstrate the power of our approach by applying it to five real-world medical datasets. We show that it provides dramatically improved estimation of missing measurements in comparison to 11 state-of-the-art benchmarks (including Spline and Cubic Interpolations, MICE, MissForest, matrix completion, and several RNN methods); typical improvements in Root Mean Squared Error are between 35%-50%. Additional experiments based on the same five datasets demonstrate that the improvements provided by our method are extremely robust.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
(2014) · Cited by 33,419
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Multiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
MissForest—Non-parametric missing value imputation for mixed-type data
Stekhoven, D. J., & Bühlmann, P. (2012) · Bioinformatics · doi:10.1093/bioinformatics/btr597 · Cited by 6,156
Framewise phoneme classification with bidirectional LSTM and other neural network architectures
Graves, A., & Schmidhuber, J. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.06.042 · Cited by 5,839
Review: a gentle introduction to imputation of missing values.
Donders, A. R. T., van der Heijden, G. J. M. G., Stijnen, T., & Moons, K. G. M. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.014 · Cited by 2,582
Recurrent Neural Networks for Multivariate Time Series with Missing Values
Che, Z., Purushotham, S., Cho, K., Sontag, D., & Liu, Y. (2018) · Scientific Reports · doi:10.1038/s41598-018-24271-9 · Cited by 2,370
Pattern classification with missing data: a review
García-Laencina, P. J., Sancho-Gómez, J.-L., & Figueiras-Vidal, A. R. (2010) · Neural Computing and Applications · doi:10.1007/s00521-009-0295-6 · Cited by 759
Multiple-Imputation Inferences with Uncongenial Sources of Input
Meng, X.-L. (1994) · Statistical Science · doi:10.1214/ss/1177010269 · Cited by 756
Temporal regularized matrix factorization for high-dimensional time series prediction
Yu, H., Rao, N., & Dhillon, I. S. (2016) · neural information processing systems · Cited by 378
Palmer, L. J. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60924-6 · Cited by 373
MIDA: Multiple Imputation Using Denoising Autoencoders
Gondara, L., & Wang, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93040-4_21 · Cited by 292
Doctor AI: Predicting Clinical Events via Recurrent Neural Networks
Choi, E., Bahadori, M. T., Schuetz, A., Stewart, W. F., & Sun, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05942 · Cited by 244
The use and reporting of multiple imputation in medical research – a review
Mackinnon, A. (2010) · Journal of Internal Medicine · doi:10.1111/j.1365-2796.2010.02274.x · Cited by 229
Multiple imputation for missing data†‡
Patrician, P. A. (2002) · Research in Nursing & Health · doi:10.1002/nur.10015 · Cited by 207
Modeling Missing Data in Clinical Time Series with RNNs
Lipton, Z. C., Kale, D. C., & Wetzel, R. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04130 · Cited by 159
A Markov chain Monte Carlo algorithm for multiple imputation in large surveys
Schunk, D. (2008) · AStA Advances in Statistical Analysis · doi:10.1007/s10182-008-0053-6 · Cited by 142
Multiple Imputation for General Missing Data Patterns in the Presence of High-dimensional Data
Deng, Y., Chang, C., Ido, M., & Long, Q. (2016) · Scientific Reports · doi:10.1038/srep21689 · Cited by 136
Combining multiple imputation and meta‐analysis with individual participant data
Burgess, S., White, I. R., Resche‐Rigon, M., & Wood, A. (2013) · Statistics in Medicine · doi:10.1002/sim.5844 · Cited by 109
Recurrent Neural Networks for Missing or Asynchronous Data
Bengio, Y., & Gingras, F. (1995) · Cited by 78
Personalized Risk Scoring for Critical Care Prognosis Using Mixtures of Gaussian Processes
Alaa, A. M., Yoon, J., Hu, S. B., & van der Schaar, M. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2017.2698602 · Cited by 75
Self-citationWavelet variance analysis for gappy time series
Mondal, D., & Percival, D. B. (2008) · Annals of the Institute of Statistical Mathematics · doi:10.1007/s10463-008-0195-z · Cited by 68
Volker Tresp, C., & Briegel, T. (1997) · Cited by 39
Kim, H.-G., Jang, G., Choi, H.-J., Kim, M., Kim, Y.-W., & Choi, J. H. (2017) · IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp.2017.7881685 · Cited by 29
Speech Recognition with Missing Data using Recurrent Neural Nets
Parveen, S., & Green, P. (2001) · Cited by 28
Learning from Clinical Judgments: Semi-Markov-Modulated Marked Hawkes Processes for Risk PrognosisPreprint
Alaa, A. M., Hu, S. B., & van der Schaar, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.05267 · Cited by 19
Cited by
Multimodal data fusion for cancer biomarker discovery with deep learning
Steyaert, S., Pizurica, M., Nagaraj, D., Khandelwal, P., Hernandez-Boussard, T., Gentles, A. J., & Gevaert, O. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00633-5 · Cited by 402
Wang, F., Jiang, Y., Zhang, R., Wei, A., Xie, J., & Pang, X. (2025) · Sensors · doi:10.3390/s25010190 · Cited by 119
Multivariate Time Series Missing Data Imputation Using Recurrent Denoising Autoencoder
Zhang, J., & Yin, P. (2019) · 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8982996 · Cited by 47
Systematic Review of Advanced AI Methods for Improving Healthcare Data Quality in Post COVID-19 Era
Isgut, M., Gloster, L., Choi, K., Venugopalan, J., & Wang, M. D. (2023) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2022.3216531 · Cited by 35
Deep Convolutional Bidirectional LSTM for Complex Activity Recognition with Missing Data
Saha, S. S., Sandha, S. S., & Srivastava, M. (2021) · Smart Innovation, Systems and Technologies · doi:10.1007/978-981-15-8269-1_4 · Cited by 12
Metadata
- Authors
- Yoon, J., Zame, W. R., & van der Schaar, M.
- Venue
- IEEE Transactions on Biomedical Engineering
- Published
- 2019-05
- Volume
- 66
- Issue
- 5
- Pages
- 1477-1490
- ISSN
- 0018-9294 (ISSN-L)
- 1558-2531
- OpenAlex
- W2770565645
- Cited by
- 341
- References
- 31
- FWCI
- 9.62
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
