CoChat
Cited by 433

The DOI matches its Crossref record; 95 of the 95 references it cites were found in a registry or an index.

A review of irregular time series data handling with gated recurrent neural networks

Weerakody, Philip B., Wong, Kok Wai, Wang, Guanjin, Ela, Wendell · 2021 · Neurocomputing

Abstract

Abstract Irregular time series data is becoming increasingly prevalent with the growth of multi-sensor systems as well as the continued use of unstructured manual data recording mechanisms. Irregular data and the resulting missing values severely limit the data's ability to be analysed and modelled for classification and forecasting tasks. Often, conventional methods used for handling time series data introduce bias and make strong assumptions on the underlying data generation process, which can lead to poor model predictions. Traditional machine learning and deep learning methods, although at the forefront of data modelling, are at best compromised by irregular time series data sets and fail to model the temporal irregularity of incomplete time series. Gated recurrent neural networks (RNN), such as LSTM and GRU, have had outstanding success in sequential modelling, and have been applied in many application fields, including natural language processing. These models have become an obvious choice for time series modelling and a promising tool for handling irregular time series data. RNNs have a unique ability to be adapted to make effective use of missing value patterns, time intervals and complex temporal dependencies in irregular univariate and multivariate time series data. In this paper, we provide a systematic review of recent studies in which gated recurrent neural networks have been successfully applied to irregular time series data for prediction tasks within several fields, including medical, human activity recognition, traffic monitoring and environmental monitoring. The review highlights the two common approaches for handling irregular time series data: missing value imputation at the data pre-processing stage and modification of algorithms to directly handle missing values in the learning process. Reviewed models are confined to those that can address issues with irregular time series data and does not cover the broader range of models that deal more generally with sequences and regular time series. This paper aims to present the most effective techniques emerging within this branch of research as well as to identify remaining challenges, so that researchers may build upon this platform of work towards further novel techniques for handling irregular time series data.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.neucom.2021.02.046

Cites

95 of 95 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 95 references

Research works printed but not linked: 8

  1. van den Oord, 2016, A Generative model for Raw Audio, ArXiv
  2. S.N. Shukla, B.M. Marlin, Interpolation-prediction networks for irregularly sampled time series, in: International Conference on Learning Representations, 2019. https://openreview.net/forum?id=r1efr3C9Ym.
  3. Lanckriet, 2004, Learning the Kernel matrix with semidefinite programming, J. Mach. Learn. Res., 5, 27
  4. Kulesh, 2008, Adaptive metrics in the nearest neighbours method, Physica D, 237, 283, 10.1016/j.physd.2007.08.019 · doi:10.1016/j.physd.2007.08.019
  5. J. Yoon, W.R. Zame, M. van der Schaar, Multi-directional recurrent neural networks: a novel method for estimating missing data, in: International Conference on Machine Learning (ICML) Time Series Workshop, 2017. https://icml.cc/Conferences/2019/ScheduleMultitrack?event=3525.
  6. Tang, 2017, Sequence-to-sequence model with attention for time series classification, IEEE International Conference on Data Mining Workshops, ICDMW, 503
  7. E. Choi, T. Bahadori, J. Sun, Doctor AI: predicting clinical events via recurrent neural networks, in: Proceedings of the 1st Machine Learning for Healthcare Conference 56 (2016) 301–318. http://proceedings.mlr.press/v56/Choi16.html.
  8. R.T.Q. Chen, Y. Rubanova, J. Bettencourt, D. Duvenaud, Neural ordinary differential equations, in: Proceedings of the 32nd International Conference on Neural Information Processing Systems, Curran Associates Inc., Red Hook, NY, USA, 2018, pp. 6572–6583. https://papers.nips.cc/paper/7892-neural-ordinary-differential-equations.pdf.

Cited by

Metadata

Authors
Weerakody, P. B., Wong, K. W., Wang, G., & Ela, W.
Venue
Neurocomputing
Publisher
Elsevier BV
Published
2021-06
Volume
441
Pages
161-178
ISSN
0925-2312 (ISSN-L)
OpenAlex
W3133618741
Cited by
433
References
95
FWCI
29.07
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.