The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
A survey on long short-term memory networks for time series prediction
Open accessAbstract
Recurrent neural networks and exceedingly Long short-term memory (LSTM) have been investigated intensively in recent years due to their ability to model and predict nonlinear time-variant system dynamics. The present paper delivers a comprehensive overview of existing LSTM cell derivatives and network architectures for time series prediction. A categorization in LSTM with optimized cell state representations and LSTM with interacting cell states is proposed. The investigated approaches are evaluated against defined requirements being relevant for an accurate time series prediction. These include short-term and long-term memory behavior, the ability for multimodal and multi-step ahead predictions and the according error propagation. Sequence-to-sequence networks with partially conditioning outperform the other approaches, such as bidirectional or associative networks, and are best suited to fulfill the requirements.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
Williams, R. J., & Zipser, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.270 · Cited by 4,369
A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction
Qin, Y., Song, D., Chen, H., Cheng, W., Jiang, G., & Cottrell, G. W. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/366 · Cited by 1,585
Predicting residential energy consumption using CNN-LSTM neural networks
Kim, T.-Y., & Cho, S.-B. (2019) · Energy · doi:10.1016/j.energy.2019.05.230 · Cited by 1,469
Incorporating Copying Mechanism in Sequence-to-Sequence Learning
Gu, J., Lu, Z., Li, H., & Li, V. O. K. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1154 · Cited by 1,446
Attractor dynamics and parallelism in a connectionist sequential machine
Jordan, M. I. (1986) · eScholarship (California Digital Library) · Cited by 709
A Deep CNN-LSTM Model for Particulate Matter (PM2.5) Forecasting in Smart Cities
Huang, C.-J., & Kuo, P.-H. (2018) · Sensors · doi:10.3390/s18072220 · Cited by 705
Deep Learning for solar power forecasting — An approach using AutoEncoder and LSTM Neural Networks
Gensler, A., Henze, J., Sick, B., & Raabe, N. (2016) · 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · doi:10.1109/smc.2016.7844673 · Cited by 614
Building energy load forecasting using Deep Neural Networks
Marino, D. L., Amarasinghe, K., & Manic, M. (2016) · IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society · doi:10.1109/iecon.2016.7793413 · Cited by 522
Massive Exploration of Neural Machine Translation Architectures
Britz, D., Goldie, A., Luong, M.-T., & Le, Q. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1151 · Cited by 482
SS-LSTM: A Hierarchical LSTM Model for Pedestrian Trajectory Prediction
Xue, H., Huynh, D. Q., & Reynolds, M. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00135 · Cited by 433
Dilated Recurrent Neural NetworksPreprint
Chang, S., Zhang, Y., Han, W., Yu, M., Guo, X., Tan, W. Q., Cui, X., Witbrock, M., Hasegawa‐Johnson, M., & Huang, T. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.02224 · Cited by 279
Ma, X., Zhang, J., Du, B., Ding, C., & Sun, L. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2867042 · Cited by 209
Deep Multi-Scale Convolutional LSTM Network for Travel Demand and Origin-Destination Predictions
Chu, K.-F., Lam, A. Y. S., & Li, V. O. K. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2924971 · Cited by 169
Learning to Rank Question Answer Pairs with Holographic Dual LSTM Architecture
Tay, Y., Phan, M. C., Tuan, L. A., & Hui, S. C. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080790 · Cited by 121
Position-Based Content Attention for Time Series Forecasting with Sequence-to-Sequence RNNs
Cinar, Y. G., Mirisaee, H., Goswami, P., Gaussier, É., Aït-Bachir, A., & Strijov, V. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70139-4_54 · Cited by 99
Anomaly detection in discrete manufacturing using self-learning approaches
Lindemann, B., Fesenmayr, F., Jazdi, N., & Weyrich, M. (2019) · Procedia CIRP · doi:10.1016/j.procir.2019.02.073 · Cited by 86
Self-citationTime Series Forecasting Using Sequence-to-Sequence Deep Learning Framework
Du, S., Li, T., & Horng, S. (2018) · International Symposium on Parallel Architectures, Algorithms and Programming · doi:10.1109/paap.2018.00037 · Cited by 67
Pedestrian trajectory prediction via the Social‐Grid LSTM model
Cheng, B., Xu, X., Zeng, Y., Ren, J., & Jung, S. (2018) · The Journal of Engineering · doi:10.1049/joe.2018.8316 · Cited by 43
Cross-modal Recurrent Models for Weight Objective Prediction from Multimodal Time-series Data
Veličković, P., Karazija, L., Lane, N. D., Bhattacharya, S., Liberis, E., Lió, P., Chieh, A., Bellahsen, O., & Vegreville, M. (2018) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3240925.3240937 · Cited by 22
Deep Sequence-to-Sequence Neural Networks for Ionospheric Activity Map Prediction
Cherrier, N., Castaings, T., & Boulch, A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70139-4_55 · Cited by 17
Detektion von Anomalien zur Qualitätssicherung basierend auf Sequence-to-Sequence LSTM Netzen
Lindemann, B., Jazdi, N., & Weyrich, M. (2019) · at - Automatisierungstechnik · doi:10.1515/auto-2019-0076 · Cited by 13
Self-citationHierarchical Gated Recurrent Unit with Semantic Attention for Event Prediction
Su, Z., & Jiang, J. (2020) · Future Internet · doi:10.3390/fi12020039 · Cited by 12
Learning to Generate Long-term Future via Hierarchical Prediction
Villegas, R., Yang, J., Zou, Y., Sohn, S., Lin, X., & Lee, H. (2017) · arXiv · doi:10.48550/arxiv.1704.05831
Cited by
A survey on anomaly detection for technical systems using LSTM networks
Lindemann, B., Maschler, B., Sahlab, N., & Weyrich, M. (2021) · Computers in Industry · doi:10.1016/j.compind.2021.103498 · Cited by 445
Self-citationKarijadi, I., & Chou, S.-Y. (2022) · Energy and Buildings · doi:10.1016/j.enbuild.2022.111908 · Cited by 159
Zhang, J., Wu, J., Qiu, Y., Song, A., Li, W., Li, X., & Liu, Y. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106517 · Cited by 69
Mazzi, Y., Ben Sassi, H., Gaga, A., & Errahimi, F. (2022) · International Journal of Energy Research · doi:10.1002/er.7713 · Cited by 53
Sequential Monte Carlo Learning for Time Series Structure Discovery
Saad, F. A., Patton, B. J., Hoffman, M. D., Saurous, R. A., & Mansinghka, V. K. (2023) · arXiv · doi:10.48550/arxiv.2307.09607 · Cited by 3
Metadata
- Authors
- Lindemann, B., Müller, T., Vietz, H., Jazdi, N., & Weyrich, M.
- Venue
- Procedia CIRP
- Publisher
- Elsevier BV
- Published
- 2021
- Volume
- 99
- Pages
- 650-655
- ISSN
- 2212-8271 (ISSN-L)
- OpenAlex
- W3157175643
- Cited by
- 720
- References
- 28
- FWCI
- 32.55
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.