Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Multivariate time series forecasting is an important machine learning problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. Temporal data arise in these real-world applications often involves a mixture of long-term and short-term patterns, for which traditional approaches such as Autoregressive models and Gaussian Process may fail. In this paper, we proposed a novel deep learning framework, namely Long- and Short-term Time-series network (LSTNet), to address this open challenge. LSTNet uses the Convolution Neural Network (CNN) and the Recurrent Neural Network (RNN) to extract short-term local dependency patterns among variables and to discover long-term patterns for time series trends. Furthermore, we leverage traditional autoregressive model to tackle the scale insensitive problem of the neural network model. In our evaluation on real-world data with complex mixtures of repetitive patterns, LSTNet achieved significant performance improvements over that of several state-of-the-art baseline methods. All the data and experiment codes are available online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Time Series Analysis: Forecasting and Control
Geurts, M., Box, G. E. P., & Jenkins, G. M. (1977) · Journal of Marketing Research · doi:10.2307/3150485 · Cited by 19,186
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Breitung, J., & Hamilton, J. D. (1995) · Contemporary Sociology · doi:10.2307/2076916 · Cited by 10,966
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Hamilton, J. D. (1994) · Princeton University Press eBooks · doi:10.1515/9780691218632 · Cited by 7,293
Research works printed but not linked: 13
- Che Z., 2016, Recurrent neural networks for multivariate time series with missing values. arXiv preprint arXiv:1606.01865 · arXiv
- Connor J., 1991, NIPS, 301
- Dasgupta S., 2016, Nonlinear dynamic boltzmann machines for time-series prediction. AAAI-17. Extended research report available at goo. gl/Vd0wna
- Frigola R., 2013, Advances in Neural Information Processing Systems, 3156
- Kingma D., 2014, Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 · arXiv
- LeCun Y., 1995, Convolutional networks for images, speech, and time series. The handbook of brain theory and neural networks, 3361(10):1995
- 10.1002/for.3980030312 · doi:10.1002/for.3980030312
- Melnyk I., 2016, Estimating structured vector autoregressive model. arXiv preprint arXiv:1602.06606 · arXiv
- Neil D., 2016, Advances in Neural Information Processing Systems, 3882
- 10.5555/2832747.2832806 · doi:10.5555/2832747.2832806
- Yu H.-F., 2016, Advances in Neural Information Processing Systems, 847
- Zhang G., 1998, International journal of forecasting, 14(1):35--62
- 10.5555/3172077.3172393 · doi:10.5555/3172077.3172393
Cited by
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., & Zhang, W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17325 · Cited by 7,752
Are Transformers Effective for Time Series Forecasting?
Zeng, A., Chen, M., Zhang, L., & Xu, Q. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26317 · Cited by 3,320
Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks
Wu, Z., Pan, S., Long, G., Jiang, J., Chang, X., & Zhang, C. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403118 · Cited by 2,001
Recurrent Neural Networks for Time Series Forecasting: Current status and future directions
Hewamalage, H., Bergmeir, C., & Bandara, K. (2021) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2020.06.008 · Cited by 1,371
Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting
Li, S., Jin, X., Xuan, Y., Zhou, X., Chen, W., Wang, Y.-X., & Yan, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.00235 · Cited by 1,053
Temporal pattern attention for multivariate time series forecasting
Shih, S.-Y., Sun, F.-K., & Lee, H.-Y. (2019) · Machine Learning · doi:10.1007/s10994-019-05815-0 · Cited by 960
Forecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
TS2Vec: Towards Universal Representation of Time Series
Yue, Z., Wang, Y., Duan, J., Yang, T., Huang, C., Tong, Y., & Xu, B. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20881 · Cited by 850
“LSTnet (Lai et al. 2018): LSTnet combines CNNs and RNNs to incorporate both short-term local dependencies and long-term trends.”
BackgroundMethodInfluentialAdaptive Graph Convolutional Recurrent Network for Traffic Forecasting
Bai, L., Yao, L., Li, C., Wang, X., & Wang, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02842 · Cited by 701
Deep Learning on Traffic Prediction: Methods, Analysis, and Future Directions
Yin, X., Wu, G., Wei, J., Shen, Y., Qi, H., & Yin, B. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3054840 · Cited by 583
Jin, M., Koh, H. Y., Wen, Q., Zambon, D., Alippi, C., Webb, G. I., King, I., & Pan, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3443141 · Cited by 567
NHITS: Neural Hierarchical Interpolation for Time Series Forecasting
Challu, C., Olivares, K. G., Oreshkin, B. N., Garza Ramirez, F., Mergenthaler Canseco, M., & Dubrawski, A. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25854 · Cited by 537
A novel genetic LSTM model for wind power forecast
Shahid, F., Zameer, A., & Muneeb, M. (2021) · Energy · doi:10.1016/j.energy.2021.120069 · Cited by 529
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting
Wu, H., Xu, J., Wang, J., & Long, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.13008 · Cited by 498
A survey on anomaly detection for technical systems using LSTM networks
Lindemann, B., Maschler, B., Sahlab, N., & Weyrich, M. (2021) · Computers in Industry · doi:10.1016/j.compind.2021.103498 · Cited by 445
Traffic flow prediction using LSTM with feature enhancement
Yang, B., Sun, S., Li, J., Lin, X., & Tian, Y. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.12.016 · Cited by 434
A review of irregular time series data handling with gated recurrent neural networks
Weerakody, P. B., Wong, K. W., Wang, G., & Ela, W. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.02.046 · Cited by 433
Deep Learning for Time Series Forecasting: Tutorial and Literature Survey
Benidis, K., Rangapuram, S. S., Flunkert, V., Wang, Y., Maddix, D., Turkmen, C., Gasthaus, J., Bohlke-Schneider, M., Salinas, D., Stella, L., et al. (2023) · ACM Computing Surveys · doi:10.1145/3533382 · Cited by 382
Stock price prediction using deep learning and frequency decomposition
Rezaei, H., Faaljou, H., & Mansourfar, G. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114332 · Cited by 372
Graph Neural Networks for Intelligent Transportation Systems: A Survey
Rahmani, S., Baghbani, A., Bouguila, N., & Patterson, Z. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3257759 · Cited by 353
Sagheer, A., & Kotb, M. (2019) · Scientific Reports · doi:10.1038/s41598-019-55320-6 · Cited by 351
Long sequence time-series forecasting with deep learning: A survey
Chen, Z., Ma, M., Li, T., Wang, H., & Li, C. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101819 · Cited by 349
Spatio-Temporal Meta-Graph Learning for Traffic Forecasting
Jiang, R., Wang, Z., Yong, J., Jeph, P., Chen, Q., Kobayashi, Y., Song, X., Fukushima, S., & Suzumura, T. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.25976 · Cited by 313
Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals
Zhang, Y., Chen, Y., Wang, J., & Pan, Z. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3102110 · Cited by 312
Transformers in Time-Series Analysis: A Tutorial
Ahmed, S., Nielsen, I. E., Tripathi, A., Siddiqui, S., Ramachandran, R. P., & Rasool, G. (2023) · Circuits, Systems, and Signal Processing · doi:10.1007/s00034-023-02454-8 · Cited by 305
Is Mamba effective for time series forecasting?
Wang, Z., Kong, F., Feng, S., Wang, M., Yang, X., Zhao, H., Wang, D., & Zhang, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2024.129178 · Cited by 284
Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects
Zhang, K., Wen, Q., Zhang, C., Cai, R., Jin, M., Liu, Y., Zhang, J. Y., Liang, Y., Pang, G., Song, D., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3387317 · Cited by 295
Spatio-Temporal Graph Neural Networks for Multi-Site PV Power Forecasting
Simeunovic, J., Schubnel, B., Alet, P.-J., & Carrillo, R. E. (2022) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2021.3125200 · Cited by 268
Shaygan, M., Meese, C., Li, W., Zhao, X. (., & Nejad, M. (2022) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2022.103921 · Cited by 267
Forecast evaluation for data scientists: common pitfalls and best practices
Hewamalage, H., Ackermann, K., & Bergmeir, C. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00894-5 · Cited by 263
Shao, Z., Wang, F., Xu, Y., Wei, W., Yu, C., Zhang, Z., Yao, D., Sun, T., Jin, G., Cao, X., et al. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3484454 · Cited by 190
“Forinstance,thePEMS[1]dataset consistsoftrafficdatafromcriticallocationsinatransportation system,andtheElectricity[2]datasetrecordstheelectricity consumptionbykeyclientsinapowersystem.”
LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters
Chang, C., Wang, W.-Y., Peng, W.-C., & Chen, T.-F. (2023) · arXiv · doi:10.48550/arxiv.2308.08469 · Cited by 146
Tang, X., Yao, H., Sun, Y., Aggarwal, C., Mitra, P., & Wang, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6056 · Cited by 125
UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecasting
Liu, X., Hu, J., Li, Y., Diao, S., Liang, Y., Hooi, B., & Zimmermann, R. (2024) · Proceedings of the ACM Web Conference 2024 · doi:10.1145/3589334.3645434 · Cited by 115
“For example, ETTm2, ETTh2, Exchange, and Illness experience severe overfitting beyond the 4th epoch, while others require more epochs to reach convergence.”
BackgroundModeling Heart Rate and Activity Data for Personalized Fitness Recommendation
Ni, J., Muhlstein, L., & McAuley, J. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313643 · Cited by 94
“[ 17] introduced an LSTM-based model to address traditional multivariate time series prediction problems.”
Small perturbations are enough: Adversarial attacks on time series prediction
Wu, T., Wang, X., Qiao, S., Xian, X., Liu, Y., & Zhang, L. (2022) · Information Sciences · doi:10.1016/j.ins.2021.11.007 · Cited by 72
He, H., Li, X., Chen, P., Chen, J., Liu, M., & Wu, L. (2024) · Journal of Cloud Computing · doi:10.1186/s13677-024-00677-x · Cited by 62
“Complex structures such as the recursive skip layer (LSTNet-S), the temporal attention layer (LSTNet-A) [25].”
BackgroundMulti-Granularity Residual Learning with Confidence Estimation for Time Series Prediction
Hou, M., Xu, C., Li, Z., Liu, Y., Liu, W., Chen, E., & Bian, J. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3512056 · Cited by 59
Chae, S. G., Bae, S. J., & Oh, K.-Y. (2025) · Journal of Energy Storage · doi:10.1016/j.est.2024.114826 · Cited by 47
MOMENT: a family of open time-series foundation models
Goswami, M., Szafer, K., Choudhry, A., Cai, Y., Li, S., & Dubrawski, A. (2024) · arXiv · doi:10.48550/arxiv.2402.03885 · Cited by 41
Adversarial Multi-view Networks for Activity Recognition
Bai, L., Yao, L., Wang, X., Kanhere, S. S., Guo, B., & Yu, Z. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3397323 · Cited by 40
“Let there be N potential activities to be recognized, 𝐶 = { 𝑐 1 ,𝑐 2 , ...,𝑐 𝑁 } , the purpose of HAR is to learn a function, F ( 𝑺𝒆𝒈 , •) , to infer the correct activity label for the given segment 𝑆𝑒𝑔 , where • represents all the parameters to be learned during the training process.”
BackgroundTSGBench: Time Series Generation Benchmark
Ang, Y., Huang, Q., Bao, Y., Tung, A. K. H., & Huang, Z. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3632093.3632097 · Cited by 38
Calibrated Reliable Regression using Maximum Mean Discrepancy
Cui, P., Hu, W., & Zhu, J. (2020) · arXiv · doi:10.48550/arxiv.2006.10255 · Cited by 27
Multi-Variate Time Series Forecasting on Variable Subsets
Chauhan, J., Raghuveer, A., Saket, R., Nandy, J., & Ravindran, B. (2022) · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3534678.3539394 · Cited by 21
ACT: Adversarial Convolutional Transformer for Time Series Forecasting
Li, Y., Wang, H., Li, J., Liu, C., & Tan, J. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892791 · Cited by 19
“LSTNet [23] combines LSTM and autoregressive methods to capture the long-term and short-term dependencies.”
Method
Metadata
- Authors
- Lai, G., Chang, W.-C., Yang, Y., & Liu, H.
- Venue
- The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval
- Publisher
- ACM
- Published
- 2018-06-27
- Pages
- 95-104
- OpenAlex
- W2604847698
- Cited by
- 2,152
- References
- 33
- FWCI
- 78.99
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.