The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks
Open accessAbstract
Multivariate time series forecasting is an important machine learning problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. Temporal data arise in these real-world applications often involves a mixture of long-term and short-term patterns, for which traditional approaches such as Autoregressive models and Gaussian Process may fail. In this paper, we proposed a novel deep learning framework, namely Long- and Short-term Time-series network (LSTNet), to address this open challenge. LSTNet uses the Convolution Neural Network (CNN) and the Recurrent Neural Network (RNN) to extract short-term local dependency patterns among variables and to discover long-term patterns for time series trends. Furthermore, we leverage traditional autoregressive model to tackle the scale insensitive problem of the neural network model. In our evaluation on real-world data with complex mixtures of repetitive patterns, LSTNet achieved significant performance improvements over that of several state-of-the-art baseline methods. All the data and experiment codes are available online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Time Series Analysis: Forecasting and Control
Geurts, M., Box, G. E. P., & Jenkins, G. M. (1977) · Journal of Marketing Research · doi:10.2307/3150485 · Cited by 19,186
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Breitung, J., & Hamilton, J. D. (1995) · Contemporary Sociology · doi:10.2307/2076916 · Cited by 10,966
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Hamilton, J. D. (1994) · Princeton University Press eBooks · doi:10.1515/9780691218632 · Cited by 7,293
New Introduction to Multiple Time Series Analysis
Lütkepohl, H. (2005) · Springer eBooks · doi:10.1007/978-3-540-27752-1 · Cited by 5,918
Time Series Analysis: Forecasting and Control.
Anderson, O. D., Box, G. E. P., & Jenkins, G. M. (1978) · The Statistician · doi:10.2307/2988198 · Cited by 5,298
Time series forecasting using a hybrid ARIMA and neural network model
Zhang, G. P. (2003) · Neurocomputing · doi:10.1016/s0925-2312(01)00702-0 · Cited by 4,428
Forecasting with artificial neural networks:
Zhang, G., Eddy Patuwo, B., & Y. Hu, M. (1998) · International Journal of Forecasting · doi:10.1016/s0169-2070(97)00044-7 · Cited by 4,229
Box, G. E. P., & Pierce, D. A. (1970) · Journal of the American Statistical Association · doi:10.1080/01621459.1970.10481180 · Cited by 3,234
Support Vector Method for Function Approximation, Regression Estimation, and Signal Processing
Vapnik, V. N., Golowich, S. E., & Smola, A. J. (1997) · Cited by 2,757
Time series analysis forecasting and control
Janacek, G. (2010) · Journal of Time Series Analysis · doi:10.1111/j.1467-9892.2009.00643.x · Cited by 2,584
Financial time series forecasting using support vector machines
Kim, K.-J. (2003) · Neurocomputing · doi:10.1016/s0925-2312(03)00372-2 · Cited by 1,734
Support vector machine with adaptive parameters in financial time series forecasting
Cao, L. J., & Tay, F. E. H. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.820556 · Cited by 1,008
(2015) · Cited by 989
Temporal Convolutional Networks: A Unified Approach to Action Segmentation
Lea, C., Vidal, R., Reiter, A., & Hager, G. D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49409-8_7 · Cited by 924
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1505.00387 · Cited by 912
Learning to Diagnose with LSTM Recurrent Neural Networks
Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015) · arXiv · doi:10.48550/arxiv.1511.03677 · Cited by 879
Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables
Hammerla, N. Y., Halloran, S., & Ploetz, T. (2016) · arXiv · doi:10.48550/arxiv.1604.08880 · Cited by 606
Gaussian processes for time-series modelling
Roberts, S., Osborne, M., Ebden, M., Reece, S., Gibson, N., & Aigrain, S. (2013) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2011.0550 · Cited by 605
What to Do Next: Modeling User Behaviors by Time-LSTM
Zhu, Y., Li, H., Liao, Y., Wang, B., Guan, Z., Liu, H., & Cai, D. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/504 · Cited by 468
Self-citationHybrid neural network models for hydrologic time series forecasting
Jain, A., & Kumar, A. M. (2007) · Applied Soft Computing · doi:10.1016/j.asoc.2006.03.002 · Cited by 465
Deep Learning: A Generic Approach for Extreme Condition Traffic Forecasting
Yu, R., Li, Y., Shahabi, C., Demiryurek, U., & Liu, Y. (2017) · Proceedings of the 2017 SIAM International Conference on Data Mining · doi:10.1137/1.9781611974973.87 · Cited by 412
Temporal regularized matrix factorization for high-dimensional time series prediction
Yu, H., Rao, N., & Dhillon, I. S. (2016) · neural information processing systems · Cited by 378
Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequences
Neil, D., Pfeiffer, M., & Liu, S. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.48550/arxiv.1610.09513 · Cited by 319
Li, J., & Chen, W. (2014) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2014.03.016 · Cited by 158
Bayesian Time Series Learning with Gaussian Processes
Frigola, R. (2015) · Apollo (University of Cambridge) · doi:10.17863/cam.46480 · Cited by 93
Research works printed but not linked: 13
- Che Z., 2016, Recurrent neural networks for multivariate time series with missing values. arXiv preprint arXiv:1606.01865 · arXiv
- Connor J., 1991, NIPS, 301
- Dasgupta S., 2016, Nonlinear dynamic boltzmann machines for time-series prediction. AAAI-17. Extended research report available at goo. gl/Vd0wna
- Frigola R., 2013, Advances in Neural Information Processing Systems, 3156
- Kingma D., 2014, Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 · arXiv
- LeCun Y., 1995, Convolutional networks for images, speech, and time series. The handbook of brain theory and neural networks, 3361(10):1995
- 10.1002/for.3980030312 · doi:10.1002/for.3980030312
- Melnyk I., 2016, Estimating structured vector autoregressive model. arXiv preprint arXiv:1602.06606 · arXiv
- Neil D., 2016, Advances in Neural Information Processing Systems, 3882
- 10.5555/2832747.2832806 · doi:10.5555/2832747.2832806
- Yu H.-F., 2016, Advances in Neural Information Processing Systems, 847
- Zhang G., 1998, International journal of forecasting, 14(1):35--62
- 10.5555/3172077.3172393 · doi:10.5555/3172077.3172393
Cited by
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., & Zhang, W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17325 · Cited by 7,752
Are Transformers Effective for Time Series Forecasting?
Zeng, A., Chen, M., Zhang, L., & Xu, Q. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26317 · Cited by 3,320
Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks
Wu, Z., Pan, S., Long, G., Jiang, J., Chang, X., & Zhang, C. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403118 · Cited by 2,001
Recurrent Neural Networks for Time Series Forecasting: Current status and future directions
Hewamalage, H., Bergmeir, C., & Bandara, K. (2021) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2020.06.008 · Cited by 1,371
Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting
Li, S., Jin, X., Xuan, Y., Zhou, X., Chen, W., Wang, Y.-X., & Yan, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.00235 · Cited by 1,053
Metadata
- Authors
- Lai, G., Chang, W.-C., Yang, Y., & Liu, H.
- Venue
- The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval
- Publisher
- ACM
- Published
- 2018-06-27
- Pages
- 95-104
- OpenAlex
- W2604847698
- Cited by
- 2,152
- References
- 33
- FWCI
- 78.99
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.