The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Forecasting across time series databases using recurrent neural networks on groups of similar series: A clustering approach
Open accessAbstract
With the advent of Big Data, nowadays in many applications databases containing large quantities of similar time series are available. Forecasting time series in these domains with traditional univariate forecasting procedures leaves great potentials for producing accurate forecasts untapped. Recurrent neural networks (RNNs), and in particular Long Short-Term Memory (LSTM) networks, have proven recently that they are able to outperform state-of-the-art univariate time series forecasting methods in this context when trained across all available time series. However, if the time series database is heterogeneous, accuracy may degenerate, so that on the way towards fully automatic forecasting methods in this space, a notion of similarity between the time series needs to be built into the methods. To this end, we present a prediction model that can be used with different types of RNN models on subgroups of similar time series, which are identified by time series clustering techniques. We assess our proposed methodology using LSTM networks, a widely popular RNN variant. Our method achieves competitive results on benchmarking datasets under competition evaluation procedures. In particular, in terms of mean sMAPE accuracy, it consistently outperforms the baseline LSTM model and outperforms all other methods on the CIF2016 forecasting competition dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Least squares quantization in PCM
Lloyd, S. (1982) · IEEE Transactions on Information Theory · doi:10.1109/tit.1982.1056489 · Cited by 15,836
An Analysis of Transformations
Box, G. E. P., & Cox, D. R. (1964) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1964.tb00553.x · Cited by 15,052
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
(2016) · Cited by 11,679
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“For more information on RNN design patters, we refer to Goodfellow et al. (2016).”
BackgroundLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
Approximation capabilities of multilayer feedforward networks
Hornik, K. (1991) · Neural Networks · doi:10.1016/0893-6080(91)90009-t · Cited by 6,091
Another look at measures of forecast accuracy
Hyndman, R. J., & Koehler, A. B. (2006) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2006.03.001 · Cited by 5,757
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 3×
“As a result, RNN architectures are heavily used in domains such as Natural Language Processing (Mikolov et al., 2010), machine translation (Sutskever et al., 2014), and speech recognition (Graves et al., 2013), and are also gaining popularity in time series research (Fei and Yeung, 2015; Paw lowski and Kurach, 2015; L…”
MethodInfluentialTime Series Analysis: Forecasting and Control.
Anderson, O. D., Box, G. E. P., & Jenkins, G. M. (1978) · The Statistician · doi:10.2307/2988198 · Cited by 5,298
Learning to forget: Continual prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 4,823
Forecasting principles and practice
Hyndman, R. J., & Athanasopoulos, G. (2018) · Cited by 4,405
Forecasting with artificial neural networks:
Zhang, G., Eddy Patuwo, B., & Y. Hu, M. (1998) · International Journal of Forecasting · doi:10.1016/s0169-2070(97)00044-7 · Cited by 4,229
Automatic Time Series Forecasting: The forecast Package for R
Hyndman, R. J., & Khandakar, Y. (2008) · Journal of Statistical Software · doi:10.18637/jss.v027.i03 · Cited by 3,511
factoextra: Extract and Visualize the Results of Multivariate Data Analyses
Kassambara, A., & Mundt, F. (2016) · CRAN: Contributed Packages · doi:10.32614/cran.package.factoextra · Cited by 3,295
A Survey of Clustering Data Mining Techniques
Berkhin, P. (2006) · Grouping Multidimensional Data · doi:10.1007/3-540-28349-8_2 · Cited by 2,804
Clustering of time series data—a survey
Warren Liao, T. (2005) · Pattern Recognition · doi:10.1016/j.patcog.2005.01.025 · Cited by 2,401
STL : A Seasonal-Trend Decomposition Procedure Based on Loess
Cleveland, R. B. (1990) · Medical Entomology and Zoology · Cited by 2,244
García, S., Fernández, A., Luengo, J., & Herrera, F. (2010) · Information Sciences · doi:10.1016/j.ins.2009.12.010 · Cited by 2,229
The Boosting Approach to Machine Learning: An Overview
Schapire, R. E. (2003) · Lecture Notes in Statistics · doi:10.1007/978-0-387-21579-2_9 · Cited by 2,003
Time-series clustering – A decade review
Aghabozorgi, S., Seyed Shirkhorshidi, A., & Ying Wah, T. (2015) · Information Systems · doi:10.1016/j.is.2015.04.007 · Cited by 1,826 · cited 1×
“Also, many such measures mostly focus on the shape of the respective time series (Aghabozorgi et al., 2015), and they may yield unintuitive results and limited interpretability (Wang et al.”
BackgroundThe M3-Competition: results, conclusions and implications
Makridakis, S., & Hibon, M. (2000) · International Journal of Forecasting · doi:10.1016/s0169-2070(00)00057-1 · Cited by 1,695
The accuracy of extrapolation (time series) methods: Results of a forecasting competition
Makridakis, S., Andersen, A., Carbone, R., Fildes, R., Hibon, M., Lewandowski, R., Newton, J., Parzen, E., & Winkler, R. (1982) · Journal of Forecasting · doi:10.1002/for.3980010202 · Cited by 1,462
Recurrent neural networks and robust time series prediction
Connor, J. T., Martin, R. D., & Atlas, L. E. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279188 · Cited by 1,316
A review of unsupervised feature learning and deep learning for time-series modeling
Längkvist, M., Karlsson, L., & Loutfi, A. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.01.008 · Cited by 1,243
Out-of-sample tests of forecasting accuracy: an analysis and review
Tashman, L. J. (2000) · International Journal of Forecasting · doi:10.1016/s0169-2070(00)00065-0 · Cited by 1,021
Neural network forecasting for seasonal and trend time series
Zhang, G. P., & Qi, M. (2005) · European Journal of Operational Research · doi:10.1016/j.ejor.2003.08.037 · Cited by 986
Automatic time series forecasting: the forecast package for R
Hyndman, R. J., & Khandakar, Y. (2017) · RePEc: Research Papers in Economics · doi:10.26180/5090230 · Cited by 978
Learning to Diagnose with LSTM Recurrent Neural Networks
Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015) · arXiv · doi:10.48550/arxiv.1511.03677 · Cited by 879
dbscan: Fast Density-Based Clustering with R
Hahsler, M., Piekenbrock, M., & Doran, D. (2019) · Journal of Statistical Software · doi:10.18637/jss.v091.i01 · Cited by 802
forecast: Forecasting Functions for Time Series and Linear Models
Hyndman, R., Athanasopoulos, G., Bergmeir, C., Caceres, G., Chhay, L., Kuroptev, K., Mücke, M., O'Hara-Wild, M., Petropoulos, F., Razbash, S., et al. (2009) · CRAN: Contributed Packages · doi:10.32614/cran.package.forecast · Cited by 791
Self-citationBen Taieb, S., Bontempi, G., Atiya, A. F., & Sorjamaa, A. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.01.039 · Cited by 734
Characteristic-Based Clustering for Time Series Data
Wang, X., Smith, K., & Hyndman, R. (2006) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-005-0039-x · Cited by 679
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units
Le, Q. V., Jaitly, N., & Hinton, G. E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00941 · Cited by 513
How effective are neural networks at forecasting and prediction? A review and evaluation
Adya, M., & Collopy, F. (1998) · Journal of Forecasting · doi:10.1002/(sici)1099-131x(1998090)17:5/6<481::aid-for709>3.0.co;2-q · Cited by 451
Gradient-based learning algorithms for recurrent networks and their computational complexity
Williams, R. J., & Zipser, D. (1995) · Cited by 424
Time Series Forecasting with Neural Networks: A Comparative Study Using the Air Line Data
Faraway, J., & Chatfield, C. (1998) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/1467-9876.00109 · Cited by 419
Time series forecasting using neural networks vs. Box- Jenkins methodology
Tang, Z., de Almeida, C., & Fishwick, P. A. (1991) · SIMULATION · doi:10.1177/003754979105700508 · Cited by 407
CNTK: Microsoft's Open-Source Deep-Learning Toolkit
Seide, F., & Agarwal, A. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2945397 · Cited by 382
Highly Comparative Feature-Based Time-Series Classification
Fulcher, B. D., & Jones, N. S. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2316504 · Cited by 343
Travel time prediction with LSTM neural network
Duan, Y., L.V., Y., & Wang, F.-Y. (2016) · 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2016.7795686 · Cited by 336
Bagging exponential smoothing methods using STL decomposition and Box–Cox transformation
Bergmeir, C., Hyndman, R. J., & Benítez, J. M. (2016) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2015.07.002 · Cited by 328
Self-citationNeural network ensemble operators for time series forecasting
Kourentzes, N., Barrow, D. K., & Crone, S. F. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.12.011 · Cited by 292
Multi-output bus travel time prediction with convolutional LSTM neural network
Petersen, N. C., Rodrigues, F., & Pereira, F. C. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.11.028 · Cited by 288
Temporal Models for Predicting Student Dropout in Massive Open Online Courses
Fei, M., & Yeung, D.-Y. (2015) · 2015 IEEE International Conference on Data Mining Workshop (ICDMW) · doi:10.1109/icdmw.2015.174 · Cited by 276
Crone, S. F., Hibon, M., & Nikolopoulos, K. (2011) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2011.04.001 · Cited by 271
Findings from evidence-based forecasting: Methods for reducing forecast error
Armstrong, J. S. (2006) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2006.04.006 · Cited by 199
Measuring forecasting accuracy: The case of judgmental adjustments to SKU-level demand forecasts
Davydenko, A., & Fildes, R. (2013) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2012.09.002 · Cited by 193
Time series forecasting with neural network ensembles: an application for exchange rate prediction
Zhang, G. P., & Berardi, V. L. (2001) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601133 · Cited by 191
Large-Scale Unusual Time Series Detection
Hyndman, R. J., Wang, E., & Laptev, N. (2015) · 2015 IEEE International Conference on Data Mining Workshop (ICDMW) · doi:10.1109/icdmw.2015.104 · Cited by 189
Evaluating Forecasting Methods
Armstrong, J. S. (2001) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-0-306-47630-3_20 · Cited by 183
Toward Automatic Time-Series Forecasting Using Neural Networks
Yan, W. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2198074 · Cited by 182
Time series forecasting using neural networks: should the data be deseasonalized first?
Nelson, M., Hill, T., Remus, W., & O'Connor, M. (1999) · Journal of Forecasting · doi:10.1002/(sici)1099-131x(199909)18:5<359::aid-for746>3.0.co;2-p · Cited by 175
MML clustering of multi-state, Poisson, von Mises circular and Gaussian distributions
Wallace, C. S., & Dowe, D. L. (2000) · Statistics and Computing · doi:10.1023/a:1008992619036 · Cited by 167
Hyndman, R. J., & Billah, B. (2003) · International Journal of Forecasting · doi:10.1016/s0169-2070(01)00143-1 · Cited by 161
Impact of information exchange on supplier forecasting performance
Trapero, J. R., Kourentzes, N., & Fildes, R. A. (2011) · Omega · doi:10.1016/j.omega.2011.08.009 · Cited by 129
On the identification of sales forecasting models in the presence of promotions
Trapero, J. R., Kourentzes, N., & Fildes, R. A. (2014) · Journal of the Operational Research Society · doi:10.1057/jors.2013.174 · Cited by 101
A comparison of AdaBoost algorithms for time series forecast combination
Barrow, D. K., & Crone, S. F. (2016) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2016.01.006 · Cited by 81
An evaluation of neural network ensembles and model selection for time series prediction
Barrow, D. K., Crone, S. F., & Kourentzes, N. (2010) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2010.5596686 · Cited by 54
Layered Ensemble Architecture for Time Series Forecasting
Rahman, M. M., Islam, M. M., Murase, K., & Yao, X. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2401038 · Cited by 38
Exploiting big data in time series forecasting: A cross-sectional approach
Hartmann, C., Hahmann, M., Lehner, W., & Rosenthal, F. (2015) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2015.7344786 · Cited by 17
Detecting Methane Outbreaks from Time Series Data with Deep Neural Networks
Pawłowski, K., & Kurach, K. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25783-9_42 · Cited by 9
Cited by
A survey on sentiment analysis methods, applications, and challenges
Wankhade, M., Rao, A. C. S., & Kulkarni, C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10144-1 · Cited by 1,528
Recurrent Neural Networks for Time Series Forecasting: Current status and future directions
Hewamalage, H., Bergmeir, C., & Bandara, K. (2021) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2020.06.008 · Cited by 1,371
Self-citationForecasting: theory and practice
Petropoulos, F., Apiletti, D., Assimakopoulos, V., Babai, M. Z., Barrow, D. K., Ben Taieb, S., Bergmeir, C., Bessa, R. J., Bijak, J., Boylan, J. E., et al. (2022) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.11.001 · Cited by 921
Self-citationAn Experimental Review on Deep Learning Architectures for Time Series Forecasting
Lara-Benítez, P., Carranza-García, M., & Riquelme, J. C. (2021) · International Journal of Neural Systems · doi:10.1142/s0129065721300011 · Cited by 532
Probabilistic forecasting with temporal convolutional neural network
Chen, Y., Kang, Y., Chen, Y., & Wang, Z. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.011 · Cited by 393
Metadata
- Authors
- Bandara, K., Bergmeir, C., & Smyl, S.
- Venue
- Expert Systems with Applications
- Publisher
- Elsevier BV
- Published
- 2020-02
- Volume
- 140
- Pages
- 112896
- ISSN
- 0957-4174 (ISSN-L)
- OpenAlex
- W2891702854
- Cited by
- 435
- References
- 68
- FWCI
- 25.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.