Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting
Open accessThe DOI matches its OpenAlex record; 43 of the 43 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“We borrow the design of batch normalization [21] to speedup the Auto-Correlation mechanism.”
MethodProbability, Random Variables, and Stochastic Processes.
Abrahams, J., & Papoulis, A. (1984) · Journal of the American Statistical Association · doi:10.2307/2288754 · Cited by 16,226
An interactive web-based dashboard to track COVID-19 in real time
Dong, E., Du, H., & Gardner, L. (2020) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30120-1 · Cited by 10,048 · cited 1×
“We also apply our model to the COVID-19 real-world data [15].”
MethodPostwar U.S. Business Cycles: An Empirical Investigation
Hodrick, R. J., & Prescott, E. C. (1997) · Journal of Money, Credit and Banking · doi:10.2307/2953682 · Cited by 7,349
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
Bai, S., Kolter, J. Z., & Koltun, V. (2018) · arXiv · doi:10.48550/arxiv.1803.01271 · Cited by 4,655
Forecasting principles and practice
Hyndman, R. J., & Athanasopoulos, G. (2018) · Cited by 4,405
The Analysis of Time Series: An Introduction
Dickey, D. A., & Chatfield, C. (1991) · Technometrics · doi:10.2307/1268794 · Cited by 3,525
Time Series Analysis, Forecasting, and Control
Ziegel, E. R., Box, G., Jenkins, G., & Reinsel, G. (1995) · Technometrics · doi:10.2307/1269640 · Cited by 3,494
Taylor, S. J., & Letham, B. (2018) · The American Statistician · doi:10.1080/00031305.2017.1380080 · Cited by 2,737
DeepAR: Probabilistic forecasting with autoregressive recurrent networks
Salinas, D., Flunkert, V., Gasthaus, J., & Januschowski, T. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.07.001 · Cited by 2,661
STL : A Seasonal-Trend Decomposition Procedure Based on Loess
Cleveland, R. B. (1990) · Medical Entomology and Zoology · Cited by 2,244
Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks
Lai, G., Chang, W.-C., Yang, Y., & Liu, H. (2018) · The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval · doi:10.1145/3209978.3210006 · Cited by 2,152
Time Series Analysis Forecasting and Control
Bartholomew, D. J. (1971) · Journal of the Operational Research Society · doi:10.1057/jors.1971.52 · Cited by 1,792
Christiano, L. J., & Fitzgerald, T. J. (2003) · International Economic Review · doi:10.1111/1468-2354.t01-1-00076 · Cited by 1,786
Wiener, N. (1930) · Acta Mathematica · doi:10.1007/bf02546511 · Cited by 1,765
A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction
Qin, Y., Song, D., Chen, H., Cheng, W., Jiang, G., & Cottrell, G. W. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/366 · Cited by 1,585
Reformer: The Efficient Transformer
Kitaev, N., Kaiser, Ł., & Levskaya, A. (2020) · arXiv · doi:10.48550/arxiv.2001.04451 · Cited by 1,435 · cited 13×
“Recent deep forecasting models [41, 17, 20, 28, 23, 29, 19, 35] have achieved great progress, especially the Transformer-based models.”
BackgroundMethodInfluentialDeep State Space Models for Time Series Forecasting
Rangapuram, S. S., Seeger, M., Gasthaus, J. A., Stella, L., Wang, Y., & Januschowski, T. (2018) · neural information processing systems · Cited by 1,097
Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting
Li, S., Jin, X., Xuan, Y., Zhou, X., Chen, W., Wang, Y.-X., & Yan, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.00235 · Cited by 1,053
Temporal pattern attention for multivariate time series forecasting
Shih, S.-Y., Sun, F.-K., & Lee, H.-Y. (2019) · Machine Learning · doi:10.1007/s10994-019-05815-0 · Cited by 960
Attend and Diagnose: Clinical Time Series Analysis Using Attention Models
Song, H., Rajan, D., Thiagarajan, J., & Spanias, A. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11635 · Cited by 468
(2021) · International Conference on Learning Representations · Cited by 449
Methodology for long-term prediction of time series
Sorjamaa, A., Hao, J., Reyhani, N., Ji, Y., & Lendasse, A. (2007) · Neurocomputing · doi:10.1016/j.neucom.2006.06.015 · Cited by 438
Conditional Time Series Forecasting with Convolutional Neural Networks
Borovykh, A., Bohté, S. M., & Oosterlee, C. W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04691 · Cited by 362
A Multi-Horizon Quantile Recurrent Forecaster
Wen, R., Torkkola, K., Narayanaswamy, B., & Madeka, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11053 · Cited by 236
Normalizing Kalman Filters for Multivariate Time Series Analysis
de Bézenac, E., Rangapuram, S. S., Benidis, K., Bohlke‐Schneider, M., Kurle, R., Stella, L., Hasson, H., Gallinari, P., & Januschowski, T. (2020) · neural information processing systems · Cited by 164
N-BEATS: Neural basis expansion analysis for interpretable time series forecasting
Oreshkin, B. N., Carpov, D., Chapados, N., & Bengio, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10437 · Cited by 162
Adversarial Sparse Transformer for Time Series Forecasting
Wu, S., Xiao, X., Ding, Q., Zhao, P., Wei, Y., & Huang, J. (2020) · neural information processing systems · Cited by 159
Long-term Forecasting using Higher Order Tensor RNNsPreprint
Yu, R., Zheng, S., Anandkumar, A., & Yue, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00073 · Cited by 152
Measuring predictability: theory and macroeconomic applications
Diebold, F. X., & Kilian, L. (2001) · Journal of Applied Econometrics · doi:10.1002/jae.619 · Cited by 135
Long-term Forecasting using Tensor-Train RNNs
Yu, R., Zheng, S., Anandkumar, A., & Yue, Y. (2017) · CaltechAUTHORS (California Institute of Technology) · Cited by 132
A spatio-temporal decomposition based deep neural network for time series forecasting
Asadi, R., & Regan, A. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105963 · Cited by 116
Anderson, O. D., & Kendall, M. G. (1976) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2988091 · Cited by 83
Huang, C.-Z. A., Vaswani, A., Uszkoreit, J., Shazeer, N., Simon, I., Hawthorne, C., Dai, A. M., Hoffman, M. D., Dinculescu, M., & Eck, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04281 · Cited by 68
Deep Factors with Gaussian Processes for ForecastingPreprint
Maddix, D. C., Wang, Y., & Smola, A. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00098 · Cited by 57
Deep Rao-Blackwellised Particle Filters for Time Series Forecasting
Kurle, R., Rangapuram, S. S., de Bézenac, E., Günnemann, S., & Gasthaus, J. A. (2020) · neural information processing systems · Cited by 42
Cited by
Transformers in Time Series: A Survey
Wen, Q., Zhou, T., Zhang, C., Chen, W., Ma, Z., Yan, J., & Sun, L. (2023) · Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/759 · Cited by 1,260
NHITS: Neural Hierarchical Interpolation for Time Series Forecasting
Challu, C., Olivares, K. G., Oreshkin, B. N., Garza Ramirez, F., Mergenthaler Canseco, M., & Dubrawski, A. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25854 · Cited by 537
Spatio-Temporal Adaptive Embedding Makes Vanilla Transformer SOTA for Traffic Forecasting
Liu, H., Dong, Z., Jiang, R., Deng, J., Deng, J., Chen, Q., & Song, X. (2023) · Proceedings of the 32nd ACM International Conference on Information and Knowledge Management · doi:10.1145/3583780.3615160 · Cited by 383
PromptCast: A New Prompt-Based Learning Paradigm for Time Series Forecasting
Xue, H., & Salim, F. D. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3342137 · Cited by 302
Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy
Xu, J., Wu, H., Wang, J., & Long, M. (2021) · arXiv (Cornell University) · doi:10.4230/lipics.time.2024.17 · Cited by 233
Self-citation
Metadata
- Authors
- Wu, H., Xu, J., Wang, J., & Long, M.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2021-06-24
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2106.13008
- OpenAlex
- W3173539742
- Cited by
- 498
- References
- 43
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.