Cited by 3,291Time Series Analysis and ForecastingForecasting Techniques and ApplicationsTraffic Prediction and Management Techniques

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Temporal Fusion Transformers for interpretable multi-horizon time series forecasting

Open access

Lim, Bryan, Arık, Sercan Ö., Loeff, Nicolas, Pfister, Tomas·2021·International Journal of Forecasting

DOI 10.1016/j.ijforecast.2021.03.012

Open this paper in CoChat — free account Open PDF

Abstract

Multi-horizon forecasting often contains a complex mix of inputs – including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed in the past – without any prior information on how they interact with the target. Several deep learning methods have been proposed, but they are typically ‘black-box’ models that do not shed light on how they use the full range of inputs present in practical scenarios. In this paper, we introduce the Temporal Fusion Transformer (TFT) – a novel attention-based architecture that combines high-performance multi-horizon forecasting with interpretable insights into temporal dynamics. To learn temporal relationships at different scales, TFT uses recurrent layers for local processing and interpretable self-attention layers for long-term dependencies. TFT utilizes specialized components to select relevant features and a series of gating layers to suppress unnecessary components, enabling high performance in a wide range of scenarios. On a variety of real-world datasets, we demonstrate significant performance improvements over existing benchmarks, and highlight three practical interpretability use cases of TFT.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1016/j.ijforecast.2021.03.012

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Attention Is All You Need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Long Short-Term Memory
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Layer NormalizationPreprint
Ba, J., Kiros, J., & Hinton, G. E. (2016) · arXiv.org · doi:10.48550/arxiv.1607.06450 · Cited by 13,762
On a Method to Measure Supervised Multiclass Model’s Interpretability: Application to Degradation Diagnosis (Short Paper)
Gauriat, C.-M., Pencolé, Y., Ribot, P., et al. (2024) · HAL · doi:10.4230/oasics.dx.2024.27 · Cited by 12,623
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682
Kernel-based object tracking
Comaniciu, D., Ramesh, V., & Meer, P. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1195991 · Cited by 4,560
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513
Residual Attention Network for Image Classification
Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.683 · Cited by 4,073

Show all 41 references

Sorted by citations

Time-series forecasting with deep learning: a survey
Lim, B. Y., & Zohren, S. (2021) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2020.0209 · Cited by 2,198
Self-citation
Multimodal biomedical AI
Acosta, J. N., Falcone, G. J., Rajpurkar, P., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-022-01981-2 · Cited by 1,365
A Transformer-based Framework for Multivariate Time Series Representation Learning
Zerveas, G., Jayaraman, S., Patel, D., Bhamidipaty, A., & Eickhoff, C. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467401 · Cited by 1,278
Transformers in Time Series: A Survey
Wen, Q., Zhou, T., Zhang, C., Chen, W., Ma, Z., Yan, J., & Sun, L. (2023) · Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/759 · Cited by 1,260
Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction
Yu, C., Ma, X., Ren, J., Zhao, H., & Yi, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58610-2_30 · Cited by 645
NHITS: Neural Hierarchical Interpolation for Time Series Forecasting
Challú, C., Olivares, K. G., Oreshkin, B. N., Ramírez, F. G., Mergenthaler, M., & Dubrawski, A. W. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25854 · Cited by 760
Traffic transformer: Capturing the continuity and periodicity of time series for traffic forecasting
Cai, L., Janowicz, K., Mai, G., Yan, B., & Zhu, R. (2020) · Transactions in GIS · doi:10.1111/tgis.12644 · Cited by 418
Deep Learning for Time Series Forecasting: Tutorial and Literature Survey
Benidis, K., Rangapuram, S. S., Flunkert, V., Wang, Y., Maddix, D., Turkmen, C., Gasthaus, J., Bohlke-Schneider, M., Salinas, D., Stella, L., et al. (2023) · ACM Computing Surveys · doi:10.1145/3533382 · Cited by 382
Transformers in Time-Series Analysis: A Tutorial
Ahmed, S., Nielsen, I. E., Tripathi, A. G., Siddiqui, S., Ramachandran, R. P., & Rasool, G. (2023) · Circuits Systems and Signal Processing · doi:10.1007/s00034-023-02454-8 · Cited by 364
A multi-head attention-based transformer model for traffic flow forecasting with a comparative analysis to recurrent neural networks
Reza, S., Ferreira, M. C., Machado, J. J. M., & Tavares, J. M. R. S. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117275 · Cited by 334
Improved multistep ahead photovoltaic power prediction model based on LSTM and self-attention with weather forecast data
Hu, Z., Gao, Y., Siyu, J. I., Masayuki, M. A. E., & Imaizumi, T. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.122709 · Cited by 315
Unlocking the black box: an in-depth review on interpretability, explainability, and reliability in deep learning
Şahin, E., Arslan, N. N., & Özdemir, D. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10437-2 · Cited by 358
GETNext
Yang, S., Liu, J., & Zhao, K. (2022) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3477495.3531983 · Cited by 311
A comprehensive survey of deep learning for time series forecasting: architectural diversity and open challenges
Kim, J., Kim, H., Kim, H., Lee, D., & Yoon, S. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11223-9 · Cited by 389
Harnessing eXplainable artificial intelligence for feature selection in time series energy forecasting: A comparative analysis of Grad-CAM and SHAP
van Zyl, C., Ye, X., & Naidoo, R. M. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.122079 · Cited by 273
Deep learning for time series forecasting: a survey
Kong, X., Chen, Z., Liu, W., Ning, K., Zhang, L., Marier, S. M., Liu, Y., Chen, Y., & Xia, F. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02560-w · Cited by 312
Interpretable wind speed prediction with multivariate time series and temporal fusion transformers
Wu, B., Wang, L., & Zeng, Y. (2022) · Energy · doi:10.1016/j.energy.2022.123990 · Cited by 224
A transformer-based deep neural network with wavelet transform for forecasting wind speed and wind energy
Nascimento, E. G. S., Melo, T. A. C., & Moreira, D. M. (2023) · Energy · doi:10.1016/j.energy.2023.127678 · Cited by 223
Spatio-temporal wind speed forecasting using graph networks and novel Transformer architectures
Bentsen, L. Ø., Warakagoda, N. D., Stenbro, R., & Engelstad, P. E. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.120565 · Cited by 231
Battery Safety: Machine Learning-Based Prognostics
Zhao, J., Feng, X., Pang, Q., Fowler, M., Lian, Y., Ouyang, M., & Burke, A. F. (2024) · Progress in Energy and Combustion Science · doi:10.1016/j.pecs.2023.101142 · Cited by 216
Foundations & Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions
Liang, P. P., Zadeh, A., & Morency, L. (2024) · ACM Computing Surveys · doi:10.1145/3656580 · Cited by 438
A systematic review for transformer-based long-term series forecasting
Su, L., Zuo, X., Li, R., Wang, X., Zhao, H., & Huang, B. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11044-2 · Cited by 237
TKAN: Temporal Kolmogorov-Arnold NetworksPreprint
Genet, R., & Inzirillo, H. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4825654 · Cited by 267
Machine Fault Detection Using a Hybrid CNN-LSTM Attention-Based Model
Borré, A., Seman, L. O., Camponogara, E., Stefenon, S. F., Mariani, V. C., & Coelho, L. D. S. (2023) · Sensors · doi:10.3390/s23094512 · Cited by 164
A Comprehensive Survey of Regression-Based Loss Functions for Time Series Forecasting
Jadon, A., Patil, A., & Jadon, S. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-3245-6_9 · Cited by 206
A temporal fusion transformer for short-term freeway traffic speed multistep prediction
Zhang, H., Zou, Y., Yang, X., & Yang, H. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.05.083 · Cited by 141
TCCT: Tightly-coupled convolutional transformer on time series forecasting
Shen, L., & Wang, Y. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.01.039 · Cited by 148
Evaluation of post-hoc interpretability methods in time-series classification
Turbé, H., Bjelogrlic, M., Lovis, C., & Mengaldo, G. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00620-w · Cited by 130
Deep Time Series Forecasting Models: A Comprehensive Survey
Liu, X., & Wang, W. (2024) · Mathematics · doi:10.3390/math12101504 · Cited by 152
Short-term electricity load forecasting—A systematic approach from system level to secondary substations
Pinheiro, M. G., Madeira, S. C., & Francisco, A. P. (2023) · Applied Energy · doi:10.1016/j.apenergy.2022.120493 · Cited by 119
Specialized Deep Neural Networks for Battery Health Prognostics: Opportunities and Challenges
Zhao, J., Han, X., Ouyang, M., & Burke, A. F. (2023) · Journal of Energy Chemistry · doi:10.1016/j.jechem.2023.08.047 · Cited by 129
Forecasting energy consumption demand of customers in smart grid using Temporal Fusion Transformer (TFT)
Nazir, A., Shaikh, A. K., Shah, A. S., & Khalil, A. (2023) · Results in Engineering · doi:10.1016/j.rineng.2023.100888 · Cited by 128
Toward Explainable Artificial Intelligence for Regression Models: A methodological perspective
Letzgus, S., Wagner, P., Lederer, J., Samek, W., Müller, K., & Montavon, G. (2022) · IEEE Signal Processing Magazine · doi:10.1109/msp.2022.3153277 · Cited by 139
Optimizing multi-step wind power forecasting: Integrating advanced deep neural networks with stacking-based probabilistic learning
Takara, L. D. A., Teixeira, A. C., Yazdanpanah, H., Mariani, V. C., & Coelho, L. D. S. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.123487 · Cited by 132
Expanding the prediction capacity in long sequence time-series forecasting
Zhou, H., Li, J., Zhang, S., Zhang, S., Yan, M., & Xiong, H. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103886 · Cited by 137
Transformer models in biomedicine
Madan, S., Lentzen, M., Brandt, J., Rueckert, D., Hofmann‐Apitius, M., & Fröhlich, H. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02600-5 · Cited by 143
EXplainable Artificial Intelligence (XAI)—From Theory to Methods and Applications
Ortigossa, E. S., Gonçalves, T., & Nonato, L. G. (2024) · IEEE Access · doi:10.1109/access.2024.3409843 · Cited by 124
Prediction of biogas production in anaerobic co-digestion of organic wastes using deep learning models
Jeong, K., Abbas, A., Shin, J., Son, M., Kim, Y. M., & Cho, K. H. (2021) · Water Research · doi:10.1016/j.watres.2021.117697 · Cited by 126
Application of Temporal Fusion Transformer for Day-Ahead PV Power Forecasting
Santos, M. L., García‐Santiago, X., Camarero, F. E., Gil, G. B., & Ortega, P. C. (2022) · Energies · doi:10.3390/en15145232 · Cited by 135
Forecasting with trees
Januschowski, T., Wang, Y., Torkkola, K., Erkkilä, T., Hasson, H., & Gasthaus, J. A. (2021) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2021.10.004 · Cited by 141
Short-Term Electricity Load Forecasting Based on Temporal Fusion Transformer Model
Huy, P. C., Minh, N. Q., Tien, N. D., & Anh, T. T. Q. (2022) · IEEE Access · doi:10.1109/access.2022.3211941 · Cited by 119
Deep learning-based time series forecasting
Song, X., Deng, L., Wang, H., Zhang, Y., He, Y., & Cao, W. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10989-8 · Cited by 151
Interpretable building energy consumption forecasting using spectral clustering algorithm and temporal fusion transformers architecture
Zheng, P., Zhou, H., Liu, J., & Nakanishi, Y. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.121607 · Cited by 118
Li-ion battery capacity prediction using improved temporal fusion transformer model
Gomez, W., Wang, F., & Chou, J. (2024) · Energy · doi:10.1016/j.energy.2024.131114 · Cited by 118
Transformers in EEG Analysis: A Review of Architectures and Applications in Motor Imagery, Seizure, and Emotion Classification
Vafaei, E., & Hosseini, M. (2025) · Sensors · doi:10.3390/s25051293 · Cited by 147
Real-time decision-making for Digital Twin in additive manufacturing with Model Predictive Control using time-series deep neural networks
Chen, Y.-P., Karkaria, V. N., Tsai, Y.-K., Rolark, F., Quispe, D., Gao, R. X., Cao, J., & Chen, W. (2025) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2025.03.009 · Cited by 114
Data-driven science and machine learning methods in laser–plasma physics
Döpp, A., Eberle, C., Howard, S., Irshad, F., Lin, J., & Streeter, M. J. V. (2023) · High Power Laser Science and Engineering · doi:10.1017/hpl.2023.47 · Cited by 119
Multi-Sensor Fault Detection, Identification, Isolation and Health Forecasting for Autonomous Vehicles
Safavi, S., Safavi, M. A., Hamid, H., & Fallah, S. (2021) · Sensors · doi:10.3390/s21072547 · Cited by 109
Semantic understanding and prompt engineering for large-scale traffic data imputation
Zhang, K., Zhou, F., Wu, L., Xie, N., & He, Z. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102038 · Cited by 113
RSAM: Robust Self-Attention Based Multi-Horizon Model for Solar Irradiance Forecasting
Sharda, S., Singh, M., & Sharma, K. (2020) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2020.3046098 · Cited by 105
Time Series Forecasting Model for Supermarket Sales using FB-Prophet
Jha, B. K., & Pande, S. M. (2021) · International Conference on Computing Methodologies and Communication (ICCMC) · doi:10.1109/iccmc51019.2021.9418033 · Cited by 102
Image-based time series forecasting: A deep convolutional neural network approach
Semenoglou, A.-A., Spiliotis, E., & Assimakopoulos, V. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.10.006 · Cited by 111
Temporal Fusion Transformers for streamflow Prediction: Value of combining attention with recurrence
Koya, S. R., & Roy, T. (2024) · Journal of Hydrology · doi:10.1016/j.jhydrol.2024.131301 · Cited by 120
Preformer: Predictive Transformer with Multi-Scale Segment-Wise Correlations for Long-Term Time Series Forecasting
Du, D., Su, B., & Wei, Z. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096881 · Cited by 107
A Hybrid LSTM-Transformer Model for Power Load Forecasting
Pentsos, V., Tragoudas, S., Wibbenmeyer, J., & Khdeer, N. (2025) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2025.3535407 · Cited by 107
Progress in prediction of remaining useful life of hydrogen fuel cells based on deep learning
He, W., Liu, T., Ming, W., Li, Z., Du, J., Li, X., Guo, X., & Sun, P. (2023) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2023.114193 · Cited by 99
On Forecasting Cryptocurrency Prices: A Comparison of Machine Learning, Deep Learning, and Ensembles
Murray, K., Rossi, A., Carraro, D., & Visentin, A. (2023) · Forecasting · doi:10.3390/forecast5010010 · Cited by 118
MetaProbformer for Charging Load Probabilistic Forecasting of Electric Vehicle Charging Stations
Huang, X., Wu, D., & Boulet, B. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3276947 · Cited by 100
Probabilistic forecasting method for mid-term hourly load time series based on an improved temporal fusion transformer model
Li, D., Tan, Y., Zhang, Y., Miao, S., & He, S. (2022) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2022.108743 · Cited by 92
Transformer-based hierarchical latent space VAE for interpretable remaining useful life prediction
Tao, J., Zheng, P., Xia, L., & Liu, T. (2022) · Advanced Engineering Informatics · doi:10.1016/j.aei.2022.101781 · Cited by 90
Task incremental learning-driven Digital-Twin predictive modeling for customized metal forming product manufacturing process
Li, J., Wang, Z., Zhang, S., Lin, Y., Jiang, L., & Tan, J. (2023) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2023.102647 · Cited by 94
Semi-supervised multivariate time series anomaly detection for wind turbines using generator SCADA data
Zheng, M., Man, J., Wang, D., Chen, Y., Li, Q., & Liu, Y. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2023.109235 · Cited by 89
Do We Really Need Deep Learning Models for Time Series Forecasting?Preprint
Elsayed, S., Thyssens, D., Rashed, A. N. Z., Jomaa, H. S., & Schmidt-Thieme, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.02118 · Cited by 88
A study of deep learning-based multi-horizon building energy forecasting
Ni, Z., Zhang, C., Karlsson, M., & Gong, S. (2023) · Energy and Buildings · doi:10.1016/j.enbuild.2023.113810 · Cited by 93
Interpretable feature-temporal transformer for short-term wind power forecasting with multivariate time series
Liu, L., Wang, X., Dong, X., Chen, K., Chen, Q., & Li, B. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.124035 · Cited by 84
A deep learning framework for constitutive modeling based on temporal convolutional network
Wang, J., Wang, C., Fan, J., & Mo, Y. L. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110784 · Cited by 84
Real-time forecasting of time series in financial markets using sequentially trained dual-LSTMs
Gajamannage, K., Park, Y., & Jayathilake, D. I. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119879 · Cited by 102
Federated learning for 5G base station traffic forecasting
Perifanis, V., Pavlidis, N., Koutsiamanis, R.-A., & Efraimidis, P. S. (2023) · Computer Networks · doi:10.1016/j.comnet.2023.109950 · Cited by 87
A new approach to seasonal energy consumption forecasting using temporal convolutional networks
Shaikh, A. K., Nazir, A., Khalique, N., Shah, A. S., & Adhikari, N. (2023) · Results in Engineering · doi:10.1016/j.rineng.2023.101296 · Cited by 80
Bayesian Spatio-Temporal Graph Transformer Network (B-Star) for Multi-Aircraft Trajectory Prediction
Pang, Y., Zhao, X., Hu, J., Yan, H., & Liu, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108998 · Cited by 84
An improved feature-time Transformer encoder-Bi-LSTM for short-term forecasting of user-level integrated energy loads
Qin, Y. F., Lu, Z., Liu, H., He, X., Zhang, X., & Guo, J. (2023) · Energy and Buildings · doi:10.1016/j.enbuild.2023.113396 · Cited by 82
Data-driven multi-step prediction and analysis of monthly rainfall using explainable deep learning
He, R., Zhang, L., & Chew, A. W. Z. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121160 · Cited by 81
Towards energy efficiency: A comprehensive review of deep learning-based photovoltaic power forecasting strategies
Husein, M., Gago, E. J., Balfaqih, H., & Pegalajar, M. C. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e33419 · Cited by 96
DFNet: Decomposition fusion model for long sequence time-series forecasting
Zhang, F., Guo, T., & Wang, H. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110794 · Cited by 79
A novel Transformer-based network forecasting method for building cooling loads
Li, L., Su, X., Bi, X., Lu, Y., & Sun, X. (2023) · Energy and Buildings · doi:10.1016/j.enbuild.2023.113409 · Cited by 75
Explainable prediction of loan default based on machine learning models
Zhu, X., Chu, Q., Song, X., Hu, P., & Peng, L. (2023) · Data Science and Management · doi:10.1016/j.dsm.2023.04.003 · Cited by 74
Evaluating the Effectiveness of Time Series Transformers for Demand Forecasting in Retail
Oliveira, J. M., & Ramos, P. (2024) · Mathematics · doi:10.3390/math12172728 · Cited by 99
Approaching sales forecasting using recurrent neural networks and transformers
Vallés-Ṕerez, I., Soria‐Olivas, E., Martı́nez-Sober, M., Serrano-López, A. J., Gómez‐Sanchís, J., & Mateo, F. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116993 · Cited by 73
Two-stage decomposition and temporal fusion transformers for interpretable wind speed forecasting
Wu, B., & Wang, L. (2023) · Energy · doi:10.1016/j.energy.2023.129728 · Cited by 72
From DevOps to MLOps: Overview and Application to Electricity Market Forecasting
Subramanya, R., Sierla, S., & Vyatkin, V. V. (2022) · Applied Sciences · doi:10.3390/app12199851 · Cited by 79
A survey on wind power forecasting with machine learning approaches
Yang, Y., Lou, H., Wu, J., Zhang, S., & Gao, S. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-09923-4 · Cited by 86
STGHTN: Spatial-temporal gated hybrid transformer network for traffic flow forecasting
Liu, J., Kang, Y., Li, H., Wang, H., & Yang, X. (2022) · Applied Intelligence · doi:10.1007/s10489-022-04122-x · Cited by 70
An optimization-centric review on integrating artificial intelligence and digital twin technologies in manufacturing
Karkaria, V. N., Tsai, Y.-K., Chen, Y.-P., & Chen, W. (2025) · Engineering Optimization · doi:10.1080/0305215x.2024.2434201 · Cited by 78
Deep-learning model using hybrid adaptive trend estimated series for modelling and forecasting sales
Efat, M. I. A., Hájek, P., Abedin, M. Z., Azad, R. U., Jaber, M. A., Aditya, S., & Hassan, M. K. (2022) · Annals of Operations Research · doi:10.1007/s10479-022-04838-6 · Cited by 69
DroughtCast: A Machine Learning Forecast of the United States Drought Monitor
Brust, C., Kimball, J. S., Maneta, M., Jencso, K., & Reichle, R. H. (2021) · Frontiers in Big Data · doi:10.3389/fdata.2021.773478 · Cited by 68
A Novel Two-Stage Framework for Mid-Term Electric Load Forecasting
Sharma, A., & Jain, S. K. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3259445 · Cited by 68
Hypertuned temporal fusion transformer for multi-horizon time series forecasting of dam level in hydroelectric power plants
Stefenon, S. F., Seman, L. O., Aquino, L. S., Mariani, V. C., & Coelho, L. D. S. (2024) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2024.109876 · Cited by 68
Nonlinear inflation forecasting with recurrent neural networks
Almosova, A., & Andresen, N. (2022) · Journal of Forecasting · doi:10.1002/for.2901 · Cited by 79
Short-term residential household reactive power forecasting considering active power demand via deep Transformer sequence-to-sequence networks
Dong, H., Zhu, J., Li, S., Wu, W., Zhu, H., & Fan, J. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.120281 · Cited by 67
Transfer learning integrating similarity analysis for short-term and long-term building energy consumption prediction
Xing, Z., Pan, Y., Yang, Y., Yuan, X., Liang, Y., & Huang, Z. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.123276 · Cited by 71
Edge AI for Real-Time Anomaly Detection in Smart Homes
Reis, M. J. C. S., & Serôdio, C. (2025) · Future Internet · doi:10.3390/fi17040179 · Cited by 79
MCDFN: supply chain demand forecasting via an explainable multi-channel data fusion network model
Jahin, M. A., Shahriar, A., & Amin, M. A. (2025) · Evolutionary Intelligence · doi:10.1007/s12065-025-01053-7 · Cited by 79
Mamba-360: Survey of state space models as transformer alternative for long sequence modelling: Methods, Applications, and Challenges
Patro, B. N., & Agneeswaran, V. S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111279 · Cited by 81
FPSeq2Q: Fully Parameterized Sequence to Quantile Regression for Net-Load Forecasting With Uncertainty Estimates
Faustine, A., & Pereira, L. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3148699 · Cited by 66
Population-Specific Glucose Prediction in Diabetes Care With Transformer-Based Deep Learning on the Edge
Zhu, T., Kuang, L., Piao, C., Zeng, J., Li, K., & Georgiou, P. (2024) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2023.3348844 · Cited by 74
Multi-Horizon Electricity Load and Price Forecasting Using an Interpretable Multi-Head Self-Attention and EEMD-Based Framework
Azam, M. F., & Younis, M. S. (2021) · IEEE Access · doi:10.1109/access.2021.3086039 · Cited by 65
Data-driven models for train control dynamics in high-speed railways: LAG-LSTM for train trajectory prediction
Yin, J., Ning, C., & Tang, T. (2022) · Information Sciences · doi:10.1016/j.ins.2022.04.004 · Cited by 68
Deep learning-based algorithms for long-term prediction of chlorophyll-a in catchment streams
Abbas, A., Park, M., Baek, S.-S., & Cho, K. H. (2023) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.130240 · Cited by 63
Weather-informed probabilistic forecasting and scenario generation in power systems
Zhang, H., Zandehshahvar, M., Tanneau, M., & Hentenryck, P. V. (2025) · Applied Energy · doi:10.1016/j.apenergy.2025.125369 · Cited by 62
Interpretable Probabilistic Forecasting of Imbalances in Renewable-Dominated Electricity Systems
Toubeau, J., Bottieau, J., Wang, Y., & Vallée, F. (2021) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2021.3092137 · Cited by 66

Authors: Lim, B., Arık, S. Ö., Loeff, N., & Pfister, T.
Affiliations: University of Oxford (GB)
Google (United States) (US)
Corresponding author: Lim, Bryan
ORCID: Lim, Bryan
Arık, Sercan Ö.
Venue: International Journal of Forecasting
Publisher: Elsevier BV
Published: 2021-10
Volume: 37
Issue: 4
Pages: 1748-1764
ISSN: 0169-2070 (ISSN-L)
DOI: 10.1016/j.ijforecast.2021.03.012
OpenAlex: W2996331899
Cited by: 3,291
References: 41
Citations by year: 2026: 1359 · 2025: 827 · 2024: 508 · 2023: 362 · 2022: 153 · 2021: 66
FWCI: 126.76
Type: journal article
Language: en
Open access: hybrid
doi.org
Licence: cc-by
www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/legal/tdmrep-license (tdm)
creativecommons.org/licenses/by/4.0/ (vor)
Locations: International Journal of Forecasting (publishedVersion, cc-by)
arXiv (Cornell University) (submittedVersion)
RePEc: Research Papers in Economics (submittedVersion)
arXiv (Cornell University)
Funders: Google Inc
Topics: Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
Social Sciences › Decision Sciences › Management Science and Operations Research › Forecasting Techniques and Applications
Social Sciences › Transportation › Traffic Prediction and Management Techniques
Keywords: Temporal Fusion Transformer, interpretability, self-attention, gating mechanism, feature selection, exogenous variables, recurrent layers, long-range dependencies, temporal dynamics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Temporal Fusion Transformers for interpretable multi-horizon time series forecasting

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks