The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Spatio-Temporal Adaptive Embedding Makes Vanilla Transformer SOTA for Traffic Forecasting
Open accessAbstract
With the rapid development of the Intelligent Transportation System (ITS), accurate traffic forecasting has emerged as a critical challenge. The key bottleneck lies in capturing the intricate spatio-temporal traffic patterns. In recent years, numerous neural networks with complicated architectures have been proposed to address this issue. However, the advancements in network architectures have encountered diminishing performance gains. In this study, we present a novel component called spatio-temporal adaptive embedding that can yield outstanding results with vanilla transformers. Our proposed Spatio-Temporal Adaptive Embedding transformer (STAEformer) achieves state-of-the-art performance on five real-world traffic forecasting datasets. Further experiments demonstrate that spatio-temporal adaptive embedding plays a crucial role in traffic forecasting by effectively capturing intrinsic spatio-temporal relations and chronological information in traffic time series.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., & Zhang, W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17325 · Cited by 7,752
Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting
Yu, B., Yin, H., & Zhu, Z. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/505 · Cited by 3,728
T-GCN: A Temporal Graph Convolutional Network for Traffic Prediction
Zhao, L., Song, Y., Zhang, C., Liu, Y., Wang, P., Lin, T., Deng, M., & Li, H. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2935152 · Cited by 3,326
Are Transformers Effective for Time Series Forecasting?
Zeng, A., Chen, M., Zhang, L., & Xu, Q. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26317 · Cited by 3,320
Attention Based Spatial-Temporal Graph Convolutional Networks for Traffic Flow Forecasting
Guo, S., Lin, Y., Feng, N., Song, C., & Wan, H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301922 · Cited by 3,123 · cited 1×
“Among them, Spatio-Temporal Graph Neural Networks (STGNNs) [18, 37] and Transformer-based models [11, 13, 35, 41] become very popular for their outstanding performance.”
BackgroundGraph WaveNet for Deep Spatial-Temporal Graph Modeling
Wu, Z., Pan, S., Long, G., Jiang, J., & Zhang, C. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/264 · Cited by 2,948
Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks
Wu, Z., Pan, S., Long, G., Jiang, J., Chang, X., & Zhang, C. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403118 · Cited by 2,001
GMAN: A Graph Multi-Attention Network for Traffic Prediction
Zheng, C., Fan, X., Wang, C., & Qi, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5477 · Cited by 1,730
Song, C., Lin, Y., Guo, S., & Wan, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5438 · Cited by 1,574
Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecasting
Li, M., & Zhu, Z. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16542 · Cited by 921
Traffic Flow Prediction via Spatial Temporal Graph Neural Network
Wang, X., Ma, Y., Wang, Y., Jin, W., Wang, X., Tang, J., Jia, C., & Yu, J. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380186 · Cited by 644
Spatial-Temporal Graph ODE Networks for Traffic Flow Forecasting
Fang, Z., Long, Q., Song, G., & Xie, K. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467430 · Cited by 636
Urban Traffic Prediction from Spatio-Temporal Data Using Deep Meta Learning
Pan, Z., Liang, Y., Wang, W., Yu, Y., Zheng, Y., & Zhang, J. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330884 · Cited by 559
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting
Wu, H., Xu, J., Wang, J., & Long, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.13008 · Cited by 498
Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecasting
Shao, Z., Zhang, Z., Wang, F., Wei, W., & Xu, Y. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557702 · Cited by 465
Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting
Cao, D., Wang, Y., Duan, J., Zhang, C., Zhu, X., Huang, C., Tong, Y., Xu, B., Bai, J., Tong, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.07719 · Cited by 388 · cited 1×
“…aims to infer the traffic data in the future 𝑇 ′ frames by training a model F (·) with parameters 𝜃 , which can be formulated as: where each frame 𝑋 𝑖 ∈ R 𝑁 × 𝑑 , 𝑁 is the number of spatial nodes. is the dimension of the input feature which equals 1 in our case, standing for traffic volume.”
BackgroundPre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecasting
Shao, Z., Zhang, Z., Wang, F., & Xu, Y. (2022) · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3534678.3539396 · Cited by 338
Dynamic Spatial-Temporal Graph Convolutional Neural Networks for Traffic Forecasting
Diao, Z., Wang, X., Zhang, D., Liu, Y., Xie, K., & He, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301890 · Cited by 321
Spatio-Temporal Meta-Graph Learning for Traffic Forecasting
Jiang, R., Wang, Z., Yong, J., Jeph, P., Chen, Q., Kobayashi, Y., Song, X., Fukushima, S., & Suzumura, T. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.25976 · Cited by 313
Self-citationDynamic and Multi-faceted Spatio-temporal Deep Learning for Traffic Speed Forecasting
Han, L., Du, B., Sun, L., Fu, Y., Lv, Y., & Xiong, H. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467275 · Cited by 281
Spatio-Temporal Graph Structure Learning for Traffic Forecasting
Zhang, Q., Chang, J., Meng, G., Xiang, S., & Pan, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5470 · Cited by 254
Hierarchical Graph Convolution Network for Traffic Forecasting
Guo, K., Hu, Y., Sun, Y., Qian, S., Gao, J., & Yin, B. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i1.16088 · Cited by 211
ST-Norm: Spatial and Temporal Normalization for Multi-variate Time Series Forecasting
Deng, J., Chen, X., Jiang, R., Song, X., & Tsang, I. W. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467330 · Cited by 198
Self-citationCoupled Layer-wise Graph Convolution for Transportation Demand Prediction
Ye, J., Sun, L., Du, B., Fu, Y., & Xiong, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16591 · Cited by 188
DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Prediction
Jiang, R., Yin, D., Wang, Z., Wang, Y., Deng, J., Liu, H., Cai, Z., Deng, J., Song, X., & Shibasaki, R. (2021) · Proceedings of the 30th ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482000 · Cited by 158
Self-citationSpatiotemporal Adaptive Gated Graph Convolution Network for Urban Traffic Flow Forecasting
Lü, B., Gan, X., Jin, H., Fu, L., & Zhang, H. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411894 · Cited by 129
Historical Inertia: A Neglected but Powerful Baseline for Long Sequence Time-series Forecasting
Cui, Y., Xie, J., & Zheng, K. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482120 · Cited by 120
A Multi-View Multi-Task Learning Framework for Multi-Variate Time Series Forecasting
Deng, J., Chen, X., Jiang, R., Song, X., & Tsang, I. W.-H. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3218803 · Cited by 98
Self-citationEnhanceNet: Plugin Neural Networks for Enhancing Correlated Time Series Forecasting
Cirstea, R.-G., Kieu, T., Guo, C., Yang, B., & Pan, S. J. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00153 · Cited by 93
Event-Aware Multimodal Mobility Nowcasting
Wang, Z., Jiang, R., Xue, H., Salim, F. D., Song, X., & Shibasaki, R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i4.20342 · Cited by 60
Self-citation
Metadata
- Authors
- Liu, H., Dong, Z., Jiang, R., Deng, J., Deng, J., Chen, Q., & Song, X.
- Venue
- Proceedings of the 32nd ACM International Conference on Information and Knowledge Management
- Publisher
- ACM
- Published
- 2023-10-21
- Pages
- 4125-4129
- OpenAlex
- W4387846860
- Cited by
- 383
- References
- 31
- FWCI
- 247.43
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.