The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Learning Dynamic and Hierarchical Traffic Spatiotemporal Features With Transformer
Abstract
Traffic forecasting has attracted considerable attention due to its importance in proactive urban traffic control and management. Scholars and engineers have exerted considerable efforts in improving the performance of traffic forecasting algorithms in terms of accuracy, reliability, and efficiency. Spatial feature representation of traffic flow is a core component that greatly influences traffic forecasting performance. In previous studies, several spatial attributes of traffic flow are ignored due to the following issues: a) traffic flow propagation does not comply with the road network, b) the spatial pattern of traffic flow varies over time, and c) single adjacent matrix cannot handle the complex and hierarchical urban traffic flow. To address the abovementioned issues, this study proposes a novel traffic forecasting algorithm called traffic transformer, which achieves great success in natural language processing. The multihead attention mechanism and stacking layers enable the transformer to learn dynamic and hierarchical features in sequential data. Two components, namely, global encoder and global–local decoder, are proposed to extract and fuse the spatial patterns globally and locally. Experimental results indicate that the proposed traffic transformer outperforms state-of-the-art methods. The learned dynamic and hierarchical features of traffic flow can help achieve a better understanding of spatial dependency of traffic flow for effective and efficient traffic control and management strategies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
Veličković, P., Casanova, A., Liò, P., Cucurull, G., Romero, A., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.17863/cam.48429 · Cited by 8,657
Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting
Yu, B., Yin, H., & Zhu, Z. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/505 · Cited by 3,728
Transformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169 · cited 1×
“Some variants of the transformer, such as [43] and [44], are proposed recently.”
BackgroundGraph WaveNet for Deep Spatial-Temporal Graph Modeling
Wu, Z., Pan, S., Long, G., Jiang, J., & Zhang, C. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/264 · Cited by 2,948
Longformer: The Long-Document Transformer
Beltagy, I., Peters, M. E., & Cohan, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05150 · Cited by 2,281
Ma, X., Tao, Z., Wang, Y., Yu, H., & Wang, Y. (2015) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2015.03.014 · Cited by 2,191
Self-citationWilliams, B. M., & Hoel, L. A. (2003) · Journal of Transportation Engineering · doi:10.1061/(asce)0733-947x(2003)129:6(664 · Cited by 2,164
Guo, M.-H., Cai, J.-X., Liu, Z.-N., Mu, T.-J., Martin, R. R., & Hu, S.-M. (2021) · Computational Visual Media · doi:10.1007/s41095-021-0229-5 · Cited by 2,100
GMAN: A Graph Multi-Attention Network for Traffic Prediction
Zheng, C., Fan, X., Wang, C., & Qi, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5477 · Cited by 1,730
Ma, X., Dai, Z., He, Z., Ma, J., Wang, Y., & Wang, Y. (2017) · Sensors · doi:10.3390/s17040818 · Cited by 1,409
Self-citationShort-term traffic forecasting: where we are and where we’re going
Vlahogianni, E. I., Karlaftis, M. G., & Golias, J. C. (2014) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2014.01.005 · Cited by 1,132
Dynamic prediction of traffic volume through Kalman filtering theory
Okutani, I., & Stephanedes, Y. J. (1984) · Transportation Research Part B: Methodological · doi:10.1016/0191-2615(84)90002-x · Cited by 1,104
Neural Networks in Civil Engineering: 1989–2000
Adeli, H. (2001) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/0885-9507.00219 · Cited by 884
Combining kohonen maps with arima time series models to forecast traffic flow
Van Der Voort, M., Dougherty, M., & Watson, S. (1996) · Transportation Research Part C: Emerging Technologies · doi:10.1016/s0968-090x(97)82903-8 · Cited by 845
A gradient boosting method to improve travel time prediction
Zhang, Y., & Haghani, A. (2015) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2015.02.019 · Cited by 832
A Bayesian Network Approach to Traffic Flow Forecasting
Sun, S., Zhang, C., & Yu, G. (2006) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.869623 · Cited by 795
ANALYSIS OF FREEWAY TRAFFIC TIME-SERIES DATA BY USING BOX-JENKINS TECHNIQUES
Ahmed, M. S., & Cook, A. R. (1979) · Transportation Research Record Journal of the Transportation Research Board · Cited by 767
Spatiotemporal Recurrent Convolutional Networks for Traffic Prediction in Transportation Networks
Yu, H., Wu, Z., Wang, S., Wang, Y., & Ma, X. (2017) · Sensors · doi:10.3390/s17071501 · Cited by 618
Self-citationNonparametric Regression and Short‐Term Freeway Traffic Forecasting
Davis, G. A., & Nihan, N. L. (1991) · Journal of Transportation Engineering · doi:10.1061/(asce)0733-947x(1991)117:2(178 · Cited by 524
Traffic transformer: Capturing the continuity and periodicity of time series for traffic forecasting
Cai, L., Janowicz, K., Mai, G., Yan, B., & Zhu, R. (2020) · Transactions in GIS · doi:10.1111/tgis.12644 · Cited by 392
A recurrent neural network based microscopic car following model to predict traffic oscillation
Zhou, M., Qu, X., & Li, X. (2017) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2017.08.027 · Cited by 309
Hou, Y., Li, Q., Zhang, C., Lu, G., Ye, Z., Chen, Y., Wang, L., & Cao, D. (2021) · Engineering · doi:10.1016/j.eng.2020.07.030 · Cited by 283
Supervised Deep Restricted Boltzmann Machine for Estimation of Concrete
(2017) · ACI Materials Journal · doi:10.14359/51689560 · Cited by 278
Rafiei, M. H., & Adeli, H. (2018) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0001570 · Cited by 269
Spatiotemporal traffic forecasting: review and proposed directions
Ermagun, A., & Levinson, D. (2018) · Transport Reviews · doi:10.1080/01441647.2018.1442887 · Cited by 231
Neural network model for rapid forecasting of freeway link travel time
Dharia, A., & Adeli, H. (2003) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2003.09.011 · Cited by 231
High-Resolution Vehicle Trajectory Extraction and Denoising From Aerial Videos
Chen, X., Li, Z., Yang, Y., Qi, L., & Ke, R. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3003782 · Cited by 207
Wavelet Packet-Autocorrelation Function Method for Traffic Flow Pattern Analysis
Jiang, X., & Adeli, H. (2004) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/j.1467-8667.2004.00360.x · Cited by 205
Traffic Flow Prediction Using Adaboost Algorithm With Random Forests As A Weak Learner
Leshem, G., & Ritov, Y. (2007) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1060206 · Cited by 163
Improving flex-route transit services with modular autonomous vehicles
Liu, X., Qu, X., & Ma, X. (2021) · Transportation Research Part E Logistics and Transportation Review · doi:10.1016/j.tre.2021.102331 · Cited by 151
Self-citationTravel Mode Choice Modeling with Support Vector Machines
Zhang, Y., & Xie, Y. (2008) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/2076-16 · Cited by 148
Vlahogianni, E. I., Karlaftis, M. G., & Golias, J. (2007) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/j.1467-8667.2007.00488.x · Cited by 145
Huang, Y., Weng, Y., Yu, S., & Chen, X. (2019) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom/bigdatase.2019.00096 · Cited by 130
Chen, X., Qi, L., Yang, Y., Luo, Q., Postolache, O. A., Tang, J., & Wu, H. (2020) · Journal of Advanced Transportation · doi:10.1155/2020/7194342 · Cited by 116
ST-UNet: A Spatio-Temporal U-Network for Graph-structured Time Series ModelingPreprint
Yu, B., Yin, H., & Zhu, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.05631 · Cited by 86
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Cited by
PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Prediction
Jiang, J., Han, C., Zhao, W. X., & Wang, J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25556 · Cited by 632
Reza, S., Ferreira, M. C., Machado, J. J. M., & Tavares, J. M. R. S. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117275 · Cited by 306
Metadata
- Authors
- Yan, H., Ma, X., & Pu, Z.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2022-11
- Volume
- 23
- Issue
- 11
- Pages
- 22386-22399
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W3193812480
- Cited by
- 290
- References
- 41
- FWCI
- 16.37
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.