A deep-learning model for urban traffic flow prediction with traffic events mined from twitter
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Short-term traffic parameter forecasting is critical to modern urban traffic management and control systems. Predictive accuracy in data-driven traffic models is reduced when exposed to non-recurring or non-routine traffic events, such as accidents, road closures, and extreme weather conditions. The analytical mining of data from social networks – specifically twitter – can improve urban traffic parameter prediction by complementing traffic data with data representing events capable of disrupting regular traffic patterns reported in social media posts. This paper proposes a deep learning urban traffic prediction model that combines information extracted from tweet messages with traffic and weather information. The predictive model adopts a deep Bi-directional Long Short-Term Memory (LSTM) stacked autoencoder (SAE) architecture for multi-step traffic flow prediction trained using tweets, traffic and weather datasets. The model is evaluated on an urban road network in Greater Manchester, United Kingdom. The findings from extensive empirical analysis using real-world data demonstrate the effectiveness of the approach in improving prediction accuracy when compared to other classical/statistical and machine learning (ML) state-of-the-art models. The improvement in predictive accuracy can lead to reduced frustration for road users, cost savings for businesses, and less harm to the environment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Accurate traffic prediction based on machine and deep learning modeling can help to minimize the issues [17, 30, 31].”
From Machine learning: Algorithms, real-world applications and research directions (2021) · cites this paper as [31]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Unsupervised Learning of Video Representations using LSTMs
Srivastava, N., Mansimov, E., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1502.04681 · Cited by 1,861
A Review of Data Fusion Techniques
Castanedo, F. (2013) · The Scientific World Journal · doi:10.1155/2013/704504 · Cited by 1,027
Research works printed but not linked: 38
- Abidin, A.F., Kolberg, M., Hussain, A.: Integrating twitter traffic information with Kalman filter models for public transportation vehicle arrival time prediction. In: big-data analytics and cloud computing. Pp. 67–82. Springer international publishing, Cham (2015) · DOI
- Agarwal, M., Maze, T., Souleyrette, R.: Impacts of weather on urban freeway traffic flow characteristics and facility capacity. In: Proceedings of the 2005 mid-continent transportation research symposium. pp. 18–19 (2005)
- Bin, Y., Yang, Y., Shen, F., Xu, X., Shen, H.T.: Bidirectional long-short term memory for video description. In: Proceedings of the 24th ACM international conference on Multimedia. pp. 436–440. ACM (2016) · DOI
- Dasgupta, B., Liu, D., Siegelmann, H.T.: Neural Networks. In: Handbook of Approximation Algorithms and Metaheuristics (2007) · doi:10.1201/9781420010749.ch22
- Dong, X., Lei, T., Jin, S., Hou, Z.: Short-Term Traffic Flow Prediction Based on XGBoost. In: 2018 IEEE 7th Data Driven Control and Learning Systems Conference (DDCLS). pp. 854–859. IEEE (2018) · DOI
- Elman, J.L.: Finding structure in time. Cogn. Sci. 14, 179–211 (1990). https://doi.org/10.1016/0364-0213(90)90002-E · doi:10.1016/0364-0213(90)90002-e · Paper page
- Essien, A., Giannetti, C.: A deep learning framework for Univariate time series prediction using convolutional LSTM stacked autoencoders. In: 2019 IEEE international conference on INnovations in intelligent SysTems and applications (INISTA). Pp. 1–6. IEEE, Sofia (2019) · DOI
- Essien, A., Petrounias, I., Sampaio, P., Sampaio, S.: The impact of rainfall and temperature on peak and off-peak urban traffic. In: International Conference on Database and Expert Systems Applications. pp. 399–407. Springer, Cham. (2018) · doi:10.1007/978-3-319-98812-2_36
- Essien, A., Petrounias, I., Sampaio, P., Sampaio, S.: Deep-PRESIMM: Integrating Deep Learning with Microsimulation for Traffic Prediction. In: IEEE International Conference on Systems, Man, and Cybernetics. pp. 1–6. IEEE Xplore (2019) · DOI
- Essien, A., Petrounias, I., Sampaio, P., Sampaio, S.: Improving Urban Traffic Speed Prediction Using Data Source Fusion and Deep Learning. In: 2019 IEEE International Conference on Big Data and Smart Computing (BigComp). pp. 1–8. IEEE (2019) · DOI · Paper page
- Essien, A., Chukwukelu, G., Giannetti, C.: (2019) A Scalable Deep Convolutional LSTM Neural Network for Large-Scale Urban Traffic Flow Prediction using Recurrence Plots. In: 2019 IEEE AFRICON. IEEE Xplore · DOI
- Fernando, S., Sethu, V., Ambikairajah, E., Epps, J.: Bidirectional Modelling for Short Duration Language Identification. In: INTERSPEECH. pp. 2809–2813 (2017) · doi:10.21437/interspeech.2017-286
- Giannetti, C., Essien, A., Pang, Y.O.: A novel deep learning approach for event detection in smart manufacturing. In: CIE49 proceedings, Beijing (2019)
- Goh, G., Koh, J., Zhang, Y.: Twitter-Informed Crowd Flow Prediction. In: 2018 IEEE Conference on Data Mining Workshops (ICDMW). pp. 624–631 (2018) · DOI
- Goodfellow, I., Bengio, Y.: Deep learning. MIT Press (2015)
- Hermans, M., Schrauwen, B.: Training and analysing deep recurrent neural networks. Advances in Neural information processing systems. 190–198 (2013)
- Huberman, B., Romero, D., Wu, F.: Social networks that matter: twitter under the microscope. First Monday. 14, (2009) · DOI · Paper page
- Jia, Y., Wu, J., Xu, M.: Traffic flow prediction with rainfall impact using a deep learning method. J. Adv. Transp. 2017, (2017). https://doi.org/10.1155/2017/6575947 · DOI · Paper page
- Jia, Y., Wu, J., Ben-Akiva, M., Seshadri, R., Du, Y.: Rainfall-integrated traffic speed prediction using deep learning method. IET Intell. Transp. Syst. 11, 531–536 (2017). https://doi.org/10.1049/iet-its.2016.0257 · DOI · Paper page
- Kaastra, I., Boyd, M.: Designing a neural network for forecasting financial and economic time series. Neurocomputing. 10, 215–236 (1996) · DOI · Paper page
- Kim, S., Hong, S., Joh, M., Song, S.: DeepRain: ConvLSTM network for precipitation prediction using multichannel radar data. ArXiv preprint. 1711., (2017)
- Lana, I., Del-Ser, J., Velez, M., Vlahogianni, E.I.: Road traffic forecasting: recent advances and new challenges. IEEE Intell. Transp. Syst. Mag. 10, 93–109 (2018). https://doi.org/10.1109/MITS.2018.2806634 · DOI · Paper page
- Liu, Y., Wu, H.: Prediction of Road Traffic Congestion Based on Random Forest. In: 2017 10th International Symposium on Computational Intelligence and Design (ISCID). pp. 361–364. IEEE (2017) · DOI · Paper page
- Ma, X., Tao, Z., Wang, Y., Yu, H., Wang, Y.: Long short-term memory neural network for traffic speed prediction using remote microwave sensor data. Transportation Research Part C: Emerging Technologies. 54, 187–197 (2015). https://doi.org/10.1016/j.trc.2015.03.014 · DOI · Paper page
- Nguyen, T.H., Shirai, K., Velcin, J.: Sentiment analysis on social media for stock movement prediction. Expert Syst. Appl. 42, 9603–9611 (2015). https://doi.org/10.1016/j.eswa.2015.07.052 · DOI · Paper page
- Petrović, S., Osborne, M., Lavrenko, V.: Streaming first story detection with application to twitter. In: 2010 Annual Conference of the North American Chapter of the Association for Computer Linguistics. pp. 181–189. Association for Computational Linguistics (2010)
- Philip, A.M., Ramadurai, G., Vanajakshi, L.: Urban arterial travel time prediction using support vector regression. Transportation in Developing Economies. 4, 7 (2018) · doi:10.1007/s40890-018-0060-6
- Poonia, P., Jain, V.K., Kumar, A.: Short term traffic flow prediction methodologies: a review. Mody University International Journal of Computing and Engineering Research. 2, 37–39 (2018)
- Qiao, W., Haghani, A., Hamedi, M.: A Nonparametric Model for Short-Term Travel Time Prediction Using Bluetooth Data. Journal of Intelligent Transportation Systems: Technology, Planning, and Operations. (2013). doi:https://doi.org/10.1080/15472450.2012.748555 · doi:10.1080/15472450.2012.748555
- Qin, Z., Petrounias, I.: A semantic-based framework for fine grained sentiment analysis. In: 2017 IEEE 19th Conference on Business Informatics (CBI). pp. 295–301. IEEE (2017) · DOI
- Rodriguez, P., Wiles, J., Elman, J.L.: A recurrent neural network that learns to count. Connect. Sci. 11, 5–40 (1999). https://doi.org/10.1080/095400999116340 · DOI · Paper page
- Smith, B.L., Williams, B.M., Keith Oswald, R.: Comparison of parametric and nonparametric models for traffic flow forecasting. Transportation Research Part C: Emerging Technologies. 10, 303–321 (2002). https://doi.org/10.1016/S0968-090X(02)00009-8 · DOI · Paper page
- Wang, X., Gerber, M.S., Brown, D.E.: Automatic crime prediction using events extracted from twitter posts. In: lecture notes in computer science (including subseries lecture notes in Artificial intelligence and lecture notes in bioinformatics). Pp. 231–238. Springer, Berlin (2012) · DOI · Paper page
- Wang, X., An, K., Tang, L., Chen, X.: Short term prediction of freeway exiting volume based on SVM and KNN. International Journal of Transportation Science and Technology. (2015). https://doi.org/10.1260/2046-0430.4.3.337 · doi:10.1260/2046-0430.4.3.337
- Wongcharoen, S., Senivongse, T.: Twitter analysis of road traffic congestion severity estimation. In: 2016 13th International Joint Conference on Computer Science and Software Engineering, JCSSE 2016. pp. 1–6. IEEE (2016) · doi:10.1109/jcsse.2016.7748850
- Yu, B., Song, X., Guan, F., Yang, Z., Yao, B.: k-Nearest Neighbor Model for Multiple-Time-Step Prediction of Short-Term Traffic Condition. Journal of Transportation Engineering. 142, 04016018 (2016). https://doi.org/10.1061/(ASCE)TE.1943-5436.0000816 · DOI · Paper page
- Zhang, L., Liu, Q., Yang, W., Wei, N., Dong, D.: An improved k-nearest neighbor model for short-term traffic flow prediction. Procedia-Social and Behavioural Sciences. 96, 653–662 (2013) · DOI
- Zhang, J., Zheng, Y., Artificial, D.Q.: Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction. In: Thirty-First AAAI Conference on Artificial Intelligence. pp. 1655–1661 (2017) · DOI · Paper page
Cited by
Machine learning: Algorithms, real-world applications and research directions
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00592-x · Cited by 5,583
“Accurate Accurate traffic prediction based on machine and deep learning modeling can help to minimize the issues [17] [31] [30].”
Shaygan, M., Meese, C., Li, W., Zhao, X. (., & Nejad, M. (2022) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2022.103921 · Cited by 267
Encrypted Network Traffic Analysis and Classification Utilizing Machine Learning
Alwhbi, I. A., Zou, C. C., & Alharbi, R. N. (2024) · Sensors · doi:10.3390/s24113509 · Cited by 81
“The bulk of anomaly detection systems typically involves two phases, which are training and testing [77–80].”
Background
Metadata
- Authors
- Essien, A., Petrounias, I., Sampaio, P., & Sampaio, S.
- Venue
- World Wide Web
- Published
- 2020-03-14
- Volume
- 24
- Issue
- 4
- Pages
- 1345-1368
- ISSN
- 1386-145X
- 1573-1413
- Cited by
- 163
- References
- 3
- Language
- en
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- University of Manchester
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A deep-learning model for urban traffic flow prediction with traffic events mined from twitter. https://app.cochat.ai/papers/10.1007/s11280-020-00800-3
- The paper
- Essien, A., Petrounias, I., Sampaio, P., & Sampaio, S. (2021). A deep-learning model for urban traffic flow prediction with traffic events mined from twitter. World Wide Web. https://doi.org/10.1007/s11280-020-00800-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.