CoChat

A deep-learning model for urban traffic flow prediction with traffic events mined from twitter

Essien, Aniekan, Petrounias, Ilias, Sampaio, Pedro, Sampaio, Sandra · 2021 · World Wide Web
Cited by 163

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

Short-term traffic parameter forecasting is critical to modern urban traffic management and control systems. Predictive accuracy in data-driven traffic models is reduced when exposed to non-recurring or non-routine traffic events, such as accidents, road closures, and extreme weather conditions. The analytical mining of data from social networks – specifically twitter – can improve urban traffic parameter prediction by complementing traffic data with data representing events capable of disrupting regular traffic patterns reported in social media posts. This paper proposes a deep learning urban traffic prediction model that combines information extracted from tweet messages with traffic and weather information. The predictive model adopts a deep Bi-directional Long Short-Term Memory (LSTM) stacked autoencoder (SAE) architecture for multi-step traffic flow prediction trained using tweets, traffic and weather datasets. The model is evaluated on an urban road network in Greater Manchester, United Kingdom. The findings from extensive empirical analysis using real-world data demonstrate the effectiveness of the approach in improving prediction accuracy when compared to other classical/statistical and machine learning (ML) state-of-the-art models. The improvement in predictive accuracy can lead to reduced frustration for road users, cost savings for businesses, and less harm to the environment.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s11280-020-00800-3

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 37

  1. Abidin, A.F., Kolberg, M., Hussain, A.: Integrating twitter traffic information with Kalman filter models for public transportation vehicle arrival time prediction. In: big-data analytics and cloud computing. Pp. 67–82. Springer international publishing, Cham (2015) · DOI
  2. Agarwal, M., Maze, T., Souleyrette, R.: Impacts of weather on urban freeway traffic flow characteristics and facility capacity. In: Proceedings of the 2005 mid-continent transportation research symposium. pp. 18–19 (2005)
  3. Bin, Y., Yang, Y., Shen, F., Xu, X., Shen, H.T.: Bidirectional long-short term memory for video description. In: Proceedings of the 24th ACM international conference on Multimedia. pp. 436–440. ACM (2016) · DOI
  4. Dasgupta, B., Liu, D., Siegelmann, H.T.: Neural Networks. In: Handbook of Approximation Algorithms and Metaheuristics (2007) · doi:10.1201/9781420010749.ch22
  5. Dong, X., Lei, T., Jin, S., Hou, Z.: Short-Term Traffic Flow Prediction Based on XGBoost. In: 2018 IEEE 7th Data Driven Control and Learning Systems Conference (DDCLS). pp. 854–859. IEEE (2018) · DOI
  6. Essien, A., Giannetti, C.: A deep learning framework for Univariate time series prediction using convolutional LSTM stacked autoencoders. In: 2019 IEEE international conference on INnovations in intelligent SysTems and applications (INISTA). Pp. 1–6. IEEE, Sofia (2019) · DOI
  7. Essien, A., Petrounias, I., Sampaio, P., Sampaio, S.: The impact of rainfall and temperature on peak and off-peak urban traffic. In: International Conference on Database and Expert Systems Applications. pp. 399–407. Springer, Cham. (2018) · doi:10.1007/978-3-319-98812-2_36
  8. Essien, A., Petrounias, I., Sampaio, P., Sampaio, S.: Deep-PRESIMM: Integrating Deep Learning with Microsimulation for Traffic Prediction. In: IEEE International Conference on Systems, Man, and Cybernetics. pp. 1–6. IEEE Xplore (2019) · DOI
  9. Essien, A., Petrounias, I., Sampaio, P., Sampaio, S.: Improving Urban Traffic Speed Prediction Using Data Source Fusion and Deep Learning. In: 2019 IEEE International Conference on Big Data and Smart Computing (BigComp). pp. 1–8. IEEE (2019) · DOI · Paper page
  10. Essien, A., Chukwukelu, G., Giannetti, C.: (2019) A Scalable Deep Convolutional LSTM Neural Network for Large-Scale Urban Traffic Flow Prediction using Recurrence Plots. In: 2019 IEEE AFRICON. IEEE Xplore · DOI
  11. Fernando, S., Sethu, V., Ambikairajah, E., Epps, J.: Bidirectional Modelling for Short Duration Language Identification. In: INTERSPEECH. pp. 2809–2813 (2017) · doi:10.21437/interspeech.2017-286
  12. Giannetti, C., Essien, A., Pang, Y.O.: A novel deep learning approach for event detection in smart manufacturing. In: CIE49 proceedings, Beijing (2019)
  13. Goh, G., Koh, J., Zhang, Y.: Twitter-Informed Crowd Flow Prediction. In: 2018 IEEE Conference on Data Mining Workshops (ICDMW). pp. 624–631 (2018) · DOI
  14. Goodfellow, I., Bengio, Y.: Deep learning. MIT Press (2015)
  15. Hermans, M., Schrauwen, B.: Training and analysing deep recurrent neural networks. Advances in Neural information processing systems. 190–198 (2013)
  16. Huberman, B., Romero, D., Wu, F.: Social networks that matter: twitter under the microscope. First Monday. 14, (2009) · DOI · Paper page
  17. Jia, Y., Wu, J., Xu, M.: Traffic flow prediction with rainfall impact using a deep learning method. J. Adv. Transp. 2017, (2017). https://doi.org/10.1155/2017/6575947 · DOI · Paper page
  18. Jia, Y., Wu, J., Ben-Akiva, M., Seshadri, R., Du, Y.: Rainfall-integrated traffic speed prediction using deep learning method. IET Intell. Transp. Syst. 11, 531–536 (2017). https://doi.org/10.1049/iet-its.2016.0257 · DOI · Paper page
  19. Kaastra, I., Boyd, M.: Designing a neural network for forecasting financial and economic time series. Neurocomputing. 10, 215–236 (1996) · DOI · Paper page
  20. Kim, S., Hong, S., Joh, M., Song, S.: DeepRain: ConvLSTM network for precipitation prediction using multichannel radar data. ArXiv preprint. 1711., (2017)
  21. Lana, I., Del-Ser, J., Velez, M., Vlahogianni, E.I.: Road traffic forecasting: recent advances and new challenges. IEEE Intell. Transp. Syst. Mag. 10, 93–109 (2018). https://doi.org/10.1109/MITS.2018.2806634 · DOI · Paper page
  22. Liu, Y., Wu, H.: Prediction of Road Traffic Congestion Based on Random Forest. In: 2017 10th International Symposium on Computational Intelligence and Design (ISCID). pp. 361–364. IEEE (2017) · DOI · Paper page
  23. Ma, X., Tao, Z., Wang, Y., Yu, H., Wang, Y.: Long short-term memory neural network for traffic speed prediction using remote microwave sensor data. Transportation Research Part C: Emerging Technologies. 54, 187–197 (2015). https://doi.org/10.1016/j.trc.2015.03.014 · DOI · Paper page
  24. Nguyen, T.H., Shirai, K., Velcin, J.: Sentiment analysis on social media for stock movement prediction. Expert Syst. Appl. 42, 9603–9611 (2015). https://doi.org/10.1016/j.eswa.2015.07.052 · DOI · Paper page
  25. Petrović, S., Osborne, M., Lavrenko, V.: Streaming first story detection with application to twitter. In: 2010 Annual Conference of the North American Chapter of the Association for Computer Linguistics. pp. 181–189. Association for Computational Linguistics (2010)
  26. Philip, A.M., Ramadurai, G., Vanajakshi, L.: Urban arterial travel time prediction using support vector regression. Transportation in Developing Economies. 4, 7 (2018) · doi:10.1007/s40890-018-0060-6
  27. Poonia, P., Jain, V.K., Kumar, A.: Short term traffic flow prediction methodologies: a review. Mody University International Journal of Computing and Engineering Research. 2, 37–39 (2018)
  28. Qiao, W., Haghani, A., Hamedi, M.: A Nonparametric Model for Short-Term Travel Time Prediction Using Bluetooth Data. Journal of Intelligent Transportation Systems: Technology, Planning, and Operations. (2013). doi:https://doi.org/10.1080/15472450.2012.748555 · doi:10.1080/15472450.2012.748555
  29. Qin, Z., Petrounias, I.: A semantic-based framework for fine grained sentiment analysis. In: 2017 IEEE 19th Conference on Business Informatics (CBI). pp. 295–301. IEEE (2017) · DOI
  30. Rodriguez, P., Wiles, J., Elman, J.L.: A recurrent neural network that learns to count. Connect. Sci. 11, 5–40 (1999). https://doi.org/10.1080/095400999116340 · DOI · Paper page
  31. Smith, B.L., Williams, B.M., Keith Oswald, R.: Comparison of parametric and nonparametric models for traffic flow forecasting. Transportation Research Part C: Emerging Technologies. 10, 303–321 (2002). https://doi.org/10.1016/S0968-090X(02)00009-8 · DOI · Paper page
  32. Wang, X., Gerber, M.S., Brown, D.E.: Automatic crime prediction using events extracted from twitter posts. In: lecture notes in computer science (including subseries lecture notes in Artificial intelligence and lecture notes in bioinformatics). Pp. 231–238. Springer, Berlin (2012) · DOI · Paper page
  33. Wang, X., An, K., Tang, L., Chen, X.: Short term prediction of freeway exiting volume based on SVM and KNN. International Journal of Transportation Science and Technology. (2015). https://doi.org/10.1260/2046-0430.4.3.337 · doi:10.1260/2046-0430.4.3.337
  34. Wongcharoen, S., Senivongse, T.: Twitter analysis of road traffic congestion severity estimation. In: 2016 13th International Joint Conference on Computer Science and Software Engineering, JCSSE 2016. pp. 1–6. IEEE (2016) · doi:10.1109/jcsse.2016.7748850
  35. Yu, B., Song, X., Guan, F., Yang, Z., Yao, B.: k-Nearest Neighbor Model for Multiple-Time-Step Prediction of Short-Term Traffic Condition. Journal of Transportation Engineering. 142, 04016018 (2016). https://doi.org/10.1061/(ASCE)TE.1943-5436.0000816 · DOI · Paper page
  36. Zhang, L., Liu, Q., Yang, W., Wei, N., Dong, D.: An improved k-nearest neighbor model for short-term traffic flow prediction. Procedia-Social and Behavioural Sciences. 96, 653–662 (2013) · DOI
  37. Zhang, J., Zheng, Y., Artificial, D.Q.: Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction. In: Thirty-First AAAI Conference on Artificial Intelligence. pp. 1655–1661 (2017) · DOI · Paper page

Cited by

See all 163

Metadata

Authors
Essien, A., Petrounias, I., Sampaio, P., & Sampaio, S.
Venue
World Wide Web
Published
2020-03-14
Volume
24
Issue
4
Pages
1345-1368
ISSN
  • 1386-145X
  • 1573-1413
Cited by
163
References
4
Language
en
Licence
Funders
University of Manchester

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.