A variational autoencoder solution for road traffic forecasting systems: Missing data imputation, dimension reduction, model selection and anomaly detection
Open accessThe DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
Abstract Efforts devoted to mitigate the effects of road traffic congestion have been conducted since 1970s. Nowadays, there is a need for prominent solutions capable of mining information from messy and multidimensional road traffic data sets with few modeling constraints. In that sense, we propose a unique and versatile model to address different major challenges of traffic forecasting in an unsupervised manner. We formulate the road traffic forecasting problem as a latent variable model, assuming that traffic data is not generated randomly but from a latent space with fewer dimensions containing the underlying characteristics of traffic. We solve the problem by proposing a variational autoencoder (VAE) model to learn how traffic data are generated and inferred, while validating it against three different real-world traffic data sets. Under this framework, we propose an online unsupervised imputation method for unobserved traffic data with missing values. Additionally, taking advantage of the low dimension latent space learned, we compress the traffic data before applying a prediction model obtaining improvements in the forecasting accuracy. Finally, given that the model not only learns useful forecasting features but also meaningful characteristics, we explore the latent space as a tool for model and data selection and traffic anomaly detection from the point of view of traffic modelers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870
(2010) · University of Twente Research Information · Cited by 6,037
Traffic Flow Prediction With Big Data: A Deep Learning Approach
Lv, Y., Duan, Y., Kang, W., Li, Z., & Wang, F.-Y. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2345663 · Cited by 3,000
Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction
Zhang, J., Zheng, Y., & Qi, D. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10735 · Cited by 2,282
Ma, X., Tao, Z., Wang, Y., Yu, H., & Wang, Y. (2015) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2015.03.014 · Cited by 2,191
Generating Sentences from a Continuous Space
Bowman, S. R., Vilnis, L., Vinyals, O., Dai, A., Jozefowicz, R., & Bengio, S. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1002 · Cited by 2,061
LSTM network: a deep learning approach for short‐term traffic forecast
Zhao, Z., Chen, W., Wu, X., Chen, P. C. Y., & Liu, J. (2017) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2016.0208 · Cited by 1,834
Ma, X., Dai, Z., He, Z., Ma, J., Wang, Y., & Wang, Y. (2017) · Sensors · doi:10.3390/s17040818 · Cited by 1,409
(2015) · Cited by 1,279
Short-term traffic forecasting: where we are and where we’re going
Vlahogianni, E. I., Karlaftis, M. G., & Golias, J. C. (2014) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2014.01.005 · Cited by 1,132
Deep learning for short-term traffic flow prediction
Polson, N. G., & Sokolov, V. O. (2017) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2017.02.024 · Cited by 1,015
Combining kohonen maps with arima time series models to forecast traffic flow
Van Der Voort, M., Dougherty, M., & Watson, S. (1996) · Transportation Research Part C: Emerging Technologies · doi:10.1016/s0968-090x(97)82903-8 · Cited by 845
A hybrid deep learning based traffic flow prediction method and its understanding
Wu, Y., Tan, H., Qin, L., Ran, B., & Jiang, Z. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.03.001 · Cited by 798
Lippi, M., Bertini, M., & Frasconi, P. (2013) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2013.2247040 · Cited by 747
Tolstikhin, I., Bousquet, O., Gelly, S., & Schoelkopf, B. (2017) · arXiv · doi:10.48550/arxiv.1711.01558 · Cited by 695
Advances in Variational Inference
Zhang, C., Butepage, J., Kjellstrom, H., & Mandt, S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2889774 · Cited by 671
2006 IEEE Intelligent Transportation Systems Conference
(2006) · doi:10.1109/itsc10413.2006 · Cited by 580
2017 IEEE Winter Conference on Applications of Computer Vision (WACV)
(2017) · doi:10.1109/wacv37755.2017 · Cited by 564
Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting
Li, Y., Yu, R., Shahabi, C., & Liu, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01926 · Cited by 507
MICE: Multivariate Imputation by Chained Equations in R
van Buuren, S., & Groothuis-Oudshoorn, K. (2010) · Utrecht University Repository (Utrecht University) · Cited by 496
Accurate freeway travel time prediction with state-space neural networks under missing data
van Lint, J. W. C., Hoogendoorn, S. P., & van Zuylen, H. J. (2005) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2005.03.001 · Cited by 442
Deep Learning: A Generic Approach for Extreme Condition Traffic Forecasting
Yu, R., Li, Y., Shahabi, C., Demiryurek, U., & Liu, Y. (2017) · Proceedings of the 2017 SIAM International Conference on Data Mining · doi:10.1137/1.9781611974973.87 · Cited by 412
Proceedings of the 2017 SIAM International Conference on Data Mining
(2017) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611974973 · Cited by 402
Temporal regularized matrix factorization for high-dimensional time series prediction
Yu, H., Rao, N., & Dhillon, I. S. (2016) · neural information processing systems · Cited by 378
A Bayesian tensor decomposition approach for spatiotemporal traffic data imputation
Chen, X., He, Z., & Sun, L. (2019) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.11.003 · Cited by 373
Road Traffic Forecasting: Recent Advances and New Challenges
Lana, I., Del Ser, J., Velez, M., & Vlahogianni, E. I. (2018) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2018.2806634 · Cited by 367
Supervised Weighting-Online Learning Algorithm for Short-Term Traffic Flow Prediction
Jeong, Y.-S., Byon, Y.-J., Castro-Neto, M. M., & Easa, S. M. (2013) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2013.2267735 · Cited by 335
Short-term traffic flow rate forecasting based on identifying similar traffic patterns
Habtemichael, F. G., & Cetin, M. (2015) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2015.08.017 · Cited by 315
2017 IEEE International Conference on Big Data (Big Data)
(2017) · doi:10.1109/bigdata41644.2017 · Cited by 302
MIDA: Multiple Imputation Using Denoising Autoencoders
Gondara, L., & Wang, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93040-4_21 · Cited by 292
Neural Photo Editing with Introspective Adversarial Networks
Brock, A., Lim, T., Ritchie, J. M., & Weston, N. (2016) · arXiv · doi:10.48550/arxiv.1609.07093 · Cited by 275
Optimized Structure of the Traffic Flow Forecasting Model With a Deep Learning Approach
Yang, H.-F., Dillon, T. S., & Chen, Y.-P. P. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2574840 · Cited by 263
Short-Term Traffic and Travel Time Prediction Models
van Lint, H., & van Hinsbergen, C. P. I. (2012) · Transportation research circular · Cited by 242
Wang, D., & Gu, J. (2018) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2018.08.003 · Cited by 215
Missing Value Imputation for Traffic-Related Time Series Data Based on a Multi-View Learning Method
Li, L., Zhang, J., Wang, Y., & Ran, B. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2869768 · Cited by 210
Missing traffic data: comparison of imputation methods
Li, Y., Li, Z., & Li, L. (2014) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2013.0052 · Cited by 203
Understanding autoencoders with information theoretic concepts
Yu, S., & Príncipe, J. C. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.05.003 · Cited by 183
Short‐Term Traffic Speed Forecasting Based on Attention Convolutional Neural Network for Arterials
Liu, Q., Wang, B., & Zhu, Y. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12417 · Cited by 162
Martín, G. S., Droguett, E. L., Meruane, V., & Moura, M. D. C. (2018) · Structural Health Monitoring · doi:10.1177/1475921718788299 · Cited by 157
A Survey on Urban Traffic Anomalies Detection Algorithms
Djenouri, Y., Belhadi, A., Lin, J. C., Djenouri, D., & Cano, A. (2019) · IEEE Access · doi:10.1109/access.2019.2893124 · Cited by 156
Gaussian Process Prior Variational AutoencodersPreprint
Casale, F. P., Dalca, A. V., Saglietti, L., Listgarten, J., & Fusi, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.11738 · Cited by 145
VIGAN: Missing view imputation with generative adversarial networks
Shang, C., Palmer, A., Sun, J., Chen, K.-S., Lu, J., & Bi, J. (2017) · 2017 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2017.8257992 · Cited by 142
Vlahogianni, E. I., Karlaftis, M. G., & Golias, J. (2006) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2006.09.002 · Cited by 135
On the imputation of missing data for road traffic forecasting: New insights and novel techniques
Laña, I., Olabarrieta, I. I., Velez, M. M., & Ser, J. D. (2018) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2018.02.021 · Cited by 129
Distance-based k-nearest neighbors outlier detection method in large-scale traffic data
Dang, T. T., Ngan, H. Y. T., & Liu, W. (2015) · IEEE International Conference on Digital Signal Processing (DSP) · doi:10.1109/icdsp.2015.7251924 · Cited by 123
Complementary Set Variational Autoencoder for Supervised Anomaly Detection
Kawachi, Y., Koizumi, Y., & Harada, N. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462181 · Cited by 111
Pavlyuk, D. (2019) · European Transport Research Review · doi:10.1186/s12544-019-0345-9 · Cited by 83
Diagnosing and Enhancing VAE Models
Dai, B., & Wipf, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.05789 · Cited by 81
Impact of Data Loss for Prediction of Traffic Flow on an Urban Road Using Neural Networks
Pamuła, T. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2836141 · Cited by 81
Recurrent neural network-based semantic variational autoencoder for Sequence-to-sequence learning
Jang, M., Seo, S., & Kang, P. (2019) · Information Sciences · doi:10.1016/j.ins.2019.03.066 · Cited by 77
Yang, S., & Qian, S. (2019) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2019.2919615 · Cited by 73
Optimization of traffic forecasting: Intelligent surrogate modeling
Vlahogianni, E. I. (2015) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2015.03.016 · Cited by 67
Short-term Traffic Forecasting Using Multivariate Autoregressive Models
Pavlyuk, D. (2017) · Procedia Engineering · doi:10.1016/j.proeng.2017.01.062 · Cited by 57
Low-Dimensional Models for Compressed Sensing and Prediction of Large-Scale Traffic Data
Mitrović, N., Asif, M. T., Dauwels, J., & Jaillet, P. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2411675 · Cited by 47
Outlier Detection in Urban Traffic Data
Djenouri, Y., & Zimek, A. (2018) · International Conference on Web Intelligence, Mining and Semantics · doi:10.1145/3227609.3227692 · Cited by 39
Proceedings of the 7th International Conference on Web Intelligence, Mining and Semantics
Akerkar, R. A., Cuzzocrea, A., Cao, J., & Hacid, M.-S. (2017) · doi:10.1145/3102254 · Cited by 31
Channel-Recurrent Autoencoding for Image Modeling
Shang, W., Sohn, K., & Tian, Y. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00136 · Cited by 24
A Preliminary Study on Automatic Algorithm Selection for Short-Term Traffic Forecasting
Angarita-Zapata, J. S., Triguero, I., & Masegosa, A. (2018) · International Conference on Interaction Design and Children · doi:10.1007/978-3-319-99626-4_18 · Cited by 10
Metadata
- Authors
- Boquet, G., Morell, A., Serrano, J., & Vicario, J. L.
- Venue
- Transportation Research Part C: Emerging Technologies
- Publisher
- Elsevier BV
- Published
- 2020-06
- Volume
- 115
- Pages
- 102622
- ISSN
- 0968-090X (ISSN-L)
- OpenAlex
- W3011157584
- Cited by
- 164
- References
- 61
- FWCI
- 10.93
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.