The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning
Abstract
Traffic flow prediction is a fundamental problem in transportation modeling and management. Many existing approaches fail to provide favorable results due to being: 1) shallow in architecture; 2) hand engineered in features; and 3) separate in learning. In this paper we propose a deep architecture that consists of two parts, i.e., a deep belief network (DBN) at the bottom and a multitask regression layer at the top. A DBN is employed here for unsupervised feature learning. It can learn effective features for traffic flow prediction in an unsupervised fashion, which has been examined and found to be effective for many areas such as image and audio classification. To the best of our knowledge, this is the first paper that applies the deep learning approach to transportation research. To incorporate multitask learning (MTL) in our deep architecture, a multitask regression layer is used above the DBN for supervised prediction. We further investigate homogeneous MTL and heterogeneous MTL for traffic flow prediction. To take full advantage of weight sharing in our deep architecture, we propose a grouping method based on the weights in the top layer to make MTL more effective. Experiments on transportation data sets show good performance of our deep architecture. Abundant experiments show that our approach achieved close to 5% improvements over the state of the art. It is also presented that MTL can improve the generalization performance of shared tasks. These positive results demonstrate that deep learning and MTL are promising in transportation research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 1×
“contrastive divergence [9] effectively.”
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
(2011) · Cited by 2,752
Data-Driven Intelligent Transportation Systems: A Survey
Zhang, J., Wang, F.-Y., Wang, K., Lin, W.-H., Xu, X., & Chen, C. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2158001 · Cited by 1,817 · cited 1×
“TRAFFIC flow prediction aims at estimating the number of vehicles given a specific region and a time interval, which is an important problem to address in transportation management [21], [34], [36].”
BackgroundExploring Strategies for Training Deep Neural Networks
Larochelle, H., Bengio, Y., Louradour, J., & Lamblin, P. (2009) · doi:10.1145/1577069.1577070 · Cited by 1,095
Wang, F.-Y. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2060218 · Cited by 856
(2007) · Cited by 849
Combining kohonen maps with arima time series models to forecast traffic flow
Van Der Voort, M., Dougherty, M., & Watson, S. (1996) · Transportation Research Part C: Emerging Technologies · doi:10.1016/s0968-090x(97)82903-8 · Cited by 845
Online-SVR for short-term traffic flow prediction under typical and atypical traffic conditions
Castro-Neto, M., Jeong, Y.-S., Jeong, M.-K., & Han, L. D. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.07.069 · Cited by 842
A Bayesian Network Approach to Traffic Flow Forecasting
Sun, S., Zhang, C., & Yu, G. (2006) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.869623 · Cited by 795
Caruana, R. (1998) · Learning to Learn · doi:10.1007/978-1-4615-5529-2_5 · Cited by 577
Short-Term Freeway Traffic Flow Prediction: Bayesian Combined Neural Network Approach
Zheng, W., Lee, D.-H., & Shi, Q. (2006) · Journal of Transportation Engineering · doi:10.1061/(asce)0733-947x(2006)132:2(114 · Cited by 440
Chan, K. Y., Dillon, T. S., Singh, J., & Chang, E. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2174051 · Cited by 430
Traffic Prediction Using Multivariate Nonparametric Regression
Clark, S. (2003) · Journal of Transportation Engineering · doi:10.1061/(asce)0733-947x(2003)129:2(161 · Cited by 340
An Aggregation Approach to Short-Term Traffic Flow Prediction
Tan, M.-C., Wong, S. C., Xu, J.-M., Guan, Z.-R., & Zhang, P. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2008.2011693 · Cited by 337
SHORT-TERM TRAFFIC FLOW PREDICTION: NEURAL NETWORK APPROACH
Smith, B. L., & Demetsky, M. J. (1994) · Transportation Research Record Journal of the Transportation Research Board · Cited by 311
Scalable stacking and learning for building deep architectures
Deng, L., Yu, D., & Platt, J. (2012) · 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2012.6288333 · Cited by 210
Shaban, A., & Yousefi, S. (2024) · Springer Optimization and Its Applications · doi:10.1007/978-3-031-53092-0_10 · Cited by 189
Using Deep Belief Nets to Learn Covariance Kernels for Gaussian Processes
Hinton, G. E., & Salakhutdinov, R. (2007) · neural information processing systems · Cited by 177
Rate-coded Restricted Boltzmann Machines for Face Recognition
Teh, Y. W., & Hinton, G. E. (2000) · UCL Discovery (University College London) · Cited by 162
Bayesian Time-Series Model for Short-Term Traffic Flow Forecasting
Ghosh, B., Basu, B., & O’Mahony, M. (2007) · Journal of Transportation Engineering · doi:10.1061/(asce)0733-947x(2007)133:3(180 · Cited by 158
Sun, S., & Xu, X. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2093575 · Cited by 137
Short-Term Traffic Speed Forecasting Based on Data Recorded at Irregular Intervals
Ye, Q., Szeto, W. Y., & Wong, S. C. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2203122 · Cited by 134
Short-term traffic flow forecasting based on Markov chain model
Yu, G., Hu, J., Zhang, C., Zhuang, L., & Song, J. (2004) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2003.1212910 · Cited by 125
Short-Term Traffic State Prediction Based on Temporal–Spatial Correlation
Pan, T. L., Sumalee, A., Zhong, R., & Indra-Payoong, N. (2013) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2013.2258916 · Cited by 123
Predictions of Urban Volumes in Single Time Series
Thomas, T., Weijermars, W., & van Berkum, E. C. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2028149 · Cited by 86
The Selective Random Subspace Predictor for Traffic Flow Forecasting
Sun, S., & Zhang, C. (2007) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.888603 · Cited by 85
Real-Time Video-Based Traffic Measurement and Visualization System for Energy/Emissions
Morris, B., Tran, C., Scora, G. A., Trivedi, M. M., & Barth, M. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2208222 · Cited by 76
Neural network multitask learning for traffic flow forecasting
Jin, F., & Sun, S. (2008) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2008.4634057 · Cited by 74
Traffic flow forecasting based on multitask ensemble learning
Sun, S. (2009) · ACM/SIGEVO Summit on Genetic and Evolutionary Computation (GEC) · doi:10.1145/1543834.1543984 · Cited by 26
Cited by
Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting
Yu, B., Yin, H., & Zhu, Z. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/505 · Cited by 3,728
T-GCN: A Temporal Graph Convolutional Network for Traffic Prediction
Zhao, L., Song, Y., Zhang, C., Liu, Y., Wang, P., Lin, T., Deng, M., & Li, H. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2935152 · Cited by 3,326
LSTM network: a deep learning approach for short‐term traffic forecast
Zhao, Z., Chen, W., Wu, X., Chen, P. C. Y., & Liu, J. (2017) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2016.0208 · Cited by 1,834
Ma, X., Dai, Z., He, Z., Ma, J., Wang, Y., & Wang, Y. (2017) · Sensors · doi:10.3390/s17040818 · Cited by 1,409
Spectral-spatial classification of hyperspectral data based on deep belief network
Chen, Y., Zhao, X., & Jia, X. (2015) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2015.2388577 · Cited by 1,259
Metadata
- Authors
- Huang, W., Song, G., Hong, H., & Xie, K.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2014-10
- Volume
- 15
- Issue
- 5
- Pages
- 2191-2201
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2165991108
- Cited by
- 1,139
- References
- 34
- FWCI
- 50.98
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.