Variational Inference for Infinite Mixtures of Gaussian Processes With Applications to Traffic Flow Prediction
The DOI matches its Crossref record; 34 of the 37 references it cites were found in a registry or an index.
Abstract
This paper proposes a new variational approximation for infinite mixtures of Gaussian processes. As an extension of the single Gaussian process regression model, mixtures of Gaussian processes can characterize varying covariances or multimodal data and reduce the deficiency of the computationally cubic complexity of the single Gaussian process model. The infinite mixture of Gaussian processes further integrates a Dirichlet process prior to allowing the number of mixture components to automatically be determined from data. We use variational inference and a truncated stick-breaking representation of the Dirichlet process to approximate the posterior of hidden variables involved in the model. To fix the hyperparameters of the model, the variational EM algorithm and a greedy algorithm are employed. In addition to presenting the variational infinite-mixture model, we apply it to the problem of traffic flow prediction. Experiments with comparisons to other approaches show the effectiveness of the proposed model.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Traditional content providers may simply use rule-based solutions such as Least Recently Used (LRU), Least Frequently Used (LFU) and their variants [88], [89], or model-based solutions such as [90], [91] given the easy implementation.”
From Deep learning for edge computing applications: A State-of-the-Art survey (2020) · cites this paper as [89]
Citations
Cites
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Pattern Recognition and Machine Learning
(2007) · Kybernetes · doi:10.1108/03684920710743466 · Cited by 8,265
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
A Bayesian Analysis of Some Nonparametric Problems
Ferguson, T. S. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342360 · Cited by 4,697
Encyclopedia of Machine Learning
(2010) · Springer eBooks · doi:10.1007/978-0-387-30164-8 · Cited by 3,465
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
Barker, L. (2002) · Technometrics · doi:10.1198/tech.2002.s659 · Cited by 2,477
The feynman lectures on physics
De Shalit, A. (1967) · Journal of the Franklin Institute · doi:10.1016/0016-0032(67)90572-8 · Cited by 2,279
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2008) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000001 · Cited by 1,820
A Constructive Definition of Dirichlet Priors
Sethuraman, J. (1991) · doi:10.21236/ada238689 · Cited by 1,572
Gibbs Sampling Methods for Stick-Breaking Priors
Ishwaran, H., & James, L. F. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750332758 · Cited by 1,511
Variational inference for Dirichlet process mixtures
Blei, D. M., & Jordan, M. I. (2006) · Bayesian Analysis · doi:10.1214/06-ba104 · Cited by 1,438
The Infinite Gaussian Mixture Model
Rasmussen, C. E. (1999) · Cited by 1,057
(2018) · Physics Subject Headings (PhySH) · doi:10.29172/0660b3fe-654b-49c9-a7fa-79f18efe2aa0 · Cited by 882
Wang, F.-Y. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2060218 · Cited by 856
A Bayesian Network Approach to Traffic Flow Forecasting
Sun, S., Zhang, C., & Yu, G. (2006) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.869623 · Cited by 795
Self-citationItzykson, C., & Drouffe, J.-M. (1989) · Cambridge University Press eBooks · doi:10.1017/cbo9780511622786 · Cited by 581
Infinite Mixtures of Gaussian Process Experts
Rasmussen, C. E., & Ghahramani, Z. (2001) · Cambridge University Engineering Department Publications Database · Cited by 512
Sparse Greedy Gaussian Process Regression
Smola, A. J., & Bartlett, P. L. (2000) · ANU Open Research (Australian National University) · Cited by 421
Mixtures of Gaussian Processes
Tresp, V. (2000) · neural information processing systems · Cited by 288
An Alternative Model for Mixtures of Experts
Xu, L., Jordan, M. I., & Hinton, G. E. (1994) · neural information processing systems · Cited by 268
A comparison of numerical optimizers for logistic regression
Minka, T. P. (2004) · Cited by 246
An Alternative Infinite Mixture Of Gaussian Process Experts
Meeds, E., & Osindero, S. (2005) · neural information processing systems · Cited by 146
Short-term traffic flow forecasting based on Markov chain model
Yu, G., Hu, J., Zhang, C., Zhuang, L., & Song, J. (2004) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2003.1212910 · Cited by 125
Bayesian Hierarchical Mixtures of Experts
Bishop, C., & Svensen, M. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.2447 · Cited by 117
Variational Mixture of Gaussian Process Experts
Yuan, C., & Neubauer, C. (2008) · neural information processing systems · Cited by 103
Predictions of Urban Volumes in Single Time Series
Thomas, T., Weijermars, W., & van Berkum, E. C. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2028149 · Cited by 92
The Selective Random Subspace Predictor for Traffic Flow Forecasting
Sun, S., & Zhang, C. (2007) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.888603 · Cited by 78
Self-citationA Simplified Estimation Scheme for the Number of Vehicles in Signalized Links
Vigos, G., & Papageorgiou, M. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2042807 · Cited by 44
Building an Intellectual Highway for ITS Research and Development
(2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2043751 · Cited by 13
Cited by
Traffic Flow Prediction With Big Data: A Deep Learning Approach
Lv, Y., Duan, Y., Kang, W., Li, Z., & Wang, F.-Y. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2345663 · Cited by 3,000
Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning
Huang, W., Song, G., Hong, H., & Xie, K. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2311123 · Cited by 1,139
Short-term traffic forecasting: where we are and where we’re going
Vlahogianni, E. I., Karlaftis, M. G., & Golias, J. C. (2014) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2014.01.005 · Cited by 1,132
When Gaussian Process Meets Big Data: A Review of Scalable GPs
Liu, H., Ong, Y.-S., Shen, X., & Cai, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2957109 · Cited by 878
Traffic Flow Prediction for Road Transportation Networks With Limited Traffic Data
Abadi, A., Rajabioun, T., & Ioannou, P. A. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2337238 · Cited by 338
Metadata
- Authors
- Sun, S., & Xu, X.
- Affiliations
- East China Jiaotong University (CN)
- National University of Defense Technology (CN)
- ORCID
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2011-06
- Volume
- 12
- Issue
- 2
- Pages
- 466-475
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2160299137
- Cited by
- 137
- References
- 37
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 4 · 2023: 10 · 2022: 10 · 2021: 12 · 2020: 10 · 2019: 9 · 2018: 15 · 2017: 9 · 2016: 7 · 2015: 7 · 2014: 21 · 2013: 7 · 2012: 8
- FWCI
- 5.08
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Intelligent Transportation Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Methods and Mixture Models
- Social Sciences › Transportation › Traffic Prediction and Management Techniques
- Keywords
- variational inference, Dirichlet process, traffic flow prediction, variational EM algorithm, hyperparameter estimation, multimodal data, computational complexity reduction, nonparametric Bayesian models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.