The DOI matches its Crossref record; 171 of the 171 references it cites were found in a registry or an index.
When Gaussian Process Meets Big Data: A Review of Scalable GPs
Open accessAbstract
The vast quantity of information brought by big data as well as the evolving computer hardware encourages success stories in the machine learning community. In the meanwhile, it poses challenges for the Gaussian process regression (GPR), a well-known nonparametric, and interpretable Bayesian model, which suffers from cubic complexity to data size. To improve the scalability while retaining desirable prediction quality, a variety of scalable GPs have been presented. However, they have not yet been comprehensively reviewed and analyzed to be well understood by both academia and industry. The review of scalable GPs in the GP community is timely and important due to the explosion of data size. To this end, this article is devoted to reviewing state-of-the-art scalable GPs involving two main categories: global approximations that distillate the entire data and local approximations that divide the data for subspace learning. Particularly, for global approximations, we mainly focus on sparse approximations comprising prior approximations that modify the prior but perform exact inference, posterior approximations that retain exact prior but perform approximate inference, and structured sparse approximations that exploit specific structures in kernel matrix; for local approximations, we highlight the mixture/product of experts that conducts model averaging from multiple local experts to boost predictions. To present a complete review, recent advances for improving the scalability and capability of scalable GPs are reviewed. Finally, the extensions and open issues of scalable GPs in various scenarios are reviewed and discussed to inspire novel ideas for future research avenues.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
MapReduce: simplified data processing on large clusters
Dean, J., & Ghemawat, S. (2008) · Communications of the ACM · doi:10.1145/1327452.1327492 · Cited by 18,476
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · cited 1×
“9]. Finally, we again see the trend in combining recurrent GPs with neural networks. For instance, the deep recurrent GP [230], [231] attempts to mimic the well-known recurrent neural networks (RNNs) [232], with each layer modeled by a GP. Similar to DGP [201], the inference in deep recurrent GP is intractable and req…”
BackgroundDesign and Analysis of Computer Experiments
Sacks, J., Welch, W. J., Mitchell, T. J., & Wynn, H. P. (1989) · Statistical Science · doi:10.1214/ss/1177012413 · Cited by 6,919
Taking the Human Out of the Loop: A Review of Bayesian Optimization
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494218 · Cited by 6,049
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 7×
“Given the GP experts x ∗ , the PoEs [25], [144]–[146] aggregate the experts’ predictions through a modified product rule as where β ∗ i is a weight quantifying the contribution of p i ( y ∗”
BackgroundMethodInfluentialMatheron, G. (1963) · Economic Geology · doi:10.2113/gsecongeo.58.8.1246 · Cited by 4,845
Bayesian Learning for Neural Networks
Neal, R. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0745-0 · Cited by 4,276
Computational Geometry--An Introduction.
Atallah, M. J., Preparata, F. P., & Shamos, M. I. (1986) · Mathematics of Computation · doi:10.2307/2008200 · Cited by 4,238
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. D. (2017) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1285773 · Cited by 3,811
Hierarchical Mixtures of Experts and the EM Algorithm
Jordan, M. I., & Jacobs, R. A. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.181 · Cited by 2,673
Wendland, H. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511617539 · Cited by 2,538
Variational Inference: A Review for Statisticians
Blei, D. M., Kucukelbir, A., & McAuliffe, J. (2017) · Figshare · doi:10.6084/m9.figshare.5203696 · Cited by 1,919
A Unifying View of Sparse Approximate Gaussian Process Regression
Quiñonero-Candela, J., & Rasmussen, C. E. (2005) · doi:10.5555/1046920.1194909 · Cited by 1,671
Using the Nyström Method to Speed Up Kernel Machines
Williams, C. K. I., & Seeger, M. (2000) · Cited by 1,646
Sparse Gaussian Processes using Pseudo-inputs
Snelson, E., & Ghahramani, Z. (2005) · Cited by 1,415
Multi-task Gaussian Process Prediction
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2007) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 1,378
Stochastic variational inference
Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. W. (2013) · Journal of Machine Learning Research · doi:10.5555/2567709.2502622 · Cited by 1,333
Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models
Lawrence, N. D. (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1194904 · Cited by 1,156
Some aspects of the spline smoothing approach to non-parametric regression curve fitting
Silverman, B. W. (1985) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1985.tb01327.x · Cited by 1,117 · cited 1×
“Particularly, the subset-of-regressors (SoR) [55]–[57] approximation, also called deterministic inducing conditional (DIC) approximation, imposes both deterministic training and test conditionals, i.”
BackgroundVariational Learning of Inducing Variables in Sparse Gaussian Processes
Titsias, M. K. (2009) · Cited by 1,083
Fixed Rank Kriging for Very Large Spatial Data Sets
Cressie, N., & Johannesson, G. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00633.x · Cited by 994
Bayesian Inference for Logistic Models Using Pólya–Gamma Latent Variables
Polson, N. G., Scott, J. G., & Windle, J. (2013) · Journal of the American Statistical Association · doi:10.1080/01621459.2013.829001 · Cited by 928
Sparse On-Line Gaussian Processes
Csató, L., & Opper, M. (2002) · Neural Computation · doi:10.1162/089976602317250933 · Cited by 749
Communication Efficient Distributed Machine Learning with the Parameter Server
Li, M., Andersen, D. G., Smola, A. J., & Yu, K. (2014) · neural information processing systems · Cited by 715
Fast Direct Methods for Gaussian Processes
Ambikasaran, S., Foreman-Mackey, D., Greengard, L., Hogg, D. W., & O'Neil, M. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2448083 · Cited by 669
Ensemble approaches for regression: A survey
Mendes-Moreira, J., Soares, C., Jorge, A. M., & Sousa, J. F. D. (2012) · ACM Computing Surveys · doi:10.1145/2379776.2379786 · Cited by 667
Bayesian Treed Gaussian Process Models With an Application to Computer Modeling
Gramacy, R. B., & Lee, H. K. H. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000689 · Cited by 650
Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geostatistical Datasets
Datta, A., Banerjee, S., Finley, A. O., & Gelfand, A. E. (2016) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1044091 · Cited by 615
Twenty Years of Mixture of Experts
Yuksel, S. E., Wilson, J. N., & Gader, P. D. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2200299 · Cited by 606
Kernels for Vector-Valued Functions: a Review
Álvarez, M. A., Rosasco, L., & Lawrence, N. D. (2012) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · Cited by 587
Big Data for Modern Industry: Challenges and Trends [Point of View]
Yin, S., & Kaynak, O. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2388958 · Cited by 565
Mixture of experts: a literature survey
Masoudnia, S., & Ebrahimpour, R. (2014) · Artificial Intelligence Review · doi:10.1007/s10462-012-9338-y · Cited by 561
GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Acceleration
Gardner, J. R., Pleiss, G., Bindel, D., Weinberger, K. Q., & Wilson, A. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.11165 · Cited by 496
Fast Sparse Gaussian Process Methods: The Informative Vector Machine
Herbrich, R., Lawrence, N. D., & Seeger, M. (2002) · neural information processing systems · Cited by 488
Gaussian Process Behaviour in Wide Deep Neural NetworksPreprint
Matthews, A., Rowland, M., Hron, J., Turner, R. E., & Ghahramani, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.11271 · Cited by 461
Liu, H., Ong, Y.-S., & Cai, J. (2018) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-017-1739-8 · Cited by 444
Self-citationTresp, V. (2000) · Neural Computation · doi:10.1162/089976600300014908 · Cited by 402
Gaussian Processes for Big Data
Hensman, J. J., Fusi, N., & Lawrence, N. D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.6835 · Cited by 393
Fast Forward Selection to Speed Up Sparse Gaussian Process Regression
Seeger, M., Williams, C. K. I., & Lawrence, N. D. (2003) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 386
Bayesian Gaussian Process Latent Variable Model
Titsias, M. K., & Lawrence, N. D. (2010) · International Conference on Artificial Intelligence and Statistics · Cited by 378
Infinite Mixtures of Gaussian Process Experts
Rasmussen, C. E., & Ghahramani, Z. (2001) · Cited by 377
Local Gaussian Process Approximation for Large Computer Experiments
Gramacy, R. B., & Apley, D. W. (2015) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2014.914442 · Cited by 361
Sparse Spectrum Gaussian Process Regression
Lázaro-Gredilla, M., Quiñonero-Candela, J., Rasmussen, C. E., & Figueiras-Vidal, A. R. (2010) · doi:10.5555/1756006.1859914 · Cited by 352
Distributed Gaussian ProcessesPreprint
Deisenroth, M. P., & Ng, J. (2015) · arXiv (Cornell University) · doi:10.25561/21163 · Cited by 338
On the use of MapReduce for imbalanced big data using Random Forest
del Río, S., López, V., Benítez, J. M., & Herrera, F. (2014) · Information Sciences · doi:10.1016/j.ins.2014.03.043 · Cited by 328
A Multiresolution Gaussian Process Model for the Analysis of Large Spatial Datasets
Nychka, D., Bandyopadhyay, S., Hammerling, D., Lindgren, F., & Sain, S. (2015) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2014.914946 · Cited by 326
Model Learning with Local Gaussian Process Regression
Nguyen-Tuong, D., Seeger, M., & Peters, J. (2009) · Advanced Robotics · doi:10.1163/016918609x12529286896877 · Cited by 316
Sparse Greedy Gaussian Process Regression
Smola, A. J., & Bartlett, P. L. (2000) · Cited by 316
Scalable Variational Gaussian Process Classification
Hensman, J. J., Matthews, A., & Ghahramani, Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.2005 · Cited by 310
Approximations for Binary Gaussian Process Classification
Nickisch, H., & Rasmussen, C. E. (2008) · Cited by 298
Remarks on multi-output Gaussian process regression
Liu, H., Cai, J., & Ong, Y.-S. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.12.034 · Cited by 294
Self-citationCompactly Supported Correlation Functions
Gneiting, T. (2002) · Journal of Multivariate Analysis · doi:10.1006/jmva.2001.2056 · Cited by 291
GPflow: A Gaussian process library using TensorFlow
Matthews, A., van der Wilk, M., Nickson, T., Fujii, K., Boukouvalas, A., León-Villagrá, P., Ghahramani, Z., & Hensman, J. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.08733 · Cited by 289
Regression with Input-dependent Noise: A Gaussian Process Treatment
Goldberg, P. W., Williams, C. K. I., & Bishop, C. (1997) · Aston Publications Explorer (Aston University) · Cited by 275
A Survey on Gaussian Processes for Earth-Observation Data Analysis: A Comprehensive Investigation
Camps-Valls, G., Verrelst, J., Munoz-Mari, J., Laparra, V., Mateo-Jimenez, F., & Gomez-Dans, J. (2016) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2015.2510084 · Cited by 260
Damianou, A., & Lawrence, N. D. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1211.0358 · Cited by 249
Survey on Multi-Output Learning
Xu, D., Shi, Y., Tsang, I. W., Ong, Y.-S., Gong, C., & Shen, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2945133 · Cited by 240
Self-citationAdaptive Design and Analysis of Supercomputer Experiments
Gramacy, R. B., & Lee, H. K. H. (2009) · Technometrics · doi:10.1198/tech.2009.0015 · Cited by 239
Local and global sparse Gaussian process approximations.
Snelson, E., & Zoubin Ghahramani, A. (2007) · Cited by 236
An Alternative Model for Mixtures of Experts
Xu, L., Jordan, M. I., & Hinton, G. E. (1994) · Cited by 215
Computationally Efficient Convolved Multiple Output Gaussian Processes
Álvarez, M. A., & Lawrence, N. D. (2009) · Apollo (University of Cambridge) · doi:10.17863/cam.48485 · Cited by 214
Mixtures of Gaussian Processes
Volker Tresp, C. (2000) · Cited by 206
Manifold Gaussian Processes for regression
Calandra, R., Peters, J., Rasmussen, C. E., & Deisenroth, M. P. (2016) · 2016 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727626 · Cited by 205
Sparse probabilistic regression for activity-independent human pose inference
Urtasun, R., & Darrell, T. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587360 · Cited by 204
Bayesian Gaussian Process Models: PAC-Bayesian Generalisation Error Bounds and Sparse Approximations
Seeger, M. (2003) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 197
Variational Heteroscedastic Gaussian Process Regression
Titsias, M. K., & Lázaro-Gredilla, M. (2011) · International Conference on Machine Learning · Cited by 190
Automatic online tuning for fast Gaussian summation
Morariu, V. I., Srinivasan, B. V., Raykar, V. C., Ramani Duraiswami, B., & Davis, L. S. (2008) · Cited by 189
Kernel Interpolation for Scalable Structured Gaussian Processes (KISS-GP)
Wilson, A. G., & Nickisch, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.01057 · Cited by 184
Chen, M., Silva, J., Paisley, J., Wang, C., Dunson, D., & Carin, L. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2070796 · Cited by 182
Geweke, J., & Keane, M. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.05.022 · Cited by 177
Deep Gaussian Processes for Regression using Approximate Expectation PropagationPreprint
Bui, T. D., Hernández-Lobato, J. M., Hernández-Lobato, D., Li, Y., & Turner, R. E. (2016) · arXiv (Cornell University) · doi:10.17863/cam.21348 · Cited by 174
Gaussian process modeling of large‐scale terrain
Vasudevan, S., Ramos, F., Nettleton, E., & Durrant‐Whyte, H. (2009) · Journal of Field Robotics · doi:10.1002/rob.20309 · Cited by 170
Variational Inference for Latent Variables and Uncertain Inputs in Gaussian Processes
Damianou, A., Titsias, M. K., & Lawrence, N. D. (2016) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.5555/2946645.2946687 · Cited by 168
Bagging for Gaussian process regression
Chen, T., & Ren, J. (2008) · Neurocomputing · doi:10.1016/j.neucom.2008.09.002 · Cited by 162
laGP: Large-Scale Spatial Modeling via Local Approximate Gaussian Processes in R
Gramacy, R. B. (2016) · Journal of Statistical Software · doi:10.18637/jss.v072.i01 · Cited by 162
Big Data for Modern Industry: Challenges and Trends
Yin, S., & Kaynak, O. (2015) · Cited by 161
Stochastic Variational Deep Kernel LearningPreprint
Wilson, A. G., Hu, Z., Salakhutdinov, R., & Xing, E. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00336 · Cited by 152
Bui, T. D., Yan, J., & Turner, R. E. (2016) · Journal of machine learning research · doi:10.17863/cam.20846 · Cited by 148
A Framework for Evaluating Approximation Methods for Gaussian Process RegressionPreprint
Chalupka, K., Williams, C. K. I., & Murray, I. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.6326 · Cited by 140
Bayesian Hierarchical Mixtures of ExpertsPreprint
Bishop, C., & Svensen, M. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.2447 · Cited by 139
A new class of radial basis functions with compact support
Buhmann, M. (2000) · Mathematics of Computation · doi:10.1090/s0025-5718-00-01251-5 · Cited by 138
Variational Gaussian Process State-Space ModelsPreprint
Frigola, R., Chen, Y., & Rasmussen, C. E. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.4905 · Cited by 137
Sun, S., & Xu, X. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2093575 · Cited by 137
Recursive Gaussian process: On-line regression and learning
Huber, M. F. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.03.004 · Cited by 136
Improved learning algorithms for mixture of experts in multiclass classification
Chen, K., Xu, L., & Chi, H. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00043-x · Cited by 131
Bayesian Gaussian Process Classification with the EM-EP Algorithm
Kim, H., & Ghahramani, Z. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.238 · Cited by 124
Bayesian Inference and Learning in Gaussian Process State-Space Models with Particle MCMCPreprint
Frigola, R., Lindsten, F., Schön, T. B., & Rasmussen, C. E. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.2861 · Cited by 119
Healing the relevance vector machine through augmentation
Rasmussen, C. E., & Quiñonero-Candela, J. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102438 · Cited by 117
Generalized Product of Experts for Automatic and Principled Fusion of Gaussian Process Predictions
Cao, Y., & Fleet, D. J. (2014) · arXiv · doi:10.48550/arxiv.1410.7827 · Cited by 116
Almosallam, I. A., Jarvis, M. J., & Roberts, S. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw1618 · Cited by 112
Overlapping Mixtures of Gaussian Processes for the data association problem
Lázaro-Gredilla, M., Vaerenbergh, S. V., & Lawrence, N. D. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.10.004 · Cited by 111
An Alternative Infinite Mixture Of Gaussian Process Experts
Meeds, E., & Osindero, S. (2005) · Cited by 110
Random Feature Expansions for Deep Gaussian Processes
Cutajar, K., Bonilla, E. V., Pietro Michiardi, A., & Filippone, M. (2016) · Graduate School and Research Center in Digital Science (EURECOM) · doi:10.48550/arxiv.1610.04386 · Cited by 109
Bradshaw, J., Matthews, A. G. D. G., & Ghahramani, Z. (2017) · arXiv · doi:10.48550/arxiv.1707.02476 · Cited by 109
On Sparse Variational Methods and the Kullback-Leibler Divergence between Stochastic ProcessesPreprint
Matthews, A., Hensman, J. J., Turner, R. E., & Ghahramani, Z. (2015) · arXiv (Cornell University) · doi:10.17863/cam.15597 · Cited by 107
Variational Auto-encoded Deep Gaussian ProcessesPreprint
Dai, Z., Damianou, A., González, J., & Lawrence, N. D. (2015) · arXiv (Cornell University) · doi:10.17863/cam.47957 · Cited by 106
Fast Gaussian Process Regression using KD-Trees
Shen, Y., Seeger, M., & Ng, A. Y. (2005) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 97
Spatial Gaussian Process Regression With Mobile Sensor Networks
Gu, D., & Hu, H. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2200694 · Cited by 93
Fast Gaussian process methods for point process intensity estimation
Cunningham, J. P., Shenoy, K. V., & Sahani, M. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390181 · Cited by 90
Variational Mixture of Gaussian Process Experts
Yuan, C., & Neubauer, C. (2008) · Cited by 84
MCMC for Variationally Sparse Gaussian Processes
Hensman, J. J., Matthews, A., Filippone, M., & Ghahramani, Z. (2015) · Graduate School and Research Center in Digital Science (EURECOM) · doi:10.48550/arxiv.1506.04000 · Cited by 84
Nested Kriging predictions for datasets with a large number of observations
Rullière, D., Durrande, N., Bachoc, F., & Chevalier, C. (2017) · Statistics and Computing · doi:10.1007/s11222-017-9766-2 · Cited by 83
Learning Scalable Deep Kernels with Recurrent Structure
Al-Shedivat, M., Wilson, A. G., Saatchi, Y., Hu, Z., & Xing, E. P. (2016) · PubMed · doi:10.48550/arxiv.1610.08936 · Cited by 79
Streaming Sparse Gaussian Process ApproximationsPreprint
Bui, T. D., Nguyen, C. V., & Turner, R. E. (2017) · arXiv (Cornell University) · doi:10.17863/cam.21293 · Cited by 74
The kriging update equations and their application to the selection of neighboring data
Emery, X. (2008) · Computational Geosciences · doi:10.1007/s10596-008-9116-8 · Cited by 73
Thoughts on Massively Scalable Gaussian ProcessesPreprint
Wilson, A. G., Dann, C., & Nickisch, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.01870 · Cited by 71
Collaborative multi-output Gaussian processes
Nguyen, T., & Bonilla, E. V. (2014) · Cited by 71
Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo
Havasi, M., Hernández-Lobato, J. M., & Murillo-Fuentes, J. J. (2018) · arXiv · doi:10.48550/arxiv.1806.05490 · Cited by 69
Parallel Bayesian Additive Regression Trees
Pratola, M. T., Chipman, H., Gattiker, J., et al. (2014) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2013.841584 · Cited by 68
Convolutional Gaussian ProcessesPreprint
van der Wilk, M., Rasmussen, C. E., & Hensman, J. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01894 · Cited by 67
Lima, C. A. M., Coelho, A. L. V., & Zuben, F. J. V. (2007) · Information Sciences · doi:10.1016/j.ins.2007.01.009 · Cited by 66
Hoang, T. N., Hoang, Q. M., & Low, B. K. H. (2015) · Cited by 65
Learning Scalable Deep Kernels with Recurrent\nStructure
Al-Shedivat, M., Wilson, A. G., Saatchi, Y., Hu, Z., & Xing, E. P. (2017) · Europe PMC (PubMed Central) · Cited by 64
Denison, D. G. T., Adams, N. M., Holmes, C. C., & Hand, D. J. (2002) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(01)00073-1 · Cited by 57
Scaling Multidimensional Inference for Structured Gaussian Processes
Gilboa, E., Saatçi, Y., & Cunningham, J. P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.192 · Cited by 57
Approximate inference for disease mapping with sparse Gaussian processes
Vanhatalo, J. P., Pietiläinen, V., & Vehtari, A. (2010) · Statistics in Medicine · doi:10.1002/sim.3895 · Cited by 56
Chen, J., Low, K. H., Tan, C. K.-Y., Oran, A., Jaillet, P., Dolan, J. M., & Sukhatme, G. S. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6230 · Cited by 56
Gaussian Process Regression with Heteroscedastic or Non-Gaussian ResidualsPreprint
Wang, C.-Y., & Neal, R. M. (2012) · arXiv.org · doi:10.48550/arxiv.1212.6246 · Cited by 56
Parallel Gaussian Process Regression with Low-Rank Covariance Matrix ApproximationsPreprint
Chen, J., Cao, N., Low, K. H., Ouyang, R., Tan, C. K.-Y., & Jaillet, P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1305.5826 · Cited by 54
Gal, Y., & Turner, R. E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.02424 · Cited by 54
Nonparametric Mixture of Gaussian Processes with Constraints
Ross, J. C., & Dy, J. (2013) · Cited by 53
Product Kernel Interpolation for Scalable Gaussian ProcessesPreprint
Gardner, J. R., Pleiss, G., Wu, R., Weinberger, K. Q., & Wilson, A. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.08903 · Cited by 53
Efficient Optimization for Sparse Gaussian Process Regression
Cao, Y., Brubaker, M. A., Fleet, D. J., & Hertzmann, A. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2424873 · Cited by 52
Fast Allocation of Gaussian Process Experts
Nguyen, T., & Bonilla, E. V. (2014) · Cited by 51
Massively Parallel Approximate Gaussian Process Regression
Gramacy, R. B., Niemi, J., & Weiss, R. M. (2014) · SIAM/ASA Journal on Uncertainty Quantification · doi:10.1137/130941912 · Cited by 51
Integrated pre-processing for Bayesian nonlinear system identification with Gaussian processes
Frigola, R., & Rasmussen, C. E. (2013) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2013.6760734 · Cited by 51
Understanding and comparing scalable Gaussian process regression for big data
Liu, H., Cai, J., Ong, Y.-S., & Wang, Y. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.11.002 · Cited by 48
Self-citationBijl, H., van Wingerden, J., Schön, T. B., & Verhaegen, M. (2015) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2015.12.212 · Cited by 46
Xu, N., Low, K. H., Chen, J., Lim, K. K., & Özgül, E. B. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.9058 · Cited by 46
Convolutional Gaussian Processes
van der Wilk, M., Rasmussen, C. E., & Hensman, J. J. (2017) · Apollo (University of Cambridge) · doi:10.17863/cam.21271 · Cited by 44
Large-Scale Heteroscedastic Regression via Gaussian Process
Liu, H., Ong, Y.-S., & Cai, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979188 · Cited by 44
Self-citationHoang, T. N., Hoang, Q. M., & Low, B. K. H. (2016) · International Conference on Machine Learning · Cited by 42
Deep Gaussian Processes with Convolutional KernelsPreprint
Kumar, V., Singh, V. K., Srijith, P. K., & Damianou, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.01655 · Cited by 42
Extension of mixture-of-experts networks for binary classification of hierarchical data
Ng, S., & McLachlan, G. J. (2007) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2007.06.001 · Cited by 40
Scalable Gaussian process inference using variational methods
Matthews, A. G. D. G. (2016) · Apollo (University of Cambridge) · doi:10.17863/cam.25348 · Cited by 40
Dirichlet-based Gaussian Processes for Large-scale Calibrated ClassificationPreprint
Milios, D., Camoriano, R., Pietro Michiardi, A., Rosasco, L., & Filippone, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10915 · Cited by 39
Parallelizing Gaussian Process Calculations inR
Paciorek, C. J., Lipshitz, B., Zhuo, W., Prabhat, Kaufman, C. G., & Thomas, R. C. (2015) · Journal of Statistical Software · doi:10.18637/jss.v063.i10 · Cited by 31
Park, C., & Huang, J. Z. (2016) · OakTrust (Texas A&M University Libraries) · doi:10.5555/2946645.3053456 · Cited by 31
Variational Dependent Multi-output Gaussian Process Dynamical Systems
Zhao, J., & Sun, S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11812-3_30 · Cited by 30
An Efficient EM Approach to Parameter Learning of the Mixture of Gaussian Processes
Yang, Y. T., & Ma, J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21090-7_20 · Cited by 29
Incremental Variational Sparse Gaussian Process Regression
Cheng, C.-A., & Boots, B. (2016) · neural information processing systems · Cited by 29
Sufficient Dimension Reduction via Bayesian Mixture Modeling
Reich, B. J., Bondell, H. D., & Li, L. (2010) · Biometrics · doi:10.1111/j.1541-0420.2010.01501.x · Cited by 28
Hoang, Q. M., Hoang, T. N., & Low, K. H. (2017) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v31i1.10772 · Cited by 27
Scalable Gaussian Processes with Billions of Inducing Inputs via Tensor Train DecompositionPreprint
Izmailov, P., Novikov, A., & Kropotov, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.07324 · Cited by 26
Deep Gaussian Processes with Importance-Weighted Variational InferencePreprint
Salimbeni, H., Dutordoir, V., Hensman, J. J., & Deisenroth, M. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.05435 · Cited by 26
Variational multinomial logit gaussian process
Chai, K. M. A. (2012) · Journal of Machine Learning Research · doi:10.5555/2188385.2343700 · Cited by 25
Variational Inference for Uncertainty on the Inputs of Gaussian Process ModelsPreprint
Damianou, A., Titsias, M. K., & Lawrence, N. D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.2287 · Cited by 24
Observations on the Nyström Method for Gaussian Process Prediction
Williams, C. S. J., Rasmussen, C. E., Scwaighofer, A., et al. (2002) · Cambridge University Engineering Department Publications Database · Cited by 24
Stochastic Variational Inference for Bayesian Sparse Gaussian Process Regression
Yu, H., Nghia, T., Low, B. K. H., & Jaillet, P. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852481 · Cited by 22
Variational Inference for Mahalanobis Distance Metrics in Gaussian Process Regression
Titsias, M. K., & Lázaro-Gredilla, M. (2013) · Cited by 21
Deep Gaussian Covariance NetworkPreprint
Cremanns, K., & Roos, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.06202 · Cited by 20
Variational inference for sparse spectrum Gaussian process regression
Tan, L. S. L., Ong, V. M.-H., Nott, D. J., & Jasra, A. (2015) · Statistics and Computing · doi:10.1007/s11222-015-9600-7 · Cited by 19
Forecasting of Commercial Sales with Large Scale Gaussian Processes
Rivera, R., & Burnaev, E. V. (2017) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2017.89 · Cited by 19
Preconditioning Kernel MatricesPreprint
Cutajar, K., Osborne, M. A., Cunningham, J. P., & Filippone, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.06693 · Cited by 18
GoGP: Fast Online Regression with Gaussian Processes
Le, T., Nguyen, K., Nguyen, V., Nguyen, T. D., & Phung, D. (2017) · Proceedings · doi:10.1109/icdm.2017.35 · Cited by 18
Variational dependent multi-output Gaussian process dynamical systems
ZhaoJing, Z., & SunShiliang (2016) · Journal of Machine Learning Research · doi:10.5555/2946645.3007074 · Cited by 18
String and Membrane Gaussian ProcessesPreprint
Samo, Y.-L. K., & Roberts, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06977 · Cited by 17
A stochastic variational framework for Recurrent Gaussian Processes models
Mattos, C. L. C., & Barreto, G. A. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.005 · Cited by 14
Low, K. H., Yu, J., Chen, J., & Jaillet, P. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9575 · Cited by 13
Scalable Multi-Class Gaussian Process Classification using Expectation PropagationPreprint
Villacampa-Calvo, C., & Hernández-Lobato, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.07258 · Cited by 12
Bayesian site selection for fast Gaussian process regression
Pourhabib, A., Liang, F., & Ding, Y. C. (2013) · IIE Transactions · doi:10.1080/0740817x.2013.849833 · Cited by 11
Variational inference for infinite mixtures of sparse Gaussian processes through KL-correction
Nguyen, T. N. A., Bouzerdoum, A., & Phung, S. L. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472143 · Cited by 10
Distributed robust Gaussian Process regression
Mair, S., & Brefeld, U. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1084-7 · Cited by 8
Stochastic Variational Inference for Bayesian Sparse Gaussian Process RegressionPreprint
Yu, H., Hoang, T. N., Low, K. H., & Jaillet, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00221 · Cited by 7
Scalable Gaussian Process Classification with Additive Noise for Various LikelihoodsPreprint
Liu, H., Ong, Y.-S., Yu, Z., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06541 · Cited by 2
Self-citation
Cited by
Nanoparticle synthesis assisted by machine learning
Tao, H., Wu, T., Aldeghi, M., Wu, T. C., Aspuru-Guzik, A., & Kumacheva, E. (2021) · Nature Reviews Materials · doi:10.1038/s41578-021-00337-5 · Cited by 545
Recent Advances in Bayesian Optimization
Wang, X., Jin, Y., Schmitt, S., & Olhofer, M. (2023) · ACM Computing Surveys · doi:10.1145/3582078 · Cited by 477
A Case Study Competition Among Methods for Analyzing Large Spatial Data
Heaton, M. J., Datta, A., Finley, A. O., Furrer, R., Guinness, J., Guhaniyogi, R., Gerber, F., Gramacy, R. B., Hammerling, D., Katzfuss, M., et al. (2019) · Journal of Agricultural, Biological and Environmental Statistics · doi:10.1007/s13253-018-00348-w · Cited by 397
Recent Advances in 2D Material Theory, Synthesis, Properties, and Applications
Lin, Y.-C., Torsi, R., Younas, R., Hinkle, C. L., Rigosi, A. F., Hill, H. M., Zhang, K., Huang, S., Shuck, C. E., Chen, C., et al. (2023) · ACS Nano · doi:10.1021/acsnano.2c12759 · Cited by 342
Machine learning for hydrologic sciences: An introductory overview
Xu, T., & Liang, F. (2021) · WIREs Water · doi:10.1002/wat2.1533 · Cited by 267
Metadata
- Authors
- Liu, H., Ong, Y.-S., Shen, X., & Cai, J.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2020-11
- Volume
- 31
- Issue
- 11
- Pages
- 4405-4423
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W3000508506
- Cited by
- 878
- References
- 171
- FWCI
- 43.66
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.