Deep Gaussian Processes
Open accessThe DOI matches its OpenAlex record; 21 of the 21 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336 · cited 1×
“The recent advances in the domain of deep learning [Hinton and Osindero, 2006, Bengio et al., 2012] have brought this kind of models again in popularity.”
BackgroundA Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585 · cited 1×
“These observations are then used to train the following models: a deep GP, a simple stacked Isomap [Tenenbaum et al., 2000] and a stacked PCA method, the results of which are shown in figures 2 (b, c, d) respectively.”
MethodLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Bayesian Learning for Neural Networks
Neal, R. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0745-0 · Cited by 4,276 · cited 2×
“…to the SVM, Gaussian process (GP) models [Rasmussen and Williams, 2006] were introduced as a fully probabilistic substitute for the multilayer perceptron (MLP), inspired by the observation [Neal, 1996] that, under certain conditions, a GP is an MLP with infinite units in the hidden layer.”
MethodA Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 1×
“d it is useful to have an objective measure of the model’s applicability. The traditional approach to deep learning is based around binary latent variables and the restricted Boltzmann machine (RBM) [Hinton, 2010]. Deep hierarchies are constructed by stacking these models and various approximate inference techniques (…”
MethodWhy Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Bengio, S. (2010) · Journal of Machine Learning Research · Cited by 2,641
Stochastic variational inference
Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. W. (2013) · Journal of Machine Learning Research · doi:10.5555/2567709.2502622 · Cited by 1,333 · cited 1×
“A very promising approach would be to apply stochastic variational inference [Hoffman et al., 2012].”
BackgroundProbabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models
Lawrence, N. D. (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1194904 · Cited by 1,167
Self-citationVariational Learning of Inducing Variables in Sparse Gaussian Processes
Titsias, M. K. (2009) · Cited by 1,083
Theory-based Bayesian models of inductive learning and reasoning
Tenenbaum, J. B., Griffiths, T. L., & Kemp, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.009 · Cited by 880 · cited 1×
“Most deep algorithms require a large amount of data to perform learning, however, we know that humans are able to perform inductive reasoning (equivalent to concept generalization) with only a few examples [Tenenbaum et al., 2006].”
BackgroundGaussian Process Latent Variable Models for Visualisation of High Dimensional Data
Lawrence, N. D. (2003) · Cited by 672
Self-citationBayesian methods for adaptive models
Mackay, D. (1992) · doi:10.7907/h3a1-wm07 · Cited by 610 · cited 1×
“nalized allowing a variational lower bound on the likelihood to be computed. The appropriate size of the latent space can be computed using automatic relevance determination (ARD) priors [Neal, 1996, MacKay et al., 1992]. Damianou et al. [2011] extended this approach by placing a Gaussian process prior over the latent…”
MethodUnsupervised Feature Learning and Deep Learning: A Review and New Perspectives
Bengio, Y., Courville, A. C., & Vincent, P. (2012) · Cited by 585
On the quantitative analysis of deep belief networks
Salakhutdinov, R., & Murray, I. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390266 · Cited by 411 · cited 1×
“A significant amount of work has then to be done with annealed importance sampling if even the likelihood1 of a data set under the RBM model is to be estimated [Salakhutdinov and Murray, 2008].”
BackgroundBayesian Gaussian Process Latent Variable Model
Titsias, M. K., & Lawrence, N. D. (2010) · International Conference on Artificial Intelligence and Statistics · Cited by 378
Self-citationSnelson, E., Rasmussen, C. E., Zoubin Ghahramani, A., Thrun, S., Saul, L. K., & Schölkopf, B. (2003) · Cited by 257
Gaussian Process Regression NetworksPreprint
Wilson, A. G., Knowles, D. A., & Ghahramani, Z. (2011) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1110.4411 · Cited by 213 · cited 1×
“s, for example by considering sophisticated covariance functions [Durrande et al., 2011, Gonen and Alpaydin, 2011] or by embedding GPs in more¨ complex probabilistic structures [Snelson et al., 2004, Wilson et al., 2012] able to learn more powerful representations of the data. However, all GP-based approaches consider…”
BackgroundHierarchical Gaussian process latent variable models
Lawrence, N. D., & Moore, A. J. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273557 · Cited by 162 · cited 5×
“For our first demonstration on real data we recreate a motion capture data experiment from Lawrence and Moore [2007].”
BackgroundMethodInfluentialSelf-citationOn Nonparametric Guidance for Learning Autoencoder RepresentationsPreprint
Snoek, J., Adams, R. P., & Larochelle, H. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1102.1492 · Cited by 15 · cited 1×
“Indeed, previous efforts to combine GPs with deep structures were successful at unsupervised pre-training [Erhan et al., 2010] or guiding [Snoek et al., 2012] of traditional deep models.”
Background
Cited by
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
“Deep Gaussian processes (DGPs) [136], [137], [138], [139], [140], [141], [142] are effective multi-layer decision making models that can accurately model the uncertainty.”
BackgroundTime-series forecasting with deep learning: a survey
Lim, B., & Zohren, S. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0209 · Cited by 1,787
Deep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
When Gaussian Process Meets Big Data: A Review of Scalable GPs
Liu, H., Ong, Y.-S., Shen, X., & Cai, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2957109 · Cited by 878
Metadata
- Authors
- Damianou, A., & Lawrence, N. D.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2012-11-02
- Volume
- 31
- Pages
- 207-215
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1211.0358
- OpenAlex
- W1866206747
- Cited by
- 249
- References
- 21
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.