The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
A Survey on Bayesian Deep Learning
Open accessAbstract
A comprehensive artificial intelligence system needs to not only perceive the environment with different “senses” (e.g., seeing and hearing) but also infer the world’s conditional (or even causal) relations and corresponding uncertainty. The past decade has seen major advances in many perception tasks, such as visual object recognition and speech recognition, using deep learning models. For higher-level inference, however, probabilistic graphical models with their Bayesian nature are still more powerful and flexible. In recent years, Bayesian deep learning has emerged as a unified probabilistic framework to tightly integrate deep learning and Bayesian models. 1 In this general framework, the perception of text or images using deep learning can boost the performance of higher-level inference and, in turn, the feedback from the inference process is able to enhance the perception of text or images. This survey provides a comprehensive introduction to Bayesian deep learning and reviews its recent applications on recommender systems, topic models, control, and so on. We also discuss the relationship and differences between Bayesian deep learning and other related topics, such as Bayesian treatment of neural networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“However, these algorithms still lack capabilities such as reasoning [129] or modelling the uncertainty between the input data and the predictions made [130].”
From A survey on deep learning-based monocular spacecraft pose estimation: Current state, limitations and prospects (2023) · cites this paper as [130]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
(2016) · Cited by 11,679
(2012) · Cited by 9,062
Pattern Recognition and Machine Learning
(2007) · Kybernetes · doi:10.1108/03684920710743466 · Cited by 8,545
Receptive fields and functional architecture of monkey striate cortex
Hubel, D. H., & Wiesel, T. N. (1968) · The Journal of Physiology · doi:10.1113/jphysiol.1968.sp008455 · Cited by 6,685
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 10×
“The energy function leads to the following conditional distributions: RBM is trained using ‘Contrastive Divergence’ [40] rather than BP.”
Influential(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
Collaborative Filtering for Implicit Feedback Datasets
Hu, Y., Koren, Y., & Volinsky, C. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.22 · Cited by 3,615
A Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601
DeepAR: Probabilistic forecasting with autoregressive recurrent networks
Salinas, D., Flunkert, V., Gasthaus, J. A., & Januschowski, T. (2019) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.07.001 · Cited by 3,094
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
MCMC Using Hamiltonian Dynamics
Neal, R. M. (2011) · Handbook of Markov Chain Monte Carlo · doi:10.1201/b10905-6 · Cited by 2,574
Introduction to Recommender Systems Handbook
Ricci, F., Rokach, L., & Shapira, B. (2011) · Recommender Systems Handbook · doi:10.1007/978-0-387-85820-3_1 · Cited by 2,378
Deep Learning for Health Informatics
Ravì, D., Wong, C., Deligianni, F., Berthelot, M., Andreu-Perez, J., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636665 · Cited by 2,000
Stochastic Variational InferencePreprint
Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. W. (2012) · arXiv (Cornell University) · doi:10.5555/2567709.2502622 · Cited by 1,991
Collaborative Knowledge Base Embedding for Recommender Systems
Zhang, F., Yuan, N. J., Lian, D., Xie, X., & Ma, W. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939673 · Cited by 1,820
Collaborative Deep Learning for Recommender Systems
Wang, H., Wang, N., & Yeung, D.-Y. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783273 · Cited by 1,657
Self-citationBayesian probabilistic matrix factorization using Markov chain Monte Carlo
Salakhutdinov, R., & Mnih, A. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390267 · Cited by 1,461
Auto-association by multilayer perceptrons and singular value decomposition
Bourlard, H., & Kamp, Y. (1988) · Biological Cybernetics · doi:10.1007/bf00332918 · Cited by 1,391
Estimation and Prediction for Stochastic Blockstructures
Nowicki, K., & Snijders, T. A. B. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753208735 · Cited by 1,099
Keeping the neural networks simple by minimizing the description length of the weights
Hinton, G. E., & van Camp, D. (1993) · Proceedings of the sixth annual conference on Computational learning theory - COLT '93 · doi:10.1145/168304.168306 · Cited by 994
Improving Aggregate Recommendation Diversity Using Ranking-Based Techniques
Adomavičius, G., & Kwon, Y. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.15 · Cited by 674
Low-rank matrix factorization for Deep Neural Network training with high-dimensional output targets
Sainath, T. N., Kingsbury, B., Sindhwani, V., Arisoy, E., & Ramabhadran, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638949 · Cited by 593
Fast collapsed gibbs sampling for latent dirichlet allocation
Porteous, I., Newman, D. J., Ihler, A., Asuncion, A., Smyth, P., & Welling, M. (2008) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1401890.1401960 · Cited by 573
Connectionist learning of belief networks
Neal, R. M. (1992) · Artificial Intelligence · doi:10.1016/0004-3702(92)90065-6 · Cited by 528
Collaborative Variational Autoencoder for Recommender Systems
Li, X., & She, J. P. M. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098077 · Cited by 467
Deep Collaborative Filtering via Marginalized Denoising Auto-encoder
Li, S., Kawale, J., & Fu, Y. (2015) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2806416.2806527 · Cited by 438
Improving Content-based and Hybrid Music Recommendation using Deep Learning
Wang, X., & Wang, Y. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2654940 · Cited by 370
A Guide to Distribution Theory and Fourier Transforms.
Synowiec, J. A., & Strichartz, R. S. (1996) · American Mathematical Monthly · doi:10.2307/2974944 · Cited by 338
A Guide to Distribution Theory and Fourier Transforms
Strichartz, R. S. (2003) · WORLD SCIENTIFIC eBooks · doi:10.1142/5314 · Cited by 242
Typicality-Based Collaborative Filtering Recommendation
Cai, Y., Leung, H.-F., Li, Q., Min, H., Tang, J., & Li, J. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.7 · Cited by 213
Negative Binomial Process Count and Mixture Modeling
Zhou, M., & Carin, L. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.211 · Cited by 199
Lightweight Probabilistic Deep Networks
Gast, J., & Roth, S. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00355 · Cited by 178
Asynchronous Temporal Fields for Action Recognition
Sigurdsson, G. A., Divvala, S., Farhadi, A., & Gupta, A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.599 · Cited by 150
Sampling-Free Epistemic Uncertainty Estimation Using Approximated Variance Propagation
Postels, J., Ferroni, F., Coskun, H., Navab, N., & Tombari, F. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00302 · Cited by 140
Liu, N., Meng, X., Liu, C., & Yang, Q. (2011) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/2043932.2043943 · Cited by 91
Collaborative Deep Ranking: A Hybrid Pair-Wise Recommendation Algorithm with Implicit Feedback
Ying, H., Chen, L., Xiong, Y., & Wu, J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-31750-2_44 · Cited by 72
The Adaptive Clustering Method for the Long Tail Problem of Recommender Systems
Park, Y.-J. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.119 · Cited by 70
Relational Collaborative Topic Regression for Recommender Systems
Wang, H., & Li, W.-J. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2365789 · Cited by 69
Self-citationProduct of Gaussians for speech recognition
Gales, M., & Airey, S. S. (2005) · Computer Speech & Language · doi:10.1016/j.csl.2004.12.002 · Cited by 49
Discovering and Exploiting Causal Dependencies for Robust Mobile Context-Aware Recommenders
Yap, G.-E., Tan, A., & Pang, H. (2007) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.1065 · Cited by 47
Collaborative Filtering with Personalized Skylines
Ilaria Bartolini, A., Zhang, Z., & Dimitris Papadias, C. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.86 · Cited by 47
Learning users' interests by quality classification in market-based recommender systems
Wei, Y. Z., Moreau, L., & Jennings, N. R. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.200 · Cited by 35
Extending Recommender Systems for Disjoint User/Item Sets: The Conference Recommendation Problem
Hornick, M. F., & Tamayo, P. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.90 · Cited by 34
QuaSE: Sequence Editing under Quantifiable Guidance
Liao, Y., Bing, L., Li, P., Shi, S., Lam, W. P., & Zhang, T. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1420 · Cited by 32
Cross-Space Affinity Learning with Its Application to Movie Recommendation
Tang, J., Qi, G.-J., Zhang, L., & Xu, C. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.87 · Cited by 28
Electronic health record analysis via deep Poisson factor models
Henao, R., Lu, J. T., Lucas, J. E., Ferranti, J. M., & Carin, L. (2016) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.5555/2946645.3053468 · Cited by 19
Recurrent Poisson Process Unit for Speech Recognition
Huang, H., Wang, H., & Mak, B. K.-W. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016538 · Cited by 16
Self-citationBidirectional Inference Networks:A Class of Deep Bayesian Networks for Health Profiling
Wang, H., Mao, C., He, H., Zhao, M., Jaakkola, T., & Katabi, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301766 · Cited by 13
Self-citation
Flagged first, then by citations
Research works printed but not linked: 78
- Anoop Korattikara Balan , Vivek Rathod , Kevin P. Murphy , and Max Welling . 2015 . Bayesian dark knowledge . In Proceedings of the NIPS. 3420--3428 . Anoop Korattikara Balan, Vivek Rathod, Kevin P. Murphy, and Max Welling. 2015. Bayesian dark knowledge. In Proceedings of the NIPS. 3420--3428.
- Yoshua Bengio , Li Yao , Guillaume Alain , and Pascal Vincent . 2013 . Generalized denoising auto-encoders as generative models . In Proceedings of the NIPS. 899--907 . Yoshua Bengio, Li Yao, Guillaume Alain, and Pascal Vincent. 2013. Generalized denoising auto-encoders as generative models. In Proceedings of the NIPS. 899--907.
- David Blei and John Lafferty . 2006 . Correlated topic models . In Proceedings of the NIPS. 147--154 . David Blei and John Lafferty. 2006. Correlated topic models. In Proceedings of the NIPS. 147--154.
- David M. Blei and John D . Lafferty . 2006 . Dynamic topic models. In Proceedings of the ICML. ACM , 113--120. David M. Blei and John D. Lafferty. 2006. Dynamic topic models. In Proceedings of the ICML. ACM, 113--120.
- Charles Blundell , Julien Cornebise , Koray Kavukcuoglu , and Daan Wierstra . 2015 . Weight uncertainty in neural network . In Proceedings of the ICML. 1613--1622 . Charles Blundell, Julien Cornebise, Koray Kavukcuoglu, and Daan Wierstra. 2015. Weight uncertainty in neural network. In Proceedings of the ICML. 1613--1622.
- Yuri Burda , Roger B. Grosse , and Ruslan Salakhutdinov . 2016 . Importance weighted autoencoders . In Proceedings of the ICLR. Yuri Burda, Roger B. Grosse, and Ruslan Salakhutdinov. 2016. Importance weighted autoencoders. In Proceedings of the ICLR.
- Minmin Chen , Kilian Q. Weinberger , Fei Sha , and Yoshua Bengio . 2014 . Marginalized denoising auto-encoders for nonlinear representations . In Proceedings of the ICML. 1476--1484 . Minmin Chen, Kilian Q. Weinberger, Fei Sha, and Yoshua Bengio. 2014. Marginalized denoising auto-encoders for nonlinear representations. In Proceedings of the ICML. 1476--1484.
- Minmin Chen , Zhixiang Eddie Xu , Kilian Q. Weinberger , and Fei Sha . 2012 . Marginalized denoising autoencoders for domain adaptation . In Proceedings of the ICML. Minmin Chen, Zhixiang Eddie Xu, Kilian Q. Weinberger, and Fei Sha. 2012. Marginalized denoising autoencoders for domain adaptation. In Proceedings of the ICML.
- Tianqi Chen , Emily B. Fox , and Carlos Guestrin . 2014 . Stochastic Gradient Hamiltonian Monte Carlo . In Proceedings of the ICML. 1683--1691 . Tianqi Chen, Emily B. Fox, and Carlos Guestrin. 2014. Stochastic Gradient Hamiltonian Monte Carlo. In Proceedings of the ICML. 1683--1691.
- Junyoung Chung , Kyle Kastner , Laurent Dinh , Kratarth Goel , Aaron C. Courville , and Yoshua Bengio . 2015 . A recurrent latent variable model for sequential data . In Proceedings of the NIPS. 2980--2988 . Junyoung Chung, Kyle Kastner, Laurent Dinh, Kratarth Goel, Aaron C. Courville, and Yoshua Bengio. 2015. A recurrent latent variable model for sequential data. In Proceedings of the NIPS. 2980--2988.
- Yulai Cong , Bo Chen , Hongwei Liu , and Mingyuan Zhou . 2017 . Deep latent dirichlet allocation with topic-layer-adaptive stochastic gradient riemannian MCMC . In Proceedings of the ICML. 864--873 . Yulai Cong, Bo Chen, Hongwei Liu, and Mingyuan Zhou. 2017. Deep latent dirichlet allocation with topic-layer-adaptive stochastic gradient riemannian MCMC. In Proceedings of the ICML. 864--873.
- Andreas Doerr , Christian Daniel , Martin Schiegg , Duy Nguyen-Tuong , Stefan Schaal , Marc Toussaint , and Sebastian Trimpe . 2018 . Probabilistic recurrent state-space models . In Proceedings of the ICML. 1279--1288 . Andreas Doerr, Christian Daniel, Martin Schiegg, Duy Nguyen-Tuong, Stefan Schaal, Marc Toussaint, and Sebastian Trimpe. 2018. Probabilistic recurrent state-space models. In Proceedings of the ICML. 1279--1288.
- S. M. Ali Eslami , Nicolas Heess , Theophane Weber , Yuval Tassa , David Szepesvari , Koray Kavukcuoglu , and Geoffrey E . Hinton . 2016 . Attend, infer, repeat: Fast scene understanding with generative models. In Proceedings of the NIPS. 3225--3233. S. M. Ali Eslami, Nicolas Heess, Theophane Weber, Yuval Tassa, David Szepesvari, Koray Kavukcuoglu, and Geoffrey E. Hinton. 2016. Attend, infer, repeat: Fast scene understanding with generative models. In Proceedings of the NIPS. 3225--3233.
- Yarin Gal and Zoubin Ghahramani . 2015 . Dropout as a Bayesian approximation: Insights and applications . In Proceedings of the ICML. Yarin Gal and Zoubin Ghahramani. 2015. Dropout as a Bayesian approximation: Insights and applications. In Proceedings of the ICML.
- Zhe Gan , Changyou Chen , Ricardo Henao , David E. Carlson , and Lawrence Carin . 2015 . Scalable deep Poisson factor analysis for topic modeling . In Proceedings of the ICML. 1823--1832 . Zhe Gan, Changyou Chen, Ricardo Henao, David E. Carlson, and Lawrence Carin. 2015. Scalable deep Poisson factor analysis for topic modeling. In Proceedings of the ICML. 1823--1832.
- Zhe Gan , Ricardo Henao , David E. Carlson , and Lawrence Carin . 2015 . Learning deep sigmoid belief networks with data augmentation . In Proceedings of the AISTATS. Zhe Gan, Ricardo Henao, David E. Carlson, and Lawrence Carin. 2015. Learning deep sigmoid belief networks with data augmentation. In Proceedings of the AISTATS.
- Jan Gasthaus , Konstantinos Benidis , Yuyang Wang , Syama Sundar Rangapuram , David Salinas , Valentin Flunkert , and Tim Januschowski . 2019 . Probabilistic forecasting with spline quantile function RNNs . In Proceedings of the AISTATS. 1901--1910 . Jan Gasthaus, Konstantinos Benidis, Yuyang Wang, Syama Sundar Rangapuram, David Salinas, Valentin Flunkert, and Tim Januschowski. 2019. Probabilistic forecasting with spline quantile function RNNs. In Proceedings of the AISTATS. 1901--1910.
- Kostadin Georgiev and Preslav Nakov . 2013 . A non-IID framework for collaborative filtering with restricted Boltzmann machines . In Proceedings of the ICML. 1148--1156 . Kostadin Georgiev and Preslav Nakov. 2013. A non-IID framework for collaborative filtering with restricted Boltzmann machines. In Proceedings of the ICML. 1148--1156.
- Ian Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014 . Generative adversarial nets . In Proceedings of the NIPS. 2672--2680 . Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Proceedings of the NIPS. 2672--2680.
- Alex Graves . 2011 . Practical variational inference for neural networks . In Proceedings of the NIPS. 2348--2356 . Alex Graves. 2011. Practical variational inference for neural networks. In Proceedings of the NIPS. 2348--2356.
- Aditya Grover , Aaron Zweig , and Stefano Ermon . 2019 . Graphite: Iterative generative modeling of graphs . In Proceedings of the ICML. 2434--2444 . Aditya Grover, Aaron Zweig, and Stefano Ermon. 2019. Graphite: Iterative generative modeling of graphs. In Proceedings of the ICML. 2434--2444.
- Danijar Hafner , Timothy P. Lillicrap , Ian Fischer , Ruben Villegas , David Ha , Honglak Lee , and James Davidson . 2019 . Learning latent dynamics for planning from pixels . In Proceedings of the ICML. 2555--2565 . Danijar Hafner, Timothy P. Lillicrap, Ian Fischer, Ruben Villegas, David Ha, Honglak Lee, and James Davidson. 2019. Learning latent dynamics for planning from pixels. In Proceedings of the ICML. 2555--2565.
- Jeff Harrison and Mike West . 1999. Bayesian Forecasting 8 Dynamic Models . Springer . Jeff Harrison and Mike West. 1999. Bayesian Forecasting 8 Dynamic Models. Springer.
- Andrew C. Harvey . 1990. Forecasting , Structural Time Series Models and the Kalman Filter . Cambridge University Press . Andrew C. Harvey. 1990. Forecasting, Structural Time Series Models and the Kalman Filter. Cambridge University Press.
- Hao He , Hao Wang , Guang-He Lee , and Yonglong Tian . 2019 . ProbGAN: Towards probabilistic GAN with theoretical guarantees . In Proceedings of the ICLR. Hao He, Hao Wang, Guang-He Lee, and Yonglong Tian. 2019. ProbGAN: Towards probabilistic GAN with theoretical guarantees. In Proceedings of the ICLR.
- José Miguel Hernández-Lobato and Ryan Adams . 2015 . Probabilistic backpropagation for scalable learning of Bayesian neural networks . In Proceedings of the ICML. 1861--1869 . José Miguel Hernández-Lobato and Ryan Adams. 2015. Probabilistic backpropagation for scalable learning of Bayesian neural networks. In Proceedings of the ICML. 1861--1869.
- Geoffrey E. Hinton and Richard S . Zemel . 1994 . Autoencoders, minimum description length, and Helmholtz free energy. In Proceedings of the NIPS. 3--10. Geoffrey E. Hinton and Richard S. Zemel. 1994. Autoencoders, minimum description length, and Helmholtz free energy. In Proceedings of the NIPS. 3--10.
- Matthew Hoffman , Francis R. Bach , and David M . Blei . 2010 . Online learning for latent Dirichlet allocation. In Proceedings of the NIPS. 856--864. Matthew Hoffman, Francis R. Bach, and David M. Blei. 2010. Online learning for latent Dirichlet allocation. In Proceedings of the NIPS. 856--864.
- Wei-Ning Hsu and James R . Glass . 2018 . Scalable factorized hierarchical variational autoencoder training. In Proceedings of the INTERSPEECH. 1462--1466. Wei-Ning Hsu and James R. Glass. 2018. Scalable factorized hierarchical variational autoencoder training. In Proceedings of the INTERSPEECH. 1462--1466.
- Wei-Ning Hsu , Yu Zhang , and James R. Glass . 2017. Unsupervised learning of disentangled and interpretable representations from sequential data . In Proceedings of the NIPS. 1878--1889 . Wei-Ning Hsu, Yu Zhang, and James R. Glass. 2017. Unsupervised learning of disentangled and interpretable representations from sequential data. In Proceedings of the NIPS. 1878--1889.
- Wei-Ning Hsu , Yu Zhang , Ron J. Weiss , Heiga Zen , Yonghui Wu , Yuxuan Wang , Yuan Cao , Ye Jia , Zhifeng Chen , Jonathan Shen , Patrick Nguyen , and Ruoming Pang . 2019 . Hierarchical generative modeling for controllable speech synthesis . In Proceedings of the ICLR. Wei-Ning Hsu, Yu Zhang, Ron J. Weiss, Heiga Zen, Yonghui Wu, Yuxuan Wang, Yuan Cao, Ye Jia, Zhifeng Chen, Jonathan Shen, Patrick Nguyen, and Ruoming Pang. 2019. Hierarchical generative modeling for controllable speech synthesis. In Proceedings of the ICLR.
- Hengguan Huang , Fuzhao Xue , Hao Wang , and Ye Wang . 2020 . Deep graph random process for relational-thinking-based speech recognition . In Proceedings of the ICML. Hengguan Huang, Fuzhao Xue, Hao Wang, and Ye Wang. 2020. Deep graph random process for relational-thinking-based speech recognition. In Proceedings of the ICML.
- Finn V. Jensen et al . 1996 . An Introduction to Bayesian Networks, Vol. 210 . UCL Press London . Finn V. Jensen et al. 1996. An Introduction to Bayesian Networks, Vol. 210. UCL Press London.
- Maximilian Karl , Maximilian Sölch , Justin Bayer , and Patrick van der Smagt. 2017. Deep variational Bayes filters: Unsupervised learning of state space models from raw data . In Proceedings of the ICLR. Maximilian Karl, Maximilian Sölch, Justin Bayer, and Patrick van der Smagt. 2017. Deep variational Bayes filters: Unsupervised learning of state space models from raw data. In Proceedings of the ICLR.
- Thomas N. Kipf and Max Welling . 2017 . Semi-supervised classification with graph convolutional networks. In Proceedings of the ICLR. Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the ICLR.
- Adam R. Kosiorek , Hyunjik Kim , Yee Whye Teh , and Ingmar Posner . 2018 . Sequential attend, infer, repeat: Generative modelling of moving objects . In Proceedings of the NIPS. 8615--8625 . Adam R. Kosiorek, Hyunjik Kim, Yee Whye Teh, and Ingmar Posner. 2018. Sequential attend, infer, repeat: Generative modelling of moving objects. In Proceedings of the NIPS. 8615--8625.
- Rahul G. Krishnan , Uri Shalit , and David A . Sontag . 2017 . Structured inference networks for nonlinear state space models. In Proceedings of the AAAI. 2101--2109. Rahul G. Krishnan, Uri Shalit, and David A. Sontag. 2017. Structured inference networks for nonlinear state space models. In Proceedings of the AAAI. 2101--2109.
- Alex Krizhevsky , Ilya Sutskever , and Geoffrey E . Hinton . 2012 . Imagenet classification with deep convolutional neural networks. In Proceedings of the NIPS. 1097--1105. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Proceedings of the NIPS. 1097--1105.
- Honglak Lee , Roger Grosse , Rajesh Ranganath , and Andrew Y . Ng . 2009 . Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proceedings of the ICML. 609--616. Honglak Lee, Roger Grosse, Rajesh Ranganath, and Andrew Y. Ng. 2009. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proceedings of the ICML. 609--616.
- Wu-Jun Li and Dit-Yan Yeung . 2009 . Relation regularized matrix factorization . In Proceedings of the IJCAI. Wu-Jun Li and Dit-Yan Yeung. 2009. Relation regularized matrix factorization. In Proceedings of the IJCAI.
- Zhongqi Lu , Zhicheng Dou , Jianxun Lian , Xing Xie , and Qiang Yang . 2015 . Content-based collaborative filtering for news topic recommendation . In Proceedings of the AAAI. 217--223 . Zhongqi Lu, Zhicheng Dou, Jianxun Lian, Xing Xie, and Qiang Yang. 2015. Content-based collaborative filtering for news topic recommendation. In Proceedings of the AAAI. 217--223.
- Wesley J. Maddox , Pavel Izmailov , Timur Garipov , Dmitry P. Vetrov , and Andrew Gordon Wilson . 2019 . A simple baseline for Bayesian uncertainty in deep learning . In Proceedings of the NIPS. 13132--13143 . Wesley J. Maddox, Pavel Izmailov, Timur Garipov, Dmitry P. Vetrov, and Andrew Gordon Wilson. 2019. A simple baseline for Bayesian uncertainty in deep learning. In Proceedings of the NIPS. 13132--13143.
- Takamitsu Matsubara , Vicenc Gómez , and Hilbert J . Kappen . 2014 . Latent Kullback Leibler control for continuous-state systems using probabilistic graphical models. In Proceedings of the UAI. 583--592. Takamitsu Matsubara, Vicenc Gómez, and Hilbert J. Kappen. 2014. Latent Kullback Leibler control for continuous-state systems using probabilistic graphical models. In Proceedings of the UAI. 583--592.
- Nikhil Mehta , Lawrence Carin , and Piyush Rai . 2019 . Stochastic blockmodels meet graph neural networks . In Proceedings of the ICML. 4466--4474 . Nikhil Mehta, Lawrence Carin, and Piyush Rai. 2019. Stochastic blockmodels meet graph neural networks. In Proceedings of the ICML. 4466--4474.
- Abdel-rahman Mohamed, Tara N. Sainath , George E. Dahl , Bhuvana Ramabhadran , Geoffrey E. Hinton , and Michael A . Picheny . 2011 . Deep belief networks using discriminative features for phone recognition. In Proceedings of the ICASSP. 5060--5063. Abdel-rahman Mohamed, Tara N. Sainath, George E. Dahl, Bhuvana Ramabhadran, Geoffrey E. Hinton, and Michael A. Picheny. 2011. Deep belief networks using discriminative features for phone recognition. In Proceedings of the ICASSP. 5060--5063.
- Jonas Mueller , David K. Gifford , and Tommi S . Jaakkola . 2017 . Sequence to better sequence: Continuous revision of combinatorial structures. In Proceedings of the ICML. 2536--2544. Jonas Mueller, David K. Gifford, and Tommi S. Jaakkola. 2017. Sequence to better sequence: Continuous revision of combinatorial structures. In Proceedings of the ICML. 2536--2544.
- Takahiro Omi , Naonori Ueda , and Kazuyuki Aihara . 2019 . Fully neural network based model for general temporal point processes . In Proceedings of the NIPS. 2120--2129 . Takahiro Omi, Naonori Ueda, and Kazuyuki Aihara. 2019. Fully neural network based model for general temporal point processes. In Proceedings of the NIPS. 2120--2129.
- Aäron Van Den Oord , Sander Dieleman , and Benjamin Schrauwen . 2013 . Deep content-based music recommendation . In Proceedings of the NIPS. 2643--2651 . Aäron Van Den Oord, Sander Dieleman, and Benjamin Schrauwen. 2013. Deep content-based music recommendation. In Proceedings of the NIPS. 2643--2651.
- Christopher Poultney , Sumit Chopra , Yann L. Cun et al . 2006 . Efficient learning of sparse representations with an energy-based model. In Proceedings of the NIPS. 1137--1144. Christopher Poultney, Sumit Chopra, Yann L. Cun et al. 2006. Efficient learning of sparse representations with an energy-based model. In Proceedings of the NIPS. 1137--1144.
- Sanjay Purushotham , Yan Liu , and C.-C. Jay Kuo . 2012 . Collaborative topic regression with social matrix factorization for recommendation systems . In Proceedings of the ICML. 759--766 . Sanjay Purushotham, Yan Liu, and C.-C. Jay Kuo. 2012. Collaborative topic regression with social matrix factorization for recommendation systems. In Proceedings of the ICML. 759--766.
- Syama Sundar Rangapuram , Matthias W. Seeger , Jan Gasthaus , Lorenzo Stella , Yuyang Wang , and Tim Januschowski . 2018 . Deep state space models for time series forecasting . In Proceedings of the NIPS. 7796--7805 . Syama Sundar Rangapuram, Matthias W. Seeger, Jan Gasthaus, Lorenzo Stella, Yuyang Wang, and Tim Januschowski. 2018. Deep state space models for time series forecasting. In Proceedings of the NIPS. 7796--7805.
- Salah Rifai , Pascal Vincent , Xavier Muller , Xavier Glorot , and Yoshua Bengio . 2011 . Contractive auto-encoders: Explicit invariance during feature extraction . In Proceedings of the ICML. 833--840 . Salah Rifai, Pascal Vincent, Xavier Muller, Xavier Glorot, and Yoshua Bengio. 2011. Contractive auto-encoders: Explicit invariance during feature extraction. In Proceedings of the ICML. 833--840.
- Sheldon M. Ross , John J. Kelly , Roger J. Sullivan , William James Perry , Donald Mercer, Ruth M. Davis, Thomas Dell Washburn, Earl V. Sager, Joseph B. Boyce, and Vincent L. Bristow. 1996 . Stochastic Processes. Vol. 2 . Wiley , New York. Sheldon M. Ross, John J. Kelly, Roger J. Sullivan, William James Perry, Donald Mercer, Ruth M. Davis, Thomas Dell Washburn, Earl V. Sager, Joseph B. Boyce, and Vincent L. Bristow. 1996. Stochastic Processes. Vol. 2. Wiley, New York.
- Ruslan Salakhutdinov and Andriy Mnih . 2007 . Probabilistic matrix factorization . In Proceedings of the NIPS. 1257--1264 . Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic matrix factorization. In Proceedings of the NIPS. 1257--1264.
- Ruslan Salakhutdinov , Andriy Mnih , and Geoffrey E . Hinton . 2007 . Restricted Boltzmann machines for collaborative filtering. In Proceedings of the ICML. 791--798. Ruslan Salakhutdinov, Andriy Mnih, and Geoffrey E. Hinton. 2007. Restricted Boltzmann machines for collaborative filtering. In Proceedings of the ICML. 791--798.
- Oleksandr Shchur , Marin Bilos , and Stephan Günnemann . 2020 . Intensity-free learning of temporal point processes . In Proceedings of the ICLR. Oleksandr Shchur, Marin Bilos, and Stephan Günnemann. 2020. Intensity-free learning of temporal point processes. In Proceedings of the ICLR.
- Alexander Shekhovtsov and Boris Flach . 2019 . Feed-forward propagation in probabilistic neural networks with categorical and max layers . In Proceedings of the ICLR. Alexander Shekhovtsov and Boris Flach. 2019. Feed-forward propagation in probabilistic neural networks with categorical and max layers. In Proceedings of the ICLR.
- 10.5555/2627435.2670313 · DOI
- Nitish Srivastava and Russ R . Salakhutdinov . 2012 . Multimodal learning with deep Boltzmann machines. In Proceedings of the NIPS. 2222--2230. Nitish Srivastava and Russ R. Salakhutdinov. 2012. Multimodal learning with deep Boltzmann machines. In Proceedings of the NIPS. 2222--2230.
- Karl Stelzner , Robert Peharz , and Kristian Kersting . 2019 . Faster attend-infer-repeat with tractable probabilistic models . In Proceedings of the ICML. 5966--5975 . Karl Stelzner, Robert Peharz, and Kristian Kersting. 2019. Faster attend-infer-repeat with tractable probabilistic models. In Proceedings of the ICML. 5966--5975.
- Jiahao Su , Milan Cvitkovic , and Furong Huang . 2020 . Sampling-free learning of Bayesian quantized neural networks . In Proceedings of the ICLR. Jiahao Su, Milan Cvitkovic, and Furong Huang. 2020. Sampling-free learning of Bayesian quantized neural networks. In Proceedings of the ICLR.
- Ilya Sutskever , Oriol Vinyals , and Quoc V. V . Le . 2014 . Sequence to sequence learning with neural networks. In Proceedings of the NIPS. 3104--3112. Ilya Sutskever, Oriol Vinyals, and Quoc V. V. Le. 2014. Sequence to sequence learning with neural networks. In Proceedings of the NIPS. 3104--3112.
- Wesley Tansey , Yixin Wang , David M. Blei , and Raul Rabadan . 2018 . Black box FDR . In Proceedings of the ICML. 4874--4883 . Wesley Tansey, Yixin Wang, David M. Blei, and Raul Rabadan. 2018. Black box FDR. In Proceedings of the ICML. 4874--4883.
- Chong Wang and David M . Blei . 2011 . Collaborative topic modeling for recommending scientific articles. In Proceedings of the KDD. 448--456. Chong Wang and David M. Blei. 2011. Collaborative topic modeling for recommending scientific articles. In Proceedings of the KDD. 448--456.
- Chong Wang , David M. Blei , and David Heckerman . 2008 . Continuous time dynamic topic models . In Proceedings of the UAI. 579--586 . Chong Wang, David M. Blei, and David Heckerman. 2008. Continuous time dynamic topic models. In Proceedings of the UAI. 579--586.
- Hao Wang , Binyi Chen , and Wu-Jun Li . 2013 . Collaborative topic regression with social regularization for tag recommendation . In Proceedings of the IJCAI. 2719--2725 . Hao Wang, Binyi Chen, and Wu-Jun Li. 2013. Collaborative topic regression with social regularization for tag recommendation. In Proceedings of the IJCAI. 2719--2725.
- Hao Wang , Xingjian Shi , and Dit-Yan Yeung . 2015 . Relational stacked denoising autoencoder for tag recommendation . In Proceedings of the AAAI. 3052--3058 . Hao Wang, Xingjian Shi, and Dit-Yan Yeung. 2015. Relational stacked denoising autoencoder for tag recommendation. In Proceedings of the AAAI. 3052--3058.
- Hao Wang , Xingjian Shi , and Dit-Yan Yeung . 2016 . Natural-parameter networks: A class of probabilistic neural networks . In Proceedings of the NIPS. 118--126 . Hao Wang, Xingjian Shi, and Dit-Yan Yeung. 2016. Natural-parameter networks: A class of probabilistic neural networks. In Proceedings of the NIPS. 118--126.
- Hao Wang , Xingjian Shi , and Dit-Yan Yeung . 2017 . Relational deep learning: A deep latent variable model for link prediction . In Proceedings of the AAAI. 2688--2694 . Hao Wang, Xingjian Shi, and Dit-Yan Yeung. 2017. Relational deep learning: A deep latent variable model for link prediction. In Proceedings of the AAAI. 2688--2694.
- Hao Wang , Shi Xingjian , and Dit-Yan Yeung . 2016 . Collaborative recurrent autoencoder: Recommend while learning to fill in the blanks . In Proceedings of the NIPS. 415--423 . Hao Wang, Shi Xingjian, and Dit-Yan Yeung. 2016. Collaborative recurrent autoencoder: Recommend while learning to fill in the blanks. In Proceedings of the NIPS. 415--423.
- Yuyang Wang , Alex Smola , Danielle C. Maddix , Jan Gasthaus , Dean Foster , and Tim Januschowski . 2019 . Deep factors for forecasting . In Proceedings of the ICML. 6607--6617 . Yuyang Wang, Alex Smola, Danielle C. Maddix, Jan Gasthaus, Dean Foster, and Tim Januschowski. 2019. Deep factors for forecasting. In Proceedings of the ICML. 6607--6617.
- Manuel Watter , Jost Springenberg , Joschka Boedecker , and Martin Riedmiller . 2015 . Embed to control: A locally linear latent dynamics model for control from raw images . In Proceedings of the NIPS. 2728--2736 . Manuel Watter, Jost Springenberg, Joschka Boedecker, and Martin Riedmiller. 2015. Embed to control: A locally linear latent dynamics model for control from raw images. In Proceedings of the NIPS. 2728--2736.
- Max Welling and Yee Whye Teh . 2011 . Bayesian learning via stochastic gradient langevin dynamics . In Proceedings of the ICML. 681--688 . Max Welling and Yee Whye Teh. 2011. Bayesian learning via stochastic gradient langevin dynamics. In Proceedings of the ICML. 681--688.
- Andrew Gordon Wilson. 2020. The case for Bayesian deep learning. arXiv preprint arXiv:2001.10995. Andrew Gordon Wilson. 2020. The case for Bayesian deep learning. arXiv preprint arXiv:2001.10995. · arXiv
- Zichao Yang , Zhiting Hu , Ruslan Salakhutdinov , and Taylor Berg-Kirkpatrick . 2017 . Improved variational autoencoders for text modeling using dilated convolutions . In Proceedings of the ICML. 3881--3890 . Zichao Yang, Zhiting Hu, Ruslan Salakhutdinov, and Taylor Berg-Kirkpatrick. 2017. Improved variational autoencoders for text modeling using dilated convolutions. In Proceedings of the ICML. 3881--3890.
- He Zhao , Lan Du , Wray L. Buntine , and Mingyuan Zhou . 2018 . Dirichlet belief networks for topic structure learning . In Proceedings of the NIPS. 7966--7977 . He Zhao, Lan Du, Wray L. Buntine, and Mingyuan Zhou. 2018. Dirichlet belief networks for topic structure learning. In Proceedings of the NIPS. 7966--7977.
- Vincent Wenchen Zheng , Bin Cao , Yu Zheng , Xing Xie , and Qiang Yang . 2010 . Collaborative filtering meets mobile recommendation: A user-centered approach . In Proceedings of the AAAI. Vincent Wenchen Zheng, Bin Cao, Yu Zheng, Xing Xie, and Qiang Yang. 2010. Collaborative filtering meets mobile recommendation: A user-centered approach. In Proceedings of the AAAI.
- Mingyuan Zhou , Lauren Hannah , David B. Dunson , and Lawrence Carin . 2012 . Beta-negative binomial process and Poisson factor analysis . In Proceedings of the AISTATS. 1462--1471 . Mingyuan Zhou, Lauren Hannah, David B. Dunson, and Lawrence Carin. 2012. Beta-negative binomial process and Poisson factor analysis. In Proceedings of the AISTATS. 1462--1471.
Cited by
Sorted by citations
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
A survey of uncertainty in deep neural networks
Gawlikowski, J., Tassi, C. R. N., Ali, M., Lee, J., Humt, M., Feng, J., Kruspe, A., Triebel, R., Jung, P., Roscher, R., et al. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10562-9 · Cited by 1,670
Hands-On Bayesian Neural Networks—A Tutorial for Deep Learning Users
Jospin, L. V., Laga, H., Boussaid, F., Buntine, W., & Bennamoun, M. (2022) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2022.3155327 · Cited by 879
Unsupervised Machine Learning for Networking: Techniques, Applications and Research Challenges
Usama, M., Qadir, J., Raza, A., Arif, H., Yau, K. A., Elkhatib, Y., Hussain, A., & Al‐Fuqaha, A. (2019) · IEEE Access · doi:10.1109/access.2019.2916648 · Cited by 662
Khan, A. A., Chaudhari, O., & Chandra, R. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122778 · Cited by 677
Metadata
- Authors
- Wang, H., & Yeung, D.-Y.
- Affiliations
- Massachusetts Institute of Technology (US)
- Hong Kong University of Science and Technology (HK)
- Venue
- ACM Computing Surveys
- Published
- 2020-09-28
- Volume
- 53
- Issue
- 5
- Pages
- 1-37
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3089611792
- Cited by
- 247
- References
- 52
- Citations by year
- 2026: 23 · 2025: 54 · 2024: 50 · 2023: 37 · 2022: 43 · 2021: 28 · 2020: 6
- FWCI
- 11.20
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- Bayesian deep learning, uncertainty quantification, probabilistic graphical models, Bayesian neural networks, recommender systems, topic modeling, Bayesian control
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review