The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
A Survey on Bayesian Deep Learning
Open accessAbstract
A comprehensive artificial intelligence system needs to not only perceive the environment with different “senses” (e.g., seeing and hearing) but also infer the world’s conditional (or even causal) relations and corresponding uncertainty. The past decade has seen major advances in many perception tasks, such as visual object recognition and speech recognition, using deep learning models. For higher-level inference, however, probabilistic graphical models with their Bayesian nature are still more powerful and flexible. In recent years, Bayesian deep learning has emerged as a unified probabilistic framework to tightly integrate deep learning and Bayesian models. 1 In this general framework, the perception of text or images using deep learning can boost the performance of higher-level inference and, in turn, the feedback from the inference process is able to enhance the perception of text or images. This survey provides a comprehensive introduction to Bayesian deep learning and reviews its recent applications on recommender systems, topic models, control, and so on. We also discuss the relationship and differences between Bayesian deep learning and other related topics, such as Bayesian treatment of neural networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“However, these algorithms still lack capabilities such as reasoning [129] or modelling the uncertainty between the input data and the predictions made [130].”
From A survey on deep learning-based monocular spacecraft pose estimation: Current state, limitations and prospects (2023) · cites this paper as [130]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
(2016) · Cited by 11,679
(2012) · Cited by 9,062
Pattern Recognition and Machine Learning
(2007) · Kybernetes · doi:10.1108/03684920710743466 · Cited by 8,545
Receptive fields and functional architecture of monkey striate cortex
Hubel, D. H., & Wiesel, T. N. (1968) · The Journal of Physiology · doi:10.1113/jphysiol.1968.sp008455 · Cited by 6,685
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 10×
“The energy function leads to the following conditional distributions: RBM is trained using ‘Contrastive Divergence’ [40] rather than BP.”
Influential
Flagged first, then by citations
Research works printed but not linked: 78
- Anoop Korattikara Balan , Vivek Rathod , Kevin P. Murphy , and Max Welling . 2015 . Bayesian dark knowledge . In Proceedings of the NIPS. 3420--3428 . Anoop Korattikara Balan, Vivek Rathod, Kevin P. Murphy, and Max Welling. 2015. Bayesian dark knowledge. In Proceedings of the NIPS. 3420--3428.
- Yoshua Bengio , Li Yao , Guillaume Alain , and Pascal Vincent . 2013 . Generalized denoising auto-encoders as generative models . In Proceedings of the NIPS. 899--907 . Yoshua Bengio, Li Yao, Guillaume Alain, and Pascal Vincent. 2013. Generalized denoising auto-encoders as generative models. In Proceedings of the NIPS. 899--907.
- David Blei and John Lafferty . 2006 . Correlated topic models . In Proceedings of the NIPS. 147--154 . David Blei and John Lafferty. 2006. Correlated topic models. In Proceedings of the NIPS. 147--154.
- David M. Blei and John D . Lafferty . 2006 . Dynamic topic models. In Proceedings of the ICML. ACM , 113--120. David M. Blei and John D. Lafferty. 2006. Dynamic topic models. In Proceedings of the ICML. ACM, 113--120.
- Charles Blundell , Julien Cornebise , Koray Kavukcuoglu , and Daan Wierstra . 2015 . Weight uncertainty in neural network . In Proceedings of the ICML. 1613--1622 . Charles Blundell, Julien Cornebise, Koray Kavukcuoglu, and Daan Wierstra. 2015. Weight uncertainty in neural network. In Proceedings of the ICML. 1613--1622.
- Yuri Burda , Roger B. Grosse , and Ruslan Salakhutdinov . 2016 . Importance weighted autoencoders . In Proceedings of the ICLR. Yuri Burda, Roger B. Grosse, and Ruslan Salakhutdinov. 2016. Importance weighted autoencoders. In Proceedings of the ICLR.
- Minmin Chen , Kilian Q. Weinberger , Fei Sha , and Yoshua Bengio . 2014 . Marginalized denoising auto-encoders for nonlinear representations . In Proceedings of the ICML. 1476--1484 . Minmin Chen, Kilian Q. Weinberger, Fei Sha, and Yoshua Bengio. 2014. Marginalized denoising auto-encoders for nonlinear representations. In Proceedings of the ICML. 1476--1484.
- Minmin Chen , Zhixiang Eddie Xu , Kilian Q. Weinberger , and Fei Sha . 2012 . Marginalized denoising autoencoders for domain adaptation . In Proceedings of the ICML. Minmin Chen, Zhixiang Eddie Xu, Kilian Q. Weinberger, and Fei Sha. 2012. Marginalized denoising autoencoders for domain adaptation. In Proceedings of the ICML.
- Tianqi Chen , Emily B. Fox , and Carlos Guestrin . 2014 . Stochastic Gradient Hamiltonian Monte Carlo . In Proceedings of the ICML. 1683--1691 . Tianqi Chen, Emily B. Fox, and Carlos Guestrin. 2014. Stochastic Gradient Hamiltonian Monte Carlo. In Proceedings of the ICML. 1683--1691.
- Junyoung Chung , Kyle Kastner , Laurent Dinh , Kratarth Goel , Aaron C. Courville , and Yoshua Bengio . 2015 . A recurrent latent variable model for sequential data . In Proceedings of the NIPS. 2980--2988 . Junyoung Chung, Kyle Kastner, Laurent Dinh, Kratarth Goel, Aaron C. Courville, and Yoshua Bengio. 2015. A recurrent latent variable model for sequential data. In Proceedings of the NIPS. 2980--2988.
- Yulai Cong , Bo Chen , Hongwei Liu , and Mingyuan Zhou . 2017 . Deep latent dirichlet allocation with topic-layer-adaptive stochastic gradient riemannian MCMC . In Proceedings of the ICML. 864--873 . Yulai Cong, Bo Chen, Hongwei Liu, and Mingyuan Zhou. 2017. Deep latent dirichlet allocation with topic-layer-adaptive stochastic gradient riemannian MCMC. In Proceedings of the ICML. 864--873.
- Andreas Doerr , Christian Daniel , Martin Schiegg , Duy Nguyen-Tuong , Stefan Schaal , Marc Toussaint , and Sebastian Trimpe . 2018 . Probabilistic recurrent state-space models . In Proceedings of the ICML. 1279--1288 . Andreas Doerr, Christian Daniel, Martin Schiegg, Duy Nguyen-Tuong, Stefan Schaal, Marc Toussaint, and Sebastian Trimpe. 2018. Probabilistic recurrent state-space models. In Proceedings of the ICML. 1279--1288.
- S. M. Ali Eslami , Nicolas Heess , Theophane Weber , Yuval Tassa , David Szepesvari , Koray Kavukcuoglu , and Geoffrey E . Hinton . 2016 . Attend, infer, repeat: Fast scene understanding with generative models. In Proceedings of the NIPS. 3225--3233. S. M. Ali Eslami, Nicolas Heess, Theophane Weber, Yuval Tassa, David Szepesvari, Koray Kavukcuoglu, and Geoffrey E. Hinton. 2016. Attend, infer, repeat: Fast scene understanding with generative models. In Proceedings of the NIPS. 3225--3233.
- Yarin Gal and Zoubin Ghahramani . 2015 . Dropout as a Bayesian approximation: Insights and applications . In Proceedings of the ICML. Yarin Gal and Zoubin Ghahramani. 2015. Dropout as a Bayesian approximation: Insights and applications. In Proceedings of the ICML.
- Zhe Gan , Changyou Chen , Ricardo Henao , David E. Carlson , and Lawrence Carin . 2015 . Scalable deep Poisson factor analysis for topic modeling . In Proceedings of the ICML. 1823--1832 . Zhe Gan, Changyou Chen, Ricardo Henao, David E. Carlson, and Lawrence Carin. 2015. Scalable deep Poisson factor analysis for topic modeling. In Proceedings of the ICML. 1823--1832.
- Zhe Gan , Ricardo Henao , David E. Carlson , and Lawrence Carin . 2015 . Learning deep sigmoid belief networks with data augmentation . In Proceedings of the AISTATS. Zhe Gan, Ricardo Henao, David E. Carlson, and Lawrence Carin. 2015. Learning deep sigmoid belief networks with data augmentation. In Proceedings of the AISTATS.
- Jan Gasthaus , Konstantinos Benidis , Yuyang Wang , Syama Sundar Rangapuram , David Salinas , Valentin Flunkert , and Tim Januschowski . 2019 . Probabilistic forecasting with spline quantile function RNNs . In Proceedings of the AISTATS. 1901--1910 . Jan Gasthaus, Konstantinos Benidis, Yuyang Wang, Syama Sundar Rangapuram, David Salinas, Valentin Flunkert, and Tim Januschowski. 2019. Probabilistic forecasting with spline quantile function RNNs. In Proceedings of the AISTATS. 1901--1910.
- Kostadin Georgiev and Preslav Nakov . 2013 . A non-IID framework for collaborative filtering with restricted Boltzmann machines . In Proceedings of the ICML. 1148--1156 . Kostadin Georgiev and Preslav Nakov. 2013. A non-IID framework for collaborative filtering with restricted Boltzmann machines. In Proceedings of the ICML. 1148--1156.
- Ian Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014 . Generative adversarial nets . In Proceedings of the NIPS. 2672--2680 . Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Proceedings of the NIPS. 2672--2680.
- Alex Graves . 2011 . Practical variational inference for neural networks . In Proceedings of the NIPS. 2348--2356 . Alex Graves. 2011. Practical variational inference for neural networks. In Proceedings of the NIPS. 2348--2356.
- Aditya Grover , Aaron Zweig , and Stefano Ermon . 2019 . Graphite: Iterative generative modeling of graphs . In Proceedings of the ICML. 2434--2444 . Aditya Grover, Aaron Zweig, and Stefano Ermon. 2019. Graphite: Iterative generative modeling of graphs. In Proceedings of the ICML. 2434--2444.
- Danijar Hafner , Timothy P. Lillicrap , Ian Fischer , Ruben Villegas , David Ha , Honglak Lee , and James Davidson . 2019 . Learning latent dynamics for planning from pixels . In Proceedings of the ICML. 2555--2565 . Danijar Hafner, Timothy P. Lillicrap, Ian Fischer, Ruben Villegas, David Ha, Honglak Lee, and James Davidson. 2019. Learning latent dynamics for planning from pixels. In Proceedings of the ICML. 2555--2565.
- Jeff Harrison and Mike West . 1999. Bayesian Forecasting 8 Dynamic Models . Springer . Jeff Harrison and Mike West. 1999. Bayesian Forecasting 8 Dynamic Models. Springer.
- Andrew C. Harvey . 1990. Forecasting , Structural Time Series Models and the Kalman Filter . Cambridge University Press . Andrew C. Harvey. 1990. Forecasting, Structural Time Series Models and the Kalman Filter. Cambridge University Press.
- Hao He , Hao Wang , Guang-He Lee , and Yonglong Tian . 2019 . ProbGAN: Towards probabilistic GAN with theoretical guarantees . In Proceedings of the ICLR. Hao He, Hao Wang, Guang-He Lee, and Yonglong Tian. 2019. ProbGAN: Towards probabilistic GAN with theoretical guarantees. In Proceedings of the ICLR.
- José Miguel Hernández-Lobato and Ryan Adams . 2015 . Probabilistic backpropagation for scalable learning of Bayesian neural networks . In Proceedings of the ICML. 1861--1869 . José Miguel Hernández-Lobato and Ryan Adams. 2015. Probabilistic backpropagation for scalable learning of Bayesian neural networks. In Proceedings of the ICML. 1861--1869.
- Geoffrey E. Hinton and Richard S . Zemel . 1994 . Autoencoders, minimum description length, and Helmholtz free energy. In Proceedings of the NIPS. 3--10. Geoffrey E. Hinton and Richard S. Zemel. 1994. Autoencoders, minimum description length, and Helmholtz free energy. In Proceedings of the NIPS. 3--10.
- Matthew Hoffman , Francis R. Bach , and David M . Blei . 2010 . Online learning for latent Dirichlet allocation. In Proceedings of the NIPS. 856--864. Matthew Hoffman, Francis R. Bach, and David M. Blei. 2010. Online learning for latent Dirichlet allocation. In Proceedings of the NIPS. 856--864.
- Wei-Ning Hsu and James R . Glass . 2018 . Scalable factorized hierarchical variational autoencoder training. In Proceedings of the INTERSPEECH. 1462--1466. Wei-Ning Hsu and James R. Glass. 2018. Scalable factorized hierarchical variational autoencoder training. In Proceedings of the INTERSPEECH. 1462--1466.
- Wei-Ning Hsu , Yu Zhang , and James R. Glass . 2017. Unsupervised learning of disentangled and interpretable representations from sequential data . In Proceedings of the NIPS. 1878--1889 . Wei-Ning Hsu, Yu Zhang, and James R. Glass. 2017. Unsupervised learning of disentangled and interpretable representations from sequential data. In Proceedings of the NIPS. 1878--1889.
- Wei-Ning Hsu , Yu Zhang , Ron J. Weiss , Heiga Zen , Yonghui Wu , Yuxuan Wang , Yuan Cao , Ye Jia , Zhifeng Chen , Jonathan Shen , Patrick Nguyen , and Ruoming Pang . 2019 . Hierarchical generative modeling for controllable speech synthesis . In Proceedings of the ICLR. Wei-Ning Hsu, Yu Zhang, Ron J. Weiss, Heiga Zen, Yonghui Wu, Yuxuan Wang, Yuan Cao, Ye Jia, Zhifeng Chen, Jonathan Shen, Patrick Nguyen, and Ruoming Pang. 2019. Hierarchical generative modeling for controllable speech synthesis. In Proceedings of the ICLR.
- Hengguan Huang , Fuzhao Xue , Hao Wang , and Ye Wang . 2020 . Deep graph random process for relational-thinking-based speech recognition . In Proceedings of the ICML. Hengguan Huang, Fuzhao Xue, Hao Wang, and Ye Wang. 2020. Deep graph random process for relational-thinking-based speech recognition. In Proceedings of the ICML.
- Finn V. Jensen et al . 1996 . An Introduction to Bayesian Networks, Vol. 210 . UCL Press London . Finn V. Jensen et al. 1996. An Introduction to Bayesian Networks, Vol. 210. UCL Press London.
- Maximilian Karl , Maximilian Sölch , Justin Bayer , and Patrick van der Smagt. 2017. Deep variational Bayes filters: Unsupervised learning of state space models from raw data . In Proceedings of the ICLR. Maximilian Karl, Maximilian Sölch, Justin Bayer, and Patrick van der Smagt. 2017. Deep variational Bayes filters: Unsupervised learning of state space models from raw data. In Proceedings of the ICLR.
- Thomas N. Kipf and Max Welling . 2017 . Semi-supervised classification with graph convolutional networks. In Proceedings of the ICLR. Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the ICLR.
- Adam R. Kosiorek , Hyunjik Kim , Yee Whye Teh , and Ingmar Posner . 2018 . Sequential attend, infer, repeat: Generative modelling of moving objects . In Proceedings of the NIPS. 8615--8625 . Adam R. Kosiorek, Hyunjik Kim, Yee Whye Teh, and Ingmar Posner. 2018. Sequential attend, infer, repeat: Generative modelling of moving objects. In Proceedings of the NIPS. 8615--8625.
- Rahul G. Krishnan , Uri Shalit , and David A . Sontag . 2017 . Structured inference networks for nonlinear state space models. In Proceedings of the AAAI. 2101--2109. Rahul G. Krishnan, Uri Shalit, and David A. Sontag. 2017. Structured inference networks for nonlinear state space models. In Proceedings of the AAAI. 2101--2109.
- Alex Krizhevsky , Ilya Sutskever , and Geoffrey E . Hinton . 2012 . Imagenet classification with deep convolutional neural networks. In Proceedings of the NIPS. 1097--1105. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Proceedings of the NIPS. 1097--1105.
- Honglak Lee , Roger Grosse , Rajesh Ranganath , and Andrew Y . Ng . 2009 . Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proceedings of the ICML. 609--616. Honglak Lee, Roger Grosse, Rajesh Ranganath, and Andrew Y. Ng. 2009. Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proceedings of the ICML. 609--616.
- Wu-Jun Li and Dit-Yan Yeung . 2009 . Relation regularized matrix factorization . In Proceedings of the IJCAI. Wu-Jun Li and Dit-Yan Yeung. 2009. Relation regularized matrix factorization. In Proceedings of the IJCAI.
- Zhongqi Lu , Zhicheng Dou , Jianxun Lian , Xing Xie , and Qiang Yang . 2015 . Content-based collaborative filtering for news topic recommendation . In Proceedings of the AAAI. 217--223 . Zhongqi Lu, Zhicheng Dou, Jianxun Lian, Xing Xie, and Qiang Yang. 2015. Content-based collaborative filtering for news topic recommendation. In Proceedings of the AAAI. 217--223.
- Wesley J. Maddox , Pavel Izmailov , Timur Garipov , Dmitry P. Vetrov , and Andrew Gordon Wilson . 2019 . A simple baseline for Bayesian uncertainty in deep learning . In Proceedings of the NIPS. 13132--13143 . Wesley J. Maddox, Pavel Izmailov, Timur Garipov, Dmitry P. Vetrov, and Andrew Gordon Wilson. 2019. A simple baseline for Bayesian uncertainty in deep learning. In Proceedings of the NIPS. 13132--13143.
- Takamitsu Matsubara , Vicenc Gómez , and Hilbert J . Kappen . 2014 . Latent Kullback Leibler control for continuous-state systems using probabilistic graphical models. In Proceedings of the UAI. 583--592. Takamitsu Matsubara, Vicenc Gómez, and Hilbert J. Kappen. 2014. Latent Kullback Leibler control for continuous-state systems using probabilistic graphical models. In Proceedings of the UAI. 583--592.
- Nikhil Mehta , Lawrence Carin , and Piyush Rai . 2019 . Stochastic blockmodels meet graph neural networks . In Proceedings of the ICML. 4466--4474 . Nikhil Mehta, Lawrence Carin, and Piyush Rai. 2019. Stochastic blockmodels meet graph neural networks. In Proceedings of the ICML. 4466--4474.
- Abdel-rahman Mohamed, Tara N. Sainath , George E. Dahl , Bhuvana Ramabhadran , Geoffrey E. Hinton , and Michael A . Picheny . 2011 . Deep belief networks using discriminative features for phone recognition. In Proceedings of the ICASSP. 5060--5063. Abdel-rahman Mohamed, Tara N. Sainath, George E. Dahl, Bhuvana Ramabhadran, Geoffrey E. Hinton, and Michael A. Picheny. 2011. Deep belief networks using discriminative features for phone recognition. In Proceedings of the ICASSP. 5060--5063.
- Jonas Mueller , David K. Gifford , and Tommi S . Jaakkola . 2017 . Sequence to better sequence: Continuous revision of combinatorial structures. In Proceedings of the ICML. 2536--2544. Jonas Mueller, David K. Gifford, and Tommi S. Jaakkola. 2017. Sequence to better sequence: Continuous revision of combinatorial structures. In Proceedings of the ICML. 2536--2544.
- Takahiro Omi , Naonori Ueda , and Kazuyuki Aihara . 2019 . Fully neural network based model for general temporal point processes . In Proceedings of the NIPS. 2120--2129 . Takahiro Omi, Naonori Ueda, and Kazuyuki Aihara. 2019. Fully neural network based model for general temporal point processes. In Proceedings of the NIPS. 2120--2129.
- Aäron Van Den Oord , Sander Dieleman , and Benjamin Schrauwen . 2013 . Deep content-based music recommendation . In Proceedings of the NIPS. 2643--2651 . Aäron Van Den Oord, Sander Dieleman, and Benjamin Schrauwen. 2013. Deep content-based music recommendation. In Proceedings of the NIPS. 2643--2651.
- Christopher Poultney , Sumit Chopra , Yann L. Cun et al . 2006 . Efficient learning of sparse representations with an energy-based model. In Proceedings of the NIPS. 1137--1144. Christopher Poultney, Sumit Chopra, Yann L. Cun et al. 2006. Efficient learning of sparse representations with an energy-based model. In Proceedings of the NIPS. 1137--1144.
- Sanjay Purushotham , Yan Liu , and C.-C. Jay Kuo . 2012 . Collaborative topic regression with social matrix factorization for recommendation systems . In Proceedings of the ICML. 759--766 . Sanjay Purushotham, Yan Liu, and C.-C. Jay Kuo. 2012. Collaborative topic regression with social matrix factorization for recommendation systems. In Proceedings of the ICML. 759--766.
- Syama Sundar Rangapuram , Matthias W. Seeger , Jan Gasthaus , Lorenzo Stella , Yuyang Wang , and Tim Januschowski . 2018 . Deep state space models for time series forecasting . In Proceedings of the NIPS. 7796--7805 . Syama Sundar Rangapuram, Matthias W. Seeger, Jan Gasthaus, Lorenzo Stella, Yuyang Wang, and Tim Januschowski. 2018. Deep state space models for time series forecasting. In Proceedings of the NIPS. 7796--7805.
- Salah Rifai , Pascal Vincent , Xavier Muller , Xavier Glorot , and Yoshua Bengio . 2011 . Contractive auto-encoders: Explicit invariance during feature extraction . In Proceedings of the ICML. 833--840 . Salah Rifai, Pascal Vincent, Xavier Muller, Xavier Glorot, and Yoshua Bengio. 2011. Contractive auto-encoders: Explicit invariance during feature extraction. In Proceedings of the ICML. 833--840.
- Sheldon M. Ross , John J. Kelly , Roger J. Sullivan , William James Perry , Donald Mercer, Ruth M. Davis, Thomas Dell Washburn, Earl V. Sager, Joseph B. Boyce, and Vincent L. Bristow. 1996 . Stochastic Processes. Vol. 2 . Wiley , New York. Sheldon M. Ross, John J. Kelly, Roger J. Sullivan, William James Perry, Donald Mercer, Ruth M. Davis, Thomas Dell Washburn, Earl V. Sager, Joseph B. Boyce, and Vincent L. Bristow. 1996. Stochastic Processes. Vol. 2. Wiley, New York.
- Ruslan Salakhutdinov and Andriy Mnih . 2007 . Probabilistic matrix factorization . In Proceedings of the NIPS. 1257--1264 . Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic matrix factorization. In Proceedings of the NIPS. 1257--1264.
- Ruslan Salakhutdinov , Andriy Mnih , and Geoffrey E . Hinton . 2007 . Restricted Boltzmann machines for collaborative filtering. In Proceedings of the ICML. 791--798. Ruslan Salakhutdinov, Andriy Mnih, and Geoffrey E. Hinton. 2007. Restricted Boltzmann machines for collaborative filtering. In Proceedings of the ICML. 791--798.
- Oleksandr Shchur , Marin Bilos , and Stephan Günnemann . 2020 . Intensity-free learning of temporal point processes . In Proceedings of the ICLR. Oleksandr Shchur, Marin Bilos, and Stephan Günnemann. 2020. Intensity-free learning of temporal point processes. In Proceedings of the ICLR.
- Alexander Shekhovtsov and Boris Flach . 2019 . Feed-forward propagation in probabilistic neural networks with categorical and max layers . In Proceedings of the ICLR. Alexander Shekhovtsov and Boris Flach. 2019. Feed-forward propagation in probabilistic neural networks with categorical and max layers. In Proceedings of the ICLR.
- 10.5555/2627435.2670313 · DOI
- Nitish Srivastava and Russ R . Salakhutdinov . 2012 . Multimodal learning with deep Boltzmann machines. In Proceedings of the NIPS. 2222--2230. Nitish Srivastava and Russ R. Salakhutdinov. 2012. Multimodal learning with deep Boltzmann machines. In Proceedings of the NIPS. 2222--2230.
- Karl Stelzner , Robert Peharz , and Kristian Kersting . 2019 . Faster attend-infer-repeat with tractable probabilistic models . In Proceedings of the ICML. 5966--5975 . Karl Stelzner, Robert Peharz, and Kristian Kersting. 2019. Faster attend-infer-repeat with tractable probabilistic models. In Proceedings of the ICML. 5966--5975.
- Jiahao Su , Milan Cvitkovic , and Furong Huang . 2020 . Sampling-free learning of Bayesian quantized neural networks . In Proceedings of the ICLR. Jiahao Su, Milan Cvitkovic, and Furong Huang. 2020. Sampling-free learning of Bayesian quantized neural networks. In Proceedings of the ICLR.
- Ilya Sutskever , Oriol Vinyals , and Quoc V. V . Le . 2014 . Sequence to sequence learning with neural networks. In Proceedings of the NIPS. 3104--3112. Ilya Sutskever, Oriol Vinyals, and Quoc V. V. Le. 2014. Sequence to sequence learning with neural networks. In Proceedings of the NIPS. 3104--3112.
- Wesley Tansey , Yixin Wang , David M. Blei , and Raul Rabadan . 2018 . Black box FDR . In Proceedings of the ICML. 4874--4883 . Wesley Tansey, Yixin Wang, David M. Blei, and Raul Rabadan. 2018. Black box FDR. In Proceedings of the ICML. 4874--4883.
- Chong Wang and David M . Blei . 2011 . Collaborative topic modeling for recommending scientific articles. In Proceedings of the KDD. 448--456. Chong Wang and David M. Blei. 2011. Collaborative topic modeling for recommending scientific articles. In Proceedings of the KDD. 448--456.
- Chong Wang , David M. Blei , and David Heckerman . 2008 . Continuous time dynamic topic models . In Proceedings of the UAI. 579--586 . Chong Wang, David M. Blei, and David Heckerman. 2008. Continuous time dynamic topic models. In Proceedings of the UAI. 579--586.
- Hao Wang , Binyi Chen , and Wu-Jun Li . 2013 . Collaborative topic regression with social regularization for tag recommendation . In Proceedings of the IJCAI. 2719--2725 . Hao Wang, Binyi Chen, and Wu-Jun Li. 2013. Collaborative topic regression with social regularization for tag recommendation. In Proceedings of the IJCAI. 2719--2725.
- Hao Wang , Xingjian Shi , and Dit-Yan Yeung . 2015 . Relational stacked denoising autoencoder for tag recommendation . In Proceedings of the AAAI. 3052--3058 . Hao Wang, Xingjian Shi, and Dit-Yan Yeung. 2015. Relational stacked denoising autoencoder for tag recommendation. In Proceedings of the AAAI. 3052--3058.
- Hao Wang , Xingjian Shi , and Dit-Yan Yeung . 2016 . Natural-parameter networks: A class of probabilistic neural networks . In Proceedings of the NIPS. 118--126 . Hao Wang, Xingjian Shi, and Dit-Yan Yeung. 2016. Natural-parameter networks: A class of probabilistic neural networks. In Proceedings of the NIPS. 118--126.
- Hao Wang , Xingjian Shi , and Dit-Yan Yeung . 2017 . Relational deep learning: A deep latent variable model for link prediction . In Proceedings of the AAAI. 2688--2694 . Hao Wang, Xingjian Shi, and Dit-Yan Yeung. 2017. Relational deep learning: A deep latent variable model for link prediction. In Proceedings of the AAAI. 2688--2694.
- Hao Wang , Shi Xingjian , and Dit-Yan Yeung . 2016 . Collaborative recurrent autoencoder: Recommend while learning to fill in the blanks . In Proceedings of the NIPS. 415--423 . Hao Wang, Shi Xingjian, and Dit-Yan Yeung. 2016. Collaborative recurrent autoencoder: Recommend while learning to fill in the blanks. In Proceedings of the NIPS. 415--423.
- Yuyang Wang , Alex Smola , Danielle C. Maddix , Jan Gasthaus , Dean Foster , and Tim Januschowski . 2019 . Deep factors for forecasting . In Proceedings of the ICML. 6607--6617 . Yuyang Wang, Alex Smola, Danielle C. Maddix, Jan Gasthaus, Dean Foster, and Tim Januschowski. 2019. Deep factors for forecasting. In Proceedings of the ICML. 6607--6617.
- Manuel Watter , Jost Springenberg , Joschka Boedecker , and Martin Riedmiller . 2015 . Embed to control: A locally linear latent dynamics model for control from raw images . In Proceedings of the NIPS. 2728--2736 . Manuel Watter, Jost Springenberg, Joschka Boedecker, and Martin Riedmiller. 2015. Embed to control: A locally linear latent dynamics model for control from raw images. In Proceedings of the NIPS. 2728--2736.
- Max Welling and Yee Whye Teh . 2011 . Bayesian learning via stochastic gradient langevin dynamics . In Proceedings of the ICML. 681--688 . Max Welling and Yee Whye Teh. 2011. Bayesian learning via stochastic gradient langevin dynamics. In Proceedings of the ICML. 681--688.
- Andrew Gordon Wilson. 2020. The case for Bayesian deep learning. arXiv preprint arXiv:2001.10995. Andrew Gordon Wilson. 2020. The case for Bayesian deep learning. arXiv preprint arXiv:2001.10995. · arXiv
- Zichao Yang , Zhiting Hu , Ruslan Salakhutdinov , and Taylor Berg-Kirkpatrick . 2017 . Improved variational autoencoders for text modeling using dilated convolutions . In Proceedings of the ICML. 3881--3890 . Zichao Yang, Zhiting Hu, Ruslan Salakhutdinov, and Taylor Berg-Kirkpatrick. 2017. Improved variational autoencoders for text modeling using dilated convolutions. In Proceedings of the ICML. 3881--3890.
- He Zhao , Lan Du , Wray L. Buntine , and Mingyuan Zhou . 2018 . Dirichlet belief networks for topic structure learning . In Proceedings of the NIPS. 7966--7977 . He Zhao, Lan Du, Wray L. Buntine, and Mingyuan Zhou. 2018. Dirichlet belief networks for topic structure learning. In Proceedings of the NIPS. 7966--7977.
- Vincent Wenchen Zheng , Bin Cao , Yu Zheng , Xing Xie , and Qiang Yang . 2010 . Collaborative filtering meets mobile recommendation: A user-centered approach . In Proceedings of the AAAI. Vincent Wenchen Zheng, Bin Cao, Yu Zheng, Xing Xie, and Qiang Yang. 2010. Collaborative filtering meets mobile recommendation: A user-centered approach. In Proceedings of the AAAI.
- Mingyuan Zhou , Lauren Hannah , David B. Dunson , and Lawrence Carin . 2012 . Beta-negative binomial process and Poisson factor analysis . In Proceedings of the AISTATS. 1462--1471 . Mingyuan Zhou, Lauren Hannah, David B. Dunson, and Lawrence Carin. 2012. Beta-negative binomial process and Poisson factor analysis. In Proceedings of the AISTATS. 1462--1471.
Cited by
Sorted by citations
Items 201–246 of 246
Intrinsic uncertainties and where to find themPreprint
Farina, F., Phillips, L., & Richmond, N. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.02526
PI3NN: Prediction intervals from three independently trained neural networks.Preprint
Liu, S., Zhang, P., Lu, D., & Zhang, G. (2021) · arXiv (Cornell University)
Kraft, B. (2021) · Hydrology and earth system sciences · doi:10.5194/hess-2021-211-ac3
Multi-Label Classification of Heterogeneous Underwater Soundscapes with Bayesian Deep LearningPreprint
Orescanin, M., Beckler, B., Pfau, A., Atchley, S., Villemez, N., Joseph, J. E., Miller, C. W., & Margolina, T. (2022) · doi:10.36227/techrxiv.19205016
Bayesian Deep Structured Semantic Model for Sub-Linear-Time Information Retrieval
Mo, Y., & Scott, S. (2022) · Proceedings · doi:10.1109/icdm54844.2022.00142
Jaxsgmc: Modular Stochastic Gradient MCMC in JaxPreprint
Thaler, S., Fuchs, P., Cukarska, A., & Zavadlav, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4523404
Architecture and design of AI based air situation assessment
Gehlen, J., Govaers, F., Ulmke, M., & Fischer, A. (2023) · IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI) · doi:10.1109/sdf-mfi59545.2023.10361390
Deep machine learning for biosignal analysis
Dissanayakage, P. T. T. (2024) · Queensland University of Technology · doi:10.5204/thesis.eprints.247177
A Multi-Dimensional Evaluation Model for Epidemic Prevention Policies
Gao, Z., Tan, Z., & Bao, B. (2024) · CAAI Artificial Intelligence Research · doi:10.26599/air.2024.9150034
Martinez-Ramon, M., Ajith, M., & Kurup, A. R. (2024) · Wiley eBooks · doi:10.1002/9781119861898.biblio
Concentration of Measure and Global Optimization of Bayesian Multilayer Perceptron. Part I
Temyanov, B. K., & Nigmatullin, R. R. (2024) · Lobachevskii Journal of Mathematics · doi:10.1134/s1995080224600651
Şenyürek, E., & Kevrić, J. (2024) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2024.07.391
Zhao, S., Shah, N., Meert, W., & Verhelst, M. (2024) · doi:10.1109/esserc62670.2024.10719485
Unraveling Multifaceted User Preferences on Content Platforms: A Bayesian Deep Learning ApproachPreprint
Yin, M., Cong, Z., & Liu, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5051742
Quantized SG-MCMC for Bayesian Deep Posterior Compression
Hernández, S., & López-Cortés, X. A. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-80084-9_11
BayProNet: Advancing Few-Shot Learning with Bayesian Prototype Network
Gao, C., Jiang, M., & Hui, C. H. (2024) · doi:10.1145/3709026.3709116
Toward accurate single image sand dust removal by utilizing uncertainty-aware neural network
Wei, B., Liu, H., Qian, C., Shen, H., Chen, Y., & Wang, Y. (2025) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2025.1575995
Naqvi, S. T. G., Niazi, S. A., Awan, S. E., & Qureshi, M. A. (2025) · Multiscale and Multidisciplinary Modeling Experiments and Design · doi:10.1007/s41939-025-01030-8
BBBNN: Bernoulli binary Bayesian neural network accelerator toward edge explainable AI inference
Ando, K., Saito, T., & Asai, T. (2025) · Nonlinear Theory and Its Applications IEICE · doi:10.1587/nolta.16.788
Towards Trustworthy Model via Uncertainty Verification in Multimodal Sentiment Analysis
Tang, C., Li, Y., Shen, T., Gong, X., & Zhang, T. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11208957
PHTFNet-RPM: a probabilistic hybrid network with RPM for tobacco root disease forecasting
Bu, Y., TingShan, Y., Geng, S., & Huang, R. (2025) · Frontiers in Big Data · doi:10.3389/fdata.2025.1705587
TULiP: Test-Time Uncertainty Estimation via Linearization and Weight Perturbation
Zhang, Y., Wu, D., Wada, Y., & Kanamori, T. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-4367-0_32
UGDT-SR: Uncertainty-Guided Diffusion Transformer for Ultrasound Image Super-Resolution
Xu, X., Lin, G. C., Chi, J., & Li, Z. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11356391
Meta-PDNN: Context-Aware Meta-Learning for Task Adaptation in Vehicular Edge Computing
Tran‐Dang, H., & Kim, D. (2025) · International Conference on Big Data and Information Analytics (BigDIA) · doi:10.1109/bigdia68682.2025.11382841
Uncertainty Estimation by Human Perception versus Neural Models
Mendes, P., Romano, P., & Garlan, D. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7081-2_11
Кузьминов, А. Н., Tyaglov, S. G., & Николаевна, З. Е. (2026) · Учет и статистика · doi:10.54220/1994-0874.2026.91.77.011
Integrating Conventional Reliability Prediction Methodologies with AI
Uysal, A., & Kesepara, A. (2026) · Annual Reliability and Maintainability Symposium (RAMS) · doi:10.1109/rams50514.2026.11424544
Utility Theory based Cognitive Modeling in the Application of Robotics: A SurveyPreprint
Yang, Q. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6435083
IA et recherche en intervention sociale
interdisci, L. D. R., de l’inte, H. É. D. T. E., Fofana, P., & Scheepers, J. (2026) · Vie sociale · doi:10.3917/vsoc.052.0045
APLR: A Semi-Supervised Learning Framework Based on Adaptive Pseudo-Label Refinement
魏妙琪 (2025) · IEEE International Conference of Safe Production and Informatization (IICSPI) · doi:10.1109/iicspi66775.2025.11437681
Large scale Bayesian inference
Sekkat, I. (2022) · theses.fr (ABES) · doi:10.70675/c9e12d31z25edz46a7zb99fzbdd76e4db319
Zhuoqun, C. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6571464
Zeng, J., Tong, Y., Cheng, Y., & Chen, L. (2026) · Journal of Vibroengineering · doi:10.21595/jve.2026.26015
PE-LoRA: Parameter-Efficient Bayesian Low-Rank Adaptation for Large Language Models
Huang, X., Cao, H., Sui, J., Liu, R. X., Ding, S., Tao, S., & Bu, D. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462278
A Multi-modal dialogue emotion recognition framework based on D-GBA
Liu, H., Wang, H., Ma, Y., Chen, J., Liu, X., & Wang, J. (2025) · doi:10.1145/3797552.3797664
Self-citationCybersecurity for Small Businesses: Cost-Effective AI-Driven Solutions.
Wanjiru, L. (2026) · CogNexus · doi:10.63084/cognexus.v2i1.221
Compact Semantic‐Aware Priors for Large‐Margin Few‐Shot Classification
Wu, J., Chen, J., Luo, J., & Hu, J. (2026) · IEEJ Transactions on Electrical and Electronic Engineering · doi:10.1002/tee.70302
Automated detection of freeze-thaw signatures in archaeological sediments using deep learning
Kouki, S., Li, L., & Aldeias, V. (2026) · Open Research Europe · doi:10.12688/openreseurope.23697.1
Lighting-Robust Behavioral Cloning via Bayesian Visual Encoding for Robot Manipulation
Dong, Z., Han, D., Wang, Z., Yan, Z., Lin, Q., Zhang, Z., & Zhang, P. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3692063
Shen, C., Chong, Q., Yang, H., Li, X., Sun, X., & Qian, G. (2026) · Frontiers in Earth Science · doi:10.3389/feart.2026.1769073
Robust Bayesian Dynamic Graph Embedding via Contrastive Learning
Jiao, P., Liu, Z., Liu, H., Zhao, Z., Yin, Y., & Bi, Y. (2026) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2026.3695337
Seo, S.-H. (2026) · Journal of Digital Contents Society · doi:10.9728/dcs.2026.27.5.1359
Causal Inference for Interpretable ESG Prediction: Comparing Machine Learning and Fine-Tuned LLMs
Chou, T.-N. (2026) · International Multi-Conference on Systems, Signals & Devices (SSD) · doi:10.1109/ssd69655.2026.11558982
Heterogeneous Non-Linear Performance Modeling of Parameter Interactions
Harris, S. D., Chamberlain, R. D., & Gill, C. D. (2026) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw71298.2026.00014
Salhi, I., Koundi, M. E., KHALIFA, M. A. B., Talhaoui, W., & Ghali, A. E. (2026) · Acta Geophysica · doi:10.1007/s11600-026-02024-x
Uncertainty-Aware Deep Learning for Skin Cancer Diagnosis
Mohammed, A. J., & Hassan, M. M. (2026) · Dasinya Journal for Engineering and Informatics · doi:10.65542/djei.v2i4.97
Metadata
- Authors
- Wang, H., & Yeung, D.-Y.
- Affiliations
- Massachusetts Institute of Technology (US)
- Hong Kong University of Science and Technology (HK)
- Venue
- ACM Computing Surveys
- Published
- 2020-09-28
- Volume
- 53
- Issue
- 5
- Pages
- 1-37
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3089611792
- Cited by
- 247
- References
- 52
- Citations by year
- 2026: 23 · 2025: 54 · 2024: 50 · 2023: 37 · 2022: 43 · 2021: 28 · 2020: 6
- FWCI
- 11.20
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Computing Surveys (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- Bayesian deep learning, uncertainty quantification, probabilistic graphical models, Bayesian neural networks, recommender systems, topic modeling, Bayesian control
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review