Probabilistic machine learning and artificial intelligence
The DOI matches its Crossref record; 104 of the 108 references it cites were found in a registry or an index.
Abstract
How can a machine learn from experience? Probabilistic modelling provides a framework for understanding what learning is, and has therefore emerged as one of the principal theoretical and practical approaches for designing machines that learn from data acquired through experience. The probabilistic framework, which describes how to represent and manipulate uncertainty about models and predictions, has a central role in scientific data analysis, machine learning, robotics, cognitive science and artificial intelligence. This Review provides an introduction to this framework, and discusses some of the state-of-the-art advances in the field, namely, probabilistic programming, Bayesian optimization, data compression and automatic model discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deriving from the Bayesian framework, GPR models have been widely applied to prognostic analysis as they are flexible, nonparametric and probabilistic [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ameliorate this in GPR, one way is to minimize the negative log marginal likelihood [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The performance of GPR is highly sensitive on the covariance function and the kernels should therefore be carefully selected to achieve high prediction accuracy [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These methods can be broadly classified into two categories: Bayesian approaches [40,90,106] and Frequentist, approaches [14,70,113]”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“recent advances using deep neural networks to solve challenging pattern recognition problems such as speech recognition [5], image classification [6, 7], and prediction of words in text [8], do not overtly represent the uncertainty in the structure or parameters of those neural networks.”
BackgroundA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“The HMM is a widely used probabilistic model for sequential and time-series data, which assumes the data were obtained by transitioning stochastically between a discrete number of hidden states 98 .”
MethodBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“The model could have a large number of parameters compared with the data set (for example, the neural network recently used to achieve translations of English and French sentences that approached the accuracy of state-of-the-art methods is a probabilistic model with 384 million parameters 29 ).”
MethodGaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Research works printed but not linked: 14
- [8] Bengio, Y., Ducharme, R., Vincent, P. & Janvin, C. A neural probabilistic language model. The Journal of Machine Learning Research 3 , 1137-1155 (2003). -
- Hinton, G. E., McClelland, J. L. & Rumelhart, D. E. in Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations 77–109 (MIT Press, 1986).
- Goodman, N. D. & Stuhlmüller, A. The Design and Implementation of Probabilistic Programming Languages. Available at http://dippl.org (2015).
- Mansinghka, V., Kulkarni, T. D., Perov, Y. N. & Tenenbaum, J. Approximate Bayesian image interpretation using generative probabilistic graphics programs. In Proc. Advances in Neural Information Processing Systems 26 1520–1528 (2013).
- Minka, T. P., Winn, J. M., Guiver, J. P. & Knowles, D. A. Infer.NET 2.4. http://research.microsoft.com/infernet (Microsoft Research, 2010).
- Pfeffer, A. Figaro: An Object-Oriented Probabilistic Programming Language. Tech. Rep. (Charles River Analytics, 2009).
- Mansinghka, V., Selsam, D. & Perov, Y. Venture: a higher-order probabilistic programming platform with programmable inference. Preprint at http://arxiv.org/abs/1404.0099 (2014). · arXiv
- Li, L., Wu, Y. & Russell, S. J. SWIFT: Compiled Inference for Probabilistic Programs. Report No. UCB/EECS-2015–12 (Univ. California, Berkeley, 2015).
- Bergstra, J. et al. Theano: a CPU and GPU math expression compiler. In Proc. 9th Python in Science Conference http://conference.scipy.org/proceedings/scipy2010/ (2010).
- Poupart, P. in Encyclopedia of Machine Learning 90–93 (Springer, 2010).
- Grosse, R. B., Salakhutdinov, R. & Tenenbaum, J. B. Exploiting compositionality to explore a large space of model structures. In Proc. Conference on Uncertainty in Artificial Intelligence 306–315 (2012).
- Welling, M. et al. Bayesian inference with big data: a snapshot from a workshop. ISBA Bulletin 21, https://bayesian.org/sites/default/files/fm/bulletins/1412.pdf (2014).
- Bakker, B. & Heskes, T. Task clustering and gating for Bayesian multitask learning. J. Mach. Learn. Res. 4, 83–99 (2003).
- Hensman, J., Fusi, N. & Lawrence, N. D. Gaussian processes for big data. In Proc. Conference on Uncertainty in Artificial Intelligence 244 (UAI, 2013).
Cited by
Items 601–700 of 1,004
Mou, L., Liang, L., Gao, Z., & Wang, X. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103619 · Cited by 29
Agent-based modelling for Urban Analytics: State of the art and challenges
Malleson, N., Birkin, M. H., Birks, D., Ge, J., Heppenstall, A. J., Manley, E., McCulloch, J., & Ternes, P. (2022) · AI Communications · doi:10.3233/aic-220114 · Cited by 33
“Related work is also exploring the potential of probabilistic modelling [50, 51]; an approach to model building that provides an elegant framework for representing all forms of uncertainty, updating beliefs about the target system in response to new data, and making predictions.”
Multimodal analysis methods in predictive biomedicine
Qoku, A., Katsaouni, N., Flinner, N., Buettner, F., & Schulz, M. H. (2023) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2023.11.011 · Cited by 29
Building Calibrated Deep Models via Uncertainty Matching with Auxiliary Interval Predictors
Thiagarajan, J. J., Venkatesh, B., Sattigeri, P., & Bremer, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6062 · Cited by 18
Preparation of ordered states in ultra-cold gases using Bayesian optimization
Mukherjee, R., Sauvage, F., Xie, H., Löw, R., & Mintert, F. (2020) · New Journal of Physics · doi:10.1088/1367-2630/ab8677 · Cited by 31
Bayesian Autoencoders for Drift Detection in Industrial Environments
Yong, B. X., Fathy, Y., & Brintrup, A. M. (2020) · IEEE International Workshop on Metrology for Industry 4.0 & IoT (MetroInd4.0&IoT) · doi:10.1109/metroind4.0iot48571.2020.9138306 · Cited by 28
“An emerging area of research is the uncertainty quantification of deep learning models [1].”
Tu, H., Borah, M., Moura, S. J., Wang, Y., & Fang, H. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.124086 · Cited by 30
“To address this, we could explore the use of probabilistic ML techniques, such as Bayesian neural networks [41].”
MethodDisaggregating the Carbon Exchange of Degrading Permafrost Peatlands Using Bayesian Deep Learning
Pirk, N., Aalstad, K., Mannerfelt, E. S., Clayer, F., de Wit, H. A., Christiansen, C. T., Althuizen, I., Lee, H., & Westermann, S. (2024) · Geophysical Research Letters · doi:10.1029/2024gl109283 · Cited by 29
“Such Bayesian neural networks (BNNs) produce uncertainty‐aware outputs and—while being an old concept (MacKay, 2003; Neal, 1996)—are becoming increasingly popular in machine learning where uncertainty awareness is becoming a vital consideration (Ghahramani, 2015).”
BackgroundBattery Prognostics and Health Management: AI and Big Data
Li, D., Nan, J., Burke, A. F., & Zhao, J. (2024) · World Electric Vehicle Journal · doi:10.3390/wevj16010010 · Cited by 32
“Probabilistic methods provide a robust framework for capturing essential insights, establishing a foundation for designing systems capable of learning from experiential data [20].”
Cao, W., Mai, N. T., & Liu, W. (2025) · Symmetry · doi:10.3390/sym17081332 · Cited by 53
The neural and cognitive architecture for learning from a small sample
Cortese, A., Martino, B. D., & Kawato, M. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.02.011 · Cited by 32
Fault diagnosis of new energy vehicles based on improved machine learning
Liu, H., Song, X., & Zhang, F. (2021) · Soft Computing · doi:10.1007/s00500-021-05860-9 · Cited by 30
“The literature (Ghahramani 2015) proposed a fault interval estimation method.”
BackgroundMethod selection in short-term eruption forecasting
Whitehead, M., & Bebbington, M. (2021) · Journal of Volcanology and Geothermal Research · doi:10.1016/j.jvolgeores.2021.107386 · Cited by 29
Zhang, J., Xiao, B., Zhao, J., Li, M., Lin, H., Kang, Z., Wu, X., Liu, H., Peng, D., & Zhang, Q. (2022) · Journal of Energy Chemistry · doi:10.1016/j.jechem.2022.04.007 · Cited by 28
Hammad, A. T., & Falchetta, G. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.156157 · Cited by 31
“With regards to forecasting, Probabilistic Machine Learning (ML) (Duan, 2020; Ghahramani, 2015; Gneiting and Katzfuss, 2014; Palmer, 2012) has highlighted the importance of accompanying any statement about the future with a quanti fi cation of its uncertainty to give a complete picture of the…”
BackgroundWen, Q., Luo, X., & Zhou, M. (2023) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2023.3326304 · Cited by 79
“P EOPLE’S daily life is inundated by Big Data [1], [61], where an important kind of data is the interactions data among numerous nodes, e.g., IoT node interactions [2], [3], protein or drug interactions [4], and social network systems’ user interactions [5], [6], [62], [63].”
Training of physics-informed Bayesian neural networks with ABC-SS for prognostic of Li-ion batteries
Fernández, J., Corbetta, M., Kulkarni, C. S., Chiachío, J., & Chiachío, M. (2023) · Computers in Industry · doi:10.1016/j.compind.2023.104058 · Cited by 28
A mathematical theory of cooperative communicationPreprint
Wang, P., Wang, J., Paranamana, P., & Shafto, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.02822 · Cited by 29
Prediction of the yield strength of as-cast alloys using the random forest algorithm
Zhang, W., Li, P., Wang, L., Fu, X., Wan, F., Wang, Y., Shu, L., & Yong, L. (2024) · Materials Today Communications · doi:10.1016/j.mtcomm.2024.108520 · Cited by 27
Yue, Z., Wang, N., Xu, B., Huang, X., Yang, D. M., Xiao, H. B., & Shi, Z. (2025) · Water Resources Research · doi:10.1029/2024wr038650 · Cited by 29
“However, such methods typically require training separate Bayesian models for UQ, which may introduce additional uncertainties, and rely on strong data assumptions (e.g., normality, smoothness) (Ghahramani, 2015; Hüllermeier & Waegeman, 2021).”
Chen, C., Wang, C., Guo, J., Cui, P., Zheng, J., & Liu, Z. (2025) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2025.111431 · Cited by 27
Deep Learning in Personalization of Cardiovascular Stents
Lee, Y., Veerubhotla, K., Jeong, M. H., & Lee, C. H. (2019) · Journal of Cardiovascular Pharmacology and Therapeutics · doi:10.1177/1074248419878405 · Cited by 30
“Machine learning (ML), in turn, is a subset of AI wherein machines autonomously acquire information by extracting patterns from large databases.(3) Machine learning is closely related to the fields of statistics and data mining and thus usually relies on model-based approaches in which a variety of algorithms can be p…”
BackgroundShukla, P., Muralidhar, A., Iliev, N., Tulabandhula, T., Fuller, S. B., & Trivedi, A. R. (2021) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2021.3100252 · Cited by 32
Prognostic Kalman Filter Based Bayesian Learning Model for Data Accuracy Prediction
Karthik, S., Bhadoria, R. S., Lee, J.-G., Sivaraman, A. K., Samanta, S., Balasundaram, A., Chaurasia, B. K., & Ashokkumar, S. (2022) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2022.023864 · Cited by 27
UnIC: Towards Unmanned Intelligent Cluster and Its Integration into Society
Zhang, F., Yu, J., Lin, D., & Zhang, J. (2022) · Engineering · doi:10.1016/j.eng.2022.02.008 · Cited by 29
Kort-Kamp, W. J. M., Ferrandon, M. S., Wang, X. P., Park, J. H., Malla, R. K., Ahmed, T., Holby, E. F., Myers, D. J., & Zelenay, P. (2022) · Journal of Power Sources · doi:10.1016/j.jpowsour.2022.232583 · Cited by 27
An Optimized XGBoost Model for Predicting Tunneling-Induced Ground Settlement
Geng, X., Wu, S., Yan, Q., Sun, J., Xia, Z., & Zhang, Z. (2023) · Geotechnical and Geological Engineering · doi:10.1007/s10706-023-02619-x · Cited by 27
“As a global optimization algorithm based on Bayes’ theorem, the BO algorithm is known as one of the most promising techniques in machine learning (Ghahramani 2015).”
İnan, R., Aksoy, B., & SALMAN, O. K. M. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107083 · Cited by 31
Golsefidi, A. H., Hüttel, F. B., Peled, I., Samaranayake, S., & Pereira, F. C. (2023) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2023.103863 · Cited by 34
Quantitative Bounds on Resource Usage of Probabilistic Programs
Chatterjee, K., Goharshady, A. K., Meggendorfer, T., & Žikelić, Đ. (2024) · Proceedings of the ACM on Programming Languages · doi:10.1145/3649824 · Cited by 27
“They have been used in the analysis of randomized algorithms [Barthe et al. 2018], cryptographic protocols [Barthe et al. 2009], machine learning [Ghahramani 2015; Roy et al. 2008], and robotics [Thrun 2000].”
BackgroundMethodToward Whole-Body Connectomics
Lo, C., & Chiang, A. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.2930-16.2016 · Cited by 27
Adaptive nodes enrich nonlinear cooperative learning beyond traditional adaptation by links
Sardi, S., Vardi, R., Goldental, A., Sheinin, A., Uzan, H., & Kanter, I. (2018) · Scientific Reports · doi:10.1038/s41598-018-23471-7 · Cited by 28
“…attractors for the weights, using more complex feedforward and recurrent networks and their implication on advanced deep learning algorithms 29–34 . spike waveform resulted from an intracellular stimulation (red) where the same intracellular stimulation is followed by an adjacent…”
BackgroundSpatiotemporal Prediction of Tidal Currents Using Gaussian Processes
Sarkar, D., Osborne, M. A., & Adcock, T. A. A. (2019) · Journal of Geophysical Research Oceans · doi:10.1029/2018jc014471 · Cited by 27
“GPs belong to the Bayesian class of ML techniques and have been widely used in modeling of a variety of regression problems (Ghahramani, 2015; Rasmussen & Williams, 2006) including some in the oceanic setting (see, e.g., Hollinger et al., 2012).”
MethodJung, M., Matsumoto, T., & Tani, J. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968597 · Cited by 27
“To address this limitation, we proposed a stochastic predictive model under variational predictive coding because Bayesian approaches prevent over-fitting on few training samples [35].”
MethodLow-Cost Wireless Modular Soft Tensegrity Robots
Kimber, J., Ji, Z., Petridou, A., Sipple, T., Barhydt, K., Boggs, J., Dosiek, L., & Rieffel, J. A. (2019) · IEEE International Conference on Soft Robotics (RoboSoft) · doi:10.1109/robosoft.2019.8722723 · Cited by 27
“As a result, we employ a machine learning technique known as Bayesian Optimization (BO) [27], [34], [35] to find effective gaits in a time and data-efficient manner [35].”
MethodMulti Agent System for Machine Learning Under Uncertainty in Cyber Physical Manufacturing System
Yong, B. X., & Brintrup, A. M. (2019) · Studies in computational intelligence · doi:10.1007/978-3-030-27477-1_19 · Cited by 27
Kharrat, F. G. Z., Gagné, C., LESAGE, A. D., Gariépy, G., Pelletier, J., Brousseau‐Paradis, C., Rochette, L., Pelletier, É., Lévesque, P., Mohammed, M., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0301117 · Cited by 29
Liu, Y., Li, H., Yang, Y., Zhu, W., Xie, C., Yu, X., & Guo, B. (2025) · Renewable Energy · doi:10.1016/j.renene.2025.122892 · Cited by 26
Machine Learning Models of the Geospatial Distribution of Groundwater Quality: A Systematic Review
Mehrabi, M., Polya, D. A., & Han, Y. (2025) · Water · doi:10.3390/w17192861 · Cited by 27
Transforming clinical reasoning—the role of AI in supporting human cognitive limitations
Greengrass, C. J. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1715440 · Cited by 30
Bacterial cell-free expression technology to in vitro systems engineering and optimization
Caschera, F. (2017) · Synthetic and Systems Biotechnology · doi:10.1016/j.synbio.2017.07.004 · Cited by 27
“In vitro cell-free expression systems are complex biochemical systems, therefore, they can be optimized using the state of the art of machine learning algorithms [110], and liquid handling robotics.”
Mora - Automatic Generation of Moment-Based Invariants
Bartocci, E., Kovács, L., & Stankovič, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45190-5_28 · Cited by 26
“Originally employed in randomized algorithms and cryptographic/privacy protocols, now gaining momentum due to the several emerging applications in the areas of machine learning and AI [5].”
MethodArgument-based assessment of predictive uncertainty of data-driven environmental models
Knüsel, B., Baumberger, C., Zumwald, M., Bresch, D. N., & Knutti, R. (2020) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2020.104754 · Cited by 26
“To the best of our knowledge, the literature on uncertainties in machine learning has mainly discussed the role of Bayesian approaches for quantifying uncertainty (see Blundell et al., 2015; Ghahramani, 2015; Gal and Ghahramani, 2016).”
BackgroundThenault, R., Kaulanjan, K., Darde, T., Rioux-Leclercq, N. C., Bensalah, K., Mermier, M., Khene, Z., Peyronnet, B., Shariat, S. F., Pradère, B., et al. (2020) · Applied Sciences · doi:10.3390/app10186428 · Cited by 29
Akbar, C., Li, Y., & Sung, W.-L. (2021) · IEEE Access · doi:10.1109/access.2021.3079981 · Cited by 26
“Due to rapid prediction, while maintaining the performance accuracy, ML is being applied in many research areas [21], [30], [39]–[46].”
Public demand urgency for equitable infrastructure restoration planning
Chen, Y., & Ji, W. (2021) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2021.102510 · Cited by 29
Li, M., & Song, Y. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3130289 · Cited by 26
“In spite of the extreme sparsity in these SHiDS matrices, they usually contain rich information with a variety of patterns, such as preferable communities of users in social networks [7], [9] and the relative distance of two nodes in wireless sensor networks [20], [22], [36].”
BackgroundElambasseril, J., & Brandt, M. (2022) · Materials Today Proceedings · doi:10.1016/j.matpr.2022.02.485 · Cited by 26
Reliable neural networks for regression uncertainty estimation
Tohme, T., Vanslette, K., & Youcef‐Toumi, K. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108811 · Cited by 32
Pandey, S. V., Parikh, N., Prochowicz, D., Akın, S., Satapathi, S., Tavakoli, M. M., Kalam, A., & Yadav, P. (2023) · Sustainable Energy & Fuels · doi:10.1039/d2se01209j · Cited by 27
Wang, X., Pan, Y., Chen, J.-J., & Li, M. (2024) · Tunnelling and Underground Space Technology · doi:10.1016/j.tust.2024.105733 · Cited by 26
Syam, W. P., Rybalcenko, K., Gaio, A., Crabtree, J., & Leach, R. (2019) · Optics and Lasers in Engineering · doi:10.1016/j.optlaseng.2019.04.015 · Cited by 31
Soize, C., Ghanem, R., & Desceliers, C. (2020) · Statistics and Computing · doi:10.1007/s11222-020-09954-6 · Cited by 26
“2017) and in algorithms devoted to artificial intelligence (Korb and Nicholson 2010; Ghahramani 2015).”
BackgroundIntegrating Domain Knowledge in Data-Driven Earth Observation With Process Convolutions
Svendsen, D. H., Piles, M., Munoz-Mari, J., Luengo, D., Martino, L., & Camps‐Valls, G. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3059550 · Cited by 26
“Among the many ML models available, Gaussian processes (GPs) [15] are one of the most popular probabilistic models [16].”
BackgroundAusterweil, J. L., Sanborn, S., & Griffiths, T. L. (2019) · Cognitive Science · doi:10.1111/cogs.12777 · Cited by 30
Deep Bayesian local crystallography
Kalinin, S. V., Oxley, M. P., Valleti, M., Zhang, J., Hermann, R. P., Zheng, H., Zhang, W., Eres, G., Vasudevan, R. K., & Ziatdinov, M. A. (2021) · npj Computational Materials · doi:10.1038/s41524-021-00621-6 · Cited by 25
Tophel, A., Walker, J. P., Dutta, T. T., & Kodikara, J. K. (2022) · Acta Geotechnica · doi:10.1007/s11440-021-01431-2 · Cited by 25
“Despite being able to handle complex processes with significant accuracy, NNs are poor at quantifying predictive uncertainty and often produce over-confident predictions [13, 28].”
BackgroundZhang, N., Zhang, W., Liao, K., Zhu, H., Li, Q., & Wang, J. (2022) · Environmental Earth Sciences · doi:10.1007/s12665-022-10317-9 · Cited by 25
“Bayesian optimization (BO) (Ghahramani 2015) is a type of approximation method that is effective for global optimization.”
BackgroundRainfall prediction system for Bangladesh using long short-term memory
Billah, M., Adnan, M. N., Akhond, M. R., Ema, R. R., Hossain, M. A., & Galib, S. M. (2022) · Open Computer Science · doi:10.1515/comp-2022-0254 · Cited by 25
Tanimu, B., Bello, A. D., Abdullahi, S. A., Ajibike, M. A., Yaseen, Z. M., Kamruzzaman, M., Muhammad, M. K. I., & Shahid, S. (2024) · Theoretical and Applied Climatology · doi:10.1007/s00704-024-04888-9 · Cited by 25
“ML models' performance is intrinsically linked to the attributes of the data they have encountered (Ghahramani 2015; Greener et al. 2022).”
Nakajima, N., Fujimori, T., Furuya, M., Kanie, Y., Imai, H., Kita, K., Uemura, K., & Okada, S. (2024) · Cureus · doi:10.7759/cureus.56402 · Cited by 28
Zhang, H., Huo, S., Feng, L., Ma, C., Li, W., Liu, Y., & Wu, F. (2024) · Water Resources Research · doi:10.1029/2023wr036587 · Cited by 26
“A two‐layer stacking modeling was used here, in which a higher‐level model integrated the results of lower‐level models to improve the predictive power of the regression (Ghahramani, 2015).”
MethodCORP: Cooperative Opportunistic Resource Provisioning for Short-Lived Jobs in Cloud Systems
Liu, J., Shen, H., & Chen, L. (2016) · IEEE International Conference on Cluster Computing (CLUSTER) · doi:10.1109/cluster.2016.65 · Cited by 25
Big Data – How to Realize the Promise
Cave, A. C., Brun, N. C., Sweeney, F., Rasi, G., Senderovitz, T., & Taskforce, T. H. J. B. D. (2019) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1736 · Cited by 25
“15), is gaining much attention as a route to extract the greatest value from big data and is already part of the regulatory landscape.”
BackgroundPET Image Reconstruction Using a Cascading Back-Projection Neural Network
Zhang, Q., Gao, J., Ge, Y., Zhang, N., Yang, Y., Liu, X., Zheng, H., Liang, D., & Hu, Z. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2998607 · Cited by 25
“In statistical machine learning, it is not necessary to use an explicit assumption on the prior P (x); instead, the posterior distribution P (x/y) is learned directly from the training data using supervised learning [30].”
MethodLearning of Sub-optimal Gait Controllers for Magnetic Walking Soft Millirobots
Çulha, U., Demir, S. Ö., Trimpe, S., & Sitti, M. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.070 · Cited by 27
“Conversely, Bayesian optimization (BO) [10, 34] allows for the maximization of a performance function using a small number of physical experiments.”
BackgroundPredicting Genetic Variation Severity Using Machine Learning to Interpret Molecular Simulations
McCoy, M., Hamre, J. R., Klimov, D. K., & Jafri, M. S. (2020) · Biophysical Journal · doi:10.1016/j.bpj.2020.12.002 · Cited by 26
Liu, Q., Liu, T., Liu, Z., Wang, Y., Jin, Y., & Wen, W. (2018) · arXiv (Cornell University) · doi:10.5555/3201607.3201772 · Cited by 25
Artificial intelligence as a prediction tool for orthognathic surgery assessment
de Oliveira, P. H. J., Li, T., Li, H., Gonçalves, J. R., dos Santos-Pinto, A., Júnior, L. G. G., Cevidanes, L., Hino, C. T., Feltrin, G. P., Campanha, A. A., et al. (2024) · Orthodontics and Craniofacial Research · doi:10.1111/ocr.12805 · Cited by 27
Mukherjee, B., Sain, K., Kar, S., & Srivardhan, V. (2024) · Earth Science Informatics · doi:10.1007/s12145-024-01425-0 · Cited by 25
“We performed the uncertainty analysis of the DL models using Baye’s rule (Ghahramani 2015).”
Twin neural network regression
Wetzel, S. J., Ryczko, K., Melko, R. G., & Tamblyn, I. (2022) · Applied AI Letters · doi:10.1002/ail2.78 · Cited by 26
“We perform Monte-Carlo dropout at an ANN (Gal & Ghahramani, 2015).”
BackgroundMethodInfluentialAn Analysis of Supervised Machine Learning Algorithms for Spam Email Detection
Toma, T. J., Hassan, S. B., & Arifuzzaman, M. (2021) · International Conference on Automation, Control and Mechatronics for Industry 4.0 (ACMI) · doi:10.1109/acmi53878.2021.9528108 · Cited by 24
Jiao, R., Xue, B., & Zhang, M. (2021) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2021.3120980 · Cited by 24
“Gaussian process [7] is often chosen as a prior over the objective and/or constraint functions in Bayesian optimization [5], [8], and has been widely used to solve expensive optimization problems [9]–[12].”
BackgroundMeng, Q., Xiao, K., Shen, D., Zhu, H., & Xiong, H. (2022) · INFORMS journal on computing · doi:10.1287/ijoc.2022.1182 · Cited by 25
Shape adjustment for uncertain mesh reflectors using machine learning
Ren, Z., Du, J., Bao, H., Ge, D., & Wang, F. (2022) · International Journal of Mechanical Sciences · doi:10.1016/j.ijmecsci.2022.108082 · Cited by 24
Landslide Susceptibility Prediction based on Decision Tree and Feature Selection Methods
Nirbhav, Malik, A., Maheshwar, Jan, T., & Prasad, M. (2023) · Journal of the Indian Society of Remote Sensing · doi:10.1007/s12524-022-01645-1 · Cited by 24
“…research domains for example data mining and swarm intelligence (Lavrac, 1999; Maheshwar et al., 2015), pattern recognition (Narayanan, 2016), medical diagnosis (Goyal & Maheshwar, 2019; Maheshwar and Kumar, 2019) and artificial intelligence (Ghahramani, 2015) and have revealed prominent outcomes.”
BackgroundBNP-Track: a framework for superresolved tracking
Sgouralis, I., Xu, L. W. Q., Jalihal, A. P., Kilic, Z., Walter, N. G., & Pressé, S. (2024) · Nature Methods · doi:10.1038/s41592-024-02349-9 · Cited by 26
“Developed within the Bayesian paradigm [50, 12, 53], BNP-Track not only provides point estimates over unknown quantities of interest, such as numbers of emitters and their associated tracks, but also distributions over them, which includes uncertainty.”
Multiplexed imaging of intracellular protein networks
Grecco, H. E., Imtiaz, S., & Zamir, E. (2016) · Cytometry Part A · doi:10.1002/cyto.a.22876 · Cited by 25
Cyber Secure Man-in-the-Middle Attack Intrusion Detection Using Machine Learning Algorithms
Jayapandian, N. (2019) · Advances in computational intelligence and robotics book series · doi:10.4018/978-1-5225-9687-5.ch011 · Cited by 27
Evidence-based programming language design : a philosophical and methodological exploration
Kaijanaho, A.-J. (2015) · Jyväskylä University Digital Archive (University of Jyväskylä) · Cited by 37
Article Commentary: Predictive Modeling of Drug Treatment in the Area of Personalized Medicine
Ogilvie, L. A., Wierling, C., Kessler, T., Lehrach, H., & Lange, B. M. H. (2015) · Cancer Informatics · doi:10.4137/cin.s19330 · Cited by 24
He, G., Demartini, G., & Gadiraju, U. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713218 · Cited by 23
“However, such AI systems are not good at dealing with out-of-distribution data [44, 72], and their intrinsic probabilistic nature brings much uncertainty in practice [28].”
Guo, Q., Cheng, S., Bai, W., Wang, Y., Tan, C., Zhang, J., Liu, D., & Qi, H. (2024) · Petroleum Science · doi:10.1016/j.petsci.2024.02.018 · Cited by 23
Uncertainty in automated valuation models: Error-based versus model-based approaches
Krause, A., Martin, A., & Fix, M. (2020) · Journal of Property Research · doi:10.1080/09599916.2020.1807587 · Cited by 25
Zhang, L., & Li, N. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-05852-8 · Cited by 23
Impact of Artificial Intelligence on E-Commerce Development
Areiqat, A. Y., Hamdan, A., Alheet, A. F., & Alareeni, B. A. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-69221-6_43 · Cited by 32
Termination Analysis of Probabilistic Programs with Martingales
Chatterjee, K., Fu, H., & Novotný, P. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108770750.008 · Cited by 23
“, 2011); (c) systems that interact with uncertainty in artificial intelligence (Kaelbling et al., 1996, 1998; Ghahramani, 2015).”
BackgroundExposure forecasting – ExpoCast – for data-poor chemicals in commerce and the environment
Wambaugh, J. F., & Rager, J. E. (2022) · Journal of Exposure Science & Environmental Epidemiology · doi:10.1038/s41370-022-00492-z · Cited by 25
Efficient energy transport in constant-voltage triboelectric nanogenerator-based power units
Li, X., Zhao, Z., Hu, Y., Gao, Y., He, L., Qiao, W., Zhang, B., Xu, Y., Wang, Z. L., & Wang, J. (2023) · Energy & Environmental Science · doi:10.1039/d3ee03728b · Cited by 23
Classifying antimicrobial and multifunctional peptides with Bayesian network models
Barrett, R., Jiang, S., & White, A. D. (2018) · Peptide Science · doi:10.1002/pep2.24079 · Cited by 27
Urinary pro-thrombotic, anti-thrombotic, and fibrinolytic molecules as biomarkers of lupus nephritis
Qin, L., Stanley, S. K., Ding, H., Zhang, T., Truong, V. T. T., Celhar, T., Fairhurst, A., Pedroza, C., Petri, M., Saxena, R., et al. (2019) · Arthritis Research & Therapy · doi:10.1186/s13075-019-1959-y · Cited by 23
Toward the practical application of direct CO2 hydrogenation technology for methanol production
Lee, H. W., Kim, K., An, J., Na, J., Kim, H., Lee, H., & Lee, U. (2020) · International Journal of Energy Research · doi:10.1002/er.5573 · Cited by 24
“In addition, the probabilistic sequential evaluation of machine learning methods (eg, Gaussian process Bayesian optimization) can successfully reduce the number of iterations and thus arrive at a solution more efficiently.(31) However, these methods are generally used in conjunction with continuous search spaces and s…”
MethodLearning an expandable EMR-based medical knowledge network to enhance clinical diagnosis
Xie, J., Jiang, J., Wang, Y., Guan, Y., & Guo, X. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101927 · Cited by 25
Development Trend and Thinking of Artificial Intelligence in Education
Liang, W. (2020) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc48107.2020.9148078 · Cited by 23
“education-related training platforms to facilitate teachers to share and co-build teaching resources from online teaching and research, communication, and cooperation[10-12].”
BackgroundMishra, A. (2020) · Welding Technology Review · doi:10.26628/wtr.v92i6.1120 · Cited by 23
“AI can be defined as a simulation of human intelligence which possesses the skills of identifying, observing, learning, performing the task and if needed, it can self-correct itself [3-4].”
BackgroundA hierarchical machine learning framework for the analysis of large scale animal movement data
Torney, C. J., Morales, J. M., & Husmeier, D. (2021) · Movement Ecology · doi:10.1186/s40462-021-00242-0 · Cited by 29
Kennedy, A., Nash, G., Rattenbury, N. J., & Kempa-Liehr, A. W. (2021) · Astronomy and Computing · doi:10.1016/j.ascom.2021.100460 · Cited by 26
Xie, M., Ma, X., Wang, Y., Li, C., Shi, H., Yuan, X., Hellwich, O., Chen, C., Zhang, W., Zhang, C., et al. (2023) · Scientific Data · doi:10.1038/s41597-023-02473-9 · Cited by 23
An Overview of Deep Learning Methods Used in Vibration-Based Damage Detection in Civil Engineering
Avcı, O., Abdeljaber, O., & Serkan Kiranyaz, B. (2021) · Conference proceedings of the Society for Experimental Mechanics · doi:10.1007/978-3-030-77143-0_10 · Cited by 22
Loperfido, A., Celebrini, A., Marzetti, A., & Bellocchi, G. (2023) · Exploration of Targeted Anti-tumor Therapy · doi:10.37349/etat.2023.00174 · Cited by 23
Metadata
- Authors
- Ghahramani, Z.
- Venue
- Nature
- Published
- 2015-05-27
- Volume
- 521
- Issue
- 7553
- Pages
- 452-459
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1494192115
- Cited by
- 1,995
- References
- 108
- Citations by year
- 2026: 166 · 2025: 231 · 2024: 228 · 2023: 206 · 2022: 217 · 2021: 265 · 2020: 235 · 2019: 210 · 2018: 102 · 2017: 84 · 2016: 39 · 2015: 11
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/I036575/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- stochastic modeling, machine learning, artificial intelligence, uncertainty representation, probabilistic programming, Bayesian optimization, data compression, experiential learning
- MeSH terms
- Artificial Intelligence, Automation, Bayes Theorem, Models, Statistical, Statistics, Nonparametric, Uncertainty, Data Compression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.