Probabilistic machine learning and artificial intelligence
The DOI matches its Crossref record; 104 of the 108 references it cites were found in a registry or an index.
Abstract
How can a machine learn from experience? Probabilistic modelling provides a framework for understanding what learning is, and has therefore emerged as one of the principal theoretical and practical approaches for designing machines that learn from data acquired through experience. The probabilistic framework, which describes how to represent and manipulate uncertainty about models and predictions, has a central role in scientific data analysis, machine learning, robotics, cognitive science and artificial intelligence. This Review provides an introduction to this framework, and discusses some of the state-of-the-art advances in the field, namely, probabilistic programming, Bayesian optimization, data compression and automatic model discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deriving from the Bayesian framework, GPR models have been widely applied to prognostic analysis as they are flexible, nonparametric and probabilistic [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ameliorate this in GPR, one way is to minimize the negative log marginal likelihood [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The performance of GPR is highly sensitive on the covariance function and the kernels should therefore be carefully selected to achieve high prediction accuracy [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These methods can be broadly classified into two categories: Bayesian approaches [40,90,106] and Frequentist, approaches [14,70,113]”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“recent advances using deep neural networks to solve challenging pattern recognition problems such as speech recognition [5], image classification [6, 7], and prediction of words in text [8], do not overtly represent the uncertainty in the structure or parameters of those neural networks.”
BackgroundA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“The HMM is a widely used probabilistic model for sequential and time-series data, which assumes the data were obtained by transitioning stochastically between a discrete number of hidden states 98 .”
MethodBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“The model could have a large number of parameters compared with the data set (for example, the neural network recently used to achieve translations of English and French sentences that approached the accuracy of state-of-the-art methods is a probabilistic model with 384 million parameters 29 ).”
MethodGaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Research works printed but not linked: 14
- [8] Bengio, Y., Ducharme, R., Vincent, P. & Janvin, C. A neural probabilistic language model. The Journal of Machine Learning Research 3 , 1137-1155 (2003). -
- Hinton, G. E., McClelland, J. L. & Rumelhart, D. E. in Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations 77–109 (MIT Press, 1986).
- Goodman, N. D. & Stuhlmüller, A. The Design and Implementation of Probabilistic Programming Languages. Available at http://dippl.org (2015).
- Mansinghka, V., Kulkarni, T. D., Perov, Y. N. & Tenenbaum, J. Approximate Bayesian image interpretation using generative probabilistic graphics programs. In Proc. Advances in Neural Information Processing Systems 26 1520–1528 (2013).
- Minka, T. P., Winn, J. M., Guiver, J. P. & Knowles, D. A. Infer.NET 2.4. http://research.microsoft.com/infernet (Microsoft Research, 2010).
- Pfeffer, A. Figaro: An Object-Oriented Probabilistic Programming Language. Tech. Rep. (Charles River Analytics, 2009).
- Mansinghka, V., Selsam, D. & Perov, Y. Venture: a higher-order probabilistic programming platform with programmable inference. Preprint at http://arxiv.org/abs/1404.0099 (2014). · arXiv
- Li, L., Wu, Y. & Russell, S. J. SWIFT: Compiled Inference for Probabilistic Programs. Report No. UCB/EECS-2015–12 (Univ. California, Berkeley, 2015).
- Bergstra, J. et al. Theano: a CPU and GPU math expression compiler. In Proc. 9th Python in Science Conference http://conference.scipy.org/proceedings/scipy2010/ (2010).
- Poupart, P. in Encyclopedia of Machine Learning 90–93 (Springer, 2010).
- Grosse, R. B., Salakhutdinov, R. & Tenenbaum, J. B. Exploiting compositionality to explore a large space of model structures. In Proc. Conference on Uncertainty in Artificial Intelligence 306–315 (2012).
- Welling, M. et al. Bayesian inference with big data: a snapshot from a workshop. ISBA Bulletin 21, https://bayesian.org/sites/default/files/fm/bulletins/1412.pdf (2014).
- Bakker, B. & Heskes, T. Task clustering and gating for Bayesian multitask learning. J. Mach. Learn. Res. 4, 83–99 (2003).
- Hensman, J., Fusi, N. & Lawrence, N. D. Gaussian processes for big data. In Proc. Conference on Uncertainty in Artificial Intelligence 244 (UAI, 2013).
Cited by
Items 701–800 of 1,004
Jaffari, Z. H., Na, S., Abbas, A., Park, K. Y., & Cho, K. H. (2024) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2024.133762 · Cited by 22
Enabling artificial intelligence‐based scenario application in new type power systems
Fan, S., Guo, J., Ma, S., Wang, G., Li, D., & Zhao, Z. (2024) · Energy internet. · doi:10.1049/ein2.12009 · Cited by 22
Developing a computer vision method based on AHP and feature ranking for ores type detection
Ebrahimi, M., Abdolshah, M., & Abdolshah, S. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2016.08.027 · Cited by 24
A Generic Human–Machine Annotation Framework Based on Dynamic Cooperative Learning
Zhang, Y., Michi, A., Wagner, J., André, E., Schuller, B. W., & Weninger, F. J. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2901499 · Cited by 22
“error is crucial in probabilistic machine learning [13], [14].”
BackgroundPlanning as Inference in Epidemiological Dynamics Models
Wood, F., Warrington, A., Naderiparizi, S., Weilbach, C., Masrani, V., Harvey, W., Ścibior, A., Beronov, B., Grefenstette, J. J., Campbell, D., et al. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.550603 · Cited by 25
“, 2016) that can be understood in terms of Bayesian inference (Bishop, 2006; Gelman et al., 2013; Ghahramani, 2015).”
BackgroundPredicting Flood Property Insurance Claims over CONUS, Fusing Big Earth Observation Data
Yang, Q., Shen, X., Yang, F., Anagnostou, E. N., He, K., Mo, C., Seyyedi, H., Kettner, A. J., & Zhang, Q. (2021) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-21-0082.1 · Cited by 24
“We choose the Bayesian optimization, a 301 widely used search algorithm (Ghahramani 2015), to find the best hyperparameters.”
MethodZhang, L., Wang, M., Zhao, H., & Xu, C. W. (2022) · Computers and Geotechnics · doi:10.1016/j.compgeo.2022.104665 · Cited by 22
Predicting the Enthalpy and Gibbs Energy of Sublimation by QSPR Modeling
Meftahi, N., Walker, M. L., Enciso, M., & Smith, B. J. (2018) · Scientific Reports · doi:10.1038/s41598-018-28105-6 · Cited by 22
Fintech in Financial Reporting and Audit for Fraud Prevention and Safeguarding Equity InvestmentsPreprint
Roszkowska, P. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3679816 · Cited by 23
Artificial intelligence in orthodontics
Sakolia, A. (2021) · International Journal of Health Sciences · doi:10.53730/ijhs.v5ns1.5673 · Cited by 21
“10 Data are the key ingredient of machine learning 11 as Modern software programs, sophisticated statistical analyzes, and algorithms require a tremendous amount of data to be able to predict treatment outcomes and analyze the shortcoming of past-approaches.”
Chen, Z., Cui, Y., Cai, H., Zheng, H., Ning, Q., & Ding, X. (2025) · Energy · doi:10.1016/j.energy.2025.136470 · Cited by 21
Liu, J., Tang, Z., Zhang, J., Chen, Q., Xu, P., & Liu, W. (2016) · PLoS ONE · doi:10.1371/journal.pone.0146484 · Cited by 21
“The corresponding statistical models[25,26] can also be used as a priori model for image processing.”
MethodUncertainty quantification in medical image synthesis
Barbano, R., Arridge, S., Jin, B., & Tanno, R. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-824349-7.00033-5 · Cited by 32
The Emergence of Artificial Intelligence in Cardiology: Current and Future Applications
Kulkarni, P., Mahadevappa, M., & Chilakamarri, S. (2021) · Current Cardiology Reviews · doi:10.2174/1573403x17666211119102220 · Cited by 22
Appoh, F., & Yunusa‐Kaltungo, A. (2022) · IEEE Access · doi:10.1109/access.2022.3155494 · Cited by 21
“The goal is to perform MLE for θ, which becomes ?̂? as [80]–[82]”
AI Privacy Opinions between US and Chinese People
Xing, Y., He, W., Zhang, Z., & Cao, G. (2022) · Journal of Computer Information Systems · doi:10.1080/08874417.2022.2079107 · Cited by 23
“Machine learning A branch of AI and computer science focuses on using data and algorithms to mimic the way humans learn and gradually improve their accuracy.(46) “Opt out data collect AI machine learning should always default after every upgrade tech providers respect users previochoices opting out Won’t a user Fitbvo…”
Robotics in Industry 4.0: A Bibliometric Analysis (2011-2022)
Sekhar, R., Shah, P., & Iswanto, I. (2022) · Journal of Robotics and Control (JRC) · doi:10.18196/jrc.v3i5.15453 · Cited by 23
Calzetta, L., Pistocchini, E., Chetta, A. A., Rogliani, P., & Cazzola, M. (2023) · Expert Opinion on Investigational Drugs · doi:10.1080/13543784.2023.2230138 · Cited by 23
“ML, an evolving branch of AI training algorithms designed to make predictions on new data without being explicitly programmed [23,27], was used to explore the relationship between the investigated variables using data-driven methods”
MethodGholami, H., Mohammadifar, A., Behrooz, R. D., Kaskaoutis, D. G., Li, Y., & Song, Y. (2023) · Environmental Pollution · doi:10.1016/j.envpol.2023.123082 · Cited by 21
Michel, M., Tan, X.-J., & Deng, Y. (2019) · Physical review. E · doi:10.1103/physreve.99.010105 · Cited by 21
A Novel Deep Density Model for Unsupervised Learning
Yang, X., Huang, K., Zhang, R., & Goulermas, J. Y. (2018) · Cognitive Computation · doi:10.1007/s12559-018-9566-9 · Cited by 21
“Density models constitute a family of effective machine learning methodologies that connect density estimation and manifold discovery [8, 22].”
BackgroundEnhancing Model Predictability for a Scramjet Using Probabilistic Learning on Manifolds
Soize, C., Ghanem, R., Safta, C., Huan, X., Vane, Z. P., Oefelein, J. C., Lacaze, G., & Najm, H. N. (2018) · AIAA Journal · doi:10.2514/1.j057069 · Cited by 22
Prognostic models based on imaging findings in glioblastoma: Human versus Machine
Molina-García, D., Vera-Ramírez, L., Pérez-Beteta, J., Arana, E., & Pérez‐García, V. M. (2019) · Scientific Reports · doi:10.1038/s41598-019-42326-3 · Cited by 22
Toward evolutionary and developmental intelligence
Doya, K., & Taniguchi, T. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2019.04.006 · Cited by 24
“Probabilistic programming languages [48], which allow flexible designs of probabilistic models and derivation of their inference algorithms, are now incorporating deep neural networks as generative models [49], which is a favorable function for acquisition of world models through real sensory–motor interactions.”
Zhang, Y., Pan, Z., Yue, Y., Ren, Y., Wang, Z., Liu, B., Zhang, H., Li, S., Fang, Y., Huang, H., et al. (2019) · Journal of Lightwave Technology · doi:10.1109/jlt.2019.2942431 · Cited by 23
“used in various fields, such as biomedicine, natural language processing, computer vision, and autonomous vehicles [4]–[6].”
Predicting Fundraising Performance in Medical Crowdfunding Campaigns Using Machine Learning
Peng, N., Zhou, X., Niu, B., & Feng, Y. (2021) · Electronics · doi:10.3390/electronics10020143 · Cited by 23
“Although machine learning is an effective method to analyze hidden association in big data set and identify complex data [51], scholars begin to apply such algorithms to practical issues.”
Cyanobacterial risk prevention under global warming using an extended Bayesian network
Jiang, P., Liu, X., Zhang, J., Te, S. H., Gin, K. Y., Fan, Y. V., Klemeš, J. J., & Shoemaker, C. A. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2021.127729 · Cited by 21
Avcı, O., Abdeljaber, O., Serkan Kiranyaz, B., Hussein, M. F. M., Gabbouj, M., & Inman, D. J. (2021) · Conference proceedings of the Society for Experimental Mechanics · doi:10.1007/978-3-030-77143-0_2 · Cited by 21
Optimizing maintenance decisions in railway wheelsets: A Markov decision process approach
Braga, J. A., & Andrade, A. R. (2018) · Proceedings of the Institution of Mechanical Engineers Part O Journal of Risk and Reliability · doi:10.1177/1748006x18783403 · Cited by 21
Wu, W., Guo, Y., Li, Q., & Jia, C. (2024) · Liver International · doi:10.1111/liv.16112 · Cited by 22
“15,16 Although LLMs have demonstrated impressive capabilities, efforts to assess their clinical knowledge primarily depend on automated assessments utilising restricted benchmarks.”
Probabilistic Models with Deep Neural Networks
Masegosa, A. R., Cabañas, R., Langseth, H., Nielsen, T. D., & Salmerón, A. (2021) · Entropy · doi:10.3390/e23010117 · Cited by 22
“These software tools usually fall under the umbrella term probabilistic programming languages (PPLs) (Gordon et al., 2014; Ghahramani, 2015), and support methods for learning and reasoning about complex probabilistic models.”
BackgroundMethodHeaps’ Law and Heaps functions in tagged texts: evidences of their linguistic relevance
Chacoma, A., & Zanette, D. H. (2020) · Royal Society Open Science · doi:10.1098/rsos.200008 · Cited by 20
“The identification of statistically significant regularities in data corpora of broader origins may point to the usefulness of Heaps functions –and, in general, Heaps-like analyses– not only in the processing of natural languages, but also in the characterization of other complex combinatorial structures [33], such as…”
BackgroundThe Impacts of Artificial Intelligence on Research in the Legal Profession
Biresaw, S. M., & Saste, A. U. (2022) · International Journal of Law and Society · doi:10.11648/j.ijls.20220501.17 · Cited by 20
An Optimized Uncertainty-Aware Training Framework for Neural Networks
Tabarisaadi, P., Khosravi, A., Nahavandi, S., Shafie‐khah, M., & Catalào, J. P. S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3213315 · Cited by 26
“As a principled way for UQ, Bayesian neural networks (BNNs) bridge deep learning and Bayesian probability theory and have been extensively used to generate reliability scores for NNs [14], [15], [16], [17], [18], [19], [20].”
MethodA scoping review on deep learning for next-generation RNA-Seq. data analysis
Pandey, D., & Perumal, P. O. (2023) · Functional & Integrative Genomics · doi:10.1007/s10142-023-01064-6 · Cited by 23
“The learned models (formula formed) would be used to predict an array of outputs such as binary responses, categorical labels and also continuous values (Ghahramani 2015).”
MethodWater Quality Prediction Based on Hybrid Deep Learning Algorithm
Perumal, B., Rajarethinam, N., Velusamy, A. D., & Sundramurthy, V. P. (2023) · Advances in Civil Engineering · doi:10.1155/2023/6644681 · Cited by 20
Seismic fragility analysis of nuclear containment structure using Bayesian logistic regression model
Jin, S., Zhai, C., Liu, J., Jiang, D., Wang, D., Wang, S., & Zhou, Y. (2024) · Soil Dynamics and Earthquake Engineering · doi:10.1016/j.soildyn.2023.108435 · Cited by 20
Mo, R., Chen, L., Chen, Y., Xiong, C., Zhang, C., Chen, Z., & Lin, E. (2024) · Structural Safety · doi:10.1016/j.strusafe.2024.102457 · Cited by 20
Artificial intelligence and Eddy covariance: A review
Lucarini, A., Cascio, M. L., Marras, S., Sirca, C., & Spano, D. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.175406 · Cited by 20
Bayesian deep learning applied to diabetic retinopathy with uncertainty quantification
Hassan, M. M., & Ismael, H. R. (2025) · Heliyon · doi:10.1016/j.heliyon.2025.e41802 · Cited by 21
CCRP: Customized cooperative resource provisioning for high resource utilization in clouds
Liu, J., Shen, H., & Narman, H. S. (2016) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2016.7840610 · Cited by 20
Local versus Regional Soil Screening Levels to Identify Potentially Polluted Areas
Boente, C., Gerassis, S., Albuquerque, T., Taboada, J., & Gallego, J. R. (2019) · Mathematical Geosciences · doi:10.1007/s11004-019-09792-x · Cited by 20
“The Space-Stat software v.4.0.18 from Biomedware was used for computation purposes (Goovaerts 1997; Albuquerque et al. 2017).”
MethodInfluentialStructural damage detection using Bayesian inference and seismic interferometry
Uzun, M., Sun, H., Smit, D., & Büyüköztürk, O. (2019) · Structural Control and Health Monitoring · doi:10.1002/stc.2445 · Cited by 20
First-Arrival Picking for Microseismic Monitoring Based on Deep Learning
Guo, X. (2021) · International Journal of Geophysics · doi:10.1155/2021/5548346 · Cited by 20
“Ghahramani has pointed out that Bayesian optimization is one of the most advanced and promising technologies in the artificial intelligence field [53].”
BackgroundRetractedOgunsina, K., & DeLaurentis, D. A. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104600 · Cited by 25
BDNNSurv: Bayesian Deep Neural Networks for Survival Analysis Using Pseudo Values
Feng, D., & Zhao, L. (2021) · Journal of Data Science · doi:10.6339/21-jds1018 · Cited by 20
Fernandes, P. H. E., Silva, G. C., Pitz, D. B., Schnelle, M., Koschek, K., Nagel, C., & Beber, V. C. (2023) · Applied Mechanics · doi:10.3390/applmech4010019 · Cited by 23
Building Next-Generation Marketing Teams Navigating the Role of AI and Emerging Digital Skills
Rathore, B. (2023) · Eduzone International peer reviewed/refereed academic multidisciplinary journal · doi:10.56614/eiprmj.v5i2y16.320 · Cited by 20
Real-time optimization of nuclear magnetic resonance experiments
Song, Y., Tang, Y., Hürlimann, M. D., & Cory, D. G. (2018) · Journal of Magnetic Resonance · doi:10.1016/j.jmr.2018.02.009 · Cited by 20
Calibrating Healthcare AI: Towards Reliable and Interpretable Deep Predictive ModelsPreprint
Thiagarajan, J. J., Sattigeri, P., Rajan, D., & Venkatesh, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.14480 · Cited by 24
“While there has been considerable effort in quantifying uncertainties in machine learning models and presenting users with expected variability in the predictions [7,8], they are not human interpretable unless they can be mapped to patterns in the input data.”
BackgroundKoh, D., Wang, Q., McGoldrick, B. C., Chou, C.-T., Liu, L., & Baldo, M. A. (2025) · Nano Letters · doi:10.1021/acs.nanolett.4c05728 · Cited by 20
“Aside from the well-known examples of probabilistic models [1] and cybersecurity [2], the recent rapid development of new artificial intelligence (AI) algorithms [3,4] further enhances the demand for efficient hardware with stochastic functionalities [5,6].”
BackgroundMouchabac, S., Leray, P., Adrien, V., Gollier-Briant, F., & Bonnot, O. (2021) · Journal of Medical Internet Research · doi:10.2196/24560 · Cited by 20
“There are several recent reviews and perspectives in this field [22,26-28].”
Liu, J., & Jiang, C. (2023) · Applied Mathematical Modelling · doi:10.1016/j.apm.2023.05.036 · Cited by 19
Optimized machine learning models for predicting crown convergence of plateau mountain tunnels
An, X., Zheng, F., Jiao, Y., Li, Z., Zhang, Y., & He, L. (2024) · Transportation Geotechnics · doi:10.1016/j.trgeo.2024.101254 · Cited by 21
Accuracy of machine learning to predict the outcomes of shoulder arthroplasty: a systematic review
Karimi, A. H., Langberg, J., Malige, A., Rahman, O., Abboud, J. A., & Stone, M. A. (2024) · Arthroplasty · doi:10.1186/s42836-024-00244-4 · Cited by 23
“Artificial intelligence (AI) utilizes computer systems to simulate cognitive capacities to accomplish goals such as problem-solving and decision-making [1, 2].”
BackgroundA Comprehensive Study on Self-Learning Methods and Implications to Autonomous Driving
Xing, J., Wei, D., Zhou, S., Wang, T., Huang, Y., & Chen, H. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3440498 · Cited by 28
“1) Learning: Learning in AI is the accumulation and summation of experience leading to the acquisition of a skill, the solution of a task, or the completion of exploiting knowledge or experience [18].”
Kyhoiesh, H. A. K., Salem, K. H., Elnaggar, A. Y., Al-Kubaisi, A. A., Azab, I. H. E., Mahmoud, M. H. H., Hamoodah, Z. J., & Nief, A. H. (2025) · Chemical Physics Letters · doi:10.1016/j.cplett.2025.142291 · Cited by 19
Li, J., Wang, D., & Zhang, M. (2019) · IEEE photonics journal · doi:10.1109/jphot.2019.2936426 · Cited by 23
“The DNN is selected due to its powerful nonlinear mapping ability where the simple one-hidden-layer DNN is capable of fitting any nonlinear continuous function with arbitrary accuracy [29], [30].”
Modeling Maximum Tsunami Heights Using Bayesian Neural Networks
Song, M.-J., & Cho, Y.-S. (2020) · Atmosphere · doi:10.3390/atmos11111266 · Cited by 19
Swarm Differential Privacy for Purpose-Driven Data-Information-Knowledge-Wisdom Architecture
Li, Y., Duan, Y., Maamar, Z., Che, H., Spulber, A.-B., & Fuentes, S. (2021) · Mobile Information Systems · doi:10.1155/2021/6671628 · Cited by 19
“Artificial intelligence [1, 2] has been in the limelight as a result of the abundant data stemmed from big data and acquired from multiple industries: healthcare, lifelog, Internet, and Internet of *ings (IoT).”
BackgroundSchneider, L., & Pablo, J. (2021) · Macromolecules · doi:10.1021/acs.macromol.1c01583 · Cited by 19
Liu, J. F., Jiang, C., & Zheng, J. (2022) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-021-03161-1 · Cited by 24
“After that, the mission of classification as well as regression can be properly solved (Ghahramani 2015; Hin-ton et al. 2012; Krizhevsky et al. 2012; LeCun et al. 2015; Mikolov et al. 2011; Ren et al. 2015).”
BackgroundGenerating highly accurate prediction hypotheses through collaborative ensemble learning
Arsov, N., Pavlovski, M., Basnarkov, L., & Kocarev, L. (2017) · Scientific Reports · doi:10.1038/srep44649 · Cited by 19
“There are three main approaches to institute generalization guarantees: (1) by providing bounds of various notions of functional space capacity- most notably, using the VC-dimension7; (2) by establishing connections between the stability of a learning algorithm and its ability to generalize8–10, and (3) by considering…”
Artificial Intelligence: A Child's Play
Kashyap, R. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.120555 · Cited by 23
A Bayesian Deep Learning Approach to Near‐Term Climate Prediction
Luo, X., Nadiga, B. T., Park, J. H., Ren, Y., Xu, W., & Yoo, S. (2022) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2022ms003058 · Cited by 18
“Estimation and quantification of the various sources of uncertainty is critical to establish the reliability of an ML model and provide an assessment of confidence in its predictions (Ghahramani, 2015).”
BackgroundWei, R.-Z., Liu, X., & Lyu, P. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e39352 · Cited by 18
“The application of machine learning algorithms also enables public administration to provide more personalized services and customize services and policies by analyzing personal data [39].”
BackgroundRecent advances in microfluidic biosensing technologies for the detection of infectious pathogens
Li, S. D., Chen, Z., Liu, C., Lin, H., Cui, L., Zhi, A., Huang, H., Liang, L., Yang, Z., Wen, H., et al. (2026) · Microchemical Journal · doi:10.1016/j.microc.2026.117188 · Cited by 18
The Probabilistic Termination Tool Amber
Moosbrugger, M., Bartocci, E., Katoen, J.-P., & Kovács, L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-90870-6_36 · Cited by 18
Bayesian parametric models for survival prediction in medical applications
Paolucci, I., Lin, Y., Silva, J. A. M., Brock, K. K., & Odisio, B. C. (2023) · BMC Medical Research Methodology · doi:10.1186/s12874-023-02059-4 · Cited by 18
“It is also essential for physicians who base their clinical decisions on such predictions to have a measure of uncertainty about a prediction [9].”
BackgroundMehdi, S., Borumand, M., & Hwang, G. (2024) · International Journal of Heat and Mass Transfer · doi:10.1016/j.ijheatmasstransfer.2024.125487 · Cited by 18
Machine learning-based prediction of hydrogen-assisted fatigue crack growth rate in Cr–Mo steel
Hu, J., Ma, K., Zhang, Z., Zhang, R., & Zheng, J. (2025) · International Journal of Hydrogen Energy · doi:10.1016/j.ijhydene.2025.03.370 · Cited by 18
Snyder, L. D., DePietro, M. R., Reich, M., Neely, M. L., Lugogo, N. L., Pleasants, R. A., Li, T., Granovsky, L., Brown, R., & SAFIOTI, G. G. (2025) · BMJ Open Respiratory Research · doi:10.1136/bmjresp-2024-002577 · Cited by 18
“25 Supervised learning, in which the model is ‘trained’ to classify data using input data with corresponding labels (or outcome), can determine if any relationships exist between the input data and the outcome label.”
Raja, M. N. A., Mercado, V., Abdoun, T. H., & El-Sekelly, W. (2025) · Georisk Assessment and Management of Risk for Engineered Systems and Geohazards · doi:10.1080/17499518.2025.2521870 · Cited by 18
Zhang, S., Li, S., Harley, R. G., & Habetler, T. G. (2018) · IEEE Energy Conversion Congress and Exposition (ECCE) · doi:10.1109/ecce.2018.8557480 · Cited by 22
An automatic diagnostic system based on deep learning, to diagnose hyperlipidemia
Zhang, Q., Liu, Y., Liu, G., Zhao, G., Qu, Z., & Yang, W. (2019) · Diabetes Metabolic Syndrome and Obesity · doi:10.2147/dmso.s198547 · Cited by 21
Alloghani, M. A., Baker, T., Al‐Jumeily, D., Hussain, A. J., Mustafina, J., & Aljaaf, A. J. (2019) · Studies in computational intelligence · doi:10.1007/978-3-030-28553-1_6 · Cited by 23
SNAPS: Sensor Analytics Point Solutions for Detection and Decision Support Systems
McLamore, E. S., Datta, S., Morgan, V., Cavallaro, N. D., Kiker, G. A., Jenkins, D. M., Rong, Y., Gomes, C. L., Claussen, J. C., Vanegas, D. C., et al. (2019) · Sensors · doi:10.3390/s19224935 · Cited by 57
Representing Uncertainty in Property Valuation Through a Bayesian Deep Learning Approach
Lee, C., & Park, K. K.-H. (2020) · Real Estate Management and Valuation · doi:10.1515/remav-2020-0028 · Cited by 18
“Representing model uncertainty, however, is indispensable for applications in the real-world (Ghahramani, 2015).”
BackgroundThe Evaluation of the Black Box Problem for AI-Based Recommendations: An Interview-Based Study
Ochmann, J., Zilker, S., & Laumer, S. (2021) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-86797-3_16 · Cited by 25
“…and explainability of data-based decisions are crucial for most business processes (e.g., recruiting of candidates) and medical (e.g., interpretation of radiographic images) or safety-critical (e.g., autonomous driving) as well as commercial (e.g., lending decisions) applications [7, 11, 12].”
BackgroundInfluentialGeneralization Performance of Pure Accuracy and its Application in Selective Ensemble Learning
Wang, J., Qian, Y., Li, F., Liang, J., & Zhang, Q. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3171436 · Cited by 24
“Designed by humans and induced from some limited data, the learning algorithms analogously have probabilities to generate randomness [1] and random consistency [2], [3].”
BackgroundThe Spring of Processing Chemistry in Perovskite Solar Cells–Bayesian Optimization
Song, Q., Bai, Y., & Chen, Q. H. (2022) · The Journal of Physical Chemistry Letters · doi:10.1021/acs.jpclett.2c02635 · Cited by 19
Machine learning using approximate inference : Variational and sequential Monte Carlo methods
Naesseth, C. A. (2018) · Linköping studies in science and technology. Dissertations · doi:10.3384/diss.diva-152647 · Cited by 20
“One of the most succesful coherent approaches to machine learning in the presence of uncertainty is probabilistic machine learning (Ghahramani, 2015).”
BackgroundEnd-To-End Prediction of Emotion from Heartbeat Data Collected by a Consumer Fitness Tracker
Harper, R. J., & Southern, J. (2019) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2019.8925520 · Cited by 22
“Uncertainty is a key component of decision-making in many real-world domains, especially healthcare [32].”
BackgroundA critical deconstruction of computer-based test application in Turkish State University
Ulum, Ö. G. (2020) · Education and Information Technologies · doi:10.1007/s10639-020-10199-z · Cited by 17
“…(b) interactive communication, in which computerized oral communication, comprehension and conversational exchanges are the principle practices (Ghahramani 2015); (c) intelligent content, in which text and voice analytics, comprehension, narration, and attitude judgment play a central role in…”
BackgroundLou, X., Zhou, Q., Dong, Z., Bai, L., Su, J., & Yue, H. (2025) · Journal of Orthopaedic Translation · doi:10.1016/j.jot.2025.07.010 · Cited by 17
“It encompasses multiple subfields, such as ML, DL, computer vision (CV), and natural language processing (NLP) [85 – 87].”
Hussain, T., Nugent, C., Moore, A., Liu, J., & Beard, A. (2021) · Sensors · doi:10.3390/s21134504 · Cited by 18
“Certain models, such as LR, inherently generate well-calibrated probabilities as they optimize the conditional probability P(X|Y) (also known as log loss) directly in the training phase and therefore usually do not require calibration [33].”
BackgroundMethodBaars, T., Gieseler, R. K. H., Patsalis, P., & Canbay, A. E. (2022) · Metabolism · doi:10.1016/j.metabol.2022.155179 · Cited by 19
Tracking the contribution of inductive bias to individualised internal models
Török, B., Nagy, D., Kiss, M. M., Janacsek, K., Németh, D., & Orbán, G. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010182 · Cited by 18
Tang, X., Zhu, J., Zhong, P., Yu, C., Zhang, B., & Hu, H. (2022) · Optics and Lasers in Engineering · doi:10.1016/j.optlaseng.2022.107281 · Cited by 17
Clinical Concept-Based Radiology Reports Classification Pipeline for Lung Carcinoma
Mithun, S., Jha, A. K., Sherkhane, U. B., Jaiswar, V., Purandare, N. C., Dekker, A. L. A. J., Puts, S., Bermejo, I., Rangarajan, V., Zegers, C. M. L., et al. (2023) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-023-00787-z · Cited by 18
“However, the ML and DL algorithms are probabilistic or statistical [51–53].”
MethodLi, H., Wang, Z., & Lin, W. (2023) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2023.3292339 · Cited by 18
“Compared with statistical regression, ML trains models through prediction [52], [53]andgenerallydoesnotrequireasignificancetest[54].”
MethodIdentifying healthy individuals with Alzheimer’s disease neuroimaging phenotypes in the UK Biobank
Azevedo, T., Bethlehem, R. A. I., Whiteside, D. J., Swaddiwudhipong, N., Rowe, J. B., Lió, P., Rittman, T., Initiative, T. A. D. N., Silbert, L. C., Lind, B., et al. (2023) · Communications Medicine · doi:10.1038/s43856-023-00313-w · Cited by 20
“A relatively recent trend applies a probabilistic approach to deep learning by using measures to describe Bayesian uncertainty 35,36 .”
Zhou, J. P., Tian, Q., Nazar, S., & Huang, J. (2023) · Materials Today Communications · doi:10.1016/j.mtcomm.2023.107885 · Cited by 17
A Network Intrusion Detection Method Based on Bagging Ensemble
Zhang, Z., Kong, S., Xiao, T. D., & Yang, A. (2024) · Symmetry · doi:10.3390/sym16070850 · Cited by 25
How Much Can We Learn from a Single Chromatographic Experiment? A Bayesian Perspective
Wiczling, P., & Kaliszan, R. (2015) · Analytical Chemistry · doi:10.1021/acs.analchem.5b03859 · Cited by 17
Inferential framework for two-fluid model of cryogenic chilldown
Luchinsky, D. G., Khasin, M., Timuçin, D. A., Sass, J. P., & Brown, B. L. (2017) · International Journal of Heat and Mass Transfer · doi:10.1016/j.ijheatmasstransfer.2017.06.097 · Cited by 17
“It is known that the best predictive performance is often obtained [71] using the most flexible system that can better adapt to the complexity of the data.”
BackgroundMethodInfluentialBayesian uncertainty quantification in linear models for diffusion MRI
Sjölund, J., Eklund, A., Özarslan, E., Herberthson, M., Bånkestad, M., & Knutsson, H. E. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.059 · Cited by 19
“It could then be viewed as part of a general framework called probabilistic programming (Ghahramani, 2015).”
BackgroundVirtual Materials Intelligence for Design and Discovery of Advanced Electrocatalysts
Malek, A., Eslamibidgoli, M. J., Mokhtari, M., Wang, Q., Eikerling, M. H., & Malek, K. (2019) · ChemPhysChem · doi:10.1002/cphc.201900570 · Cited by 17
Goel, S., & Bajpai, R. (2020) · Machine Learning and Knowledge Extraction · doi:10.3390/make2030014 · Cited by 19
“The uncertainties in predictions can be described in a probabilistic framework [20], which has a central role in machine learning models.”
BackgroundGao, J., Yang, H., Hu, G., Wang, C., & Robertson, N. M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58592-1_35 · Cited by 24
Metadata
- Authors
- Ghahramani, Z.
- Venue
- Nature
- Published
- 2015-05-27
- Volume
- 521
- Issue
- 7553
- Pages
- 452-459
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1494192115
- Cited by
- 1,995
- References
- 108
- Citations by year
- 2026: 166 · 2025: 231 · 2024: 228 · 2023: 206 · 2022: 217 · 2021: 265 · 2020: 235 · 2019: 210 · 2018: 102 · 2017: 84 · 2016: 39 · 2015: 11
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/I036575/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- stochastic modeling, machine learning, artificial intelligence, uncertainty representation, probabilistic programming, Bayesian optimization, data compression, experiential learning
- MeSH terms
- Artificial Intelligence, Automation, Bayes Theorem, Models, Statistical, Statistics, Nonparametric, Uncertainty, Data Compression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.