Probabilistic machine learning and artificial intelligence
The DOI matches its Crossref record; 104 of the 108 references it cites were found in a registry or an index.
Abstract
How can a machine learn from experience? Probabilistic modelling provides a framework for understanding what learning is, and has therefore emerged as one of the principal theoretical and practical approaches for designing machines that learn from data acquired through experience. The probabilistic framework, which describes how to represent and manipulate uncertainty about models and predictions, has a central role in scientific data analysis, machine learning, robotics, cognitive science and artificial intelligence. This Review provides an introduction to this framework, and discusses some of the state-of-the-art advances in the field, namely, probabilistic programming, Bayesian optimization, data compression and automatic model discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deriving from the Bayesian framework, GPR models have been widely applied to prognostic analysis as they are flexible, nonparametric and probabilistic [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ameliorate this in GPR, one way is to minimize the negative log marginal likelihood [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The performance of GPR is highly sensitive on the covariance function and the kernels should therefore be carefully selected to achieve high prediction accuracy [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These methods can be broadly classified into two categories: Bayesian approaches [40,90,106] and Frequentist, approaches [14,70,113]”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“recent advances using deep neural networks to solve challenging pattern recognition problems such as speech recognition [5], image classification [6, 7], and prediction of words in text [8], do not overtly represent the uncertainty in the structure or parameters of those neural networks.”
BackgroundA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“The HMM is a widely used probabilistic model for sequential and time-series data, which assumes the data were obtained by transitioning stochastically between a discrete number of hidden states 98 .”
MethodBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“The model could have a large number of parameters compared with the data set (for example, the neural network recently used to achieve translations of English and French sentences that approached the accuracy of state-of-the-art methods is a probabilistic model with 384 million parameters 29 ).”
MethodGaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Research works printed but not linked: 14
- [8] Bengio, Y., Ducharme, R., Vincent, P. & Janvin, C. A neural probabilistic language model. The Journal of Machine Learning Research 3 , 1137-1155 (2003). -
- Hinton, G. E., McClelland, J. L. & Rumelhart, D. E. in Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations 77–109 (MIT Press, 1986).
- Goodman, N. D. & Stuhlmüller, A. The Design and Implementation of Probabilistic Programming Languages. Available at http://dippl.org (2015).
- Mansinghka, V., Kulkarni, T. D., Perov, Y. N. & Tenenbaum, J. Approximate Bayesian image interpretation using generative probabilistic graphics programs. In Proc. Advances in Neural Information Processing Systems 26 1520–1528 (2013).
- Minka, T. P., Winn, J. M., Guiver, J. P. & Knowles, D. A. Infer.NET 2.4. http://research.microsoft.com/infernet (Microsoft Research, 2010).
- Pfeffer, A. Figaro: An Object-Oriented Probabilistic Programming Language. Tech. Rep. (Charles River Analytics, 2009).
- Mansinghka, V., Selsam, D. & Perov, Y. Venture: a higher-order probabilistic programming platform with programmable inference. Preprint at http://arxiv.org/abs/1404.0099 (2014). · arXiv
- Li, L., Wu, Y. & Russell, S. J. SWIFT: Compiled Inference for Probabilistic Programs. Report No. UCB/EECS-2015–12 (Univ. California, Berkeley, 2015).
- Bergstra, J. et al. Theano: a CPU and GPU math expression compiler. In Proc. 9th Python in Science Conference http://conference.scipy.org/proceedings/scipy2010/ (2010).
- Poupart, P. in Encyclopedia of Machine Learning 90–93 (Springer, 2010).
- Grosse, R. B., Salakhutdinov, R. & Tenenbaum, J. B. Exploiting compositionality to explore a large space of model structures. In Proc. Conference on Uncertainty in Artificial Intelligence 306–315 (2012).
- Welling, M. et al. Bayesian inference with big data: a snapshot from a workshop. ISBA Bulletin 21, https://bayesian.org/sites/default/files/fm/bulletins/1412.pdf (2014).
- Bakker, B. & Heskes, T. Task clustering and gating for Bayesian multitask learning. J. Mach. Learn. Res. 4, 83–99 (2003).
- Hensman, J., Fusi, N. & Lawrence, N. D. Gaussian processes for big data. In Proc. Conference on Uncertainty in Artificial Intelligence 244 (UAI, 2013).
Cited by
Items 401–500 of 1,004
Evaluating the impact of AI on insurance: The four emerging AI- and data-driven business models
Zarifis, A., Holland, C. P., & Milne, A. K. L. (2019) · Emerald Open Research · doi:10.35241/emeraldopenres.13249.1 · Cited by 51
Artificial intelligence in computer networks
Jaber, T. A. (2022) · Periodicals of Engineering and Natural Sciences (PEN) · doi:10.21533/pen.v10.i1.539 · Cited by 51
Kambara, M., Kawaguchi, S., Lee, H. J., Ikuse, K., Hamaguchi, S., Ohmori, T., & Ishikawa, K. (2022) · Japanese Journal of Applied Physics · doi:10.35848/1347-4065/ac9189 · Cited by 53
Biasing the quantum vacuum to control macroscopic probability distributions
Roques‐Carmes, C., Salamin, Y., Sloan, J., Choi, S., Velez, G., Koskas, E., Rivera, N., Kooi, S. E., Joannopoulos, J. D., & Soljacic, M. (2023) · Science · doi:10.1126/science.adh4920 · Cited by 60
Wang, N., Yang, W., Wang, B., Bai, X., Wang, X., & Xu, Q. (2024) · Bioresource Technology · doi:10.1016/j.biortech.2024.130663 · Cited by 53
A Comprehensive Survey on Big Data Analytics: Characteristics, Tools and Techniques
Shahnawaz, M., & Kumar, M. (2025) · ACM Computing Surveys · doi:10.1145/3718364 · Cited by 68
Enabling distributed intelligence assisted Future Internet of Things Controller (FITC)
Rahman, H., & Rahmani, R. (2017) · Applied Computing and Informatics · doi:10.1016/j.aci.2017.05.001 · Cited by 61
“To reap value from the raw-data, the data need to put into context to provide intelligence for converting into knowledge [3,23].”
BackgroundMethodInfluentialAutomatic Generation of Moment-Based Invariants for Prob-Solvable Loops
Bartocci, E., Kovács, L., & Stankovič, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-31784-3_15 · Cited by 51
Predicting seismic-induced liquefaction through ensemble learning frameworks
Alobaidi, M. H., Meguid, M. A., & Chebana, F. (2019) · Scientific Reports · doi:10.1038/s41598-019-48044-0 · Cited by 51
Exploring online intelligent teaching method with machine learning and SVM algorithm
Shuo, W., & Mu, M. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-05846-6 · Cited by 57
Machine learning for expediting next-generation of fire-retardant polymer composites
Jafari, P., Zhang, R., Huo, S., Wang, Q., Yong, J., Hong, M., Deo, R. C., Wang, H., & Song, P. (2023) · Composites Communications · doi:10.1016/j.coco.2023.101806 · Cited by 51
“ML algorithms optimize and discover functional materials in thermoelectric, photo-voltaic, catalytic, and optical fields [22 – 30].”
MethodPrediction and interpretation of concrete corrosion induced by carbon dioxide using machine learning
Wang, J., Zhang, Z., Liu, X., Shao, Y., Liu, X., & Wang, H. (2024) · Corrosion Science · doi:10.1016/j.corsci.2024.112100 · Cited by 53
Neural-Symbolic Methods for Knowledge Graph Reasoning: A Survey
Cheng, K., Ahmed, N. K., Rossi, R. A., Willke, T. L., & Sun, Y. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3686806 · Cited by 70
“While other surveys have been conducted to summarize the approaches to KG reasoning, these studies tend to focus on either traditional symbolic approaches [35, 95] or more recent neural approaches [19, 49, 115].”
Stem cells and extracellular vesicles: biological regulators of physiology and disease
Borgovan, T., Crawford, L. A., Nwizu, C. C., & Quesenberry, P. J. (2019) · American Journal of Physiology-Cell Physiology · doi:10.1152/ajpcell.00017.2019 · Cited by 55
Groot, O. Q., Bongers, M. E. R., Ogink, P. T., Senders, J. T., Karhade, A. V., Bramer, J. A. M., Verlaan, J., & Schwab, J. H. (2020) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000001360 · Cited by 57
“Artificial intelligence is the capability of computers to display intelligent behavior, as opposed to humans, who demonstrate natural intelligence [15, 20].”
BackgroundExplainable and trustworthy artificial intelligence for correctable modeling in chemical sciences
Feng, J., Lansford, J. L., Katsoulakis, M. A., & Vlachos, D. G. (2020) · Science Advances · doi:10.1126/sciadv.abc3204 · Cited by 50
“First, we introduce the use of Bayesian networks (20), a class of probabilistic graphical models (PGMs) (25), common in probabilistic artificial intelligence (AI) (26), to integrate simultaneously and systematically physics- and chemistrybased models, data, and expert knowledge.”
Song, M., Zhu, Y., Xing, X., & Du, J. (2024) · Behaviour & Information Technology · doi:10.1080/0144929x.2023.2285943 · Cited by 49
“…predict customers ’ possible inquiries, the ability to understand and interpret customers ’ natural language, analytical skills and the ability to provide e ff ective solutions (Ghahramani 2015), rather than the social-oriented interaction capabilities that the emotional connection fi eld emphasizes.”
Lee, M. A., Monteiro, A., Barclay, A., Marcar, J., Miteva-Neagu, M., & Parker, J. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.105103 · Cited by 49
Uncertainty estimation for deep learning-based automated analysis of 12-lead electrocardiograms
Vranken, J. F., van de Leur, R. R., Gupta, D. K., Juárez‐Orozco, L. E., Hassink, R. J., van der Harst, P., Doevendans, P. A., Gulshad, S., & van Es, R. (2021) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztab045 · Cited by 53
“7,8 It has been argued that the Softmax output (the probability distribution of predicted classes) of a regular DNN can also be interpreted as a measure of uncertainty.”
BackgroundLee, C., Choi, J., Park, H., Lee, C., Kim, C., Yoo, H., & Im, S. G. (2021) · Small · doi:10.1002/smll.202103365 · Cited by 49
Evaluation of Chatbots in the Emergency Management of Avulsion Injuries
Mustuloğlu, Ş., & Deniz, B. P. (2025) · Dental Traumatology · doi:10.1111/edt.13041 · Cited by 58
“As a result, asking the same question twice may not always yield the same answers [30].”
Prediction of tidal currents using Bayesian machine learning
Sarkar, D., Osborne, M. A., & Adcock, T. A. A. (2018) · Ocean Engineering · doi:10.1016/j.oceaneng.2018.03.007 · Cited by 49
“GPs represent a Bayesian non-parametric approach to modelling unknown functions, and have been widely used in solving a variety of regression problems (Ghahramani, 2015; Rasmussen and Williams).”
BackgroundMethodLee, A., Inceoglu, I., Hauser, O., & Greene, M. (2022) · The Leadership Quarterly · doi:10.1016/j.leaqua.2020.101426 · Cited by 48
Intelligent network intrusion detection system using optimized deep CNN-LSTM with UNSW-NB15
Thaljaoui, A. (2025) · International Journal of Information Technology · doi:10.1007/s41870-025-02416-0 · Cited by 64
Optimal Quantum Control with Poor Statistics
Sauvage, F., & Mintert, F. (2020) · PRX Quantum · doi:10.1103/prxquantum.1.020322 · Cited by 52
“[74] Z.”
BackgroundA common probabilistic framework for perceptual and statistical learning
Fiser, J., & Lengyel, G. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.09.007 · Cited by 53
Path Planning With Local Motion Estimations
Guzzi, J., Chavéz-García, R. O., Nava, M., Gambardella, L. M., & Giusti, A. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2972849 · Cited by 60
“In particular, by adopting probabilistic machine learning [3] tools, one can expect that any uncertainty in the estimator inputs is properly mapped to uncertainty in the”
MethodApplication and prospect of artificial intelligence in smart grid
Jiao, J. (2020) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/510/2/022012 · Cited by 48
Machine learning in medical imaging
Kumar, A., Bi, L., Kim, J., & Feng, D. D. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-816034-3.00005-5 · Cited by 53
Gradient Boosting Estimation of the Leaf Area Index of Apple Orchards in UAV Remote Sensing
Liu, Z., Guo, P., Liu, H., Fan, P., Zeng, P., Liu, X., Feng, C., Wang, W., & Yang, F. (2021) · Remote Sensing · doi:10.3390/rs13163263 · Cited by 53
Deep learning of dispersion engineering in two-dimensional phononic crystals
Miao, X.-B., Dong, H., & Wang, Y. (2021) · Engineering Optimization · doi:10.1080/0305215x.2021.1988587 · Cited by 48
“Through the learning process, the model can extract latent relationships from the abstract training samples, which difficult for a human to find (Ghahramani 2015).”
MethodMultivariate Deep Evidential RegressionPreprint
Meinert, N., & Lavin, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.06135 · Cited by 57
“Observed data can be consistent with many models, and therefore which model is appropriate given the data is uncertain [12].”
ResultThe Role of Artificial Intelligence and Machine Learning Techniques: Race for COVID-19 Vaccine
Kannan, S., Subbaram, K., Ali, S., & Kannan, H. (2020) · Archives of Clinical Infectious Diseases · doi:10.5812/archcid.103232 · Cited by 53
Water quality prediction using LSTM with combined normalizer for efficient water management
Mahesh, N., Babu, J. J., Nithya, K., & Arunmozhi, S. A. (2024) · Desalination and Water Treatment · doi:10.1016/j.dwt.2024.100183 · Cited by 47
Zhang, R., Li, X., Zhao, M., Wan, C., Luo, X., Liu, S., Zhang, Y., Wang, Y., Yu, G., & Han, X. (2024) · Advanced Science · doi:10.1002/advs.202402182 · Cited by 51
Liu, Q., Liu, T., Liu, Z., Wang, Y., Jin, Y., & Wen, W. (2018) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2018.8297407 · Cited by 47
Sparse Convolutional Neural Networks for Genome-Wide Prediction
Waldmann, P., Pfeiffer, C., & Mészáros, G. (2020) · Frontiers in Genetics · doi:10.3389/fgene.2020.00025 · Cited by 52
“A major direction of machine learning is to develop ef fi cient algorithms for analysis and model prediction of large scale data sets (Ghahramani, 2015; Jordan and Mitchell, 2015).”
MethodToxicological assessment of agrochemicals on bees using machine learning tools
Bernardes, R. C., Botina, L. L., da Silva, F. P., Fernandes, K. M., Lima, M. A. P., & Martins, G. F. (2021) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2021.127344 · Cited by 53
A visual introduction to Gaussian Belief PropagationPreprint
Ortiz, J., Evans, T., & Davison, A. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.02308 · Cited by 62
“Bayesian probability theory is the fundamental framework for dealing with uncertain data, and is at the core of practical systems in machine learning and robotics [23, 11].”
BackgroundRETRACTED ARTICLE: Localization and segmentation of metal cracks using deep learning
Aslam, Y., Santhi, N., Ramasamy, N., & Ramar, K. (2020) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-01803-8 · Cited by 50
“Better work efficiency, faster detection, ability to work in extreme conditions, long work schedule, lower maintenance cost, etc. are the main positives of using computer-aided detection over manual procedure (Ghahramani 2015).”
MethodRetractedSun, M., & Huang, B. (2023) · Advanced Energy Materials · doi:10.1002/aenm.202301948 · Cited by 46
Uncertainty quantification in multiaxial fatigue life prediction using Bayesian neural networks
He, G., Zhao, Y., & Yan, C. (2024) · Engineering Fracture Mechanics · doi:10.1016/j.engfracmech.2024.109961 · Cited by 49
Synthetic biology routes to bio-artificial intelligence
Nesbeth, D., Zaikin, A. A., Saka, Y., Romano, M. C., Giuraniuc, C. V., Игоревич, К. О., & Laptyeva, T. V. (2016) · Essays in Biochemistry · doi:10.1042/ebc20160014 · Cited by 53
Artificial Intelligence and Pharmacometrics: Time to Embrace, Capitalize, and Advance?
Chaturvedula, A., Calad-Thomson, S., Liu, C., Sale, M. E., Gattu, N., & Goyal, N. (2019) · CPT Pharmacometrics & Systems Pharmacology · doi:10.1002/psp4.12418 · Cited by 46
“DL represents learning using multiple processing layers, whereas ML techniques use learning algorithms that self- learn and improve efficiency for a period of time.(2) There have already been significant contributions of AI in medicine, and some notable examples include the diagnosis of tuberculosis,(3) metastasis of…”
MethodCai, N., Sun, P. C., & Jiang, S. (2021) · Journal of Materials Chemistry A · doi:10.1039/d1ta04092h · Cited by 47
BayeStab: Predicting effects of mutations on protein stability with uncertainty quantification
Wang, S., Tang, H., Zhao, Y., & Zuo, L. (2022) · Protein Science · doi:10.1002/pro.4467 · Cited by 43
“36 The key idea behind the probabilistic machine learning is to infer plausible models from the data with uncertainty.”
BackgroundLin, L., Zhong, Z., Li, C., Gorman, A. R., Wei, H., Kuang, Y., Wen, S., Cai, Z., & Hao, F. (2024) · Earth-Science Reviews · doi:10.1016/j.earscirev.2024.104887 · Cited by 52
Zhao, J., Lv, Z., Li, D., Feng, X., Wang, Z., Wu, Y., Shi, D., Fowler, M. W., & Burke, A. F. (2024) · eTransportation · doi:10.1016/j.etran.2024.100364 · Cited by 48
Probabilistic photonic computing with chaotic light
Brückerhoff‐Plückelmann, F., Borras, H., Klein, B., Varri, A., Becker, M., Dijkstra, J., Brückerhoff, M., Wright, C. D., Salinga, M., Bhaskaran, H., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-54931-6 · Cited by 59
“Consequently, BNNs are also significantly more robust against overfitting to small data sets 16,17 .”
A Stochastic Quasi-Newton Method for Large-Scale Nonconvex Optimization With Applications
Chen, H., Wu, H. C., Chan, S. C., & Lam, W.-H. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2957843 · Cited by 50
Machine learning for medical imaging‐based COVID‐19 detection and diagnosis
Rehouma, R., Büchert, M., & Chen, Y. P. (2021) · International Journal of Intelligent Systems · doi:10.1002/int.22504 · Cited by 50
“As data is an essential component of ML techniques, 15 the quality of data representation plays a critical role in the performance of ML models; thus the availability of large quantities of data with balanced representation provides opportunities to achieve high performing detection and prediction…”
BackgroundWei, N., Zhang, Q., Zhang, Y., Jin, J., Chang, J., Yang, Z., Ma, C., Jia, Z., Ren, C., Wu, L., et al. (2021) · Environment International · doi:10.1016/j.envint.2021.106977 · Cited by 45
Battery Prognostics and Health Management for Electric Vehicles Under Industry 4.0
Zhao, J., & Burke, A. F. (2023) · Journal of Energy Chemistry · doi:10.1016/j.jechem.2023.04.042 · Cited by 44
Tang, J., Liu, G., & Pan, Q. (2022) · Journal of Systems Engineering and Electronics · doi:10.23919/jsee.2022.000109 · Cited by 44
A flexible RUL prediction method based on poly-cell LSTM with applications to lithium battery data
Wang, J., Zhang, F., Zhang, J., Liu, W., & Zhou, K. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108976 · Cited by 46
AI-driven development of high-performance solid-state hydrogen storage
Wang, G., Luo, Z., Desta, H. G., Chen, M., Dong, Y., & Lin, B. (2024) · Energy Reviews · doi:10.1016/j.enrev.2024.100106 · Cited by 46
Kang, M., Kim, E., Temoçin, Z., Li, J., Dadachova, E., Wang, Z., Panzella, L., Napolitano, A., Bentley, W. E., & Payne, G. F. (2018) · Chemistry of Materials · doi:10.1021/acs.chemmater.8b02428 · Cited by 46
Hung, C.-Y., Lin, C., Lan, T., Peng, G.-S., & Lee, C.-C. (2019) · PLoS ONE · doi:10.1371/journal.pone.0213007 · Cited by 50
“[32] It is capable of modeling complex non-linear relationships between predictive variables without prior statistical assumptions.[33] Moreover, when given a sufficiently large amount of data, the DNN may outperform conventional statistical methods due to its non-linear learning structure.”
MethodZhang, X., Chen, M. Y., Wang, M., Ge, Y.-E., & Stanley, E. (2019) · Applied Mathematics and Computation · doi:10.1016/j.amc.2019.05.043 · Cited by 44
This is the moment for probabilistic loops
Moosbrugger, M., Stankovič, M., Bartocci, E., & Kovács, L. (2022) · Proceedings of the ACM on Programming Languages · doi:10.1145/3563341 · Cited by 49
“As such, PPs offer a unifying framework to naturally encode probabilistic machine learning models [Ghahramani 2015], for example Bayesian networks [Kaminski et al. 2016], into programs.”
BackgroundQiu, X., Meyerson, E., & Miikkulainen, R. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00588 · Cited by 47
“For real-world decision makers, representing the model uncertainty is of crucial importance [10, 13, 20].”
BackgroundNguyen, H. T., Nguyen, K. T. Q., Le, T. C., & Zhang, G. (2021) · Molecules · doi:10.3390/molecules26041022 · Cited by 43
“Unlike the CFD approach, ML uses a series of algorithms to construct statistical models to carry out predictions based on sample data instead of relying on existing knowledge [22,23].”
MethodNew LZ and PW(Z) relations of RR Lyrae stars calibrated withGaiaEDR3 parallaxes
Garofalo, A., Delgado, H. E., Sarro, L. M., Clementini, G., Muraveva, T., Marconi, M., & Ripepi, V. (2022) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stac735 · Cited by 53
Towards Integrative Machine Learning and Knowledge Extraction
Holzinger, A., Goebel, R. G., Palade, V., & Ferri, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-69775-8_1 · Cited by 43
Probabilistic modelling and reconstruction of strain
Jidling, C., Hendriks, J., Wahlström, N., Gregg, A., Schön, T. B., Wensrich, C. M., & Wills, A. (2018) · Nuclear Instruments and Methods in Physics Research Section B Beam Interactions with Materials and Atoms · doi:10.1016/j.nimb.2018.08.051 · Cited by 43
“The solution technique presented in this work relies upon the concept of probabilistic modelling (Ghahramani, 2015).”
MethodA Fast Distributed Variational Bayesian Filtering for Multisensor LTV System With Non-Gaussian Noise
Li, J., Deng, F. Y., & Chen, J. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2815697 · Cited by 44
Wang, Y., Guo, T., Liu, G., Li, T., Lv, S., Song, S., Cheng, Y., Song, W., Ren, K., & Song, Z. (2019) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.8b22580 · Cited by 43
Pang, G., & Karniadakis, G. E. (2020) · Nonlinear systems and complexity · doi:10.1007/978-3-030-44992-6_14 · Cited by 43
Design of an expert system architecture: An overview
Durgaprasad, J., Ganesh, B., & Manjunatha, L. (2021) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1767/1/012036 · Cited by 56
Smart Crop Recommender System-A Machine Learning Approach
Ray, R. K., Das, S. K., & Chakravarty, S. (2022) · International Conference on Cloud Computing, Data Science & Engineering (Confluence) · doi:10.1109/confluence52989.2022.9734173 · Cited by 50
“There exists multiple distribution functions i.e., probability density function, cumulative density function, parametric density function, and non-parametric density function which can also be called as kernel density function [6].”
BackgroundZhou, J., Ji, N., Wang, G., Zhang, Y., Song, H., Yuan, Y., Yang, C., Jin, Y., Zhang, Z., Zhang, L., et al. (2022) · EBioMedicine · doi:10.1016/j.ebiom.2022.104097 · Cited by 43
Learning under Model Misspecification: Applications to Variational and Ensemble methodsPreprint
Masegosa, A. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.08335 · Cited by 95
Wearable MOF biosensors: A new frontier in real-time health monitoring
Rabiee, N. (2025) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2025.118156 · Cited by 43
Economic complexity unfolded: Interpretable model for the productive structure of economies
Utkovski, Z., Pradier, M. F., Stojkoski, V., Pérez‐Cruz, F., & Kocarev, L. (2018) · PLoS ONE · doi:10.1371/journal.pone.0200822 · Cited by 49
Xu, H., Zhang, X., Ye, Z., Jiang, L., Qiu, X., Tian, Y., Zhu, Y. P., & Cao, W. (2021) · European Journal of Agronomy · doi:10.1016/j.eja.2021.126335 · Cited by 44
A machine learning route between band mapping and band structure
Xian, R. P., Stimper, V., Zacharias, M., Dendzik, M., Dong, S., Beaulieu, S., Schölkopf, B., Wolf, M., Rettig, L., Carbogno, C., et al. (2022) · Nature Computational Science · doi:10.1038/s43588-022-00382-2 · Cited by 49
“We exploit the connection between theory and experiment in our framework, based on a probabilistic machine-learning 21,22 model, to approximate the intensity data from band-mapping experiments.”
MethodRecent advances in photocatalytic hydrogen evolution of AgIn5S8‐based photocatalysts
Zheng, X., Yang, Y., Song, Y., Ma, Z., Gao, Q., Liu, Y., Li, J., Wu, X., Wang, X., Mao, W., et al. (2023) · Interdisciplinary materials · doi:10.1002/idm2.12120 · Cited by 41
AI in software programming: understanding emotional responses to GitHub Copilot
Eshraghian, F., Hafezieh, N., Farivar, F., & de Cesare, S. (2024) · Information Technology and People · doi:10.1108/itp-01-2023-0084 · Cited by 49
Industrial batch process monitoring with limited data
Tulsyan, A., Garvin, C., & Undey, C. (2019) · Journal of Process Control · doi:10.1016/j.jprocont.2019.03.002 · Cited by 39
Cataldo, S. D., Vinco, S., Urgese, G., Calignano, F., Ficarra, E., Macii, A., & Macii, E. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3054628 · Cited by 49
“In Computer Science, Artificial Intelligence (AI) refers to the capability of a machine of interacting with the environment to take decisions, exploiting attitudes that are traditionally associated to humans [112].”
Generation of Tunable Stochastic Sequences Using the Insulator–Metal Transition
del Valle, J., Salev, P., Gariglio, S., Kalcheim, Y., Schuller, I. K., & Triscone, J. (2022) · Nano Letters · doi:10.1021/acs.nanolett.1c04404 · Cited by 46
Leitherer, A., Yeo, B. C., Liebscher, C. H., & Ghiringhelli, L. M. (2023) · npj Computational Materials · doi:10.1038/s41524-023-01133-1 · Cited by 47
Soize, C. (2023) · Mathematics and Mechanics of Complex Systems · doi:10.2140/memocs.2023.11.87 · Cited by 41
Liu, Y., Ma, S., Yang, Z., Wu, D., Zhao, Y., Avdeev, M., & Shi, S. (2025) · Journal of Materiomics · doi:10.1016/j.jmat.2025.101066 · Cited by 51
On the Generation of Probabilistic Forecasts From Deterministic Models
Camporeale, E., Chu, X., Agapitov, O. V., & Bortnik, J. (2019) · Space Weather · doi:10.1029/2018sw002026 · Cited by 46
Recognition of Handwritten Chinese Characters Based on Concept Learning
Liang, X., Wang, Y., Li, X., & Pan, M. H. (2019) · IEEE Access · doi:10.1109/access.2019.2930799 · Cited by 40
“’’ In a study byGhahramani [26], a conceptual model framework describing the methods of learning from data using experiential knowledge was proposed.”
BackgroundBayesian differential programming for robust systems identification under uncertainty
Yang, Y., Bhouri, M. A., & Perdikaris, P. G. (2020) · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.26226/morressier.5f5f8e69aa777f8ba5bd6168 · Cited by 55
Ma, J., Zhang, J., Li, R., Zheng, H., & Li, W. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2021.105235 · Cited by 40
Geng, X., Wu, S., Zhang, Y., Sun, J., Cheng, H., Zhang, Z., & Pu, S. (2023) · Natural Hazards · doi:10.1007/s11069-023-06137-0 · Cited by 39
Shi, K., Gu, D., Liu, H., Chen, Y., & Lin, K. (2023) · Virtual and Physical Prototyping · doi:10.1080/17452759.2023.2266641 · Cited by 43
“By converting the prior probability distribution (before analysing the data) into a posterior probability distribution (after analysing data) through Bayesian theory, GPR can infer unobserved quantities (including structural, parametric and noise-related) [48].”
Artificial intelligence interventions in 2D MXenes-based photocatalytic applications
Mahapatra, D. M., Kumar, A., Kumar, R., Gupta, N. K., Ethiraj, B., & Singh, L. (2025) · Coordination Chemistry Reviews · doi:10.1016/j.ccr.2025.216460 · Cited by 39
Computational Methods for the Discovery of Metabolic Markers of Complex Traits
Lee, M. Y., & Hu, T. (2019) · Metabolites · doi:10.3390/metabo9040066 · Cited by 41
“The curation of large-volume, high-dimensional big data across multiple disciplines has been driving the methodological development of machine-learning algorithms [66,67].”
BackgroundBayesian deep learning with hierarchical prior: Predictions from limited and noisy data
Luo, X., & Kareem, A. (2020) · Structural Safety · doi:10.1016/j.strusafe.2019.101918 · Cited by 40
“To date, most machine learning models are deterministic, which implies that a certain input sample xi is strictly bounded to a point estimator ŷi notwithstanding the existence of model uncertainties [7, 8].”
BackgroundPrediction of vestibular schwannoma recurrence using artificial neural network
Abouzari, M., Goshtasbi, K., Sarna, B., Khosravi, P., Reutershan, T., Mostaghni, N., Lin, H. W., & Djalilian, H. R. (2020) · Laryngoscope Investigative Otolaryngology · doi:10.1002/lio2.362 · Cited by 39
“nostic/management accuracy and thus result in better treatment decisions and more appropriate use of health care resources.(6-10) Prediction of recurrence especially in cancer patients is one promising application of both regression and ANN models.”
MethodChen, X., & Geyer, P. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.118240 · Cited by 44
Sound and Complete Certificates for Quantitative Termination Analysis of Probabilistic Programs
Chatterjee, K., Goharshady, A. K., Meggendorfer, T., & Žikelić, Đ. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-13185-1_4 · Cited by 39
“They provide an expressive framework for specifying probabilistic models and have been used in machine learning [22,39], network analysis [20], robotics [41] and security [4].”
MethodMachine Learning and Knowledge Extraction in Digital Pathology Needs an Integrative Approach
Holzinger, A., Malle, B., Kieseberg, P., Roth, P. M., Müller, H., Reihs, R., & Zatloukal, K. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-69775-8_2 · Cited by 43
“This is particularly the case in personalized medicine where there might be a large amount of data, but there is still a relatively small amount of data for each patient available [7].”
BackgroundBayesian machine learning for virtual flow metering
Sandnes, A. T. (2024) · NORA - Norwegian Open Research Archives · Cited by 40
Physics-guided Bayesian neural networks by ABC-SS: Application to reinforced concrete columns
Fernández, J., Chiachío, J., Chiachío, M., Barros, J., & Corbetta, M. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105790 · Cited by 43
Wang, L., Zeng, W., Cao, R., Zhuo, Y., Fu, J., & Wang, J. (2023) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.129697 · Cited by 38
Metadata
- Authors
- Ghahramani, Z.
- Venue
- Nature
- Published
- 2015-05-27
- Volume
- 521
- Issue
- 7553
- Pages
- 452-459
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1494192115
- Cited by
- 1,995
- References
- 108
- Citations by year
- 2026: 166 · 2025: 231 · 2024: 228 · 2023: 206 · 2022: 217 · 2021: 265 · 2020: 235 · 2019: 210 · 2018: 102 · 2017: 84 · 2016: 39 · 2015: 11
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/I036575/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- stochastic modeling, machine learning, artificial intelligence, uncertainty representation, probabilistic programming, Bayesian optimization, data compression, experiential learning
- MeSH terms
- Artificial Intelligence, Automation, Bayes Theorem, Models, Statistical, Statistics, Nonparametric, Uncertainty, Data Compression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.