Probabilistic machine learning and artificial intelligence
The DOI matches its Crossref record; 104 of the 108 references it cites were found in a registry or an index.
Abstract
How can a machine learn from experience? Probabilistic modelling provides a framework for understanding what learning is, and has therefore emerged as one of the principal theoretical and practical approaches for designing machines that learn from data acquired through experience. The probabilistic framework, which describes how to represent and manipulate uncertainty about models and predictions, has a central role in scientific data analysis, machine learning, robotics, cognitive science and artificial intelligence. This Review provides an introduction to this framework, and discusses some of the state-of-the-art advances in the field, namely, probabilistic programming, Bayesian optimization, data compression and automatic model discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deriving from the Bayesian framework, GPR models have been widely applied to prognostic analysis as they are flexible, nonparametric and probabilistic [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ameliorate this in GPR, one way is to minimize the negative log marginal likelihood [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The performance of GPR is highly sensitive on the covariance function and the kernels should therefore be carefully selected to achieve high prediction accuracy [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These methods can be broadly classified into two categories: Bayesian approaches [40,90,106] and Frequentist, approaches [14,70,113]”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“recent advances using deep neural networks to solve challenging pattern recognition problems such as speech recognition [5], image classification [6, 7], and prediction of words in text [8], do not overtly represent the uncertainty in the structure or parameters of those neural networks.”
BackgroundA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“The HMM is a widely used probabilistic model for sequential and time-series data, which assumes the data were obtained by transitioning stochastically between a discrete number of hidden states 98 .”
MethodBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“The model could have a large number of parameters compared with the data set (for example, the neural network recently used to achieve translations of English and French sentences that approached the accuracy of state-of-the-art methods is a probabilistic model with 384 million parameters 29 ).”
MethodGaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Research works printed but not linked: 14
- [8] Bengio, Y., Ducharme, R., Vincent, P. & Janvin, C. A neural probabilistic language model. The Journal of Machine Learning Research 3 , 1137-1155 (2003). -
- Hinton, G. E., McClelland, J. L. & Rumelhart, D. E. in Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations 77–109 (MIT Press, 1986).
- Goodman, N. D. & Stuhlmüller, A. The Design and Implementation of Probabilistic Programming Languages. Available at http://dippl.org (2015).
- Mansinghka, V., Kulkarni, T. D., Perov, Y. N. & Tenenbaum, J. Approximate Bayesian image interpretation using generative probabilistic graphics programs. In Proc. Advances in Neural Information Processing Systems 26 1520–1528 (2013).
- Minka, T. P., Winn, J. M., Guiver, J. P. & Knowles, D. A. Infer.NET 2.4. http://research.microsoft.com/infernet (Microsoft Research, 2010).
- Pfeffer, A. Figaro: An Object-Oriented Probabilistic Programming Language. Tech. Rep. (Charles River Analytics, 2009).
- Mansinghka, V., Selsam, D. & Perov, Y. Venture: a higher-order probabilistic programming platform with programmable inference. Preprint at http://arxiv.org/abs/1404.0099 (2014). · arXiv
- Li, L., Wu, Y. & Russell, S. J. SWIFT: Compiled Inference for Probabilistic Programs. Report No. UCB/EECS-2015–12 (Univ. California, Berkeley, 2015).
- Bergstra, J. et al. Theano: a CPU and GPU math expression compiler. In Proc. 9th Python in Science Conference http://conference.scipy.org/proceedings/scipy2010/ (2010).
- Poupart, P. in Encyclopedia of Machine Learning 90–93 (Springer, 2010).
- Grosse, R. B., Salakhutdinov, R. & Tenenbaum, J. B. Exploiting compositionality to explore a large space of model structures. In Proc. Conference on Uncertainty in Artificial Intelligence 306–315 (2012).
- Welling, M. et al. Bayesian inference with big data: a snapshot from a workshop. ISBA Bulletin 21, https://bayesian.org/sites/default/files/fm/bulletins/1412.pdf (2014).
- Bakker, B. & Heskes, T. Task clustering and gating for Bayesian multitask learning. J. Mach. Learn. Res. 4, 83–99 (2003).
- Hensman, J., Fusi, N. & Lawrence, N. D. Gaussian processes for big data. In Proc. Conference on Uncertainty in Artificial Intelligence 244 (UAI, 2013).
Cited by
Items 501–600 of 1,004
Brain Tumour Classification Using Quantum Support Vector Machine Learning Algorithm
Kumar, T., Kumar, D., & Singh, G. (2023) · IETE Journal of Research · doi:10.1080/03772063.2023.2245350 · Cited by 48
“It is classified as supervised [15], unsupervised [16], and reinforced [17] machine learning.”
Recent advances and applications of machine learning in electrocatalysis
Hu, Y., Chen, J., Wei, Z. X., He, Q., & Zhao, Y. (2023) · Journal of Materials Informatics · doi:10.20517/jmi.2023.23 · Cited by 44
Grigo, C., & Koutsourelakis, P. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.053 · Cited by 41
“The significant progress that has been materialized in the fields of statistical or machine learning Ghahramani (2015) in the last few years, particularly in the context of Deep Learning LeCun et al. (2015); Goodfellow et al.”
BackgroundInfluentialSolomon, S., Saxena, R. C., Neradilek, M. B., Hau, V., Fong, C. T., Lang, J. D., Posner, K. L., & Nair, B. G. (2020) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000004636 · Cited by 41
Is Artificial Intelligence Ready for Standardization?
Zielke, T. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-56441-4_19 · Cited by 40
Soize, C., & Ghanem, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113777 · Cited by 39
A systematic review of multivariate uncertainty quantification for engineering systems
Grenyer, A., Erkoyuncu, J. A., Zhao, Y., & Roy, R. (2021) · CIRP journal of manufacturing science and technology · doi:10.1016/j.cirpj.2021.03.004 · Cited by 38
Ex Situ Transfer of Bayesian Neural Networks to Resistive Memory‐Based Inference Hardware
Dalgaty, T., Esmanhotto, E., Castellani, N., Querlioz, D., & Vianello, E. (2021) · Advanced Intelligent Systems · doi:10.1002/aisy.202000103 · Cited by 41
Performance enhancement of artificial intelligence: A survey
Krichen, M., & Abdalzaher, M. S. (2024) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2024.104034 · Cited by 41
Predictive collective variable discovery with deep Bayesian models
Schöberl, M., Zabaras, N. J., & Koutsourelakis, P. (2019) · The Journal of Chemical Physics · doi:10.1063/1.5058063 · Cited by 39
Xiang, Z., Tang, C., Chang, C., & Liu, G. (2020) · Nano Research · doi:10.1007/s12274-020-3016-1 · Cited by 39
Naloufi, M., Lucas, F. S., Souihi, S., Servais, P., Janne, A., & Abreu, T. W. M. (2021) · Water · doi:10.3390/w13182457 · Cited by 38
Uncertainty quantification of inverse analysis for geomaterials using probabilistic programming
Zhao, H., Li, S., Zang, X., Liu, X., Zhang, L., & Ren, J. (2023) · Journal of Rock Mechanics and Geotechnical Engineering · doi:10.1016/j.jrmge.2023.07.014 · Cited by 37
Artificial Intelligence in Anesthetic Care: A Survey of Physician Anesthesiologists
Estrada Alamo, C. E., Diatta, F., Monsell, S. E., & Lane-Fall, M. B. (2024) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000006752 · Cited by 36
“10,11 .”
Evidential classification of incomplete instance based on K-nearest centroid neighbor
Ma, Z., Liu, Z., Luo, C., & Song, L. (2021) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-210991 · Cited by 38
Yu, X., Yang, Y., Xie, C., Li, Y., Zhao, B., Zhang, L., Song, J., & Deng, Z. (2023) · IEEE Transactions on Transportation Electrification · doi:10.1109/tte.2023.3336324 · Cited by 36
“Since predictive outcomes may occasionally be unreliable, the absence of uncertainty quantification could render the method unable to provide confidence and assess the usability of the prediction [38].”
BackgroundMachine Learning With Computer Networks: Techniques, Datasets, and Models
Afifi, H., Pochaba, S., Boltres, A., Laniewski, D., Haberer, J., Paeleke, L., Poorzare, R., Stolpmann, D., Wehner, N., Redder, A., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3384460 · Cited by 45
“Uncertainty may exist in the input data, in the decision model parameters and output values and even in the architecture of the decision model itself [30].”
Photonic probabilistic machine learning using quantum vacuum noise
Choi, S., Salamin, Y., Roques‐Carmes, C., Dangovski, R., Luo, D., Chen, Z., Horodynski, M., Sloan, J., Uddin, S. Z., & Soljacic, M. (2024) · Nature Communications · doi:10.1038/s41467-024-51509-0 · Cited by 45
Liu, N., Deng, W., & Ayub, A. F. M. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13349-3 · Cited by 37
“Among these, the advanced simulation and application of human language stand out, laying the foundation for AI’s transformative potential in language education (Ghahramani, 2015).”
Entropy-based closure for probabilistic learning on manifolds
Soize, C., Ghanem, R., Safta, C., Huan, X., Vane, Z. P., Oefelein, J. C., Lacaze, G., Najm, H. N., Tang, Q., & Chen, X. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.12.029 · Cited by 36
“Statistical and probabilistic learning methods have been extensively developed (see for instance, [3, 4, 5, 6, 7, 8, 9, 10, 11, 12]) and play an increasingly important role in computational physics and engineering science [13], in particular for design optimization with underlying stochastic…”
Kaltenbach, S., & Koutsourelakis, P. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109673 · Cited by 46
“Data-based methodologies have also been fueled by recent advances in statistical [3] or machine learning [4] which, in large part, have been enabled by large datasets (and the computational means to leverage them).”
MethodTask space adaptation via the learning of gait controllers of magnetic soft millirobots
Demir, S. Ö., Çulha, U., Karacakol, A. C., Pena‐Francesch, A., Trimpe, S., & Sitti, M. (2021) · The International Journal of Robotics Research · doi:10.1177/02783649211021869 · Cited by 39
“Conversely, Bayesian optimization (BO) (Ghahramani, 2015; Shahriari et al., 2015) allows for the maximization of a performance function using a small number of physical experiments.”
BackgroundA Taxonomy of Food Supply Chain Problems from a Computational Intelligence Perspective
Angarita-Zapata, J. S., Alonso‐Vicario, A., Masegosa, A. D., & Legarda, J. (2021) · Sensors · doi:10.3390/s21206910 · Cited by 42
“And third, a model can have diverse parameters (e.g., the coefficients of linear regression) and/or different inner structures (e.g., the architecture of ANNs); hence, there is uncertainty regarding the specifications for a concrete model [54].”
BackgroundMC-CIM: Compute-in-Memory With Monte-Carlo Dropouts for Bayesian Edge Intelligence
Shukla, P., Nasrin, S., Darabi, N., Gomes, W., & Trivedi, A. R. (2022) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2022.3224703 · Cited by 40
“To enhance the predictive robustness of neural networks, a Bayesian approach for neural network inference is attracting attention [2].”
MethodApplication of Bayesian Generative Adversarial Networks to Geological Facies Modeling
Feng, R., Graña, D., Mukerji, T., & Mosegaard, K. (2022) · Mathematical Geosciences · doi:10.1007/s11004-022-09994-w · Cited by 36
“Alternatively,aBayesianinterpretationofdeeplearningcanbeproposedtocombine deep learning and probabilistic formulations (Ghahramani 2015).”
BackgroundImproving Industrial Robot Positioning Accuracy to the Microscale Using Machine Learning Method
Bučinskas, V., Dzedzickis, A., Šumanas, M., Šutinys, E., Petkevičius, S., Butkiene, J., Viržonis, D., & Morkvėnaitė-Vilkončienė, I. (2022) · Machines · doi:10.3390/machines10100940 · Cited by 38
Machine Learning Algorithms for Financial Asset Price ForecastingPreprint
Ndikum, P. (2020) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2004.01504 · Cited by 48
“In the ML literature there has also been a movement away from the development of point forecasts models to Bayesian techniques which allow for probabilistic forecasts [98]–[101].”
BackgroundProbabilistic Deep Learning to Quantify Uncertainty in Air Quality Forecasting
Murad, A., Kraemer, F. A., Bach, K., & Taylor, G. (2021) · Sensors · doi:10.3390/s21238009 · Cited by 44
“Progress in probabilistic machine learning [1] and, more recently, in probabilistic deep learning led to the development of practical tools to estimate uncertainty about models and predictions [2–7].”
BackgroundBahroun, Z., Tanash, M., As’ad, R. A., & Alnajar, M. (2023) · Management Systems in Production Engineering · doi:10.2478/mspe-2023-0017 · Cited by 49
“In essence, ML is a key method for automating the process by which robots make meaningful use of data [6].”
Song, C., Wang, X., Xu, S., Zhao, C., & Huang, Z. (2024) · Applied Acoustics · doi:10.1016/j.apacoust.2024.109906 · Cited by 35
Li, H., Zhang, J., Yang, X., Ye, M., Jiang, W., Gong, J., Tian, Y., Zhao, L., Wang, W., & Xu, Z. (2024) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2024.136675 · Cited by 35
Liu, X., Li, Y., Zhang, X., Zhao, Y.-M., Wang, X., Zhou, J., Shen, J., Zhou, M., & Shen, L. (2025) · Journal of Materials Chemistry A · doi:10.1039/d4ta07683d · Cited by 35
Safety and reliability analysis of lithium-ion batteries with real-time health monitoring
Khan, A., Naqvi, I. H., Bhargava, C., Lin, C.-P., Boles, S. T., Kong, L., & PECHT, M. G. (2025) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2025.115408 · Cited by 38
Optimizing the sustainable performance of public buildings: A hybrid machine learning algorithm
Xu, W. H., Wu, X., Xiong, S., Li, T., & Liu, Y. (2025) · Energy · doi:10.1016/j.energy.2025.135283 · Cited by 36
Nuclear safety in the unexpected second nuclear era
Wu, Y., Chen, Z., Wang, Z., Chen, S., Ge, D., Chen, C., Jia, J., Li, Y., Jin, M., Zhou, T., et al. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1820007116 · Cited by 38
“Collection and analysis techniques that can be applied to huge amounts of data should be studied, such as artificial intelligence (AI) (63) and big data (64).”
BackgroundScientometric Analysis of Artificial Intelligence (AI) for Geohazard Research
Jiang, S., Ma, J., Liu, Z., & Guo, H. (2022) · Sensors · doi:10.3390/s22207814 · Cited by 37
Probabilistic learning of nonlinear dynamical systems using sequential Monte Carlo
Schön, T. B., Svensson, A., Murray, L. M., & Lindsten, F. (2017) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2017.10.033 · Cited by 35
“A good introduction to the ideas underlying probabilistic modeling in contemporary machine learning is provided by Ghahramani (2015) and from a system identification point of view we recommend Peterka (1981).”
BackgroundVariational Bayesian Multiple Instance Learning with Gaussian Processes
Haußmann, M., Hamprecht, F. A., & Kandemir, M. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.93 · Cited by 45
“The probabilistic nature of GPs allows them to handle uncertainty in a principled manner [10].”
BackgroundBounded expectations: resource analysis for probabilistic programs
Ngo, V. C., Carbonneaux, Q., & Hoffmann, J. (2018) · ACM SIGPLAN Notices · doi:10.1145/3296979.3192394 · Cited by 35
Predicting Acute Kidney Injury after Cardiac Surgery by Machine Learning Approaches
Thongprayoon, C., Hansrivijit, P., Bathini, T. J., Vallabhajosyula, S., Mekraksakit, P., Kaewput, W., & Cheungpasitporn, W. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9061767 · Cited by 38
Possibilities and Challenges of Compounding Artificial Intelligence in India’s Educational LandscapePreprint
Alam, A. (2020) · SSRN Electronic Journal · Cited by 35
Bayesian Deep Learning via Subnetwork InferencePreprint
Daxberger, E., Nalisnick, E., Allingham, J. U., Antorán, J., & Hernández-Lobato, J. M. (2020) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.2010.14689 · Cited by 95
“Bayesian modeling (Bishop, 2006; Ghahramani, 2015) Equal contribution (1)University of Cambridge (2)Max Planck Institute for Intelligent Systems, Tübingen (3)University of Amsterdam (4)Microsoft Research (5)The Alan Turing Institute.”
BackgroundClaudy, M. C., Aquino, K., & Graso, M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.898027 · Cited by 34
“…(Robert et al., 2020), have made many optimistic that AI will soon eliminate human biases and overcome the limitations that often lead to injustice and suboptimal allocation decisions (Ghahramani, 2015; Silver et al., 2017; Singh et al., 2017; Mozer et al., 2019; Glikson and Woolley, 2020).”
BackgroundSing, D. C., Metz, L. N., & Dudli, S. (2017) · Spine · doi:10.1097/brs.0000000000002079 · Cited by 34
PMAF: an algebraic framework for static analysis of probabilistic programs
Wang, D., Hoffmann, J., & Reps, T. (2018) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3192366.3192408 · Cited by 45
“Probabilistic programming is becoming increasingly popular because it provides a rich framework for implementing randomized algorithms [5], cryptography protocols [6], cognitive [39] models, and machine learning [37] algorithms.”
BackgroundCyber-Physical Security Design in Multimedia Data Cache Resource Allocation for Industrial Networks
Jiang, B., Yang, J., Ding, G., & Wang, H. H. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2917693 · Cited by 37
“W ITH the development of artificial intelligence technology, it promotes all kinds of fields for industry [1], [2].”
BackgroundWong, M., & Farooq, B. (2019) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2019.11.022 · Cited by 37
“Variational Bayesian inference combines prior knowledge and empirical evidence to resolve uncertainty and adapt to noisy datasets through data-driven algorithms such as neural networks and generative models [18].”
BackgroundEvaluating soil nutrients of Dacrydium pectinatum in China using machine learning techniques
Wu, C., Chen, Y., Hong, X., Liu, Z., & Peng, C. H. (2020) · Forest Ecosystems · doi:10.1186/s40663-020-00232-5 · Cited by 36
“Currently, machine learning (ML) models have become increasingly popular in agricultural industry and forestry for classification and discrimination (Ghahramani 2015; Shine et al. 2018).”
BackgroundBrain Tumor Segmentation Using Deep Capsule Network and Latent-Dynamic Conditional Random Fields
Elmezain, M., Mahmoud, A., Mosa, D. T., & Said, W. (2022) · Journal of Imaging · doi:10.3390/jimaging8070190 · Cited by 36
“Probabilistic machine learning and artificial intelligence [10] 2015 An overview of stochastic machine learning techniques and the applications of these approaches.”
BackgroundFrom Large Language Models to Databases and Back: A Discussion on Research and Education
Amer-Yahia, S., Bonifati, A., Chen, L., Li, G., Shim, K., Xu, J., & Yang, X. (2023) · ACM SIGMOD Record · doi:10.1145/3631504.3631518 · Cited by 34
Zaidan, M. A., Dada, L., Alghamdi, M. A., Al-Jeelani, H., Lihavainen, H., Hyvärinen, A., & Hussein, T. (2019) · Applied Sciences · doi:10.3390/app9204475 · Cited by 34
“Probabilistic modelling framework takes into account the uncertainty in modelling by using probability theory to express all forms of uncertainty [39].”
MethodSaurabh, K., Sharma, V., Singh, U., Khondoker, R., Vyas, R., & Vyas, O. P. (2024) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-024-08935-5 · Cited by 39
From human-computer interaction to cognitive infocommunications: A cognitive science perspective
Török, Á. (2016) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2016.7804588 · Cited by 33
“The reason why commands are still dominating interaction between humans and computers is that before the machine learning revolution (up until very recently) collaborative interaction was highly ineffective [20].”
BackgroundKuhn, C. B., Hofbauer, M., Petrović, G., & Steinbach, E. G. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3044813 · Cited by 36
Modelling spatial patterns in host‐associated microbial communities
Ruuskanen, M. O., Sommeria‐Klein, G., Havulinna, A. S., Niiranen, T., & Lahti, L. (2021) · Environmental Microbiology · doi:10.1111/1462-2920.15462 · Cited by 33
“These approaches can be divided into two broad categories, which we review in the subsequent two sections in a spatial context: classical machine learning approaches, for instance, based on decision/regression trees or neural networks, and probabilistic modelling approaches, sometimes referred to as ‘probabilistic mac…”
BackgroundInfluentialCentral moment analysis for cost accumulators in probabilistic programs
Wang, D., Hoffmann, J., & Reps, T. (2021) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3453483.3454062 · Cited by 33
“Researchers have used probabilistic programs to implement and analyze randomized algorithms [2], cryptographic protocols [3], and machine-learning algorithms [15].”
MethodControllable SiOx Nanorod Memristive Neuron for Probabilistic Bayesian Inference
Choi, S., Kim, G. S., Yang, J., Cho, H., Kang, C., & Wang, G. (2021) · Advanced Materials · doi:10.1002/adma.202104598 · Cited by 35
Quantifying the uncertainty of precipitation forecasting using probabilistic deep learning
Xu, L., Chen, N., Yang, C., Yu, H., & Chen, Z. (2022) · Hydrology and earth system sciences · doi:10.5194/hess-26-2923-2022 · Cited by 36
A Bibliometric Review on Artificial Intelligence for Smart Buildings
Luo, J. (2022) · Sustainability · doi:10.3390/su141610230 · Cited by 37
Tensor Networks for Interpretable and Efficient Quantum-Inspired Machine Learning
Ran, S.-J., & Su, G. (2023) · Intelligent Computing · doi:10.34133/icomputing.0061 · Cited by 40
“The probabilistic ML models [14], such as Bayesian networks [15] and Boltzmann machines [16] (a type of Markov random fields), are regarded to be “white-box” and intrinsically interpretable.”
MethodChang, F., Dong, S., Yin, H., Ye, X., Wu, Z., Zhang, W., & Zhu, H. (2025) · Journal of Rock Mechanics and Geotechnical Engineering · doi:10.1016/j.jrmge.2024.10.033 · Cited by 39
Mulat, M., Banicod, R. J. S., Tabassum, N., Javaid, A., Kim, T., Kim, Y., & Khan, F. (2025) · Journal of Microbiological Methods · doi:10.1016/j.mimet.2025.107232 · Cited by 35
Ultrasound Nerve Segmentation Using Deep Probabilistic Programming
Rubasinghe, I., & Meedeniya, D. (2019) · Journal of ICT Research and Applications · doi:10.5614/itbj.ict.res.appl.2019.13.3.5 · Cited by 32
Know Your Cognitive Environment! Mental Models as Crucial Determinant of Offloading Preferences
Weis, P. P., & Wiese, E. (2022) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820956861 · Cited by 29
“…(e.g., the steady increase in processing power; Schaller, 1997), software and algorithms (e.g., modeling uncertainty in probabilistic programming; Ghahramani, 2015), and embodiment (e.g., the creation of intelligent virtual agents; Cassell et al., 2000; or improving the social component of robot…”
BackgroundPly-drop design of non-conventional laminated composites using Bayesian optimization
Yamaguchi, K., Phenisee, S. E., Chen, Z., Salviato, M., & Yang, J. (2020) · Composites Part A Applied Science and Manufacturing · doi:10.1016/j.compositesa.2020.106136 · Cited by 32
Introspective Black Box Failure Prediction for Autonomous Driving
Kuhn, C. B., Hofbauer, M., Petrović, G., & Steinbach, E. G. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304844 · Cited by 35
Examining the use of artificial intelligence in recruitment processes
Karaboga, U., & Vardarlıer, P. (2020) · Bussecon Review of Social Sciences (2687-2285) · doi:10.36096/brss.v2i4.234 · Cited by 47
Earth’s gradients as the engine of plate tectonics and earthquakes
Zaccagnino, D., & Doglioni, C. (2022) · Rivista Del Nuovo Cimento · doi:10.1007/s40766-022-00038-x · Cited by 33
“Recently, artificial intelligence has burst into the world of Earth sciences with dramatic improvement of seismic data acquisition [77] and geodetic signal resolution [78], while its effective power to push forward our comprehension and ability to predict still poorly understood phenomena such as earthquake remains un…”
ResultA novel semi-supervised fault detection and isolation method for battery system of electric vehicles
Yang, J., Cheng, F., Liu, Z., Duodu, M. M., & Zhang, M. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.121650 · Cited by 32
The Human KernelPreprint
Wilson, A. G., Dann, C., Lucas, C. G., & Xing, E. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.07389 · Cited by 36
“In recent years, probabilistic modelling has become a cornerstone of machine learning approaches [2, 3, 4], with applications in neural processing [5, 6, 3, 7] and human learning [8, 9].”
BackgroundLearning to Control in Power Systems: Design and Analysis Guidelines for Concrete Safety Problems
Dobbe, R., Hidalgo-Gonzalez, P., Karagiannopoulos, S., Henriquez-Auba, R., Hug, G., Callaway, D. S., & Tomlin, C. J. (2020) · Electric Power Systems Research · doi:10.1016/j.epsr.2020.106615 · Cited by 31
Ensemble learning algorithms based on easyensemble sampling for financial distress prediction
Liu, W., Suzuki, Y., & Du, S. (2025) · Annals of Operations Research · doi:10.1007/s10479-025-06494-y · Cited by 36
“Probabilistic models have become a mainstream approach in the field of artificial intelligence and machine learning (Ghahramani, 2015).”
Machine learning applications for agricultural impacts under extreme events
Gaitán, C. F. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-814895-2.00007-0 · Cited by 37
Enhancing Network Security Via Machine Learning: Opportunities and Challenges
Amrollahi, M., Hadayeghparast, S., Karimipour, H., Derakhshan, F., & Srivastava, G. (2020) · Springer eBooks · doi:10.1007/978-3-030-38557-6_8 · Cited by 35
Performance Evaluation of CNN-Based End-Point Detection Using In-Situ Plasma Etching Data
Kim, B., Im, S., & Yoo, G. (2020) · Electronics · doi:10.3390/electronics10010049 · Cited by 32
Robust optimization of SVM hyper-parameters for spillway type selection
Gül, E., Alpaslan, N., & Emiroğlu, M. E. (2021) · Ain Shams Engineering Journal · doi:10.1016/j.asej.2020.10.022 · Cited by 31
Gaussian process latent class choice models
Sfeir, G., Rodrigues, F., & Abou-Zeid, M. (2022) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2022.103552 · Cited by 34
“On the other hand, parametric models are constrained to the functional forms they assume, which restricts the flexibility of the learning process and might lead to poor generalization or prediction accuracies (Ghahramani, 2015).”
BackgroundZhang, L., Hu, Y., Wang, C., Tang, Q., & Li, X. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.04.019 · Cited by 31
Optimizing Age of Information and Security of the Next-Generation Internet of Everything Systems
Asheralieva, A., & Niyato, D. T. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3173912 · Cited by 32
“To deal with hidden types, the BRL model uses the Bayesian inference method [49], [50], where the beliefs are updated according to Bayes’ rule based on the model-specific relationships between the observed state transitions and hidden types of the POMDP.”
MethodWu, Y., She, D., Xia, J., Song, J., Xiao, T., & Zhou, Y. (2023) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.129116 · Cited by 32
Accelerating Monte Carlo methods for Bayesian inference in dynamical models
Dahlin, J. (2016) · Linköping studies in science and technology. Dissertations · doi:10.3384/diss.diva-125992 · Cited by 31
“A standard approach for forecasting and decision making is to make use of probabilistic models (Ghahramani, 2015), which are created by combining some pre-defined model with observations from the true system.”
BackgroundPearce, T., Anastassacos, N., Zaki, M., & Neely, A. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.11324 · Cited by 33
“This has been used with success (Gal & Ghahramani, 2015; Osband et al., 2016).”
BackgroundMethodSong, Z., Yang, Z., Hou, M., & Shi, X. (2022) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2022.951881 · Cited by 34
Unsupervised learning for medical data: A review of probabilistic factorization methods
Neijzen, D., & Lunter, G. A. (2023) · Statistics in Medicine · doi:10.1002/sim.9924 · Cited by 32
“In the models, we discussed this always includes the number of latent dimensions K ; in LDA we also have for example, the prior parameters 𝛼 , 𝛽 , 97,105 The performance of a model depends on these hyperparameters; in fact, models with different choices for hyperparameters can be regarded as…”
BackgroundMethodMashhadimoslem, H., Abdol, M. A., Zanganeh, K. E., Shafeen, A., AlHammadi, A. A., Kamkar, M., & Elkamel, A. (2024) · ACS Applied Energy Materials · doi:10.1021/acsaem.4c01465 · Cited by 30
Analysing brain networks in population neuroscience: a case for the Bayesian philosophy
Bzdok, D., Floris, D. L., & Marquand, A. F. (2020) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2019.0661 · Cited by 30
Hopkins, D., Rickwood, D., Hallford, D. J., & Watsford, C. R. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.945006 · Cited by 33
“Machine learning (ML) is a subfield of artificial intelligence (AI) and refers to the ability of computers to “learn” through algorithms (a defined set of instructions) on datasets (17, 18).”
BackgroundReliable and Intelligent Fault Diagnosis With Evidential VGG Neural Networks
Zhou, H., Chen, W., Cheng, L., Williams, D., de Silva, C. W., & Xia, M. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3250308 · Cited by 46
“Bayesian-based methods provide a theoretical framework for uncertainty estimation by casting dropout training in conventional deep networks as a Bayesian approximation of a Gaussian process [12].”
MethodGao, J., Zeng, W., Ren, Z., Ao, C., Lei, G., Gaiser, T., & Srivastava, A. K. (2023) · Agronomy · doi:10.3390/agronomy13051400 · Cited by 33
“The Bayesian optimization method [49] was first used to adjust the parameters within a given range, and then the parameters were manually optimized slightly.”
MethodProbabilistic programming: A review for environmental modellers
Krapu, C., & Borsuk, M. E. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.01.014 · Cited by 32
Deep Bayesian Active Learning, A Brief Survey on Recent AdvancesPreprint
Mohamadi, S., & Amindavar, H. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.08044 · Cited by 32
“tainty representation and even better generalization on small amount of data [20].”
BackgroundSchröder, H. C., Neufurth, M., Zhou, H., Wang, S., Wang, X., & Müller, W. E. G. (2022) · International Journal of Nanomedicine · doi:10.2147/ijn.s389819 · Cited by 29
“By coupling with a decision-making system and an effector, polyP as a sensor together with the ALP/ADK system could even be part of a bio-artificial intelligence system.(155,156) Future studies need to demonstrate the potential existence”
MethodWani, S. R., & Suthar, M. (2024) · Multiscale and Multidisciplinary Modeling Experiments and Design · doi:10.1007/s41939-024-00601-5 · Cited by 30
“ML is the discipline where processors are programmed to study information, combining both scientific principles and creative approaches (Ghahramani 2015).”
What does the mind learn? A comparison of human and machine learning representations
Spicer, J., & Sanborn, A. N. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.02.004 · Cited by 37
“Recent years have also offered a more advanced form of this representation in ‘program’ models [42,43], which use Bayesian induction to construct complex production procedures from more basic elements.”
BackgroundGhost Imputation: Accurately Reconstructing Missing Data of the Off Period
Rawassizadeh, R., Keshavarz, H., & Pazzani, M. J. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2914653 · Cited by 30
“1 One of the inevitable challenges of real-world data analysis is uncertainty rising from noise and missing data [16].”
BackgroundBianchi, J., Ruellas, A. C. D. O., Prieto, J. C., Li, T., Soroushmehr, S. M. R., Najarian, K., Gryak, J., Deleat‐Besson, R., Le, C., Yatabe, M., et al. (2021) · Seminars in Orthodontics · doi:10.1053/j.sodo.2021.05.004 · Cited by 33
Research on Artificial Intelligence Interaction in Computer-Aided Arts and Crafts
Deng, J., & Chen, X. (2021) · Mobile Information Systems · doi:10.1155/2021/5519257 · Cited by 37
A data value metric for quantifying information content and utility
Noshad, M., CHOI, J.-C., Sun, Y., Hero, A. O., & Dinov, I. D. (2021) · Journal Of Big Data · doi:10.1186/s40537-021-00446-6 · Cited by 29
The Use of Machine Learning for the Care of Hypertension and Heart Failure
Cai, A., Zhu, Y., Clarkson, S. A., & Feng, Y. (2021) · JACC Asia · doi:10.1016/j.jacasi.2021.07.005 · Cited by 31
Rapid Perception of Public Opinion in Emergency Events through Social Media
Chen, Y., Li, Y., Wang, Z., Quintero, A. J., Yang, C. P., & Ji, W. (2021) · Natural Hazards Review · doi:10.1061/(asce)nh.1527-6996.0000547 · Cited by 32
Metadata
- Authors
- Ghahramani, Z.
- Venue
- Nature
- Published
- 2015-05-27
- Volume
- 521
- Issue
- 7553
- Pages
- 452-459
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1494192115
- Cited by
- 1,995
- References
- 108
- Citations by year
- 2026: 166 · 2025: 231 · 2024: 228 · 2023: 206 · 2022: 217 · 2021: 265 · 2020: 235 · 2019: 210 · 2018: 102 · 2017: 84 · 2016: 39 · 2015: 11
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/I036575/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- stochastic modeling, machine learning, artificial intelligence, uncertainty representation, probabilistic programming, Bayesian optimization, data compression, experiential learning
- MeSH terms
- Artificial Intelligence, Automation, Bayes Theorem, Models, Statistical, Statistics, Nonparametric, Uncertainty, Data Compression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.