Probabilistic machine learning and artificial intelligence
The DOI matches its Crossref record; 104 of the 108 references it cites were found in a registry or an index.
Abstract
How can a machine learn from experience? Probabilistic modelling provides a framework for understanding what learning is, and has therefore emerged as one of the principal theoretical and practical approaches for designing machines that learn from data acquired through experience. The probabilistic framework, which describes how to represent and manipulate uncertainty about models and predictions, has a central role in scientific data analysis, machine learning, robotics, cognitive science and artificial intelligence. This Review provides an introduction to this framework, and discusses some of the state-of-the-art advances in the field, namely, probabilistic programming, Bayesian optimization, data compression and automatic model discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deriving from the Bayesian framework, GPR models have been widely applied to prognostic analysis as they are flexible, nonparametric and probabilistic [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ameliorate this in GPR, one way is to minimize the negative log marginal likelihood [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The performance of GPR is highly sensitive on the covariance function and the kernels should therefore be carefully selected to achieve high prediction accuracy [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These methods can be broadly classified into two categories: Bayesian approaches [40,90,106] and Frequentist, approaches [14,70,113]”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“recent advances using deep neural networks to solve challenging pattern recognition problems such as speech recognition [5], image classification [6, 7], and prediction of words in text [8], do not overtly represent the uncertainty in the structure or parameters of those neural networks.”
BackgroundA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“The HMM is a widely used probabilistic model for sequential and time-series data, which assumes the data were obtained by transitioning stochastically between a discrete number of hidden states 98 .”
MethodBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“The model could have a large number of parameters compared with the data set (for example, the neural network recently used to achieve translations of English and French sentences that approached the accuracy of state-of-the-art methods is a probabilistic model with 384 million parameters 29 ).”
MethodGaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Research works printed but not linked: 14
- [8] Bengio, Y., Ducharme, R., Vincent, P. & Janvin, C. A neural probabilistic language model. The Journal of Machine Learning Research 3 , 1137-1155 (2003). -
- Hinton, G. E., McClelland, J. L. & Rumelhart, D. E. in Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations 77–109 (MIT Press, 1986).
- Goodman, N. D. & Stuhlmüller, A. The Design and Implementation of Probabilistic Programming Languages. Available at http://dippl.org (2015).
- Mansinghka, V., Kulkarni, T. D., Perov, Y. N. & Tenenbaum, J. Approximate Bayesian image interpretation using generative probabilistic graphics programs. In Proc. Advances in Neural Information Processing Systems 26 1520–1528 (2013).
- Minka, T. P., Winn, J. M., Guiver, J. P. & Knowles, D. A. Infer.NET 2.4. http://research.microsoft.com/infernet (Microsoft Research, 2010).
- Pfeffer, A. Figaro: An Object-Oriented Probabilistic Programming Language. Tech. Rep. (Charles River Analytics, 2009).
- Mansinghka, V., Selsam, D. & Perov, Y. Venture: a higher-order probabilistic programming platform with programmable inference. Preprint at http://arxiv.org/abs/1404.0099 (2014). · arXiv
- Li, L., Wu, Y. & Russell, S. J. SWIFT: Compiled Inference for Probabilistic Programs. Report No. UCB/EECS-2015–12 (Univ. California, Berkeley, 2015).
- Bergstra, J. et al. Theano: a CPU and GPU math expression compiler. In Proc. 9th Python in Science Conference http://conference.scipy.org/proceedings/scipy2010/ (2010).
- Poupart, P. in Encyclopedia of Machine Learning 90–93 (Springer, 2010).
- Grosse, R. B., Salakhutdinov, R. & Tenenbaum, J. B. Exploiting compositionality to explore a large space of model structures. In Proc. Conference on Uncertainty in Artificial Intelligence 306–315 (2012).
- Welling, M. et al. Bayesian inference with big data: a snapshot from a workshop. ISBA Bulletin 21, https://bayesian.org/sites/default/files/fm/bulletins/1412.pdf (2014).
- Bakker, B. & Heskes, T. Task clustering and gating for Bayesian multitask learning. J. Mach. Learn. Res. 4, 83–99 (2003).
- Hensman, J., Fusi, N. & Lawrence, N. D. Gaussian processes for big data. In Proc. Conference on Uncertainty in Artificial Intelligence 244 (UAI, 2013).
Cited by
Items 201–300 of 1,004
An Active Inference Approach to Modeling Structure Learning: Concept Learning as an Example Case
Smith, R., Schwartenbeck, P., Parr, T., & Friston, K. J. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00041 · Cited by 99
“Other recent hierarchical Bayesian approaches in cognitive science have made progress in this domain, however, by modeling concepts as types of probabilistic programs (Ghahramani, 2015; Goodman, Tenenbaum, & Gerstenberg, 2015; Lake et al., 2015).”
BackgroundA machine learning approach to predict the success of crowdfunding fintech project
Yeh, J.-Y., & Chen, C. (2020) · Journal of Enterprise Information Management · doi:10.1108/jeim-01-2019-0017 · Cited by 119
Merging data curation and machine learning to improve nanomedicines
Chen, C., Yaari, Z. A., Apfelbaum, E., Grodzinski, P. A., Shamay, Y., & Heller, D. A. (2022) · Advanced Drug Delivery Reviews · doi:10.1016/j.addr.2022.114172 · Cited by 124
Machine learning for battery research
Wei, Z. X., He, Q., & Zhao, Y. (2022) · Journal of Power Sources · doi:10.1016/j.jpowsour.2022.232125 · Cited by 122
Artificial intelligence: revolutionizing cardiology with large language models
Boonstra, M., Weissenbacher, D., Moore, J. H., Gonzalez‐Hernandez, G., & Asselbergs, F. W. (2024) · European Heart Journal · doi:10.1093/eurheartj/ehad838 · Cited by 132
“3,4 Furthermore, when trained with reinforcement learning, the model lets users immediately prompt modifications to the output through subsequent interactions, improving its answers to better fit the needs of the users.”
Senanayake, S. J., White, N. M., Graves, N., Healy, H. G., Baboolal, K., & Kularatna, S. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.103957 · Cited by 118
“…(ML) is a suite of methods whose theoretical construct may lead to improved predictive performance over conventional statistical modelling (13) (Supplementary File 1) ML is an efficient way of analysing large quantities of data and identifying hidden associations in complex data sets (14, 15) .”
BackgroundKohonen, P., Parkkinen, J. A., Willighagen, E. L., Ceder, R., Wennerberg, K., Kaski, S., & Grafström, R. C. (2017) · Nature Communications · doi:10.1038/ncomms15932 · Cited by 110
Coupling and convergence for Hamiltonian Monte Carlo
Bou-Rabee, N. M., Eberle, A., & Zimmer, R. (2020) · The Annals of Applied Probability · doi:10.1214/19-aap1528 · Cited by 180
“In conjunction with Bayesian methods, MCMC has revolutionized statistics and enabled applications of statistical inference to machine learning, pattern recognition, and artificial intelligence [2, 20, 39, 3, 10].”
MethodYang, Y., Zhang, J., Zang, G., & Pu, J. (2019) · PubMed · doi:10.11909/j.issn.1671-5411.2019.08.010 · Cited by 95
AI-Assisted Exploration of Superionic Glass-Type Li + Conductors with Aromatic Structures
Hatakeyama‐Sato, K., Tezuka, T., Umeki, M., & Oyaizu, K. (2020) · Journal of the American Chemical Society · doi:10.1021/jacs.9b11442 · Cited by 114
Bounded expectations: resource analysis for probabilistic programs
Ngo, V. C., Carbonneaux, Q., & Hoffmann, J. (2018) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3192366.3192394 · Cited by 113
“Probabilistic programming [64, 77] is an increasingly popular technique for implementing and analyzing Bayesian Networks and Markov Chains [41], randomized algorithms [9], cryptographic constructions [11], and machine-learning algorithms [40].”
MethodMultifidelity Information Fusion Algorithms for High-Dimensional Systems and Massive Data sets
Perdikaris, P., Venturi, D., & Karniadakis, G. E. (2016) · SIAM Journal on Scientific Computing · doi:10.1137/15m1055164 · Cited by 115
“Decision making in data-rich yet budget-constrained environments necessitates the adoption of a probabilistic machine learning [1] mindset that combines versatile tools, ranging from experiments to multifidelity simulations to expert opinions, ultimately shaping new frontiers in data analytics, surrogate-based modelin…”
BackgroundCreation and application of virtual patient cohorts of heart models
Niederer, S. A., Aboelkassem, Y., Cantwell, C. D., Corrado, C., Coveney, S., Cherry, E. M., Delhaas, T., Fenton, F. H., Panfilov, A. V., Pathmanathan, P., et al. (2020) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2019.0558 · Cited by 103
“On the other hand, machine learning—especially its probabilistic version [47]—provides efficient approaches for clustering, dimensionality reduction and constraining models.”
BackgroundSemantic Communication: A Survey on Research Landscape, Challenges, and Future Directions
Getu, T. M., Kaddoum, G., & Bennis, M. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3520707 · Cited by 110
The Bayesian sampler: Generic Bayesian inference causes incoherence in human probability judgments.
Zhu, J.-Q., Sanborn, A. N., & Chater, N. (2020) · Psychological Review · doi:10.1037/rev0000190 · Cited by 97
“Such methods are routinely used to approximate probabilistic calculations in Bayesian machine learning (Craiu & Rosenthal, 2014; Ghahramani, 2015; Neal, 2011), artificial intelligence (Frey, Dayan, & Hinton, 1997), and cognitive science (Chater & Manning, 2006; Chater & Oaksford, 2008; Tenenbaum,…”
MethodFuture Developments in Geographical Agent‐Based Models: Challenges and Opportunities
Heppenstall, A. J., Crooks, A. T., Malleson, N., Manley, E., Ge, J., & Batty, M. (2020) · Geographical Analysis · doi:10.1111/gean.12267 · Cited by 121
“Probabilistic programing (Ghahramani 2015; Grazzini, Richiardi, and Tsionas 2017) and reinforcement learning (Dhalke et al. 2020; Wooldridge 2020) both offer mechanisms for im - proving behavioral responses, enabling agents to be more proactive than reactive.”
BackgroundMethodMissing well log prediction using convolutional long short-term memory network
Pham, N. H., Wu, X., & Naeini, E. Z. (2020) · Geophysics · doi:10.1190/geo2019-0282.1 · Cited by 107
“To understand the uncertainty of neural networks, we can express the training and prediction phase of deep learning using Bayes’ rule (Ghahramani, 2015).”
MethodInfluentialCalisto, F. M., Santiago, C., Nunes, N., & Nascimento, J. C. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102607 · Cited by 118
Self-Learning Perfect Optical Chirality via a Deep Neural Network
Li, Y., Xu, Y., Jiang, M., Li, B., Han, T., Chi, C., Lin, F., Shen, B., Zhu, X. L., Lai, L., et al. (2019) · Physical Review Letters · doi:10.1103/physrevlett.123.213902 · Cited by 105
MarkBot – A Language Model-Driven Chatbot for Interactive Marketing in Post-Modern World
Kushwaha, A. K., & Kar, A. K. (2021) · Information Systems Frontiers · doi:10.1007/s10796-021-10184-y · Cited by 116
“By altering the focus of training the model, repetition optimizes the objective function more on contextual losses (Bengio et al., 2003) than coverage (Ghahramani, 2015).”
Guest Editorial: Special Topic on Data-Enabled Theoretical Chemistry
Rupp, M., von Lilienfeld, O. A., & Burke, K. (2018) · The Journal of Chemical Physics · doi:10.1063/1.5043213 · Cited by 98
Rossettini, G., Rodeghiero, L., Corradi, F., Cook, C., Pillastrini, P., Turolla, A., Castellini, G., Chiappinotto, S., Gianola, S., & Palese, A. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05630-9 · Cited by 103
“These models are probabilistic in nature, forming responses by estimating the probability of the next word according to statistical patterns in their training data [69].”
BackgroundProbabilistic Forecasting of Sensory Data With Generative Adversarial Networks – ForGAN
Koochali, A., Schichtel, P., Dengel, A. R., & Ahmed, S. (2019) · IEEE Access · doi:10.1109/access.2019.2915544 · Cited by 113
“For an in-depth review of Bayesian probabilistic machine learning, please refer to [72], [73].”
BackgroundA Data-Driven Approach for Lithology Identification Based on Parameter-Optimized Ensemble Learning
Sun, Z., Jiang, B., Li, X., Li, J., & Xiao, K. (2020) · Energies · doi:10.3390/en13153903 · Cited by 103
Artificial intelligence and the future of the internal audit function
Wassie, F. A., & Lakatos, L. P. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-02905-w · Cited by 103
“By combining technical knowledge with interactive interview skills, project management skills, responsive intelligence, and logical thinking, the IAF can support AI in the early data feed (Ghahramani, 2015).”
A Survey of Autonomous Driving from a Deep Learning Perspective
Zhao, J., Wu, Y., Deng, R., Xu, S., Gao, J., & Burke, A. F. (2025) · ACM Computing Surveys · doi:10.1145/3729420 · Cited by 150
Geometric integrators and the Hamiltonian Monte Carlo method
Bou-Rabee, N. M., & Sanz-Serna, J. M. (2018) · Acta Numerica · doi:10.1017/s0962492917000101 · Cited by 141
“…2015), machine learning (Andrieu, De Freitas, Doucet and Jordan 2003), inverse problems (Stuart 2010), data assimilation (Chen 2003, Evensen 2009), pattern recognition (Webb 2003, Bishop 2006), artificial intelligence (Ghahramani 2015), and probabilistic robots (Thrun, Burgard and Fox 2005).”
BackgroundMethodA single shot coherent Ising machine based on a network of injection-locked multicore fiber lasers
Babaeian, M., Nguyen, D. T., Demir, V., Akbulut, M., Blanche, P., Kaneda, Y., Guha, S., Neifeld, M. A., & Peyghambarian, N. N. (2019) · Nature Communications · doi:10.1038/s41467-019-11548-4 · Cited by 121
Zhu, W., Guo, B., Li, Y., Yang, Y., Xie, C., Jin, J., & Gooi, H. B. (2023) · eTransportation · doi:10.1016/j.etran.2023.100230 · Cited by 107
Progress in prediction of remaining useful life of hydrogen fuel cells based on deep learning
He, W., Liu, T., Ming, W., Li, Z., Du, J., Li, X., Guo, X., & Sun, P. (2023) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2023.114193 · Cited by 110
How emerging data technologies can increase trust and transparency in fisheries
Probst, W. N. (2019) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsz036 · Cited by 114
Mortier, T., Wieme, A. D., Vandamme, P. A. R., & Waegeman, W. (2021) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2021.11.004 · Cited by 106
Triberti, S., Durosini, I., & Pravettoni, G. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.00117 · Cited by 88
Machine learning integrated photocatalysis: progress and challenges
Ge, L., Ke, Y., & Li, X. (2023) · Chemical Communications · doi:10.1039/d3cc00989k · Cited by 99
Bayesian Convolutional Neural Networks for Seismic Facies Classification
Feng, R., Balling, N., Graña, D., Dramsch, J. S., & Hansen, T. M. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3049012 · Cited by 97
“Ghahramani [20] described a probabilistic framework for investigating the uncertainty of models and predictions in the learning process.”
BackgroundCompositional Inductive Biases in Function Learning
Schulz, E., Tenenbaum, J. B., Duvenaud, D., Speekenbrink, M., & Gershman, S. J. (2016) · Cognitive Psychology · doi:10.1016/j.cogpsych.2017.11.002 · Cited by 116
Emerging frontiers in wind engineering: Computing, stochastics, machine learning and beyond
Kareem, A. (2020) · Journal of Wind Engineering and Industrial Aerodynamics · doi:10.1016/j.jweia.2020.104320 · Cited by 96
Generalized Nesterov's Acceleration-Incorporated, Non-Negative and Adaptive Latent Factor Analysis
Luo, X., Zhou, Y., Liu, Z., Hu, L., & Zhou, M. (2021) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2021.3069108 · Cited by 128
“is to estimate its missing data [2], [3], [4], [5], [7], [8], [9], [10], [52].”
BackgroundData-driven prediction of battery failure for electric vehicles
Zhao, J., Ling, H., Wang, J., Burke, A. F., & Lian, Y. (2022) · iScience · doi:10.1016/j.isci.2022.104172 · Cited by 91
“Machine learning using probabilistic frameworks are well suited for prediction tasks and have hence emerged as one of the principal theoretical and practical solutions to designing self-controlled machines to automatically recognize and organize patterns from training data (Ghahramani, 2015).”
Remaining Useful Life Prediction Method for Bearings Based on LSTM with Uncertainty Quantification
Yang, J., Peng, Y., Xie, J., & Wang, P. (2022) · Sensors · doi:10.3390/s22124549 · Cited by 96
“Ghahramani [22] stated that the Bayesian method is a promising measure of uncertainty, and Bayesian inference can be used as a learning tool to address uncertainty in deep learning.”
MethodA Bayesian Deep Learning Framework for End-To-End Prediction of Emotion From Heartbeat
Harper, R. J., & Southern, J. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2981610 · Cited by 105
“medical diagnosis) [52].”
Shi, X., He, Q., Luo, X., Bai, Y., & Shang, M. (2020) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2020.2973141 · Cited by 147
Khan, O. Z., Badhiwala, J. H., Grasso, G., & Fehlings, M. G. (2020) · World Neurosurgery · doi:10.1016/j.wneu.2020.04.022 · Cited by 105
Machine learning applications in radiation oncology
Field, M., Hardcastle, N., Jameson, M., Aherne, N. J., & Holloway, L. C. (2021) · Physics and Imaging in Radiation Oncology · doi:10.1016/j.phro.2021.05.007 · Cited by 105
“There have been increased investments in machine learning technology by commercial and research sectors in recent years due to the highly practical solutions that can be obtained [17,20].”
BackgroundWerther, M., Odermatt, D., Simis, S. G. H., Gurlin, D., Lehmann, M. K., Kutser, T., Gupana, R. S., Varley, A., Hunter, P., Tyler, A. N., et al. (2022) · Remote Sensing of Environment · doi:10.1016/j.rse.2022.113295 · Cited by 96
Improving model calibration with accuracy versus uncertainty optimizationPreprint
Krishnan, R., & Tickoo, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.07923 · Cited by 223
“Probabilistic deep neural networks (DNNs) enable quantification of principled uncertainty estimates, which are essential to understand the model predictions for reliable decision making in safety critical applications [1].”
BackgroundThreshold switching memristor-based stochastic neurons for probabilistic computing
Wang, K., Hu, Q., Gao, B., Lin, Q., Zhuge, F., Zhang, D., Wang, L., He, Y., Scheicher, R. H., Tong, H., et al. (2020) · Materials Horizons · doi:10.1039/d0mh01759k · Cited by 94
Li, B., Yue, R., Shen, L., Chen, C., Li, R., Xu, Y., Zhang, M., Hong, H., & Lin, H. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.134236 · Cited by 94
Bayesian deep learning on a quantum computer
Zhao, Z., Pozas-Kerstjens, A., Rebentrost, P., & Wittek, P. (2019) · Quantum Machine Intelligence · doi:10.1007/s42484-019-00004-7 · Cited by 63
“…M5S 3E6 Toronto, Canada 7 Vector Institute for Artificial Intelligence, M5G 1M1 Toronto, Canada 8 Perimeter Institute for Theoretical Physics, N2L 2Y5 Waterloo, Canada a principled foundation (Ghahramani 2015), and robustness to adversarial attacks (Bradshaw et al. 2017; Grosse et al. 2017).”
BackgroundArtificial intelligence changes the way we work: A close look at innovating with chatbots
Wang, X., Lin, X., & Shao, B. (2022) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24621 · Cited by 112
“Specifically, chatbots can provide knowledge support by strengthening knowledge creation, storage, dissemination, and management processes and achieving superior analysis, comprehension, and prediction capabilities (Ghahramani, 2015).”
BackgroundMachine learning accelerated calculation and design of electrocatalysts for CO2 reduction
Sun, Z., Yin, H., Liu, K., Cheng, S., Li, G. K., Kawi, S., Zhao, H., Jia, G., & Yin, Z. (2022) · SmartMat · doi:10.1002/smm2.1107 · Cited by 96
“The selected descriptor set will be taken directly as input or combined into a new simplified but more robust descriptor set through correlation analysis, providing key performance indicator (KPI) fingerprints.(50) A good descriptor set offers sufficient resolution for the prediction space.”
MethodDu, S., Wang, J., Wang, M., Yang, J., Zhang, C., Zhao, Y. S., & Song, H. (2022) · Energy · doi:10.1016/j.energy.2022.126121 · Cited by 100
Quantum ensembles of quantum classifiers
Schuld, M., & Petruccione, F. (2018) · Scientific Reports · doi:10.1038/s41598-018-20403-3 · Cited by 81
“Interesting enough, this formulation is also very close to another paradigm of classification, the Bayesian learning approach [12, 13].”
Towards algorithmic analytics for large-scale datasets
Bzdok, D., Nichols, T. E., & Smith, S. M. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0069-5 · Cited by 84
Ma, C., Zhang, Z., Luce, B., Pusateri, S., Xie, B., Rafiei, M. H., & Hu, N. (2020) · npj Computational Materials · doi:10.1038/s41524-020-0309-6 · Cited by 97
“The network architecture has become more applicable in recent years due to (1) the invention of new training/learning methods for faster and less computationally intensive training and (2) the advent of faster computer hardware such as GPUs.”
BackgroundMethodZheng, H., Lu, X., & He, K. (2021) · Journal of Energy Chemistry · doi:10.1016/j.jechem.2021.12.001 · Cited by 95
Integrated Photonic Neural Networks: Opportunities and Challenges
Liao, K., Dai, T., Yan, Q., Hu, X., & Gong, Q. (2023) · ACS Photonics · doi:10.1021/acsphotonics.2c01516 · Cited by 104
A review of recent trend in motion planning of industrial robots
Tamizi, M. G., Yaghoubi, M., & Najjaran, H. (2023) · International Journal of Intelligent Robotics and Applications · doi:10.1007/s41315-023-00274-2 · Cited by 98
“The advantage of these methods in LbD is employing probability theory to cover uncertainties at all levels of modelling (Ghahramani 2015).”
MethodBonnet, D., Hirtzlin, T., Majumdar, A., Dalgaty, T., Esmanhotto, E., Meli, V., Castellani, N., Martin, S., Nodin, J.-F., Bourgeois, G., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-43317-9 · Cited by 110
What is generative in generative artificial intelligence? A design-based perspective
Bordas, A., Masson, P. L., Thomas, M., & Weil, B. (2024) · Research in Engineering Design · doi:10.1007/s00163-024-00441-x · Cited by 107
“Following this, the training phase is part of the modeling process; as such, in the rest of the paper, we refer to a model once its training process is completed, its parameters are fixed, and it is thus able to make predictions or generate content (Ghahramani 2015).”
Seven Paradoxes of Business Process Management in a Hyper-Connected World
Beverungen, D., Buijs, J. C. A. M., Becker, J., Di Ciccio, C., van der Aalst, W. M. P., Bartelheimer, C., vom Brocke, J., Comuzzi, M., Kraume, K., Leopold, H., et al. (2021) · Business & Information Systems Engineering · doi:10.1007/s12599-020-00646-z · Cited by 89
“Moreover, this issue contradicts the decisions and actions that process designers might conduct based on probabilistic methods in Big Data Analytics, since these methods are subject to uncertainty when predicting unobserved data (Ghahramani 2015).”
MethodBig data management challenges in health research—a literature review
Wang, X., Williams, C., Liu, Z. H., & Croghan, J. (2019) · Briefings in Bioinformatics · doi:10.1093/bib/bbx086 · Cited by 85
Agrawal, S., Chatterjee, K., & Novotný, P. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3158122 · Cited by 89
Interpretation and Prediction of the CO2 Sequestration of Steel Slag by Machine Learning
He, B., Zhu, X., Cang, Z., Liu, Y., Lei, Y., Chen, Z., Wang, Y., Zheng, Y., Cang, D., & Zhang, L. (2023) · Environmental Science & Technology · doi:10.1021/acs.est.2c06133 · Cited by 90
Engel, C., Ebel, P., & Leimeister, J. M. (2022) · Electronic Markets · doi:10.1007/s12525-021-00519-7 · Cited by 100
“The notion of “learning” in ML can thus be described as inferring models to explain observed data, which shall enable a machine to make predictions about future data, and to make decisions based on these predictions (Ghahramani, 2015).”
BackgroundFuzzy Deep Learning for the Diagnosis of Alzheimer's Disease: Approaches and Challenges
Tanveer, M., Sajid, M., Akhtar, M., Quadir, A., Goel, T., Aimen, A., Mitra, S., Zhang, Y., Lin, C., & Ser, J. D. (2024) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2024.3409412 · Cited by 94
“Bayesian methods provide a probabilistic framework for reasoning under uncertainty, enabling DL to capture and propagate uncertainty throughout the model [58].”
MethodOutlook for Exploiting Artificial Intelligence in the Earth and Environmental Sciences
Boukabara, S.-A., Krasnopolsky, V., Penny, S. G., Stewart, J. Q., McGovern, A., Hall, D., Ten Hoeve, J. E., Hickey, J., Allen Huang, H.-L., Williams, J. K., et al. (2021) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-20-0031.1 · Cited by 87
“Ghahramani (2015) states that ML must be able to represent and manipulate uncertainty about models and predictions.”
Wingfield, L. R., Ceresa, C. D. L., Thorogood, S., Fleuriot, J., & Knight, S. R. (2020) · Liver Transplantation · doi:10.1002/lt.25772 · Cited by 91
“( 24 ) ( 20 13 ) 10 03 M EL D (n ot q ua nt ita tiv el y”
BackgroundInfluentialLiu, Z., Luo, X., & Wang, Z. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2990990 · Cited by 119
“…LF space; 2) defining a learning objective on the known data of an HiDS target with desired LFs; and 3) optimizing the objective to achieve LFs precisely outlining concerned objects, which are highly useful in addressing subsequent learning tasks such as missing data recovering [9]–[17], [43].”
BackgroundAttention-guided analysis of infrastructure damage with semi-supervised deep learning
Karaaslan, E., Bağcı, U., & Çatbaş, F. N. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103634 · Cited by 86
Hybrid Triboelectric Nanogenerators: From Energy Complementation to Integration
Xie, L., Zhai, N., Liu, Y., Wen, Z., & Sun, X. (2021) · Research · doi:10.34133/2021/9143762 · Cited by 88
Lin, B., & Wu, S. (2021) · OMICS A Journal of Integrative Biology · doi:10.1089/omi.2021.0037 · Cited by 89
“…disease diagnosis using collected static data for training using machine learning (ML) techniques for structured data or using natural language processing (NLP) methods to extract and convert information from unstructured data such as clinical record into structured data for ML (Ghahramani, 2015).”
Grad-CAM (Gradient-weighted Class Activation Mapping): A systematic literature review
Fayyaz, A. M., Abdulkadir, S. J., Talpur, N., Al-Selwi, S. M., Hassan, S. U., & Sumiea, E. H. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.111200 · Cited by 94
Hwang, J. H., Kim, J., Lee, H. W., Na, J., Ahn, B. S., Lee, S. D., Kim, H. S., Lee, H., & Lee, U. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.04.135 · Cited by 84
Machine learning for knowledge transfer across multiple metals additive manufacturing printers
Liu, S., Stebner, A. P., Kappes, B. B., & Zhang, X. (2021) · Additive manufacturing · doi:10.1016/j.addma.2021.101877 · Cited by 111
Triboelectric Nanogenerator Based Smart Electronics via Machine Learning
Ji, X., Zhao, T., Zhao, X. H., Lu, X., & Li, T. (2020) · Advanced Materials Technologies · doi:10.1002/admt.201900921 · Cited by 81
Choosing wisely: Review and commentary on anti-nuclear antibody (ANA) testing
Fritzler, M. J. (2015) · Autoimmunity Reviews · doi:10.1016/j.autrev.2015.12.002 · Cited by 82
Prognostication and risk factors for cystic fibrosis via automated machine learning
Alaa, A. M., & van der Schaar, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-29523-2 · Cited by 80
“AutoPrognosis uses Bayesian optimization techniques 31 in order to (efficiently) identify the machine learning pipelines (out of a huge space of possible pipelines) that maximize a predefined diagnostic accuracy metric, where a pipeline consists of an imputation algorithm, a feature processing…”
MethodPredictive pretrained transformer (PPT) for real-time battery health diagnostics
Zhao, J., Wang, Z., Wu, Y., & Burke, A. F. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.124746 · Cited by 87
Implementation of Genomic Prediction in Lolium perenne (L.) Breeding Populations
Grinberg, N. F., Lovatt, A., Hegarty, M., Lovatt, A., Skøt, K. P., Kelly, R., Blackmore, T. M., Thorogood, D., King, R. D., Armstead, I., et al. (2016) · Frontiers in Plant Science · doi:10.3389/fpls.2016.00133 · Cited by 87
“There is currently considerable interest in applying machine learning (ML) to science, and reviews have recently appeared (Ghahramani, 2015; Jordan and Mitchell, 2015).”
BackgroundA 619-pixel machine vision enhancement chip based on two-dimensional semiconductors
Ma, S., Wu, T., Chen, X., Wang, Y., Ma, J., Chen, H., Riaud, A., Wan, J., Xu, Z., Chen, L., et al. (2022) · Science Advances · doi:10.1126/sciadv.abn9328 · Cited by 78
Lugogo, N. L., DePietro, M. R., Reich, M., Merchant, R. K., Chrystyn, H., Pleasants, R. A., Granovsky, L., Li, T., Hill, T. D., Brown, R. W., et al. (2022) · Journal of Asthma and Allergy · doi:10.2147/jaa.s377631 · Cited by 78
“Used for a variety of clinical applications, machine learning entails the use of computer algorithms to develop a model capable of making accurate predictions based on data inputs.(21) One machine learning technique is supervised learning, in which the model is “trained” to classify data using input data with correspo…”
BackgroundMachine-Learning-Assisted Design of Highly Tough Thermosetting Polymers
Hu, Y., Zhao, W., Wang, L., Lin, J., & Du, L. (2022) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.2c14290 · Cited by 80
From Time-Reversal Symmetry to Quantum Bayes’ Rules
Parzygnat, A. J., & Fullwood, J. (2023) · PRX Quantum · doi:10.1103/prxquantum.4.020334 · Cited by 99
A Primer on Bayesian Neural Networks: Review and Debates
Arbel, J., Pitas, K., Vladimirova, M., & Fortuin, V. (2026) · Statistical Science · doi:10.1214/24-sts969 · Cited by 92
Being Realist about Bayes, and the Predictive Processing Theory of Mind
Colombo, M., Elkin, L., & Hartmann, S. (2018) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axy059 · Cited by 83
Deep Learning for Cognitive Neuroscience
Storrs, K. R., & Kriegeskorte, N. (2020) · The Cognitive Neurosciences · doi:10.7551/mitpress/11442.003.0077 · Cited by 67
Bhattad, P. B., & Jain, V. K. (2020) · Cureus · doi:10.7759/cureus.8041 · Cited by 90
“Algorithms are used to obtain results/answers to the initial question and these results are further analyzed [1-4].”
BackgroundMethodUnveiling the Mind of the Machine
Clegg, M., Hofstetter, R., de Bellis, E., & Schmitt, B. H. (2023) · Journal of Consumer Research · doi:10.1093/jcr/ucad075 · Cited by 85
A Comprehensive Survey on Evidential Deep Learning and its Applications
Gao, J., Chen, M., Xiang, L., & Xu, C. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3625258 · Cited by 108
“Consequently, uncertainty estimation, which is expected to reflect the true likelihood of error across diverse scenarios and provide a certain degree of reliability assurance for algorithms, has emerged as a crucial and widely debated topic in deep learning [5], [6], [7], [8], [9], [10].”
Lee, J. H., Baek, J. H., Kim, J. H., Shim, W. H., Chung, S. R., Choi, Y. J., & Lee, J. H. (2018) · Thyroid · doi:10.1089/thy.2018.0082 · Cited by 77
Healthcare pathway discovery and probabilistic machine learning
Kempa-Liehr, A. W., Lin, C. Y.-C., Britten, R. D., Armstrong, D., Wallace, J., Mordaunt, D., & O’Sullivan, M. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104087 · Cited by 86
Wang, H., Kang, X., & Han, B. (2025) · Chemical Society Reviews · doi:10.1039/d5cs00780a · Cited by 81
AI Systems Under Criminal Law: a Legal Analysis and a Regulatory Perspective
Lagioia, F., & Sartor, G. (2020) · Philosophy & Technology · doi:10.1007/s13347-019-00362-x · Cited by 75
“Some probabilistic systems explicitly represent and manipulate uncertain information and make predictions accordingly (Ghahramani 2015, 452).”
BackgroundLuo, X., Shang, M., & Li, S. (2016) · Proceedings · doi:10.1109/icdm.2016.0042 · Cited by 84
Bioprocess systems analysis, modeling, estimation, and control
Luo, Y., Kurian, V., & Ogunnaike, B. A. (2021) · Current Opinion in Chemical Engineering · doi:10.1016/j.coche.2021.100705 · Cited by 81
Physical laws meet machine intelligence: current developments and future directions
Muther, T., Dahaghi, A. K., Syed, F. I., & Pham, V. V. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10329-8 · Cited by 82
Fu, H., Li, K., Zhang, C., Zhang, J., Liu, J., Chen, X., Chen, G., Sun, Y., Li, S., & Ling, L. (2023) · ACS Nano · doi:10.1021/acsnano.3c03610 · Cited by 75
A cognitive approach to human–AI complementarity in dynamic decision-making
González, C., & Heidari, H. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-025-00499-x · Cited by 93
“For example, Bayesian learning from demonstration enables an agent to generalize from limited human demonstrations and dynamically incorporate new information to improve task performance 88,89 .”
A Statistical Analysis of Factors Affecting Higher Education Dropouts
Perchinunno, P., Bilancia, M., & Vitale, D. (2019) · Social Indicators Research · doi:10.1007/s11205-019-02249-y · Cited by 80
“The analysis and use of supervised classification algorithms that predict the performance of future students based on historical data is part of that discipline generally known as ‘Machine Learning’ (ML; Mitchell 1997; Ghahramani 2015).”
Method
Metadata
- Authors
- Ghahramani, Z.
- Venue
- Nature
- Published
- 2015-05-27
- Volume
- 521
- Issue
- 7553
- Pages
- 452-459
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1494192115
- Cited by
- 1,995
- References
- 108
- Citations by year
- 2026: 166 · 2025: 231 · 2024: 228 · 2023: 206 · 2022: 217 · 2021: 265 · 2020: 235 · 2019: 210 · 2018: 102 · 2017: 84 · 2016: 39 · 2015: 11
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/I036575/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- stochastic modeling, machine learning, artificial intelligence, uncertainty representation, probabilistic programming, Bayesian optimization, data compression, experiential learning
- MeSH terms
- Artificial Intelligence, Automation, Bayes Theorem, Models, Statistical, Statistics, Nonparametric, Uncertainty, Data Compression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.