Probabilistic machine learning and artificial intelligence
The DOI matches its Crossref record; 102 of the 108 references it cites were found in a registry or an index.
Abstract
How can a machine learn from experience? Probabilistic modelling provides a framework for understanding what learning is, and has therefore emerged as one of the principal theoretical and practical approaches for designing machines that learn from data acquired through experience. The probabilistic framework, which describes how to represent and manipulate uncertainty about models and predictions, has a central role in scientific data analysis, machine learning, robotics, cognitive science and artificial intelligence. This Review provides an introduction to this framework, and discusses some of the state-of-the-art advances in the field, namely, probabilistic programming, Bayesian optimization, data compression and automatic model discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deriving from the Bayesian framework, GPR models have been widely applied to prognostic analysis as they are flexible, nonparametric and probabilistic [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ameliorate this in GPR, one way is to minimize the negative log marginal likelihood [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The performance of GPR is highly sensitive on the covariance function and the kernels should therefore be carefully selected to achieve high prediction accuracy [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These methods can be broadly classified into two categories: Bayesian approaches [40,90,106] and Frequentist, approaches [14,70,113]”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“recent advances using deep neural networks to solve challenging pattern recognition problems such as speech recognition [5], image classification [6, 7], and prediction of words in text [8], do not overtly represent the uncertainty in the structure or parameters of those neural networks.”
BackgroundA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“The HMM is a widely used probabilistic model for sequential and time-series data, which assumes the data were obtained by transitioning stochastically between a discrete number of hidden states 98 .”
MethodBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“The model could have a large number of parameters compared with the data set (for example, the neural network recently used to achieve translations of English and French sentences that approached the accuracy of state-of-the-art methods is a probabilistic model with 384 million parameters 29 ).”
MethodGaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Research works printed but not linked: 14
- Bengio, Y., Ducharme, R., Vincent, P. & Janvin, C. A neural probabilistic language model. J. Mach. Learn. Res. 3, 1137–1155 (2003).
- Hinton, G. E., McClelland, J. L. & Rumelhart, D. E. in Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations 77–109 (MIT Press, 1986).
- Goodman, N. D. & Stuhlmüller, A. The Design and Implementation of Probabilistic Programming Languages. Available at http://dippl.org (2015).
- Mansinghka, V., Kulkarni, T. D., Perov, Y. N. & Tenenbaum, J. Approximate Bayesian image interpretation using generative probabilistic graphics programs. In Proc. Advances in Neural Information Processing Systems 26 1520–1528 (2013).
- Minka, T. P., Winn, J. M., Guiver, J. P. & Knowles, D. A. Infer.NET 2.4. http://research.microsoft.com/infernet (Microsoft Research, 2010).
- Pfeffer, A. Figaro: An Object-Oriented Probabilistic Programming Language. Tech. Rep. (Charles River Analytics, 2009).
- Mansinghka, V., Selsam, D. & Perov, Y. Venture: a higher-order probabilistic programming platform with programmable inference. Preprint at http://arxiv.org/abs/1404.0099 (2014). · arXiv
- Li, L., Wu, Y. & Russell, S. J. SWIFT: Compiled Inference for Probabilistic Programs. Report No. UCB/EECS-2015–12 (Univ. California, Berkeley, 2015).
- Bergstra, J. et al. Theano: a CPU and GPU math expression compiler. In Proc. 9th Python in Science Conference http://conference.scipy.org/proceedings/scipy2010/ (2010).
- Poupart, P. in Encyclopedia of Machine Learning 90–93 (Springer, 2010).
- Grosse, R. B., Salakhutdinov, R. & Tenenbaum, J. B. Exploiting compositionality to explore a large space of model structures. In Proc. Conference on Uncertainty in Artificial Intelligence 306–315 (2012).
- Welling, M. et al. Bayesian inference with big data: a snapshot from a workshop. ISBA Bulletin 21, https://bayesian.org/sites/default/files/fm/bulletins/1412.pdf (2014).
- Bakker, B. & Heskes, T. Task clustering and gating for Bayesian multitask learning. J. Mach. Learn. Res. 4, 83–99 (2003).
- Hensman, J., Fusi, N. & Lawrence, N. D. Gaussian processes for big data. In Proc. Conference on Uncertainty in Artificial Intelligence 244 (UAI, 2013).
Cited by
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
“For the 12 images, the model predicts classes [1 1 1 1 1 5 5 7 7 7 7 7].”
BackgroundSelf-citationDeep learning and process understanding for data-driven Earth system science
Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N., & Prabhat (2019) · Nature · doi:10.1038/s41586-019-0912-1 · Cited by 5,673
How artificial intelligence will change the future of marketing
Davenport, T., Guha, A., Grewal, D., & Bressgott, T. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00696-0 · Cited by 2,875
“3 In contrast, context awareness continues to be developed, and researchers in computer science are working on moving AI capabilities forward, from task automation to context awareness (e.g., Ghahramani 2015; Mnih et al. 2015).”
BackgroundHuman-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aab3050 · Cited by 2,817
“Concepts are represented as simple probabilistic programs—that is, probabilistic generative models expressed as structured procedures in an abstract description language (17, 18).”
BackgroundBuilding machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Building Machines That Learn and Think Like People
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2016) · arXiv · doi:10.48550/arxiv.1604.00289 · Cited by 2,550
Scientific discovery in the age of artificial intelligence.
Wang, H., Fu, T., Du, Y., Gao, W., Huang, K., Liu, Z., Chandak, P., Liu, S., Van Katwyk, P., Deac, A., et al. (2023) · Nature · doi:10.1038/s41586-023-06221-2 · Cited by 1,823
Hughes, D. P., & Salathé, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.08060 · Cited by 900
Can we open the black box of AI?
Castelvecchi, D. (2016) · Nature · doi:10.1038/538020a · Cited by 1,773
Automated Machine Learning: Methods, Systems, Challenges
(2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5 · Cited by 1,485
Avci, O., Abdeljaber, O., Kiranyaz, S., Hussein, M., Gabbouj, M., & Inman, D. J. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2020.107077 · Cited by 1,442
Dong, K., Peng, X., & Wang, Z. L. (2020) · Advanced Materials · doi:10.1002/adma.201902549 · Cited by 1,322
Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review
Li, Y., Liu, K., Foley, A. M., Zülke, A., Berecibar, M., Nanini-Maury, E., Van Mierlo, J., & Hoster, H. E. (2019) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2019.109254 · Cited by 1,193
“Probabilistic approaches use probability theory to express all forms of uncertainty, where probability distributions are used to represent all the uncertain unobserved quantities and their correlations with the data [138].”
BackgroundStudy on artificial intelligence: The state of the art and future prospects
Zhang, C., & Lu, Y. (2021) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2021.100224 · Cited by 1,066
Drug discovery with explainable artificial intelligence
Jiménez-Luna, J., Grisoni, F., & Schneider, G. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00236-4 · Cited by 1,063
“138 The model then composes more complex programs us-ing the elements of previously learned ones using a Bayesian criterion.”
MethodMachine learning with big data: challenges and approaches.
L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M. (2017) · IEEE Access · doi:10.1109/access.2017.2696365 · Cited by 1,023
“Moreover, some algorithms also depend on other distributions; for example the Markov sequence assumes that probability distribution of the next state depends only on the current state [60].”
BackgroundLuo, W., Phung, D., Tran, T., Gupta, S., Rana, S., Karmakar, C., Shilton, A., Yearwood, J., Dimitrova, N., Ho, T. B., et al. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5870 · Cited by 988
“The reviews by Jordan and Mitchell [5] and Ghahramani [6] provide accessible overviews for machine learning.”
Inferring causation from time series in Earth system sciences
Runge, J., Bathiany, S., Bollt, E., Camps-Valls, G., Coumou, D., Deyle, E., Glymour, C., Kretschmer, M., Mahecha, M. D., Muñoz-Marí, J., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-10105-3 · Cited by 984
Interaction Networks for Learning about Objects, Relations and Physics
Battaglia, P. W., Pascanu, R., Lai, M., Rezende, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1612.00222 · Cited by 969
“Structured models [7] can exploit rich, explicit knowledge of relations among objects, independent of the objects themselves, which supports general-purpose reasoning across diverse contexts.”
BackgroundZhang, W., Wu, C., Zhong, H., Li, Y., & Wang, L. (2021) · Geoscience Frontiers · doi:10.1016/j.gsf.2020.03.007 · Cited by 884
The Zwicky Transient Facility: Science Objectives
Graham, M. J., Kulkarni, S. R., Bellm, E. C., Adams, S. M., Barbarino, C., Blagorodnova, N., Bodewits, D., Bolin, B., Brady, P. R., Cenko, S. B., et al. (2019) · Publications of the Astronomical Society of the Pacific · doi:10.1088/1538-3873/ab006c · Cited by 832
“…recent developments related to (local) interpretability (e.g. Ribeiro et al. 2016; Krause et al. 2016) and probabilistic machine learning (e.g. Tran et al. 2016; Ghahramani 2015) may be able to either shed light on these biases or incorporate them directly into the subsequent modelling tasks.”
BackgroundAccelerated search for materials with targeted properties by adaptive design
Xue, D., Balachandran, P. V., Hogden, J., Theiler, J., Xue, D., & Lookman, T. (2016) · Nature Communications · doi:10.1038/ncomms11241 · Cited by 801
Physics-informed machine learning: case studies for weather and climate modelling
Kashinath, K., Mustafa, M., Albert, A., Wu, J.-L., Jiang, C., Esmaeilzadeh, S., Azizzadenesheli, K., Wang, R., Chattopadhyay, A., Singh, A., et al. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0093 · Cited by 662
“A natural way to model distributions and incorporate stochasticity and uncertainty in ML is through probabilistic models such as Bayesian NNs and generative models [34].”
MethodAdvances in Variational Inference
Zhang, C., Butepage, J., Kjellstrom, H., & Mandt, S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2889774 · Cited by 671
Moll, J., & Yigitbasioglu, O. (2019) · The British Accounting Review · doi:10.1016/j.bar.2019.04.002 · Cited by 686
Frontiers in Artificial Intelligence and Applications
Yadav, J., Shukla, S., Sharma, K., Soni, N., Agarwal, S., & Pathak, P. C. (2022) · 2022 3rd International Conference on Computation, Automation and Knowledge Management (ICCAKM) · doi:10.1109/iccakm54721.2022.9990098 · Cited by 660
“Information extraction, information retrieval, semantic and grammatical analysis, the question-answering system, text mining, machine translation, and the dialogue system are the seven directions of NLP [23].”
BackgroundMethodArviZ a unified library for exploratory analysis of Bayesian models in Python
Kumar, R., Carroll, C., Hartikainen, A., & Martin, O. (2019) · Journal of Open Source Software · doi:10.21105/joss.01143 · Cited by 664
“This helps separate the model building from the inference, allowing practitioners to focus on their specific problems and leaving PPLs to handle the computational details for them (Bessiere, Mazer, Ahuactzin, & Mekhnacha, 2013; Daniel Roy, 2015; Ghahramani, 2015).”
MethodAlaa, A. M., Bolton, T., Di Angelantonio, E., Rudd, J. H. F., & van der Schaar, M. (2019) · PLOS ONE · doi:10.1371/journal.pone.0213653 · Cited by 604
Artificial intelligence: a survey on evolution, models, applications and future trends
Lu, Y. (2019) · Journal of Management Analytics · doi:10.1080/23270012.2019.1570365 · Cited by 641
Machine Learning for Catalysis Informatics: Recent Applications and Prospects
Toyao, T., Maeno, Z., Takakusagi, S., Kamachi, T., Takigawa, I., & Shimizu, K.-I. (2020) · ACS Catalysis · doi:10.1021/acscatal.9b04186 · Cited by 617
Machine learning in acoustics: Theory and applications
Bianco, M. J., Gerstoft, P., Traer, J., Ozanich, E., Roch, M. A., Gannot, S., & Deledalle, C.-A. (2019) · The Journal of the Acoustical Society of America · doi:10.1121/1.5133944 · Cited by 609
“31.”
Hashimoto, D. A., Witkowski, E., Gao, L., Meireles, O., & Rosman, G. (2020) · Anesthesiology · doi:10.1097/aln.0000000000002960 · Cited by 536
Artificial intelligence and the changing sources of competitive advantage
Krakowski, S., Luger, J., & Raisch, S. (2023) · Strategic Management Journal · doi:10.1002/smj.3387 · Cited by 594
“Machines perform well under uncertainty (Ghahramani, 2015), but need clear objectives and constraints to operate.”
BackgroundChen, K., Chen, H., Zhou, C., Huang, Y., Qi, X., Shen, R., Liu, F., Zuo, M., Zou, X., Wang, J., et al. (2020) · Water Research · doi:10.1016/j.watres.2019.115454 · Cited by 580
Mathematics for Machine Learning
Deisenroth, M. P., Faisal, A. A., & Ong, C. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108679930 · Cited by 573
Aligning artificial intelligence with climate change mitigation
Kaack, L. H., Donti, P. L., Strubell, E., Kamiya, G., Creutzig, F., & Rolnick, D. (2022) · Nature Climate Change · doi:10.1038/s41558-022-01377-7 · Cited by 570
Ali, O., Abdelbaki, W., Shrestha, A., Elbasi, E., Alryalat, M. A. A., & Dwivedi, Y. K. (2023) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2023.100333 · Cited by 568
Smart manufacturing: Characteristics, technologies and enabling factors
Mittal, S., Khan, M. A., Romero, D., & Wuest, T. (2019) · Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture · doi:10.1177/0954405417736547 · Cited by 560
Machine Learning for Electrocatalyst and Photocatalyst Design and Discovery
Mai, H., Le, T. C., Chen, D., Winkler, D. A., & Caruso, R. A. (2022) · Chemical Reviews · doi:10.1021/acs.chemrev.2c00061 · Cited by 552
Deep learning, reinforcement learning, and world models
Matsuo, Y., LeCun, Y., Sahani, M., Precup, D., Silver, D., Sugiyama, M., Uchibe, E., & Morimoto, J. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.03.037 · Cited by 543
Artificial intelligence and big data in entrepreneurship: a new era has begun
Obschonka, M., & Audretsch, D. B. (2020) · Small Business Economics · doi:10.1007/s11187-019-00202-4 · Cited by 527
“On the other hand, AI under conditions of uncertainty is a vibrant research field (e.g., Ghahramani 2015; Tversky and Kahnemann 1974; for an overview see also see Russell and Norvig 2016) and we might see major developments in this particular field in the near future as well, including new…”
BackgroundLeveraging uncertainty information from deep neural networks for disease detection
Leibig, C., Allken, V., Ayhan, M. S., Berens, P., & Wahl, S. (2017) · Scientific Reports · doi:10.1038/s41598-017-17876-z · Cited by 510
Mousavi, S. M., & Beroza, G. C. (2022) · Science · doi:10.1126/science.abm4470 · Cited by 506
“Bayesian DNNs can play a key role in this area by providing probabilistic treatment of neural networks ( 154 ).”
Applications of machine learning in animal behaviour studies
Valletta, J. J., Torney, C., Kings, M., Thornton, A., & Madden, J. (2017) · Animal Behaviour · doi:10.1016/j.anbehav.2016.12.005 · Cited by 505
“Both statistical modelling and ML seek to build a mathematical description, a model, of the data and the underlying mechanism it represents; thus inevitably there is substantial overlap between the two (Breiman, 2001b; Friedman, 2001; Zoubin Ghahramani, 2015).”
Machine learning and neurosurgical outcome prediction: a systematic review
Senders, J. T., Staples, P. C., Karhade, A. V., Zaki, M. M., Gormley, W. B., Broekman, M. L. D., Smith, T. R., & Arnaout, O. (2018) · World Neurosurgery · doi:10.1016/j.wneu.2017.09.149 · Cited by 486
Drawbacks of artificial intelligence and their potential solutions in the healthcare sector.
khan, B., Fatima, H., Qureshi, A., Kumar, S., Hanan, A., Hussain, J., & Abdullah, S. (2023) · Biomedical Materials & Devices · doi:10.1007/s44174-023-00063-2 · Cited by 461
“Various new solving processes are capable and prepared to execute continuous learning [44].”
Emerging Technology and Business Model Innovation: The Case of Artificial Intelligence
Lee, J., Suh, T., Roy, D., & Baucus, M. (2019) · Journal of Open Innovation: Technology, Market, and Complexity · doi:10.3390/joitmc5030044 · Cited by 441
“Additionally, Zoubin Ghahramani proposed a probabilistic machine learning method to resolve data quantity issue [39]; this method addresses more issues than data quantity, because it uses a new machine learning paradigm to resolve data uncertainty.”
MethodUnified representation of molecules and crystals for machine learning
Huo, H., & Rupp, M. (2022) · Machine Learning: Science and Technology · doi:10.1088/2632-2153/aca005 · Cited by 276
“In settings that require many calculations, such as dynamics simulations, phase diagrams, or high-throughput searches, machine learning (ML) [1, 2] can reduce overall costs by orders of magnitude via accurate interpolation between reference calculations [3–5].”
BackgroundAn introduction to domain adaptation and transfer learning
Kouw, W. M., & Loog, M. (2018) · arXiv (Cornell University) · doi:10.13140/rg.2.2.33906.56004 · Cited by 234
Artificial intelligence: foundations of computational agents
(2010) · Choice Reviews Online · doi:10.5860/choice.48-2130 · Cited by 415
O’Dwyer, E., Pan, I., Acha, S., & Shah, N. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.01.024 · Cited by 410
Mohtasham Moein, M., Saradar, A., Rahmati, K., Ghasemzadeh Mousavinejad, S. H., Bristow, J., Aramali, V., & Karakouzian, M. (2023) · Journal of Building Engineering · doi:10.1016/j.jobe.2022.105444 · Cited by 391
Machine Learning Strategy for Accelerated Design of Polymer Dielectrics
Mannodi-Kanakkithodi, A., Pilania, G., Huan, T. D., Lookman, T., & Ramprasad, R. (2016) · Scientific Reports · doi:10.1038/srep20952 · Cited by 389
Battery Health Prediction Using Fusion-Based Feature Selection and Machine Learning
Hu, X., Che, Y., Lin, X., & Onori, S. (2021) · IEEE Transactions on Transportation Electrification · doi:10.1109/tte.2020.3017090 · Cited by 379
“The probabilistic predictions provide uncertainty and their correlation with data for the results [83].”
BackgroundEmotional intelligence or artificial intelligence– an employee perspective
Prentice, C., Dominique Lopes, S., & Wang, X. (2020) · Journal of Hospitality Marketing & Management · doi:10.1080/19368623.2019.1647124 · Cited by 367
“Previous research (e.g. Ghahramani, 2015; Morav č ík et al., 2017; Russell & Norvig, 2016) on AI was primarily focused on functionality and technical e ffi ciency.”
MethodAutonomous driving system: A comprehensive survey
Zhao, J., Zhao, W., Deng, B., Wang, Z., Zhang, F., Zheng, W., Cao, W., Nan, J., Lian, Y., & Burke, A. F. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122836 · Cited by 361
Artificial intelligence (AI) methods in optical networks: A comprehensive survey
Mata, J., de Miguel, I., Durán, R. J., Merayo, N., Singh, S. K., Jukan, A., & Chamania, M. (2018) · Optical Switching and Networking · doi:10.1016/j.osn.2017.12.006 · Cited by 359
“Thus, bayesian learning methods [27] formulate learning as a form of probabilistic inference, using the observations to update a prior distribution over hypotheses; maximum a posteriori (MAP) learning [28] selects a single most likely hypothesis given the data, and maximum-likelihood learning [29] simply selects the h…”
MethodAl-garadi, M. A., Varathan, K. D., & Ravana, S. D. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.05.051 · Cited by 350
“Generally the tweets are labeled via human coding (Dadvar & De Jong, 2012; Diakopoulos & Shamma, 2010; Ghahramani, 2015; Gokulakrishnan, Priyanthan, Ragavan, Prasath, & Perera, 2012; Myslín, Zhu, Chapman, & Conway, 2013; Paul, Dredze, & Broniatowski, 2014; Prieto, Matos, Alvarez, Cacheda, &…”
Numerical Gaussian Processes for Time-Dependent and Nonlinear Partial Differential Equations
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2018) · SIAM Journal on Scientific Computing · doi:10.1137/17m1120762 · Cited by 318
“Data-driven methods are taking center stage across many disciplines of science, and machine learning techniques have achieved groundbreaking results across a diverse spectrum of pattern recognition tasks [10, 15, 16].”
BackgroundFlexible Piezoelectric Acoustic Sensors and Machine Learning for Speech Processing
Jung, Y. H., Hong, S. K., Wang, H. S., Han, J. H., Pham, T. X., Park, H., Kim, J., Kang, S., Yoo, C. D., & Lee, K. J. (2020) · Advanced Materials · doi:10.1002/adma.201904020 · Cited by 338
A Survey of Robot Learning Strategies for Human-Robot Collaboration in Industrial Settings
Mukherjee, D., Gupta, K., Chang, L. H., & Najjaran, H. (2022) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2021.102231 · Cited by 344
A Review of User Interface Design for Interactive Machine Learning
Dudley, J. J., & Kristensson, P. O. (2018) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3185517 · Cited by 343
Asynchronous federated learning on heterogeneous devices: A survey
Xu, C., Qu, Y., Xiang, Y., & Gao, L. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100595 · Cited by 335
A survey of regularization strategies for deep models
Moradi, R., Berangi, R., & Minaei, B. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09784-7 · Cited by 297
Inferring solutions of differential equations using noisy multi-fidelity data
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2017) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.01.060 · Cited by 323
“Indeed, in recent years we have been witnessing the emergence of a data-driven era in which probability and statistics have been the focal point in the development of disruptive technologies such as probabilistic machine learning [2,3].”
BackgroundExpressive power of parametrized quantum circuits
Du, Y., Hsieh, M.-H., Liu, T., & Tao, D. (2020) · Physical Review Research · doi:10.1103/physrevresearch.2.033125 · Cited by 318
Schulz, M.-A., Yeo, B. T. T., Vogelstein, J. T., Mourao-Miranada, J., Kather, J. N., Kording, K., Richards, B., & Bzdok, D. (2020) · Nature Communications · doi:10.1038/s41467-020-18037-z · Cited by 315
From Machine Learning to Explainable AI
Holzinger, A. (2018) · 2018 World Symposium on Digital Intelligence for Systems and Machines (DISA) · doi:10.1109/disa.2018.8490530 · Cited by 306
“The inverse probability allows to learn from data, infer unknowns, and make predictions [27].”
BackgroundUncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty
Bhatt, U., Antorán, J., Zhang, Y., Liao, Q. V., Sattigeri, P., Fogliato, R., Melançon, G., Krishnan, R., Stanley, J., Tickoo, O., et al. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462571 · Cited by 300
“These methods can be broadly classified into two categories: Bayesian approaches [40, 90, 106] and Frequentist, approaches [14, 70, 113] Bayesian methods explicitly define a hypothesis space of plausible models a priori (before observing any data) and use deductive logic to update these priors given the observed data.”
MethodBayesian Deep-Learning-Based Health Prognostics Toward Prognostics Uncertainty
Peng, W., Ye, Z.-S., & Chen, N. (2020) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2019.2907440 · Cited by 294
“For handling uncertainty in machine learning, Bayesian method has been highlighted as a promising way by Ghahramani [24].”
MethodInfluentialA generative vision model that trains with high data efficiency and breaks text-based CAPTCHAs
George, D., Lehrach, W., Kansky, K., Lázaro-Gredilla, M., Laan, C., Marthi, B., Lou, X., Meng, Z., Liu, Y., Wang, H., et al. (2017) · Science · doi:10.1126/science.aag2612 · Cited by 280
Causal inference for time series
Runge, J., Gerhardus, A., Varando, G., Eyring, V., & Camps-Valls, G. (2023) · Nature Reviews Earth & Environment · doi:10.1038/s43017-023-00431-y · Cited by 288
“(5) does not contain any do expression, it can be estimated from observational data D y x z = {( , , )} .”
InfluentialFintech in financial reporting and audit for fraud prevention and safeguarding equity investments
Roszkowska, P. (2021) · Journal of Accounting & Organizational Change · doi:10.1108/jaoc-09-2019-0098 · Cited by 212
Pantano, E., & Pizzi, G. (2020) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2020.102096 · Cited by 240
Bayesian Machine Learning in Metamaterial Design: Fragile Becomes Supercompressible
Bessa, M. A., Glowacki, P., & Houlder, M. (2019) · Advanced Materials · doi:10.1002/adma.201904845 · Cited by 280
Consumer engagement via interactive artificial intelligence and mixed reality
Sung, E. (., Bae, S., Han, D.-I. D., & Kwon, O. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2021.102382 · Cited by 240
Technology readiness levels for machine learning systems
Lavin, A., Gilligan-Lee, C. M., Visnjic, A., Ganju, S., Newman, D., Ganguly, S., Lange, D., Baydin, A. G., Sharma, A., Gibson, A., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-33128-9 · Cited by 209
“Probabilistic ML methods, rooted in Bayesian probability theory, provide a principled approach to representing and manipulating uncertainty about models and predictions [19].”
MethodWang, Y. (2021) · Journal of Educational Administration · doi:10.1108/jea-10-2020-0216 · Cited by 196
Natural language processing in medicine: A review
Locke, S., Bashall, A., Al-Adely, S., Moore, J., Wilson, A., & Kitchen, G. B. (2021) · Trends in Anaesthesia and Critical Care · doi:10.1016/j.tacc.2021.02.007 · Cited by 250
Current status and applications of Artificial Intelligence (AI) in medical field: An overview
Haleem, A., Javaid, M., & Khan, I. H. (2019) · Current Medicine Research and Practice · doi:10.1016/j.cmrp.2019.11.005 · Cited by 268
Machine learning for hydrologic sciences: An introductory overview
Xu, T., & Liang, F. (2021) · WIREs Water · doi:10.1002/wat2.1533 · Cited by 267
“In contrast to the frequentist approach based on ensembles, Bayesian neural networks reformulate the training problem as inferring the posterior distribution of weights (Ghahramani, 2015; Heckerman, 2008).”
Position-Transitional Particle Swarm Optimization-Incorporated Latent Factor Analysis
Luo, X., Yuan, Y., Chen, S., Zeng, N., & Wang, Z. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3033324 · Cited by 264
“N MANY BIG ‐ DATA ‐ RELATED FIELDS like wireless sensor networks [1 ‐ 3], bioinformatic applications [4 ‐ 6], social networks [7 ‐ 9] and electronic commerce systems [10 ‐ 12], people usually encounter a mass of entities and their high ‐ dimensional and sparse (HiDS) relationships [10 ‐ 12].”
BackgroundNatural and Artificial Intelligence in Neurosurgery: A Systematic Review
Senders, J. T., Arnaout, O., Karhade, A. V., Dasenbrock, H. H., Gormley, W. B., Broekman, M. L., & Smith, T. R. (2018) · Neurosurgery · doi:10.1093/neuros/nyx384 · Cited by 264
A network approach to topic models
Gerlach, M., Peixoto, T. P., & Altmann, E. G. (2018) · Science Advances · doi:10.1126/sciadv.aaq1360 · Cited by 243
Structural Health Monitoring in Composite Structures: A Comprehensive Review
Hassani, S., Mousavi, M., & Gandomi, A. H. (2021) · Sensors · doi:10.3390/s22010153 · Cited by 258
Autonomous Discovery in the Chemical Sciences Part II: Outlook
Coley, C. W., Eyke, N. S., & Jensen, K. F. (2020) · Angewandte Chemie International Edition · doi:10.1002/anie.201909989 · Cited by 245
Learning earth system models from observations: machine learning or data assimilation?
Geer, A. J. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0089 · Cited by 229
“Probabilistic problems can also be expressed in a graphical form known as Bayesian networks [54], which are themselves used for solving ML problems [55].”
BackgroundAn Introduction to Probabilistic ProgrammingPreprint
van de Meent, J.-W., Paige, B., Yang, H., & Wood, F. (2018) · arXiv (Cornell University) · doi:10.4230/lipics.fscd.2021.4 · Cited by 281
Generative artificial intelligence acceptance scale: A validity and reliability study
Yilmaz, F. G. K., Yilmaz, R., & Ceylan, M. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2288730 · Cited by 244
“Through the application of algorithms and statistical models, AI systems analyze and interpret complex datasets, learning from experience and adapting their actions accordingly (Ghahramani, 2015; Mitchell, 2019).”
Machine learning in agricultural and applied economics
Storm, H., Baylis, K., & Heckelei, T. (2020) · European Review of Agricultural Economics · doi:10.1093/erae/jbz033 · Cited by 216
“An interesting promise of probabilistic programming is to move from the case-specific development of variational inference procedures to a generic approach only requiring the specification of a probabilistic economic model from which one can generate a random sample (Ghahramani, 2015).”
BackgroundKim, C., Pilania, G., & Ramprasad, R. (2016) · Chemistry of Materials · doi:10.1021/acs.chemmater.5b04109 · Cited by 236
Buchlak, Q. D., Esmaili, N., Leveque, J.-C., Farrokhi, F., Bennett, C., Piccardi, M., & Sethi, R. K. (2020) · Neurosurgical Review · doi:10.1007/s10143-019-01163-8 · Cited by 227
“Artificial intelligence (AI) involves the use of computer systems to achieve goals by simulating cognitive capabilities [42, 79].”
BackgroundA review of machine learning applications to coastal sediment transport and morphodynamics
Goldstein, E. B., Coco, G., & Plant, N. G. (2019) · Earth-Science Reviews · doi:10.1016/j.earscirev.2019.04.022 · Cited by 222
“Second, many newer techniques may not yet have been applied to coastal research, such as recent advances in ANN architecture and training (e.g., Deep Learning; LeCun et al., 2015), or newer probabilistic techniques (Ghahramani, 2015).”
Adaptive Strategies for Materials Design using Uncertainties
Balachandran, P. V., Xue, D., Theiler, J., Hogden, J., & Lookman, T. (2016) · Scientific Reports · doi:10.1038/srep19660 · Cited by 223
Neurodevelopmental Resilience and Susceptibility to Maternal Immune Activation
Meyer, U. (2019) · Trends in Neurosciences · doi:10.1016/j.tins.2019.08.001 · Cited by 221
Vakili, M., Ghamsari, M., & Rezaei, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.09636 · Cited by 298
“To address all of the above-mentioned challenges, the best option is probably getting help from artificial intelligence (AI), and especially machine learning, as the most noticeable part of AI [4].”
BackgroundWang, H. S., Hong, S. K., Han, J. H., Jung, Y. H., Jeong, H. K., Im, T. H., Jeong, C. K., Lee, B.-Y., Kim, G., Yoo, C. D., et al. (2021) · Science Advances · doi:10.1126/sciadv.abe5683 · Cited by 219
Holzinger, A., Saranti, A., Angerschmid, A., Retzlaff, C. O., Gronauer, A., Pejakovic, V., Medel-Jimenez, F., Krexner, T., Gollob, C., & Stampfer, K. (2022) · Sensors · doi:10.3390/s22083043 · Cited by 192
“The inverse probability allows us to learn from data, infer unknowns, and make predictions [20].”
BackgroundInternal models in biological control
McNamee, D., & Wolpert, D. M. (2019) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-060117-105206 · Cited by 225
“The brain must use approximations to the optimal solution which are as yet unknown although there are a variety of machine learning methods [140] which may provide inspiration for such investigations.”
Background6G White Paper on Machine Learning in Wireless Communication NetworksPreprint
Ali, S., Saad, W., Rajatheva, N., Chang, K., Steinbach, D., Sliwa, B., Wietfeld, C., Mei, K., Shiri, H., Zepernick, H., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13875 · Cited by 252
“There have been a lot of recent advances in probabilistic ML and Bayesian inference [3] which could potentially be used in 6G wireless networks.”
Background
Metadata
- Authors
- Ghahramani, Z.
- Venue
- Nature
- Published
- 2015-05-27
- Volume
- 521
- Issue
- 7553
- Pages
- 452-459
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1494192115
- Cited by
- 1,995
- References
- 108
- Citations by year
- 2026: 166 · 2025: 231 · 2024: 228 · 2023: 206 · 2022: 217 · 2021: 265 · 2020: 235 · 2019: 210 · 2018: 102 · 2017: 84 · 2016: 39 · 2015: 11
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/I036575/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- stochastic modeling, machine learning, artificial intelligence, uncertainty representation, probabilistic programming, Bayesian optimization, data compression, experiential learning
- MeSH terms
- Artificial Intelligence, Automation, Bayes Theorem, Models, Statistical, Statistics, Nonparametric, Uncertainty, Data Compression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.