Probabilistic machine learning and artificial intelligence
The DOI matches its Crossref record; 104 of the 108 references it cites were found in a registry or an index.
Abstract
How can a machine learn from experience? Probabilistic modelling provides a framework for understanding what learning is, and has therefore emerged as one of the principal theoretical and practical approaches for designing machines that learn from data acquired through experience. The probabilistic framework, which describes how to represent and manipulate uncertainty about models and predictions, has a central role in scientific data analysis, machine learning, robotics, cognitive science and artificial intelligence. This Review provides an introduction to this framework, and discusses some of the state-of-the-art advances in the field, namely, probabilistic programming, Bayesian optimization, data compression and automatic model discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deriving from the Bayesian framework, GPR models have been widely applied to prognostic analysis as they are flexible, nonparametric and probabilistic [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ameliorate this in GPR, one way is to minimize the negative log marginal likelihood [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The performance of GPR is highly sensitive on the covariance function and the kernels should therefore be carefully selected to achieve high prediction accuracy [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These methods can be broadly classified into two categories: Bayesian approaches [40,90,106] and Frequentist, approaches [14,70,113]”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“recent advances using deep neural networks to solve challenging pattern recognition problems such as speech recognition [5], image classification [6, 7], and prediction of words in text [8], do not overtly represent the uncertainty in the structure or parameters of those neural networks.”
BackgroundA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“The HMM is a widely used probabilistic model for sequential and time-series data, which assumes the data were obtained by transitioning stochastically between a discrete number of hidden states 98 .”
MethodBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“The model could have a large number of parameters compared with the data set (for example, the neural network recently used to achieve translations of English and French sentences that approached the accuracy of state-of-the-art methods is a probabilistic model with 384 million parameters 29 ).”
MethodGaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Research works printed but not linked: 14
- [8] Bengio, Y., Ducharme, R., Vincent, P. & Janvin, C. A neural probabilistic language model. The Journal of Machine Learning Research 3 , 1137-1155 (2003). -
- Hinton, G. E., McClelland, J. L. & Rumelhart, D. E. in Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations 77–109 (MIT Press, 1986).
- Goodman, N. D. & Stuhlmüller, A. The Design and Implementation of Probabilistic Programming Languages. Available at http://dippl.org (2015).
- Mansinghka, V., Kulkarni, T. D., Perov, Y. N. & Tenenbaum, J. Approximate Bayesian image interpretation using generative probabilistic graphics programs. In Proc. Advances in Neural Information Processing Systems 26 1520–1528 (2013).
- Minka, T. P., Winn, J. M., Guiver, J. P. & Knowles, D. A. Infer.NET 2.4. http://research.microsoft.com/infernet (Microsoft Research, 2010).
- Pfeffer, A. Figaro: An Object-Oriented Probabilistic Programming Language. Tech. Rep. (Charles River Analytics, 2009).
- Mansinghka, V., Selsam, D. & Perov, Y. Venture: a higher-order probabilistic programming platform with programmable inference. Preprint at http://arxiv.org/abs/1404.0099 (2014). · arXiv
- Li, L., Wu, Y. & Russell, S. J. SWIFT: Compiled Inference for Probabilistic Programs. Report No. UCB/EECS-2015–12 (Univ. California, Berkeley, 2015).
- Bergstra, J. et al. Theano: a CPU and GPU math expression compiler. In Proc. 9th Python in Science Conference http://conference.scipy.org/proceedings/scipy2010/ (2010).
- Poupart, P. in Encyclopedia of Machine Learning 90–93 (Springer, 2010).
- Grosse, R. B., Salakhutdinov, R. & Tenenbaum, J. B. Exploiting compositionality to explore a large space of model structures. In Proc. Conference on Uncertainty in Artificial Intelligence 306–315 (2012).
- Welling, M. et al. Bayesian inference with big data: a snapshot from a workshop. ISBA Bulletin 21, https://bayesian.org/sites/default/files/fm/bulletins/1412.pdf (2014).
- Bakker, B. & Heskes, T. Task clustering and gating for Bayesian multitask learning. J. Mach. Learn. Res. 4, 83–99 (2003).
- Hensman, J., Fusi, N. & Lawrence, N. D. Gaussian processes for big data. In Proc. Conference on Uncertainty in Artificial Intelligence 244 (UAI, 2013).
Cited by
Items 101–200 of 1,004
Toward the third generation artificial intelligence
Zhang, B., Zhu, J., & Su, H. (2023) · Science China Information Sciences · doi:10.1007/s11432-021-3449-x · Cited by 217
“Given the observed data set d ⊂ D , it calculates the posterior probability distribution of each hypothesis via Bayes’ rule in (6) [12,77] as where p ( h i ) is the prior distribution (before seeing the data), and p ( d | h i ) is the likelihood of d given the hypothesis h i .”
MethodPrecision medicine in stroke: towards personalized outcome predictions using artificial intelligence
Bonkhoff, A. K., & Grefkes, C. (2022) · Brain · doi:10.1093/brain/awab439 · Cited by 193
“as well as further non-parametric models, such as nearestneighbour algorithms and those applying kernels, may be more capable to ‘let data speak for themselves’.(123) They can—at best— uncover complex, predictive patterns in data automatically.”
Battery Safety: Machine Learning-Based Prognostics
Zhao, J., Feng, X., Pang, Q., Fowler, M., Lian, Y., Ouyang, M., & Burke, A. F. (2024) · Progress in Energy and Combustion Science · doi:10.1016/j.pecs.2023.101142 · Cited by 216
Wang, Y. (2021) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2020.100872 · Cited by 162
“The state-of-the-art advances in probabilistic machine learning include probabilistic programming, Bayesian optimization, data compression, and automatic model discovery (see Ghahramani, 2015, for a detailed review).”
Application of machine-learning methods in forest ecology: recent progress and future challenges
Liu, Z., Peng, C., Work, T., Candau, J.-N., DesRochers, A., & Kneeshaw, D. (2018) · Environmental Reviews · doi:10.1139/er-2018-0034 · Cited by 201
“One way to deal with uncertainties effectively is to develop a probabilistic machine learning (PML) approach which provides a framework for representing and manipulating uncertainty related to data, models, and predictions (Ghahramani 2015).”
Applying Artificial Intelligence in Physical Education and Future Perspectives
Lee, H. S., & Lee, J. (2021) · Sustainability · doi:10.3390/su13010351 · Cited by 213
“Per Ghahramani [16], machine learning is the development of methods for improving a computer’s performance in tasks based on observed data.”
MethodMachine learning and artificial intelligence in physiologically based pharmacokinetic modeling
Chou, W.-C., & Lin, Z. (2023) · Toxicological Sciences · doi:10.1093/toxsci/kfac101 · Cited by 190
Kubota, K. J., Chen, J. A., & Little, M. A. (2016) · Movement Disorders · doi:10.1002/mds.26693 · Cited by 210
“20 For example, Dirichlet process mixture models in PD subtyping discover both the number of subtypes and the representative clinical characteristics of each subtype.”
BackgroundArtificial intelligence for precision oncology: beyond patient stratification
Azuaje, F. (2019) · npj Precision Oncology · doi:10.1038/s41698-019-0078-1 · Cited by 200
“, random forests and gradient boosting machines; GBM).(3,18,19) These and other approaches have provided the basis for promising predictive modelling applications in oncology research.”
BackgroundMachine learning for predicting battery capacity for electric vehicles
Zhao, J., Ling, H., Liu, J., Wang, J., Burke, A. F., & Lian, Y. (2023) · eTransportation · doi:10.1016/j.etran.2022.100214 · Cited by 200
Thayyib, P. V., Mamilla, R., Khan, M., Fatima, H., Asim, M., Anwar, I., Shamsudheen, M. K., & Khan, M. A. (2023) · Sustainability · doi:10.3390/su15054026 · Cited by 163
“Therefore, humans should know that machines learn from experience using probabilistic modelling and optimized artificial decision-making The role of AI in achieving sustainable business models has already gained traction in the literature. capabilities [63].”
BackgroundMachine Learning Aided Design and Optimization of Thermal Metamaterials
Zhu, C., Bamidele, E. A., Shen, X., Zhu, G., & Li, B. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.3c00708 · Cited by 195
Schramowski, P., Stammer, W., Teso, S., Brugger, A., Herbert, F., Shao, X., Luigs, H.-G., Mahlein, A.-K., & Kersting, K. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0212-3 · Cited by 207
Machine Learning the Voltage of Electrode Materials in Metal-Ion Batteries
Joshi, R. P., Eickholt, J., Li, L., Fornari, M., Barone, V., & Peralta, J. E. (2019) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.9b04933 · Cited by 199
Bayesian neural networks for flight trajectory prediction and safety assessment
Zhang, X., & Mahadevan, S. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113246 · Cited by 195
A systematic review of personal thermal comfort models
Arakawa Martins, L., Soebarto, V., & Williamson, T. (2022) · Building and Environment · doi:10.1016/j.buildenv.2021.108502 · Cited by 187
Data‐Driven Materials Innovation and Applications
Wang, Z., Sun, Z., Yin, H., Liu, X., Wang, J., Zhao, H., Pang, C. H., Wu, T., Li, S., Yin, Z., et al. (2022) · Advanced Materials · doi:10.1002/adma.202104113 · Cited by 187
He, K., Wang, C., He, Y., Su, J., & Chen, X. (2023) · Chemical Reviews · doi:10.1021/acs.chemrev.3c00527 · Cited by 200
CNN-BiLSTM hybrid neural networks with attention mechanism for well log prediction
Shan, L., Liu, Y., Tang, M., Yang, M., & Bai, X. (2021) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2021.108838 · Cited by 191
Luo, X., Zhou, M., Li, S., & Shang, M. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2766528 · Cited by 200
“, protein interactome analysis [1]–[3], [14], social network analysis [4]–[6], business intelligence [7]–[9], [16]–[32], [31]–[38], [44], [62]– [67], and cloud energy/quality-of-service analysis [68]–[76].”
BackgroundXu, L., Chen, N., Chen, Z., Zhang, C., & Yu, H. (2021) · Earth-Science Reviews · doi:10.1016/j.earscirev.2021.103828 · Cited by 185
Reliable deep-learning-based phase imaging with uncertainty quantification
Xue, Y., Cheng, S., Li, Y., & Tian, L. (2019) · Optica · doi:10.1364/optica.6.000618 · Cited by 198
“2 Uncertainty learning framework Our UL framework is built on the probabilistic view of neural networks [28].”
BackgroundMachine learning for ecosystem services
Willcock, S., Martínez-López, J., Hooftman, D. A. P., Bagstad, K. J., Balbi, S., Marzo, A., Prato, C., Sciandrello, S., Signorello, G., Voigt, B., et al. (2018) · Ecosystem Services · doi:10.1016/j.ecoser.2018.04.004 · Cited by 181
“Machine learning algorithms assume considerable changes in the modelled system have not taken place during the time period covered by the model (Ghahramani, 2015; Jordan and Mitchell, 2015), though machine learning can also be used for identifying change, i.e., detecting concept drift (Gama et al.,…”
BackgroundMethodInference in the age of big data: Future perspectives on neuroscience
Bzdok, D., & Yeo, B. T. T. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.04.061 · Cited by 189
“Non-parametric models can therefore outperform parametric alternatives in many data-rich scenarios (Ghahramani, 2015).”
InfluentialBambi : A Simple Interface for Fitting Bayesian Linear Models in Python
Capretto, T., Piho, C., Kumar, R. R., Westfall, J., Yarkoni, T., & Martin, O. A. (2022) · Journal of Statistical Software · doi:10.18637/jss.v103.i15 · Cited by 221
“The aim of a PPL is to augment general purpose programming languages with built-in probabilistic capabilities, allowing applied users to focus on the creation of models, rather than on the implementation of their computation Daniel Roy [2015], Bessiere et al. [2013], Ghahramani [2015].”
BackgroundArtificial Intelligence in Education: Current Insights and Future Perspectives
Goksel, N., & Bozkurt, A. (2019) · Advances in Educational Technologies and Instructional Design · doi:10.4018/978-1-5225-8431-5.ch014 · Cited by 179
In situ learning using intrinsic memristor variability via Markov chain Monte Carlo sampling
Dalgaty, T., Castellani, N., Turck, C., Harabi, K.-E., Querlioz, D., & Vianello, E. (2021) · Nature Electronics · doi:10.1038/s41928-020-00523-3 · Cited by 180
A Fast Non-Negative Latent Factor Model Based on Generalized Momentum Method
Luo, X., Liu, Z., Li, S., Shang, M., & Wang, Z. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2018.2875452 · Cited by 186
Al-Garadi, M. A., Hussain, M. R., Khan, N., Murtaza, G., Nweke, H. F., Ali, I., Mujtaba, G., Chiroma, H., Khattak, H. A., & Gani, A. (2019) · IEEE Access · doi:10.1109/access.2019.2918354 · Cited by 177
Multi-classifier information fusion in risk analysis
Pan, Y., Zhang, L., Wu, X., & Skibniewski, M. J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.02.003 · Cited by 191
From zero-shot machine learning to zero-day attack detection
Sarhan, M., Layeghy, S., Gallagher, M. R., & Portmann, M. (2023) · International Journal of Information Security · doi:10.1007/s10207-023-00676-0 · Cited by 217
“and efficiency of various technological applications [1].”
Quantum-Assisted Learning of Hardware-Embedded Probabilistic Graphical Models
Benedetti, M., Realpe-Gómez, J., Biswas, R., & Perdomo-Ortiz, A. (2017) · Physical Review X · doi:10.1103/physrevx.7.041052 · Cited by 111
“The dynamics of a quantum annealer are characterized by the time-dependent Hamiltonian where τ = t/t a is the ratio between time t and annealing time t a , while A ( τ ) and B ( τ ) are monotonic functions satisfying A (0) B (0) ≈ 0 and B (1) A (1) ≈ 0.”
BackgroundHow does Machine Learning Change Software Development Practices?
Wan, Z., Xia, X., Lo, D., & Murphy, G. C. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2937083 · Cited by 181
“Uncertainty plays a fundamental role in probabilistic modeling [14]: Observed data can be consistent with various models, and thus which model is appropriate given the data is uncertain.”
BackgroundThrane, J., Wass, J., Piels, M., Diniz, J. C. M., Jones, R., & Zibar, D. (2017) · Journal of Lightwave Technology · doi:10.1109/jlt.2016.2590989 · Cited by 176
“THE field of machine learning offers many powerful techniques to: estimate parameters from noisy measurement data, determine complex mapping between input and output data, infer probability distributions, predict the output based on the past input data and perform classification [1], [2].”
BackgroundAI for managing open innovation: Opportunities, challenges, and a research agenda
Broekhuizen, T., Dekker, H. C., de Faria, P., Firk, S., Nguyen, D. K., & Sofka, W. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.114196 · Cited by 210
An introduction and overview of machine learning in neurosurgical care
Senders, J. T., Zaki, M. M., Karhade, A. V., Chang, B., Gormley, W. B., Broekman, M. L., Smith, T. R., & Arnaout, O. (2018) · Acta Neurochirurgica · doi:10.1007/s00701-017-3385-8 · Cited by 178
Bayesian-Deep-Learning Estimation of Earthquake Location From Single-Station Observations
Mousavi, S. M., & Beroza, G. C. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2988770 · Cited by 185
“Predictions using future data are also uncertain [20].”
MethodHamon, R., Junklewitz, H., Sanchez, I., Malgieri, G., & De Hert, P. (2022) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2021.3129960 · Cited by 160
Predicting sex from brain rhythms with deep learning
van Putten, M. J. A. M., Olbrich, S., & Arns, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-21495-7 · Cited by 169
“Deep nets do not need prior extraction of such hand-made features, can learn from raw data 28–30 , and have potential to detect subtle differences in otherwise similar patterns 25,28 .”
BackgroundArtificial Intelligence: Foundations of Computational Agents
Poole, D. L., & Mackworth, A. K. (2017) · Cambridge University Press eBooks · doi:10.1017/9781108164085 · Cited by 158
Li, Y., Li, K., Zhang, C., Montoya, J., & Chen, G.-H. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2910760 · Cited by 169
“In statistical machine learning, instead of using an explicit assumption on the prior P(x), the posterior distribution P(x |y) is directly learned from the training data via a supervised learning process [33].”
Liu, K., Ashwin, T. R., Hu, X., Lucu, M., & Widanage, W. D. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110017 · Cited by 161
Using online verification to prevent autonomous vehicles from causing accidents
Pek, C., Manzinger, S., Koschi, M., & Althoff, M. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0225-y · Cited by 194
“Existing prediction approaches usually compute a countable set of most likely behaviours by applying probabilistic 28–30 or machine learning meth-ods 31–33 .”
MethodCharting the Attack Surface of Trigger-Action IoT Platforms
Wang, Q., Datta, P., Yang, W., Liu, S., Bates, A., & Gunter, C. A. (2019) · Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3319535.3345662 · Cited by 158
“Alternately, our method could be augmented with prediction uncertainty analysis and quantiication techniques [43] to request human intervention when the classiier is not conident enough in its prediction.”
MethodLanger, M. F., Goeßmann, A., & Rupp, M. (2022) · npj Computational Materials · doi:10.1038/s41524-022-00721-x · Cited by 173
“[2] Zoubin Ghahramani: Probabilistic machine learning and artificial intelligence.”
BackgroundStaszak, M., Staszak, K., Wieszczycka, K., Bajek, A., Roszkowski, K., & Tylkowski, B. (2021) · Wiley Interdisciplinary Reviews Computational Molecular Science · doi:10.1002/wcms.1568 · Cited by 204
“Naive Bayes regression is linear method in which statistical analysis is carried out using the method of Bayesian inference 54 and classifiers are based on the assumption of mutual independence of independent variables.”
MethodLuo, X., Wen, Q., Dong, A., Sedraoui, K., & Zhou, M. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2020.1003396 · Cited by 199
“Note that the achieved LF can precisely represent each user and item’s characteristics hidden in an HiDS matrix’s observed data [6]–[8].”
BackgroundAdaptive and Resilient Soft Tensegrity Robots
Rieffel, J. A., & Mouret, J.-B. (2018) · Soft Robotics · doi:10.1089/soro.2017.0066 · Cited by 164
“…essentially arXiv preprint | 8 implements a variant of Bayesian optimization, which is a state-of-the-art optimization algorithm designed to maximize expensive performance functions (a.k.a. cost functions) whose gradient cannot be evaluated analytically (Ghahramani, 2015; Shahri-ari et al., 2016).”
Computational Neuropsychology and Bayesian Inference
Parr, T., Rees, G., & Friston, K. J. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00061 · Cited by 149
“Bayesian inference uses a generative model to compute the probable causes of sensory data (Beal, 2003; Doya, 2007; Ghahramani, 2015).”
BackgroundMethodApplications of Artificial Intelligence in Ophthalmology: General Overview
Lü, W., Tong, Y., Yu, Y., Xing, Y., Chen, C., & Shen, Y. (2018) · Journal of Ophthalmology · doi:10.1155/2018/5278196 · Cited by 173
“As we mentioned above, ML is one subset of AI and includes DL and CML (Figure 1(a)). defining characteristic of ML algorithms is the quality of predictions improved with experience [13]. more data we provide (usually up to a platform), the better the prediction model we can achieve.”
Classical Statistics and Statistical Learning in Imaging Neuroscience
Bzdok, D. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00543 · Cited by 172
“In contrast, computation-intensive pattern learning methods have always had a strong focus on prediction in frequently extensive data with more modest concern for interpretability and the “right” underlying question (Ghahramani, 2015; Hastie et al., 2001).”
MethodMachine learning and knowledge graph based design rule construction for additive manufacturing
Ko, H., Witherell, P., Lu, Y., Kim, S., & Rosen, D. W. (2020) · Additive manufacturing · doi:10.1016/j.addma.2020.101620 · Cited by 206
Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork
Bansal, G., Nushi, B., Kamar, E., Horvitz, E., & Weld, D. S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17359 · Cited by 121
“…renders AI predictions more actionable (for humans) and better suitable for team-ing is confidence-calibration , for example, using Bayesian models (Ghahramani 2015; Beach 1975; Gal and Ghahra-mani 2016) or via post-hoc calibration (Platt 1999; Zadrozny and Elkan 2001; Guo et al. 2017;…”
MethodLiu, Y., Su, X., Ding, J., Zhou, J., Liu, Z., Wei, X., Yang, H. B., & Liu, B. (2024) · Chemical Society Reviews · doi:10.1039/d3cs00967j · Cited by 167
Machine learning of explicit order parameters: From the Ising model to SU(2) lattice gauge theory
Wetzel, S. J., & Scherzer, M. (2017) · Physical review. B./Physical review. B · doi:10.1103/physrevb.96.184410 · Cited by 169
Zhao, J., Feng, X., Wang, J., Lian, Y., Ouyang, M., & Burke, A. F. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.121949 · Cited by 152
Schauberger, B., Jägermeyr, J., & Gornott, C. (2020) · European Journal of Agronomy · doi:10.1016/j.eja.2020.126153 · Cited by 161
Luo, X., Zhou, Y., Liu, Z., & Zhou, M. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3125252 · Cited by 202
Fu, X., Wu, X., Zhang, C., Fan, S., & Liu, N. (2022) · Protection and Control of Modern Power Systems · doi:10.1186/s41601-022-00262-x · Cited by 150
“Reference [164] considers that the probabilistic frame - work of machine intelligence has an attractive advantage in dealing with uncertainty modeling.”
BackgroundRemaining Useful Life Prediction for Bearings Based on a Gated Recurrent Unit
Que, Z., Jin, X., & Xu, Z. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3054025 · Cited by 148
“The Bayesian machine learning is used to manipulate uncertainties [21].”
Sustainable AI: An integrated model to guide public sector decision-making
Wilson, C., & van der Velden, M. (2022) · Technology in Society · doi:10.1016/j.techsoc.2022.101926 · Cited by 123
Hughes, D. P., & Salathé, M. (2015) · arXiv (Cornell University) · Cited by 194
Bianchi, J., Ruellas, A. C. D. O., Gonçalves, J. R., Paniagua, B., Prieto, J. C., Styner, M. A., Li, T., Hongtu Zhu, B., Sugai, J. V., Giannobile, W., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-64942-0 · Cited by 154
Privacy enhancing technologies for solving the privacy-personalization paradox: Taxonomy and survey
Kaaniche, N., Laurent, M., & Belguith, S. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102807 · Cited by 136
Information-theoretic exploration with Bayesian optimization
Bai, S., Wang, J., Chen, F., & Englot, B. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759289 · Cited by 171
“At each iteration of Bayesian optimization, a candidate sensing action is suggested and evaluated, then added to the pool of sensing actions used to approximate the MI objective function.”
MethodInverse design of photonic topological state via machine learning
Long, Y., Ren, J., Li, Y., & Chen, H. (2019) · Applied Physics Letters · doi:10.1063/1.5094838 · Cited by 145
A Stacking Ensemble Model of Various Machine Learning Models for Daily Runoff Forecasting
Lu, M., Hou, Q., Qin, S., Zhou, L., Hua, D., Wang, X., & Cheng, L. (2023) · Water · doi:10.3390/w15071265 · Cited by 156
“The main strategies in the current optimization of hyper-parameters are babysitting, grid search, random search, and Bayesian optimization [51].”
BackgroundMonte Carlo DropBlock for modeling uncertainty in object detection
Yelleni, S. H., Kumari, D., Srijith, P. K., & Mohan, C. K. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110003 · Cited by 152
An Adaptive Machine Learning Strategy for Accelerating Discovery of Perovskite Electrocatalysts
Li, Z., Achenie, L. E. K., & Xin, H. (2020) · ACS Catalysis · doi:10.1021/acscatal.9b05248 · Cited by 135
Ramadhan, R. A. A., Heatubun, Y. R. J., Tan, S. F., & Lee, H. (2021) · Renewable Energy · doi:10.1016/j.renene.2021.06.079 · Cited by 146
Luo, X., Sun, J., Wang, Z., Li, S., & Shang, M. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2724769 · Cited by 154
A systematic review of digital transformation technologies in museum exhibition
Li, J., Zheng, X., Watanabe, I., & Ochiai, Y. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108407 · Cited by 136
Applicability of deep neural networks on production forecasting in Bakken shale reservoirs
Wang, S., Chen, Z., & Chen, S. (2019) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2019.04.016 · Cited by 142
Machine learning for modeling, diagnostics, and control of non-equilibrium plasmas
Mesbah, A., & Graves, D. B. (2019) · Journal of Physics D Applied Physics · doi:10.1088/1361-6463/ab1f3f · Cited by 136
“In our view, the paradigm of probabilistic or Bayesian ML, which enables quantifying and manipulating uncertainty about models and predictions [65], can play a central role in future developments of scientific data analysis and ML for NEPs.”
BackgroundMachine Learning for Sustainable Energy Systems
Donti, P. L., & Kolter, J. Z. (2021) · Annual Review of Environment and Resources · doi:10.1146/annurev-environ-020220-061831 · Cited by 109
“In terms of uncertainty-aware ML, Ghahramani (161) discusses research directions in areas such as probabilistic programming and Bayesian optimization.”
BackgroundHow Do Machines Learn? Artificial Intelligence as a New Era in Medicine
Koteluk, O., Wartecki, A., Mazurek, S., Kołodziejczak, I., & Mackiewicz, A. A. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11010032 · Cited by 148
Interactive Thyroid Disease Prediction System Using Machine Learning Technique
Tyagi, A., Mehra, R., & Saxena, A. K. (2018) · International Conference on Parallel, Distributed and Grid Computing (PDGC) · doi:10.1109/pdgc.2018.8745910 · Cited by 151
“These algorithms may somehow be dominant in previously formerly arrangements in complex data that are not primarily measurable by humans [9] and may be used to develop labels to finally train a supervised model.”
BackgroundArtificial intelligence in radiotherapy
Siddique, S., & Chow, J. C. L. (2020) · Reports of Practical Oncology & Radiotherapy · doi:10.1016/j.rpor.2020.03.015 · Cited by 143
The global workspace needs metacognition
Shea, N., & Frith, C. D. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.04.007 · Cited by 130
“Confidence-involving computations have recently begun to gain prominence in artificial intelligence research [112]; (iv) coarse-graining and other kinds of simplification of the right kind enable better communication of the causal structure of systems than at the microscale [87].”
Automatic channel detection using deep learning
Pham, N. H., Fomel, S. B., & Dunlap, D. B. (2019) · Interpretation · doi:10.1190/int-2018-0202.1 · Cited by 129
Likelihood-free inference via classification
Gutmann, M. U., Dutta, R., Kaski, S., & Corander, J. (2018) · Statistics and Computing · doi:10.1007/s11222-017-9738-6 · Cited by 90
“2006), and artificial intelligence (Ghahramani 2015).”
Li, H., Huang, H., Li, Y., Zhou, J., & Mi, J. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2018.05.015 · Cited by 134
Artificial Intelligence in Clinical Health Care Applications: Viewpoint
van Hartskamp, M., Consoli, S., Verhaegh, W., Petkovic, M., & van de Stolpe, A. (2019) · Interactive Journal of Medical Research · doi:10.2196/12100 · Cited by 123
“Technology-wise, numerous methods from the domain of AI have been explored for the development of clinical applications [8,11,16,43].”
BackgroundMethodInfluentialAn Overview of Organs-on-Chips Based on Deep Learning
Li, J., Chen, J., Bai, H., Wang, H., Hao, S., Ding, Y., Peng, B., Zhang, J., Li, L., & Huang, W. (2022) · Research · doi:10.34133/2022/9869518 · Cited by 134
“Deep learning [6] is the most representative research field in artificial intelligence (AI) [7].”
BackgroundHow does hemispheric specialization contribute to human-defining cognition?
Hartwigsen, G., Bengio, Y., & Bzdok, D. (2021) · Neuron · doi:10.1016/j.neuron.2021.04.024 · Cited by 129
Ethical considerations about artificial intelligence for prognostication in intensive care
Beil, M., Proft, I., van Heerden, D., Sviri, S., & van Heerden, P. V. (2019) · Intensive Care Medicine Experimental · doi:10.1186/s40635-019-0286-6 · Cited by 124
Machine learning for high-throughput experimental exploration of metal halide perovskites
Ahmadi, M., Ziatdinov, M., Zhou, Y., Lass, E. A., & Kalinin, S. V. (2021) · Joule · doi:10.1016/j.joule.2021.10.001 · Cited by 117
TLT: Recurrent fine-tuning transfer learning for water quality long-term prediction
Lin, P., Wu, H., Gao, M., Yi, H., Xiong, Q., Yang, Y., & Cheng, S. (2022) · Water Research · doi:10.1016/j.watres.2022.119171 · Cited by 124
Artificial Intelligence and Advanced Materials
López, C. (2023) · Advanced Materials · doi:10.1002/adma.202208683 · Cited by 144
Measurable Counterfactual Local Explanations for Any Classifier
Adam, W., & Artur, D. G. (2020) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/faia200387 · Cited by 68
Machine learning in concrete technology: A review of current researches, trends, and applications
Gamil, Y. (2023) · Frontiers in Built Environment · doi:10.3389/fbuil.2023.1145591 · Cited by 133
“It produces a model based on training data to make predictions or judgments without having to be explicitly programmed to do so (Ghahramani, 2015).”
BackgroundSong, Y., Li, M., Luo, X., Yang, G., & Wang, C. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2908958 · Cited by 122
“W ITH the rapid development of the communication technology and the social economy, data volume composed of numerous entities has been explosively increased along with the computer science deeply integrated into various industrial applications such as e-business systems [1], [13], genetic engineering [3], and social n…”
BackgroundBenker, M., Furtner, L., Semm, T., & Zaeh, M. F. (2020) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.11.005 · Cited by 132
Manis, K. T., & Madhavaram, S. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2022.113485 · Cited by 136
Machine learning-assisted enzyme engineering
Siedhoff, N. E., Schwaneberg, U., & Davari, M. D. (2020) · Methods in enzymology on CD-ROM/Methods in enzymology · doi:10.1016/bs.mie.2020.05.005 · Cited by 121
Kanarachos, S., Christopoulos, S.-R. G., Chroneos, A., & Fitzpatrick, M. E. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.04.028 · Cited by 120
“) as well as heart attack prevention (Ghahramani, 2015; Ikonomopoulos, Alamaniotis, Chatzidakis, & Tsoukalas, 2013; Nicholas V. Sarlis et al., 2015; P. A. Varotsos, Sarlis, Skordas, & Lazaridou, 2007).”
The growing ubiquity of algorithms in society: implications, impacts and innovations
Olhede, S. C., & Wolfe, P. J. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0364 · Cited by 120
“An example is given by neural networks, which build models of how responses depend on variables of interest using input data in relatively complex ways [53,66].”
BackgroundFusion of Probability Density Functions
Koliander, G., El-Laham, Y., Djurić, P. M., & Hlawatsch, F. (2022) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3154399 · Cited by 141
Gao, Y. N., Wang, J., & Xu, X. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105380 · Cited by 134
Leveraging Modern Artificial Intelligence for Remote Sensing and NWP: Benefits and Challenges
Boukabara, S., Krasnopolsky, V. M., Stewart, J. Q., Maddy, E. S., Shahroudi, N., & Hoffman, R. N. (2019) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-18-0324.1 · Cited by 126
Metadata
- Authors
- Ghahramani, Z.
- Venue
- Nature
- Published
- 2015-05-27
- Volume
- 521
- Issue
- 7553
- Pages
- 452-459
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1494192115
- Cited by
- 1,995
- References
- 108
- Citations by year
- 2026: 166 · 2025: 231 · 2024: 228 · 2023: 206 · 2022: 217 · 2021: 265 · 2020: 235 · 2019: 210 · 2018: 102 · 2017: 84 · 2016: 39 · 2015: 11
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/I036575/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- stochastic modeling, machine learning, artificial intelligence, uncertainty representation, probabilistic programming, Bayesian optimization, data compression, experiential learning
- MeSH terms
- Artificial Intelligence, Automation, Bayes Theorem, Models, Statistical, Statistics, Nonparametric, Uncertainty, Data Compression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.