Probabilistic machine learning and artificial intelligence
The DOI matches its Crossref record; 104 of the 108 references it cites were found in a registry or an index.
Abstract
How can a machine learn from experience? Probabilistic modelling provides a framework for understanding what learning is, and has therefore emerged as one of the principal theoretical and practical approaches for designing machines that learn from data acquired through experience. The probabilistic framework, which describes how to represent and manipulate uncertainty about models and predictions, has a central role in scientific data analysis, machine learning, robotics, cognitive science and artificial intelligence. This Review provides an introduction to this framework, and discusses some of the state-of-the-art advances in the field, namely, probabilistic programming, Bayesian optimization, data compression and automatic model discovery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deriving from the Bayesian framework, GPR models have been widely applied to prognostic analysis as they are flexible, nonparametric and probabilistic [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To ameliorate this in GPR, one way is to minimize the negative log marginal likelihood [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The performance of GPR is highly sensitive on the covariance function and the kernels should therefore be carefully selected to achieve high prediction accuracy [139].”
From Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review (2019) · cites this paper as [139]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These methods can be broadly classified into two categories: Bayesian approaches [40,90,106] and Frequentist, approaches [14,70,113]”
From Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty (2021) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“recent advances using deep neural networks to solve challenging pattern recognition problems such as speech recognition [5], image classification [6, 7], and prediction of words in text [8], do not overtly represent the uncertainty in the structure or parameters of those neural networks.”
BackgroundA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 1×
“The HMM is a widely used probabilistic model for sequential and time-series data, which assumes the data were obtained by transitioning stochastically between a discrete number of hidden states 98 .”
MethodBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 1×
“The model could have a large number of parameters compared with the data set (for example, the neural network recently used to achieve translations of English and French sentences that approached the accuracy of state-of-the-art methods is a probabilistic model with 384 million parameters 29 ).”
MethodGaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Research works printed but not linked: 14
- [8] Bengio, Y., Ducharme, R., Vincent, P. & Janvin, C. A neural probabilistic language model. The Journal of Machine Learning Research 3 , 1137-1155 (2003). -
- Hinton, G. E., McClelland, J. L. & Rumelhart, D. E. in Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations 77–109 (MIT Press, 1986).
- Goodman, N. D. & Stuhlmüller, A. The Design and Implementation of Probabilistic Programming Languages. Available at http://dippl.org (2015).
- Mansinghka, V., Kulkarni, T. D., Perov, Y. N. & Tenenbaum, J. Approximate Bayesian image interpretation using generative probabilistic graphics programs. In Proc. Advances in Neural Information Processing Systems 26 1520–1528 (2013).
- Minka, T. P., Winn, J. M., Guiver, J. P. & Knowles, D. A. Infer.NET 2.4. http://research.microsoft.com/infernet (Microsoft Research, 2010).
- Pfeffer, A. Figaro: An Object-Oriented Probabilistic Programming Language. Tech. Rep. (Charles River Analytics, 2009).
- Mansinghka, V., Selsam, D. & Perov, Y. Venture: a higher-order probabilistic programming platform with programmable inference. Preprint at http://arxiv.org/abs/1404.0099 (2014). · arXiv
- Li, L., Wu, Y. & Russell, S. J. SWIFT: Compiled Inference for Probabilistic Programs. Report No. UCB/EECS-2015–12 (Univ. California, Berkeley, 2015).
- Bergstra, J. et al. Theano: a CPU and GPU math expression compiler. In Proc. 9th Python in Science Conference http://conference.scipy.org/proceedings/scipy2010/ (2010).
- Poupart, P. in Encyclopedia of Machine Learning 90–93 (Springer, 2010).
- Grosse, R. B., Salakhutdinov, R. & Tenenbaum, J. B. Exploiting compositionality to explore a large space of model structures. In Proc. Conference on Uncertainty in Artificial Intelligence 306–315 (2012).
- Welling, M. et al. Bayesian inference with big data: a snapshot from a workshop. ISBA Bulletin 21, https://bayesian.org/sites/default/files/fm/bulletins/1412.pdf (2014).
- Bakker, B. & Heskes, T. Task clustering and gating for Bayesian multitask learning. J. Mach. Learn. Res. 4, 83–99 (2003).
- Hensman, J., Fusi, N. & Lawrence, N. D. Gaussian processes for big data. In Proc. Conference on Uncertainty in Artificial Intelligence 244 (UAI, 2013).
Cited by
Items 301–400 of 1,004
Estimating latent demand of shared mobility through censored Gaussian Processes
Gammelli, D., Peled, I., Rodrigues, F., Pacino, D., Kurtaran, H. A., & Pereira, F. C. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.102775 · Cited by 79
Artificial intelligence-assisted smartphone-based sensing for bioanalytical applications: A review
Yang, Y., Xu, F., Chen, J., Tao, C., Li, Y., Chen, Q., Tang, S. N., Lee, H. K., & Shen, W. (2023) · Biosensors and Bioelectronics · doi:10.1016/j.bios.2023.115233 · Cited by 78
Chen, Y., Li, F., Zhou, S., Zhang, X., Zhang, S., Zhang, Q., & Su, Y. (2023) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2023.131564 · Cited by 76
Xia, H., Tang, J., Aljerf, L., Cui, C., Gao, B., & Ukaogo, P. O. (2023) · Waste Management · doi:10.1016/j.wasman.2023.05.056 · Cited by 77
Artificial Intelligence: The Milestone in Modern Biomedical Research
Athanasopoulou, K., Daneva, G. N., Adamopoulos, P. G., & Scorilas, A. (2022) · BioMedInformatics · doi:10.3390/biomedinformatics2040049 · Cited by 92
Introduction to MAchine Learning & Knowledge Extraction (MAKE)
Holzinger, A. (2017) · Machine Learning and Knowledge Extraction · doi:10.3390/make1010001 · Cited by 65
“is the likelihood times the prior through the evidence and the inverse probability allows us to learn from data, to infer unknowns and to make predictions [29].”
BackgroundPrediction and Classification of Rheumatoid Arthritis using Ensemble Machine Learning Approaches
Sundaramurthy, S., Saravanabhavan, C., & Kshirsagar, P. R. (2020) · International Conference on Decision Aid Sciences and Applications (DASA) · doi:10.1109/dasa51403.2020.9317253 · Cited by 71
A Survey on Goal-Oriented Semantic Communication: Techniques, Challenges, and Future Directions
Getu, T. M., Kaddoum, G., & Bennis, M. (2024) · IEEE Access · doi:10.1109/access.2024.3381967 · Cited by 97
The inverse design of structural color using machine learning
Huang, Z., Liu, X., & Zang, J. (2019) · Nanoscale · doi:10.1039/c9nr06127d · Cited by 74
Data Privacy Protection for Edge Computing of Smart City in a DIKW Architecture
Duan, Y., Lu, Z., Zhou, Z., Sun, X., & Wu, J. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2019.03.002 · Cited by 70
A Survey of Uncertainty Quantification in Machine Learning for Space Weather Prediction
Siddique, T., Mahmud, M. S., Keesee, A. M., Ngwira, C. M., & Connor, H. K. (2022) · Geosciences · doi:10.3390/geosciences12010027 · Cited by 90
“The probability distributions capture the uncertainty in the data [13,59].”
BackgroundDubé, S., & Anctil, D. (2021) · International Journal of Social Robotics · doi:10.1007/s12369-020-00706-0 · Cited by 66
“Level 3 erobots are built on a variety of software architectures to improve their interactive and learning functions using methods like statistical pattern recognition and probabilistic ML [119, 173].”
MethodZhang, J., Zhao, X., Jin, S., & Greaves, D. M. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.119711 · Cited by 69
“In particular, this work explores, for the first time, the Bayesian machine learning (BML) approach [39,40] for phase-resolved wave prediction, which can take advantage of ML’s ability in tackling nonlinear problems while taking different kinds of uncertainties into account via the Bayesian…”
BackgroundMaking Sense of Meaning: A Survey on Metrics for Semantic and Goal-Oriented Communication
Getu, T. M., Kaddoum, G., & Bennis, M. (2023) · IEEE Access · doi:10.1109/access.2023.3269848 · Cited by 91
“At the crossroads of SemCom [51], [53], [54], [58]; ML [74]–[76]; quantum ML (QML) [148]–[150]; quantum computing [63], [80], [81]; quantum communication [82]–[84]; and quantum networking [62], [85], [86], the authors of [69] propose a SemCom system in the quantum domain dubbed quantum semantic communication (QSC) [69…”
BackgroundMethodNeuroadaptive Bayesian Optimization and Hypothesis Testing
Lorenz, R., Hampshire, A., & Leech, R. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.01.006 · Cited by 71
An Effective Hybrid Atrous Convolutional Network for Pixel-Level Crack Detection
Chen, H., & Lin, H. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3075022 · Cited by 88
“The small number of layers and parameters in HACNet allowed easy prevention of overfitting for relatively small training sets [53].”
BackgroundKim, S. W., Oh, K., & Lee, S. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.119011 · Cited by 71
Oyebisi, S. O., & Alomayri, T. S. (2023) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2023.132606 · Cited by 67
Kumar, R., Kumar, S., Rai, B., & Samui, P. (2024) · Structures · doi:10.1016/j.istruc.2024.106850 · Cited by 67
AIR5: Five Pillars of Artificial Intelligence Research
Ong, Y.-S., & Gupta, A. (2019) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2019.2928344 · Cited by 76
“In this regard, it is worth noting that although DNNs are (rightly) considered to be state-of-the-art among ML techniques, they do not (as of now) satisfactorily represent uncertainties [16].”
BackgroundMachine Learning for Integrated Quantum Photonics
Kudyshev, Z. A., Shalaev, V. M., & Boltasseva, A. E. (2020) · ACS Photonics · doi:10.1021/acsphotonics.0c00960 · Cited by 78
Cui, M. (2022) · Energy · doi:10.1016/j.energy.2022.124283 · Cited by 66
Deep learning approaches and interventions for futuristic engineering in agriculture
Chakraborty, S. K., Chandel, N. S., Jat, D., Tiwari, M. K., Rajwade, Y. A., & Subeesh, A. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07744-x · Cited by 73
Lin, Y., Zhang, Q., Gao, B., Tang, J., Yao, P., Li, C., Huang, S., Liu, Z., Zhou, Y., Liu, Y., et al. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00680-y · Cited by 74
“This feature arises from the inherent variations, partial observations or missing information in dynamic physical systems 3,4 .”
BackgroundZhao, J., Han, X., Wu, Y., Wang, Z., & Burke, A. F. (2024) · Journal of Energy Chemistry · doi:10.1016/j.jechem.2024.11.011 · Cited by 73
Projecting Australia's forest cover dynamics and exploring influential factors using deep learning
Ye, L., Gao, L., Marcos-Martínez, R., Mallants, D., & Bryan, B. A. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.07.013 · Cited by 69
Khan, O. Z., Badhiwala, J. H., Wilson, J. R. F., Jiang, F., Martin, A. R., & Fehlings, M. G. (2019) · Neurospine · doi:10.14245/ns.1938390.195 · Cited by 70
“11 Broadly, ML is divided into 3 categories: supervised ML, unsupervised ML, 12 and reinforcement learning.”
BackgroundChen, J., Luo, X., & Zhou, M. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2021.3090905 · Cited by 111
“D IMENSIONAL And Sparse (HiDS) matrices are accumulated with the rapid expansion of social network services (SNS) [1], [2], [3], recommender systems [4], [5], [6], [7], [8] and various big data-related applications [9], [10], [11], [12], [13].”
BackgroundBirur, P. N., Song, B., Sunny, S. P., Gurushanth, K., Mendonca, P., Mukhia, N., Li, S., Patrick, S., Shubha, G., Subhashini, A. R., et al. (2021) · Scientific Reports · doi:10.1038/s41598-022-18249-x · Cited by 65
“We trained the BDL with the dual-modal intraoral images using VGG19 (epochs = 300, learning rate = 0.0001, decay 5 times by every 20 epochs, batch size = 32).”
MethodInfluentialBayesian optimized multimodal deep hybrid learning approach for tomato leaf disease classification
Khan, B., Das, S., Fahim, N. S., Banerjee, S., Khan, S., Al‐Sadoon, M. K., Al-Otaibi, H. S., & Islam, A. R. M. T. (2024) · Scientific Reports · doi:10.1038/s41598-024-72237-x · Cited by 82
“Zoubin Ghahramani 82 noted that the current most effective global optimization methods uphold a Bayesian representation of the probability distribution over the uncertain function ‘f’ undergoing optimized and utilize this uncertainty to determine the next query location within the search space ‘X’.”
MethodMultiscale modeling and simulation of brain blood flow
Perdikaris, P. G., Grinberg, L., & Karniadakis, G. E. (2016) · Physics of Fluids · doi:10.1063/1.4941315 · Cited by 65
Machine Learning for Health Informatics
Holzinger, A. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-50478-0_1 · Cited by 81
Disruptive Technology and the Board: the Tip of the Iceberg
Evans, G. L. (2017) · Economics and Business Review/The Poznań University of Economics Review · doi:10.18559/ebr.2017.1.11 · Cited by 75
Wang, R., Chen, H., & Guan, C. (2021) · ISA Transactions · doi:10.1016/j.isatra.2021.02.024 · Cited by 67
Bayesian deep learning for reliable oral cancer image classification
Song, B., Sunny, S. P., Li, S., Gurushanth, K., Mendonca, P., Mukhia, N., Patrick, S., Gurudath, S., Raghavan, S., Imchen, T., et al. (2021) · Biomedical Optics Express · doi:10.1364/boe.432365 · Cited by 68
“Bayesian neural networks provide a prediction and an uncertainty value by imposing prior distributions on the model parameters (weights) to obtain a posterior distribution of these parameters [13].”
BackgroundA dye-assisted paper-based point-of-care assay for fast and reliable blood grouping
Zhang, H., Qiu, X., Zou, Y., Ye, Y., Qi, C., Zou, L., Xiang, Y., Yang, K., Zhu, Y., Yang, Y., et al. (2017) · Science Translational Medicine · doi:10.1126/scitranslmed.aaf9209 · Cited by 64
Ban, Z., Zhou, Q., Sun, A., Mu, L., & Hu, X. (2018) · Environmental Science & Technology · doi:10.1021/acs.est.8b02757 · Cited by 65
Niu, Z., Pinfield, V. J., Wu, B., Wang, H., Jiao, K., Leung, D. Y. C., & Xuan, J. (2021) · Energy & Environmental Science · doi:10.1039/d1ee00398d · Cited by 70
Williams, D. (2020) · Synthese · doi:10.1007/s11229-018-1768-x · Cited by 63
“2015) and machine learning (Ghahramani 2015) to abandon such models as the data structures implicated in probabilistic inference in favour of probabilistic programming languages—that is, programming languages familiar from computer science that capture the expressive power of higher-order logics but nevertheless facil…”
BackgroundForesti, L., Sideris, I. V., Nerini, D., Beusch, L., & Germann, U. (2019) · Weather and Forecasting · doi:10.1175/waf-d-18-0206.1 · Cited by 60
“There are several ways to estimate the PI depending on the chosen ML algorithm and adopted philosophy (i.e., Bayesian or frequentist) (see e.g., Heskes 1997; Meinshausen 2006; Khosravi et al. 2011; Ghahramani 2015).”
BackgroundMethodMachine Learning, Deep Learning, and Closed Loop Devices—Anesthesia Delivery
Wingert, T., Lee, C., & Cannesson, M. P. (2021) · Anesthesiology Clinics · doi:10.1016/j.anclin.2021.03.012 · Cited by 69
Luo, J., Shi, X., Chen, P., Han, K., Li, X., Cao, X., & Wang, Z. L. (2022) · Materials Today Physics · doi:10.1016/j.mtphys.2022.100798 · Cited by 72
Ko, H., Lu, Y., Yang, Z., Ndiaye, N. Y., & Witherell, P. (2023) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.09.010 · Cited by 72
Identifying At-Risk Students for Early Intervention – a Probabilistic Machine Learning Approach
Nimy, E., Mosia, M. S., & Chibaya, C. (2022) · Applied Sciences · doi:10.2139/ssrn.4253016 · Cited by 71
Zhou, C., Xie, Y., Wang, W., & Zheng, Y. (2023) · Engineering Structures · doi:10.1016/j.engstruct.2023.116539 · Cited by 66
Fernández, J., Chiachío, M., Chiachío, J., Muñoz, R., & Herrera, F. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104511 · Cited by 67
Bayesian Invariant Risk Minimization
Yong, L., Dong, H., Wang, H., & Zhang, T. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01555 · Cited by 106
“Bayesian inference is an essential method of statistical inference; it considers the uncertainty of model parameters [9, 21, 47, 48].”
MethodJaison, A., Mohan, A., & Lee, Y. (2024) · Materials Science and Engineering R Reports · doi:10.1016/j.mser.2024.100880 · Cited by 64
Rahmanpanah, H., Mouloodi, S., Burvill, C. R., Gohery, S., & Davies, H. M. S. (2020) · International Journal of Engineering Science · doi:10.1016/j.ijengsci.2020.103319 · Cited by 62
Toward the third generation of artificial intelligence
Zhu, J., Su, H., & Zhang, B. (2020) · Scientia Sinica Informationis · doi:10.1360/ssi-2020-0204 · Cited by 62
Modeling Data, Information and Knowledge for Security Protection of Hybrid IoT and Edge Resources
Duan, Y., Sun, X., Che, H., Cao, C., Li, Z., & Yang, X. (2019) · IEEE Access · doi:10.1109/access.2019.2931365 · Cited by 61
“rity of sensitive relationships in graph data [20].”
BackgroundInfluentialEtalumis: bringing probabilistic programming to scientific simulators at scale
Baydin, A. G., Shao, L., Bhimji, W., Heinrich, L., Meadows, L., Liu, J., Munk, A., Naderiparizi, S., Gram-Hansen, B., Louppe, G., et al. (2019) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3295500.3356180 · Cited by 74
“Probabilistic programming languages (PPLs) have semantics [67] that can be understood as Bayesian inference [13, 24, 26].”
BackgroundPerry, A., Wen, W. X., Kochan, N. A., Thalamuthu, A., Sachdev, P. S., & Breakspear, M. J. (2017) · Human Brain Mapping · doi:10.1002/hbm.23717 · Cited by 65
“In our opinion, parametric inference was appropriate to ensure stable and robust linear-model fits (Bzdok and Yeo, 2017; Ghahramani, 2015).”
MethodA machine learning based approach for phononic crystal property discovery
Sadat, S. M., & Wang, R. Y. (2020) · Journal of Applied Physics · doi:10.1063/5.0006153 · Cited by 60
Machine learning meets quantum foundations: A brief survey
Bharti, K., Haug, T., Vedral, V., & Kwek, L.-C. (2020) · AVS Quantum Science · doi:10.1116/5.0007529 · Cited by 59
Multi‐Fidelity High‐Throughput Optimization of Electrical Conductivity in P3HT‐CNT Composites
Bash, D., Cai, Y., Chellappan, V., Wong, S. L., Xu, Y., Kumar, P., Tan, J. D., Abutaha, A., Cheng, J. J. W., Lim, Y., et al. (2021) · Advanced Functional Materials · doi:10.1002/adfm.202102606 · Cited by 68
FPGA-Based Acceleration for Bayesian Convolutional Neural Networks
Fan, H., Ferianc, M., Que, Z., Liu, S., Niu, X., Rodrigues, M. R. D., & Luk, W. W. (2022) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2022.3160948 · Cited by 62
“…of input feature map W The width of input feature map K H The kernel height K W The kernel width K L The kernel length along temporal dimension C The number of channels F The number of filters L The length along temporal dimension PV The data parallelism level PC The channel parallelism level…”
BackgroundSultana, A., & Islam, R. (2023) · Journal of Electrical Systems and Information Technology · doi:10.1186/s43067-023-00101-5 · Cited by 69
Ding, J., Feng, D., Brunesi, E., Parisi, F., & Wu, G. (2023) · Engineering Structures · doi:10.1016/j.engstruct.2023.116739 · Cited by 61
A memristor-based Bayesian machine
Harabi, K.-E., Hirtzlin, T., Turck, C., Vianello, E., Laurent, R., Droulez, J., Bessière, P., Portal, J.-M., Bocquet, M., & Querlioz, D. (2022) · Nature Electronics · doi:10.1038/s41928-022-00886-9 · Cited by 58
Ground PM2.5 prediction using imputed MAIAC AOD with uncertainty quantification
Pu, Q., & Yoo, E. (2021) · Environmental Pollution · doi:10.1016/j.envpol.2021.116574 · Cited by 59
Nguyen, T., Ly, D.-K., Nguyen-Thoi, T., Nguyen, B.-P., & Doan, N. (2022) · SOILS AND FOUNDATIONS · doi:10.1016/j.sandf.2022.101203 · Cited by 58
Literature-based automated discovery of tumor suppressor p53 phosphorylation and inhibition by NEK2
Choi, B.-K., Dayaram, T., Parikh, N., Wilkins, A. D., Nagarajan, M., Novikov, I. B., Bachman, B. J., Jung, S. Y., Haas, P. J., Labrie, J. L., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806643115 · Cited by 58
“Algorithms are already highly effective for reasoning and generating solutions when this large-scale information is structured, that is, tabulated in accessible databases (1, 2).”
BackgroundNguyen, A. V. P., Blears, E. E., Ross, E., Lall, R. R., & Ortega-Barnett, J. R. (2018) · Neurosurgical FOCUS · doi:10.3171/2018.8.focus18325 · Cited by 59
Bio-inspired cryptosystem with DNA cryptography and neural networks
Basu, S., Karuppiah, M., Nasipuri, M., Halder, A. K., & Niranchana, R. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2019.02.005 · Cited by 58
Wang, Q., Wang, Z., Liu, P., Zhang, L., Sauer, D. U., & Li, W. (2023) · Cell Reports Physical Science · doi:10.1016/j.xcrp.2023.101720 · Cited by 77
Liu, Y., Yu, W., & Dillon, T. S. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01254-x · Cited by 62
Pang, G., Perdikaris, P. G., Cai, W., & Karniadakis, G. E. (2017) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.07.052 · Cited by 57
“We have extended the multi-fidelity Bayesian optimization method, one of the probabilistic machine learning algorithms [33], to identification of the fractional orders in advection–dispersion equations of complex form.”
MethodRobust Probabilistic Modeling with Bayesian Data ReweightingPreprint
Wang, Z., Kucukelbir, A., & Blei, D. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.03860 · Cited by 62
“Advances in automated inference (Hoffman and Gelman, 2014; Mansinghka et al., 2014; Kucukelbir et al., 2016) now enable easy development of new models for machine learning and artificial intelligence (Ghahramani, 2015).”
BackgroundMethodRajendran, S., Chamundeswari, S., & Sinha, A. A. (2022) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2022.100357 · Cited by 56
Sampaio, P., Almeida, A. S., & Brites, C. M. (2021) · Foods · doi:10.3390/foods10123016 · Cited by 56
Cooperative Control of Uncertain Multiagent Systems via Distributed Gaussian Processes
Lederer, A., Yang, Z., Jiao, J., & Hirche, S. (2022) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2022.3205424 · Cited by 56
“Probabilistic machine learning methods overcome these issues by representing epistemic uncertainty [8], thereby achieving high data efficiency and providing estimates for model errors.”
BackgroundRDeepSense: Reliable Deep Mobile Computing Models with Uncertainty Estimations
Yao, S., Zhao, Y., Shao, H., Zhang, A., Zhang, C., Li, S., & Abdelzaher, T. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3161181 · Cited by 52
“On the other hand, uncertainty estimation itself is crucial for scientic measurements [19, 33].”
BackgroundA Perspective on Deep Learning for Molecular Modeling and Simulations
Zhang, J., Lei, Y.-K., Zhang, Z., Chang, J., Li, M., Han, X., Yang, L., Yang, Y., & Gao, Y. Q. (2020) · The Journal of Physical Chemistry A · doi:10.1021/acs.jpca.0c04473 · Cited by 61
SPPL: probabilistic programming with fast exact symbolic inference
Saad, F. A., Rinard, M., & Mansinghka, V. K. (2021) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3453483.3454078 · Cited by 79
“There is growing recognition of the utility of PPLs for solving challenging tasks that involve probabilistic reasoning in various application domains [8, 27, 34, 35].”
BackgroundApproximate Bayesian neural networks in genomic prediction
Waldmann, P. (2018) · Genetics Selection Evolution · doi:10.1186/s12711-018-0439-1 · Cited by 52
From WOM to aWOM – the evolution of unpaid influence: a perspective article
Williams, N. L., Ferdinand, N., & Bustard, J. (2019) · Tourism Review · doi:10.1108/tr-05-2019-0171 · Cited by 62
Deep Learning Convolutional Networks for Multiphoton Microscopy Vasculature SegmentationPreprint
Teikari, P., Santos, M. E. C., Poon, C., & Hynynen, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.02382 · Cited by 60
“This in practice allows the estimation uncertainty based on Bayesian statistics [55].”
BackgroundMethodHuan, S. (2023) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.130034 · Cited by 54
Bayesian Neural Networks via MCMC: A Python-Based Tutorial
Chandra, R., & Simmons, J. A. (2024) · IEEE Access · doi:10.1109/access.2024.3401234 · Cited by 63
Liu, T., Zhang, H., Wu, J., Liu, W., & Fang, Y. (2024) · Journal of Environmental Management · doi:10.1016/j.jenvman.2024.121430 · Cited by 58
Testolin, A., & Zorzi, M. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00073 · Cited by 59
“An important challenge will be to more closely link generative networks with structured Bayesian models (Ghahramani, 2015), which can successfully simulate a wide variety of high-level cognitive functions ranging from one-shot learning (Lake et al., 2015) to inferring causal relations, categories…”
BackgroundSteinruecken, C., Smith, E., Janz, D., Lloyd, J., & Ghahramani, Z. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_9 · Cited by 46
Self-citationDemocratizing cognitive technology: a proactive approach
Ienca, M. (2018) · Ethics and Information Technology · doi:10.1007/s10676-018-9453-9 · Cited by 61
“An example of practical realization of algorithmic transparency is Automatic Statistician, an intelligent software capable of spotting trends and anomalies in data sets and presenting its conclusion, including a detailed explanation of its reasoning (Ghahramani 2015).”
MethodScalable Learning Paradigms for Data-Driven Wireless Communication
Xu, Y., Yin, F., Xu, W., Lee, C., Lin, J., & Cui, S. R. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000143 · Cited by 58
“Apart from the GP algorithm introduced above, the development of deep Bayesian neural networks has been rapid in recent years [10].”
BackgroundDu, S., Zhao, X., Xie, C., Zhu, J., Wang, J.-L., Yang, J., & Song, H. (2023) · Petroleum Science · doi:10.1016/j.petsci.2023.04.001 · Cited by 54
Functions and applications of artificial intelligence in droplet microfluidics
Liu, H., Nan, L., Chen, F., Zhao, Y., & Zhao, Y. (2023) · Lab on a Chip · doi:10.1039/d3lc00224a · Cited by 56
Modeling the rutting performance of asphalt pavements: a review
Deng, Y. J., & Shi, X. (2023) · Journal of Infrastructure Preservation and Resilience · doi:10.1186/s43065-023-00082-9 · Cited by 53
“Probabilistic models The models mentioned above can be categorized as deterministic models except that some ML models introduce the probabilistic framework to represent and manipulate uncertainty about models and predictions [41].”
BackgroundAutonomous optimization of an organic solar cell in a 4-dimensional parameter space
Osterrieder, T., Schmitt, F., Lüer, L., Wagner, J., Heumueller, T., Hauch, J., & Brabec, C. J. (2023) · Energy & Environmental Science · doi:10.1039/d3ee02027d · Cited by 55
“Most commonly, a Bayesian Optimizer is incorporated to sample the design space efficiently and is currently the leading method for the exploration of low dimensional parameter spaces [34]–[39].”
MethodOptimizing multicopy chromosomal integration for stable high-performing strains
Du, F., Li, Z., Li, X., Zhang, D., Zhang, F., Zhang, Z., Xu, Y., Tang, J., Li, Y., Huang, X., et al. (2024) · Nature Chemical Biology · doi:10.1038/s41589-024-01650-0 · Cited by 58
“It has been reported that GPR has notable advantages when dealing with small-scale datasets 21–23 , especially when using the dot product kernel and white noise kernel 24–27 .”
Parashar, P., Sharma, M. K., Nahak, B. K., Khan, A., Hsu, W.-Z., Tseng, Y., Chowdhury, J. R., Huang, Y., Liao, J., Kao, F., et al. (2025) · Journal of Materials Chemistry A · doi:10.1039/d4ta07496c · Cited by 56
Harmonizing models and observations: Data assimilation in Earth system science
Li, X., Liu, F., & Fang, M. (2020) · Science China Earth Sciences · doi:10.1007/s11430-019-9620-x · Cited by 54
“They both use the Bayesian estimation strategy (Tenenbaum, 1999; Ghahramani, 2015).”
MethodImproving Seasonal Forecast Using Probabilistic Deep Learning
Pan, B., Anderson, G. J., Goncalves, A., Lucas, D. D., Bonfils, C. J. W., & Lee, J. (2022) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2021ms002766 · Cited by 49
Zhang, R., Ji, C., Zhou, X., Liu, T., Jin, G., Pan, Z., & Liu, Y. (2024) · Energy · doi:10.1016/j.energy.2024.131154 · Cited by 52
Machine learning for modern power distribution systems: Progress and perspectives
Marković, M., Bossart, M., & Hodge, B. S. (2023) · Journal of Renewable and Sustainable Energy · doi:10.1063/5.0147592 · Cited by 60
Specialized convolutional transformer networks for estimating battery health via transfer learning
Zhao, J., & Wang, Z. (2024) · Energy storage materials · doi:10.1016/j.ensm.2024.103668 · Cited by 80
Huang, Y., Wu, Q., Gong, T., Yang, J., Luo, Q., & Liu, M. (2025) · Nature Communications · doi:10.1038/s41467-025-63302-8 · Cited by 59
Visual recency bias is explained by a mixture model of internal representations
Kalm, K., & Norris, D. G. (2018) · Journal of Vision · doi:10.1167/18.7.1 · Cited by 56
Zhang, X., Xue, T., & Stanley, E. (2018) · IEEE Access · doi:10.1109/access.2018.2884877 · Cited by 52
Novel Biomarkers of Atherosclerotic Vascular Disease—Latest Insights in the Research Field
Adam, C. A., Șalaru, D. L., Prisacariu, C., Marcu, D. T. M., Sascău, R. A., & Stătescu, C. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms23094998 · Cited by 56
Metadata
- Authors
- Ghahramani, Z.
- Venue
- Nature
- Published
- 2015-05-27
- Volume
- 521
- Issue
- 7553
- Pages
- 452-459
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1494192115
- Cited by
- 1,995
- References
- 108
- Citations by year
- 2026: 166 · 2025: 231 · 2024: 228 · 2023: 206 · 2022: 217 · 2021: 265 · 2020: 235 · 2019: 210 · 2018: 102 · 2017: 84 · 2016: 39 · 2015: 11
- FWCI
- 2.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- Apollo (University of Cambridge) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/I036575/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- stochastic modeling, machine learning, artificial intelligence, uncertainty representation, probabilistic programming, Bayesian optimization, data compression, experiential learning
- MeSH terms
- Artificial Intelligence, Automation, Bayes Theorem, Models, Statistical, Statistics, Nonparametric, Uncertainty, Data Compression
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.