Uncertainty-aware deep learning in healthcare: A scoping review
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Mistrust is a major barrier to implementing deep learning in healthcare settings. Entrustment could be earned by conveying model certainty, or the probability that a given model output is accurate, but the use of uncertainty estimation for deep learning entrustment is largely unexplored, and there is no consensus regarding optimal methods for quantifying uncertainty. Our purpose is to critically evaluate methods for quantifying uncertainty in deep learning for healthcare applications and propose a conceptual framework for specifying certainty of deep learning predictions. We searched Embase, MEDLINE, and PubMed databases for articles relevant to study objectives, complying with PRISMA guidelines, rated study quality using validated tools, and extracted data according to modified CHARMS criteria. Among 30 included studies, 24 described medical imaging applications. All imaging model architectures used convolutional neural networks or a variation thereof. The predominant method for quantifying uncertainty was Monte Carlo dropout, producing predictions from multiple networks for which different neurons have dropped out and measuring variance across the distribution of resulting predictions. Conformal prediction offered similar strong performance in estimating uncertainty, along with ease of interpretation and application not only to deep learning but also to other machine learning approaches. Among the six articles describing non-imaging applications, model architectures and uncertainty estimation methods were heterogeneous, but predictive performance was generally strong, and uncertainty estimation was effective in comparing modeling methods. Overall, the use of model learning curves to quantify epistemic uncertainty (attributable to model parameters) was sparse. Heterogeneity in reporting methods precluded the performance of a meta-analysis. Uncertainty estimation methods have the potential to identify rare but important misclassifications made by deep learning models and compare modeling methods, which could build patient and clinician trust in deep learning applications in healthcare. Efficient maturation of this field will require standardized guidelines for reporting performance and uncertainty metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To bridge this gap, explainable AI (XAI) has emerged, providing tools to make model predictions more interpretable and, ideally, more trustworthy to reduce perceived uncertainty [48].”
From Implementing Artificial Intelligence in Critical Care Medicine: a consensus of 22. (2025) · cites this paper as [48]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362 · cited 1×
“Computer vision models have matched or outperformed physicians for several common and essential clinical tasks, albeit in select circumstances [3,4].”
BackgroundExplanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
International evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287 · cited 1×
“Computer vision models have matched or outperformed physicians for several common and essential clinical tasks, albeit in select circumstances [3,4].”
BackgroundMoons, K. G. M., de Groot, J. A. H., Bouwmeester, W., Vergouwe, Y., Mallett, S., Altman, D. G., Reitsma, J. B., & Collins, G. S. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001744 · Cited by 2,018 · cited 1×
“Data extraction was performed according to a modification of CHARMS criteria, which included methods for measuring uncertainty in deep learning predictions [10].”
MethodAleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods
Hüllermeier, E., & Waegeman, W. (2021) · Machine Learning · doi:10.1007/s10994-021-05946-3 · Cited by 1,834 · cited 2×
“Epistemic uncertainty can be seen as a lack of information about the best model and can be reduced by adding more training data [13].”
BackgroundLiu, X., Cruz Rivera, S., Moher, D., Calvert, M. J., Denniston, A. K., The SPIRIT-AI and CONSORT-AI Working Group, SPIRIT-AI and CONSORT-AI Steering Group, Chan, A.-W., Darzi, A., Holmes, C., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1034-x · Cited by 1,421
Lederer, D. J., Bell, S. C., Branson, R. D., Chalmers, J. D., Marshall, R., Maslove, D. M., Ost, D. E., Punjabi, N. M., Schatz, M., Smyth, A. R., et al. (2019) · Annals of the American Thoracic Society · doi:10.1513/annalsats.201808-564ps · Cited by 715
Cruz Rivera, S., Liu, X., Chan, A.-W., Denniston, A. K., Calvert, M. J., Ashrafian, H., Beam, A. L., Collins, G. S., Darzi, A., Deeks, J. J., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30219-3 · Cited by 486
Nair, T., Precup, D., Arnold, D. L., & Arbel, T. (2020) · Medical Image Analysis · doi:10.1016/j.media.2019.101557 · Cited by 451
Research works printed but not linked: 7
- K Stubbs, 2007, Autonomy and common ground in human-robot interaction: A field study (vol 22, pg 42, 2007)., Ieee Intell Syst, 22, 3
- Tonekaboni S, Joshi S, McCradden MD, Goldenberg A. What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Use. In: Finale D-V, Jim F, Ken J, David K, Rajesh R, Byron W, et al., editors. Proceedings of the 4th Machine Learning for Healthcare Conference; Proceedings of Machine Learning Research: PMLR; 2019. p. 359–80.
- Gal Y, Ghahramani Z. Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. In: Maria Florina B, Kilian QW, editors. Proceedings of The 33rd International Conference on Machine Learning; Proceedings of Machine Learning Research: PMLR; 2016. p. 1050–9.
- M Valiuddin, 2021, Improving Aleatoric Uncertainty Quantification in Multi-annotated Medical Image Segmentation with Normalizing Flows. Uncertainty for Safe Utilization of Machine Learning in Medical Imaging, and Perinatal Imaging, Placental and Preterm Image Analysis, 75
- MS Graham, 2020, Hierarchical brain parcellation with uncertainty. Uncertainty for Safe Utilization of Machine Learning in Medical Imaging, and Graphs in Biomedical Image Analysis, 23
- SI Ktena, 2017, Distance metric learning using graph convolutional networks: Application to functional brain networks. International Conference on Medical Image Computing and Computer-Assisted Intervention
- A Sedghi, 2019, Probabilistic image registration via deep multi-class classification: characterizing uncertainty. Uncertainty for Safe Utilization of Machine Learning in Medical Imaging and Clinical Image-Based Procedures, 12
Cited by
A survey of uncertainty in deep neural networks
Gawlikowski, J., Tassi, C. R. N., Ali, M., Lee, J., Humt, M., Feng, J., Kruspe, A., Triebel, R., Jung, P., Roscher, R., et al. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10562-9 · Cited by 1,406
Lambert, B., Forbes, F., Doyle, S., Dehaene, H., & Dojat, M. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102830 · Cited by 269
Seoni, S., Jahmunah, V., Salvi, M., Barua, P. D., Molinari, F., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107441 · Cited by 239
A Survey on Uncertainty Quantification Methods for Deep Learning
He, W., Jiang, Z., Xiao, T., Xu, Z., & Li, Y. (2025) · ACM Computing Surveys · doi:10.1145/3786319 · Cited by 333
Artificial Intelligence–enabled Decision Support in Surgery: State-of-the-art and Future Directions
Loftus, T. J., Altieri, M. S., Balch, J. A., Abbott, K. L., Choi, J., Marwaha, J. S., Hashimoto, D. A., Brat, G. A., Raftopoulos, Y., Evans, H. L., et al. (2023) · Annals of Surgery · doi:10.1097/sla.0000000000005853 · Cited by 105
“52,53 There is no universally effective approach to determining adequate sample sizes for arti fi cial intelligence modeling.”
BackgroundSelf-citationCobianchi, L., Piccolo, D., Mas, F. D., Agnoletti, V., Ansaloni, L., Balch, J. A., Biffl, W. L., Butturini, G., Catena, F., Coccolini, F., et al. (2023) · World Journal of Emergency Surgery · doi:10.1186/s13017-022-00467-3 · Cited by 88
“Even when AI accurately predicts clinical outcomes hours or days in advance, its application in trauma and emergency surgery will remain marginal until the deployment proves trust in the accuracy and the lack of bias of the model, addresses target risk-sensitive decisions, and integrates with clinical workflows [11, 1…”
BackgroundSelf-citationImplementing Artificial Intelligence in Critical Care Medicine: a consensus of 22.
Cecconi, M., Greco, M., Shickel, B., Angus, D. C., Bailey, H., Bignami, E., Calandra, T., Celi, L. A., Einav, S., Elbers, P., et al. (2025) · Critical Care · doi:10.1186/s13054-025-05532-2 · Cited by 80
“Yet, we argue that interpretability alone is not enough [48].”
Self-citationSubramanian, H. V., Canfield, C., & Shank, D. B. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102780 · Cited by 84
Uncertainty quantification in DenseNet model using myocardial infarction ECG signals
Jahmunah, V., Ng, E. Y. K., Tan, R. S., Oh, S. L., & Acharya, U. R. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.107308 · Cited by 64
Ghadimi, D. J., Vahdani, A. M., Karimi, H., Ebrahimi, P., Fathi, M., Moodi, F., Habibzadeh, A., Shoushtari, F. K., Valizadeh, G., Salari, H. M., et al. (2024) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.29543 · Cited by 63
“42 Studies by Wang et al further analyzed uncertainty in brain tumor segmentation, proposing methods for quantifying both epistemic (model-based, resulting from model bias or insuf fi cient data) and aleatoric (data-based, resulting from inherent randomness) uncertainty.”
Reliability and Interpretability in Science and Deep Learning
Scorzato, L. (2024) · Minds and Machines · doi:10.1007/s11023-024-09682-0 · Cited by 59
“The computational cost of the Bayesian approach applied to DNNs has been widely acknowledged (Gawlikowski et al., 2021; Abdar et al., 2021; Loftus et al., 2022), but it is important to emphasise that this makes it also difficult to define the Bayesian errors in the first place.”
Artificial intelligence uncertainty quantification in radiotherapy applications − A scoping review
Wahid, K. A., Kaffey, Z. Y., Farris, D. P., Humbert‐Vidan, L., Moreno, A. C., Rasmussen, M. E., Ren, J., Naser, M. A., Netherton, T., Korreman, S., et al. (2024) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2024.110542 · Cited by 45
Huang, A. A., & Huang, S. Y. (2023) · Health Science Reports · doi:10.1002/hsr2.1214 · Cited by 36
“These algorithms are unique in that they can predict data without explicit instructions from the modeler.(1,5,8,9) XGBoost and Random Forest, two well‐known machine learning algorithms, have been shown to be significantly more accurate than linear and logistic regression.”
BackgroundKanwal, N., López-Pérez, M., Kiraz, U., Zuiverloon, T. C. M., Molina, R., & Engan, K. (2023) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2023.102321 · Cited by 38
Navigating Uncertainty: A User-Perspective Survey of Trustworthiness of AI in Healthcare
Ojha, J., Presacan, O., Lind, P. G., Monteiro, E., & Yazidi, A. (2025) · ACM Transactions on Computing for Healthcare · doi:10.1145/3716317 · Cited by 41
Uncertainty Quantification for Machine Learning in Healthcare: A SurveyPreprint
López, L. J. L., Elsharief, S., Jorf, D. A., Darwish, F., Ma, C., & Shamout, F. E. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.02874 · Cited by 52
Community-engaged artificial intelligence research: A scoping review
Loftus, T. J., Balch, J. A., Abbott, K. L., Hu, D., Ruppert, M. M., Shickel, B., Ozrazgat‐Baslanti, T., Efron, P. A., Tighe, P. J., Hogan, W. R., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000561 · Cited by 27
“For model development, to obtain adequately sized training datasets that include community subjects, it seems advantageous to use large, existing datasets or harmonized electronic health record-derived data from multiple institutions [37,38,40–42].”
MethodSelf-citationStark, T., Wurm, M., Zhu, X. X., & Taubenböck, H. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3359636 · Cited by 27
“This technique has been applied successfully in various domains, such as computer vision [61], [62], natural language processing [63], and healthcare [64].”
MethodLi, S., Yuan, M., Dai, X., & Zhang, C. (2025) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2025.102574 · Cited by 20
Vicario, C. M., Rodríguez-Salas, D., Maier, A., Hock, S. W., Kuramatsu, J. B., Kallmuenzer, B., Thamm, F., Taubmann, O., Ditt, H., Schwab, S., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-55761-8 · Cited by 20
Ji, C., & Tang, H. (2025) · Earth-Science Reviews · doi:10.1016/j.earscirev.2025.105070 · Cited by 16
Impact of spectrum bias on deep learning–based stroke MRI analysis
Krag, C. H., Müller, F. C., Gandrup, K. L., Plesner, L. L., Sagar, M. V., Andersen, M. B., Nielsen, M., Kruuse, C. R., & Boesen, M. (2025) · European Journal of Radiology · doi:10.1016/j.ejrad.2025.112161 · Cited by 13
Sherkatghanad, Z., Abdar, M., Bakhtyari, M., Pławiak, P., & Makarenkov, V. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114123 · Cited by 19
Blattmann, M., Lindenmeyer, A., Franke, S., Neumuth, T., & Schneider, D. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000801 · Cited by 16
“Despite its potential to enhance the trustworthiness of AI-based clinical prognosis and decision support, epistemic uncertainty estimation for deep learning remains largely underexplored in medical research, with no consensus on the most suitable methods for its quantification [24].”
Machine Learning in Cardiovascular Imaging: A Scoping Review of Published Literature
Rouzrokh, P., Khosravi, B., Vahdati, S., Moassefi, M., Faghani, S., Mahmoudi, E., Chalian, H., & Erickson, B. J. (2022) · Current Radiology Reports · doi:10.1007/s40134-022-00407-8 · Cited by 15
“Although several techniques exist for uncertainty quan-tification of DL models, they have not been thoroughly studied for medical purposes and therefore, it is not surprising that only a small number of studies in our pool have employed such techniques (52).”
MethodTranscription Accuracy of Automatic Speech Recognition for Orthodontic Clinical Records
O’Kane, R., Stonehouse‐Smith, D., Ota, L. C. U., Patel, R., Johnson, N., Slipper, C., Seehra, J., Papageorgiou, S. N., & Cobourne, M. T. (2025) · Journal of Dental Research · doi:10.1177/00220345251382452 · Cited by 11
“Future products should feature uncertainty-aware visualizations to highlight terms with low-calibrated confidence scores for manual verification, particularly those deemed clinically significant (Loftus et al. 2022).”
Zhang, W., Di, X., Wei, G., Geng, S., Fu, Z., & Hong, S. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-09267-5 · Cited by 11
Rogowski, V., Svalkvist, A., Maspero, M., Janssen, T. M., Maruccio, F. C., Gorgisyan, J., Scherman, J. B., Häggström, I., Skärström, V. W., Gunnlaugsson, A., et al. (2025) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.70221 · Cited by 10
“This lack of transparency raises trust and reliability issues in critical healthcare settings 11 and stresses the need to quantify and convey model uncertainty.”
Machine Learning-Based Modelling in Atomic Layer Deposition Processes
Adeleke, O., Karimzadeh, S., & Jen, T. (2023) · CRC Press eBooks · doi:10.1201/9781003346234 · Cited by 11
AI and IoT Uses, Challenges and Opportunities for e-Health: a review
Ziadi, F., Fourati, H., & Saïdane, L. A. (2024) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc61514.2024.10592569 · Cited by 8
“On this basis, a critical study conducted in [16] assessed the degree of confidence in predictions generated by deep learning models in healthcare.”
BackgroundUncertainty in Physics and AI: Taxonomy, Quantification, and ValidationPreprint
Haußmann, M., Winterhalder, R., & Ubiali, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.10378 · Cited by 10
Jena, T., Suryodai, R., Reddy, D. N., Kumar, K. V., Muniyandy, E., & Kumar, N. V. P. S. (2025) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2025.100302 · Cited by 22
Berumen, F., Ouellet, S., Enger, S. A., & Beaulieu, L. (2024) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ad3418 · Cited by 6
Kobayashi, K., Takamizawa, Y., Miyake, M., Ito, S., Gu, L., Nakatsuka, T., Akagi, Y., Harada, T., Kanemitsu, Y., & Hamamoto, R. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102929 · Cited by 8
Quantitative evaluation model of variable diagnosis for chest X-ray images using deep learning
Nakagawa, S., Ono, N., Hakamata, Y., Ishii, T., Saito, A., Yanagimoto, S., & Kanaya, S. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000460 · Cited by 6
“There have been proposed various approaches to quantify model uncertainty using deep learning [10–12].”
MethodMai, A., Luan, Y., Loy, S. L., Qin, C., Ji, H., Obeng, A., Oladuti, M., Ejima, K., Mok, K. T., Kaur, S., et al. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1805704 · Cited by 4
“By incorporating probabilistic reasoning, methods such as Bayesian neural networks (250) and Monte Carlo dropout can estimate prediction confidence and distinguish between model-based and data-based uncertainty (251).”
Generalisation and reliability of deep learning for digital pathology in a clinical setting
Pocevičiūtė, M. (2023) · Linköping studies in science and technology. Dissertations · doi:10.3384/9789180753005 · Cited by 6
“This is particularly crucial in applications where erroneous predictions can have significant consequences, such as in medical diagnosis [80] or autonomous driving [35].”
BackgroundObesity prediction: Novel machine learning insights into waist circumference accuracy
Harris, C., Olshvang, D., Chellappa, R., & Santhanam, P. (2024) · Diabetes & Metabolic Syndrome Clinical Research & Reviews · doi:10.1016/j.dsx.2024.103113 · Cited by 4
Thomas, N. R., Anitha, J., Popîrlan, C., Popirlan, C.-I., & Hemanth, D. J. (2025) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.070689 · Cited by 5
Goodmaker, C., Bhandari, R., Tappuni, A. R., & Pham, T. D. (2026) · Digital Health · doi:10.1177/20552076261481593 · Cited by 3
TCPNet: A Novel Tumor Contour Prediction Network Using MRIs
Agarwal, S., Kurmi, V. K., Banerjee, A., & Basu, T. (2024) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi61247.2024.00031 · Cited by 3
“Estimating uncertainty is particularly important in neural networks, as they often exhibit a tendency to make overly confident predictions [19].”
BackgroundMachine learning-based remote PPG signal quality assessment for in-vehicle driver monitoring
Babac, S., Vosters, L., Vullings, R., Zinger, S., & van Gastel, M. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.109869 · Cited by 2
Automated C-Arm Positioning via Conformal Landmark Localization
Arrabi, A., Jung, J., Luo, J., Franssen, N., Raymond, S. B., & Wshah, S. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00461 · Cited by 2
“This has motivated the integration of uncertainty estimation into deep learning models across various imaging modalities, such as magnetic resonance imaging (MRI), computed tomography (CT), and X-ray [9, 22, 37].”
Nogair, N. A., Algarni, A. D., Kammoun, B., Souissi, G., Ghorbel, I., Jardak, I., & Hmida, A. A. B. (2026) · IEEE Access · doi:10.1109/access.2026.3692612 · Cited by 2
Sharma, A. K., Pesarlanka, D. B., & Sharma, S. (2024) · Advances in healthcare information systems and administration book series · doi:10.4018/979-8-3693-7277-7.ch012 · Cited by 2
Mamiya, H., & Fuller, D. (2025) · Physical Activity and Nutrition · doi:10.20463/pan.2025.0020 · Cited by 2
“The importance of capturing prediction uncertainty has gained research focus in clinical (diagnostic and prognostic) prediction in the last few years (e.g., conformal prediction methods) but not in population health research 9 .”
Computer-Aided Lung Auscultation Screening and Radiographic Evaluation of Pediatric Pneumonia
Kala, A., Chong, D. Y., Baqui, A. H., Ahmed, S., Islam, M. A., Chowdhury, N. H., Roy, A. D., McCollum, E. D., & Elhilali, M. (2024) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc53108.2024.10781834 · Cited by 2
“As discussed in other studies [29], there is a need for robust computer-aided models in diagnostics, but importantly a more graded outlook in model output interpretation.”
Hiswati, M. E., & Diqi, M. (2025) · Jurnal Teknik Informatika (Jutif) · doi:10.52436/1.jutif.2025.6.5.5294 · Cited by 1
Liu, Z., Qian, S., Bao, X., Li, S., Chen, W., & Liu, Z. (2026) · American Journal Of Pathology · doi:10.1016/j.ajpath.2026.04.004 · Cited by 1
A Systematic Review for Deep Learning-Based System for the Diagnosis of Uterine Fibroids and Cancer
Salah, M. Y., Ali, M. H., & Abdullah, A. S. (2026) · International Symposium on AI-Driven Engineering Systems (ISADES) · doi:10.1109/isades69945.2026.11608222 · Cited by 1
Uncertainty Quantification in Advanced Machine Learning Approaches
Ahamad, S., Rather, I. H., & Gupta, R. (2023) · Advances in social networking and online communities book series · doi:10.4018/978-1-6684-6909-5.ch011 · Cited by 1
Najera-Flores, D., Jacobs, J. M., Quinn, D. D., Garland, A., & Todd, M. D. (2024) · ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems Part B Mechanical Engineering · doi:10.1115/1.4066054 · Cited by 3
Jahmunah, V. (2022) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/170476
Uncertainty Quantification in Deep Learning Framework for Mallampati Classification
Mahato, A., Sarangi, P., Kurmi, V. K., Banerjee, A., Goyal, A., & Basu, T. (2024) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi61247.2024.00100
“These features are significant for different types of computer vision tasks, and the initial 5 layers of ConvNeXt can properly identify them as reported in different applications [18].”
BackgroundHesitation is defeat? Connecting Linguistic and Predictive UncertaintyPreprint
Manzo, G., & Ive, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.03910
Μοντελοποίηση παιδικής παχυσαρκίας με χρήση ερμηνεύσιμης τεχνητής νοημοσύνης
Vogkas, D. (2024) · DSpace - NTUA (National Technical University of Athens) · doi:10.26240/heal.ntua.26206
Assessing the Quality of Counterfactual Explanations with Large Language Models
Välja, J. (2024) · DSpace repository (University of Tartu)
Ren, X., Song, J., Liu, C., Li, J., Ma, L., & Xue, Y. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3787101
Mas, F. D., Fijałkowska, J., Rdzanek, J., & Cobianchi, L. (2026) · Hot topics in acute care surgery and trauma · doi:10.1007/978-3-032-09357-8_4
Uncertainty-Aware Training for Ophthalmic Segmentation Using MedSAM
Clark, C. W., Kinder, S., Nebbia, G., Veturi, Y. A., McNamara, S., Manoharan, N., de Carlo, T. E., Kahook, M. Y., Mandava, N., Singh, P., et al. (2026) · Translational Vision Science & Technology · doi:10.1167/tvst.15.2.19
Manage, P. D., Wu, Y., Zhang, J., & Li, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7081-2_37 · Cited by 1
Shank, D. B., Canfield, C., & Subramanian, H. V. (2024) · OSF Preprints (OSF Preprints)
Tendencias y patrones de los modelos de inteligencia artificial en salud
Zepeda-Lugo, C., & Castro, J. R. R. (2026) · Ciencia Latina Revista Científica Multidisciplinar · doi:10.37811/cl_rcm.v10i1.22887
Federated Learning Approach in Medicine: Enhancing Privacy and Model Quality: A Narrative Review
Çolak, C., & Tetik, B. K. (2025) · Konuralp Tıp Dergisi · doi:10.18521/ktd.1664270
Joseph, J., & Kartheeban, K. (2026) · Informatica · doi:10.31449/inf.v50i1.13040 · Cited by 1
“A detailed examination reveals several key insights: • High-confidence predictions (such as: samples 3, 8, 16, 25) are indicated by very small error bars and they are clearly near to 0 (low risk) or 1 (high risk).”
Li, Y., Bartell, J. A., & Krogh, A. (2026) · Research Square · doi:10.21203/rs.3.rs-9379765/v1
Implementing responsible artificial intelligence-driven precision medicine in critical care
Ennouri, E., Boussarsar, M., Saida, I. B., Meddeb, K., & Toumi, R. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-36554-6.00021-0
Explainable techniques for trustworthy artificial intelligence
Sarica, A., & Gramigna, V. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-13545-3.00012-8
Uncertainty-Guided Curriculum Learning for Automated Liver Fibrosis Staging on Heterogeneous MRI
Jin, Y., Zhao, F., Chen, Y., & He, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-16271-7_2
Newton, J. C., Ekundayo, J. M., Tippaya, N., Smith, S. J., Tadesse, D. B., Çakan, H., & Moorin, R. E. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03617-8
“…strengths of such models that can be appreciated in the development of models with clinical applications are the availability of confidence estimates or uncertainty quantification alongside model predictions, to facilitate downstream quality control by flagging low-confidence cases for review [36].”
Peña, A. D., Clariza, J., & Aballiar-Vista, M. A. (2026) · Transactions of the Institute of Aviation · doi:10.2478/tar-2026-0009
“Empirical studies demonstrate that uncertainty estimates help identify rare but clinically or operationally important misclassifications and that selective classification can improve reliability by trading coverage for correctness when appropriate [32].”
A Review on Deep State Space Models for Sequential Healthcare Data Prediction
Li, W., Xie, Y., & Dai, Y. (2026) · Mathematics · doi:10.3390/math14122210
“However, they rely on self-attention computations between the current token and all previous tokens, which leads to quadratic computational complexity and strictly limits their scalability for long-sequence, high-frequency medical data [35].”
A spatiotemporal state-inference framework for adaptive immunotherapy in glioblastoma
Chen, X., Li, S., Liu, X., & Ma, W. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1875352
“Trust must be built into model development, validation, and use (74, 78, 79).”
InfluentialYin, X.-L., Wang, B.-Y., & Song, G.-L. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114446
Sadib, M. S. H., Mukit, M. M., Sarker, R. K. R., Tamim, T. A., Hasan, M. N., & Shimul, M. M. H. (2026) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2026.100517
Pengembangan Sistem Informasi Deteksi Dini Penyakit Ginjal Kronis Berbasis Web dengan TabNet
Pratama, J. H., & Hoendarto, G. (2026) · Progresif Jurnal Ilmiah Komputer · doi:10.35889/progresif.v22i2.3669
“Hal ini sejalan dengan literatur medical AI yang menekankan pentingnya ketidakpastian prediksi dalam meningkatkan keandalan penggunaan model kecerdasan buatan di bidang kesehatan [11], [12].”
Khan, A., Bhat, S. A., Wolff, A., & Islam, A. K. M. N. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.115824
Islam, A., Jalde, F., & Fransén, E. A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-35387-0_43
Alanazi, M. F., Shakhreet, B. Z., A.Asiri, H. A., Bajahzar, A. S., Ahmad, R., Ahmed, A. M., & Alturkistani, H. (2026) · Scientific Reports · doi:10.1038/s41598-026-66377-5
Risk-Calibrated Polypharmacy Graph Learning for Uncertainty-Aware Drug Combination Optimization
Biró, A., Kolumbán, G., & Iantovics, L. B. (2026) · IEEE International Conference on Intelligent Engineering Systems (INES) · doi:10.1109/ines69513.2026.11661206
“Recent advances also explore [18], highlighting the importance of reliable confidence estimates in safety-critical applications.”
Oluwagbemi, J. B., Oyetayo, O. V., & Fadugba, A. (2026) · Trends in Biological Sciences · doi:10.21124/tbs.2026.430.441
Integrating ex vivo platforms with AI to guide glioblastoma treatment
Bardhan, M., Paul, S., Pun, S., Aryal, M. R., Claudio, P. P., Binder, J., Barrile, R., & Krummel, D. P. (2026) · Journal of Neuro-Oncology · doi:10.1007/s11060-026-05708-y
Huy, N. T., Minh, P. Q., & Bich, L. T. (2022) · Journal of Artificial Intelligence for Healthcare Systems · doi:10.68159/f249917157
UbiQVision: Spatial Dempster–Shafer fusion of XAI attributions for reliable deep vision ensembles
Dubey, A., Anžel, A., İlgen, B., & Hattab, G. (2026) · Machine Learning with Applications · doi:10.1016/j.mlwa.2026.101000
Divya Priya, R., & Bagyamani, J. (2026) · INTERNATIONAL JOURNAL OF CREATIVE RESEARCH THOUGHTS · doi:10.56975/ijcrt.v14i9.313321
Artificial intelligence in cardiovascular medicine: a practical guide for clinicians and researchers
Basile, C., Villaschi, A., Ambrosino, P., Canonico, M. E., Rawshani, A., & Bobbio, E. (2026) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztag153
“62 From a practical standpoint, when an AI system’s prediction or its accompanying explainability heatmap directly contradicts a clinician’s well-founded judgment, the clinician should not re-flexively defer to the algorithm.”
AMHAT: Multimodal Pipeline for Privacy-Preserving Stress Screening
Mehdi, G., Liu, C., & Nye, E. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-28463-1_10
Manage, P. D., Wu, Y., Zhang, J., & Li, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-10970629/v1
Bakir, M., Masri, M. K. A., Mushtaha, Y., Shaikh, N., Raddaoui, M., & Mohammad, K. S. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1960963
“This approach helps prevent dangerous forced-choice errors, reduces clinician alert fatigue, and preserves trust in the AI system (140).”
Predictive Uncertainty for Medical Image Synthesis with Continuous-Time Generative Models
Feola, F. D., & Soda, P. (2026) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms69103.2026.00219
“Such approaches have proven effective in several medical imaging tasks, including segmentation, registration, and image reconstruction [13].”
Semi-Supervised and Uncertainity-Aware Deep Learning for Multimodal Artery-Vein Segmentation
Kumar, K., Prakash, A., Ahmad, S., & Ali, S. A. (2026) · International Conference on Computational Intelligence Systems and Devices (ICCISD) · doi:10.1109/iccisd69924.2026.11731883
Luo, Y., Wang, M., Lin, T., Lin, A., Chen, Y., He, G., Lin, Z., Chen, L. J., Yam, J. C. S., Cheng, C., et al. (2026) · Cell Reports Medicine · doi:10.1016/j.xcrm.2026.103124
Choi, J. (2026) · International Communications in Heat and Mass Transfer · doi:10.1016/j.icheatmasstransfer.2026.112891
Halab, K., & Akhloufi, M. A. (2026) · Applied Biosciences · doi:10.3390/applbiosci5040108
Lin, A. S., Biju, A., Goode, A. R., Im, J. Y., Noël, P. B., Bazalova‐Carter, M., Reynolds, T., & Hindley, N. (2026) · medRxiv · doi:10.64898/2026.10.28.26366767
Manisekaran, N. K., Tiwari, P., & Rathinasabapathi, P. (2026) · Biomedical Microdevices · doi:10.1007/s10544-026-00853-7
Razali, R. A., Rahim, F. A., Khairuddin, A. M., Othman, N. I., Masri, R. Y., & Shaari, N. A. M. (2026) · doi:10.1109/icssa70263.2026.11765905
Metadata
- Authors
- Loftus, T. J., Shickel, B., Ruppert, M. M., Balch, J. A., Ozrazgat-Baslanti, T., Tighe, P. J., Efron, P. A., Hogan, W. R., Rashidi, P., Upchurch, G. R., & Bihorac, A.
- Affiliations
- University of Florida Health (US)
- University of Florida (US)
- Corresponding author
- Loftus, Tyler J.
- ORCID
- Venue
- PLOS Digital Health
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-08-10
- Volume
- 1
- Issue
- 8
- Pages
- e0000085
- ISSN
- 2767-3170 (ISSN-L)
- PMC
- PMC9802673
- OpenAlex
- W4293152273
- Cited by
- 73
- References
- 35
- Citations by year
- 2026: 27 · 2025: 14 · 2024: 19 · 2023: 9 · 2022: 4
- FWCI
- 3.46
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLOS Digital Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute of General Medical Sciences of the National Institutes of Health (K23 GM140268)
- National Institute of Diabetes and Digestive and Kidney Diseases (K01 DK120784)
- National Institute of General Medical Sciences (R01GM110240, R01GM114290, R01GM-110240, R01 GM110240)
- University of Florida Research, and Gator Trust (AWD09459)
- National Institute on Aging (R01AG121647, P30AG028740, R01AG05533)
- National Science CAREER Award (1750192)
- National Institute of Biomedical Imaging and Bioengineering (1R21EB027344)
- W. Martin Smith Interdisciplinary Patient Quality and Safety Award (IPQSA),
- Sepsis and Critical Illness Research Center Award
- University of Florida Research (AWD09458)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- uncertainty estimation, deep learning in healthcare, entrustment, Monte Carlo dropout, conformal prediction, epistemic uncertainty, diagnostic imaging, convolutional neural networks, trust in AI, reporting guidelines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

