The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index; none of the 20 sources its claims cite is checked for support yet.
The need for uncertainty quantification in machine-assisted medical decision making
Open accessOverview
AI snapshot
Written from the paper’s full text.
TL;DR
This perspective argues that machine-assisted medical decision making, especially deep learning, requires a principled and formal discipline of uncertainty quantification (UQ) comparable to that used in nuclear stockpile stewardship and risk management. It maps where uncertainty enters the DL pipeline, identifies four overlapping challenge areas, and sketches research directions for building UQ for DL.
Key findings
- The paper contends that predictions without UQ "are neither predictions nor actionable," and that automated clinical systems not analyzable via known causal connections will require formal UQ to be adopted, as happened in nuclear security.
- It identifies four overlapping challenge groups for UQ of data-driven approaches: (1) absence of theory (no "hard laws" in medicine), (2) absence of causal models (DL exploits correlations without causal links), (3) sensitivity to imperfect data (missing elements and errors with patterned confounds), and (4) computational expense of recomputation for uncertainty bounds.
- It proposes that uncertainty must be quantified across at least four pipeline steps: collection/selection of training data and its coverage of the medical phenomenon, accuracy and completeness of labelling, selection and understanding of the DL model and its performance bounds, and model performance against operational (clinical inference) data.
- It highlights three research directions: quantifying and limiting overfitting (noting classical information criteria fail given DL's parameter counts and capacity to memorize random noise), understanding DL internals, and training DL to provide its own uncertainty estimates—suggesting GANs for detecting out-of-sample cases as "particularly fruitful."
- Cited (not original) performance claims: DL transfer-learning applications reported performance comparable to human experts or better, and DL function estimators reported performance better than state-of-the-art classical predictive models.
Methods
- Design: a conceptual/perspective article (no empirical study, dataset, or experiment conducted by the authors).
- Content: narrative discussion of the role of DL in clinical decision making, the proposed place of UQ, anticipated challenges, and foreseen research directions, illustrated by a figure of uncertainty sources in the DL pipeline.
- Analysis: argumentative synthesis drawing analogies to UQ practice in nuclear security and risk management; no statistical analysis is performed.
Limitations
- Stated by the paper: the domains where DL is applied lack underlying mechanistic theory to ground uncertainties; DL lacks causal models, limiting conclusions; real-world data is imperfect with patterned errors that can confound prediction; and recomputation for uncertainty bounds may currently be prohibitively expensive.
- Evident in the text: the article is a position/perspective piece with no empirical validation, no concrete UQ framework or method proposed, and no quantitative results of its own; the authors explicitly note that "it is possible that the entire new field of UQ for DL might need to be developed" and that a review of ongoing research is beyond its scope.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
29 Own interpretation · 17 No basis given · 10 Not checked yet
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we are ultimately operating without the fundamental, underlying mathematical model which we could otherwise use to ground our uncertainties and to bound any assumptions we make.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 4 Anticipated Challenges
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Advancements in UQ now provide measures of confidence necessary to inform national or international security decisions.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > Abstract
What the sources say
- Not checked yetcites [1] Oberkampf, W. L. & Roy, C. J. Verfication and Validation in Scientific Computing (Cambridge Univ. Press, Cambridge, 2010). source
- Not checked yetcites [2] National Research Council Evaluation of Quantification of Margins and Uncertainties: Methodology for Assessing and Certifying the Reliability of the Nuclear Stockpile (National Academies Press, Washington DC, 2009).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The absence of a causal connection, however, means garnering limited conclusions from DL models”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2. Absence of causal models:
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“most partial theories in medicine still explain an extremely small fraction of the observed phenomena and variations 3,4 .”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2 Machine-assisted Clinical Decision Making and Research
What the sources say
- Not checked yetcites [3] Zuk, O., Hechter, E., Sunyaev, S. R. & Lander, E. S. The mystery of missing heritability: Genetic interactions create phantom heritability. Proc. Natl Acad. Sci. USA 109, 1193–1198 (2012). source
- Not checked yetcites [4] Choi, J. D. & Lee, J.-S. Interplay between epigenetics and genetics in cancer. Genomics Inform. 11, 164–173 (2013). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“The applications of DL techniques based on transfer learning have reported performance comparable to that of the human experts 5 , , 6 or better 7 ., 8”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2.1 The Current Roles and Applications of AI
What the sources say
- Not checked yetcites [5] Kermany, D. S. et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172, 1122–1131 (2018). source
- Not checked yetcites [6] Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115–118 (2017). source
- Not checked yetcites [7] Mar, V. & Soyer, H. Artificial intelligence for melanoma diagnosis: How can we deliver on the promise? Ann. Oncol. 29, 1625–1628 (2018). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“uncertainty in generalization depends on the density of training points in an appropriately defined neighborhood of the prediction target.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 5.3 Training DL to provide its own uncertainty estimates
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“A particularly fruitful approach seems to be the use of Generative Adversarial Networks (GANs) for detecting out-of-sample cases.[24][25][26]”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 5.3 Training DL to provide its own uncertainty estimates
What the sources say
- Not checked yetcites [24] Brahma, P. P., Huang, Q. & Wu, D. O. Structured memory based deep model to detect as well as characterize novel inputs. Preprint at http://arxiv.org/abs/1801.09859 (2018).
- Not checked yetcites [25] Yu, Y., Qu, W., Li, N. & Guo, Z. Open-category classification by adversarial sample generation. Preprint at http://arxiv.org/abs/1705.08722 (2017). source
- Not checked yetcites [26] Ge, Z., Demyanov, S., Chen, Z. & Garnavi, R. Generative openmax for multi-class open set classification. Preprint at http://arxiv.org/abs/1707.07418 (2017). source
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“the capacity of DL networks to memorize random noise 18”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 5.1 Quantifying and limiting overfitting
What the sources say
- Not checked yetcites [18] Zhang, C., Bengio, S., Hardt, M., Recht, B. & Vinyals, O. Understanding deep learning requires rethinking generalization. Preprint at http://arxiv.org/abs/1611.03530 (2016).
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 44
- It may state two separate claims as one. 16
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“computing capacity in support of DL is growing exponentially”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 4. Computational Expense:
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“UQ today underpins many decision processes in nuclear security, our risk management and associated investments, which can be at the scale of billions of dollars.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we propose that all of these steps (illustrated in figure 1) would need to be quantified in order to arrive at even crude, overall measures of the uncertainty of the DL-based decision model.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 3 The Role for UQ in DL
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“as DL-structured neural networks are particularly suitable for recognition of visually manifested conditions such as changes in tissue, lesions and growth, etc.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2.1 The Current Roles and Applications of AI
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Real world data is usually imperfect-typically containing missing elements and errors-and these imperfections have patterns that can confound prediction.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2. Absence of causal models:
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“the domains where the DL is usually applied, such as medicine, do not have such”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 4 Anticipated Challenges
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We see at least four overlapping groups of challenges associated with the uncertainty quantification of the data-driven approaches such as DL:”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 4 Anticipated Challenges
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“To achieve this confidence, UQ extends the traditional discipline of statistical error analysis to also capture uncertainties due to possibly incomplete, inaccurate, and contradictory input data, missing and undetected mechanisms and dependencies, expert judgment, and variations between reasonable model forms and modeling strategies.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“use of scientific insights and attempts at a cohesive framework incorporating the major clinical predictors are likely to be increasingly useful as predictive models are able to efficiently summarize more complex correlations in the data.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2 Machine-assisted Clinical Decision Making and Research
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Predictions without UQ are neither predictions nor actionable.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Although AI-based research has long played an important role in medicine, it has, nevertheless, been one of the more challenging areas for AI to see an effective adoption.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2 Machine-assisted Clinical Decision Making and Research
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
- Rests on an assumption: The reluctance to delegate to machine intelligence a function of life-critical and patient-safety-related decision making is a primary reason for the slow adoption of AI in medicine.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In most of the presented cases, the applications of AI are based on the DL neural networks, trained on a very large number of labeled data sets, and their learning tuned with the large number of hyperparameters.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2.1 The Current Roles and Applications of AI
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“A need to systematize a similar situation is what actually led us to develop the formal approach to UQ in US national security sciences.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 4. Computational Expense:
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“medical AI, especially in its modern data-rich Deep Learning guise, needs to develop a principled and formal Uncertainty Quantification (UQ) discipline, just as we have seen in fields such as nuclear stockpile stewardship or risk management.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
- Rests on an assumption: The reluctance to delegate to machine intelligence a function of life-critical and patient-safety-related decision making is a primary reason for the slow adoption of AI in medicine.
None of the sources cited for this claim have been checked yet.
In the paper
“A notable example is the US support of a nuclear test moratorium since 1992, whereby we annually provide detailed measures of confidence in the safety, security, and performance of the nuclear stockpile--guaranteed through virtual testing 1,2 .”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > Abstract
What the sources say
- Not checked yetcites [1] Oberkampf, W. L. & Roy, C. J. Verfication and Validation in Scientific Computing (Cambridge Univ. Press, Cambridge, 2010). source
- Not checked yetcites [2] National Research Council Evaluation of Quantification of Margins and Uncertainties: Methodology for Assessing and Certifying the Reliability of the Nuclear Stockpile (National Academies Press, Washington DC, 2009).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The data-rich world of AI-based learning, and the frequent absence of a well-understood underlying theory poses its own unique challenges to straightforward adoption of UQ.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Obviously, there are many steps in such scenarios where there are uncertainties that would need to be quantified.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 3 The Role for UQ in DL
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“ad hoc solutions, such as sensitivity analysis and study of model variability, have sometimes been employed to mitigate some the problems we outline.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 4. Computational Expense:
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“once a low-dimensional representation is arrived at describing certain correlations (e.g., the difference between cancerous and matched normal cells), it can raise hypotheses that can be tested.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2. Absence of causal models:
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“These are then”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2.1 The Current Roles and Applications of AI
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This may not seem like a limitation since prediction does not need causal relation.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2. Absence of causal models:
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Understanding prediction system structure and defensibly quantifying uncertainty is possible, and, if done, can significantly benefit both research and practical applications of AI in this critical domain.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > Abstract
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Automated systems adoption, especially systems not analyzable in terms of known causal connections, will require principled and formal UQ to play a transformative role, just as we have seen in the nuclear security domain.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2 Machine-assisted Clinical Decision Making and Research
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
In the paper
“techniques are being developed 17 to approximate some of the UQ-relevant calculations.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 4. Computational Expense:
What the sources say
- Not checked yetcites [17] Gal, Y. & Ghahramani, Z. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. Preprint at https://arxiv.org/abs/1506.02142 (2015).
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“But numerical results, without a measure of their veracity do not provide the trust needed to inform decisions.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The training of the DL models is computationally expensive, and any further recomputation and re-evaluation of the models, aimed, for example, at the calculation of uncertainty bounds might currently be prohibitively expensive.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 4. Computational Expense:
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These challenges, while not trivial, also present significant new research opportunities for the development of new theoretical approaches, and for the practical applications of UQ in the area of machine-assisted medical decision making.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“furthermore, it is imperative to understand how the training data must be similar to prediction data.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2. Absence of causal models:
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Specific UQ methods, therefore, need to be developed to quantify the sensitivity of models to imperfect data.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2. Absence of causal models:
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“DL is essentially exploiting correlations in the data, without paying attention to any causal link.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2. Absence of causal models:
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To develop consequential decision-support from”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Unlike statistical approaches where mathematical models are used to explain variations observed in data, and to propose the margin of errors on inferences, with these recent applications, different learning architectures are combined with a large number of DL network parameters to form universal approximators.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 2.1 The Current Roles and Applications of AI
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Data-driven methods are emerging as the foundations of evidence-based decision making, and the future of data-driven scientific discovery.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 6 Summary
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Some approaches, such as attempts to empirically learn generalizable patterns with insertion of random noise 19,20 , or the use of cross-validation to determine the progression of generalizable learning, move us forward in this problem space, while still carrying the problem of overfitting 21 .”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 5.1 Quantifying and limiting overfitting
What the sources say
- Not checked yetcites [19] Arpit, D. et al. A closer look at memorization in deep networks. Preprint at https://arxiv.org/abs/1706.05394 (2017).
- Not checked yetcites [20] Zhang, C., Vinyals, O., Munos, R. & Bengio, S. A study on overfitting in deep reinforcement learning. Preprint at http://arxiv.org/abs/1804.06893 (2018).
- Not checked yetcites [21] Cawley, G. C. & Talbot, N. L. C. On over-fitting in model selection and subsequent selection bias in performance evaluation. J. Mach. Learn. Res. 11, 2079–2107 (2010).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The wider application of DL in the biomedical field now requires an extension of these methods to this emerging field.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 4. Computational Expense:
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“an effective way of addressing some of the mentioned UQ problems might be to re-shape the DL engine itself to provide an uncertainty estimate on its predictions.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 5.3 Training DL to provide its own uncertainty estimates
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Overfitting, or the problem of a model performing well on the training set, but generalizing poorly for unseen datasets, is one of the fundamental problems of all data-centric methods, and therefore DL.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 5.1 Quantifying and limiting overfitting
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The details of the medical applications and DL networks are, however, significantly different since the theoretical foundations are far less developed and there are deep psychological and sociological implications in delegating to machines decisions that affect the life or health of human beings.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 6 Summary
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“progress in understanding the structure of these predictive systems, merging model and data driven approaches with strongly defensible UQ, and the formalization of the UQ for DL discipline will be needed to make DL and other data-centric tools and methods practically useful.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 6 Summary
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These have been studied in other scientific disciplines and decision-making arena, and we can learn from those.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 6 Summary
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“UQ for DL will likely not be simply a set of tools or procedures to apply, but a more complex wrap-up of disparate methods that in total help bound the overall confidence in predictions.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 6 Summary
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In high-dimensional problems, typical to the medical setting (images, large numbers of phenotypes, etc.), every point, however, can be isolated in some other dimension, and a density of points makes sense only after irrelevant dimensions, are projected out”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 5.3 Training DL to provide its own uncertainty estimates
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“With DL, and the large number of model parameters involved as well as the capacity of DL networks to memorize random noise 18 , classical approaches do not work.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 5.1 Quantifying and limiting overfitting
What the sources say
- Not checked yetcites [18] Zhang, C., Bengio, S., Hardt, M., Recht, B. & Vinyals, O. Understanding deep learning requires rethinking generalization. Preprint at http://arxiv.org/abs/1611.03530 (2016).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Advances in understanding of how DL works internally will allow for a more effective UQ of interpreting DL.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 5.2 Understanding DL
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“there is a unifying structure to this problem in its various guises of complex predictive correlations in large data sets and engineering black boxes.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 6 Summary
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“there are ongoing studies that attempt to understand what DL does, 22 and how it learns 23”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 5.2 Understanding DL
What the sources say
- Not checked yetcites [22] Brahma, P. P., Wu, D. & She, Y. Why deep learning works: A manifold disentanglement perspective. IEEE Trans. Neural Netw. Learn. Sys. 27, 1997–2008 (2016). source
- Not checked yetcites [23] Raghu, M., Gilmer, J., Yosinski, J. & Sohl-Dickstein, J. SVCCA: Singular vector canonical correlation analysis for deep learning dynamics and interpretability. Preprint at https://arxiv.org/abs/1706.05806 (2017).
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the network itself can be used to study this uncertainty empirically and provide the uncertainty bounds.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 5.3 Training DL to provide its own uncertainty estimates
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In the end, it is possible that the entire new field of UQ for DL might need to be developed.”
§ The Need for Uncertainty Quantification in Machine-assisted Medical Decision Making > 4. Computational Expense:
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper relies on this without support.
The reluctance to delegate to machine intelligence a function of life-critical and patient-safety-related decision making is a primary reason for the slow adoption of AI in medicine.
“There are many reasons for this, primarily the reluctance to delegate to machine intelligence a function of life-critical and patient-safety-related decision making.”
The authors state this as an assumption.
Fair sampling in the training data holds.
“assuming fair sampling in the training data”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Better decision-making: AI, ML, and DL can enable robots to make better decisions based on data analysis and pattern recognition, leading to improved performance and outcomes [52] .”
From Artificial intelligence, machine learning and deep learning in advanced robotics, a review (2023) · cites this paper as [52]
Experimental — accuracy not yet measuredIn the citing paper
“However, these models have black-box nature and lack underlying theoretical foundation behind their decisions [8]”
From Explainable, trustworthy, and ethical machine learning for healthcare: A survey (2022) · cites this paper as [8]
In the citing paper
“However, due to the unavailability of sound fundamental laws and models, the explanation of DL cannot be produced up-to the required scale.”
From Explainable, trustworthy, and ethical machine learning for healthcare: A survey (2022) · cites this paper as [8]
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning
Kermany, D. S., Goldbaum, M., Cai, W., Valentim, C. C. S., Liang, H., Baxter, S. L., McKeown, A., Yang, G., Wu, X., Yan, F., et al. (2018) · Cell · doi:10.1016/j.cell.2018.02.010 · Cited by 4,842
Understanding deep learning requires rethinking generalization
Zhang, C., Bengio, S., Hardt, M., Recht, B., & Vinyals, O. (2016) · arXiv · doi:10.48550/arxiv.1611.03530 · Cited by 2,838
Scalable and accurate deep learning with electronic health records
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0029-1 · Cited by 2,648 · cited 1×
“…DL methods have been used in the predictive scenarios related to quality of care, and clinical outcomes where large neural networks were used as function estimators in place of classical predictive models, with reported performance better than the state-of-the-art, classical model approaches 9–11 .”
MethodScalable and accurate deep learning with electronic health records.
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · eScholarship (California Digital Library) · Cited by 2,242
(2010) · doi:10.5555/1756006.1859921 · Cited by 1,924
Verification and Validation in Scientific Computing
Oberkampf, W. L., & Roy, C. J. (2010) · doi:10.1017/cbo9780511760396 · Cited by 1,556
The mystery of missing heritability: Genetic interactions create phantom heritability
Zuk, O., Hechter, E., Sunyaev, S. R., & Lander, E. S. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1119675109 · Cited by 1,542
Can machine-learning improve cardiovascular risk prediction using routine clinical data?
Weng, S. F., Reps, J., Kai, J., Garibaldi, J. M., & Qureshi, N. (2017) · PLOS ONE · doi:10.1371/journal.pone.0174944 · Cited by 1,346
Cited by
Sorted by citations
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
“The uncertainties that are obvious in these steps are the following: (i) selection and collection of training data, (ii) completeness and accuracy of training data, (iii) understanding the DL (or traditional machine learning) model with performance bounds and its limitations, and (iv) uncertainties corresponds to the…”
BackgroundInfluentialA survey of uncertainty in deep neural networks
Gawlikowski, J., Tassi, C. R. N., Ali, M., Lee, J., Humt, M., Feng, J., Kruspe, A., Triebel, R., Jung, P., Roscher, R., et al. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10562-9 · Cited by 1,670
Artificial intelligence, machine learning and deep learning in advanced robotics, a review
Soori, M., Arezoo, B., & Dastres, R. (2023) · Cognitive Robotics · doi:10.1016/j.cogr.2023.04.001 · Cited by 1,131
Artificial Intelligence in Cancer Research and Precision Medicine
Bhinder, B., Gilvary, C., Madhukar, N. S., & Elemento, O. (2021) · Cancer Discovery · doi:10.1158/2159-8290.cd-21-0090 · Cited by 781
“To this end, Begoli and colleagues recommend development and adoption of systematic and pragmatic measures of uncertainty quantification in AI models (128).”
BackgroundAslam, S., Herodotou, H., Mohsin, S. M., Javaid, N., Ashraf, N., & Aslam, S. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.110992 · Cited by 700
Trustworthy artificial intelligence
Thiebes, S., Lins, S., & Sunyaev, A. (2021) · Electronic Markets · doi:10.1007/s12525-020-00441-4 · Cited by 595
“Another prominent stream of research concerned with the explainability of AI encompasses the quantification of uncertainties (Begoli et al. 2019).”
BackgroundRemote patient monitoring using artificial intelligence: Current state, applications, and challenges
Shaik, T., Tao, X., Higgins, N., Li, L., Gururajan, R., Zhou, X., & Acharya, U. R. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1485 · Cited by 620
“Begoli et al. (2019) also discussed the need for UQ in machine learning-assisted medical decision-making.”
BackgroundIdentifying Ethical Considerations for Machine Learning Healthcare Applications
Char, D. S., Abràmoff, M. D., & Feudtner, C. (2020) · The American Journal of Bioethics · doi:10.1080/15265161.2020.1819469 · Cited by 415
“…any ML-HCA built on such a classification would likely result in an even higher likelihood of de-escalation or withholding, thereby reducing the opportunity to improve outcomes for such conditions (Begoli et al. 2019; Fiske et al. 2019; Nabi 2018; Cohen et al. 2014; Ho 2019; Taljaard et al. 2014).”
BackgroundMultimodal data fusion for cancer biomarker discovery with deep learning
Steyaert, S., Pizurica, M., Nagaraj, D., Khandelwal, P., Hernandez-Boussard, T., Gentles, A. J., & Gevaert, O. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00633-5 · Cited by 402
“To be useful in clinical decision-making, models need to undergo extensive testing, be interpretable, and their predictions need to be accompanied by confidence or uncertainty measures 148,149 .”
BackgroundExplainable, trustworthy, and ethical machine learning for healthcare: A survey
Rasheed, K., Qayyum, A., Ghaly, M., Al-Fuqaha, A., Razi, A., & Qadir, J. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106043 · Cited by 372
Recent Advancements in Emerging Technologies for Healthcare Management Systems: A Survey
Junaid, S. B., Imam, A. A., Balogun, A. O., Silva, L. C. D., Surakat, Y. A., Kumar, G., Abdulkarim, M., Shuaibu, A. N., Garba, A., Sahalu, Y., et al. (2022) · Healthcare · doi:10.3390/healthcare10101940 · Cited by 398
“Some ML models (ensemble and DL methods) are black boxes with no core underlying theory, and they primarily function by exploiting patterns and correlations without taking into account any causal relationship [170].”
BackgroundMachine Learning in Chemical Engineering: Strengths, Weaknesses, Opportunities, and Threats
Dobbelaere, M. R., Plehiers, P. P., de Vijver, R. V., Stevens, C. V., & Geem, K. M. V. (2021) · Engineering · doi:10.1016/j.eng.2021.03.019 · Cited by 353
Machine learning for metabolic engineering: A review
Lawson, C. E., Martí, J. M., Radivojević, T., Jonnalagadda, S. V. R., Gentz, R., Hillson, N. J., Peisert, S., Kim, J., Simmons, B. A., Petzold, C. J., et al. (2020) · Metabolic Engineering · doi:10.1016/j.ymben.2020.10.005 · Cited by 335
Urban flow prediction from spatiotemporal data using machine learning: A survey
Xie, P., Li, T., Liu, J., Du, S., Yang, X., & Zhang, J. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.002 · Cited by 311
A machine learning Automated Recommendation Tool for synthetic biology
Radivojević, T., Costello, Z., Workman, K., & Martin, H. G. (2020) · Nature Communications · doi:10.1038/s41467-020-18008-4 · Cited by 314
Artificial intelligence in cancer research, diagnosis and therapy
Elemento, O., Leslie, C., Lundin, J., & Tourassi, G. (2021) · Nature Reviews Cancer · doi:10.1038/s41568-021-00399-1 · Cited by 264
“First, AI developers will need to offer solutions that are not only ‘on average’ accurate but also offer a measure of trustworthiness at the individual or patient decision level 28 .”
BackgroundNemani, V. P., Biggio, L., Huan, X., Hu, Z. Y., Fink, O., Tran, A., Wang, Y., Zhang, X., & Hu, C. K. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.110796 · Cited by 278
A generalized deep learning framework for whole-slide image segmentation and analysis
Khened, M., Kori, A., Rajkumar, H., Krishnamurthi, G., & Srinivasan, B. (2021) · Scientific Reports · doi:10.1038/s41598-021-90444-8 · Cited by 255
“(Begoli et al., 2019) argues the need for uncertainty analysis in machine-assisted medical decision-making system.”
BackgroundSeoni, S., Jahmunah, V., Salvi, M., Barua, P. D., Molinari, F., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107441 · Cited by 239
Emotion recognition in EEG signals using deep learning methods: A review
Jafari, M., Shoeibi, A., Khodatars, M., Bagherzadeh, S., Shalbaf, A., García, D. L., Gorriz, J. M., & Acharya, U. R. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107450 · Cited by 240
Deep learning-based cardiovascular image diagnosis: A promising challenge
Wong, K. K. L., Fortino, G., & Abbott, D. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.09.047 · Cited by 221
Dermatologist-like explainable AI enhances trust and confidence in diagnosing melanoma
Chanda, T., Hauser, K., Hobelsberger, S., Bucher, T.-C., Garcia, C. N., Wies, C., Kittler, H., Tschandl, P., Navarrete‐Dechent, C., Podlipnik, S., et al. (2024) · Nature Communications · doi:10.1038/s41467-023-43095-4 · Cited by 211
A Survey of Algorithmic Recourse: Contrastive Explanations and Consequential Recommendations
Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2023) · ACM Computing Surveys · doi:10.1145/3527848 · Cited by 301
“, prescription of life-altering medication) [24, 27, 78], and other settings (e.”
BackgroundRyu, S., Kwon, Y., & Kim, W. Y. (2019) · Chemical Science · doi:10.1039/c9sc01992h · Cited by 152
Dolezal, J. M., Srisuwananukorn, A., Karpeyev, D., Ramesh, S., Kochanny, S., Cody, B., Mansfield, A. S., Rakshit, S., Bansal, R., Bois, M. C., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-34025-x · Cited by 147
“Over the past several years, there has been a growing awareness of the need for better estimates of confidence and uncertainty within medical applications of AI 24-26 .”
BackgroundJin, E. H., Lee, D., Bae, J. H., Kang, H. Y., Kwak, M.-S., Seo, J. Y., Yang, J. I., Yang, S. Y., Lim, S. H., Yim, J. Y., et al. (2020) · Gastroenterology · doi:10.1053/j.gastro.2020.02.036 · Cited by 140
Uncertainty quantification for plant disease detection using Bayesian deep learning
Hernández, S., & López, J. L. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106597 · Cited by 144
Operationalising AI Governance through Ethics-Based Auditing: An Industry Case Study
Mökander, J., & Floridi, L. (2022) · AI and Ethics · doi:10.1007/s43681-022-00171-7 · Cited by 187
Ethical considerations about artificial intelligence for prognostication in intensive care
Beil, M., Proft, I., van Heerden, D., Sviri, S., & van Heerden, P. V. (2019) · Intensive Care Medicine Experimental · doi:10.1186/s40635-019-0286-6 · Cited by 124
Responsible AI: Requirements and challenges
Ghallab, M. (2019) · AI Perspectives · doi:10.1186/s42467-019-0003-z · Cited by 120
“, in medical diagnosis [3]? • how can a system monitor online its environment and own state with respect to the assumptions that are needed for its correct functioning, and adapt when these assumptions are not met? • how to assess the V&V properties of a complex system integrating AI techniques from the V&V properties…”
BackgroundTanno, R., Worrall, D. E., Kaden, E., Ghosh, A., Grussu, F., Bizzi, A., Sotiropoulos, S. N., Criminisi, A., & Alexander, D. C. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117366 · Cited by 150
Fusion of Probability Density Functions
Koliander, G., El-Laham, Y., Djurić, P. M., & Hlawatsch, F. (2022) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3154399 · Cited by 120
Towards risk-aware artificial intelligence and machine learning systems: An overview
Zhang, X., Chan, F. T. S., Yan, C., & Bose, I. (2022) · Decision Support Systems · doi:10.1016/j.dss.2022.113800 · Cited by 137
Al-Turjman, F. M., Zahmatkesh, H., & Mostarda, L. (2019) · IEEE Access · doi:10.1109/access.2019.2931637 · Cited by 112
Uncertainty quantification in classical molecular dynamics
Wan, S., Sinclair, R. C., & Coveney, P. V. (2021) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2020.0082 · Cited by 119
“In the field of medicine, where patient safety is at stake, it is extremely important to have an uncertainty quantification discipline for risk management [112].”
BackgroundMonte Carlo Dropout for Uncertainty Estimation and Motor Imagery Classification
Hermosilla, D. M., Codorniú, R. T., Baracaldo, R. L., Zamora, R. S., Delisle-Rodríguez, D., Mayor, J. J. V., & Álvarez, J. R. N. (2021) · Sensors · doi:10.3390/s21217241 · Cited by 119
“hence, an analysis for uncertainty quantification is crucial to guarantee more robust BCIs with reliable responses, and consequently, making them suitable for real-life scenarios [2,3].”
BackgroundUncertainty-guided dual-views for semi-supervised volumetric medical image segmentation
Peiris, H., Hayat, M., Chen, Z., Egan, G. F., & Harandi, M. T. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00682-w · Cited by 108
Abdar, M., Salari, S., Qahremani, S., Lam, H., Karray, F., Hussain, S., Khosravi, A., Acharya, U. R., Makarenkov, V., & Nahavandi, S. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.09.023 · Cited by 151
Demystifying Brain Tumor Segmentation Networks: Interpretability and Uncertainty Analysis
Natekar, P., Kori, A., & Krishnamurthi, G. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00006 · Cited by 103
“(Begoli et al., 2019) discuss the need for uncertainty in machine-assisted medical decision making and the challenges that we might face in this context.”
Pain, C. D., Egan, G. F., & Chen, Z. (2022) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-022-05746-4 · Cited by 101
“Uncertainty estimation methods [134, 135] can quantify the quality of predictions for OOD data.”
MethodA Survey on Uncertainty Quantification Methods for Deep Learning
He, W., Jiang, Z., Xiao, T., Xu, Z., & Li, Y. (2025) · ACM Computing Surveys · doi:10.1145/3786319 · Cited by 218
“This can cause serious consequences in high-stake applications, such as autonomous driving [30], medical diagnosis [10], and disaster response [4].”
Uncertainty quantification in drug design
Mervin, L., Johansson, S., Semenova, E., Giblin, K. A., & Engkvist, O. (2020) · Drug Discovery Today · doi:10.1016/j.drudis.2020.11.027 · Cited by 100
Mitigating Bias in Radiology Machine Learning: 3. Performance Metrics
Faghani, S., Khosravi, B., Zhang, K., Moassefi, M., Jagtap, J. M. M., Nugen, F., Vahdati, S., Kuanar, S. P., Rassoulinejad-Mousavi, S. M., Singh, Y., et al. (2022) · Radiology Artificial Intelligence · doi:10.1148/ryai.220061 · Cited by 104
“In this way, the model communicates with medical experts and likely increases trust in model performance over time (57,58).”
BackgroundBoundary uncertainty aware network for automated polyp segmentation
Yue, G., Zhuo, G., Yan, W., Zhou, T., Tang, C., Yang, P., & Wang, T. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.11.050 · Cited by 90
Multiscale modeling in smart cities: A survey on applications, current trends, and challenges
Khan, A., Aslam, S., Aurangzeb, K., Alhussein, M. A., & Javaid, N. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103517 · Cited by 88
Threshold switching memristor-based stochastic neurons for probabilistic computing
Wang, K., Hu, Q., Gao, B., Lin, Q., Zhuge, F., Zhang, D., Wang, L., He, Y., Scheicher, R. H., Tong, H., et al. (2020) · Materials Horizons · doi:10.1039/d0mh01759k · Cited by 90
Montero, A. M. B., Bibal, A., Huet‐Dastarac, M., Draguet, C., Valdés, G., Nguyen, D. T. D., Willems, S., Vandewinckele, L., Holmström, M., Löfman, F., et al. (2022) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ac678a · Cited by 91
“Implementing such QA tools is crucial to gain clinicians ’ trust in ML technology, since it helps identify the limitations of ML models and avoid the risks associated with uncertain predictions ( Begoli et al 2019, Kompa et al 2021 ) .”
BackgroundMethodInfluentialFernando, K. R. M., & Tsokos, C. P. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.12.013 · Cited by 90
Xiao, Z., Su, Y., Deng, Z., & Zhang, W. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.107099 · Cited by 84
Uncertainty Estimation in Deep Neural Networks for Dermoscopic Image Classification
Combalia, M., Hueto, F., Puig, S., Malvehy, J., & Vilaplana, V. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00380 · Cited by 86
“Identifying when a model is being used on a domain different from the training domain is also a critical issue in medical applications [36, 4].”
BackgroundUncertainty Estimation in Medical Image Classification: Systematic Review
Kurz, A., Hauser, K., Mehrtens, H. A., Krieghoff‐Henning, E., Hekler, A., Kather, J. N., Fröhling, S., Kalle, C. V., & Brinker, T. J. (2022) · JMIR Medical Informatics · doi:10.2196/36427 · Cited by 92
“Such a measure is important to increase trust in the AI system, and it may improve clinical decision-making [1].”
BackgroundPrabhudesai, S., Yang, L., Asthana, S., Huan, X., Liao, Q. V., & Banovic, N. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584033 · Cited by 82
“Moreover, an accurate assessment of uncertainty may lead to mitigation of model unfairness [34], improving decision-making [8] and promoting appropriate trust in AI [13, 98].”
BackgroundA survey on epistemic (model) uncertainty in supervised learning: Recent advances and applications
Zhou, X., Liu, H., Pourpanah, F., Zeng, T., & Wang, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.10.119 · Cited by 87
Saboury, B., Bradshaw, T., Boellaard, R., Buvat, I., Dutta, J., Hatt, M., Jha, A. K., Li, Q., Liu, C., McMeekin, H., et al. (2022) · Journal of Nuclear Medicine · doi:10.2967/jnumed.121.263703 · Cited by 82
Salvi, M., Seoni, S., Campagner, A., Gertych, A., Acharya, U. R., Molinari, F., & Cabitza, F. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105846 · Cited by 89
Post-disaster damage classification based on deep multi-view image fusion
Khajwal, A. B., Cheng, C., & Noshadravan, A. (2022) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12890 · Cited by 77
“The inability to quantify uncertainties associated with the practical adoption of such a model, might be a concern when making crucial decisions (Begoli et al., 2019; Sajedi & Liang, 2021a).”
BackgroundA survey of algorithmic recourse: definitions, formulations, solutions, and prospectsPreprint
Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04050 · Cited by 74
“…above are prevalent not only in finance [20, 133] but also in justice (e.g., pretrial bail) [10], healthcare (e.g., prescription of life-altering medication) [24, 27, 72], and other settings (e.g., hiring) [43, 134, 160] broadly classified as consequential decision-making settings [20, 34, 45, 91].”
BackgroundBernal, J., & Mazo, C. (2022) · Applied Sciences · doi:10.3390/app122010228 · Cited by 70
Mind and machine in drug design
Schneider, G. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0030-7 · Cited by 73
Deep Sequential Feature Learning in Clinical Image Classification of Infectious Keratitis
Xu, Y., Kong, M. C., Xie, W., Duan, R., Fang, Z., Lin, Y., Zhu, Q., Tang, S., Wu, F. Q., & Yao, Y. (2020) · Engineering · doi:10.1016/j.eng.2020.04.012 · Cited by 69
“A real-world application of such an AI system in assisting physicians in clinical practice requires further and more extensive clinical evaluations on a larger scale [51].”
MethodSlideflow: deep learning for digital histopathology with real-time whole-slide visualization
Dolezal, J. M., Kochanny, S. E., Dyer, E., Ramesh, S., Srisuwananukorn, A., Sacco, M., Howard, F. M., Li, A., Mohan, P., & Pearson, A. T. (2024) · BMC Bioinformatics · doi:10.1186/s12859-024-05758-x · Cited by 86
“Estimation of confidence and uncertainty is essential for medical AI applications, as reliable uncertainty quantification can facilitate clinical decision-making and potentially improve patient safety [29], [30].”
BackgroundDesigning Human-Agent Collaborations: Commitment, responsiveness, and support
Cila, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517500 · Cited by 65
“[11] recommended to implement a precise uncertainty estimation metric that incorpo-”
How to account artificial intelligence in human factor analysis of complex systems?
Zarei, E., Khan, F. I., & Abbassi, R. (2023) · Process Safety and Environmental Protection · doi:10.1016/j.psep.2023.01.067 · Cited by 67
Secure and robust machine learning for healthcare: A survey
Qayyum, A., Qadir, J., Bilal, M., & Al-Fuqaha, A. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.3013489 · Cited by 59
“DL models are black-box which lacks fundamental underlying theory and these models essentially work by exploiting patterns and correlations without considering any causal link [116].”
BackgroundUncertainty quantification: Can we trust artificial intelligence in drug discovery?
Yu, J., Wang, D., & Zheng, M. (2022) · iScience · doi:10.1016/j.isci.2022.104814 · Cited by 59
“The inconsistency between the distribution of training data and test data may cause the model to produce unreliable outputs, which may have adverse consequences on decision-making procedure of drug design (Begoli et al., 2019).”
BackgroundUnlocking the Power of Artificial Intelligence and Big Data in Medicine
Lovis, C. (2019) · Journal of Medical Internet Research · doi:10.2196/16607 · Cited by 61
“Some other dimensions such as transparency, reproducibility, or uncertainty qualifications might be more effective [45].”
BackgroundThiagarajan, P., Khairnar, P., & Ghosh, S. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3123300 · Cited by 68
“To evaluate the confidence of predictions, uncertainty quantification is important [42].”
BackgroundHyperspectral imaging for early diagnosis of diseases: A review
Mangotra, H., Srivastava, S., Jaiswal, G., Rani, R., & Sharma, A. (2023) · Expert Systems · doi:10.1111/exsy.13311 · Cited by 57
“Our understanding of data-driven predictions' precision and uncertainty must be enhanced in order to fully realize their potential (Begoli et al., 2019).”
BackgroundLin, Y., Zhang, Q., Gao, B., Tang, J., Yao, P., Li, C., Huang, S., Liu, Z., Zhou, Y., Liu, Y., et al. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00680-y · Cited by 65
“…successfully quantify uncertainty in-memory for policy optimization, yielding consistently satisfactory results in a and smart medicine applications 10,11 , it is critical to know and quantify the two prediction uncertainties, often referred to as epistemic and aleatoric uncertainties 12,13 , to…”
BackgroundJiang, Y., Wang, C., & Zhou, S. (2023) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2023.09.005 · Cited by 62
Dilated densely connected U-Net with uncertainty focus loss for 3D ABUS mass segmentation
Cao, X., Chen, H., Li, Y., Peng, Y., Wang, S., & Cheng, L. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106313 · Cited by 55
Schaumberg, A. J., Juarez-Nicanor, W. C., Choudhury, S. J., Guerra, L., Pritt, B. S., Pozuelo, M. P., Sánchez, R. S., Ho, K., Zahra, N., Sener, B. D., et al. (2020) · Modern Pathology · doi:10.1038/s41379-020-0540-1 · Cited by 56
“Quantifying uncertainty is particularly important [25] in medicine, to assess how much trust to put in predictions that”
BackgroundFair Conformal Predictors for Applications in Medical Imaging
Lu, C., Lemay, A., Chang, K., Hoebel, K., & Kalpathy–Cramer, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21459 · Cited by 79
Unleashing the potential of AI for pathology: challenges and recommendations
Asif, A., Rajpoot, K., Graham, S., Snead, D. R. J., Minhas, F., & Rajpoot, N. (2023) · The Journal of Pathology · doi:10.1002/path.6168 · Cited by 62
“Confidence scores can enable predictive models to ‘knowwhat they don’t know’, detect OOD test examples, and abstain from generating a decision in such cases [102,103].”
BackgroundTrustworthy multi-phase liver tumor segmentation via evidence-based uncertainty
Hu, C., Xia, T., Cui, Y., Zou, Q., Wang, Y., Xiao, W., Ju, S., & Li, X. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108289 · Cited by 53
Artificial Intelligence in Breast Cancer Screening and Diagnosis
Dileep, G., & Gianchandani, S. (2022) · Cureus · doi:10.7759/cureus.30318 · Cited by 63
“Another challenge in the use of AI is building trust among doctors to make their decisions with the help of AI [42].”
Show and tell: A critical review on robustness and uncertainty for a more responsible medical AI
Marconi, L., & Cabitza, F. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105970 · Cited by 58
Andrew, O., Apan, A., Paudyal, D. R., & Perera, K. (2023) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi12050194 · Cited by 50
Baker, M. R., Jihad, K. H., Al-bayaty, H., Ghareeb, A. H., Ali, H., Choi, J., & Sun, Q. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106350 · Cited by 50
Uncertainty-aware deep learning for monitoring and fault diagnosis from synthetic data
Das, L., Gjorgiev, B., & Sansavini, G. (2024) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2024.110386 · Cited by 46
Lee, S. W., Chu, Y., Yoo, S. K., Choi, S. G., Choe, S., Koh, S. B., Chung, K. Y., Xing, L., Oh, B. H., & Yang, S. (2020) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.16185 · Cited by 47
Wang, D., Yu, J., Chen, L., Li, X., Jiang, H., Chen, K., Zheng, M., & Luo, X. (2021) · Journal of Cheminformatics · doi:10.1186/s13321-021-00551-x · Cited by 48
Dalvi‐Esfahani, M., Mosharaf‐Dehkordi, M., Leong, L. W., Ramayah, T., & Kanaan-Jebna, A. M. J. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.122768 · Cited by 46
Barandas, M., Famiglini, L., Campagner, A., Folgado, D., Simão, R., Cabitza, F., & Gamboa, H. F. S. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101978 · Cited by 44
Qiao, L., Khalilimeybodi, A., Linden-Santangeli, N. J., & Rangamani, P. (2025) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-102723-065309 · Cited by 57
“Therefore, uncertainty quantification of model predictions is essential for making informed decisions in clinical research (8).”
BackgroundAI Meets Exascale Computing: Advancing Cancer Research With Large-Scale High Performance Computing
Tanmoy Bhattacharya, A., Brettin, T. S., Doroshow, J. H., Evrard, Y. A., Greenspan, E. J., Gryshuk, A. L., Hoang, T., Lauzon, C. B., Nissley, D. V., Penberthy, L. T., et al. (2019) · Frontiers in Oncology · doi:10.3389/fonc.2019.00984 · Cited by 41
“Historically, results from computational modeling in the biological sciences did not incorporate UQ, but measures of certainty are essential for actionable predictive analytics (33).”
BackgroundThere Is Hope After All: Quantifying Opinion and Trustworthiness in Neural Networks
Cheng, M., Nazarian, S., & Bogdan, P. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00054 · Cited by 41
“Nowadays, the need for uncertainty quantification in machine-assisted decision-making is rising, especially when human’s security and safety are at stake (Begoli et al., 2019).”
BackgroundTemperature guided network for 3D joint segmentation of the pancreas and tumors
Li, Q., Liu, X., He, Y., Li, D., & Xue, J. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.10.026 · Cited by 42
Self-Attention LSTM-FCN model for arrhythmia classification and uncertainty assessment
Park, J., Lee, K., Park, N., You, S. C., & Ko, J. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102570 · Cited by 41
Appositeness of Optimized and Reliable Machine Learning for Healthcare: A Survey
Swain, S., Bhushan, B., Dhiman, G., & Viriyasitavat, W. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-022-09733-8 · Cited by 40
“Distribution shifts as they are expected to be deployed on different domain data, they are also vulnerable to adversarial attacks [130].”
BackgroundJi, K., Lin, W., Sun, Y., Cui, L.-S., Shamsi, J., Chiang, Y.-H., Chen, J., Tennyson, E. M., Dai, L., Li, Q., et al. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00736-z · Cited by 36
“Furthermore, concerns have been raised regarding the trustworthiness of ML-based models when predicting unseen samples that fall outside the distribution of the training data 16,17 .”
BackgroundAltabaji, W. I. A. E., Umair, M., Tan, W.-H., Foo, Y., & Ooi, C. (2024) · IEEE Access · doi:10.1109/access.2024.3373000 · Cited by 35
“Neural networks, particularly CNNs, have been used in various applications involving disease diagnosis [24], [25], [26].”
MethodCheng, C., Behzadan, A. H., & Noshadravan, A. (2022) · Structural Control and Health Monitoring · doi:10.1002/stc.3019 · Cited by 40
“15,61 Explainability is critical to decision-makers who use model outcomes to make impactful decisions.”
BackgroundEveryday Uncertainty: How Blind People Use GenAI Tools for Information Access
Tang, X., Abdolrahmani, A., Gergle, D., & Piper, A. M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713433 · Cited by 30
“This perspective is reflected in efforts to measure [13, 18], control [81, 110], visualize [36, 60, 71], and understand human perceptions of uncertainty related to computing systems [74].”
Artificial intelligence uncertainty quantification in radiotherapy applications − A scoping review
Wahid, K. A., Kaffey, Z. Y., Farris, D. P., Humbert‐Vidan, L., Moreno, A. C., Rasmussen, M. E., Ren, J., Naser, M. A., Netherton, T., Korreman, S., et al. (2024) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2024.110542 · Cited by 42
Application of machine learning in chemical engineering: outlook and perspectives
Sharah, A. A., Owida, H. A., Alnaimat, F., & Abuowaida, S. F. A. (2023) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v13.i1.pp619-630 · Cited by 40
Tuan, T. A., Zeevi, T., Haider, S. P., Karam, G. A., Berson, E. R., Tharmaseelan, H., Qureshi, A. I., Sanelli, P. C., Werring, D. J., Malhotra, A., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01007-w · Cited by 32
Uncertainty Propagation in a Multiscale CALPHAD-Reinforced Elastochemical Phase-Field ModelPreprint
Attari, V., Honarmandi, P., Duong, T., Sauceda, D., Allaire, D., & Arróyave, R. (2019) · SSRN Electronic Journal · doi:10.1016/j.actamat.2019.11.031 · Cited by 32
“Uncertainty Quantification (UQ) has a long and successful history of application to very diverse areas such as climate change [1], structural engineering [2], aerospace engineering and design [3], and medicine [4], to name a few.”
Valizadeh, G., Elahi, R., Hasankhani, Z., Rad, H. S., & Shalbaf, A. (2024) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-024-10176-6 · Cited by 35
Zhou, B., Li, X., Pan, Y., He, B., & Gao, B. (2025) · Colloids and Surfaces B Biointerfaces · doi:10.1016/j.colsurfb.2025.114970 · Cited by 36
Metadata
- Authors
- Begoli, E., Bhattacharya, T., & Kusnezov, D.
- Affiliations
- Oak Ridge National Laboratory (US)
- United States Department of Energy (US)
- Corresponding author
- Begoli, Edmon
- ORCID
- Begoli, Edmon
- Venue
- Nature Machine Intelligence
- Published
- 2019-01-07
- Volume
- 1
- Issue
- 1
- Pages
- 20-23
- ISSN
- 2522-5839 (ISSN-L)
- OpenAlex
- W2904422658
- Semantic Scholar
- a73eef4e0ec8e49be1c0e6abb04cc1967a681c50
- Cited by
- 597
- References
- 22
- Citations by year
- 2026: 158 · 2025: 102 · 2024: 73 · 2023: 94 · 2022: 72 · 2021: 47 · 2020: 33 · 2019: 16
- FWCI
- 6.47
- Type
- journal article
- Language
- en
- Open access
- green
- www.osti.gov
- Licence
- Locations
- Nature Machine Intelligence (publishedVersion)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- Funders
- Battelle (DE-AC05- 00OR22725, DE-AC05)
- UT-Battelle (DE-AC05, DEAC05-00OR22725, AC05-00OR22725)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- uncertainty quantification, artificial intelligence in healthcare, deep learning, patient safety, trust in AI, forecast uncertainty
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
