The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Interpretable AI/ML for High-stakes Tasks with Human-in-the-loop: Critical Review and Future Trends
Open accessAbstract
Domains with high-stakes tasks include medical diagnosis, financial decision-making, autonomous vehicles, criminal justice, disaster response, search and rescue operations, and others. In high-stakes tasks the effects of incorrect decisions or predictions can cause significant harm to individuals or society. This paper presents (1) major topics of research in interpretable AI/ML models for high-stakes tasks with human-in-the-loop, and (2) motivates and explains topics of emerging importance in this area. It is widely accepted that model explanations should accurately describe the model’s inner decision making and be convincing to the user. However, quite often these properties are missing. revealing only a quasi-explanation of the model, thus not serving the goal of true model explanation. This paper presents both benefits and deficiencies of current methods and ways to overcome deficiencies with a focus on high-stakes AI/ML tasks, where incorrect decisions or predictions can result in devastating consequences. While a human-in-the-loop is necessary for solving explainability problems, the success heavily depends on human cognitive abilities and limitations. This makes human visual knowledge discovery with granular computing critical for the progress of interpretable machine learning. Therefore, a significant part of the paper is devoted to presenting interpretable ML models built with human visual knowledge discovery methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![Figure 4 SHAP Tree-Explainer for tree-based models [Lundberg, et al., 2019]: linear explantion of mortality risk score 4 = 2.5*(age) + 0.5*(BMI) + 3*(blood pressure) - 2*(sex).](https://figures.cochat.ai/paper-figures/d6f15b7f7b24409f84cf4f20157c5718/interpretable-ai-ml-for-high-stakes-tasks-with-human-in-the-loop-critical-review-figure-4.png)


![(a) BC-DT with proportional (unequal) edges (b) BC-DT with disproportional (equal) edges Figure 6. BC-DT with proportional edges (a) and disproportional edges (b) serving as Bended Coordinates [Kovalerchuk, Dunn, et al., 2024].](https://figures.cochat.ai/paper-figures/214c0956b62640be973aedbc8f7ee697/interpretable-ai-ml-for-high-stakes-tasks-with-human-in-the-loop-critical-review-figure-6.png)














Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Explanations that interrupt workflow, require excessive cognitive effort to process, or provide irrelevant detail can reduce rather than enhance human performance [4].”
From Human-in-the-Loop Artificial Intelligence: A Systematic Review of Concepts, Methods, and Applications (2026) · cites this paper as [4]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Explainable AI is a term that comprises various methods that make AI model behavior comprehensible to humans, thus aiding them in decision-making based on when to trust AI suggestions and when not to [4].”
From Human-in-the-Loop Artificial Intelligence: A Systematic Review of Concepts, Methods, and Applications (2026) · cites this paper as [4]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Gauriat, C.-M., Pencolé, Y., Ribot, P., & Brouillet, G. (2024) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.4230/oasics.dx.2024.27 · Cited by 12,586
From local explanations to global understanding with explainable AI for trees
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-019-0138-9 · Cited by 10,551
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
The false hope of current approaches to explainable artificial intelligence in health care
Ghassemi, M., Oakden-Rayner, L., & Beam, A. L. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00208-9 · Cited by 1,724
Interpretable machine learning
Parliamentary Office of Science and Technology, & Christie, L. (2020) · doi:10.58248/pn633 · Cited by 952
Journal of Ambient Intelligence and Humanized Computing
(2013) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/12652.1868-5145 · Cited by 840
Albahri, A. S., Duhaim, A. M., Fadhel, M. A., Alnoor, A., Baqer, N. S., Alzubaidi, L., Albahri, O. S., Alamoodi, A. H., Bai, J., Salhi, A., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.03.008 · Cited by 716
Hein, M., Andriushchenko, M., & Bitterwolf, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00013 · Cited by 428
Research works printed but not linked: 3
- [28]28. Lei J, Li D, Xu C, Fang L, Hospedales TM, Fu Y. Worst-case Feature Risk Minimization for Data-Efficient Learning. Transactions on Machine Learning Research. 2023 Oct 26;2023(09):1-9.
- [42]42. Theisen RC. Beyond Worst-Case Generalization in Modern Machine Learning, Doctoral dissertation, University of California, Berkeley, 2023, https://escholarship.org/uc/item/62j5g7vd.
- [43]43. VKD, CWU Visual Knowledge Discovery Lab software, 2024, https://github.com/CWU-VKD-LAB, 44. Watson DS, Conceptual challenges for interpretable machine learning, Synthese (2022) 200:65, https://link.springer.com/content/pdf/10.1007/s11229-022-03485-5.pdf · doi:10.1007/s11229-022-03485-5.pdf
Cited by
Hettikankanamage, N. D., Shafiabady, N., Chatteur, F., Wu, M., Din, F. U., & Zhou, J. J. (2025) · Sensors · doi:10.3390/s25216649 · Cited by 76
Lazaros, K., Vrahatis, A. G., & Kotsiantis, S. (2026) · Entropy · doi:10.3390/e28040377 · Cited by 50
Artificial intelligence in nephrology: predicting CKD progression and personalizing treatment
Yuan, S., Guo, L., & Xu, F. (2025) · International Urology and Nephrology · doi:10.1007/s11255-025-04878-4 · Cited by 20
Boosting of Classification Models with Human-in-the-Loop Computational Visual Knowledge Discovery
Williams, A., & Kovalerchuk, B. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93429-2_26 · Cited by 2
Self-citationMusa, A. A., Musa, U. S., Sai, A. M. V. V., & Yu, W. (2025) · Elsevier eBooks · doi:10.1016/b978-0-44-326572-3.00012-7 · Cited by 1
Metadata
- Authors
- Kovalerchuk, B.
- Affiliations
- Central Washington University (US)
- Corresponding author
- Kovalerchuk, Boris
- ORCID
- Kovalerchuk, Boris
- Venue
- Research Square
- Published
- 2024-02-29
- OpenAlex
- W4392298119
- Cited by
- 9
- References
- 43
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 1
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- Research Square (acceptedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Keywords
- model interpretability, high-stakes decision making, human-in-the-loop, model explanation, human cognitive limitations, granular computing, diagnosis, autonomous vehicles, criminal justice, financial decision-making, disaster response
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Interpretable AI/ML for High-stakes Tasks with Human-in-the-loop: Critical Review and Future Trends. https://app.cochat.ai/papers/10.21203/rs.3.rs-3989807/v1
- The paper
- Kovalerchuk, B. (2024). Interpretable AI/ML for High-stakes Tasks with Human-in-the-loop: Critical Review and Future Trends. Research Square. https://doi.org/10.21203/rs.3.rs-3989807/v1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.