The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Clinician-informed XAI evaluation checklist with metrics (CLIX-M) for AI-powered clinical decision support systems
Open accessAbstract
The rapid growth of clinical explainable AI (XAI) models raised concerns over unclear purposes and false hope regarding explanations. Currently, no standardised metrics exist for XAI evaluation. We developed a clinician-informed, 14-item checklist including clinical, machine and decision attributes. This is the first step toward XAI standardisation and transparent reporting XAI methods to enhance trust, reduce risks, foster AI adoption, and improve decisions to determine the true clinical potential of applied XAI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“it requires prospective validation in clinical settings before adoption as a reporting standard”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Brankovic et al., 2025
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“No validated instrument currently exists that captures both the technical fidelity of an explanation and its clinical relevance.”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Brankovic et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Tools designed to optimize computational metrics without attending to clinical, regulatory, and behavioral dimensions reproduce the same failures that have limited XAI adoption to date”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Brankovic et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Its implementation directly instantiates the CLIX-M checklist as an operational standard rather than an aspirational framework, providing the first proposal in the literature for building XAI quality standards into the AI pipeline as an architectural requirement rather than a post hoc audit step (Brankovic et al., 2025).”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Brankovic et al., 2025
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The CLIX-M checklist provides the most developed precedent (Brankovic et al., 2025), but its adaptation to specific clinical scenarios in oncology has not been conducted.”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Brankovic et al., 2025
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
RETRACTED: AI-Driven Decision-Making in Healthcare Information Systems: A Comprehensive Review
Amiri, Z., Taghavirashidizadeh, A., & Khorrami, P. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112470 · Cited by 12 · cited 1×
“Arti fi cial intelligence (AI)-supported clinical decision support systems (CDSS) are seen as a promising solution for improving ef fi ciency, accuracy, and cost-effectiveness in medical decision-making processes 1,2 .”
Retracted"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
From local explanations to global understanding with explainable AI for trees
Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-019-0138-9 · Cited by 10,551 · cited 1×
“While popular XAI methods (e.g., SHAP 35 , LIME 36 , etc.) show correlations between features and outcomes, they don ’ t establish causal relationships.”
Kuhn, M., & Johnson, K. (2013) · doi:10.1007/978-1-4614-6849-3 · Cited by 6,788 · cited 1×
“To quantify explanationof uncertainty and/or con fi dence intervals we recommend the following approaches used for calculating model con fi dence intervals 30 : Bootstrapping: Resampletheinputdata(e.g., 70%)andcomputeglobal explanations for each resampled dataset.”
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., et al. (2024) · BMJ · doi:10.1136/bmj-2023-078378 · Cited by 4,718 · cited 1×
“Several AI reporting checklists have come into widespread use, including TRIPOD 11 , TRIPOD + AI 12 , CLAIM 13 , to understand, evaluate, replicate, and apply the models appropriately.”
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0697 · Cited by 3,267
The false hope of current approaches to explainable artificial intelligence in health care
Ghassemi, M., Oakden-Rayner, L., & Beam, A. L. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00208-9 · Cited by 1,724 · cited 1×
“Evaluatingcases(truepositive(TP),false positive(FP),truenegative(TN),falsenegative(FN))couldhelpidentify sourcesofbiasormodelerrors 9,39 .”
Checklist for Artificial Intelligence in Medical Imaging (CLAIM): a guide for authors and reviewers
Mongan, J., Moy, L., & Kahn, C. E. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020200029 · Cited by 1,443
Boone, H., & Boone, D. (2012) · Journal of Extension · doi:10.34068/joe.50.02.48 · Cited by 1,407
Research works printed but not linked: 1
- Tonekaboni, S., Joshi, S., McCradden, M. D. & Goldenberg, A. What clinicians want: contextualizing explainable machine learning for clinical end use. In: Proceedings of the 4th machine learning for healthcare conference 359–380 (PMLR, 2019).
Cited by
Liquid biopsies across the cancer care continuum
Landon, B. V., Annapragada, A. V., Niknafs, N., Velculescu, V. E., & Anagnostou, V. (2025) · Nature Medicine · doi:10.1038/s41591-025-04093-9 · Cited by 67
“Explainable AI frameworks would mitigate concerns surrounding the use of ‘black-box’ models in clinical decision-making 190 , while large language models may be useful in interpreting and explaining genomic testing readouts, assessing risk and eligibility for liquid biopsy screening, or mining…”
Gangwal, A., & Lavecchia, A. (2026) · Computer Science Review · doi:10.1016/j.cosrev.2026.100943 · Cited by 23
Van Dort, B. A., Engelsma, T., Sneekes, P., Peute, L., & Medlock, S. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001417 · Cited by 9
“The XAI-evaluation checklist by Brankovic and colleagues [42] recommends assessing, reporting and discussing the actionability of explanations.”
Sardar, S., Dash, S., Roychowdhury, P., Solanki, J., Sikdar, P., Thangappan, J., & Dutta, S. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag269 · Cited by 13
“First, ‘cognitive overload’: high-dimensional SHAP outputs spanning thousands of k-mer or spectral features impose processing demands incompatible with time-pressured clinical work-flows; explanations may be skipped entirely or selectively engaged to confirm pre-existing judgment [ 101].”
Czerwinski, A., Kucharski, D., Wijata, A. M., Aldosari, H., Coenen, F., Gupta, D., Fu, L., Lin, W., Xue, Y., Kawa, J., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01932-4 · Cited by 13
“Incorporating a human in the explainable AI loop is key in accelerating such approaches in various fi elds 24 , with medicine beingaprominentexample,wheretransparentandstandardizedreportingof XAIoutcomesbecamecrucial 25 .”
Metadata
- Authors
- Brankovic, A., Cook, D., Rahman, J., Delaforce, A., Li, J., Magrabi, F., Cabitza, F., Coiera, E., & Bradford, D.
- Affiliations
- Commonwealth Scientific and Industrial Research Organisation (AU)
- Princess Alexandra Hospital (AU)
- Macquarie University (AU)
- IRCCS Ospedale Galeazzi - Sant'Ambrogio (IT)
- Corresponding author
- Brankovic, Aida
- ORCID
- Venue
- npj Digital Medicine
- Published
- 2025-06-14
- Volume
- 8
- Issue
- 1
- Pages
- 364-364
- ISSN
- 2398-6352 (ISSN-L)
- PMC
- PMC12167368
- OpenAlex
- W4411300345
- Cited by
- 37
- References
- 33
- Citations by year
- 2026: 32 · 2025: 5
- FWCI
- 3.51
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- npj Digital Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- BOA (University of Milano-Bicocca) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Commonwealth Scientific and Industrial Research Organisation
- Australian e-Health Research Centre
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- XAI evaluation, evaluation metrics, clinical decision support systems, reporting transparency, trust in AI, clinical implementation of AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Clinician-informed XAI evaluation checklist with metrics (CLIX-M) for AI-powered clinical decision support systems. https://app.cochat.ai/papers/10.1038/s41746-025-01764-2
- The paper
- Brankovic, A., Cook, D., Rahman, J., Delaforce, A., Li, J., Magrabi, F., Cabitza, F., Coiera, E., & Bradford, D. (2025). Clinician-informed XAI evaluation checklist with metrics (CLIX-M) for AI-powered clinical decision support systems. npj Digital Medicine. https://doi.org/10.1038/s41746-025-01764-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.