Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 1 of the 128 references it cites were found in a registry or an index, and 127 are not checked yet; 14 of the 73 sources its claims cite were checked for support.

Explainable and Interpretable AI for Voice and Speech Analysis in Clinical Care: Systematic Review

Open access
Ebraheem, Mohamed, Toghranegar, Jamie, Bridge2AI-Voice Consortium, Bensoussan, Yael, Templeton, John Michael · 2026 · Journal of Medical Internet Research

Abstract

Background: Driven by recent advances in artificial intelligence (AI), particularly in medicine, audio-based voice and speech biomarkers are increasingly investigated for various medical applications as a complementary or even alternative modality to traditional medical devices. The adoption of deep learning techniques in recent literature is motivated by their superior performance compared to classical machine learning methods. However, ethical and regulatory concerns regarding the black-box nature of these models have limited their integration into clinical workflows. Consequently, explainable artificial intelligence (XAI) has recently been used to address this issue by generating explanations for opaque model outputs. Ideally, medical XAI systems aim to provide human-understandable, clinically grounded explanations essential for enhanced AI trustworthiness and, thereby, facilitate adoption into real-world clinical settings. Objective: We conduct a systematic literature review of XAI methods applied for explaining deep learning techniques in audio-based voice and speech clinical applications. We aim to identify what XAI methods have been used to explain the decisions of deep learning voice and speech AI systems in health care, as well as XAI-informed insights. Additionally, we aim to contextualize these findings with respect to clinical applicability and stakeholder relevance. Lastly, we identify opportunities and recommendations for future clinical audio XAI design. Methods: We used PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). Six electronic databases (IEEE Xplore, ACM Digital Library, Scopus, PubMed, Web of Science, and Nature) were searched for papers published between January 2015 and February 2025. Eligible studies applied explainability or interpretability methods to deep learning models for voice or speech audio in health care contexts. Risk of bias was assessed using PROBAST+AI (Prediction Model Risk of Bias Assessment Tool). The results were thematically synthesized across explainability categories, input representations, clinical domains, validation strategies, and stakeholder considerations. Results: A total of 30 studies met the inclusion criteria. These studies used a range of explainability approaches, including gradient-based methods, perturbation-based techniques, surrogate model–based methods, model-internal representation analyses, concept-based detectors, and attention-based explanations. Applications spanned diverse clinical domains, including voice disorders, neurodegenerative diseases, psychiatric conditions, and traumatic brain injury. Overall, results indicate that most studies relied primarily on qualitative interpretation of explainability outputs, with limited quantitative validation of explanation consistency across external datasets. Furthermore, none of the included studies explicitly conducted human-in-the-loop evaluations with relevant stakeholders, highlighting a substantial gap in stakeholder alignment. Conclusions: Current XAI practices in clinical voice and speech analysis are limited by insufficient validation, lack of domain-specific design, and misalignment with clinical stakeholder needs. This review highlights opportunities for developing validated, audio-aware, and stakeholder-centered XAI approaches to support trustworthy clinical deployment. Interpretation of these findings should consider limitations related to single-reviewer study selection, potential high-risk of bias, and the repeated use of benchmark datasets.

Verified 2026-10-11 · 127 references not checked yet

Overview

CoChat Summary

TL;DR

This systematic review found 30 studies on explainable/interpretable AI for clinical voice and speech analysis, covering a wide range of XAI methods and clinical domains. Overall, the literature used explanations mostly qualitatively, with limited quantitative validation and no explicit human-in-the-loop evaluation with relevant stakeholders.

Key findings

  • The review included 30 studies; all but 1 were published from 2020 onward. The studies spanned voice disorders, Parkinson disease, dementia/Alzheimer disease, psychiatric conditions, traumatic brain injury, aphasia, cleft palate hypernasality, head and neck cancer intelligibility, and autism spectrum disorder.
  • The most frequently used explainability approaches were gradient-based saliency methods, input perturbation techniques, and model-internal representation analysis; specifically, Grad-CAM appeared in 5 studies, gradient-based saliency methods in 7 studies, t-SNE in 9 studies, and ablation-based analysis in 9 studies.
  • Only 6/30 studies performed model-centric explainability validation using external data, and only 1 study used ground-truth/annotation-based verification; 10 studies relied only on qualitative interpretation and prior literature, and 12 studies reported explanations without quantitative analysis or qualitative literature comparison.
  • Risk-of-bias assessment found 20/25 (80%) of model-development studies had high quality concern, and 23/25 (92%) of model-evaluation studies had high risk of bias; 6 studies had data leakage, and none explicitly reported formal human-centered evaluation of explanations with clinicians, speech-language pathologists, or regulators.

Methods

  • Systematic review conducted according to PRISMA; a protocol was prepared but not registered.
  • Searched 6 databases (IEEE Xplore, ACM Digital Library, Scopus, PubMed, Web of Science, Nature) for papers published January 2015 to February 2025; retrieved 1426 records, removed 78 duplicates, and included 30 studies after full-text screening.
  • Eligible studies applied explainability/interpretability methods to deep learning models for voice or speech audio in health care; studies were thematically synthesized by explainability type, input/output representation, validation strategy, domain, and stakeholder considerations. Risk of bias was assessed with PROBAST+AI.

Limitations

  • The paper states that study selection and data extraction were conducted by a single reviewer, which may increase the risk of selection bias or missed studies.
  • The authors note that conclusions are constrained by the high risk of bias in many underlying models and by repeated use of the same benchmark datasets, raising the risk of circular validation; this is both stated by the paper and evident from the reported dataset reuse.
  • The review only covers studies published up to February 2025, so later studies are not included.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/83790

Cites

1 of 128 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1. PRISMA flowchart. DL: deep learning; ML: machine learning; NLP: natural language processing; PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses; XAI: explainable artificial intelligence.
Figure 1. PRISMA flowchart. DL: deep learning; ML: machine learning; NLP: natural language processing; PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses; XAI: explainable artificial intelligence.CC BY · PubMed Central
Figure 2. Although XAI aims to address the black-box issue of deep learning models, current XAI methods do not cater to the diverse expectations and needs of the different stakeholders. AI: artificial intelligence; XAI: explainable artificial intelligence.
Figure 2. Although XAI aims to address the black-box issue of deep learning models, current XAI methods do not cater to the diverse expectations and needs of the different stakeholders. AI: artificial intelligence; XAI: explainable artificial intelligence.CC BY · PubMed Central
Figure 3. The future of voice and speech XAI in health care lies in the integration of perceptually aligned explanation methods, robust evaluation frameworks, and stakeholder-centered design, enabling explanations that are both faithful to model behavior and meaningful in real-world clinical practice. XAI: explainable artificial intelligence.
Figure 3. The future of voice and speech XAI in health care lies in the integration of perceptually aligned explanation methods, robust evaluation frameworks, and stakeholder-centered design, enabling explanations that are both faithful to model behavior and meaningful in real-world clinical practice. XAI: explainable artificial intelligence.CC BY · PubMed Central

Verification

Claims the paper makes

9 Valid · 3 Not valid · 52 Not checked · 117 Own results and interpretations

103 more claims · 4 with their cited sources checked

Create a free account to see all 181 claims and to verify the 59 references still open.

See all claims — free account
  • Probably not a substantial claim. 42
  • It may state two separate claims as one. 43

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 126 references

Cited by

Still being checked.

Metadata

Authors
Ebraheem, M., Toghranegar, J., Bridge2AI-Voice Consortium, Bensoussan, Y., & Templeton, J. M.
Affiliations
University of South Florida (US)
Corresponding author
Ebraheem, Mohamed
Venue
Journal of Medical Internet Research
Published
2026-06-24
Volume
28
Pages
e83790-e83790
ISSN
1438-8871 (ISSN-L)
OpenAlex
W4414100850
Cited by
0
References
126
FWCI
0.00
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
Journal of Medical Internet Research (publishedVersion, cc-by)
Funders
  • National Institutes of Health (Bridge2AI)
  • Common Fund
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
Keywords
explainable AI, speech biomarkers, gradient-based explanation, attention-based explanations, surrogate models, neurodegenerative diseases, voice disorders, traumatic brain injury, psychiatric conditions, stakeholder alignment, clinical adoption of AI, human-in-the-loop evaluation, clinical workflow integration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.