Cited by 635Explainable Artificial Intelligence (XAI)Artificial Intelligence in HealthcareArtificial Intelligence in Healthcare and Education

The importance of interpretability and visualization in machine learning for applications in medicine and health care

Open access
Vellido, Alfredo·2020·Neural Computing and Applications

Abstract

In a short period of time, many areas of science have made a sharp transition towards data-dependent methods. In some cases, this process has been enabled by simultaneous advances in data acquisition and the development of networked system technologies. This new situation is particularly clear in the life sciences, where data overabundance has sparked a flurry of new methodologies for data management and analysis. This can be seen as a perfect scenario for the use of machine learning and computational intelligence techniques to address problems in which more traditional data analysis approaches might struggle. But, this scenario also poses some serious challenges. One of them is model interpretability and explainability, especially for complex nonlinear models. In some areas such as medicine and health care, not addressing such challenge might seriously limit the chances of adoption, in real practice, of computer-based systems that rely on machine learning and computational intelligence methods for data analysis. In this paper, we reflect on recent investigations about the interpretability and explainability of machine learning methods and discuss their impact on medicine and health care. We pay specific attention to one of the ways in which interpretability and explainability in this context can be addressed, which is through data and model visualization. We argue that, beyond improving model interpretability as a goal in itself, we need to integrate the medical experts in the design of data analysis interpretation strategies. Otherwise, machine learning is unlikely to become a part of routine clinical and health care practice.

Integrity signals

Registry

Crossref · 10.1007/s00521-019-04051-w

Cites

70 of 70 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Vellido, A.
Affiliations
Universitat Politècnica de Catalunya (ES)
Corresponding author
Vellido, Alfredo
Venue
Neural Computing and Applications
Published
2019-02-04
Volume
32
Issue
24
Pages
18069-18083
ISSN
  • 0941-0643 (ISSN-L)
  • 1433-3058
OpenAlex
W2913240367
Cited by
635
References
70
Citations by year
2026: 65 · 2025: 117 · 2024: 133 · 2023: 106 · 2022: 105 · 2021: 81 · 2020: 22 · 2019: 6
FWCI
24.41
Type
journal article
Language
en
Open access
Locations
  • Neural Computing and Applications (publishedVersion)
  • LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (acceptedVersion, other-oa)
  • RECERCAT (Consorci de Serveis Universitaris de Catalunya) (acceptedVersion, other-oa)
  • UPCommons institutional repository (Universitat Politècnica de Catalunya) (submittedVersion, public-domain)
Funders
MINECO (TIN2016-79576-R)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
model interpretability, explainability, data visualization, machine learning in medicine, health care, nonlinear models, computational intelligence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review