Cited by 43AI in cancer detectionExplainable Artificial Intelligence (XAI)Breast Lesions and Carcinomas

One step further into the blackbox: A pilot study of how to build more confidence around an AI-based decision system of breast nodule assessment in 2D ultrasound

Dong, Fajin, She, Ruilian, Cui, Chen, Shi, Siyuan, Hu, Xuqiao, Zeng, Jieying, Wu, Huaiyu, Xu, Jinfeng +1 more·2021·European Radiology

Abstract

Objectives To investigate how a DL model makes decisions in lesion classification with a newly defined region of evidence (ROE) by incorporating "explainable AI" (xAI) techniques.Methods A data set of 785 2D breast ultrasound images acquired from 367 females. The DenseNet-121 was used to classify whether the lesion is benign or malignant. For performance assessment, classification results are evaluated by calculating accuracy, sensitivity, specificity, and receiver operating characteristic for experiments of both coarse and fine regions of interest (ROIs). The area under the curve (AUC) was evaluated, and the true-positive, false-positive, true-negative, and false-negative results with breakdown in high, medium, and low resemblance on test sets were also reported.Results The two models with coarse and fine ROIs of ultrasound images as input achieve an AUC of 0.899 and 0.869, respectively. The accuracy, sensitivity, and specificity of the model with coarse ROIs are 88.4%, 87.9%, and 89.2%, and with fine ROIs are 86.1%, 87.9%, and 83.8%, respectively. The DL model captures ROE with high resemblance of physicians' consideration as they assess the image.Conclusions We have demonstrated the effectiveness of using DenseNet to classify breast lesions with limited quantity of 2D grayscale ultrasound image data. We have also proposed a new ROE-based metric system that can help physicians and patients better understand how AI makes decisions in reading images, which can potentially be integrated as a part of evidence in early screening or triaging of patients undergoing breast ultrasound examinations.Key points • The two models with coarse and fine ROIs of ultrasound images as input achieve an AUC of 0.899 and 0.869, respectively. The accuracy, sensitivity, and specificity of the model with coarse ROIs are 88.4%, 87.9%, and 89.2%, and with fine ROIs are 86.1%, 87.9%, and 83.8%, respectively. • The first model with coarse ROIs is slightly better than the second model with fine ROIs according to these evaluation metrics. • The results from coarse ROI and fine ROI are consistent and the peripheral tissue is also an impact factor in breast lesion classification.

Integrity signals

Registry

Crossref · 10.1007/s00330-020-07561-7

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

1 of the 56 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Dong, F., She, R., Cui, C., Shi, S., Hu, X., Zeng, J., Wu, H., Xu, J., & Zhang, Y.
Affiliations
  • Shandong University (CN)
  • Jinan University (CN)
Corresponding author
  • Xu, Jinfeng
  • Zhang, Yun
Venue
European Radiology
Published
2021-01-06
Volume
31
Issue
7
Pages
4991-5000
ISSN
  • 0938-7994 (ISSN-L)
  • 1432-1084
OpenAlex
W3119612737
Cited by
43
References
56
Citations by year
2026: 2 · 2025: 10 · 2024: 12 · 2023: 8 · 2022: 7 · 2021: 4
FWCI
2.72
Type
journal article
Language
en
Open access
closed
Locations
  • European Radiology (publishedVersion)
  • PubMed (publishedVersion)
Funders
Medical Science and Technology Research Foundation of Guangdong (B2019045)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Health Sciences › Medicine › Pathology and Forensic Medicine › Breast Lesions and Carcinomas
Keywords
breast ultrasound, explainable AI, DenseNet121, deep learning, benign versus malignant breast lesions, transparency in decision-making
MeSH terms
Artificial Intelligence, Breast, Breast Neoplasms, Female, Humans, Pilot Projects, Sensitivity and Specificity, Ultrasonography

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review