Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.

An explainable deep-learning algorithm for the detection of acute intracranial haemorrhage from small datasets

Abstract

Owing to improvements in image recognition via deep learning, machine-learning algorithms could eventually be applied to automated medical diagnoses that can guide clinical decision-making. However, these algorithms remain a 'black box' in terms of how they generate the predictions from the input data. Also, high-performance deep learning requires large, high-quality training datasets. Here, we report the development of an understandable deep-learning system that detects acute intracranial haemorrhage (ICH) and classifies five ICH subtypes from unenhanced head computed-tomography scans. By using a dataset of only 904 cases for algorithm training, the system achieved a performance similar to that of expert radiologists in two independent test datasets containing 200 cases (sensitivity of 98% and specificity of 95%) and 196 cases (sensitivity of 92% and specificity of 95%). The system includes an attention map and a prediction basis retrieved from training data to enhance explainability, and an iterative process that mimics the workflow of radiologists. Our approach to algorithm development can facilitate the development of deep-learning systems for a variety of clinical applications and accelerate their adoption into clinical practice.

Overview

Integrity signals

Registry

Crossref · 10.1038/s41551-018-0324-9

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 35 references

Research works printed but not linked: 6

  1. Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition. Preprint at https://arxiv.org/abs/1409.1556 (2014). · arXiv
  2. Sozykin, K., Khan, A. M., Protasov, S. & Hussain, R. Multi-label class-imbalanced action recognition in hockey videos via 3D convolutional neural networks. Preprint at https://arxiv.org/abs/1709.01421 (2017). · DOI
  3. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A. & Torralba, A. Object detectors emerge in deep scene cnns. Preprint at https://arxiv.org/abs/1412.6856 (2014). · arXiv
  4. Yosinski, J., Clune, J., Nguyen, A., Fuchs, T. & Lipson, H. Understanding neural networks through deep visualization. Preprint at https://arxiv.org/abs/1506.06579 (2015). · arXiv
  5. Lin, M., Chen, Q. & Yan, S. Network in network. Preprint at https://arxiv.org/abs/1312.4400 (2013). · arXiv
  6. Nesterov, Y. A method of solving the convex programming problem with convergence rate O(1/k 2). Dokl. Akad. Nauk USSR 269, 543–547 (1983).

Cited by

See all 441

Metadata

Authors
Lee, H., Yune, S., Mansouri, M., Kim, M., Tajmir, S. H., Guerrier, C. E., Ebert, S. A., Pomerantz, S. R., Romero, J. M., Kamalian, S., Gonzalez, R. G., Lev, M. H., & Do, S.
Affiliations
  • Harvard University (US)
  • Massachusetts General Hospital (US)
Corresponding author
Do, Synho
Venue
Nature Biomedical Engineering
Published
2018-12-17
Volume
3
Issue
3
Pages
173-182
ISSN
2157-846X (ISSN-L)
OpenAlex
W2905307056
Cited by
441
References
35
Citations by year
2026: 17 · 2025: 34 · 2024: 55 · 2023: 71 · 2022: 89 · 2021: 86 · 2020: 64 · 2019: 23 · 2018: 1
FWCI
29.31
Type
journal article
Language
en
Open access
closed
Licence
Locations
  • Nature Biomedical Engineering (publishedVersion)
  • PubMed (publishedVersion)
  • Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion)
Funders
  • Nvidia
  • National Institutes of Health
  • National Institute of Biomedical Imaging and Bioengineering (U01EB025153)
Topics
  • Health Sciences › Medicine › Clinical Neurology › Intracerebral and Subarachnoid Hemorrhage Research
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
deep learning, explainable AI, attention maps, limited training data, automated medical diagnosis, clinical decision support
MeSH terms
Deep Learning, Acute Disease, Algorithms, Databases as Topic, Intracranial Hemorrhages

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: An explainable deep-learning algorithm for the detection of acute intracranial haemorrhage from small datasets. https://app.cochat.ai/papers/10.1038/s41551-018-0324-9
The paper
Lee, H., Yune, S., Mansouri, M., Kim, M., Tajmir, S. H., Guerrier, C. E., Ebert, S. A., Pomerantz, S. R., Romero, J. M., Kamalian, S., Gonzalez, R. G., Lev, M. H., & Do, S. (2018). An explainable deep-learning algorithm for the detection of acute intracranial haemorrhage from small datasets. Nature Biomedical Engineering. https://doi.org/10.1038/s41551-018-0324-9

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.