Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.

Assessment of Convolutional Neural Networks for Automated Classification of Chest Radiographs

Open access

Abstract

Purpose To assess the ability of convolutional neural networks (CNNs) to enable high-performance automated binary classification of chest radiographs. Materials and Methods In a retrospective study, 216 431 frontal chest radiographs obtained between 1998 and 2012 were procured, along with associated text reports and a prospective label from the attending radiologist. This data set was used to train CNNs to classify chest radiographs as normal or abnormal before evaluation on a held-out set of 533 images hand-labeled by expert radiologists. The effects of development set size, training set size, initialization strategy, and network architecture on end performance were assessed by using standard binary classification metrics; detailed error analysis, including visualization of CNN activations, was also performed. Results Average area under the receiver operating characteristic curve (AUC) was 0.96 for a CNN trained with 200 000 images. This AUC value was greater than that observed when the same model was trained with 2000 images (AUC = 0.84, P < .005) but was not significantly different from that observed when the model was trained with 20 000 images (AUC = 0.95, P > .05). Averaging the CNN output score with the binary prospective label yielded the best-performing classifier, with an AUC of 0.98 (P < .005). Analysis of specific radiographs revealed that the model was heavily influenced by clinically relevant spatial regions but did not reliably generalize beyond thoracic disease. Conclusion CNNs trained with a modestly sized collection of prospectively labeled chest radiographs achieved high diagnostic performance in the classification of chest radiographs as normal or abnormal; this function may be useful for automated prioritization of abnormal chest radiographs. © RSNA, 2018 Online supplemental material is available for this article. See also the editorial by van Ginneken in this issue.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1148/radiol.2018181422

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 24 references

Research works printed but not linked: 12

  1. Rosman DA, 2015, J Glob Radiol, 1, 6
  2. Ali FS, 2015, J Glob Radiol, 1, 6
  3. Deng J, 2009, In: IEEE CVPR, 248
  4. Hua KL, 2015, OncoTargets Ther, 8, 2015
  5. Anavi Y, 2015, IEEE, 2940
  6. Wang X, 2017, IEEE CVPR, 3462
  7. Davies ER. Computer and machine vision: theory, algorithms, practicalities. Waltham, Mass: Academic Press/Elsevier, 2012.
  8. He K, 2016, IEEE CVPR, 770
  9. Huang G, 2017, IEEE CVPR, 3, 4700
  10. Zhou B, 2016, In: IEEE CVPR, 2921
  11. Ratner A, 2016, Adv Neural Inf Process Syst, 29, 3567
  12. Kingma DP, 2015, In: International Conference on Learning Representations

Cited by

See all 206

Metadata

Authors
Dunnmon, J. A., Yi, D., Langlotz, C. P., Ré, C., Rubin, D. L., & Lungren, M. P.
Affiliations
Stanford University (US)
Venue
Radiology
Published
2019-02
Volume
290
Issue
2
Pages
537-544
ISSN
  • 0033-8419 (ISSN-L)
  • 1527-1315
OpenAlex
W2901782819
Cited by
206
References
24
Citations by year
2026: 4 · 2025: 16 · 2024: 24 · 2023: 38 · 2022: 26 · 2021: 39 · 2020: 37 · 2019: 20
FWCI
16.73
Type
journal article
Language
en
Open access
Locations
  • Radiology (publishedVersion)
  • PubMed Central (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • Intelligence Community Postdoctoral Research Fellowship Program
  • National Institutes of Health (1U01CA187947, 1U01CA190214, U01CA142555)
  • National Cancer Institute
  • Office of Naval Research (N000141712266)
  • Defense Advanced Research Projects Agency (FA87501720095)
Topics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
Keywords
convolutional neural networks, chest radiograph, automatic classification, normal vs abnormal classification, training data size, network architecture, activation visualization, error analysis, chest diseases
MeSH terms
Radiologists, Female, Humans, Lung, Male, Radiographic Image Interpretation, Computer-Assisted, Retrospective Studies, ROC Curve, Radiography, Thoracic, Neural Networks, Computer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Assessment of Convolutional Neural Networks for Automated Classification of Chest Radiographs. https://app.cochat.ai/papers/10.1148/radiol.2018181422
The paper
Dunnmon, J. A., Yi, D., Langlotz, C. P., Ré, C., Rubin, D. L., & Lungren, M. P. (2019). Assessment of Convolutional Neural Networks for Automated Classification of Chest Radiographs. Radiology. https://doi.org/10.1148/radiol.2018181422

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.