Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 207

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

External validation of a convolutional neural network artificial intelligence tool to predict malignancy in pulmonary nodules

Open access
Baldwin, David R, Gustafson, Jennifer, Pickup, Lyndsey, Arteta, Carlos, Novotny, Petr, Declerck, Jerome, Kadir, Timor, Figueiras, Catarina, Sterba, Albert, Exell, Alan, Potesil, Vaclav, Holland, Paul, Spence, Hazel, Clubley, Alison, O'Dowd, Emma, Clark, Matthew, Ashford-Turner, Victoria, Callister, Matthew EJ, Gleeson, Fergus V · 2020 · Thorax

Abstract

Background: Estimation of the risk of malignancy in pulmonary nodules detected by CT is central in clinical management. The use of artificial intelligence (AI) offers an opportunity to improve risk prediction. Here we compare the performance of an AI algorithm, the lung cancer prediction convolutional neural network (LCP-CNN), with that of the Brock University model, recommended in UK guidelines. Methods: A dataset of incidentally detected pulmonary nodules measuring 5–15 mm was collected retrospectively from three UK hospitals for use in a validation study. Ground truth diagnosis for each nodule was based on histology (required for any cancer), resolution, stability or (for pulmonary lymph nodes only) expert opinion. There were 1397 nodules in 1187 patients, of which 234 nodules in 229 (19.3%) patients were cancer. Model discrimination and performance statistics at predefined score thresholds were compared between the Brock model and the LCP-CNN. Results: The area under the curve for LCP-CNN was 89.6% (95% CI 87.6 to 91.5), compared with 86.8% (95% CI 84.3 to 89.1) for the Brock model (p≤0.005). Using the LCP-CNN, we found that 24.5% of nodules scored below the lowest cancer nodule score, compared with 10.9% using the Brock score. Using the predefined thresholds, we found that the LCP-CNN gave one false negative (0.4% of cancers), whereas the Brock model gave six (2.5%), while specificity statistics were similar between the two models. Conclusion: The LCP-CNN score has better discrimination and allows a larger proportion of benign nodules to be identified without missing cancers than the Brock model. This has the potential to substantially reduce the proportion of surveillance CT scans required and thus save significant resources.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/thoraxjnl-2019-214104

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Research works printed but not linked: 12

  1. Callister, 2015, British thoracic Society guidelines for the investigation and management of pulmonary nodules, Thorax, 70(Suppl 2), ii1, 10.1136/thoraxjnl-2015-207168 · DOI · Paper page
  2. 10.1097/JTO.0000000000000559 · DOI · Paper page
  3. 10.1056/NEJMoa1214726 · DOI · Paper page
  4. van Riel, 2017, Malignancy risk estimation of screen-detected nodules at baseline CT: comparison of the PanCan model, Lung-RADS and NCCN guidelines, Eur Radiol, 27, 4019, 10.1007/s00330-017-4767-2 · doi:10.1007/s00330-017-4767-2
  5. Winkler Wille, 2015, Predictive accuracy of the PanCan lung cancer risk prediction model -external validation based on CT from the Danish lung cancer screening trial, Eur Radiol, 25, 3093, 10.1007/s00330-015-3689-0 · DOI
  6. 10.1016/j.lungcan.2015.03.018 · DOI · Paper page
  7. 10.1097/RTI.0b013e31824f83e1 · DOI
  8. 10.1148/radiol.2312030167 · DOI · Paper page
  9. Huang G , Liu Z , Lvd M , eds. Densely connected Convolutional networks. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017 , 21-26 July 2017. · DOI · Paper page
  10. Oke, 2018, Development and validation of clinical prediction models to risk stratify patients presenting with small pulmonary nodules: a research protocol, Diagn Progn Res, 2, 22, 10.1186/s41512-018-0044-3 · DOI
  11. Efron BTR . An introduction to the bootstrap. New York: Chapman and Hall, 1993. · DOI · Paper page
  12. 10.1016/S1470-2045(14)70389-4 · DOI · Paper page

Cited by

See all 207

Metadata

Authors
Baldwin, D. R., Gustafson, J., Pickup, L., Arteta, C., Novotny, P., Declerck, J., Kadir, T., Figueiras, C., Sterba, A., Exell, A., Potesil, V., Holland, P., Spence, H., Clubley, A., O'Dowd, E., Clark, M., Ashford-Turner, V., Callister, M. E., & Gleeson, F. V.
Venue
Thorax
Publisher
BMJ
Published
2020-03-05
Volume
75
Issue
4
Pages
306-312
ISSN
  • 0040-6376 (ISSN-L)
  • 1468-3296
OpenAlex
W3010442991
Cited by
207
References
3
FWCI
13.79
Type
journal article
Language
en
Open access
hybrid
Funders
National Institute for Health Research (II-LB-0716-20006)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: External validation of a convolutional neural network artificial intelligence tool to predict malignancy in pulmonary nodules. https://app.cochat.ai/papers/10.1136/thoraxjnl-2019-214104
The paper
Baldwin, D. R., Gustafson, J., Pickup, L., Arteta, C., Novotny, P., Declerck, J., Kadir, T., Figueiras, C., Sterba, A., Exell, A., Potesil, V., Holland, P., Spence, H., Clubley, A., O'Dowd, E., Clark, M., Ashford-Turner, V., Callister, M. E., & Gleeson, F. V. (2020). External validation of a convolutional neural network artificial intelligence tool to predict malignancy in pulmonary nodules. Thorax. https://doi.org/10.1136/thoraxjnl-2019-214104

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.