The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
External validation of a convolutional neural network artificial intelligence tool to predict malignancy in pulmonary nodules
Open accessAbstract
Background: Estimation of the risk of malignancy in pulmonary nodules detected by CT is central in clinical management. The use of artificial intelligence (AI) offers an opportunity to improve risk prediction. Here we compare the performance of an AI algorithm, the lung cancer prediction convolutional neural network (LCP-CNN), with that of the Brock University model, recommended in UK guidelines. Methods: A dataset of incidentally detected pulmonary nodules measuring 5–15 mm was collected retrospectively from three UK hospitals for use in a validation study. Ground truth diagnosis for each nodule was based on histology (required for any cancer), resolution, stability or (for pulmonary lymph nodes only) expert opinion. There were 1397 nodules in 1187 patients, of which 234 nodules in 229 (19.3%) patients were cancer. Model discrimination and performance statistics at predefined score thresholds were compared between the Brock model and the LCP-CNN. Results: The area under the curve for LCP-CNN was 89.6% (95% CI 87.6 to 91.5), compared with 86.8% (95% CI 84.3 to 89.1) for the Brock model (p≤0.005). Using the LCP-CNN, we found that 24.5% of nodules scored below the lowest cancer nodule score, compared with 10.9% using the Brock score. Using the predefined thresholds, we found that the LCP-CNN gave one false negative (0.4% of cancers), whereas the Brock model gave six (2.5%), while specificity statistics were similar between the two models. Conclusion: The LCP-CNN score has better discrimination and allows a larger proportion of benign nodules to be identified without missing cancers than the Brock model. This has the potential to substantially reduce the proportion of surveillance CT scans required and thus save significant resources.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening
The National Lung Screening Trial Research Team (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1102873 · Cited by 11,064
MacMahon, H., Naidich, D. P., Goo, J. M., Lee, K. S., Leung, A. N. C., Mayo, J. R., Mehta, A. C., Ohno, Y., Powell, C. A., Prokop, M., et al. (2017) · Radiology · doi:10.1148/radiol.2017161659 · Cited by 2,491
Research works printed but not linked: 12
- Callister, 2015, British thoracic Society guidelines for the investigation and management of pulmonary nodules, Thorax, 70(Suppl 2), ii1, 10.1136/thoraxjnl-2015-207168 · DOI · Paper page
- 10.1097/JTO.0000000000000559 · DOI · Paper page
- 10.1056/NEJMoa1214726 · DOI · Paper page
- van Riel, 2017, Malignancy risk estimation of screen-detected nodules at baseline CT: comparison of the PanCan model, Lung-RADS and NCCN guidelines, Eur Radiol, 27, 4019, 10.1007/s00330-017-4767-2 · doi:10.1007/s00330-017-4767-2
- Winkler Wille, 2015, Predictive accuracy of the PanCan lung cancer risk prediction model -external validation based on CT from the Danish lung cancer screening trial, Eur Radiol, 25, 3093, 10.1007/s00330-015-3689-0 · DOI
- 10.1016/j.lungcan.2015.03.018 · DOI · Paper page
- 10.1097/RTI.0b013e31824f83e1 · DOI
- 10.1148/radiol.2312030167 · DOI · Paper page
- Huang G , Liu Z , Lvd M , eds. Densely connected Convolutional networks. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017 , 21-26 July 2017. · DOI · Paper page
- Oke, 2018, Development and validation of clinical prediction models to risk stratify patients presenting with small pulmonary nodules: a research protocol, Diagn Progn Res, 2, 22, 10.1186/s41512-018-0044-3 · DOI
- Efron BTR . An introduction to the bootstrap. New York: Chapman and Hall, 1993. · DOI · Paper page
- 10.1016/S1470-2045(14)70389-4 · DOI · Paper page
Cited by
Swanson, K., Wu, E., Zhang, A., Alizadeh, A. A., & Zou, J. (2023) · Cell · doi:10.1016/j.cell.2023.01.035 · Cited by 597
Lung cancer LDCT screening and mortality reduction — evidence, pitfalls and future perspectives
Oudkerk, M., Liu, S., Heuvelmans, M. A., Walter, J. E., & Field, J. K. (2021) · Nature Reviews Clinical Oncology · doi:10.1038/s41571-020-00432-6 · Cited by 519
Adams, S. J., Stone, E., Baldwin, D. R., Vliegenthart, R., Lee, P., & Fintelmann, F. J. (2023) · The Lancet · doi:10.1016/s0140-6736(22)01694-4 · Cited by 467
Self-citationAdenocarcinoma spectrum lesions of the lung: Detection, pathology and treatment strategies
Succony, L., Rassl, D., Barker, A., McCaughan, F., & Rintoul, R. (2021) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2021.102237 · Cited by 342
The Role of Artificial Intelligence in Early Cancer Diagnosis
Hunter, B., Hindocha, S., & Lee, R. W. (2022) · Cancers · doi:10.3390/cancers14061524 · Cited by 332
Metadata
- Authors
- Baldwin, D. R., Gustafson, J., Pickup, L., Arteta, C., Novotny, P., Declerck, J., Kadir, T., Figueiras, C., Sterba, A., Exell, A., Potesil, V., Holland, P., Spence, H., Clubley, A., O'Dowd, E., Clark, M., Ashford-Turner, V., Callister, M. E., & Gleeson, F. V.
- Venue
- Thorax
- Publisher
- BMJ
- Published
- 2020-03-05
- Volume
- 75
- Issue
- 4
- Pages
- 306-312
- ISSN
- 0040-6376 (ISSN-L)
- 1468-3296
- OpenAlex
- W3010442991
- Cited by
- 207
- References
- 3
- FWCI
- 13.79
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- National Institute for Health Research (II-LB-0716-20006)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: External validation of a convolutional neural network artificial intelligence tool to predict malignancy in pulmonary nodules. https://app.cochat.ai/papers/10.1136/thoraxjnl-2019-214104
- The paper
- Baldwin, D. R., Gustafson, J., Pickup, L., Arteta, C., Novotny, P., Declerck, J., Kadir, T., Figueiras, C., Sterba, A., Exell, A., Potesil, V., Holland, P., Spence, H., Clubley, A., O'Dowd, E., Clark, M., Ashford-Turner, V., Callister, M. E., & Gleeson, F. V. (2020). External validation of a convolutional neural network artificial intelligence tool to predict malignancy in pulmonary nodules. Thorax. https://doi.org/10.1136/thoraxjnl-2019-214104
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.