Evaluating a Fully Automated Pulmonary Nodule Detection Approach and Its Impact on Radiologist Performance
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
PURPOSE: To compare sensitivity in the detection of lung nodules between the deep learning (DL) model and radiologists using various patient population and scanning parameters and to assess whether the radiologists' detection performance could be enhanced when using the DL model for assistance. MATERIALS AND METHODS: A total of 12 754 thin-section chest CT scans from January 2012 to June 2017 were retrospectively collected for DL model training, validation, and testing. Pulmonary nodules from these scans were categorized into four types: solid, subsolid, calcified, and pleural. The testing dataset was divided into three cohorts based on radiation dose, patient age, and CT manufacturer. Detection performance of the DL model was analyzed by using a free-response receiver operating characteristic curve. Sensitivities of the DL model and radiologists were compared by using exploratory data analysis. False-positive detection rates of the DL model were compared within each cohort. Detection performance of the same radiologist with and without the DL model were compared by using nodule-level sensitivity and patient-level localization receiver operating characteristic curves. RESULTS: The DL model showed elevated overall sensitivity compared with manual review of pulmonary nodules. No significant dependence regarding radiation dose, patient age range, or CT manufacturer was observed. The sensitivity of the junior radiologist was significantly dependent on patient age. When radiologists used the DL model for assistance, their performance improved and reading time was reduced. CONCLUSION: DL shows promise to enhance the identification of pulmonary nodules and benefit nodule management.© RSNA, 2019
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening
The National Lung Screening Trial Research Team (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1102873 · Cited by 11,064
Elasticity of human lungs in relation to age
Turner, J. M., Mead, J., & Wohl, M. E. (1968) · Journal of Applied Physiology · doi:10.1152/jappl.1968.25.6.664 · Cited by 524 · cited 1×
“Since pulmonary structure and texture are age dependent, which might affect lung nodule detection (24,25), the test data were empirically stratified into three groups based on patient age: younger than 30 years, 31–60 years, and older than 61 years.”
MethodLow-Dose CT Screening for Lung Cancer: Computer-aided Detection of Missed Lung Cancers
Liang, M., Tang, W., Xu, D. M., Jirapatnakul, A. C., Reeves, A. P., Henschke, C. I., & Yankelevitz, D. (2016) · Radiology · doi:10.1148/radiol.2016150063 · Cited by 154
Cited by
Lung cancer LDCT screening and mortality reduction — evidence, pitfalls and future perspectives
Oudkerk, M., Liu, S., Heuvelmans, M. A., Walter, J. E., & Field, J. K. (2021) · Nature Reviews Clinical Oncology · doi:10.1038/s41571-020-00432-6 · Cited by 519
Self-citationArtificial intelligence and machine learning in cancer imaging
Koh, D.-M., Papanikolaou, N., Bick, U., Illing, R., Kahn, C. E., Kalpathi-Cramer, J., Matos, C., Martí-Bonmatí, L., Miles, A., Mun, S. K., et al. (2022) · Communications Medicine · doi:10.1038/s43856-022-00199-0 · Cited by 311
Rajpurkar, P., O’Connell, C., Schechter, A., Asnani, N., Li, J., Kiani, A., Ball, R. L., Mendelson, M., Maartens, G., van Hoving, D. J., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00322-2 · Cited by 137
Liu, M., Wu, J., Wang, N., Zhang, X., Bai, Y., Guo, J., Zhang, L., Liu, S., & Tao, K. (2023) · PLOS ONE · doi:10.1371/journal.pone.0273445 · Cited by 84
Self-citationLi, D., Pehrson, L. M., Lauridsen, C. A., Tøttrup, L., Fraccaro, M., Elliott, D., Zając, H. D., Darkner, S., Carlsen, J. F., & Nielsen, M. B. (2021) · Diagnostics · doi:10.3390/diagnostics11122206 · Cited by 35
Metadata
- Authors
- Liu, K., Li, Q., Ma, J., Zhou, Z., Sun, M., Deng, Y., Tu, W., Wang, Y., Fan, L., Xia, C., Xiao, Y., Zhang, R., & Liu, S.
- Venue
- Radiology: Artificial Intelligence
- Published
- 2019-05
- Volume
- 1
- Issue
- 3
- Pages
- e180084
- ISSN
- 2638-6100 (ISSN-L)
- OpenAlex
- W2947167326
- Cited by
- 110
- References
- 4
- FWCI
- 7.25
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating a Fully Automated Pulmonary Nodule Detection Approach and Its Impact on Radiologist Performance. https://app.cochat.ai/papers/10.1148/ryai.2019180084
- The paper
- Liu, K., Li, Q., Ma, J., Zhou, Z., Sun, M., Deng, Y., Tu, W., Wang, Y., Fan, L., Xia, C., Xiao, Y., Zhang, R., & Liu, S. (2019). Evaluating a Fully Automated Pulmonary Nodule Detection Approach and Its Impact on Radiologist Performance. Radiology: Artificial Intelligence. https://doi.org/10.1148/ryai.2019180084
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.