Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks
Open accessThe DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Abstract
We propose a novel Computer-Aided Detection (CAD) system for pulmonary nodules using multi-view convolutional networks (ConvNets), for which discriminative features are automatically learnt from the training data. The network is fed with nodule candidates obtained by combining three candidate detectors specifically designed for solid, subsolid, and large nodules. For each candidate, a set of 2-D patches from differently oriented planes is extracted. The proposed architecture comprises multiple streams of 2-D ConvNets, for which the outputs are combined using a dedicated fusion method to get the final classification. Data augmentation and dropout are applied to avoid overfitting. On 888 scans of the publicly available LIDC-IDRI dataset, our method reaches high detection sensitivities of 85.4% and 90.1% at 1 and 4 false positives per scan, respectively. An additional evaluation on independent datasets from the ANODE09 challenge and DLCST is performed. We showed that the proposed multi-view ConvNets is highly suited to be used for false positive reduction of a CAD system.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“13 (refs. 63–75) studies validated algorithms on external data”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [71]
In the citing paper
“Deep learning methods generally adopt different methods to handle this 3D information. This can involve converting 3D volume data into 2D slices and combination of features from 2D and multi-view planes to benefit from the contextual information [87] [88].”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [88]
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
(2014) · Cited by 33,419
(2010) · Cited by 14,134
Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening
The National Lung Screening Trial Research Team (2011) · New England Journal of Medicine · doi:10.1056/nejmoa1102873 · Cited by 11,064
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Armato, S. G., McLennan, G., Bidaut, L., McNitt‐Gray, M. F., Meyer, C. R., Reeves, A. P., Zhao, B., Aberle, D. R., Henschke, C. I., Hoffman, E. A., et al. (2011) · Medical Physics · doi:10.1118/1.3528204 · Cited by 2,887
Medical Image Computing and Computer-Assisted Intervention
Yang, G., Hawkes, D. J., Rueckert, D., Noble, J. A., & Taylor, C. (2009) · Research Explorer (The University of Manchester) · Cited by 1,591
Multi-column deep neural network for traffic sign classification
Cireşan, D., Meier, U., Masci, J., & Schmidhuber, J. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.023 · Cited by 1,057
Theano: new features and speed improvements
Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I., Bergeron, A., Bouchard, N., Warde-Farley, D., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5590 · Cited by 1,005
Naidich, D. P., Bankier, A. A., MacMahon, H., Schaefer-Prokop, C. M., Pistolesi, M., Goo, J. M., Macchiarini, P., Crapo, J. D., Herold, C. J., Austin, J. H., et al. (2013) · Radiology · doi:10.1148/radiol.12120628 · Cited by 1,000
Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network
Prasoon, A., Petersen, K., Igel, C., Lauze, F., Dam, E., & Nielsen, M. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_31 · Cited by 582
Deep Learning Based Imaging Data Completion for Improved Brain Disease Diagnosis
Li, R., Zhang, W., Suk, H.-I., Wang, L., Li, J., Shen, D., & Ji, S. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10443-0_39 · Cited by 469
A new computationally efficient CAD system for pulmonary nodule detection in CT imagery
Messay, T., Hardie, R. C., & Rogers, S. K. (2010) · Medical Image Analysis · doi:10.1016/j.media.2010.02.004 · Cited by 439
Pedersen, J. H., Ashraf, H., Dirksen, A., Bach, K., Hansen, H., Toennesen, P., Thorsen, H., Brodersen, J., Skov, B. G., Døssing, M., et al. (2009) · Journal of Thoracic Oncology · doi:10.1097/jto.0b013e3181a0d98f · Cited by 434
Cruz-Roa, A. A., Arevalo Ovalle, J. E., Madabhushi, A., & González Osorio, F. A. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_50 · Cited by 403
Nodule management protocol of the NELSON randomised lung cancer screening trial
Xu, D. M., Gietema, H., de Koning, H., Vernhout, R., Nackaerts, K., Prokop, M., Weenink, C., Lammers, J.-W., Groen, H., Oudkerk, M., et al. (2006) · Lung Cancer · doi:10.1016/j.lungcan.2006.08.006 · Cited by 347
Murphy, K., van Ginneken, B., Schilham, A. M. R., de Hoop, B. J., Gietema, H. A., & Prokop, M. (2009) · Medical Image Analysis · doi:10.1016/j.media.2009.07.001 · Cited by 331
Artificial convolution neural network for medical image pattern recognition
Lo, S.-C. B., Chan, H.-P., Lin, J.-S., Li, H., Freedman, M. T., & Mun, S. K. (1995) · Neural Networks · doi:10.1016/0893-6080(95)00061-5 · Cited by 321
van Ginneken, B., Armato, S. G., de Hoop, B., van Amelsvoort-van de Vorst, S., Duindam, T., Niemeijer, M., Murphy, K., Schilham, A., Retico, A., Fantacci, M. E., et al. (2010) · Medical Image Analysis · doi:10.1016/j.media.2010.05.005 · Cited by 298
Kuhnigk, J.-M., Dicken, V., Bornemann, L., Bakai, A., Wormanns, D., Krass, S., & Peitgen, H.-O. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.871547 · Cited by 288
van Ginneken, B., Setio, A. A. A., Jacobs, C., & Ciompi, F. (2015) · 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2015.7163869 · Cited by 278
Self-citationAutomatic detection of subsolid pulmonary nodules in thoracic computed tomography images
Jacobs, C., van Rikxoort, E. M., Twellmann, T., Scholten, E. T., de Jong, P. A., Kuhnigk, J.-M., Oudkerk, M., de Koning, H. J., Prokop, M., Schaefer-Prokop, C., et al. (2014) · Medical Image Analysis · doi:10.1016/j.media.2013.12.001 · Cited by 262
Self-citationFirmino, M., de Morais, A. H. F., Mendoça, R. M., Ribeiro-Dantas, M. D. C., Hékis, H. R., & Valentim, R. A. D. M. (2014) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-13-41 · Cited by 161
Automatic detection of lung nodules in CT datasets based on stable 3D mass–spring models
Cascio, D., Magro, R., Fauci, F., Iacomi, M., & Raso, G. (2012) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2012.09.002 · Cited by 153
Zhao, Y., de Bock, G. H., Vliegenthart, R., van Klaveren, R. J., Wang, Y., Bogoni, L., de Jong, P. A., Mali, W. P. T. M., van Ooijen, P. M. A., & Oudkerk, M. (2012) · European Radiology · doi:10.1007/s00330-012-2437-y · Cited by 138
Automatic detection of large pulmonary solid nodules in thoracic CT images
Setio, A. A. A., Jacobs, C., Gelderblom, J., & van Ginneken, B. (2015) · Medical Physics · doi:10.1118/1.4929562 · Cited by 136
Self-citationOn Combining Computer-Aided Detection Systems
Niemeijer, M., Loog, M., Abràmoff, M. D., Viergever, M. A., Prokop, M., & van Ginneken, B. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2072789 · Cited by 131
Large scale validation of the M5L lung CAD on heterogeneous CT datasets
Torres, E. L., Fiorina, E., Pennazio, F., Peroni, C., Saletta, M., Camarlinghi, N., Fantacci, M. E., & Cerello, P. (2015) · Medical Physics · doi:10.1118/1.4907970 · Cited by 128
Fast lung nodule detection in chest CT images using cylindrical nodule-enhancement filter
Teramoto, A., & Fujita, H. (2012) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-012-0767-5 · Cited by 117
Choi, W., & Choi, T. (2013) · Entropy · doi:10.3390/e15020507 · Cited by 94
A novel multithreshold method for nodule detection in lung CT
Golosio, B., Masala, G. L., Piccioli, A., Oliva, P., Carpinelli, M., Cataldo, R., Cerello, P., Carlo, F. D., Falaschi, F., Fantacci, M. E., et al. (2009) · Medical Physics · doi:10.1118/1.3160107 · Cited by 86
Wille, M. M. W., van Riel, S. J., Saghir, Z., Dirksen, A., Pedersen, J. H., Jacobs, C., Thomsen, L. H., Scholten, E. T., Skovgaard, L. T., & van Ginneken, B. (2015) · European Radiology · doi:10.1007/s00330-015-3689-0 · Cited by 83
Self-citationThe Lung Reporting and Data System (LU-RADS): A Proposal for Computed Tomography Screening
Manos, D., Seely, J. M., Taylor, J. L., Borgaonkar, J. N., Roberts, H. C., & Mayo, J. R. (2014) · Canadian Association of Radiologists Journal · doi:10.1016/j.carj.2014.03.004 · Cited by 71
Toward clinically usable CAD for lung cancer screening with computed tomography
Brown, M. S., Lo, P., Goldin, J. G., Barnoy, E. A., Kim, G. H. J., McNitt‐Gray, M. F., & Aberle, D. R. (2014) · European Radiology · doi:10.1007/s00330-014-3329-0 · Cited by 63
Brosch, T., Yoo, Y., Li, D. K. B., Traboulsee, A. L., & Tam, R. C. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10470-6_58 · Cited by 59
Tan, M., Deklerck, R., Cornelis, J. P., & Jansen, B. (2013) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2013.07.002 · Cited by 28
Automated Detection of Small Pulmonary Nodules in Whole Lung CT Scans
Enquobahrie, A. A., Reeves, A. P., Yankelevitz, D. F., & Henschke, C. I. (2007) · Academic Radiology · doi:10.1016/j.acra.2007.01.029 · Cited by 28
High performance lung nodule detection schemes in CT using local and global information
Guo, W., & Li, Q. (2012) · Medical Physics · doi:10.1118/1.4737109 · Cited by 23
A voxel-based neural approach (VBNA) to identify lung nodules in the ANODE09 study
Retico, A., Bagagli, F., Camarlinghi, N., Carpentieri, C., Fantacci, M. E., & Gori, I. (2009) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.811721 · Cited by 12
Research works printed but not linked: 7
- tieleman, 2012, Lecture 6.5?RmsProp: Divide the gradient by a running average of its recent magnitude, COURSERA Neural Networks for Machine Learning
- cruz-roa, 2013, Medical Image Computing and Computer-Assisted Intervention, 8150, 403
- li, 2014, Medical Image Computing and Computer-Assisted Intervention, 8675, 305
- roth, 2014, Medical Image Computing and Computer-Assisted Intervention, 8673, 520
- brosch, 2014, Medical Image Computing and Computer-Assisted Intervention, 8674, 462
- 2014, Cancer Facts Figures 2014
- bergstra, 2010, Theano: A CPU and GPU math expression compiler, Proc Python Sci Comput Conf, 1
Cited by
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Self-citationDeep learning in medical image analysis
Shen, D., Wu, G., & Suk, H.-I. (2017) · Annual Review of Biomedical Engineering · doi:10.1146/annurev-bioeng-071516-044442 · Cited by 4,968
Convolutional neural networks: an overview and application in radiology
Yamashita, R., Nishio, M., Do, R. K. G., & Togashi, K. (2018) · Insights into Imaging · doi:10.1007/s13244-018-0639-9 · Cited by 4,682
“For example, Setio et al. [39] used a multistream CNN to classify nodule candidates of chest CT images between nodules or non-nodules in the databases of the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) [40], ANODE09 [41], and the Danish Lung Cancer Screening…”
MethodWang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., & Summers, R. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.369 · Cited by 4,616
Frid-Adar, M., Diamant, I., Klang, E., Amitai, M., Goldberger, J., & Greenspan, H. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.09.013 · Cited by 1,938
Metadata
- Authors
- Setio, A. A. A., Ciompi, F., Litjens, G., Gerke, P., Jacobs, C., van Riel, S. J., Wille, M. M. W., Naqibullah, M., Sanchez, C. I., & van Ginneken, B.
- Affiliations
- Radboud University Medical Center (NL)
- Diagnostic Image Analysis Group at the Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
- University of Copenhagen (DK)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2016-05
- Volume
- 35
- Issue
- 5
- Pages
- 1160-1169
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2322371438
- Cited by
- 1,258
- References
- 45
- Citations by year
- 2026: 67 · 2025: 71 · 2024: 89 · 2023: 137 · 2022: 140 · 2021: 186 · 2020: 158 · 2019: 193 · 2018: 132 · 2017: 72 · 2016: 13
- FWCI
- 112.57
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- The Netherlands Organization for Scientific Research (639.023.207)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Lung Cancer Diagnosis and Treatment
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- lung nodule detection, computer-aided detection, false positive reduction, multi-stream feature fusion, solid nodules, subsolid nodules, LIDC-IDRI
- MeSH terms
- Machine Learning, Algorithms, Solitary Pulmonary Nodule, Humans, Lung Neoplasms, Pattern Recognition, Automated, Radiographic Image Interpretation, Computer-Assisted, Tomography, X-Ray Computed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.