The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Knowledge-based Collaborative Deep Learning for Benign-Malignant Lung Nodule Classification on Chest CT
Abstract
The accurate identification of malignant lung nodules on chest CT is critical for the early detection of lung cancer, which also offers patients the best chance of cure. Deep learning methods have recently been successfully introduced to computer vision problems, although substantial challenges remain in the detection of malignant nodules due to the lack of large training data sets. In this paper, we propose a multi-view knowledge-based collaborative (MV-KBC) deep model to separate malignant from benign nodules using limited chest CT data. Our model learns 3-D lung nodule characteristics by decomposing a 3-D nodule into nine fixed views. For each view, we construct a knowledge-based collaborative (KBC) submodel, where three types of image patches are designed to fine-tune three pre-trained ResNet-50 networks that characterize the nodules' overall appearance, voxel, and shape heterogeneity, respectively. We jointly use the nine KBC submodels to classify lung nodules with an adaptive weighting scheme learned during the error back propagation, which enables the MV-KBC model to be trained in an end-to-end manner. The penalty loss function is used for better reduction of the false negative rate with a minimal effect on the overall performance of the MV-KBC model. We tested our method on the benchmark LIDC-IDRI data set and compared it to the five state-of-the-art classification approaches. Our results show that the MV-KBC model achieved an accuracy of 91.60% for lung nodule classification with an AUC of 95.70%. These results are markedly superior to the state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Siegel, R. L., Miller, K. D., & Jemal, A. (2015) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21254 · Cited by 11,853
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759
The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository
Clark, K., Vendt, B., Smith, K., Freymann, J., Kirby, J., Koppel, P., Moore, S., Phillips, S., Maffitt, D., Pringle, M., et al. (2013) · Journal of Digital Imaging · doi:10.1007/s10278-013-9622-7 · Cited by 4,599 · cited 1×
“The LIDC-IDRI database [41]–[43] in the Cancer Imaging Archive (TCIA) contains 1018 clinical chest CT scans with lung nodules obtained from seven institutions.”
MethodLearning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 1×
“First, it has been reported that the image representation ability learned from large-scale datasets, such as the ImageNet, can be transferred to generic visual recognition tasks, which have limited training data [32].”
BackgroundArmato, S. G., McLennan, G., Bidaut, L., McNitt‐Gray, M. F., Meyer, C. R., Reeves, A. P., Zhao, B., Aberle, D. R., Henschke, C. I., Hoffman, E. A., et al. (2011) · Medical Physics · doi:10.1118/1.3528204 · Cited by 2,887 · cited 1×
“The LIDC-IDRI database [41-43] in the Cancer Imaging Archive (TCIA) contains 1018 clinical chest CT scans with lung nodules obtained from seven institutions.”
MethodA fuzzy K-nearest neighbor algorithm
Keller, J. M., Gray, M. R., & Givens, J. A. (1985) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1985.6313426 · Cited by 2,648
Theory of the backpropagation neural network
Hecht-Nielsen (1989) · International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1989.118638 · Cited by 2,222
Setio, A. A. A., Ciompi, F., Litjens, G., Gerke, P., Jacobs, C., van Riel, S. J., Wille, M. M. W., Naqibullah, M., Sanchez, C. I., & van Ginneken, B. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2536809 · Cited by 1,258
Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks
Dou, Q., Chen, H., Yu, L., Zhao, L., Qin, J., Wang, D., Mok, V. C., Shi, L., & Heng, P.-A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528129 · Cited by 679
Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification
Shen, W., Zhou, M., Yang, F., Yu, D., Dong, D., Yang, C., Zang, Y., & Tian, J. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.05.029 · Cited by 635
Multi-scale Convolutional Neural Networks for Lung Nodule Classification
Shen, W., Zhou, M., Yang, F., Yang, C., & Tian, J. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-19992-4_46 · Cited by 592
Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network
Prasoon, A., Petersen, K., Igel, C., Lauze, F., Dam, E., & Nielsen, M. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_31 · Cited by 582
Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection
Dou, Q., Chen, H., Yu, L., Qin, J., & Heng, P.-A. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2613502 · Cited by 582
Yu-Jen Chen, Y.-J., Hua, K.-L., Hsu, C.-H., Cheng, W.-H., & Hidayati, S. C. (2015) · OncoTargets and Therapy · doi:10.2147/ott.s80733 · Cited by 542
A new computationally efficient CAD system for pulmonary nodule detection in CT imagery
Messay, T., Hardie, R. C., & Rogers, S. K. (2010) · Medical Image Analysis · doi:10.1016/j.media.2010.02.004 · Cited by 439
Lung Nodule Classification Using Deep Features in CT Images
Kumar, D., Wong, A., & Clausi, D. A. (2015) · 2015 12th Conference on Computer and Robot Vision · doi:10.1109/crv.2015.25 · Cited by 398 · cited 1×
“[57] used auto-encoders and CNNs to classify lung nodules as malignant or benign, with an accuracy of 77.”
MethodQuantitative Analysis of Pulmonary Emphysema Using Local Binary Patterns
Srensen, L., Shaker, S. B., & de Bruijne, M. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2038575 · Cited by 367
Xie, Y., Zhang, J., Xia, Y., Fulham, M., & Zhang, Y. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.005 · Cited by 284
Self-citationTexture Feature Analysis for Computer-Aided Diagnosis on Pulmonary Nodules
Han, F., Wang, H., Zhang, G., Han, H., Song, B., Li, L., Moore, W., Lu, H., Zhao, H., & Liang, Z. (2015) · Journal of Digital Imaging · doi:10.1007/s10278-014-9718-8 · Cited by 265
Firmino, M., Angelo, G., Morais, H., Dantas, M. R., & Valentim, R. (2016) · BioMedical Engineering OnLine · doi:10.1186/s12938-015-0120-7 · Cited by 252
Hu, J., Lu, J., & Tan, Y.-P. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298629 · Cited by 211
Dhara, A. K., Mukhopadhyay, S., Dutta, A., Garg, M., & Khandelwal, N. (2016) · Journal of Digital Imaging · doi:10.1007/s10278-015-9857-6 · Cited by 201
Risk Stratification of Lung Nodules Using 3D CNN-Based Multi-task Learning
Hussein, S., Cao, K., Song, Q., & Bagci, U. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_20 · Cited by 161
Chen, S., Qin, J., Ji, X., Lei, B., Wang, T., Ni, D., & Cheng, J. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2629462 · Cited by 147
LUNGx Challenge for computerized lung nodule classification
Kirby, J., Armato, S. G., Drukker, K., Li, F., Hadjiiski, L. M., Tourassi, G. D., Clarke, L. P., Engelmann, R. M., Giger, M. L., Redmond, G., et al. (2016) · Journal of medical imaging · doi:10.1117/1.jmi.3.4.044506 · Cited by 138
Hussein, S., Gillies, R. J., Cao, K., Song, Q., & Bağcı, U. (2017) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2017.7950686 · Cited by 137
Automated Segmentation Refinement of Small Lung Nodules in CT Scans by Local Shape Analysis
Diciotti, S., Lombardo, S., Falchini, M., Picozzi, G., & Mascalchi, M. (2011) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2011.2167621 · Cited by 123
Zhang, J., Xia, Y., Xie, Y., FULHAM, M. J., & Feng, D. D. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2775662 · Cited by 116
Self-citationAccurate Lungs Segmentation on CT Chest Images by Adaptive Appearance-Guided Shape Modeling
Soliman, A., Khalifa, F., Elnakib, A. A., El‐Ghar, M. A., Dunlap, N., Wang, B., El-Baz, A. S., Keynton, R. S., & El-Baz, A. S. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2606370 · Cited by 102
Lung Lesion Extraction Using a Toboggan Based Growing Automatic Segmentation Approach
Song, J., Yang, C., Fan, L., Wang, K., Yang, F., Liu, S., & Tian, J. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2474119 · Cited by 99
Psychological Burden Associated With Lung Cancer Screening: A Systematic Review
Wu, G. X., Raz, D. J., Brown, L. M., & Sun, V. C.-Y. (2016) · Clinical Lung Cancer · doi:10.1016/j.cllc.2016.03.007 · Cited by 90
Robust semi-automatic segmentation of pulmonary subsolid nodules in chest computed tomography scans
Lassen-Schmidt, B. C., Jacobs, C., Kuhnigk, J., van Ginneken, B., & van Rikxoort, E. M. (2015) · Physics in Medicine and Biology · doi:10.1088/0031-9155/60/3/1307 · Cited by 84
Pulmonary nodule detection in medical images: A survey
Zhang, J., Xia, Y., Cui, H., & Zhang, Y. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2018.01.011 · Cited by 83
Self-citationShen, W., Zhou, M., Yang, F., Dong, D., Yang, C., Zang, Y., & Tian, J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_15 · Cited by 78
Transferable Multi-model Ensemble for Benign-Malignant Lung Nodule Classification on Chest CT
Xie, Y., Xia, Y., Zhang, J., Feng, D. D., FULHAM, M. J., & Cai, W. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_75 · Cited by 77
Self-citationChen, H., Zhang, J., Xu, Y., Chen, B., & Zhang, K. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.04.001 · Cited by 72
Self-citationStratified learning of local anatomical context for lung nodules in CT images
Wu, D., Lü, L., Bi, J., Shinagawa, Y., Boyer, K. L., Krishnan, A. V., & Salganicoff, M. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540008 · Cited by 67
Zhang, J., Xia, Y., Zeng, H., & Zhang, Y. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.08.022 · Cited by 64
Self-citationA texture feature analysis for diagnosis of pulmonary nodules using LIDC-IDRI database
Han, F., Zhang, G., Wang, H., Song, B., Lu, H., Zhao, D., Zhao, H., & Liang, Z. (2013) · IEEE International Conference on Medical Imaging Physics and Engineering (ICMIPE) · doi:10.1109/icmipe.2013.6864494 · Cited by 52
Lung Nodule Classification by Jointly Using Visual Descriptors and Deep Features
Xie, Y., Zhang, J., Liu, S., Cai, W., & Xia, Y. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-61188-4_11 · Cited by 41
Self-citationMetz, S., Ganter, C., Lorenzen, S., van Marwick, S., Holzapfel, K., Herrmann, K., Rummeny, E. J., Wester, H., Schwaiger, M., Nekolla, S. G., et al. (2015) · PLoS ONE · doi:10.1371/journal.pone.0132386 · Cited by 36
Lung nodule malignancy prediction using multi-task convolutional neural network
Li, X., Kao, Y., Shen, W., Li, X., & Xie, G. (2017) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2253836 · Cited by 27
Discovery Radiomics via StochasticNet Sequencers for Cancer DetectionPreprint
Shafiee, M. J., Chung, A. G., Kumar, D., Khalvati, F., Haider, M. A., & Wong, A. M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.03361 · Cited by 19
Every Untrue Label is Untrue in its Own Way: Controlling Error Type with the Log Bilinear LossPreprint
Resheff, Y. S., Mandelbaum, A., & Weinshall, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.06062 · Cited by 9
Cited by
Attention Residual Learning for Skin Lesion Classification
Zhang, J., Xie, Y., Xia, Y., & Shen, C. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2893944 · Cited by 568
Self-citationDeep Transfer Learning Based Classification Model for COVID-19 Disease
Pathak, Y., Shukla, P. K., Tiwari, A., Stalin, S., Singh, S., & Shukla, P. K. (2022) · IRBM · doi:10.1016/j.irbm.2020.05.003 · Cited by 460
Bhandary, A., Prabhu, G. A., Rajinikanth, V., Thanaraj, K. P., Satapathy, S. C., Robbins, D. E., Shasky, C., Zhang, Y.-D., Tavares, J. M. R. S., & Raja, N. S. M. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.11.013 · Cited by 449
A Mutual Bootstrapping Model for Automated Skin Lesion Segmentation and Classification
Xie, Y., Zhang, J., Xia, Y., & Shen, C. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2972964 · Cited by 399
Self-citationA survey on incorporating domain knowledge into deep learning for medical image analysis
Xie, X., Niu, J., Liu, X., Chen, Z., Tang, S., & Yu, S. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.101985 · Cited by 311
Metadata
- Authors
- Xie, Y., Xia, Y., Zhang, J., Song, Y., Feng, D., Fulham, M., & Cai, W.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2019-04
- Volume
- 38
- Issue
- 4
- Pages
- 991-1004
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2897755679
- Cited by
- 496
- References
- 53
- FWCI
- 22.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.