The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Multisource Transfer Learning With Convolutional Neural Networks for Lung Pattern Analysis
Open accessAbstract
Early diagnosis of interstitial lung diseases is crucial for their treatment, but even experienced physicians find it difficult, as their clinical manifestations are similar. In order to assist with the diagnosis, computer-aided diagnosis systems have been developed. These commonly rely on a fixed scale classifier that scans CT images, recognizes textural lung patterns, and generates a map of pathologies. In a previous study, we proposed a method for classifying lung tissue patterns using a deep convolutional neural network (CNN), with an architecture designed for the specific problem. In this study, we present an improved method for training the proposed network by transferring knowledge from the similar domain of general texture classification. Six publicly available texture databases are used to pretrain networks with the proposed architecture, which are then fine-tuned on the lung tissue data. The resulting CNNs are combined in an ensemble and their fused knowledge is compressed back to a network with the original architecture. The proposed approach resulted in an absolute increase of about 2% in the performance of the proposed CNN. The results demonstrate the potential of transfer learning in the field of medical image analysis, indicate the textural nature of the problem and show that the method used for training a network can be as important as designing its architecture.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“Formal definitions and a survey on transfer learning can be found in [31].”
BackgroundDistilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
Tajbakhsh, N., Shin, J. Y., Gurudu, S. R., Hurst, R. T., Kendall, C. B., Gotway, M. B., & Liang, J. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2535302 · Cited by 3,277 · cited 1×
“GoogleNet pretrained on ImageNet [30], [38].”
Describing Textures in the Wild
Cimpoi, M., Maji, S., Kokkinos, I., Mohamed, S., & Vedaldi, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.461 · Cited by 2,438
Buciluǎ, C., Caruana, R., & Niculescu-Mizil, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150464 · Cited by 2,068
Greenspan, H., van Ginneken, B., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2553401 · Cited by 1,700
Static Analysis of Shape in TensorFlow Programs
The Theano Development Team, Al‐Rfou, R., Alain, G., Almahairi, A., Angermueller, C., Bahdanau, D., Ballas, N., Bastien, F., Bayer, J., Belikov, A., et al. (2016) · arXiv (Cornell University) · doi:10.4230/lipics.ecoop.2020.15 · Cited by 1,589
Lung pattern classification for interstitial lung diseases using a deep convolutional neural network
Anthimopoulos, M., Christodoulidis, S., Ebner, L., Christe, A., & Mougiakakou, S. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2535865 · Cited by 1,343
Self-citationA sparse texture representation using local affine regions
Lazebnik, S., Schmid, C., & Ponce, J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.151 · Cited by 1,123
Medical image classification with convolutional neural network
Li, Q., Cai, W., Wang, X., Zhou, Y., Feng, D. D., & Chen, M. (2014) · 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV) · doi:10.1109/icarcv.2014.7064414 · Cited by 880
Ensemble selection from libraries of models
Caruana, R., Niculescu-Mizil, A., Crew, G., & Ksikes, A. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015432 · Cited by 861
Computer analysis of computed tomography scans of the lung: a survey
Sluimer, I., Schilham, A., Prokop, M., & van Ginneken, B. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2005.862753 · Cited by 556
From generic to specific deep representations for visual recognition
Azizpour, H., Razavian, A. S., Sullivan, J., Maki, A., & Carlsson, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301270 · Cited by 394
Quantitative Analysis of Pulmonary Emphysema Using Local Binary Patterns
Srensen, L., Shaker, S. B., & de Bruijne, M. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2038575 · Cited by 367
Material perception: What can you see in a brief glance?
Sharan, L., Rosenholtz, R., & Adelson, E. (2010) · Journal of Vision · doi:10.1167/9.8.784 · Cited by 303
Class-specific material categorisation
Caputo, B., Hayman, E., & Mallikarjuna, P. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.54 · Cited by 286
Building a reference multimedia database for interstitial lung diseases
Depeursinge, A., Vargas, A., Platon, A., Geissbuhler, A., Poletti, P.-A., & Müller, H. (2012) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2011.07.003 · Cited by 248 · cited 4×
“Dataset: The HUG database [39] consists of 109 HRCT scans of different ILD cases with 512 × 512 pixels per slice and an average of 25 slices per case.”
BackgroundInfluentialComputer Recognition of Regional Lung Disease Patterns
UPPALURI, R., HOFFMAN, E. A., SONKA, M., HARTLEY, P. G., HUNNINGHAKE, G. W., & McLENNAN, G. (1999) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.160.2.9804094 · Cited by 227
Learning Aligned Cross-Modal Representations from Weakly Aligned Data
Castrejon, L., Aytar, Y., Vondrick, C., Pirsiavash, H., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.321 · Cited by 188
Good Practice in CNN Feature TransferPreprint
Zheng, L., Zhao, Y., Wang, S., Wang, J., & Tian, Q. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.00133 · Cited by 170
Quantitative computerized analysis of diffuse lung disease in high‐resolution computed tomography
Uchiyama, Y., Katsuragawa, S., Abé, H., Shiraishi, J., Li, F., Li, Q., Zhang, C., Suzuki, K., & Doi, K. (2003) · Medical Physics · doi:10.1118/1.1597431 · Cited by 163
Material-specific adaptation of color invariant features
Burghouts, G. J., & Geusebroek, J. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.10.005 · Cited by 153
The Diagnosis, Assessment and Treatment of Diffuse Parenchymal Lung Disease in Adults
B. T. SOCIETY (1999) · Thorax · doi:10.1136/thx.54.suppl_1.s1 · Cited by 147
van Tulder, G., & de Bruijne, M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2526687 · Cited by 142
High Resolution Multidetector CT-Aided Tissue Analysis and Quantification of Lung Fibrosis
Zavaletta, V. A., Bartholmai, B. J., & Robb, R. A. (2007) · Academic Radiology · doi:10.1016/j.acra.2007.03.009 · Cited by 136
Computer‐aided diagnosis in high resolution CT of the lungs
Sluimer, I. C., van Waes, P. F. G. M., Viergever, M. A., & van Ginneken, B. (2003) · Medical Physics · doi:10.1118/1.1624771 · Cited by 134
A Texton-Based Approach for the Classification of Lung Parenchyma in CT Images
Gangeh, M. J., Sørensen, L., Shaker, S. B., Kamel, M. S., de Bruijne, M., & Loog, M. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15711-0_74 · Cited by 97
Near-Affine-Invariant Texture Learning for Lung Tissue Analysis Using Isotropic Wavelet Frames
Depeursinge, A., Ville, D. V. D., Platon, A., Geissbühler, A., Poletti, P., & Müller, H. (2012) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2012.2198829 · Cited by 84
Kylberg Texture Dataset v. 1.0
Kylberg, G. (2011) · Uppsala University Publications (Uppsala University) · Cited by 83
Korfiatis, P. D., Karahaliou, A. N., Kazantzi, A., Kalogeropoulou, C., & Costaridou, L. I. (2009) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2036166 · Cited by 80
Lung image patch classification with automatic feature learning
Li, Q., Cai, W., & Feng, D. D. (2013) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6610939 · Cited by 62
Classification of interstitial lung disease patterns using local DCT features and random forest
Anthimopoulos, M., Christodoulidis, S., Christe, A., & Mougiakakou, S. G. (2014) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2014.6945006 · Cited by 52
Self-citationUsing Multiscale Visual Words for Lung Texture Classification and Retrieval
Foncubierta–Rodríguez, A., Depeursinge, A., & Müller, H. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-28460-1_7 · Cited by 34
Depeursinge, A., Pad, P., Chin, A. S.-L., Leung, A. N. C., Rubin, D. L., Müller, H., & Unser, M. A. (2015) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2015.7163897 · Cited by 23
Zhao, W., Xu, R., Hirano, Y., Tachibana, R., & Kido, S. (2013) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6610784 · Cited by 21
Multiple kernel learning for classification of diffuse lung disease using HRCT lung images
Vo, K. T., & Sowmya, A. (2010) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2010.5626113 · Cited by 21
Cited by
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Exploring the effect of image enhancement techniques on COVID-19 detection using chest X-ray images
Rahman, T., Khandakar, A., Qiblawey, Y., Tahir, A., Kiranyaz, S., Abul Kashem, S. B., Islam, M. T., Al Maadeed, S., Zughaier, S. M., Khan, M. S., et al. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104319 · Cited by 1,147
Deep learning in medical imaging and radiation therapy
Sahiner, B., Pezeshk, A., Hadjiiski, L. M., Wang, X., Drukker, K., Cha, K. H., Summers, R. M., & Giger, M. L. (2019) · Medical Physics · doi:10.1002/mp.13264 · Cited by 740
Reliable Tuberculosis Detection Using Chest X-Ray With Deep Learning, Segmentation and Visualization
Rahman, T., Khandakar, A., Kadir, M. A., Islam, K. R., Islam, K. F., Mazhar, R., Hamid, T., Islam, M. T., Kashem, S., Mahbub, Z. B., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3031384 · Cited by 651
Rahman, T., Chowdhury, M. E. H., Khandakar, A., Islam, K. R., Islam, K. F., Mahbub, Z. B., Kadir, M. A., & Kashem, S. (2020) · Applied Sciences · doi:10.3390/app10093233 · Cited by 638
Metadata
- Authors
- Christodoulidis, S., Anthimopoulos, M., Ebner, L., Christe, A., & Mougiakakou, S.
- Venue
- IEEE Journal of Biomedical and Health Informatics
- Published
- 2017-01
- Volume
- 21
- Issue
- 1
- Pages
- 76-84
- ISSN
- 2168-2194 (ISSN-L)
- 2168-2208
- OpenAlex
- W2560476520
- Cited by
- 296
- References
- 45
- FWCI
- 20.24
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.