Fast Convolutional Neural Network Training Using Selective Data Sampling: Application to Hemorrhage Detection in Color Fundus Images
Open accessThe DOI matches its Crossref record; 50 of the 51 references it cites were found in a registry or an index.
Abstract
Convolutional neural networks (CNNs) are deep learning network architectures that have pushed forward the state-of-the-art in a range of computer vision applications and are increasingly popular in medical image analysis. However, training of CNNs is time-consuming and challenging. In medical image analysis tasks, the majority of training examples are easy to classify and therefore contribute little to the CNN learning process. In this paper, we propose a method to improve and speed-up the CNN training for medical image analysis tasks by dynamically selecting misclassified negative samples during training. Training samples are heuristically sampled based on classification by the current status of the CNN. Weights are assigned to the training samples and informative samples are more likely to be included in the next CNN training iteration. We evaluated and compared our proposed method by training a CNN with (SeS) and without (NSeS) the selective sampling method. We focus on the detection of hemorrhages in color fundus images. A decreased training time from 170 epochs to 60 epochs with an increased performance-on par with two human experts-was achieved with areas under the receiver operating characteristics curve of 0.894 and 0.972 on two data sets. The SeS CNN statistically outperformed the NSeS CNN on an independent test set.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Twenty-five studies17,28,29,35,37,39,40,44–61 compared algorithm performance against healthcare professionals.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [44]
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 2×
“Using multiple smaller sized layers with non-linear rectifications makes the CNN more discriminative and less parameters need to be optimized [30].”
BackgroundMethodImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“The CNN architecture used in this study consists of five convolutional layers followed by rectified linear units (ReLUs) [4] and spatial max-pooling.”
MethodLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“Additions such as the inclusion of drop-out [42] or batch normalization [43] could potentially further increase performance.”
BackgroundA decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741 · cited 1×
“Pilot experiments using MSRA weight initialization [3] showed an equal number of epochs required to train the SeS with similar end-performance on the test sets.”
MethodDeep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Cited by
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
“Some researchers have specifically looked into tackling this imbalance by incorporating intelligence in the training process itself, by applying selective sampling (van Grinsven et al., 2016) or hard negative mining (Wang et al., 2016b).”
BackgroundSelf-citationDeep Learning for Health Informatics
Ravì, D., Wong, C., Deligianni, F., Berthelot, M., Andreu-Perez, J., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636665 · Cited by 2,000
“Example applications of CNNs in medical imaging include the classification of interstitial lung diseases based on computed tomography (CT) images [70], the classification of tuberculosis manifestation based on X-ray images [71], the classification of neural progenitor cells from somatic cell source [57], the detection…”
Liu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883
Greenspan, H., van Ginneken, B., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2553401 · Cited by 1,700
“[24] attempt to improve and speed-up the CNN training for medical image analysis tasks by dynamically selecting misclassified negative samples during training.”
BackgroundBig data and machine learning algorithms for health-care delivery
Ngiam, K. Y., & Khor, I. W. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30149-4 · Cited by 1,424
Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
Acharya, U. R., Fujita, H., Oh, S. L., Hagiwara, Y., Tan, J. H., & Adam, M. (2017) · Information Sciences · doi:10.1016/j.ins.2017.06.027 · Cited by 937
Convolutional neural networks in medical image understanding: a survey
Sarvamangala, D. R., & Kulkarni, R. V. (2022) · Evolutionary Intelligence · doi:10.1007/s12065-020-00540-3 · Cited by 917
Zhang, K., Liu, X., Shen, J., Li, Z., Sang, Y., Wu, X., Zha, Y., Liang, W., Wang, C., Wang, K., et al. (2020) · Cell · doi:10.1016/j.cell.2020.04.045 · Cited by 917
“Recent studies demonstrated the potential of integrating AI into both the eye and childhood disease diagnostic systems and was found to significantly improve clinical diagnostic efficiency and accuracy (Burlina et al., 2017; Kermany et al., 2018; Long et al., 2017; Van Grinsven et al., 2016) .”
Artificial intelligence in retina
Schmidt-Erfurth, U., Sadeghipour, A., Gerendas, B. S., Waldstein, S. M., & Bogunović, H. (2018) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2018.07.004 · Cited by 779
Acharya, U. R., Fujita, H., Lih, O. S., Hagiwara, Y., Tan, J. H., & Adam, M. (2017) · Information Sciences · doi:10.1016/j.ins.2017.04.012 · Cited by 752
Deep Learning and Its Applications in Biomedicine
Cao, C., Liu, F., Tan, H., Song, D., Shu, W., Li, W., Zhou, Y., Bo, X., & Xie, Z. (2018) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2017.07.003 · Cited by 624
“Medical images analysis CNN Brain tumor segmentation, won top 2 in BRATS [108] Segmentation of pancreas in CT [113] Knee cartilage segmentation [114] Segmentation of hippocampus [117] Predict semantic descriptions from medical images [118] Segmentation of MR brain images [121] Anatomy-specific classification of medica…”
MethodFundus Image Classification Using VGG-19 Architecture with PCA and SVD
Mateen, M., Wen, J., Nasrullah, Song, S., & Huang, Z. (2018) · Symmetry · doi:10.3390/sym11010001 · Cited by 614
“[4] introduced a novel technique to detect rapid hemorrhages.”
MethodDeep image mining for diabetic retinopathy screening
Quellec, G., Charrière, K., Boudi, Y., Cochener, B., & Lamard, M. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.04.012 · Cited by 520
Leveraging uncertainty information from deep neural networks for disease detection
Leibig, C., Allken, V., Ayhan, M. S., Berens, P., & Wahl, S. (2017) · Scientific Reports · doi:10.1038/s41598-017-17876-z · Cited by 510
Real-world data: A brief review of the methods, applications, challenges and opportunities
Liu, F., & Panagiotakos, D. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01768-6 · Cited by 496
Fang, L., Cunefare, D., Wang, C., Guymer, R. H., Li, S., & Farsiu, S. (2017) · Biomedical Optics Express · doi:10.1364/boe.8.002732 · Cited by 481
“Recent works have extended the CNN framework to complex medical image analysis, such as retinal blood vessels segmentation [39,40], retinal hemorrhage detection [41], brain tumor segmentation [42], and cerebral microbleeds detection [43].”
BackgroundMethodDeep learning in microscopy image analysis: a survey
Xing, F., Xie, Y., Su, H., Liu, F., & Yang, L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2766168 · Cited by 460
Fully Automated Deep Learning System for Bone Age Assessment
Lee, H., Tajmir, S., Lee, J., Zissen, M., Yeshiwas, B. A., Alkasab, T. K., Choy, G., & Do, S. (2017) · Journal of Digital Imaging · doi:10.1007/s10278-017-9955-8 · Cited by 452
“In addition to segmentation and detection tasks, many deep learning-based methods are well suited for recognition and classification tasks in medical imaging [8, 9].”
MethodLi, X., Hu, X., Yu, L., Zhu, L., Fu, C.-W., & Heng, P.-A. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2951844 · Cited by 449
“[29] sped up model training by dynamically selecting misclassified negative samples for hemorrhage detection.”
MethodApplications of deep learning in fundus images: A review
Li, T., Bo, W., Hu, C., Kang, H., Liu, H., Wang, K., & Fu, H. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.101971 · Cited by 396
CABNet: Category Attention Block for Imbalanced Diabetic Retinopathy Grading
He, A., Li, T., Li, N., Wang, K., & Fu, H. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3023463 · Cited by 395
“Van Grinsven et al. [18] proposed a selective sampling method to speed-up the training for the detection of hemorrhages in colored fundus images by dynamically selecting misclas-sified negative samples during training.”
MethodIDRiD: Diabetic Retinopathy – Segmentation and Grading Challenge
Porwal, P., Pachade, S., Kokare, M., Deshmukh, G., Son, J., Bae, W., Liu, L., Wang, J., Liu, X., Gao, L., et al. (2020) · Medical Image Analysis · doi:10.1016/j.media.2019.101561 · Cited by 372
“In another approach researchers used two-dimensional (2D) image patches as an input instead of full-sized images for lesion detection ( Tan et al., 2017b; van Grinsven et al., 2016; Lam et al., 2018; Chudzik et al., 2018; Khojasteh et al., 2018 ), and OD and fovea detection ( Tan et al., 2017a ).”
MethodThe present and future of deep learning in radiology
Saba, L., Biswas, M., Kuppili, V., Cuadrado Godia, E., Suri, H. S., Edla, D. R., Omerzu, T., Laird, J. R., Khanna, N. N., Mavrogeni, S., et al. (2019) · European Journal of Radiology · doi:10.1016/j.ejrad.2019.02.038 · Cited by 353
“DL has been used in disease classification [97,98], brain cancer classification [99–101], organ segmentation [102–108], haemorrhage detection [109,110], tumor detection [111–116] are some key progresses.”
MethodCollaborative Learning of Semi-Supervised Segmentation and Classification for Medical Images
Zhou, Y., He, X., Huang, L., Liu, L., Zhu, F., Cui, S., & Shao, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00218 · Cited by 285
“Since the fundus images from different datasets have various illuminations and resolutions, we proposed a data pre-processing method (clarified in the supplementary file) based on [43] to unify the image quality and sharpen the texture details.”
MethodAn ensemble deep learning based approach for red lesion detection in fundus images
Orlando, J. I., Prokofyeva, E., del Fresno, M., & Blaschko, M. B. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2017.10.017 · Cited by 293
“Red lesion detection in fundus photographs have been extensively explored in the literature, although most of the existing approaches are based on detecting MAs or HEs separately, and not both structures simultaneously (Niemeijer et al., 2010, van Grinsven et al., 2016, Seoud et al., 2016).”
BackgroundMethodDeep learning in medical image analysis: A third eye for doctors
Fourcade, A., & Khonsari, R. H. (2019) · Journal of Stomatology, Oral and Maxillofacial Surgery · doi:10.1016/j.jormas.2019.06.002 · Cited by 284
Deep learning based computer-aided diagnosis systems for diabetic retinopathy: A survey
Asiri, N., Hussain, M., Al Adel, F., & Alzaidi, N. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.07.009 · Cited by 279
Gómez-Valverde, J. J., Antón, A., Fatti, G., Liefers, B., Herranz, A., Santos, A., Sánchez, C. I., & Ledesma-Carbayo, M. J. (2019) · Biomedical Optics Express · doi:10.1364/boe.10.000892 · Cited by 265
“…can find since 2015 several studies applying CNN in retinal vessel segmentation [34], image quality assessment [35], segmentation of the optic disc and the optic disc cup [36,37], diabetic retinopathy detection [38], age-macular degeneration detection [13] or hemorrhage detection [39] among others.”
BackgroundTan, J. H., Fujita, H., Sivaprasad, S., Bhandary, S. V., Rao, A. K., Chua, K. C., & Acharya, U. R. (2017) · Information Sciences · doi:10.1016/j.ins.2017.08.050 · Cited by 266
“In that study [31], a neighborhood of 41 x 41 around the pixel of interest was extracted and fed into a 10-layer (input is considered as a layer) convolutional neural network.”
MethodDiabetic retinopathy detection using red lesion localization and convolutional neural networks
Zago, G. T., Andreão, R. V., Dorizzi, B., & Teatini Salles, E. O. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103537 · Cited by 250
Role of machine learning in medical research: A survey
Garg, A., & Mago, V. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100370 · Cited by 243
Acharya, J., & Basu, A. (2020) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2020.2981172 · Cited by 163
“extensively used in biomedical research for image classification [14], anomaly detection [15], image segmentation [16], image enhancement [17], automated report generation [18] etc.”
BackgroundQuantitative imaging of cancer in the postgenomic era: Radio(geno)mics, deep learning, and habitats
Napel, S., Mu, W., Jardim‐Perassi, B. V., Aerts, H. J. W. L., & Gillies, R. J. (2018) · Cancer · doi:10.1002/cncr.31630 · Cited by 229
“103 A common problem with CNNs is “overfitting,” which occurs when the training set is too small compared with the number of layers or a trained model fails to generalize.”
BackgroundRADnet: Radiologist level accuracy using deep learning for hemorrhage detection in CT scans
Grewal, M., Srivastava, M. M., Kumar, P., & Varadarajan, S. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363574 · Cited by 213
Yang, Y., Li, T., Li, W., Wu, H., Fan, W., & Zhang, W. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66179-7_61 · Cited by 192
“Later, Haloi [3] try to find MAs in color fundus images via deep neural networks. van Grinsven et al. [6] propose a selective sampling method for fast hemorrhage detection.”
MethodRetinal Lesion Detection With Deep Learning Using Image Patches
Lam, C., Yu, C., Huang, L., & Rubin, D. (2018) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.17-22721 · Cited by 210
Machine Learning‐Enabled Smart Sensor Systems
Ha, N., Xu, K., Ren, G., Mitchell, A., & Ou, J. Z. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000063 · Cited by 207
Li, X., Pang, T., Xiong, B., Liu, W., Liang, P., & Wang, T. (2017) · 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI) · doi:10.1109/cisp-bmei.2017.8301998 · Cited by 195
“For the hemorrhage detection, this paper [50] proposes a dynamic CNN training strategy.”
MethodOphthalmic diagnosis using deep learning with fundus images – A critical review
Sengupta, S., Singh, A., Leopold, H. A., Gulati, T., & Lakshminarayanan, V. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.101758 · Cited by 201
“All previous studies [51] [52] [54] tried to detect different lesions separately, Tan et al.”
MethodIakovidis, D. K., Georgakopoulos, S. V., Vasilakakis, M., Koulaouzidis, A., & Plagianakos, V. P. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2837002 · Cited by 194
Bizopoulos, P., & Koutsouris, D. (2019) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2018.2885714 · Cited by 163
“In [188] the authors trained a five layer CNN to detect hemorrhage using 6679 images from DS16 and Messidor databases.”
MethodBreast cancer diagnosis in DCE-MRI using mixture ensemble of convolutional neural networks
Rasti, R., Teshnehlab, M., & Phung, S. L. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.08.004 · Cited by 185
Automatic Detection of Diabetic Eye Disease Through Deep Learning Using Fundus Images: A Survey
Sarki, R., Ahmed, K., Wang, H., & Zhang, Y. (2020) · IEEE Access · doi:10.1109/access.2020.3015258 · Cited by 176
“Authors in [19]–[24], [28], [29], [51]–[57], [59], [60], [78] used Kaggle data and [24], [25], [28], [30], [71], [72], [79] used Messidor [77] data.”
MethodToolkits and Libraries for Deep Learning
Erickson, B. J., Korfiatis, P., Akkus, Z., Kline, T., & Philbrick, K. (2017) · Journal of Digital Imaging · doi:10.1007/s10278-017-9965-6 · Cited by 176
Bodapati, J. D., Shaik, N. S., & Naralasetti, V. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02727-z · Cited by 175
Intelligent Health Care: Applications of Deep Learning in Computational Medicine
Yang, S., Zhu, F., Ling, X., Liu, Q., & Zhao, P. (2021) · Frontiers in Genetics · doi:10.3389/fgene.2021.607471 · Cited by 168
Age-related Macular Degeneration detection using deep convolutional neural network
Tan, J. H., Bhandary, S. V., Sivaprasad, S., Hagiwara, Y., Bagchi, A., Raghavendra, U., Krishna Rao, A., Raju, B., Shetty, N. S., Gertych, A., et al. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.05.001 · Cited by 169
Blended Multi-Modal Deep ConvNet Features for Diabetic Retinopathy Severity Prediction
Bodapati, J. D., Naralasetti, V., Shareef, S. N., Hakak, S., Bilal, M., Maddikunta, P. K. R., & Jo, O. (2020) · Electronics · doi:10.3390/electronics9060914 · Cited by 163
Computer-aided detection of small intestinal ulcer and erosion in wireless capsule endoscopy images
Fan, S., Xu, L., Fan, Y., Wei, K., & Li, L. (2018) · Physics in Medicine & Biology · doi:10.1088/1361-6560/aad51c · Cited by 166
Deep Learning Models for Retinal Blood Vessels Segmentation: A Review
Soomro, T. A., Afifi, A. J., Zheng, L., Soomro, S., Gao, J., Hellwich, O., & Paul, M. (2019) · IEEE Access · doi:10.1109/access.2019.2920616 · Cited by 176
Hookworm Detection in Wireless Capsule Endoscopy Images With Deep Learning
He, J.-Y., Wu, X., Jiang, Y.-G., Peng, Q., & Jain, R. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2801119 · Cited by 152
“A fast method is proposed in [31] to speed up the CNN training for medical image analysis tasks, by dynamically selecting misclassified negative samples during training.”
MethodMicroaneurysm detection in fundus images using a two-step convolutional neural network
Eftekhari, N., Pourreza, H. R., Masoudi, M., Ghiasi-Shirazi, K., & Saeedi, E. (2019) · BioMedical Engineering OnLine · doi:10.1186/s12938-019-0675-9 · Cited by 162
“The output of the CNN is typically one or more probabilities or class labels [5].”
BackgroundAddressing class imbalance in deep learning for small lesion detection on medical images
Bria, A., Marrocco, C., & Tortorella, F. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103735 · Cited by 174
A critical review on diagnosis of diabetic retinopathy using machine learning and deep learning
Das, D., Biswas, S. K., & Bandyopadhyay, S. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12642-4 · Cited by 180
“…techniques [15], watershed transformation [16], active contour model [16, 67, 82], image reconstruction [16, 102], template matching [68, 111, 136, 142], ensemble-based techniques [5, 33, 105, 113, 142], a priori shape knowledge approach [95], Dynamic Decision Thresholding (DDT) [64],…”
MethodClinical big data and deep learning: Applications, challenges, and future outlooks
Yu, Y., Li, M., Liu, L., Li, Y., & Wang, J. (2019) · Big Data Mining and Analytics · doi:10.26599/bdma.2019.9020007 · Cited by 217
“Image detection Fast CNN Hemorrhage detection[132]”
Vision Transformer‐based recognition of diabetic retinopathy grade
Wu, J., Hu, R., Xiao, Z., Chen, J., & Liu, J.-W. (2021) · Medical Physics · doi:10.1002/mp.15312 · Cited by 169
Lesion-Aware Transformers for Diabetic Retinopathy Grading
Sun, R., Li, Y., Zhang, T., Mao, Z., Wu, F., & Zhang, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01079 · Cited by 190
“In addition, the identification of lesion regions in fundus images is also very important, since it provides visual instructions for ophthalmologists to assist their diagnosis [12, 26, 30].”
BackgroundDeep learning in ophthalmology: a review
Grewal, P. S., Oloumi, F., Rubin, U., & TENNANT, M. T. S. (2018) · Canadian Journal of Ophthalmology · doi:10.1016/j.jcjo.2018.04.019 · Cited by 162
Automatic Detection of Diabetic Retinopathy: A Review on Datasets, Methods and Evaluation Metrics
Mateen, M., Wen, J., Hassan, M., Nasrullah, N., Sun, S., & Hayat, S. (2020) · IEEE Access · doi:10.1109/access.2020.2980055 · Cited by 168
“[100] introduced an approach to increase the speed of convolutional neural network training for the evaluation of retinal photographs.”
BackgroundBlended multi-modal deep convnet features for diabetic retinopathy severity prediction
Bodapati, J. D., Veeranjaneyulu, N., Shareef, S. N., Hakak, S., Bilal, M., Maddikunta, P. K. R., & Jo, O. (2020) · Lancaster EPrints (Lancaster University) · Cited by 141
Image Segmentation Using Computational Intelligence Techniques: Review
Chouhan, S. S., Kaul, A., & Singh, U. P. (2018) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-018-9257-4 · Cited by 155
Venhuizen, F. G., van Ginneken, B., Liefers, B. J., van Grinsven, M. J. J. P., Fauser, S., Hoyng, C. B., Theelen, T., & Sánchez, C. I. (2017) · Biomedical Optics Express · doi:10.1364/boe.8.003292 · Cited by 132
Self-citationFundus images analysis using deep features for detection of exudates, hemorrhages and microaneurysms
Khojasteh, P., Aliahmad, B., & Kumar, D. (2018) · BMC Ophthalmology · doi:10.1186/s12886-018-0954-4 · Cited by 142
“The values of the α, β, σ and μ were chosen as 4, −4, 300/30 and 128, respectively based on the works by Van Grinsven [13].”
BackgroundMethodInfluentialTajmir, S., Lee, H., Shailam, R., Gale, H. I., Nguyen, J. C., Westra, S. J., Lim, R., Yune, S., Gee, M. S., & Do, S. (2018) · Skeletal Radiology · doi:10.1007/s00256-018-3033-2 · Cited by 137
Coarse-to-fine classification for diabetic retinopathy grading using convolutional neural network
Wu, Z., Shi, G., Chen, Y., Shi, F., Chen, X., Coatrieux, G., Yang, J., Luo, L., & Li, S. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101936 · Cited by 140
“To remove the irrelevant information from varying illumination, a contrast-enhanced image ( ) I x,y;σ is obtained as follows [26]: .”
BackgroundReview on the Applications of Deep Learning in the Analysis of Gastrointestinal Endoscopy Images
Du, W., Rao, N., Liu, D., Jiang, H., Luo, C., Li, Z., Gan, T., & Zeng, B. (2019) · IEEE Access · doi:10.1109/access.2019.2944676 · Cited by 129
Welikala, R. A., Foster, P. J., Whincup, P. H., Rudnicka, A. R., Owen, C. G., Strachan, D. P., & Barman, S. A. (2017) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2017.09.005 · Cited by 124
A survey of medical image classification techniques
Miranda, E., Aryuni, M., & Irwansyah, E. (2016) · International Conference on Information Management and Technology (ICIMTech) · doi:10.1109/icimtech.2016.7930302 · Cited by 132
Joint segmentation and classification of retinal arteries/veins from fundus images
Girard, F., Kavalec, C., & Farida Cheriet, A. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.02.004 · Cited by 117
Soft computing approaches for image segmentation: a survey
Chouhan, S. S., Kaul, A., & Singh, U. P. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6005-6 · Cited by 120
“3) Clustering: an unsupervised procedure of grouping a set of entities into classes of alike features [217].”
BackgroundMethodDeep multiple instance learning for automatic detection of diabetic retinopathy in retinal images
Zhou, L., Zhao, Y., Yang, J., Yu, Q., & Xu, X. (2017) · IET Image Processing · doi:10.1049/iet-ipr.2017.0636 · Cited by 120
“The area under the ROC curve (AUC) [11] is used to measure the training performance.”
BackgroundMethodInfluentialDetection of Diabetic Retinopathy Using Bichannel Convolutional Neural Network
Pao, S., Lin, H.-Z., Chien, K., Tai, M., Chen, J., & Lin, G. (2020) · Journal of Ophthalmology · doi:10.1155/2020/9139713 · Cited by 135
Sugeno, A., Ishikawa, Y., Ohshima, T., & Muramatsu, R. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104795 · Cited by 137
Owais, M., Arsalan, M., Choi, J., & Park, K. R. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8040462 · Cited by 118
“In [35], an efficient CNN training method is proposed by dynamically choosing negative samples (misclassified) during the training process, which shows better performance in hemorrhage detection within a color fundus image.”
MethodNiu, Y., Mostaghimi, P., Shabaninejad, M., Świętojański, P., & Armstrong, R. T. (2020) · Water Resources Research · doi:10.1029/2019wr026597 · Cited by 107
Sine-Net: A fully convolutional deep learning architecture for retinal blood vessel segmentation
Atlı, İ., & Gedık, O. S. (2020) · Engineering Science and Technology an International Journal · doi:10.1016/j.jestch.2020.07.008 · Cited by 111
Automated estimation of chronological age from panoramic dental X-ray images using deep learning
Milošević, D., Vodanović, M., Galić, I., & Subašić, M. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116038 · Cited by 114
Lin, Z., Guo, R., Wang, Y., Wu, B., Chen, T., Wang, W., Chen, D. Z., & Wu, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_9 · Cited by 108
Luca, A. R., Ursuleanu, T. F., Gheorghe, L., Grigorovici, R., Iancu, S., Hlusneac, M., & Grigorovici, A. (2022) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2022.100911 · Cited by 121
Medical images classification using deep learning: a survey
Kumar, R., Kumbharkar, P., Vanam, S., & Sharma, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15576-7 · Cited by 123
“To reduce the training time of the model a new method called Fast Convolutional Neural Network was developed for detection of hemorrhage [153].”
Cunefare, D., Fang, L., Cooper, R. F., Dubra, A., Carroll, J., & Farsiu, S. (2017) · Scientific Reports · doi:10.1038/s41598-017-07103-0 · Cited by 99
Deep Convolutional Neural Network with Transfer Learning for Detecting Pneumonia on Chest X-Rays
Chhikara, P., Singh, P., Gupta, P., & Bhatia, T. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-981-15-0339-9_13 · Cited by 90
Diabetic retinopathy detection through artificial intelligent techniques: a review and open issues
Ishtiaq, U., Kareem, S. A., Abdullah, E. R. M. F., Mujtaba, G., Jahangir, R., & Ghafoor, H. Y. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-7044-8 · Cited by 100
FFU‐Net: Feature Fusion U‐Net for Lesion Segmentation of Diabetic Retinopathy
Xu, Y., Zhou, Z., Li, X., Zhang, N., Zhang, M., & Wei, P. (2021) · BioMed Research International · doi:10.1155/2021/6644071 · Cited by 94
“method [17], M-Net [31], FC-DenseNet [32], Sambyal et al.”
BackgroundResultADAM Challenge: Detecting Age-Related Macular Degeneration From Fundus Images
Fang, H., Li, F., Fu, H., Sun, X., Cao, X., Lin, F., Son, J., Kim, S. H., Quellec, G., Matta, S. C., et al. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3172773 · Cited by 116
“More recently, due to the cutting-edge developments in the field of deep learning, the methods of retinal structures analysis [15]–[20], lesion extraction [21]–[26], and disease prediction [27]–[31] based on fundus images have move towards more principled data-driven approaches.”
BackgroundMachine Learning Techniques for Ophthalmic Data Processing: A Review
Sarhan, M. H., Nasseri, M. A., Zapp, D., Maier, M., Lohmann, C. P., Navab, N., & Eslami, A. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3012134 · Cited by 80
“of retinal vessels [3], haemorrhages [8], drusen [9] or optic disk [10].”
BackgroundMVDRNet: Multi-view diabetic retinopathy detection by combining DCNNs and attention mechanisms
Luo, X., Pu, Z., Xu, Y. D., Wong, W. K., Su, J., Dou, X., Ye, B., Hu, J., & Mou, L. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108104 · Cited by 98
TW3-Based Fully Automated Bone Age Assessment System Using Deep Neural Networks
Son, S. J., Song, Y.-M., Kim, N., Do, Y., Kwak, N., Lee, M. S., & Lee, B.-D. (2019) · IEEE Access · doi:10.1109/access.2019.2903131 · Cited by 80
“…field of medical image analysis [7] and have achieved state-of-the-art results in some medical imaging applications, such as the segmentation of brain lesions [8], leak detection in airway tree segmentation [9], diabetic retinopathy classification [10], and breast cancer metastasis detection [11].”
BackgroundIdentification of glaucoma from fundus images using deep learning techniques
Ajitha, S., Akkara, J. D., & Judy, M. V. (2021) · Indian Journal of Ophthalmology · doi:10.4103/ijo.ijo_92_21 · Cited by 108
“[7] suggested an approach utilizing CNN with three convolutional layers and max pooling applied at each layer followed by two fully connected layers to recognize glaucoma in retinal Colour fundus images.”
MethodDetecting retinal microaneurysms and hemorrhages with robustness to the presence of blood vessels
Srivastava, R., Duan, L., Wong, D. W. K., Liu, J., & Wong, T. Y. (2016) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.10.017 · Cited by 79
Wang, H., Yuan, G., Zhao, X., Peng, L., Wang, Z., He, Y., Qu, C., & Peng, Z. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105398 · Cited by 88
Luo, X., Wang, W., Xu, Y. D., Lai, Z., Jin, X., Zhang, B., & Zhang, D. D. (2023) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12155 · Cited by 85
Liu, B., Chi, W., Li, X., Li, P., Liang, W., Liu, H., Wang, W., & He, J. (2020) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-019-03098-5 · Cited by 62
Facial Recognition System for People with and without Face Mask in Times of the COVID-19 Pandemic
Talahua, J. S., Buele, J., Calvopiña, P., & Aldás, J. V. (2021) · Sustainability · doi:10.3390/su13126900 · Cited by 83
“In [32], a system that analyzes medical images is proposed, through selective data sampling, that detects hemorrhages in color images.”
BackgroundChen, D., Li, X., & Li, S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3105384 · Cited by 94
“CNN analysis has many applications, such as medical image data recognition. van Grinsven et al. [41] applied CNNs to the detection of bleeding in color fundus images and proposed a method for improving and accelerating the CNN training of medical image analysis tasks.”
MethodLesion-attention pyramid network for diabetic retinopathy grading
Li, X., Jiang, Y., Zhang, J., Li, M., Luo, H., & Yin, S. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102259 · Cited by 73
Skouta, A., Elmoufidi, A., Andaloussi, S. J., & Ouchetto, O. (2022) · Journal Of Big Data · doi:10.1186/s40537-022-00632-0 · Cited by 77
“Grinsven et al. [29] created a CNN architecture to detect hemorrhage with nine layers formed by selective samples and 41 × 41 size patches labeled with or without evidence of hemorrhage.”
Learn to Segment Retinal Lesions and Beyond
Wei, Q., Li, X., Yu, W., Zhang, X., Zhang, Y., Hu, B., Mo, B., Gong, D., Chen, N., Ding, D., et al. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412088 · Cited by 81
“In [32], for instance, a customized CNN is used to segment iHE by patch classification.”
MethodProgressive Multiscale Consistent Network for Multiclass Fundus Lesion Segmentation
He, A., Wang, K., Li, T., Wang, B., Kang, H., & Fu, H. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3177803 · Cited by 79
“For the segmentation of HE, Grinsven et al. [40] proposed a CNN-based method to improve the performance and accelerate the training by dynamically choosing misclassified negative images during the training stage and achieved good results.”
Metadata
- Authors
- van Grinsven, M. J. J. P., van Ginneken, B., Hoyng, C. B., Theelen, T., & Sanchez, C. I.
- Affiliations
- Radboud University Medical Center (NL)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2016-05
- Volume
- 35
- Issue
- 5
- Pages
- 1273-1284
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2344912502
- Cited by
- 426
- References
- 51
- Citations by year
- 2026: 7 · 2025: 13 · 2024: 27 · 2023: 41 · 2022: 49 · 2021: 70 · 2020: 57 · 2019: 68 · 2018: 50 · 2017: 38 · 2016: 6
- FWCI
- 46.88
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- convolutional neural network training, training efficiency, sample weighting, hemorrhage detection, color fundus images, medical image analysis, training time reduction
- MeSH terms
- Machine Learning, Fundus Oculi, Humans, Image Interpretation, Computer-Assisted, Retinal Hemorrhage, Databases, Factual, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.