Fast Convolutional Neural Network Training Using Selective Data Sampling: Application to Hemorrhage Detection in Color Fundus Images
Open accessThe DOI matches its Crossref record; 50 of the 51 references it cites were found in a registry or an index.
Abstract
Convolutional neural networks (CNNs) are deep learning network architectures that have pushed forward the state-of-the-art in a range of computer vision applications and are increasingly popular in medical image analysis. However, training of CNNs is time-consuming and challenging. In medical image analysis tasks, the majority of training examples are easy to classify and therefore contribute little to the CNN learning process. In this paper, we propose a method to improve and speed-up the CNN training for medical image analysis tasks by dynamically selecting misclassified negative samples during training. Training samples are heuristically sampled based on classification by the current status of the CNN. Weights are assigned to the training samples and informative samples are more likely to be included in the next CNN training iteration. We evaluated and compared our proposed method by training a CNN with (SeS) and without (NSeS) the selective sampling method. We focus on the detection of hemorrhages in color fundus images. A decreased training time from 170 epochs to 60 epochs with an increased performance-on par with two human experts-was achieved with areas under the receiver operating characteristics curve of 0.894 and 0.972 on two data sets. The SeS CNN statistically outperformed the NSeS CNN on an independent test set.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Twenty-five studies17,28,29,35,37,39,40,44–61 compared algorithm performance against healthcare professionals.”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [44]
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 2×
“Using multiple smaller sized layers with non-linear rectifications makes the CNN more discriminative and less parameters need to be optimized [30].”
BackgroundMethodImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“The CNN architecture used in this study consists of five convolutional layers followed by rectified linear units (ReLUs) [4] and spatial max-pooling.”
MethodLeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“Additions such as the inclusion of drop-out [42] or batch normalization [43] could potentially further increase performance.”
BackgroundA decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741 · cited 1×
“Pilot experiments using MSRA weight initialization [3] showed an equal number of epochs required to train the SeS with similar end-performance on the test sets.”
MethodDeep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Cited by
Items 401–426 of 426
Zhao, K., Zhao, W., Xie, J., Li, B., Zhang, Z., & Xu, X. (2022) · Communications in computer and information science · doi:10.1007/978-981-16-9247-5_27
Senthilkumar, R., Bharathi, A., & Daniel Madan Raja, S. (2022) · International Journal of Health Sciences · doi:10.53730/ijhs.v6ns2.7731
“In this work, discriminative Convolution Neural Network towards diagnosis of diabetic retinopathy through classification and progression prediction of lesion grading in fundus image of Retina has been designed and implemented using Alexanet Architecture on MESSIDOR Dataset and Image-Ret Dataset.”
MethodInfluentialEnhance Segmentation and Classification of Retinal Fundus Image with Deep LearningPreprint
Banupriya, V., & Kalaivani, A. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4120044
A Survey on Recent Computer‐Aided Diagnosis for Detecting Diabetic Retinopathy
Priyadharsini, C., Kannan, R. J., & Hussain, F. K. (2022) · doi:10.1002/9781119841937.ch2
Zhang, X., Peng, Z., Meng, M., Wu, J., HAN, Y., Zhang, Y., Yang, J., & ZHAO, Q. (2022) · Journal of Mechanics in Medicine and Biology · doi:10.1142/s0219519422400292
Deep Learning-Based Intelligent Analysis of Medical Big Data
Binoy, R. M., Prakash, P., Thomas, D., Nath, D. R., & Joseph, G. (2022) · International Journal of Engineering Technology and Management Sciences · doi:10.46647/ijetms.2022.v06i05.113
2D Winograd CNN Chip for COVID-19 and Pneumonia Detection
Fan, Y., Lin, K.-Y., & Tsai, Y.-H. (2022) · Applied Sciences · doi:10.3390/app122412891
Deep Learning Methods for Microscopic Medical Images
R, Y. N. G., B, V. K., & Shetty, N. R. (2023) · International Conference on Inventive Computation Technologies (ICICT) · doi:10.1109/icict57646.2023.10134148
Ali, M., Sharma, V., & Ali, M. F. (2022) · International Journal Of Engineering And Computer Science · doi:10.18535/ijecs/v11i09.4656
Comparative Analysis on Deep Learning Algorithms for Detecting Retinal Diseases Using OCT Images
Nagamani, G. M., & Karthikeyan, S. (2023) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-99-0609-3_36
DREXUNET: A novel Deep CNN Algorithm for drusen and exudates classification on fundus imagesPreprint
Arunavinodhini, C., & Sabena, S. (2023) · Research Square · doi:10.21203/rs.3.rs-3383744/v1 · Cited by 1
Merging/Filtering/Voting to Improve Segmentation of Diabetic Retinopathy Eye Fundus Lesions
Furtado, P. (2023) · International Conference on Bioinformatics and Biomedical Technology (ICBBT) · doi:10.1145/3608164.3608166
“[10], Van Grinsven [11] and Shan et al. [13] are classification CNNs that classify small square windows around potential lesions.”
BackgroundMulti-Scale Feature Pyramid for Detection of Red Lesions in Fundus Images
Ghorai, G. K., Kundu, S., Sarkar, G., & Dhara, A. K. (2023) · International Journal of Recent Technology and Engineering (IJRTE) · doi:10.35940/ijrte.d7951.1112423
Contemporary Studies in Biological Sciences I
Shamchı, M. P., Aksöz, N., Katırcıoğlu, H., Karacasoy, A. R., Özel, Ç. A., Akyön, Y. B., Yıltırak, A. F., Akdağ, E., Batmaz, G., Arslan, P., et al. (2024) · Akademisyen Kitabevi eBooks · doi:10.37609/akya.2964
Fast Feed Forward Neural Networks and the Industrial Application
Chen, S., & Guo, L. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240011
Deep transfer learning from limited source for abdominal CT and MR image segmentation
Krishnan, C., Schmidt, E., Onuoha, E. E., Mrug, M. M., Cárdenas, C., & Kim, H. (2024) · SPIE Medical Imaging: Image Processing · doi:10.1117/12.3006814 · Cited by 1
Classification of Diabetic Retinopathy using Deep Learning
Reddy, M. V. P. C., Sharma, S. V., Reshmi, M., Reddy, J. S., & Priya, D. S. (2024) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2024.60150
A Lightweight UNet with Inverted Residual Blocks for Diabetic Retinopathy Lesion Segmentation
Bhati, A., Choudhary, K., Jain, S., Gour, N., Khanna, P., Ojha, A., & Werghi, N. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-58174-8_6
INTERCRANIAL HEMORRHAGE DETECTION USING CNN
(2024) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets60601
Diabetic Retinopathy Grading with Enhanced Attention Using CNN
Lekhana, D., Rohini, T. V., Bai, S. P., & Kavitha, K. S. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-5370-6_26
Intelligence artificielle et banques de données
Hennocq, Q. (2026) · EMC - Chirurgie orale et maxillo-faciale · doi:10.1016/s2352-3999(25)49562-4
Diabetic Retinopathy Diagnosis using Inception-ResNet-V2 Deep Learning Architecture
Yeruva, M., Nelakuditi, Y., Kumar, G. K., Anila, M., Ramu, S. C., & Mohan, A. (2025) · International Conference on Advancement in Futuristic Technologies (ICAFT) · doi:10.1109/icaft66710.2025.11452856
“In a study [6],they proposed a method called selective sampling(SeS) to speed up CNN training.”
Computer Vision for Healthcare and Medicine: Unlocking Insights from Visual Data
Ray, A., Firouzi, F., Farahani, B., & Chakrabarty, K. (2026) · Springer eBooks · doi:10.1007/978-3-032-06286-4_5 · Cited by 1
Dixit, R. B., & Jha, C. K. (2026) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-026-07435-6
Metadata
- Authors
- van Grinsven, M. J. J. P., van Ginneken, B., Hoyng, C. B., Theelen, T., & Sanchez, C. I.
- Affiliations
- Radboud University Medical Center (NL)
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2016-05
- Volume
- 35
- Issue
- 5
- Pages
- 1273-1284
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2344912502
- Cited by
- 426
- References
- 51
- Citations by year
- 2026: 7 · 2025: 13 · 2024: 27 · 2023: 41 · 2022: 49 · 2021: 70 · 2020: 57 · 2019: 68 · 2018: 50 · 2017: 38 · 2016: 6
- FWCI
- 46.88
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- IEEE Transactions on Medical Imaging (publishedVersion)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- convolutional neural network training, training efficiency, sample weighting, hemorrhage detection, color fundus images, medical image analysis, training time reduction
- MeSH terms
- Machine Learning, Fundus Oculi, Humans, Image Interpretation, Computer-Assisted, Retinal Hemorrhage, Databases, Factual, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.