The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
An ensemble deep learning based approach for red lesion detection in fundus images
Open accessAbstract
BACKGROUND AND OBJECTIVES Diabetic retinopathy (DR) is one of the leading causes of preventable blindness in the world. Its earliest sign are red lesions, a general term that groups both microaneurysms (MAs) and hemorrhages (HEs). In daily clinical practice, these lesions are manually detected by physicians using fundus photographs. However, this task is tedious and time consuming, and requires an intensive effort due to the small size of the lesions and their lack of contrast. Computer-assisted diagnosis of DR based on red lesion detection is being actively explored due to its improvement effects both in clinicians consistency and accuracy. Moreover, it provides comprehensive feedback that is easy to assess by the physicians. Several methods for detecting red lesions have been proposed in the literature, most of them based on characterizing lesion candidates using hand crafted features, and classifying them into true or false positive detections. Deep learning based approaches, by contrast, are scarce in this domain due to the high expense of annotating the lesions manually. METHODS In this paper we propose a novel method for red lesion detection based on combining both deep learned and domain knowledge. Features learned by a convolutional neural network (CNN) are augmented by incorporating hand crafted features. Such ensemble vector of descriptors is used afterwards to identify true lesion candidates using a Random Forest classifier. RESULTS We empirically observed that combining both sources of information significantly improve results with respect to using each approach separately. Furthermore, our method reported the highest performance on a per-lesion basis on DIARETDB1 and e-ophtha, and for screening and need for referral on MESSIDOR compared to a second human expert. CONCLUSIONS Results highlight the fact that integrating manually engineered approaches with deep learned features is relevant to improve results when the networks are trained from lesion-level annotated data. An open source implementation of our system is publicly available at https://github.com/ignaciorlando/red-lesion-detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · cited 1×
“05) were performed to study the statistical significance of the di ff erences in the AUC values (Hanley and McNeil, 1982).”
MethodGulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
Accelerating t-SNE using tree-based algorithms
van der Maaten, L. (2014) · doi:10.5555/2627435.2697068 · Cited by 2,226
Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification
Soares, J. V. B., Leandro, J. J. G., Cesar, R. M., Jelinek, H. F., & Cree, M. J. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.879967 · Cited by 1,497
Retinal Imaging and Image Analysis
Abramoff, M. D., Garvin, M. K., & Sonka, M. (2010) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2010.2084567 · Cited by 1,439
FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE
Decencière, E., Zhang, X., Cazuguel, G., Lay, B., Cochener, B., Trone, C., Gain, P., Ordonez, R., Massin, P., Erginay, A., et al. (2014) · Image Analysis & Stereology · doi:10.5566/ias.1155 · Cited by 1,424
CNN Features off-the-shelf: an Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · arXiv · doi:10.48550/arxiv.1403.6382 · Cited by 607
Niemeijer, M., van Ginneken, B., Cree, M. J., Mizutani, A., Quellec, G., Sanchez, C. I., Zhang, B., Hornero, R., Lamard, M., Muramatsu, C., et al. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2033909 · Cited by 516
TeleOphta: Machine learning and image processing methods for teleophthalmology
Decencière, E., Cazuguel, G., Zhang, X., Thibault, G., Klein, J.-C., Meyer, F., Marcotegui, B., Quellec, G., Lamard, M., Danno, R., et al. (2013) · IRBM · doi:10.1016/j.irbm.2013.01.010 · Cited by 506
Automatic detection of red lesions in digital color fundus photographs
Niemeijer, M., van Ginneken, B., Staal, J., Suttorp-Schulten, M. S. A., & Abramoff, M. D. (2005) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2005.843738 · Cited by 504
Orlando, J. I., Prokofyeva, E., & Blaschko, M. B. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2535311 · Cited by 503
Self-citationComputer-aided diagnosis of diabetic retinopathy: A review
Mookiah, M. R. K., Acharya, U. R., Chua, C. K., Lim, C. M., Ng, E. Y. K., & Laude, A. (2013) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2013.10.007 · Cited by 430
van Grinsven, M. J. J. P., van Ginneken, B., Hoyng, C. B., Theelen, T., & Sanchez, C. I. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2526689 · Cited by 426
Automatic detection of microaneurysms in color fundus images
Walter, T., Massin, P., Erginay, A., Ordonez, R., Jeulin, C., & Klein, J.-C. (2007) · Medical Image Analysis · doi:10.1016/j.media.2007.05.001 · Cited by 356
Wang, H., Cruz-Roa, A., Basavanhally, A., Gilmore, H., Shih, N., Feldman, M., Tomaszewski, J., Gonzalez, F., & Madabhushi, A. (2014) · Journal of Medical Imaging · doi:10.1117/1.jmi.1.3.034003 · Cited by 349
An Ensemble-Based System for Microaneurysm Detection and Diabetic Retinopathy Grading
Antal, B., & Hajdu, A. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2193126 · Cited by 335
Red Lesion Detection Using Dynamic Shape Features for Diabetic Retinopathy Screening
Seoud, L., Hurtut, T., Chelbi, J., Cheriet, F., & Langlois, J. M. P. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2509785 · Cited by 277
Epidemiology of Major Eye Diseases Leading to Blindness in Europe: A Literature Review
Prokofyeva, E., & Zrenner, E. (2012) · Ophthalmic Research · doi:10.1159/000329603 · Cited by 212
Self-citationUnderstanding the Mechanisms of Deep Transfer Learning for Medical Images
Ravishankar, H., Sudhakar, P., Venkataramani, R., Thiruvenkadam, S., Annangi, P., Babu, N., & Vaidya, V. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_20 · Cited by 189
Validating Retinal Fundus Image Analysis Algorithms: Issues and a Proposal
Trucco, E., Ruggeri, A., Karnowski, T., Giancardo, L., Chaum, E., Hubschman, J. P., al-Diri, B., Cheung, C. Y., Wong, D., Abràmoff, M., et al. (2013) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.12-10347 · Cited by 164
Automatic detection of microaneurysms in retinal fundus images
Wu, B., Zhu, W., Shi, F., Zhu, S., & Chen, X. (2017) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2016.08.001 · Cited by 164
Assessing the Need for Referral in Automatic Diabetic Retinopathy Detection
Pires, R., Jelinek, H. F., Wainer, J., Goldenstein, S. K., Junior, E. A. D. V., & Rocha, A. D. R. (2013) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2278845 · Cited by 68
Automatic detection of referral patients due to retinal pathologies through data mining
Quellec, G., Lamard, M., Erginay, A., Chabouis, A., Massin, P., Cochener, B., & Cazuguel, G. (2016) · Medical Image Anal. · doi:10.1016/j.media.2015.12.006 · Cited by 49
Annunziata, R., & Trucco, E. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2570123 · Cited by 46
Kovarik, J. J., Eller, A. W., Willard, L. A., Ding, J., Johnston, J. M., & Waxman, E. L. (2016) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2015-000164 · Cited by 43
Mass Screening of Diabetic Retinopathy Using Automated Methods
Abràmoff, M. D., & Niemeijer, M. (2014) · Springer eBooks · doi:10.1007/978-3-662-44975-2_4 · Cited by 10
Cited by
Fundus Image Classification Using VGG-19 Architecture with PCA and SVD
Mateen, M., Wen, J., Nasrullah, Song, S., & Huang, Z. (2018) · Symmetry · doi:10.3390/sym11010001 · Cited by 614
Diabetic retinopathy detection through deep learning techniques: A review
Alyoubi, W. L., Shalash, W. M., & Abulkhair, M. F. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100377 · Cited by 527
A Survey on ensemble learning under the era of deep learning
Yang, Y., Lv, H., & Chen, N. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10283-5 · Cited by 369
Deep learning for diabetic retinopathy detection and classification based on fundus images: A review
Tsiknakis, N., Theodoropoulos, D., Manikis, G., Ktistakis, E., Boutsora, O., Berto, A., Scarpa, F., Scarpa, A., Fotiadis, D. I., & Marias, K. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104599 · Cited by 328
A review on deep learning approaches in healthcare systems: Taxonomies, challenges, and open issues
Shamshirband, S., Fathi, M., Dehzangi, A., Chronopoulos, A. T., & Alinejad-Rokny, H. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103627 · Cited by 323
Metadata
- Authors
- Orlando, J. I., Prokofyeva, E., del Fresno, M., & Blaschko, M. B.
- Venue
- Computer Methods and Programs in Biomedicine
- Publisher
- Elsevier BV
- Published
- 2018-01
- Volume
- 153
- Pages
- 115-127
- ISSN
- 0169-2607 (ISSN-L)
- OpenAlex
- W2761617242
- Cited by
- 293
- References
- 27
- FWCI
- 16.28
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.