The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Deep image mining for diabetic retinopathy screening
Open accessAbstract
HighlightsA ConvNet is trained to detect images with referable diabetic retinopathy (DR).Training is supervised with image‐level annotations only (referable DR or not).Thanks to a modified training procedure, pathological pixels can also be detected.This solution outperforms DR screening systems in a public dataset of 90,000 images.It also outperforms lesion detectors in the DiaretDB1 dataset, for all lesion types. Graphical abstract Figure. No Caption available. ABSTRACT Deep learning is quickly becoming the leading methodology for medical image analysis. Given a large medical archive, where each image is associated with a diagnosis, efficient pathology detectors or classifiers can be trained with virtually no expert knowledge about the target pathologies. However, deep learning algorithms, including the popular ConvNets, are black boxes: little is known about the local patterns analyzed by ConvNets to make a decision at the image level. A solution is proposed in this paper to create heatmaps showing which pixels in images play a role in the image‐level predictions. In other words, a ConvNet trained for image‐level classification can be used to detect lesions as well. A generalization of the backpropagation method is proposed in order to train ConvNets that produce high‐quality heatmaps. The proposed solution is applied to diabetic retinopathy (DR) screening in a dataset of almost 90,000 fundus photographs from the 2015 Kaggle Diabetic Retinopathy competition and a private dataset of almost 110,000 photographs (e‐ophtha). For the task of detecting referable DR, very good detection performance was achieved: Symbol in Kaggle’s dataset and Symbol in e‐ophtha. Performance was also evaluated at the image level and at the lesion level in the DiaretDB1 dataset, where four types of lesions are manually segmented: microaneurysms, hemorrhages, exudates and cotton‐wool spots. For the task of detecting images containing these four lesion types, the proposed detector, which was trained to detect referable DR, outperforms recent algorithms trained to detect those lesions specifically, with pixel‐level supervision. At the lesion level, the proposed detector outperforms heatmap generation algorithms for ConvNets. This detector is part of the Messidor® system for mobile eye pathology screening. Because it does not rely on expert knowledge or manual segmentation for detecting relevant patterns, the proposed solution is a promising image mining tool, which has the potential to discover new biomarkers in images. Symbol. No Caption available. Symbol. No Caption available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
Cited by
Artificial intelligence and deep learning in ophthalmology
Ting, D. S. W., Pasquale, L. R., Peng, L., Campbell, J. P., Lee, A. Y., Raman, R., Tan, G. S. W., Schmetterer, L., Keane, P. A., & Wong, T. Y. (2019) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2018-313173 · Cited by 1,554
Artificial Intelligence and Deep Learning in Ophthalmology
Wang, Z., Keane, P. A., Chiang, M., Cheung, C. Y., Wong, T. Y., & Ting, D. S. W. (2022) · Artificial Intelligence in Medicine · doi:10.1007/978-3-030-64573-1_200 · Cited by 1,524
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3060483 · Cited by 1,477
“Further applications of DNN explanation techniques for medical images include the detection of lesions in diabetic retinopathy data [145], pixelwise analysis of microscopy images from global image annotations [98], the validation of predictions in dermatology [199], and analysis of X-ray images [48].”
BackgroundBurlina, P. M., Joshi, N., Pekala, M., Pacheco, K. D., Freund, D. E., & Bressler, N. M. (2017) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2017.3782 · Cited by 671
A Deep Learning Ensemble Approach for Diabetic Retinopathy Detection
Qummar, S., Khan, F. G., Shah, S., Khan, A., Shamshirband, S., Rehman, Z. U., Ahmed Khan, I., & Jadoon, W. (2019) · IEEE Access · doi:10.1109/access.2019.2947484 · Cited by 622
Fundus Image Classification Using VGG-19 Architecture with PCA and SVD
Mateen, M., Wen, J., Nasrullah, Song, S., & Huang, Z. (2018) · Symmetry · doi:10.3390/sym11010001 · Cited by 614
Diabetic retinopathy detection through deep learning techniques: A review
Alyoubi, W. L., Shalash, W. M., & Abulkhair, M. F. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100377 · Cited by 527
Applications of deep learning in fundus images: A review
Li, T., Bo, W., Hu, C., Kang, H., Liu, H., Wang, K., & Fu, H. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.101971 · Cited by 396
IDRiD: Diabetic Retinopathy – Segmentation and Grading Challenge
Porwal, P., Pachade, S., Kokare, M., Deshmukh, G., Son, J., Bae, W., Liu, L., Wang, J., Liu, X., Gao, L., et al. (2020) · Medical Image Analysis · doi:10.1016/j.media.2019.101561 · Cited by 372
Self-citationDistributed deep learning networks among institutions for medical imaging
Chang, K., Balachandar, N., Lam, C., Yi, D., Brown, J., Beers, A., Rosen, B., Rubin, D. L., & Kalpathy-Cramer, J. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy017 · Cited by 340
Deep learning for diabetic retinopathy detection and classification based on fundus images: A review
Tsiknakis, N., Theodoropoulos, D., Manikis, G., Ktistakis, E., Boutsora, O., Berto, A., Scarpa, F., Scarpa, A., Fotiadis, D. I., & Marias, K. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104599 · Cited by 328
Qiao, L., Zhu, Y., & Zhou, H. (2020) · IEEE Access · doi:10.1109/access.2020.2993937 · Cited by 304
Diabetic retinopathy detection and classification using capsule networks
Kalyani, G., Janakiramaiah, B., Karuna, A., & Prasad, L. V. N. (2023) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00318-9 · Cited by 297
Zeng, X., Chen, H., Luo, Y., & Ye, W. (2019) · IEEE Access · doi:10.1109/access.2019.2903171 · Cited by 288
Deep learning based computer-aided diagnosis systems for diabetic retinopathy: A survey
Asiri, N., Hussain, M., Al Adel, F., & Alzaidi, N. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.07.009 · Cited by 279
Deep Learning Techniques for Diabetic Retinopathy Classification: A Survey
Atwany, M. Z., Sahyoun, A. H., & Yaqub, M. (2022) · IEEE Access · doi:10.1109/access.2022.3157632 · Cited by 266
Federated learning improves site performance in multicenter deep learning without data sharing
Sarma, K. V., Harmon, S., Sanford, T., Roth, H. R., Xu, Z., Tetreault, J., Xu, D., Flores, M. G., Raman, A. G., Kulkarni, R., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa341 · Cited by 242
DR|GRADUATE: uncertainty-aware deep learning-based diabetic retinopathy grading in eye fundus images
Araújo, T., Aresta, G., Mendonça, L., Penas, S., Maia, C., Carneiro, Â., Mendonça, A. M., & Campilho, A. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101715 · Cited by 133
Artificial intelligence promotes the diagnosis and screening of diabetic retinopathy
Huang, X., Wang, H., She, C., Feng, J., Liu, X., Hu, X., Chen, L., & Tao, Y. (2022) · Frontiers in Endocrinology · doi:10.3389/fendo.2022.946915 · Cited by 115
Wu, J.-H., Liu, T. Y. A., Hsu, W.-T., Ho, J. H.-C., & Lee, C.-C. (2021) · Journal of Medical Internet Research · doi:10.2196/23863 · Cited by 108
González-Gonzalo, C., Thee, E. F., Klaver, C. C. W., Lee, A. Y., Schlingemann, R. O., Tufail, A., Verbraak, F., & Sánchez, C. I. (2022) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2021.101034 · Cited by 103
“lesion types relevant to DR and AMD grading (González-Gonzalo et al., 2020a; Quellec et al., 2017).”
Lim, G., Bellemo, V., Xie, Y., Lee, X. Q., Yip, M. Y. T., & Ting, D. S. W. (2020) · Eye and Vision · doi:10.1186/s40662-020-00182-7 · Cited by 96
Elsharkawy, M., Elrazzaz, M., Sharafeldeen, A., Alhalabi, M., Khalifa, F., Soliman, A., Elnakib, A., Mahmoud, A., Ghazal, M., El-Daydamony, E., et al. (2022) · Sensors · doi:10.3390/s22093490 · Cited by 38
“[94], 2017 A DL approach depending on ConvNets and the backpropagation method Grading based on ICDR severity scale Detection performance was 95.”
MethodEngelmann, J., McTrusty, A. D., MacCormick, I. J. C., Pead, E., Storkey, A., & Bernabeu, M. O. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00566-5 · Cited by 37
Metadata
- Authors
- Quellec, G., Charrière, K., Boudi, Y., Cochener, B., & Lamard, M.
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2017-07
- Volume
- 39
- Pages
- 178-193
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W2952436003
- Cited by
- 520
- References
- 49
- FWCI
- 29.54
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.