The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Deep image mining for diabetic retinopathy screening
Open accessAbstract
HighlightsA ConvNet is trained to detect images with referable diabetic retinopathy (DR).Training is supervised with image‐level annotations only (referable DR or not).Thanks to a modified training procedure, pathological pixels can also be detected.This solution outperforms DR screening systems in a public dataset of 90,000 images.It also outperforms lesion detectors in the DiaretDB1 dataset, for all lesion types. Graphical abstract Figure. No Caption available. ABSTRACT Deep learning is quickly becoming the leading methodology for medical image analysis. Given a large medical archive, where each image is associated with a diagnosis, efficient pathology detectors or classifiers can be trained with virtually no expert knowledge about the target pathologies. However, deep learning algorithms, including the popular ConvNets, are black boxes: little is known about the local patterns analyzed by ConvNets to make a decision at the image level. A solution is proposed in this paper to create heatmaps showing which pixels in images play a role in the image‐level predictions. In other words, a ConvNet trained for image‐level classification can be used to detect lesions as well. A generalization of the backpropagation method is proposed in order to train ConvNets that produce high‐quality heatmaps. The proposed solution is applied to diabetic retinopathy (DR) screening in a dataset of almost 90,000 fundus photographs from the 2015 Kaggle Diabetic Retinopathy competition and a private dataset of almost 110,000 photographs (e‐ophtha). For the task of detecting referable DR, very good detection performance was achieved: Symbol in Kaggle’s dataset and Symbol in e‐ophtha. Performance was also evaluated at the image level and at the lesion level in the DiaretDB1 dataset, where four types of lesions are manually segmented: microaneurysms, hemorrhages, exudates and cotton‐wool spots. For the task of detecting images containing these four lesion types, the proposed detector, which was trained to detect referable DR, outperforms recent algorithms trained to detect those lesions specifically, with pixel‐level supervision. At the lesion level, the proposed detector outperforms heatmap generation algorithms for ConvNets. This detector is part of the Messidor® system for mobile eye pathology screening. Because it does not rely on expert knowledge or manual segmentation for detecting relevant patterns, the proposed solution is a promising image mining tool, which has the potential to discover new biomarkers in images. Symbol. No Caption available. Symbol. No Caption available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Wilkinson, C. P., Ferris, F. L., Klein, R. E., Lee, P. P., Agardh, C. D., Davis, M., Dills, D., Kampik, A., Pararajasegaram, R., & Verdaguer, J. T. (2003) · Ophthalmology · doi:10.1016/s0161-6420(03)00475-5 · Cited by 3,743
Retinal Imaging and Image Analysis
Abramoff, M. D., Garvin, M. K., & Sonka, M. (2010) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2010.2084567 · Cited by 1,439
Understanding Neural Networks Through Deep Visualization
Yosinski, J., Clune, J., Nguyen, A. M., Fuchs, T. J., & Lipson, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06579 · Cited by 1,358
Evaluating the Visualization of What a Deep Neural Network Has Learned
Samek, W., Binder, A., Montavon, G., Lapuschkin, S., & Muller, K.-R. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2599820 · Cited by 1,164
Abràmoff, M. D., Lou, Y., Erginay, A., Clarida, W., Amelon, R., Folk, J. C., & Niemeijer, M. (2016) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.16-19964 · Cited by 1,101
the DIARETDB1 diabetic retinopathy database and evaluation protocol
Kauppi, T., Kalesnykiene, V., Kamarainen, J.-K., Lensu, L., Sorri, I., Raninen, A., Voutilainen, R., Uusitalo, H., Kalviainen, H., & Pietila, J. (2007) · Procedings of the British Machine Vision Conference 2007 · doi:10.5244/c.21.15 · Cited by 854
ImageNet classification with deep convolutional neural networks
Krizhevsky (2012) · Medical Entomology and Zoology · Cited by 799
A Cross-Modality Learning Approach for Vessel Segmentation in Retinal Images
Li, Q., Feng, B., Xie, L., Liang, P., Zhang, H., & Wang, T. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2457891 · Cited by 571
Neural Networks and Deep Learning
(2016) · Computer Age Statistical Inference · doi:10.1017/cbo9781316576533.019 · Cited by 509
van Grinsven, M. J. J. P., van Ginneken, B., Hoyng, C. B., Theelen, T., & Sanchez, C. I. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2526689 · Cited by 426
Glaucoma detection based on deep convolutional neural network
Chen, X., Xu, Y., Kee Wong, D. W., Wong, T. Y., & Liu, J. (2015) · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318462 · Cited by 412
EyePACS: An Adaptable Telemedicine System for Diabetic Retinopathy Screening
Cuadros, J., & Bresnick, G. (2009) · Journal of Diabetes Science and Technology · doi:10.1177/193229680900300315 · Cited by 390
Graham, B. (2014) · arXiv · doi:10.48550/arxiv.1412.6071 · Cited by 337
Algorithms for digital image processing in diabetic retinopathy
Winder, R. J., Morrow, P. J., McRitchie, I. N., Bailie, J. R., & Hart, P. M. (2009) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2009.06.003 · Cited by 248
Multiple-Instance Learning for Medical Image and Video Analysis
Quellec, G., Cazuguel, G., Cochener, B., & Lamard, M. (2017) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2017.2651164 · Cited by 245
Self-citationAutomatic Feature Learning for Glaucoma Detection Based on Deep Learning
Chen, X., Xu, Y., Yan, S., Wong, D. W. K., Wong, T. Y., & Liu, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_80 · Cited by 160
Detection of age-related macular degeneration via deep learning
Burlina, P., Freund, D., Joshi, N., Wolfson, Y., & Bressler, N. M. (2016) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493240 · Cited by 152
Maji, D., Santara, A., Mitra, P., & Sheet, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.04833 · Cited by 145
Melendez, J., van Ginneken, B., Maduskar, P., Philipsen, R. H. H. M., Reither, K., Breuninger, M., Adetifa, I., Maane, R., Ayles, H., & Sánchez, C. I. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2350539 · Cited by 136
Improved Microaneurysm Detection using Deep Neural NetworksPreprint
Haloi, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.04424 · Cited by 125
Multi-retinal disease classification by reduced deep learning features
Arunkumar, R., & Karthigaikumar, P. (2015) · Neural Computing and Applications · doi:10.1007/s00521-015-2059-9 · Cited by 116
Integrated Optic Disc and Cup Segmentation with Deep Learning
Lim, G., Cheng, Y., Hsu, W., & Lee, M. L. (2015) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2015.36 · Cited by 113
A multiple-instance learning framework for diabetic retinopathy screening
Quellec, G., Lamard, M., Abràmoff, M. D., Decencière, É., Laÿ, B., Erginay, A., Cochener, B., & Cazuguel, G. (2012) · Medical Image Analysis · doi:10.1016/j.media.2012.06.003 · Cited by 105
Self-citationFast Wavelet-Based Image Characterization for Highly Adaptive Image Retrieval
Quellec, G., Lamard, M., Cazuguel, G., Cochener, B., & Roux, C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2180915 · Cited by 104
Self-citationAutomated Retinopathy of Prematurity Case Detection with Convolutional Neural Networks
Worrall, D. E., Wilson, C. M., & Brostow, G. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46976-8_8 · Cited by 102
Multiple-Instance Learning for Anomaly Detection in Digital Mammography
Quellec, G., Lamard, M., Cozic, M., Coatrieux, G., & Cazuguel, G. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2521442 · Cited by 87
Self-citationMaji, D., Santara, A., Ghosh, S., Sheet, D., & Mitra, P. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7319030 · Cited by 85
Detection of exudates in fundus photographs using convolutional neural networks
Prentašić, P., & Lončarić, S. (2015) · International symposium on image and signal processing and analysis/ISPA ... · doi:10.1109/ispa.2015.7306056 · Cited by 71
Deep learning approach for diabetic retinopathy screening
Colás, E. R., Besse, A., Orgogozo, A., Schmauch, B., Meric, N., & Besse, E. (2016) · Acta Ophthalmologica · doi:10.1111/j.1755-3768.2016.0635 · Cited by 54
Proceedings - International Conference on Tools with Artificial Intelligence, ICTAI
Bakhtiari, A., & Bouguila, N. (2011) · Cited by 54
Automatic detection of referral patients due to retinal pathologies through data mining
Quellec, G., Lamard, M., Erginay, A., Chabouis, A., Massin, P., Cochener, B., & Cazuguel, G. (2016) · Medical Image Anal. · doi:10.1016/j.media.2015.12.006 · Cited by 49
Self-citationOPHDIAT©: Quality-assurance programme plan and performance of the network
Erginay, A., Chabouis, A., Viens-Bitker, C., Robert, N., Lecleire-Collet, A., & Massin, P. (2008) · Diabetes & Metabolism · doi:10.1016/j.diabet.2008.01.004 · Cited by 31
Suitability of a Low-Cost, Handheld, Nonmydriatic Retinograph for Diabetic Retinopathy Diagnosis
Quellec, G., Bazin, L., Cazuguel, G., Delafoy, I., Cochener, B., & Lamard, M. (2016) · Translational Vision Science & Technology · doi:10.1167/tvst.5.2.16 · Cited by 30
Self-citationDetection of Red lesions in diabetic retinopathy affected fundus images
Mane, V. M., Kawadiwale, R. B., & Jadhav, D. V. (2015) · IEEE International Advance Computing Conference · doi:10.1109/iadcc.2015.7154668 · Cited by 29
Detection of hemorrhages in diabetic retinopathy analysis using color fundus images
Bharali, P., Medhi, J. P., & Nirmala, S. R. (2015) · IEEE International Conference on Recent Trends in Information Systems · doi:10.1109/retis.2015.7232884 · Cited by 21
Fundus Lesion Detection Based on Visual Attention Model
Dai, B., Bu, W., Wang, K., & Wu, X. (2016) · Communications in computer and information science · doi:10.1007/978-981-10-2053-7_34 · Cited by 6
Cited by
Artificial intelligence and deep learning in ophthalmology
Ting, D. S. W., Pasquale, L. R., Peng, L., Campbell, J. P., Lee, A. Y., Raman, R., Tan, G. S. W., Schmetterer, L., Keane, P. A., & Wong, T. Y. (2019) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2018-313173 · Cited by 1,554
Artificial Intelligence and Deep Learning in Ophthalmology
Wang, Z., Keane, P. A., Chiang, M., Cheung, C. Y., Wong, T. Y., & Ting, D. S. W. (2022) · Artificial Intelligence in Medicine · doi:10.1007/978-3-030-64573-1_200 · Cited by 1,524
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3060483 · Cited by 1,477
“Further applications of DNN explanation techniques for medical images include the detection of lesions in diabetic retinopathy data [145], pixelwise analysis of microscopy images from global image annotations [98], the validation of predictions in dermatology [199], and analysis of X-ray images [48].”
BackgroundBurlina, P. M., Joshi, N., Pekala, M., Pacheco, K. D., Freund, D. E., & Bressler, N. M. (2017) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2017.3782 · Cited by 671
A Deep Learning Ensemble Approach for Diabetic Retinopathy Detection
Qummar, S., Khan, F. G., Shah, S., Khan, A., Shamshirband, S., Rehman, Z. U., Ahmed Khan, I., & Jadoon, W. (2019) · IEEE Access · doi:10.1109/access.2019.2947484 · Cited by 622
Metadata
- Authors
- Quellec, G., Charrière, K., Boudi, Y., Cochener, B., & Lamard, M.
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2017-07
- Volume
- 39
- Pages
- 178-193
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W2952436003
- Cited by
- 520
- References
- 49
- FWCI
- 29.54
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.