Detecting multiple retinal diseases in ultra-widefield fundus imaging and data-driven identification of informative regions with deep learning
Open accessAbstract
Advances in ultra-widefield retinal imaging have created a need for automated disease detection. Engelmann and colleagues develop a deep learning model for the detection of retinal diseases. They evaluate it under more realistic conditions than has been considered previously and investigate what regions of ultra-widefield images are important for the performance of such a model.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The AI model was trained on a dataset of 5376 patients (8570 eyes, 13 026 images of Optos 200Tx) and achieved an AUC of 0.9848 (±0.0004) for detecting disease in UWF images on the same evaluation tests.
“This model was trained on a dataset of 5376 patients (8570 eyes, 13 026 images of Optos 200Tx) and achieved an area under the curve (AUC) of 0.9848 (±0.0004)17 for detecting disease in UWF images on the same evaluation tests provided to the students.”
From Using artificial intelligence to improve human performance: efficient retinal disease detection training with synthetic images (2024) · cites this paper as [17]
The AI model achieved an accuracy of 73.3% on UWF images.
“The AI model achieved an accuracy of 73.3%.”
From Using artificial intelligence to improve human performance: efficient retinal disease detection training with synthetic images (2024) · cites this paper as [17]
For SF images, the post-training student accuracy (68.7%) surpassed the state-of-the-art AI model's accuracy of 40%.
“surpassing the state-of-the-art AI model’s 40%”
From Using artificial intelligence to improve human performance: efficient retinal disease detection training with synthetic images (2024) · cites this paper as [17]
The post-training UWF accuracy of students (74.1%) nearly matched the previously published state-of-the-art AI model's accuracy of 73.3%.
“nearly matching the previously published state-of-the-art AI model’s accuracy of 73.3%”
From Using artificial intelligence to improve human performance: efficient retinal disease detection training with synthetic images (2024) · cites this paper as [17]
The AI model's accuracy on SF images dropped to 40%.
“the performance of the AI model, which had only been trained on UWF images, dropped dramatically to just 40%.”
From Using artificial intelligence to improve human performance: efficient retinal disease detection training with synthetic images (2024) · cites this paper as [17]
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · see citing works
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Matplotlib: a 2D graphics environment
Hunter, J. D. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.55 · Cited by 39,249 · see citing works
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138 · see citing works
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473 · see citing works
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513 · see citing works
Harris, C. R., Millman, K. J., van der Walt, S. J., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N. J., et al. (2020) · Nature · doi:10.1038/s41586-020-2649-2 · Cited by 23,826 · see citing works
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741 · see citing works
Harris, C., Millman, K., van der Walt, S., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N., et al. (2020) · RePEc: Research Papers in Economics · Cited by 17,844 · see citing works
seaborn: statistical data visualization
Waskom, M. (2021) · Journal of Open Source Software · doi:10.21105/joss.03021 · Cited by 7,310 · see citing works
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7000 · Cited by 3,617 · see citing works
Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning
Poplin, R., Varadarajan, A. V., Blumer, K., Liu, Y., McConnell, M. V., Corrado, G. S., Peng, L., & Webster, D. R. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0195-0 · Cited by 1,865 · see citing works
Duker, J. S., Kaiser, P. K., Binder, S., de Smet, M. D., Gaudric, A., Reichel, E., Sadda, S. R., Sebag, J., Spaide, R. F., & Stalmans, P. (2013) · Ophthalmology · doi:10.1016/j.ophtha.2013.07.042 · Cited by 1,208 · see citing works
AI for radiographic COVID-19 detection selects shortcuts over signal
DeGrave, A. J., Janizek, J. D., & Lee, S.-I. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00338-7 · Cited by 631 · see citing works
Beede, E., Baylor, E., Hersch, F., Iurchenko, A., Wilcox, L., Ruamviboonsuk, P., & Vardoulakis, L. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376718 · Cited by 614 · see citing works
Krause, J., Gulshan, V., Rahimy, E., Karth, P., Widner, K., Corrado, G. S., Peng, L., & Webster, D. R. (2018) · Ophthalmology · doi:10.1016/j.ophtha.2018.01.034 · Cited by 564 · see citing works
Deep image mining for diabetic retinopathy screening
Quellec, G., Charrière, K., Boudi, Y., Cochener, B., & Lamard, M. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.04.012 · Cited by 526 · see citing works
Khan, S. M., Liu, X., Nath, S., Korot, E., Faes, L., Wagner, S. K., Keane, P. A., Sebire, N. J., Burton, M. J., & Denniston, A. K. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30240-5 · Cited by 335 · see citing works
Revisiting ResNets: Improved Training and Scaling StrategiesPreprint
Bello, I., Fedus, W., Du, X., Cubuk, E. D., Srinivas, A., Lin, T.-Y., Shlens, J., & Zoph, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.07579 · Cited by 257 · see citing works
ULTRA-WIDEFIELD FUNDUS IMAGING
Nagiel, A., Lalane, R. A., Sadda, S. R., et al. (2016) · Retina · doi:10.1097/iae.0000000000000937 · Cited by 221 · see citing works
The economic impact of sight loss and blindness in the UK adult population
Pezzullo, L., Streatfeild, J., Simkiss, P., & Shickle, D. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-2836-0 · Cited by 205 · see citing works
Ohsugi, H., Tabuchi, H., Enno, H., & Ishitobi, N. (2017) · Scientific Reports · doi:10.1038/s41598-017-09891-x · Cited by 144 · see citing works
Deep learning on fundus images detects glaucoma beyond the optic disc
Hemelings, R., Elen, B., Barbosa‐Breda, J., Blaschko, M. B., Boever, P. D., & Stalmans, I. (2021) · Scientific Reports · doi:10.1038/s41598-021-99605-1 · Cited by 113 · see citing works
Ultra-widefield retinal imaging: an update on recent advances
PATEL, S. N., Shi, A., Wibbelsman, T. D., & Klufas, M. A. (2020) · Therapeutic Advances in Ophthalmology · doi:10.1177/2515841419899495 · Cited by 111 · see citing works
Matsuba, S., Tabuchi, H., Ohsugi, H., Enno, H., Ishitobi, N., Masumoto, H., & Kiuchi, Y. (2018) · International Ophthalmology · doi:10.1007/s10792-018-0940-0 · Cited by 90 · see citing works
Nagasato, D., Tabuchi, H., Ohsugi, H., Masumoto, H., Enno, H., Ishitobi, N., Sonobe, T., Kameoka, M., Niki, M., Hayashi, K., et al. (2018) · Journal of Ophthalmology · doi:10.1155/2018/1875431 · Cited by 72 · see citing works
Nagasawa, T., Tabuchi, H., Masumoto, H., Enno, H., Niki, M., Ohara, Z., Yoshizumi, Y., Ohsugi, H., & Mitamura, Y. (2019) · International Ophthalmology · doi:10.1007/s10792-019-01074-z · Cited by 69 · see citing works
Nagasato, D., Tabuchi, H., Ohsugi, H., Masumoto, H., Enno, H., Ishitobi, N., Sonobe, T., Kameoka, M., Niki, M., & Mitamura, Y. (2019) · International Journal of Ophthalmology · doi:10.18240/ijo.2019.01.15 · Cited by 57 · see citing works
Masumoto, H., Tabuchi, H., Nakakura, S., Ohsugi, H., Enno, H., Ishitobi, N., Ohsugi, E., & Mitamura, Y. (2019) · PeerJ · doi:10.7717/peerj.6900 · Cited by 57 · see citing works
Antaki, F., Coussa, R. G., Kahwati, G., et al. (2021) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2021-319030 · Cited by 56 · see citing works
Masumoto, H., Tabuchi, H., Nakakura, S., Ishitobi, N., Miki, M., & Enno, H. (2018) · Journal of Glaucoma · doi:10.1097/ijg.0000000000000988 · Cited by 52 · see citing works
Nagasawa, T., Tabuchi, H., Masumoto, H., Enno, H., Niki, M., Ohsugi, H., & Mitamura, Y. (2018) · PeerJ · doi:10.7717/peerj.5696 · Cited by 43 · see citing works
Factors in Color Fundus Photographs That Can Be Used by Humans to Determine Sex of Individuals
Yamashita, T., Asaoka, R., Terasaki, H., Murata, H., Tanaka, M., Nakao, K., & Sakamoto, T. (2020) · Translational Vision Science & Technology · doi:10.1167/tvst.9.2.4 · Cited by 38 · see citing works
González-Gonzalo, C., Liefers, B. J., van Ginneken, B., & Sánchez, C. I. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2994463 · Cited by 34 · see citing works
Retinal Detachment Screening with Ensembles of Neural Network Models
Masumoto, H., Tabuchi, H., Adachi, S., et al. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21074-8_20 · Cited by 7 · see citing works
Tan, T., Ting, D. S. W., Wong, T. Y., et al. (2020) · Annals of Translational Medicine · doi:10.21037/atm.2020.03.142 · Cited by 5 · see citing works
Tabuchi, H., Masumoto, H., Nakakura, S., et al. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21074-8_18 · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Tabuchi, H., Engelmann, J., Maeda, F., Nishikawa, R., Nagasawa, T., Yamauchi, T., Tanabe, M., Akada, M., Kihara, K., Nakae, Y., et al. (2024) · British Journal of Ophthalmology · doi:10.1136/bjo-2023-324923 · Cited by 22 · see citing works
Self-citation
- Authors
- Engelmann, J., McTrusty, A. D., MacCormick, I. J. C., Pead, E., Storkey, A., & Bernabeu, M. O.
- Affiliations
- University of Edinburgh (GB)
- NHS Education for Scotland (GB)
- Centre for Inflammation Research (GB)
- Venue
- Nature Machine Intelligence
- Published
- 2022-12-08
- Volume
- 4
- Issue
- 12
- Pages
- 1143-1154
- ISSN
- 2522-5839 (ISSN-L)
- OpenAlex
- W4313214568
- Cited by
- 37
- References
- 38
- Citations by year
- 2026: 13 · 2025: 11 · 2024: 8 · 2023: 5
- FWCI
- 3.43
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Nature Machine Intelligence (publishedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
- Health Sciences › Medicine › Ophthalmology › Retinal Diseases and Treatments
- Health Sciences › Medicine › Ophthalmology › Ophthalmology and Visual Health Research
- Keywords
- retinal disease detection, ultra-widefield fundus imaging, automated disease detection, deep learning, interpretability, ocular imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review