Detecting glaucoma based on spectral domain optical coherence tomography imaging of peripapillary retinal nerve fiber layer: a comparison study between hand-crafted features and deep learning model
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Purpose To develop a deep learning (DL) model for automated detection of glaucoma and to compare diagnostic capability against hand-craft features (HCFs) based on spectral domain optical coherence tomography (SD-OCT) peripapillary retinal nerve fiber layer (pRNFL) images.Methods A DL model with pre-trained convolutional neural network (CNN) based was trained using a retrospective training set of 1501 pRNFL OCT images, which included 690 images from 153 glaucoma patients and 811 images from 394 normal subjects. The DL model was further tested in an independent test set of 50 images from 50 glaucoma patients and 52 images from 52 normal subjects. A customized software was used to extract and measure HCFs including pRNFL thickness in average and four different sectors. Area under the receiver operator characteristics (AROC) curves was calculated to compare the diagnostic capability between DL model and hand-crafted pRNFL parameters.Results In this study, the DL model achieved an AROC of 0.99 [CI: 0.97 to 1.00] which was significantly larger than the AROC values of all other HCFs (AROCs 0.661 with 95% CI 0.549 to 0.772 for temporal sector, AROCs 0.696 with 95% CI 0.549 to 0.799 for nasal sector, AROCs 0.913 with 95% CI 0.855 to 0.970 for superior sector, AROCs 0.938 with 95% CI 0.894 to 0.982 for inferior sector, and AROCs 0.895 with 95% CI 0.832 to 0.957 for average).Conclusion Our study demonstrated that DL models based on pre-trained CNN are capable of identifying glaucoma with high sensitivity and specificity based on SD-OCT pRNFL images.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Only eight studies14–21 used prospectively collected data”
From Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis (2021) · cites this paper as [20]
Citations
Cites
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428 · cited 1×
“To visualize the most predictive features for detecting glaucomatous pRNFL changes, a class activation map (CAM) was used to open the “ black box ” of DL model [19].”
MethodGulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., & Summers, R. M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.369 · Cited by 4,616 · cited 1×
“Transfer learning has proven to be a highly effective technique and been widely used in multiple medical domains with limited data [7, 23].”
MethodThe Pathophysiology and Treatment of Glaucoma: A Review
Weinreb, R. N., Aung, T., & Medeiros, F. A. (2014) · JAMA · doi:10.1001/jama.2014.3192 · Cited by 4,210
Lakhani, P., & Sundaram, B. (2017) · Radiology · doi:10.1148/radiol.2017162326 · Cited by 1,775
Quigley, H. A. (2011) · The Lancet · doi:10.1016/s0140-6736(10)61423-7 · Cited by 1,121
Medeiros, F. A., Zangwill, L. M., Bowd, C., Vessani, R. M., Susanna, R., & Weinreb, R. N. (2005) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2004.08.069 · Cited by 649
Multi-scale Convolutional Neural Networks for Lung Nodule Classification
Shen, W., Zhou, M., Yang, F., Yang, C., & Tian, J. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-19992-4_46 · Cited by 592
Retinal Nerve Fiber Layer Imaging with Spectral-Domain Optical Coherence Tomography
Leung, C. K.-S., Cheung, C. Y.-L., Weinreb, R. N., Qiu, Q., Liu, S., Li, H., Xu, G., Fan, N., Huang, L., Pang, C.-P., et al. (2009) · Ophthalmology · doi:10.1016/j.ophtha.2009.04.013 · Cited by 486
Self-citationAsaoka, R., Murata, H., Hirasawa, K., Fujino, Y., Matsuura, M., Miki, A., Kanamoto, T., Ikeda, Y., Mori, K., Iwase, A., et al. (2019) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2018.10.007 · Cited by 254
Seong, M., Sung, K. R., Choi, E. H., Kang, S. Y., Cho, J. W., Um, T. W., Kim, Y. J., Park, S. B., Hong, H. E., & Kook, M. S. (2010) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.09-4258 · Cited by 252
Detecting Preperimetric Glaucoma with Standard Automated Perimetry Using a Deep Learning Classifier
Asaoka, R., Murata, H., Iwase, A., & Araie, M. (2016) · Ophthalmology · doi:10.1016/j.ophtha.2016.05.029 · Cited by 248
Knight, O. J., Chang, R. T., Feuer, W. J., & Budenz, D. L. (2009) · Ophthalmology · doi:10.1016/j.ophtha.2008.12.032 · Cited by 199
Tong, X., Chen, J., Miao, H., Li, T., & Zhang, L. (2016) · PLOS ONE · doi:10.1371/journal.pone.0156823 · Cited by 199
Rao, H. L., Zangwill, L. M., Weinreb, R. N., Sample, P. A., Alencar, L. M., & Medeiros, F. A. (2010) · Ophthalmology · doi:10.1016/j.ophtha.2010.01.031 · Cited by 180
Le, M. H., Chen, J., Wang, L., Wang, Z., Liu, W., Cheng, K.-T. (., & Yang, X. (2017) · Physics in Medicine & Biology · doi:10.1088/1361-6560/aa7731 · Cited by 161
Shabana, N., Aquino, M. C., See, J. L. S., Zheng, C., Tan, A. M., Nolan, W. P., Hitchings, R. A., Young, S. M., Loon, S. C., Sng, C. C. A., et al. (2012) · Clinical and Experimental Ophthalmology · doi:10.1111/j.1442-9071.2012.02805.x · Cited by 115
Self-citationSung, K. R., Kim, J. S., Wollstein, G., Folio, L., Kook, M. S., & Schuman, J. S. (2010) · British Journal of Ophthalmology · doi:10.1136/bjo.2010.186924 · Cited by 101
Vermeer, K. A., van der Schoot, J., Lemij, H. G., & de Boer, J. F. (2012) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.12-9933 · Cited by 81
Xu, H., Zhai, R., Zong, Y., Kong, X., Jiang, C., Sun, X., He, Y., & Li, X. (2018) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-018-3930-z · Cited by 59
Rolle, T., Briamonte, C., Curto, D., & Grignolo, F. M. (2011) · Clinical ophthalmology · doi:10.2147/opth.s20249 · Cited by 52
Kim, S. Y., Park, H.-Y. L., & Park, C. K. (2012) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.12-9682 · Cited by 20
Chen, B., Gao, E., Chen, H., Yang, J., Shi, F., Zheng, C., Zhu, W., Xiang, D., Chen, X., & Zhang, M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0148183 · Cited by 10
Self-citationDeterminants of pupil diameters and pupil dynamics in an adult Chinese population
Zheng, C., de Leon, J. M. S., Cheung, C. Y.-L., Narayanaswamy, A., Ong, S. H., Tan, C. W. T., Chew, P., Perera, S., Wong, T. Y., & Aung, T. (2016) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-016-3272-7 · Cited by 8
Self-citation
Research works printed but not linked: 1
- Yosinski J, Clune J, Nguyen A, et al. (2015) Understanding neural networks through deep visualization. arXiv preprint. https://arxiv.org/abs/1506.06579. Published June 22, 2015. Accessed Augest 12, 2019 · arXiv
Cited by
Transfer learning for medical image classification: a literature review
Kim, H. E., Cosa-Linan, A., Santhanam, N., Jannesari, M., Maros, M. E., & Ganslandt, T. (2022) · BMC Medical Imaging · doi:10.1186/s12880-022-00793-7 · Cited by 965
Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis
Aggarwal, R., Sounderajah, V., Martin, G., Ting, D. S. W., Karthikesalingam, A., King, D., Ashrafian, H., & Darzi, A. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00438-z · Cited by 946
Digital technology, tele-medicine and artificial intelligence in ophthalmology: A global perspective
Li, J.-P. O., Liu, H., Ting, D. S. J., Jeon, S., Chan, R. V. P., Kim, J. E., Sim, D. A., Thomas, P. B. M., Lin, H., Chen, Y., et al. (2021) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2020.100900 · Cited by 626
“…practice is expected to revolu-tionise the current disease management process, improve early detection and there are hopes that it will ultimately improve outcomes (Balyen and Peto, 2019; Tan et al., 2019), although the cost-effectiveness of these systems remain unclear (Xie et al., 2020).”
InfluentialArtificial intelligence in glaucoma: opportunities, challenges, and future directions
Huang, X., Islam, M. R., Prome, S. A., Ahmed, F., Kazami, E., Serhan, H. A. A., Abd-Alrazaq, A. A., & Yousefi, S. (2023) · BioMedical Engineering OnLine · doi:10.1186/s12938-023-01187-8 · Cited by 82
Applications of deep learning in detection of glaucoma: A systematic review
Mirzania, D., Thompson, A. C., & Muir, K. W. (2020) · European Journal of Ophthalmology · doi:10.1177/1120672120977346 · Cited by 79
“Overall, the majority of studies focused on differentiation of glaucoma from non-glaucoma, 92,100,102 while the study by Thompson et al. 93 tested their DL algorithm across different levels of disease severity.”
Background
Metadata
- Authors
- Zheng, C., Xie, X., Huang, L., Chen, B., Yang, J., Lu, J., Qiao, T., Fan, Z., & Zhang, M.
- Affiliations
- Chinese University of Hong Kong (HK)
- Shantou University (CN)
- Shanghai Jiao Tong University (CN)
- Corresponding author
- Zhang, Mingzhi
- Venue
- Graefe's Archive for Clinical and Experimental Ophthalmology
- Published
- 2019-12-07
- Volume
- 258
- Issue
- 3
- Pages
- 577-585
- ISSN
- 0721-832X (ISSN-L)
- 1435-702X
- OpenAlex
- W2993661103
- Cited by
- 40
- References
- 27
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 8 · 2023: 5 · 2022: 12 · 2021: 8 · 2020: 3
- FWCI
- 3.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Graefe s Archive for Clinical and Experimental Ophthalmology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Natural Science Foundation of China (81371010)
- Clinical Research Funds of Shantou University Medical College (20130101)
- Topics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Retinal Imaging and Analysis
- Health Sciences › Medicine › Ophthalmology › Glaucoma and retinal disorders
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- glaucoma detection, peripapillary retinal nerve fiber layer, spectral-domain optical coherence tomography, deep learning, convolutional neural networks, handcrafted features, automated diagnosis, pre-trained convolutional neural networks
- MeSH terms
- Deep Learning, Adolescent, Adult, Aged, Aged, 80 and over, Female, Glaucoma, Humans, Intraocular Pressure, Male, Middle Aged, Nerve Fibers, Optic Disk, Prospective Studies, Retinal Ganglion Cells, Visual Fields, Tomography, Optical Coherence, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.