The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Artificial Intelligence to Detect Papilledema from Ocular Fundus Photographs
Open accessAbstract
BACKGROUND: Nonophthalmologist physicians do not confidently perform direct ophthalmoscopy. The use of artificial intelligence to detect papilledema and other optic-disk abnormalities from fundus photographs has not been well studied. METHODS: We trained, validated, and externally tested a deep-learning system to classify optic disks as being normal or having papilledema or other abnormalities from 15,846 retrospectively collected ocular fundus photographs that had been obtained with pharmacologic pupillary dilation and various digital cameras in persons from multiple ethnic populations. Of these photographs, 14,341 from 19 sites in 11 countries were used for training and validation, and 1505 photographs from 5 other sites were used for external testing. Performance at classifying the optic-disk appearance was evaluated by calculating the area under the receiver-operating-characteristic curve (AUC), sensitivity, and specificity, as compared with a reference standard of clinical diagnoses by neuro-ophthalmologists. RESULTS: The training and validation data sets from 6779 patients included 14,341 photographs: 9156 of normal disks, 2148 of disks with papilledema, and 3037 of disks with other abnormalities. The percentage classified as being normal ranged across sites from 9.8 to 100%; the percentage classified as having papilledema ranged across sites from zero to 59.5%. In the validation set, the system discriminated disks with papilledema from normal disks and disks with nonpapilledema abnormalities with an AUC of 0.99 (95% confidence interval [CI], 0.98 to 0.99) and normal from abnormal disks with an AUC of 0.99 (95% CI, 0.99 to 0.99). In the external-testing data set of 1505 photographs, the system had an AUC for the detection of papilledema of 0.96 (95% CI, 0.95 to 0.97), a sensitivity of 96.4% (95% CI, 93.9 to 98.3), and a specificity of 84.7% (95% CI, 82.3 to 87.1). CONCLUSIONS: A deep-learning system using fundus photographs with pharmacologically dilated pupils differentiated among optic disks with papilledema, normal disks, and disks with nonpapilledema abnormalities. (Funded by the Singapore National Medical Research Council and the SingHealth Duke-NUS Ophthalmology and Visual Sciences Academic Clinical Program.).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579
Ting, D. S. W., Cheung, C. Y.-L., Lim, G., Tan, G. S. W., Quang, N. D., Gan, A., Hamzah, H., Garcia-Franco, R., San Yeo, I. Y., Lee, S. Y., et al. (2017) · JAMA · doi:10.1001/jama.2017.18152 · Cited by 2,402
Self-citationLiu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883
Abràmoff, M. D., Lavin, P. T., Birch, M., Shah, N., & Folk, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0040-6 · Cited by 1,638
Li, Z., He, Y., Keel, S., Meng, W., Chang, R. T., & He, M. (2018) · Ophthalmology · doi:10.1016/j.ophtha.2018.01.023 · Cited by 830
Wong, T. Y., & Mitchell, P. (2004) · New England Journal of Medicine · doi:10.1056/nejmra032865 · Cited by 696
Self-citationDeep learning in ophthalmology: The technical and clinical considerations
Ting, D. S. W., Peng, L., Varadarajan, A. V., Keane, P. A., Burlina, P. M., Chiang, M. F., Schmetterer, L., Pasquale, L. R., Bressler, N. M., Webster, D. R., et al. (2019) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2019.04.003 · Cited by 534
Self-citationHow to Read Articles That Use Machine Learning: Users’ Guides to the Medical Literature
Liu, Y., Chen, P.-H. C., Krause, J., & Peng, L. (2019) · JAMA · doi:10.1001/jama.2019.16489 · Cited by 516
Self-citationLiu, H., Li, L., Wormstone, I. M., Qiao, C., Zhang, C., Liu, P., Li, S., Wang, H., Mou, D., Pang, R., et al. (2019) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2019.3501 · Cited by 307
Self-citationWith an eye to AI and autonomous diagnosis
Keane, P. A., & Topol, E. J. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0048-y · Cited by 304
Medeiros, F. A., Jammal, A. A., & Thompson, A. C. (2019) · Ophthalmology · doi:10.1016/j.ophtha.2018.12.033 · Cited by 249
The Current State of Teleophthalmology in the United States
Rathi, S., Tsui, E., Mehta, N., Zahid, S., & Schuman, J. S. (2017) · Ophthalmology · doi:10.1016/j.ophtha.2017.05.026 · Cited by 248
Bhaskaranand, M., Ramachandra, C., Bhat, S., Cuadros, J., Nittala, M. G., Sadda, S. R., & Solanki, K. (2019) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2019.0164 · Cited by 211
Papilledema: epidemiology, etiology, and clinical management
Lee, A., Rigi, M., Almarzouqi, S., & Morgan, M. (2015) · Eye and Brain · doi:10.2147/eb.s69174 · Cited by 163
The demise of direct ophthalmoscopy: A modern clinical challenge
Mackay, D. D., Garza, P. S., Bruce, B. B., Newman, N. J., & Biousse, V. (2015) · Neurology Clinical Practice · doi:10.1212/cpj.0000000000000115 · Cited by 160
Self-citationIs retinal photography useful in the measurement of stroke risk?
Yin Wong, T. (2004) · The Lancet Neurology · doi:10.1016/s1474-4422(04)00682-9 · Cited by 159
Nonmydriatic Ocular Fundus Photography in the Emergency Department
Bruce, B. B., Lamirel, C., Wright, D. W., Ward, A., Heilpern, K., Biousse, V., & Newman, N. J. (2011) · New England Journal of Medicine · doi:10.1056/nejmc1009733 · Cited by 152
Self-citationDecision Support System for Detection of Papilledema through Fundus Retinal Images
Akbar, S., Akram, M. U., Sharif, M., Tariq, A., & Yasin, U. U. (2017) · Journal of Medical Systems · doi:10.1007/s10916-017-0712-9 · Cited by 81
When and How to Investigate the Patient with Headache
DeLuca, G. C., & Bartleson, J. D. (2010) · Seminars in Neurology · doi:10.1055/s-0030-1249221 · Cited by 79
Accuracy of machine learning for differentiation between optic neuropathies and pseudopapilledema
Ahn, J. M., Kim, S., Ahn, K., Cho, S., & Kim, U. S. (2019) · BMC Ophthalmology · doi:10.1186/s12886-019-1184-0 · Cited by 64
Headache in the Emergency Department
Tabatabai, R. R., & Swadron, S. P. (2016) · Emergency Medicine Clinics of North America · doi:10.1016/j.emc.2016.06.003 · Cited by 46
Liu, T. Y. A., Ting, D. S. W., Yi, P. H., Wei, J., Zhu, H., Subramanian, P. S., Li, T., Hui, F. K., Hager, G. D., & Miller, N. R. (2019) · Journal of Neuro-Ophthalmology · doi:10.1097/wno.0000000000000827 · Cited by 43
Self-citationFeasibility of a Nonmydriatic Ocular Fundus Camera in an Outpatient Neurology Clinic
Irani, N. K., Bidot, S., Peragallo, J. H., Esper, G. J., Newman, N. J., & Biousse, V. (2020) · The Neurologist · doi:10.1097/nrl.0000000000000259 · Cited by 28
Self-citationFeasibility of the Digital Retinography System Camera in the Pediatric Emergency Department
Ivan, Y., Ramgopal, S., Cardenas-Villa, M., Winger, D. G., Wang, L., Vitale, M., & Saladino, R. A. (2017) · Pediatric Emergency Care · doi:10.1097/pec.0000000000001203 · Cited by 17
Keane, P., & Topol, E. (2019) · The Lancet · doi:10.1016/s0140-6736(19)33051-x · Cited by 7
Cited by
Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-021-01614-0 · Cited by 3,212
Artificial intelligence and deep learning in ophthalmology
Ting, D. S. W., Pasquale, L. R., Peng, L., Campbell, J. P., Lee, A. Y., Raman, R., Tan, G. S. W., Schmetterer, L., Keane, P. A., & Wong, T. Y. (2019) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2018-313173 · Cited by 1,554
Self-citationArtificial Intelligence and Deep Learning in Ophthalmology
Wang, Z., Keane, P. A., Chiang, M., Cheung, C. Y., Wong, T. Y., & Ting, D. S. W. (2022) · Artificial Intelligence in Medicine · doi:10.1007/978-3-030-64573-1_200 · Cited by 1,524
Self-citationLi, J., Chen, J., Tang, Y., Wang, C., Landman, B. A., & Zhou, S. K. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102762 · Cited by 389
Self-citationCen, L.-P., Ji, J., Lin, J.-W., Ju, S.-T., Lin, H.-J., Li, T.-P., Wang, Y., Yang, J.-F., Liu, Y.-F., Tan, S., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-25138-w · Cited by 346
Self-citation
Metadata
- Authors
- Milea, D., Najjar, R. P., Jiang, Z., Ting, D., Vasseneix, C., Xu, X., Aghsaei Fard, M., Fonseca, P., Vanikieti, K., Lagrèze, W. A., La Morgia, C., Cheung, C. Y., Hamann, S., Chiquet, C., Sanda, N., Yang, H., Mejico, L. J., Rougier, M.-B., Kho, R., Tran, T. H. C., Singhal, S., Gohier, P., Clermont-Vignal, C., Cheng, C.-Y., Jonas, J. B., Yu-Wai-Man, P., Fraser, C. L., Chen, J. J., Ambika, S., Miller, N. R., Liu, Y., Newman, N. J., Wong, T. Y., & Biousse, V.
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2020-04-30
- Volume
- 382
- Issue
- 18
- Pages
- 1687-1695
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W3015487562
- Cited by
- 348
- References
- 27
- FWCI
- 21.52
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.