The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Evaluation of a System for Automatic Detection of Diabetic Retinopathy From Color Fundus Photographs in a Large Population of Patients With Diabetes
Open accessAbstract
OBJECTIVE—To evaluate the performance of a system for automated detection of diabetic retinopathy in digital retinal photographs, built from published algorithms, in a large, representative, screening population. RESEARCH DESIGN AND METHODS—We conducted a retrospective analysis of 10,000 consecutive patient visits, specifically exams (four retinal photographs, two left and two right) from 5,692 unique patients from the EyeCheck diabetic retinopathy screening project imaged with three types of cameras at 10 centers. Inclusion criteria included no previous diagnosis of diabetic retinopathy, no previous visit to ophthalmologist for dilated eye exam, and both eyes photographed. One of three retinal specialists evaluated each exam as unacceptable quality, no referable retinopathy, or referable retinopathy. We then selected exams with sufficient image quality and determined presence or absence of referable retinopathy. Outcome measures included area under the receiver operating characteristic curve (number needed to miss one case [NNM]) and type of false negative. RESULTS—Total area under the receiver operating characteristic curve was 0.84, and NNM was 80 at a sensitivity of 0.84 and a specificity of 0.64. At this point, 7,689 of 10,000 exams had sufficient image quality, 4,648 of 7,689 (60%) were true negatives, 59 of 7,689 (0.8%) were false negatives, 319 of 7,689 (4%) were true positives, and 2,581 of 7,689 (33%) were false positives. Twenty-seven percent of false negatives contained large hemorrhages and/or neovascularizations. CONCLUSIONS—Automated detection of diabetic retinopathy using published algorithms cannot yet be recommended for clinical practice. However, performance is such that evaluation on validated, publicly available datasets should be pursued. If algorithms can be improved, such a system may in the future lead to improved prevention of blindness and vision loss in patients with diabetes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2007) · Developments in Ophthalmology · doi:10.1159/isbn.978-3-318-01439-6 · Cited by 5,583
Ridge-based vessel segmentation in color images of the retina
Staal, J., Abramoff, M. D., Niemeijer, M., Viergever, M. A., & van Ginneken, B. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2004.825627 · Cited by 4,202
Self-citationWilkinson, C. P., Ferris, F. L., Klein, R. E., Lee, P. P., Agardh, C. D., Davis, M., Dills, D., Kampik, A., Pararajasegaram, R., & Verdaguer, J. T. (2003) · Ophthalmology · doi:10.1016/s0161-6420(03)00475-5 · Cited by 3,743
Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response
Hoover, A. D., Kouznetsova, V., & Goldbaum, M. (2000) · IEEE Transactions on Medical Imaging · doi:10.1109/42.845178 · Cited by 2,582
Early Photocoagulation for Diabetic Retinopathy
(1991) · Ophthalmology · doi:10.1016/s0161-6420(13)38011-7 · Cited by 1,259
Fong, D. S., Aiello, L., Gardner, T. W., King, G. L., Blankenship, G., Cavallerano, J. D., Ferris, F. L., Klein, R., & for the American Diabetes Association (2004) · Diabetes Care · doi:10.2337/diacare.27.2007.s84 · Cited by 1,082
Fundus Photographic Risk Factors for Progression of Diabetic Retinopathy
(1991) · Ophthalmology · doi:10.1016/s0161-6420(13)38014-2 · Cited by 814
Comparative study of retinal vessel segmentation methods on a new publicly available database
Niemeijer, M., Staal, J., van Ginneken, B., Loog, M., & Abramoff, M. D. (2004) · SPIE Proceedings · doi:10.1117/12.535349 · Cited by 790
Self-citationLocating the optic nerve in a retinal image using the fuzzy convergence of the blood vessels
Hoover, A., & Goldbaum, M. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.815900 · Cited by 787
Retinal image analysis: Concepts, applications and potential
Patton, N., Aslam, T. M., MacGillivray, T., Deary, I. J., Dhillon, B., Eikelboom, R. H., Yogesan, K., & Constable, I. J. (2006) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2005.07.001 · Cited by 641
Fong, D. S., Aiello, L. P., Ferris, F. L., & Klein, R. (2004) · Diabetes Care · doi:10.2337/diacare.27.10.2540 · Cited by 640
Automated Feature Extraction in Color Retinal Images by a Model Based Approach
Li, H., & Chutatape, O. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2003.820400 · Cited by 545
Automated detection of diabetic retinopathy on digital fundus images
Sinthanayothin, C., Boyce, J. F., Williamson, T. H., Cook, H. L., Mensah, E., Lal, S., & Usher, D. (2002) · Diabetic Medicine · doi:10.1046/j.1464-5491.2002.00613.x · Cited by 509
Automatic detection of diabetic retinopathy using an artificial neural network: a screening tool.
Gardner, G. G., Keating, D., Williamson, T. H., & Elliott, A. T. (1996) · British Journal of Ophthalmology · doi:10.1136/bjo.80.11.940 · Cited by 508
Automatic detection of red lesions in digital color fundus photographs
Niemeijer, M., van Ginneken, B., Staal, J., Suttorp-Schulten, M. S. A., & Abramoff, M. D. (2005) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2005.843738 · Cited by 504
Self-citationNiemeijer, M., van Ginneken, B., Russell, S. R., Suttorp-Schulten, M. S. A., & Abra`moff, M. D. (2007) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.06-0996 · Cited by 400
Self-citationLin, D. Y., Blumenkranz, M. S., Brothers, R. J., & Grosvenor, D. M. (2002) · American Journal of Ophthalmology · doi:10.1016/s0002-9394(02)01522-2 · Cited by 327
Spencer, T., Olson, J. A., McHardy, K. C., Sharp, P. F., & Forrester, J. V. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0021 · Cited by 305
Usher, D., Dumskyj, M., Himaga, M., Williamson, T. H., Nussey, S., & Boyce, J. (2004) · Diabetic Medicine · doi:10.1046/j.1464-5491.2003.01085.x · Cited by 299
Single-field fundus photography for diabetic retinopathy screening
Williams, G. A., Scott, I. U., Haller, J. A., Maguire, A. M., Marcus, D., & McDonald, H. R. (2004) · Ophthalmology · doi:10.1016/j.ophtha.2004.02.004 · Cited by 266
Ophthalmic Examination Among Adults With Diagnosed Diabetes Mellitus
Brechner, R. J. (1993) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1993.03510140074032 · Cited by 258
Automated identification of diabetic retinal exudates in digital colour images
Osareh, A. (2003) · British Journal of Ophthalmology · doi:10.1136/bjo.87.10.1220 · Cited by 254
Abra`moff, M. D., Alward, W. L. M., Greenlee, E. C., Shuba, L., Kim, C. Y., Fingert, J. H., & Kwon, Y. H. (2007) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.06-1081 · Cited by 236
Self-citationFong, D. S., Aiello, L., Gardner, T. W., King, G. L., Blankenship, G., Cavallerano, J. D., Ferris, F. L., Klein, R., & American Diabetes Association (2003) · Diabetes Care · doi:10.2337/diacare.26.1.226 · Cited by 233
Philip, S., Fleming, A. D., Goatman, K. A., Fonseca, S., Mcnamee, P., Scotland, G. S., Prescott, G. J., Sharp, P. F., & Olson, J. A. (2007) · British Journal of Ophthalmology · doi:10.1136/bjo.2007.119453 · Cited by 225
Detection of Diabetic Macular Edema
Kinyoun, J., Barton, F., Fisher, M., Hubbard, L., Aiello, L., & Ferris, F. (1989) · Ophthalmology · doi:10.1016/s0161-6420(89)32814-4 · Cited by 211
Hipwell, J. H., Strachan, F., Olson, J. A., McHardy, K. C., Sharp, P. F., & Forrester, J. V. (2000) · Diabetic Medicine · doi:10.1046/j.1464-5491.2000.00338.x · Cited by 177
Bresnick, G. H., Mukamel, D. B., Dickinson, J. C., & Cole, D. R. (2000) · Ophthalmology · doi:10.1016/s0161-6420(99)00010-x · Cited by 163
Automated Detection of Fundus Photographic Red Lesions in Diabetic Retinopathy
Larsen, M., Godt, J., Larsen, N. B., Lund‐Andersen, H., Sjølie, A. K., Agardh, E., Kalm, H., Grunkin, M., & Owens, D. R. (2003) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.02-0418 · Cited by 149
Niemeijer, M., Abràmoff, M. D., & van Ginneken, B. (2006) · Medical Image Analysis · doi:10.1016/j.media.2006.09.006 · Cited by 146
Self-citationWeb-Based Screening for Diabetic Retinopathy in a Primary Care Population: The EyeCheck Project
Abràmoff, M. D., & Suttorp-Schulten, M. S. A. (2005) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2005.11.668 · Cited by 128
Self-citationWilson, C., Horton, M. B., Cavallerano, J. D., & Aiello, L. M. (2005) · Diabetes Care · doi:10.2337/diacare.28.2.318 · Cited by 100
Telehealth Practice Recommendations for Diabetic Retinopathy
Prepared by the American Telemedicine Association, O. T. S. I. G. (2004) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2004.10.469 · Cited by 94
Abràmoff, M. D., & Niemeijer, M. (2006) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2006.259622 · Cited by 67
Self-citationJoslin Vision Network Validation Study: pilot image stabilization phase.
Aiello, L. M., Bursell, S., Cavallerano, J. D., et al. (1998) · PubMed · Cited by 24
Chia, D. S. Y., & Yap, E. (2004) · PubMed · Cited by 24
Olson, J. A., Sharp, P. F., Fleming, A., & Philip, S. (2008) · Diabetes Care · doi:10.2337/dc08-0827 · Cited by 17
Cited by
Ting, D. S. W., Cheung, C. Y.-L., Lim, G., Tan, G. S. W., Quang, N. D., Gan, A., Hamzah, H., Garcia-Franco, R., San Yeo, I. Y., Lee, S. Y., et al. (2017) · JAMA · doi:10.1001/jama.2017.18152 · Cited by 2,402
Abràmoff, M. D., Lavin, P. T., Birch, M., Shah, N., & Folk, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0040-6 · Cited by 1,638
Self-citationArtificial intelligence and deep learning in ophthalmology
Ting, D. S. W., Pasquale, L. R., Peng, L., Campbell, J. P., Lee, A. Y., Raman, R., Tan, G. S. W., Schmetterer, L., Keane, P. A., & Wong, T. Y. (2019) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2018-313173 · Cited by 1,554
Artificial Intelligence and Deep Learning in Ophthalmology
Wang, Z., Keane, P. A., Chiang, M., Cheung, C. Y., Wong, T. Y., & Ting, D. S. W. (2022) · Artificial Intelligence in Medicine · doi:10.1007/978-3-030-64573-1_200 · Cited by 1,524
Retinal Imaging and Image Analysis
Abramoff, M. D., Garvin, M. K., & Sonka, M. (2010) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2010.2084567 · Cited by 1,439
Self-citation
Metadata
- Authors
- Abràmoff, M. D., Niemeijer, M., Suttorp-Schulten, M. S. A., Viergever, M. A., Russell, S. R., & van Ginneken, B.
- Venue
- Diabetes Care
- Publisher
- American Diabetes Association
- Published
- 2008-02-01
- Volume
- 31
- Issue
- 2
- Pages
- 193-198
- ISSN
- 0149-5992 (ISSN-L)
- 1935-5548
- OpenAlex
- W2136289855
- Cited by
- 277
- References
- 38
- FWCI
- 16.49
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.