The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Retinopathy Online Challenge: Automatic Detection of Microaneurysms in Digital Color Fundus Photographs
Open accessAbstract
The detection of microaneurysms in digital color fundus photographs is a critical first step in automated screening for diabetic retinopathy (DR), a common complication of diabetes. To accomplish this detection numerous methods have been published in the past but none of these was compared with each other on the same data. In this work we present the results of the first international microaneurysm detection competition, organized in the context of the Retinopathy Online Challenge (ROC), a multiyear online competition for various aspects of DR detection. For this competition, we compare the results of five different methods, produced by five different teams of researchers on the same set of data. The evaluation was performed in a uniform manner using an algorithm presented in this work. The set of data used for the competition consisted of 50 training images with available reference standard and 50 test images where the reference standard was withheld by the organizers (M. Niemeijer, B. van Ginneken, and M. D. Abràmoff). The results obtained on the test data was submitted through a website after which standardized evaluation software was used to determine the performance of each of the methods. A human expert detected microaneurysms in the test set to allow comparison with the performance of the automatic methods. The overall results show that microaneurysm detection is a challenging task for both the automatic methods as well as the human expert. There is room for improvement as the best performing system does not reach the performance of the human expert. The data associated with the ROC microaneurysm detection competition will remain publicly available and the website will continue accepting submissions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740
Ridge-based vessel segmentation in color images of the retina
Staal, J., Abramoff, M. D., Niemeijer, M., Viergever, M. A., & van Ginneken, B. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2004.825627 · Cited by 4,202
Self-citationLocating blood vessels in retinal images by piecewise threshold probing of a matched filter response
Hoover, A. D., Kouznetsova, V., & Goldbaum, M. (2000) · IEEE Transactions on Medical Imaging · doi:10.1109/42.845178 · Cited by 2,582
Morphological grayscale reconstruction in image analysis: applications and efficient algorithms
Vincent, L. (1993) · IEEE Transactions on Image Processing · doi:10.1109/83.217222 · Cited by 1,923
ROC Methodology in Radiologic Imaging
METZ, C. E. (1986) · Investigative Radiology · doi:10.1097/00004424-198609000-00009 · Cited by 1,642
Comparison and evaluation of methods for liver segmentation from CT datasets
Heimann, T., van Ginneken, B., Styner, M. A., Arzhaeva, Y., Aurich, V., Bauer, C., Beck, A., Becker, C., Beichel, R., Bekes, G., et al. (2009) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2013851 · Cited by 1,135
Self-citationComparative study of retinal vessel segmentation methods on a new publicly available database
Niemeijer, M., Staal, J., van Ginneken, B., Loog, M., & Abramoff, M. D. (2004) · SPIE Proceedings · doi:10.1117/12.535349 · Cited by 790
Self-citationLocating the optic nerve in a retinal image using the fuzzy convergence of the blood vessels
Hoover, A., & Goldbaum, M. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.815900 · Cited by 787
Fluorescein Angiography Complication Survey
Yannuzzi, L. A., Rohrer, K. T., Tindel, L. J., Sobel, R. S., Costanza, M. A., Shields, W., & Zang, E. (1986) · Ophthalmology · doi:10.1016/s0161-6420(86)33697-2 · Cited by 606
Automated detection of diabetic retinopathy on digital fundus images
Sinthanayothin, C., Boyce, J. F., Williamson, T. H., Cook, H. L., Mensah, E., Lal, S., & Usher, D. (2002) · Diabetic Medicine · doi:10.1046/j.1464-5491.2002.00613.x · Cited by 509
Automatic detection of red lesions in digital color fundus photographs
Niemeijer, M., van Ginneken, B., Staal, J., Suttorp-Schulten, M. S. A., & Abramoff, M. D. (2005) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2005.843738 · Cited by 504
Self-citationFree-response methodology: alternate analysis and a new observer-performance experiment.
Chakraborty, D. P., & Winter, L. H. (1990) · Radiology · doi:10.1148/radiology.174.3.2305073 · Cited by 363
Automatic detection of microaneurysms in color fundus images
Walter, T., Massin, P., Erginay, A., Ordonez, R., Jeulin, C., & Klein, J.-C. (2007) · Medical Image Analysis · doi:10.1016/j.media.2007.05.001 · Cited by 356
Optimal Wavelet Transform for the Detection of Microaneurysms in Retina Photographs
Quellec, G., Lamard, M., Josselin, P. M., Cazuguel, G., Cochener, B., & Roux, C. (2008) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2008.920619 · Cited by 343
Self-citationSpencer, T., Olson, J. A., McHardy, K. C., Sharp, P. F., & Forrester, J. V. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0021 · Cited by 305
Abràmoff, M. D., Niemeijer, M., Suttorp-Schulten, M. S. A., Viergever, M. A., Russell, S. R., & van Ginneken, B. (2008) · Diabetes Care · doi:10.2337/dc07-1312 · Cited by 277
Self-citationAn economic analysis of interventions for diabetes.
Klonoff, D. C., & Schwartz, D. M. (2000) · Diabetes Care · doi:10.2337/diacare.23.3.390 · Cited by 267
Philip, S., Fleming, A. D., Goatman, K. A., Fonseca, S., Mcnamee, P., Scotland, G. S., Prescott, G. J., Sharp, P. F., & Olson, J. A. (2007) · British Journal of Ophthalmology · doi:10.1136/bjo.2007.119453 · Cited by 225
Frame, A. J., Undrill, P. E., Cree, M. J., Olson, J. A., McHardy, K. C., Sharp, P. F., & Forrester, J. V. (1998) · Computers in Biology and Medicine · doi:10.1016/s0010-4825(98)00011-0 · Cited by 215
Self-citationBunch, P. C., Hamilton, J. F., Sanderson, G. K., & Simmons, A. H. (1977) · SPIE Proceedings · doi:10.1117/12.955926 · Cited by 212
Hipwell, J. H., Strachan, F., Olson, J. A., McHardy, K. C., Sharp, P. F., & Forrester, J. V. (2000) · Diabetic Medicine · doi:10.1046/j.1464-5491.2000.00338.x · Cited by 177
Bresnick, G. H., Mukamel, D. B., Dickinson, J. C., & Cole, D. R. (2000) · Ophthalmology · doi:10.1016/s0161-6420(99)00010-x · Cited by 163
Web-Based Screening for Diabetic Retinopathy in a Primary Care Population: The EyeCheck Project
Abràmoff, M. D., & Suttorp-Schulten, M. S. A. (2005) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2005.11.668 · Cited by 128
Information Fusion for Diabetic Retinopathy CAD in Digital Color Fundus Photographs
Niemeijer, M., Abràmoff, M. D., & van Ginneken, B. (2009) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2008.2012029 · Cited by 125
Self-citationBayesian Object Localisation in Images
Sullivan, J., Blake, A., Isard, M., & MacCormick, J. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011818912717 · Cited by 66
Cited by
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
Retinal Imaging and Image Analysis
Abramoff, M. D., Garvin, M. K., & Sonka, M. (2010) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2010.2084567 · Cited by 1,439
Self-citationFEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE
Decencière, E., Zhang, X., Cazuguel, G., Lay, B., Cochener, B., Trone, C., Gain, P., Ordonez, R., Massin, P., Erginay, A., et al. (2014) · Image Analysis & Stereology · doi:10.5566/ias.1155 · Cited by 1,424
Self-citationBlood vessel segmentation methodologies in retinal images – A survey
Fraz, M. M., Remagnino, P., Hoppe, A., Uyyanonvara, B., Rudnicka, A. R., Owen, C. G., & Barman, S. A. (2012) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2012.03.009 · Cited by 1,001
Evaluation of prostate segmentation algorithms for mri: The promise12 challenge
Litjens, G., Toth, R., van de Ven, W., Hoeks, C., Kerkstra, S., van Ginneken, B., Vincent, G., Guillard, G., Birbeck, N., Zhang, J., et al. (2014) · Medical Image Analysis · doi:10.1016/j.media.2013.12.002 · Cited by 857
Metadata
- Authors
- Niemeijer, M., van Ginneken, B., Cree, M. J., Mizutani, A., Quellec, G., Sanchez, C. I., Zhang, B., Hornero, R., Lamard, M., Muramatsu, C., Wu, X., Cazuguel, G., You, J., Mayo, A., Li, Q., Hatanaka, Y., Cochener, B., Roux, C., Karray, F., Garcia, M., Fujita, H., & Abramoff, M. D.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2010-01
- Volume
- 29
- Issue
- 1
- Pages
- 185-195
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2107871626
- Cited by
- 516
- References
- 25
- FWCI
- 16.91
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.