The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Comparative study of retinal vessel segmentation methods on a new publicly available database
Abstract
In this work we compare the performance of a number of vessel segmentation algorithms on a newly constructed retinal vessel image database. Retinal vessel segmentation is important for the detection of numerous eye diseases and plays an important role in automatic retinal disease screening systems. A large number of methods for retinal vessel segmentation have been published, yet an evaluation of these methods on a common database of screening images has not been performed. To compare the performance of retinal vessel segmentation methods we have constructed a large database of retinal images. The database contains forty images in which the vessel trees have been manually segmented. For twenty of those forty images a second independent manual segmentation is available. This allows for a comparison between the performance of automatic methods and the performance of a human observer. The database is available to the research community. Interested researchers are encouraged to upload their segmentation results to our website (http://www.isi.uu.nl/Research/Databases). The performance of five different algorithms has been compared. Four of these methods have been implemented as described in the literature. The fifth pixel classification based method was developed specifically for the segmentation of retinal vessels and is the only supervised method in this test. We define the segmentation accuracy with respect to our gold standard as the performance measure. Results show that the pixel classification method performs best, but the second observer still performs significantly better.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response
Hoover, A. D., Kouznetsova, V., & Goldbaum, M. (2000) · IEEE Transactions on Medical Imaging · doi:10.1109/42.845178 · Cited by 2,582
Detection of blood vessels in retinal images using two-dimensional matched filters
Chaudhuri, S., Chatterjee, S., Katz, N., Nelson, M., & Goldbaum, M. (1989) · IEEE Transactions on Medical Imaging · doi:10.1109/42.34715 · Cited by 1,668
ROC Methodology in Radiologic Imaging
METZ, C. E. (1986) · Investigative Radiology · doi:10.1097/00004424-198609000-00009 · Cited by 1,642
Shiraishi, J., Katsuragawa, S., Ikezoe, J., Matsumoto, T., Kobayashi, T., Komatsu, K.-I., Matsui, M., Fujita, H., Kodera, Y., & Doi, K. (2000) · American Journal of Roentgenology · doi:10.2214/ajr.174.1.1740071 · Cited by 1,004
Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation
Zana, F., & Klein, J.-C. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.931095 · Cited by 862
Current Status of the Digital Database for Screening Mammography
Heath, M., Bowyer, K., Kopans, D., Kegelmeyer, P., Moore, R., Chang, K., & Munishkumaran, S. (1998) · Computational Imaging and Vision · doi:10.1007/978-94-011-5318-8_75 · Cited by 787
Locating the optic nerve in a retinal image using the fuzzy convergence of the blood vessels
Hoover, A., & Goldbaum, M. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.815900 · Cited by 787
Jiang, X., & Mojon, D. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1159954 · Cited by 679
Cited by
Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification
Soares, J. V. B., Leandro, J. J. G., Cesar, R. M., Jelinek, H. F., & Cree, M. J. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.879967 · Cited by 1,497
An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation
Fraz, M. M., Remagnino, P., Hoppe, A., Uyyanonvara, B., Rudnicka, A. R., Owen, C. G., & Barman, S. A. (2012) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2205687 · Cited by 1,031
Blood vessel segmentation methodologies in retinal images – A survey
Fraz, M. M., Remagnino, P., Hoppe, A., Uyyanonvara, B., Rudnicka, A. R., Owen, C. G., & Barman, S. A. (2012) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2012.03.009 · Cited by 1,001
Marín, D., Aquino, A., Gegundez-Arias, M. E., & Bravo, J. M. (2011) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2064333 · Cited by 929
Mendonca, A. M., & Campilho, A. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.879955 · Cited by 921
DUNet: A deformable network for retinal vessel segmentation
Jin, Q., Meng, Z., Pham, T. D., Chen, Q., Wei, L., & Su, R. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.04.025 · Cited by 867
Retinal Blood Vessel Segmentation Using Line Operators and Support Vector Classification
Ricci, E., & Perfetti, R. (2007) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2007.898551 · Cited by 818
Trainable COSFIRE filters for vessel delineation with application to retinal images
Azzopardi, G., Strisciuglio, N., Vento, M., & Petkov, N. (2015) · Medical Image Analysis · doi:10.1016/j.media.2014.08.002 · Cited by 713
Robust Vessel Segmentation in Fundus Images
Budai, A., Bock, R., Maier, A., Hornegger, J., & Michelson, G. (2013) · International Journal of Biomedical Imaging · doi:10.1155/2013/154860 · Cited by 642
A Cross-Modality Learning Approach for Vessel Segmentation in Retinal Images
Li, Q., Feng, B., Xie, L., Liang, P., Zhang, H., & Wang, T. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2457891 · Cited by 571
Niemeijer, M., van Ginneken, B., Cree, M. J., Mizutani, A., Quellec, G., Sanchez, C. I., Zhang, B., Hornero, R., Lamard, M., Muramatsu, C., et al. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2033909 · Cited by 516
Self-citationRetinal vessel extraction by matched filter with first-order derivative of Gaussian
Zhang, B., Zhang, L., Zhang, L., & Karray, F. (2010) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2010.02.008 · Cited by 505
Automatic detection of red lesions in digital color fundus photographs
Niemeijer, M., van Ginneken, B., Staal, J., Suttorp-Schulten, M. S. A., & Abramoff, M. D. (2005) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2005.843738 · Cited by 504
Self-citationOrlando, J. I., Prokofyeva, E., & Blaschko, M. B. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2535311 · Cited by 503
An effective retinal blood vessel segmentation method using multi-scale line detection
Nguyen, U. T. V., Bhuiyan, A., Park, L. A. F., & Ramamohanarao, K. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2012.08.009 · Cited by 479
Youssif, A. A.-H. A.-R., Ghalwash, A. Z., & Ghoneim, A. A. S. A.-R. (2008) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2007.900326 · Cited by 441
Kwon, Y., Won, J.-H., Kim, B. J., & Paik, M. C. (2020) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2019.106816 · Cited by 424
An Active Contour Model for Segmenting and Measuring Retinal Vessels
Al-Diri, B., Hunter, A., & Steel, D. (2009) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2017941 · Cited by 431
Computer-aided diagnosis of diabetic retinopathy: A review
Mookiah, M. R. K., Acharya, U. R., Chua, C. K., Lim, C. M., Ng, E. Y. K., & Laude, A. (2013) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2013.10.007 · Cited by 430
Robust Retinal Vessel Segmentation via Locally Adaptive Derivative Frames in Orientation Scores
Zhang, J., Dashtbozorg, B., Bekkers, E., Pluim, J. P. W., Duits, R., & ter Haar Romeny, B. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2587062 · Cited by 417
Hierarchical retinal blood vessel segmentation based on feature and ensemble learning
Wang, S., Yin, Y., Cao, G., Wei, B., Zheng, Y., & Yang, G. (2015) · Neurocomputing · doi:10.1016/j.neucom.2014.07.059 · Cited by 390
Segmentation of retinal blood vessels using the radial projection and semi-supervised approach
You, X., Peng, Q., Yuan, Y., Cheung, Y.-M., & Lei, J. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.01.007 · Cited by 387
Glaucoma risk index:Automated glaucoma detection from color fundus images
Bock, R., Meier, J., Nyúl, L. G., Hornegger, J., & Michelson, G. (2010) · Medical Image Analysis · doi:10.1016/j.media.2009.12.006 · Cited by 361
FABC: Retinal Vessel Segmentation Using AdaBoost
Lupascu, C. A., Tegolo, D., & Trucco, E. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2010.2052282 · Cited by 352
Hu, K., Zhang, Z., Niu, X., Zhang, Y., Cao, C., Xiao, F., & Gao, X. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.011 · Cited by 349
An approach to localize the retinal blood vessels using bit planes and centerline detection
Fraz, M. M., Barman, S. A., Remagnino, P., Hoppe, A., Basit, A., Uyyanonvara, B., Rudnicka, A. R., & Owen, C. G. (2012) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2011.08.009 · Cited by 340
Fast Retinal Vessel Detection and Measurement Using Wavelets and Edge Location Refinement
Bankhead, P., Scholfield, C. N., McGeown, J. G., & Curtis, T. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032435 · Cited by 337
Blood Vessel Segmentation of Fundus Images by Major Vessel Extraction and Sub-Image Classification
Roychowdhury, S., Koozekanani, D., & Parhi, K. (2014) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2335617 · Cited by 336
Retinal Vessel Centerline Extraction Using Multiscale Matched Filters, Confidence and Edge Measures
Sofka, M., & Stewart, C. V. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.884190 · Cited by 334
Exudate-based diabetic macular edema detection in fundus images using publicly available datasets
Giancardo, L., Meriaudeau, F., Karnowski, T. P., Li, Y., Garg, S., Tobin, K. W., & Chaum, E. (2012) · Medical Image Analysis · doi:10.1016/j.media.2011.07.004 · Cited by 322
DENSE-INception U-net for medical image segmentation
Zhang, Z., Wu, C., Coleman, S., & Kerr, D. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105395 · Cited by 318
Miri, M. S., & Mahloojifar, A. (2011) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2097599 · Cited by 309
An improved matched filter for blood vessel detection of digital retinal images
Al-Rawi, M., Qutaishat, M., & Arrar, M. (2007) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2006.03.003 · Cited by 305
Retinal vessel segmentation based on Fully Convolutional Neural Networks
Oliveira, A., Pereira, S., & Silva, C. A. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.06.034 · Cited by 299
Going Deep in Medical Image Analysis: Concepts, Methods, Challenges, and Future Directions
Altaf, F., Islam, S. M. S., Akhtar, N., & Janjua, N. K. (2019) · IEEE Access · doi:10.1109/access.2019.2929365 · Cited by 286
Iterative Vessel Segmentation of Fundus Images
Roychowdhury, S., Koozekanani, D. D., & Parhi, K. K. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2403295 · Cited by 282
Abràmoff, M. D., Niemeijer, M., Suttorp-Schulten, M. S. A., Viergever, M. A., Russell, S. R., & van Ginneken, B. (2008) · Diabetes Care · doi:10.2337/dc07-1312 · Cited by 277
Self-citationGeneral Retinal Vessel Segmentation Using Regularization-Based Multiconcavity Modeling
Lam, B. S. Y., Gao, Y., & Liew, A. W.-C. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2043259 · Cited by 275
Lightweight Attention Convolutional Neural Network for Retinal Vessel Image Segmentation
Li, X., Jiang, Y., Li, M., & Yin, S. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2993842 · Cited by 265
Dasgupta, A., & Singh, S. (2017) · 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017) · doi:10.1109/isbi.2017.7950512 · Cited by 260
Metadata
- Authors
- Niemeijer, M., Staal, J., van Ginneken, B., Loog, M., & Abramoff, M. D.
- Venue
- SPIE Proceedings
- Publisher
- SPIE
- Published
- 2004-05-12
- Volume
- 5370
- Pages
- 648
- ISSN
- 0277-786X (ISSN-L)
- OpenAlex
- W2018593404
- Cited by
- 790
- References
- 13
- FWCI
- 40.98
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.