The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Reducing the Hausdorff Distance in Medical Image Segmentation With Convolutional Neural Networks
Open accessAbstract
The Hausdorff Distance (HD) is widely used in evaluating medical image segmentation methods. However, the existing segmentation methods do not attempt to reduce HD directly. In this paper, we present novel loss functions for training convolutional neural network (CNN)-based segmentation methods with the goal of reducing HD directly. We propose three methods to estimate HD from the segmentation probability map produced by a CNN. One method makes use of the distance transform of the segmentation boundary. Another method is based on applying morphological erosion on the difference between the true and estimated segmentation maps. The third method works by applying circular/spherical convolution kernels of different radii on the segmentation probability maps. Based on these three methods for estimating HD, we suggest three loss functions that can be used for training to reduce HD. We use these loss functions to train CNNs for segmentation of the prostate, liver, and pancreas in ultrasound, magnetic resonance, and computed tomography images and compare the results with commonly-used loss functions. Our results show that the proposed loss functions can lead to approximately 18-45% reduction in HD without degrading other segmentation performance criteria such as the Dice similarity coefficient. The proposed loss functions can be used for training medical image segmentation methods in order to reduce the large segmentation errors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Kass, M., Witkin, A., & Terzopoulos, D. (1988) · International Journal of Computer Vision · doi:10.1007/bf00133570 · Cited by 17,070
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931 · cited 2×
“We used three standard data augmentation methods: 1) adding random noise to images, 2) random cropping, 3) random elastic deformations [29], [31].”
BackgroundMethod3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
N4ITK: Improved N3 Bias Correction
Tustison, N. J., Avants, B. B., Cook, P. A., Zheng, Y., Egan, A., Yushkevich, P. A., & Gee, J. C. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2046908 · Cited by 6,073
Caselles, V., Kimmel, R., & Sapiro, G. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007979827043 · Cited by 5,244
Comparing images using the Hausdorff distance
Huttenlocher, D. P., Klanderman, G. A., & Rucklidge, W. J. (1993) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.232073 · Cited by 4,545
Computer vision: algorithms and applications
(2011) · Choice Reviews Online · doi:10.5860/choice.48-5140 · Cited by 3,911
Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool
Taha, A. A., & Hanbury, A. (2015) · BMC Medical Imaging · doi:10.1186/s12880-015-0068-x · Cited by 2,920
A Mathematical Introduction to Compressive Sensing
Foucart, S., & Rauhut, H. (2013) · Applied and Numerical Harmonic Analysis · doi:10.1007/978-0-8176-4948-7 · Cited by 2,548
A modified Hausdorff distance for object matching
Dubuisson, M.-P., & Jain, A. K. (2002) · Proceedings of 12th International Conference on Pattern Recognition · doi:10.1109/icpr.1994.576361 · Cited by 1,464
Statistical shape models for 3D medical image segmentation: A review
Heimann, T., & Meinzer, H.-P. (2009) · Medical Image Analysis · doi:10.1016/j.media.2009.05.004 · Cited by 1,417
Tversky Loss Function for Image Segmentation Using 3D Fully Convolutional Deep Networks
Salehi, S. S. M., Erdogmus, D., & Gholipour, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67389-9_44 · Cited by 1,086
Maurer, C. R., Qi, R., & Raghavan, V. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1177156 · Cited by 911
Evaluation of prostate segmentation algorithms for mri: The promise12 challenge
Litjens, G., Toth, R., van de Ven, W., Hoeks, C., Kerkstra, S., van Ginneken, B., Vincent, G., Guillard, G., Birbeck, N., Zhang, J., et al. (2014) · Medical Image Analysis · doi:10.1016/j.media.2013.12.002 · Cited by 857
Deeplysupervised netsPreprint
Lee, C., Xie, S., Gallagher, P., Zhang, Z., & Tu, Z. (2015) · Cited by 849
Interactive medical image segmentation using deep learning with image-specific fine tuning
Wang, G., Li, W., Zuluaga, M. A., Pratt, R., Patel, P. A., Aertsen, M., Doel, T., David, A. L., Deprest, J., Ourselin, S., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2791721 · Cited by 843 · cited 1×
“of convolutional neural network (CNN)-based segmentation algorithms in recent years, great progress has been made in reducing the performance gap between automatic and manual segmentation methods [3], [4].”
BackgroundGeneralized Overlap Measures for Evaluation and Validation in Medical Image Analysis
Crum, W. R., Camara, O., & Hill, D. L. G. (2006) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2006.880587 · Cited by 776 · cited 1×
“The performance of automatic segmentation methods is usually evaluated by computing some common objective criteria such as the Dice similarity coefficient (DSC), mean boundary distance, volume difference or overlap, and Hausdorff Distance (HD) [5], [6].”
MethodDeep Learning using Linear Support Vector Machines
Tang, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.0239 · Cited by 708
Christ, P. F., Elshaer, M. E. A., Ettlinger, F., Tatavarty, S., Bickel, M., Bilic, P., Rempfler, M., Armbruster, M., Hofmann, F., D’Anastasi, M., et al. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_48 · Cited by 625
On Loss Functions for Deep Neural Networks in Classification
Janocha, K., & Czarnecki, W. M. (2017) · Schedae Informaticae · doi:10.4467/20838476si.16.004.6185 · Cited by 591
An Efficient Algorithm for Calculating the Exact Hausdorff Distance
Taha, A. A., & Hanbury, A. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2408351 · Cited by 411
Construction of an abdominal probabilistic atlas and its application in segmentation
Park, H., Bland, P. H., & Meyer, C. R. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.809139 · Cited by 328
Roth, H. R., Lu, L., Lay, N., Harrison, A. P., Farag, A., Sohn, A., & Summers, R. M. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.01.006 · Cited by 325
A Fixed-Point Model for Pancreas Segmentation in Abdominal CT Scans
Zhou, Y., Xie, L., Shen, W., Wang, Y., Fishman, E. K., & Yuille, A. L. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_79 · Cited by 275
Retinal vessel segmentation via deep learning network and fully-connected conditional random fields
Fu, H., Xu, Y., Wong, D. W. K., & Liu, J. (2016) · 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493362 · Cited by 274
Object matching algorithms using robust Hausdorff distance measures
Sim, D., Kwon, O., & Park, R. (1999) · IEEE Transactions on Image Processing · doi:10.1109/83.748897 · Cited by 265
Medical image segmentation on GPUs – A comprehensive review
Smistad, E., Falch, T. L., Bozorgi, M., Elster, A. C., & Lindseth, F. (2015) · Medical Image Analysis · doi:10.1016/j.media.2014.10.012 · Cited by 264 · cited 1×
“mentation performance, segmentation algorithms rarely aim at minimizing or reducing HD directly [8], [9].”
BackgroundAn accurate and efficient Bayesian method for automatic segmentation of brain MRI
Marroquin, J. L., Vemuri, B. C., Botello, S., Calderon, E., & Fernandez-Bouzas, A. (2002) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2002.803119 · Cited by 251
Deep vessel segmentation by learning graphical connectivity
Shin, S. Y., Lee, S., Yun, I. D., & Lee, K. M. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101556 · Cited by 250
Hashemi, S. R., Mohseni Salehi, S. S., Erdogmus, D., Prabhu, S. P., Warfield, S. K., & Gholipour, A. (2019) · IEEE Access · doi:10.1109/access.2018.2886371 · Cited by 212
Benchmark on Automatic Six-Month-Old Infant Brain Segmentation Algorithms: The iSeg-2017 Challenge
Wang, L., Nie, D., Li, G., Puybareau, E., Dolz, J., Zhang, Q., Wang, F., Xia, J., Wu, Z., Chen, J.-W., et al. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2901712 · Cited by 196
Karimi, D., Samei, G., Kesch, C. V., Nir, G., & Salcudean, S. E. (2018) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-018-1785-8 · Cited by 94
Self-citationOn Loss Functions for Deep Neural Networks in ClassificationPreprint
Janocha, K., & Czarnecki, W. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05659 · Cited by 76
Automatic brain tissue segmentation in MR images using Random Forests and Conditional Random Fields
Pereira, S., Pinto, A. B., Oliveira, J., Mendrik, A. M., Correia, J. H., & Silva, C. A. (2016) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2016.06.017 · Cited by 64
Learning-Based Multi-Label Segmentation of Transrectal Ultrasound Images for Prostate Brachytherapy
Nouranian, S., Ramezani, M., Spadinger, I., Morris, W. J., Salcudean, S. E., & Abolmaesumi, P. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2502540 · Cited by 50
Self-citationIntegrating Statistical Prior Knowledge into Convolutional Neural Networks
Milletarì, F., Rothberg, A., Jia, J., & Sofka, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66182-7_19 · Cited by 44
Makni, N., Betrouni, N., & Colot, O. (2012) · Information Fusion · doi:10.1016/j.inffus.2012.04.002 · Cited by 43
Genetic Model Optimization for Hausdorff Distance-Based Face Localization
Kirchberg, K. J., Jesorsky, O., & Frischholz, R. W. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47917-1_11 · Cited by 40
Clinical Target-Volume Delineation in Prostate Brachytherapy Using Residual Neural Networks
Anas, E. M. A., Nouranian, S., Mahdavi, S. S., Spadinger, I., Morris, W. J., Salcudean, S. E., Mousavi, P., & Abolmaesumi, P. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_42 · Cited by 40
Self-citationTowards dense volumetric pancreas segmentation in CT using 3D fully convolutional networks
Oda, M., Shimizu, N., Oda, H., Hayashi, Y., Kitasaka, T., Fujiwara, M., Misawa, K., Mori, K., & Roth, H. R. (2018) · SPIE Medical Imaging: Image Processing · doi:10.1117/12.2293499 · Cited by 38
Brosch, T., Peters, J., Groth, A., Stehlé, T., & Weese, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00937-3_59 · Cited by 37
A Multi-Atlas-Based Segmentation Framework for Prostate Brachytherapy
Nouranian, S., Mahdavi, S. S., Spadinger, I., Morris, W. J., Salcudean, S. E., & Abolmaesumi, P. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2371823 · Cited by 35
Self-citationHausdorff Distance Constraint for Multi-surface Segmentation
Schmidt, F. R., & Boykov, Y. Y. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33718-5_43 · Cited by 15
Cited by
Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation
Tajbakhsh, N., Jeyaseelan, L., Li, Q., Chiang, J. N., Wu, Z., & Ding, X. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101693 · Cited by 1,095
A survey of loss functions for semantic segmentation
Jadon, S. (2020) · 2020 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb48159.2020.9277638 · Cited by 946
Medical image segmentation using deep learning: A survey
Wang, R., Lei, T., Cui, R., Zhang, B., Meng, H., & Nandi, A. K. (2022) · IET Image Processing · doi:10.1049/ipr2.12419 · Cited by 892
Deep semantic segmentation of natural and medical images: a review
Asgari Taghanaki, S., Abhishek, K., Cohen, J. P., Cohen-Adad, J., & Hamarneh, G. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09854-1 · Cited by 870
Towards a guideline for evaluation metrics in medical image segmentation
Müller, D., Soto-Rey, I., & Kramer, F. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06096-y · Cited by 668
Metadata
- Authors
- Karimi, D., & Salcudean, S. E.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2020-02
- Volume
- 39
- Issue
- 2
- Pages
- 499-513
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2941524851
- Cited by
- 635
- References
- 47
- FWCI
- 24.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.