The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Techniques and Challenges of Image Segmentation: A Review
Open accessAbstract
Image segmentation, which has become a research hotspot in the field of image processing and computer vision, refers to the process of dividing an image into meaningful and non-overlapping regions, and it is an essential step in natural scene understanding. Despite decades of effort and many achievements, there are still challenges in feature extraction and model design. In this paper, we review the advancement in image segmentation methods systematically. According to the segmentation principles and image data characteristics, three important stages of image segmentation are mainly reviewed, which are classic segmentation, collaborative segmentation, and semantic segmentation based on deep learning. We elaborate on the main algorithms and key techniques in each stage, compare, and summarize the advantages and defects of different segmentation models, and discuss their applicability. Finally, we analyze the main challenges and development trends of image segmentation techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Mean shift: a robust approach toward feature space analysis
Comaniciu, D., & Meer, P. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000236 · Cited by 11,305
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., & Süsstrunk, S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.120 · Cited by 9,201
Dual Attention Network for Scene Segmentation
Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., & Lu, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00326 · Cited by 7,351
Efficient Graph-Based Image Segmentation
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000022288.19776.77 · Cited by 6,176
Image segmentation using deep learning: A survey
Minaee, S., Boykov, Y. Y., Porikli, F., Plaza, A. J., Kehtarnavaz, N., & Terzopoulos, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3059968 · Cited by 3,796
Random Walks for Image Segmentation
Grady, L. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.233 · Cited by 2,624
Understanding Convolution for Semantic Segmentation
Wang, P., Chen, P., Yuan, Y., Liu, D., Huang, Z., Hou, X., & Cottrell, G. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00163 · Cited by 1,957
Yu, F., Koltun, V., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.75 · Cited by 1,804
A survey on deep learning techniques for image and video semantic segmentation
Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., Villena-Martinez, V., Martinez-Gonzalez, P., & Garcia-Rodriguez, J. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2018.05.018 · Cited by 1,490
Fuzzy c-means clustering with spatial information for image segmentation
Chuang, K.-S., Tzeng, H.-L., Chen, S., Wu, J., & Chen, T.-J. (2006) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2005.10.001 · Cited by 1,323
A spectral technique for correspondence problems using pairwise constraints
Leordeanu, M., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.20 · Cited by 1,222
PSANet: Point-wise Spatial Attention Network for Scene Parsing
Zhao, H., Zhang, Y., Liu, S., Shi, J., Loy, C. C., Lin, D., & Jia, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_17 · Cited by 1,192
Localizing Region-Based Active Contours
Lankton, S., & Tannenbaum, A. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2004611 · Cited by 1,137
CARAFE: Content-Aware ReAssembly of FEatures
Wang, J., Chen, K., Xu, R., Liu, Z., Loy, C. C., & Lin, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00310 · Cited by 989
Alexe, B., Deselaers, T., & Ferrari, V. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540226 · Cited by 776
Decision Forests for Computer Vision and Medical Image Analysis
(2013) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-1-4471-4929-3 · Cited by 595
Cosegmentation of Image Pairs by Histogram Matching - Incorporating a Global Constraint into MRFs
Rother, C., Minka, T., Blake, A., & Kolmogorov, V. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.91 · Cited by 535
Laplacian Pyramid Reconstruction and Refinement for Semantic Segmentation
Ghiasi, G., & Fowlkes, C. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_32 · Cited by 502
Superpixel segmentation using Linear Spectral Clustering
Li, Z., & Chen, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298741 · Cited by 479
Discriminative clustering for image co-segmentation
Joulin, A., Bach, F., & Ponce, J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539868 · Cited by 438
Adaptive Pyramid Context Network for Semantic Segmentation
He, J., Deng, Z., Zhou, L., Wang, Y., & Qiao, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00770 · Cited by 420
Interactive Graph Cut Based Segmentation with Shape Priors
Freedman, D., & Zhang, T. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.191 · Cited by 380
Scene labeling with LSTM recurrent neural networks
Byeon, W., Breuel, T. M., Raue, F., & Liwicki, M. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298977 · Cited by 375
Vicente, S., Rother, C., & Kolmogorov, V. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995530 · Cited by 292
ReSeg: A Recurrent Neural Network-Based Model for Semantic Segmentation
Visin, F., Romero, A., Cho, K., Matteucci, M., Ciccone, M., Kastner, K., Bengio, Y., & Courville, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.60 · Cited by 281
Joulin, A., Bach, F., & Ponce, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247719 · Cited by 279
Distributed cosegmentation via submodular optimization on anisotropic diffusion
Kim, G., Xing, E. P., Fei-Fei, L., & Kanade, T. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126239 · Cited by 270
Zheng, Q., Yang, M., Yang, J., Zhang, Q., & Zhang, X. (2018) · IEEE Access · doi:10.1109/access.2018.2810849 · Cited by 259
Deep Facial Diagnosis: Deep Transfer Learning From Face Recognition to Facial Diagnosis
Jin, B., Cruz, L., & Gonçalves, N. (2020) · IEEE Access · doi:10.1109/access.2020.3005687 · Cited by 221
From co-saliency to co-segmentation: An efficient and fully unsupervised energy minimization model
Chang, K.-Y., Liu, T.-L., & Lai, S.-H. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995415 · Cited by 215
Sub-Markov Random Walk for Image Segmentation
Dong, X., Shen, J., Shao, L., & Van Gool, L. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2505184 · Cited by 208
Fully Automatic Segmentation of the Proximal Femur Using Random Forest Regression Voting
Lindner, C., Thiagarajah, S., Wilkinson, J., Consortium, T., Wallis, G., & Cootes, T. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2258030 · Cited by 198
Half-integrality based algorithms for cosegmentation of images
Mukherjee, L., Singh, V., & Dyer, C. R. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206652 · Cited by 170
Fast mesh segmentation using random walks
Lai, Y., Hu, S., Martin, R. R., & Rosin, P. L. (2008) · ACM Symposium on Solid and Physical Modeling (SPM) · doi:10.1145/1364901.1364927 · Cited by 154
Cosegmentation Revisited: Models and Optimization
Vicente, S., Kolmogorov, V., & Rother, C. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15552-9_34 · Cited by 145
Unsupervised co-segmentation through region matching
Rubio, J. C., Serrat, J., López, A. M., & Nikos Paragios, A. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247745 · Cited by 143
Object Co-Segmentation Based on Shortest Path Algorithm and Saliency Model
Meng, F., Li, H., Liu, G., & Ngan, K. N. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2197741 · Cited by 141
User-Friendly Interactive Image Segmentation Through Unified Combinatorial User Inputs
Yang, W., Cai, J., Zheng, J., & Luo, J. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2048611 · Cited by 136
Welling, M., Sebe, N., Matas, J., & Leibe, B. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8 · Cited by 135
Jin, B., Cruz, L., & Gonçalves, N. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3197235 · Cited by 112
Spatial-Temporal Fusion for High Accuracy Depth Maps Using Dynamic MRFs
Zhu, J., Wang, L., Gao, J., & Yang, R. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.68 · Cited by 106
VoxelEmbed: 3D Instance Segmentation and Tracking with Voxel Embedding based Deep Learning
Zhao, M., Liu, Q., Jha, A., Deng, R., Yao, T., Mahadevan-Jansen, A. M., Tyska, M. J., Millis, B. A., & Huo, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87589-3_45 · Cited by 98
Random walks based multi-image segmentation: Quasiconvexity results and GPU-based solutions
Collins, M. D., Xu, J. W., Grady, L. J., & Singh, V. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247859 · Cited by 93
CARAFE++: Unified Content-Aware ReAssembly of FEatures
Wang, J., Chen, K., Xu, R., Liu, Z., Loy, C. C., & Lin, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3074370 · Cited by 91
Attention UW-Net: A fully connected model for automatic segmentation and annotation of chest X-ray
Pal, D., Reddy, P. B., & Roy, S. S. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106083 · Cited by 89
FPANet: Feature pyramid aggregation network for real-time semantic segmentation
Wu, Y. J., Jiang, J., Huang, Z., & Tian, Y. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02603-z · Cited by 81
A hierarchical image clustering cosegmentation framework
Kim, E., Li, H., & Huang, X. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247737 · Cited by 62
Number plate recognition from enhanced super-resolution using generative adversarial network
Kabiraj, A., Pal, D., Ganguly, D., Chatterjee, K., & Roy, S. S. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-14018-0 · Cited by 55
Mesh Snapping: Robust Interactive Mesh Cutting Using Fast Geodesic Curvature Flow
Zhang, J., Wu, C., Cai, J., Zheng, J., & Tai, X. (2010) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01621.x · Cited by 39
Compound Figure Separation of Biomedical Images with Side Loss
Yao, T., Qu, C., Liu, Q., Deng, R., Tian, Y., Xu, J., Jha, A., Bao, S., Zhao, M., Fogo, A. B., et al. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-88210-5_16 · Cited by 37
Cosegmentation of multiple image groups
Meng, F., Cai, J., & Li, H. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.02.004 · Cited by 35
Fabijańska, A., & Gocławski, J. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2383323 · Cited by 18
HLO: Half-kernel Laplacian operator for surface smoothing
Pan, W., Lu, X., Gong, Y., et al. (2020) · Computer-Aided Design · doi:10.1016/j.cad.2019.102807 · Cited by 18
An Improved Random Walker with Bayes Model for Volumetric Medical Image Segmentation
Dong, C., Zeng, X., Lin, L., Hu, H., Han, X., Naghedolfeizi, M., Aberra, D., & Chen, Y. (2017) · Journal of Healthcare Engineering · doi:10.1155/2017/6506049 · Cited by 14
Enhanced Feature Pyramid Network for Semantic Segmentation
Ye, M., Ouyang, J., Chen, G., Zhang, J., & Yu, X. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9413224 · Cited by 14
Chen, H., Zhen, X., Gu, X., Yan, H., Cerviño, L., Xiao, Y., & Zhou, L. (2015) · Journal of Applied Clinical Medical Physics · doi:10.1120/jacmp.v16i2.5324 · Cited by 10
Cited by
Deep learning for medical image segmentation: State-of-the-art advancements and challenges
Rayed, M. E., Islam, S. M. S., Niha, S. I., Jim, J. R., Kabir, M. M., & Mridha, M. F. (2024) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2024.101504 · Cited by 332
3D molecular generative framework for interaction-guided drug design
(2024) · doi:10.1038/s41467-024-47011-2 · Cited by 88
Metadata
- Authors
- Yu, Y., Wang, C., Fu, Q., Kou, R., Huang, F., Yang, B., Yang, T., & Gao, M.
- Venue
- Electronics
- Publisher
- MDPI AG
- Published
- 2023-03-02
- Volume
- 12
- Issue
- 5
- Pages
- 1199
- ISSN
- 2079-9292 (ISSN-L)
- OpenAlex
- W4322769471
- Cited by
- 370
- References
- 72
- FWCI
- 33.64
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.