The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Recent progress in semantic image segmentation
Open accessAbstract
Semantic image segmentation, which becomes one of the key applications in image processing and computer vision domain, has been used in multiple domains such as medical area and intelligent transportation. Lots of benchmark datasets are released for researchers to verify their algorithms. Semantic segmentation has been studied for many years. Since the emergence of Deep Neural Network (DNN), segmentation has made a tremendous progress. In this paper, we divide semantic image segmentation methods into two categories: traditional and recent DNN method. Firstly, we briefly summarize the traditional method as well as datasets released for segmentation, then we comprehensively investigate recent methods based on DNN which are described in the eight aspects: fully convolutional network, up-sample ways, FCN joint with CRF methods, dilated convolution approaches, progresses in backbone network, pyramid methods, Multi-level feature and multi-stage method, supervised, weakly-supervised and unsupervised methods. Finally, a conclusion in this area is drawn.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557 · cited 2×
“…and Triggs 2005; Bourdev et al. 2010), Scale-invariant feature transform (SIFT) (Lowe 2004), Local Binary Pattern (LBP) (He andWang 1990), SURF (Bay et al. 2008), Harris Corners (Derpanis 2004), Shi-Tomasi (Shi et al. 1994), Sub-pixelCorner (Medioni andYasumoto 1987), SUSAN (Smith and Brady…”
BackgroundThe Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433 · cited 6×
“2017), especially in autonomous driving area Cityscapes (Cordts et al. 2016), and KITTI (Fritsch et al.”
BackgroundInfluentialLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
Shi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
LabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210
BRISK: Binary Robust invariant scalable keypoints
Leutenegger, S., Chli, M., & Siegwart, R. Y. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126542 · Cited by 3,450
SUSAN—a new approach to low level image processing
Smith, S. M., & Brady, J. M. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007963824710 · Cited by 3,333
Scene Parsing through ADE20K Dataset
Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., & Torralba, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.544 · Cited by 3,326
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C. L., & Dollár, P. (2014) · arXiv · doi:10.48550/arxiv.1405.0312 · Cited by 2,579 · cited 4×
“Microsoft COCOdataset (Lin et al. 2014) contains photos of 91 objects typeswhichwould be recognized easily by a 4-year-old person with a total of 2.5 million labeled instances in 328k images.”
BackgroundInfluentialObject scene flow for autonomous vehicles
Menze, M., & Geiger, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298925 · Cited by 2,270
Faster and Better: A Machine Learning Approach to Corner Detection
Rosten, E., Porter, R., & Drummond, T. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.275 · Cited by 1,849
Yu, F., Koltun, V., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.75 · Cited by 1,804
An assessment of support vector machines for land cover classification
Huang, C., Davis, L. S., & Townshend, J. R. G. (2002) · International Journal of Remote Sensing · doi:10.1080/01431160110040323 · Cited by 1,795
Hypercolumns for object segmentation and fine-grained localization
Hariharan, B., Arbelaez, P., Girshick, R., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298642 · Cited by 1,511
A convolutional neural network cascade for face detection
Li, H., Lin, Z., Shen, X., Brandt, J., & Hua, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299170 · Cited by 1,390
Attention to Scale: Scale-Aware Semantic Image Segmentation
Chen, L.-C., Yang, Y., Wang, J., Xu, W., & Yuille, A. L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.396 · Cited by 1,377
Self-citationFusing points and lines for high performance tracking
Rosten, E., & Drummond, T. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.104 · Cited by 1,119
Fully Convolutional Instance-Aware Semantic Segmentation
Li, Y., Qi, H., Dai, J., Ji, X., & Wei, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.472 · Cited by 1,116 · cited 3×
“Apart frommulti-level strategy, amulti-stagemethod is used in semantic segmentation (Li et al. 2017b).”
MethodProceedings. 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.3 · Cited by 1,083
Weakly-and Semi-Supervised Learning of a Deep Convolutional Network for Semantic Image Segmentation
Papandreou, G., Chen, L.-C., Murphy, K. P., & Yuille, A. L. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.203 · Cited by 1,005
Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images
Hu, S., Hoffman, E. A., & Reinhardt, J. M. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.929615 · Cited by 940
Efficient Piecewise Training of Deep Structured Models for Semantic Segmentation
Lin, G., Shen, C., van den Hengel, A., & Reid, I. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.348 · Cited by 862
Nock, R., & Nielsen, F. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.110 · Cited by 815
Geometric Level Set Methods in Imaging, Vision, and Graphics
Osher, S., & Paragios, N. (2003) · Springer eBooks · doi:10.1007/b97541 · Cited by 799
Road-Sign Detection and Recognition Based on Support Vector Machines
Maldonado-Bascon, S., Lafuente-Arroyo, S., Gil-Jimenez, P., Gomez-Moreno, H., & Lopez-Ferreras, F. (2007) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2007.895311 · Cited by 724
Handbook of Granular Computing
Stefanini, L., LAERTE, S., & GUERRA, M. L. (2008) · Wiley eBooks · doi:10.1002/9780470724163 · Cited by 700
A new performance measure and evaluation benchmark for road detection algorithms
Fritsch, J., Kuhnl, T., & Geiger, A. (2013) · 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013) · doi:10.1109/itsc.2013.6728473 · Cited by 690
Semantic Image Segmentation via Deep Parsing Network
Liu, Z., Li, X., Luo, P., Loy, C.-C., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.162 · Cited by 675
Classification using discriminative restricted Boltzmann machines
Larochelle, H., & Bengio, Y. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390224 · Cited by 655
A Real-Time Algorithm for Signal Analysis with the Help of the Wavelet Transform
Holschneider, M., Kronland-Martinet, R., Morlet, J., & Tchamitchian, P. (1989) · Inverse Problems and Theoretical Imaging · doi:10.1007/978-3-642-97177-8_28 · Cited by 633
Texture Unit, Texture Spectrum, And Texture Analysis
He, D.-C., & Wang, L. (1990) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.1990.572934 · Cited by 569
Laplacian Pyramid Reconstruction and Refinement for Semantic Segmentation
Ghiasi, G., & Fowlkes, C. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_32 · Cited by 502
Feedforward semantic segmentation with zoom-out features
Mostajabi, M., Yadollahpour, P., & Shakhnarovich, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298959 · Cited by 436
Chen, L.-C., Barron, J. T., Papandreou, G., Murphy, K., & Yuille, A. L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.492 · Cited by 364
Not All Pixels Are Equal: Difficulty-Aware Semantic Segmentation via Deep Layer Cascade
Li, X., Liu, Z., Luo, P., Loy, C. C., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.684 · Cited by 268
Regularized Laplacian Zero Crossings as Optimal Edge Integrators
Kimmel, R., & Bruckstein, A. M. (2003) · International Journal of Computer Vision · doi:10.1023/a:1023030907417 · Cited by 227
Zhu, S.-C., Guo, C.-E., Wang, Y., & Xu, Z. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-4638-1 · Cited by 204
Corner detection and curve representation using cubic B-splines
Medioni, G. G., & Yasumoto, Y. (1987) · Computer Vision Graphics and Image Processing · doi:10.1016/s0734-189x(87)80181-0 · Cited by 199
Learning to segment under various forms of weak supervision
Xu, J., Schwing, A. G., & Urtasun, R. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299002 · Cited by 180
Real-Time Facial Segmentation and Performance Capture from RGB Input
Saito, S., Li, T., & Li, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_15 · Cited by 136
Deep hierarchical parsing for semantic segmentation
Sharma, A., Tuzel, O., & Jacobs, D. W. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298651 · Cited by 102
Object segmentation by alignment of poselet activations to image contours
Brox, T., Bourdev, L. D., Maji, S., & Malik, J. (2011) · doi:10.1109/cvpr.2011.5995659 · Cited by 101
Lindeberg, T., & Li, M. (1997) · Computer Vision and Image Understanding · doi:10.1006/cviu.1996.0510 · Cited by 88
Automatic tracking of laparoscopic instruments by color coding
Wei, G.-Q., Arbter, K., & Hirzinger, G. (1997) · Lecture notes in computer science · doi:10.1007/bfb0029257 · Cited by 63
Image-Adaptive Deconvolution for Three-Dimensional Deep Biological Imaging
de Monvel, J. B., Scarfone, E., Calvez, S. L., & Ulfendahl, M. (2003) · Biophysical Journal · doi:10.1016/s0006-3495(03)74813-9 · Cited by 62
Semantic Segmentation without Annotating Segments
Xia, W., Domokos, C., Dong, J., Cheong, L., & Yan, S. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.271 · Cited by 40
Cited by
A survey of the recent architectures of deep convolutional neural networks
Khan, A., Sohail, A., Zahoora, U., & Qureshi, A. S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09825-6 · Cited by 3,137
CNN Variants for Computer Vision: History, Architecture, Application, Challenges and Future Scope
Bhatt, D., Patel, C., Talsania, H., Patel, J., Vaghela, R., Pandya, S., Modi, K., & Ghayvat, H. (2021) · Electronics · doi:10.3390/electronics10202470 · Cited by 890
“Furthermore, it has demonstrated exceptional image classification, recognition, segmentation, and retrieval [2].”
BackgroundState of the Art in Defect Detection Based on Machine Vision
Ren, Z., Fang, F., Yan, N., & Wu, Y. (2022) · International Journal of Precision Engineering and Manufacturing-Green Technology · doi:10.1007/s40684-021-00343-6 · Cited by 799
Toğaçar, M., Ergen, B., & Cömert, Z. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103805 · Cited by 568
A survey of the vision transformers and their CNN-transformer based variants
Khan, A., Rauf, Z., Sohail, A., Khan, A. R., Asif, H., Asif, A., & Farooq, U. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10595-0 · Cited by 451
Metadata
- Authors
- Liu, X., Deng, Z., & Yang, Y.
- Venue
- Artificial Intelligence Review
- Published
- 2018-06-27
- Volume
- 52
- Issue
- 2
- Pages
- 1089-1106
- ISSN
- 0269-2821 (ISSN-L)
- 1573-7462
- OpenAlex
- W2810392541
- Cited by
- 455
- References
- 63
- FWCI
- 16.32
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.