DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
Open accessThe DOI matches its Crossref record; 128 of the 128 references it cites were found in a registry or an index.
Abstract
In this work we address the task of semantic image segmentation with Deep Learning and make three main contributions that are experimentally shown to have substantial practical merit. First, we highlight convolution with upsampled filters, or 'atrous convolution', as a powerful tool in dense prediction tasks. Atrous convolution allows us to explicitly control the resolution at which feature responses are computed within Deep Convolutional Neural Networks. It also allows us to effectively enlarge the field of view of filters to incorporate larger context without increasing the number of parameters or the amount of computation. Second, we propose atrous spatial pyramid pooling (ASPP) to robustly segment objects at multiple scales. ASPP probes an incoming convolutional feature layer with filters at multiple sampling rates and effective fields-of-views, thus capturing objects as well as image context at multiple scales. Third, we improve the localization of object boundaries by combining methods from DCNNs and probabilistic graphical models. The commonly deployed combination of max-pooling and downsampling in DCNNs achieves invariance but has a toll on localization accuracy. We overcome this by combining the responses at the final DCNN layer with a fully connected Conditional Random Field (CRF), which is shown both qualitatively and quantitatively to improve localization performance. Our proposed "DeepLab" system sets the new state-of-art at the PASCAL VOC-2012 semantic image segmentation task, reaching 79.7 percent mIOU in the test set, and advances the results on three other datasets: PASCAL-Context, PASCAL-Person-Part, and Cityscapes. All of our code is made publicly available online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“According to the authors, dilated convolutions allow for an exponential increase in the receptive field without a decrease in resolution or increase in parameters, as may happen in the traditional pooling or stride-based approaches.”
From Multimodal semantic segmentation in autonomous driving: A review of current approaches and future perspectives (2022) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Nevertheless, CRFs are still the most commonly adopted and recognized approach to refine segmentation masks of both natural images (Schwing and Urtasun (2015), Chen et al. (2017) and Zheng et al. (2015)) and medical images (Roth et al. (2015), Chen and de Bruijne (2018) and Wachinger et al. (2018)).”
From Embracing imperfect datasets: A review of deep learning solutions for medical image segmentation (2020) · cites this paper as Chen et al. (2017)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Nonetheless, none of these can fully eliminate the limitation of FCN architecture in receptive field.”
From Vision Transformers: From Semantic Segmentation to Dense Prediction (2024) · cites this paper as Chen et al. (2017)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In the PASCAL VOC-2012 image segmentation, their model obtained an excellent performance.”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [308]
The cited source says what the claim attributes to it.
In the citing paper
“Employing FC Conditional Random Fields (CRFs), atrous spatial pyramid pooling, and up-sampled filters were techniques introduced by Chen et al. [308]. These authors aimed to enhance the accuracy of localization and enlarge the field of view of every filter at a multi-scale. Their model, DeepLab, attained 79.7% mIOU (mean Intersection Over Union).”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [308]
12 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“DEEP Convolutional Neural Networks (DCNNs) [1] have pushed the performance of computer vision systems to soaring heights on a broad array of high-level problems, including image classification [2], [3], [4], [5], [6] and object detection [7], [8], [9], [10], [11], [12], where DCNNs trained in an end-to-end manner have…”
BackgroundGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Cited by
Items 201–300 of 1,168
1Salient Object Detection: A Survey
Borji, A., Jiang, H., & Li, J. (2016) · Cited by 761
Deep neural network models for computational histopathology: A survey
Srinidhi, C. L., Ciga, O., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101813 · Cited by 749
MeshCNN: a network with an edge
Hanocka, R., Hertz, A., Fish, N., Giryes, R., Fleishman, S., & Cohen-Or, D. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322959 · Cited by 742
Graph Attention Convolution for Point Cloud Semantic Segmentation
Wang, L., Huang, Y., Hou, Y., Zhang, S., & Shan, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01054 · Cited by 738
nnFormer: Volumetric Medical Image Segmentation via a 3D Transformer
Zhou, H.-Y., Guo, J., Zhang, Y., Han, X., Yu, L., Wang, L., & Yu, Y. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3293771 · Cited by 735
CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation With Transformers
Zhang, J., Liu, H., Yang, K., Hu, X., Liu, R., & Stiefelhagen, R. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3300537 · Cited by 731
“Pyramid-, strip-, and atrous spatial pyramid pooling are designed to harvest multiscale feature representations [5], [6], [32].”
BackgroundAsymmetric Non-Local Neural Networks for Semantic Segmentation
Zhu, Z., Xu, M., Bai, S., Huang, T., & Bai, X. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00068 · Cited by 721
Gu, R., Wang, G., Song, T., Huang, R., Aertsen, M., Deprest, J., Ourselin, S., Vercauteren, T., & Zhang, S. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3035253 · Cited by 720
DFANet: Deep Feature Aggregation for Real-Time Semantic Segmentation
Li, H., Xiong, P., Fan, H., & Sun, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00975 · Cited by 718
Luan, F., Paris, S., Shechtman, E., & Bala, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.740 · Cited by 714
Conditional Convolutions for Instance Segmentation
Tian, Z., Shen, C., & Chen, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_17 · Cited by 712
Artificial intelligence for the metaverse: A survey
Huynh-The, T., Pham, Q.-V., Pham, X.-Q., Nguyen, T. T., Han, Z., & Kim, D.-S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105581 · Cited by 710
Bidirectional Learning for Domain Adaptation of Semantic Segmentation
Li, Y., Yuan, L., & Vasconcelos, N. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00710 · Cited by 704
“In our experiments, we choose to use DeepLab V2 [3] with ResNet101 [11] and FCN-8s [18] with VGG16 [32] as our segmentation model.”
MethodRethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks
Fan, D.-P., Lin, Z., Zhang, Z., Zhu, M., & Cheng, M.-M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2996406 · Cited by 702
MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving
Teichmann, M., Weber, M., Zollner, M., Cipolla, R., & Urtasun, R. (2018) · 2018 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2018.8500504 · Cited by 681
Structured Knowledge Distillation for Semantic Segmentation
Liu, Y., Chen, K., Liu, C., Qin, Z., Luo, Z., & Wang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00271 · Cited by 681
Prior Guided Feature Enrichment Network for Few-Shot Segmentation
Tian, Z., Zhao, H., Shu, M., Yang, Z., Li, R., & Jia, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3013717 · Cited by 679
Zhang, C., Lin, G., Liu, F., Yao, R., & Shen, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00536 · Cited by 670
Classification with an edge: Improving semantic image segmentation with boundary detection
Marmanis, D., Schindler, K., Wegner, J. D., Galliani, S., Datcu, M., & Stilla, U. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.11.009 · Cited by 670
A survey and performance evaluation of deep learning methods for small object detection
Liu, Y., Sun, P., Wergeles, N., & Shang, Y. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114602 · Cited by 665
Kokkinos, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.579 · Cited by 657
Self-citationSegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentation
Guo, M.-H., Lu, C.-Z., Hou, Q., Liu, Z., Cheng, M., & Hu, S.-M. (2022) · neural information processing systems · doi:10.52202/068431-0084 · Cited by 657
Deep Feature Flow for Video Recognition
Zhu, X., Xiong, Y., Dai, J., Yuan, L., & Wei, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.441 · Cited by 653
Mask-Guided Contrastive Attention Model for Person Re-identification
Song, C., Huang, Y., Ouyang, W., & Wang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00129 · Cited by 653
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
A Simple Convolutional Generative Network for Next Item Recommendation
Yuan, F., Karatzoglou, A., Arapakis, I., Jose, J. M., & He, X. (2019) · Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining · doi:10.1145/3289600.3290975 · Cited by 640
Large-Scale Learnable Graph Convolutional Networks
Gao, H., Wang, Z., & Ji, S. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219947 · Cited by 638
PoseTrack: A Benchmark for Human Pose Estimation and Tracking
Andriluka, M., Iqbal, U., Insafutdinov, E., Pishchulin, L., Milan, A., Gall, J., & Schiele, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00542 · Cited by 638
In Silico Labeling: Predicting Fluorescent Labels in Unlabeled Images
Christiansen, E. M., Yang, S. J., Ando, D. M., Javaherian, A., Skibinski, G., Lipnick, S., Mount, E., O’Neil, A., Shah, K., Lee, A. K., et al. (2018) · Cell · doi:10.1016/j.cell.2018.03.040 · Cited by 635
Panoptic-DeepLab: A Simple, Strong, and Fast Baseline for Bottom-Up Panoptic Segmentation
Cheng, B., Collins, M. D., Zhu, Y., Liu, T., Huang, T. S., Adam, H., & Chen, L.-C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01249 · Cited by 635
Self-citationQueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection
Yang, C., Huang, Z., & Wang, N. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01330 · Cited by 634
“These methods can be mainly categorized into four types: 1) increasing the resolution of input features [31, 2, 23, 11, 28, 46, 26, 53]; 2) oversampling and strong data augmentation [31, 21, 75]; 3) incorporating context information [7, 64, 5], and 4) scale-aware training [28, 47, 48, 27].”
Method(2020) · doi:10.1109/icra40945.2020.9196885 · Cited by 633
Mou, L., Bruzzone, L., & Zhu, X. X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2863224 · Cited by 633
Review the state-of-the-art technologies of semantic segmentation based on deep learning
Mo, Y., Wu, Y., Yang, X., Liu, F., & Liao, Y. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.01.005 · Cited by 632
DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting
Rao, Y., Zhao, W., Chen, G., Tang, Y., Zhu, Z., Huang, G., Zhou, J., & Lu, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01755 · Cited by 631
A deep learning-based radiomics model for prediction of survival in glioblastoma multiforme
Lao, J., Chen, Y., Li, Z.-C., Li, Q., Zhang, J., Liu, J., & Zhai, G. (2017) · Scientific Reports · doi:10.1038/s41598-017-10649-8 · Cited by 630
Wei, Y., Xiao, H., Shi, H., Jie, Z., Feng, J., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00759 · Cited by 627
Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation
Zhu, X., Zhou, H., Wang, T., Hong, F., Ma, Y., Li, W., Li, H., & Lin, D. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00981 · Cited by 623
Hoyer, L., Dai, D., & Van Gool, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00969 · Cited by 622
Papandreou, G., Zhu, T., Chen, L.-C., Gidaris, S., Tompson, J., & Murphy, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_17 · Cited by 621
Self-citationSplit-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction
Zhang, R., Isola, P., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.76 · Cited by 616
Pointwise Convolutional Neural Networks
Hua, B.-S., Tran, M.-K., & Yeung, S.-K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00109 · Cited by 615
High-Resolution Representations for Labeling Pixels and Regions
Sun, K., Zhao, Y. S., Jiang, B., Cheng, T., Xiao, B., Liu, D., Mu, Y., Wang, X., Liu, W., & Wang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04514 · Cited by 614
Roy, A. G., Conjeti, S., Karri, S. P. K., Sheet, D., Katouzian, A., Wachinger, C., & Navab, N. (2017) · Biomedical Optics Express · doi:10.1364/boe.8.003627 · Cited by 613
Weakly Supervised Learning of Instance Segmentation With Inter-Pixel Relations
Ahn, J., Cho, S., & Kwak, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00231 · Cited by 613
SegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentation
Xue, Y., Xu, T., Zhang, H., Long, L. R., & Huang, X. (2018) · Neuroinformatics · doi:10.1007/s12021-018-9377-x · Cited by 605
Exploring Cross-Image Pixel Contrast for Semantic Segmentation
Wang, W., Zhou, T., Yu, F., Dai, J., Konukoglu, E., & Gool, L. V. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00721 · Cited by 604
Adaptive batch normalization for practical domain adaptation
Li, Y., Wang, N., Shi, J., Hou, X., & Liu, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.03.005 · Cited by 601
YouTube-VOS: Sequence-to-Sequence Video Object Segmentation
Xu, N., Yang, L., Fan, Y., Yang, J., Yue, D., Liang, Y., Price, B., Cohen, S., & Huang, T. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_36 · Cited by 598
A Brief Survey on Semantic Segmentation with Deep Learning
Hao, S., Zhou, Y., & Guo, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.118 · Cited by 596
Categorical Depth Distribution Network for Monocular 3D Object Detection
Reading, C., Harakeh, A., Chae, J., & Waslander, S. L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00845 · Cited by 595
Change Detection Based on Artificial Intelligence: State-of-the-Art and Challenges
Shi, W., Zhang, M., Zhang, R., Chen, S., & Zhan, Z. (2020) · Remote Sensing · doi:10.3390/rs12101688 · Cited by 595
Hofmanninger, J., Prayer, F., Pan, J., Röhrich, S., Prosch, H., & Langs, G. (2020) · European Radiology Experimental · doi:10.1186/s41747-020-00173-2 · Cited by 595
MISSFormer: An Effective Transformer for 2D Medical Image Segmentation
Huang, X., Deng, Z., Li, D., Yuan, X., & Fu, Y. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3230943 · Cited by 594
Development and evaluation of an artificial intelligence system for COVID-19 diagnosis
Jin, C., Chen, W., Cao, Y., Xu, Z., Tan, Z., Zhang, X., Deng, L., Zheng, C., Zhou, J., Shi, H., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18685-1 · Cited by 592
Weakly-Supervised Semantic Segmentation Network with Deep Seeded Region Growing
Huang, Z., Wang, X., Wang, J., Liu, W., & Wang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00733 · Cited by 591
FAT-Net: Feature adaptive transformers for automated skin lesion segmentation
Wu, H., Chen, S., Chen, G., Wang, W., Lei, B., & Wen, Z. (2022) · Medical Image Analysis · doi:10.1016/j.media.2021.102327 · Cited by 590
Dual-path Convolutional Image-Text Embeddings with Instance Loss
Zheng, Z., Zheng, L., Garrett, M., Yang, Y., Xu, M., & Shen, Y.-D. (2020) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3383184 · Cited by 589
AugFPN: Improving Multi-Scale Feature Learning for Object Detection
Guo, C., Fan, B., Zhang, Q., Xiang, S., & Pan, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01261 · Cited by 588
Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes
Pohlen, T., Hermans, A., Mathias, M., & Leibe, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.353 · Cited by 584
Human Semantic Parsing for Person Re-identification
Kalayeh, M. M., Basaran, E., Gokmen, M., Kamasak, M. E., & Shah, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00117 · Cited by 584
Learning Video Object Segmentation from Static Images
Perazzi, F., Khoreva, A., Benenson, R., Schiele, B., & Sorkine-Hornung, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.372 · Cited by 581
Self-supervised learning for medical image analysis using image context restoration
Chen, L., Bentley, P., Mori, K., Misawa, K., Fujiwara, M., & Rueckert, D. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101539 · Cited by 575
Self-citationShou, Z., Chan, J., Zareian, A., Miyazawa, K., & Chang, S.-F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.155 · Cited by 574
ExFuse: Enhancing Feature Fusion for Semantic Segmentation
Zhang, Z., Zhang, X., Peng, C., Xue, X., & Sun, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_17 · Cited by 573
ACDC: The Adverse Conditions Dataset with Correspondences for Semantic Driving Scene Understanding
Sakaridis, C., Dai, D., & Van Gool, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01059 · Cited by 572
Learning Human-Object Interactions by Graph Parsing Neural Networks
Qi, S., Wang, W., Jia, B., Shen, J., & Zhu, S.-C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01240-3_25 · Cited by 572
Local Relation Networks for Image Recognition
Hu, H., Zhang, Z., Xie, Z., & Lin, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00356 · Cited by 570
Multi-Scale Self-Guided Attention for Medical Image Segmentation
Sinha, A., & Dolz, J. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2986926 · Cited by 570
Bandi, P., Geessink, O., Manson, Q., Van Dijk, M., Balkenhol, M., Hermsen, M., Ehteshami Bejnordi, B., Lee, B., Paeng, K., Zhong, A., et al. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2867350 · Cited by 569
“DeepLab employs convolution with dilated filters instead of downsampling (e.g. max-pooling) to increase the spatial resolution of the network when applied in a fully-convolutional fashion.”
MethodAttention Residual Learning for Skin Lesion Classification
Zhang, J., Xie, Y., Xia, Y., & Shen, C. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2893944 · Cited by 568
Camouflaged Object Segmentation with Distraction Mining
Mei, H., Ji, G.-P., Wei, Z., Yang, X., Wei, X., & Fan, D.-P. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00866 · Cited by 565
Application of Deep Learning in Food: A Review
Zhou, L., Zhang, C., Liu, F., Qiu, Z., & He, Y. (2019) · Comprehensive Reviews in Food Science and Food Safety · doi:10.1111/1541-4337.12492 · Cited by 564
Image Segmentation Using Text and Image Prompts
Luddecke, T., & Ecker, A. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00695 · Cited by 562
Dong, H., Song, K., He, Y., Xu, J., Yan, Y., & Meng, Q. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2958826 · Cited by 559
“[11] and [18] magnify some low-contrast defect areas.”
BackgroundMethodInfluentialSurvey on semantic segmentation using deep learning techniques
Lateef, F., & Ruichek, Y. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.02.003 · Cited by 559
Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning
Kemker, R., Salvaggio, C., & Kanan, C. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.04.014 · Cited by 558
“The DeepLab semantic segmentation network [8] was built with the ResNet DCNN. DeepLab mitigates downsampling issues and makes segmentation boundaries sharper by replacing conventional convolution layers with atrous convolutions.”
MethodInfluentialVan Valen, D. A., Kudo, T., Lane, K. M., Macklin, D. N., Quach, N. T., DeFelice, M. M., Maayan, I., Tanouchi, Y., Ashley, E. A., & Covert, M. W. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005177 · Cited by 557
A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT
Zhou, C., Li, Q., Li, C., Yu, J., Liu, Y., Wang, G., Zhang, K., Ji, C., Yan, Q., He, L., et al. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02443-6 · Cited by 557
Ultra Fast Structure-Aware Deep Lane Detection
Qin, Z., Wang, H., & Li, X. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58586-0_17 · Cited by 554
On the Integration of Self-Attention and Convolution
Pan, X., Ge, C., Lu, R., Song, S., Chen, G., Huang, Z., & Huang, G. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00089 · Cited by 552
ESPNetv2: A Light-Weight, Power Efficient, and General Purpose Convolutional Neural Network
Mehta, S., Rastegari, M., Shapiro, L., & Hajishirzi, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00941 · Cited by 551
Zhang, P., Zhang, B., Zhang, T., Chen, D., Wang, Y., & Wen, F. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01223 · Cited by 549
A Survey of Visual Transformers
Liu, Y., Zhang, Y., Wang, Y., Hou, F., Yuan, J., Tian, J., Zhang, Y., Shi, Z., Fan, J., & He, Z. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3227717 · Cited by 549
Rtfnet: Rgb-thermal fusion network for semantic segmentation of urban scenes
Sun, Y., Zuo, W., & Liu, M. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2904733 · Cited by 546
Zheng, Z., & Yang, Y. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01395-y · Cited by 545
Hong, D., Zhang, B., Li, H., Li, Y., Yao, J., Li, C., Werner, M., Chanussot, J., Zipf, A., & Zhu, X. X. (2023) · Remote Sensing of Environment · doi:10.1016/j.rse.2023.113856 · Cited by 545
Learning to Compose Dynamic Tree Structures for Visual Contexts
Tang, K., Zhang, H., Wu, B., Luo, W., & Liu, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00678 · Cited by 543
An effective CNN and Transformer complementary network for medical image segmentation
Yuan, F., Zhang, Z., & Fang, Z. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2022.109228 · Cited by 539
PifPaf: Composite Fields for Human Pose Estimation
Kreiss, S., Bertoni, L., & Alahi, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01225 · Cited by 538
Learning Feature Pyramids for Human Pose Estimation
Yang, W., Li, S., Ouyang, W., Li, H., & Wang, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.144 · Cited by 536
$A^2$-Nets: Double Attention NetworksPreprint
Chen, Y., Kalantidis, Y., Li, J., Yan, S., & Feng, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.11579 · Cited by 536
Recalibrating Fully Convolutional Networks With Spatial and Channel “Squeeze and Excitation” Blocks
Roy, A. G., Navab, N., & Wachinger, C. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2867261 · Cited by 534
GANs for medical image analysis
Kazeminia, S., Baur, C., Kuijper, A., van Ginneken, B., Navab, N., Albarqouni, S., & Mukhopadhyay, A. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101938 · Cited by 534
Deep Clustering for Unsupervised Learning of Visual Features
Caron, M., Bojanowski, P., Joulin, A., & Douze, M. (2018) · arXiv · doi:10.48550/arxiv.1807.05520 · Cited by 533
Cross-Modal Self-Attention Network for Referring Image Segmentation
Ye, L., Rochan, M., Liu, Z., & Wang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01075 · Cited by 532
HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentation
Heidari, M., Kazerouni, A., Soltany, M., Azad, R., Aghdam, E. K., Cohen-Adad, J., & Merhof, D. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00614 · Cited by 530
Collaborative Multi-Robot Search and Rescue: Planning, Coordination, Perception, and Active Vision
Queralta, J. P., Taipalmaa, J., Can Pullinen, B., Sarker, V. K., Nguyen Gia, T., Tenhunen, H., Gabbouj, M., Raitoharju, J., & Westerlund, T. (2020) · IEEE Access · doi:10.1109/access.2020.3030190 · Cited by 526
CCNet: Criss-Cross Attention for Semantic Segmentation
Huang, Z., Wang, X., Wei, Y., Huang, L., Shi, H., Liu, W., & Huang, T. S. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3007032 · Cited by 524
“Deeplabv2 [6] proposed atrous spatial pyramid pooling (ASPP) to use different dilation convolutions to capture contextual information.”
BackgroundMethodInfluentialSalient object detection: A survey
Borji, A., Cheng, M.-M., Hou, Q., Jiang, H., & Li, J. (2019) · Computational Visual Media · doi:10.1007/s41095-019-0149-9 · Cited by 524
Metadata
- Authors
- Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L.
- Affiliations
- Google (United States) (US)
- University College London (GB)
- Johns Hopkins University (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2018-04-01
- Volume
- 40
- Issue
- 4
- Pages
- 834-848
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2412782625
- Cited by
- 22,392
- References
- 108
- Citations by year
- 2026: 1655 · 2025: 2789 · 2024: 3153 · 2023: 3262 · 2022: 3039 · 2021: 2885 · 2020: 2282 · 2019: 1914 · 2018: 1035
- FWCI
- 631.17
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- arXiv (Cornell University)
- Funders
- ARO 62250-CS
- FP7-RECONFIG
- FP7-MOBOT
- H2020-ISUPPORT EU
- NVIDIA Corporation
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- semantic segmentation, dilated convolution, atrous spatial pyramid pooling, conditional random fields, dense prediction, boundary localization, Pascal VOC 2012, Pascal Context, cityscape, probabilistic graphical models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.