SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Open accessThe DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Abstract
We present a novel and practical deep fully convolutional neural network architecture for semantic pixel-wise segmentation termed SegNet. This core trainable segmentation engine consists of an encoder network, a corresponding decoder network followed by a pixel-wise classification layer. The architecture of the encoder network is topologically identical to the 13 convolutional layers in the VGG16 network [1] . The role of the decoder network is to map the low resolution encoder feature maps to full input resolution feature maps for pixel-wise classification. The novelty of SegNet lies is in the manner in which the decoder upsamples its lower resolution input feature map(s). Specifically, the decoder uses pooling indices computed in the max-pooling step of the corresponding encoder to perform non-linear upsampling. This eliminates the need for learning to upsample. The upsampled maps are sparse and are then convolved with trainable filters to produce dense feature maps. We compare our proposed architecture with the widely adopted FCN [2] and also with the well known DeepLab-LargeFOV [3] , DeconvNet [4] architectures. This comparison reveals the memory versus accuracy trade-off involved in achieving good segmentation performance. SegNet was primarily motivated by scene understanding applications. Hence, it is designed to be efficient both in terms of memory and computational time during inference. It is also significantly smaller in the number of trainable parameters than other competing architectures and can be trained end-to-end using stochastic gradient descent. We also performed a controlled benchmark of SegNet and other architectures on both road scenes and SUN RGB-D indoor scene segmentation tasks. These quantitative assessments show that SegNet provides good performance with competitive inference time and most efficient inference memory-wise as compared to other architectures. We also provide a Caffe implementation of SegNet and a web demo at http://mi.eng.cam.ac.uk/projects/segnet.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“it is even quantitatively better than the methods that are pretrained on ImageNet without consideration of memory footprint and speed, such as SegNet [2], and the model parameters of CGNet M3N21 is about 60 times smaller than it.”
From CGNet: A Light-Weight Context Guided Network for Semantic Segmentation (2021) · cites this paper as [2]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, it also raises a fundamental limitation that learning long-range dependency information, critical for semantic segmentation in unconstrained scene images [1,48], becomes challenging due to still limited receptive fields.”
From Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers (2021) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“learning long-range dependency information, critical for semantic segmentation in unconstrained scene images [1,48], becomes challenging due to still limited receptive fields.”
From Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers (2021) · cites this paper as [1]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“It is shown that ViT can learn stronger long-range dependency information critical for semantic segmentation in unconstrained scene images Badrinarayanan et al. (2017), Yang et al. (2018), achieving superior semantic segmentation performances.”
From Vision Transformers: From Semantic Segmentation to Dense Prediction (2024) · cites this paper as Badrinarayanan et al. (2017)
Experimental — accuracy not yet measuredIn the citing paper
“This architecture delivers state-of-the-art results that outperform other models (e.g., SegNet, Badrinarayanan et al., 2017;DeepLab, Chen et al., 2018) against established benchmarks (Brostow et al., 2009), while having a low number of trainable parameters and corresponding training times.”
From Global mapping of river sediment bars (2024) · cites this paper as Badrinarayanan et al., 2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Fully convolutional networks for semantic segmentationPreprint
Long, J., Shelhamer, E., & Darrell, T. (2014) · Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1605.06211 · Cited by 43,735
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Research works printed but not linked: 4
- grangier, 2009, Deep convolutional networks for scene parsing, Proc ICML Deep Learn Workshop
- gal, 2015, Dropout as a Bayesian approximation: Insights and applications, Proc ICML Deep Learn Workshop
- 10.1109/ICCV.2015.304 · DOI · Paper page
- 10.1109/ICCV.2015.178 · DOI · Paper page
Cited by
Items 1,001–1,095 of 1,095
Deep Learning-Based Glaucoma Detection With Cropped Optic Cup and Disc and Blood Vessel Segmentation
Islam, M. T., Mashfu, S. T., Faisal, A., Siam, S. C., Naheen, I. T., & Khan, R. (2021) · IEEE Access · doi:10.1109/access.2021.3139160 · Cited by 134
Half-UNet: A Simplified U-Net Architecture for Medical Image Segmentation
Lu, H., She, Y., Tie, J., & Xu, S. (2022) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2022.911679 · Cited by 177
A multi-scale fully convolutional network for semantic labeling of 3D point clouds
Yousefhussien, M., Kelbe, D., Ientilucci, E. J., & Salvaggio, C. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.03.018 · Cited by 127
Lian, C., Zhang, J., Liu, M., Zong, X., Hung, S., Lin, W., & Shen, D. G. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.02.009 · Cited by 135
SegSort: Segmentation by Discriminative Sorting of Segments
Hwang, J.-J., Yu, S., Shi, J., Collins, M., Yang, T.-J., Zhang, X., & Chen, L.-C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00743 · Cited by 124
Human Activity Recognition Based on Motion Sensor Using U-Net
Zhang, Y., Zhang, Z., Zhang, Y., Bao, J., Zhang, Y., & Deng, H. (2019) · IEEE Access · doi:10.1109/access.2019.2920969 · Cited by 121
RGB and LiDAR fusion based 3D Semantic Segmentation for Autonomous Driving
El Madawi, K., Rashed, H., El Sallab, A., Nasr, O., Kamel, H., & Yogamani, S. (2019) · 2019 IEEE Intelligent Transportation Systems Conference (ITSC) · doi:10.1109/itsc.2019.8917447 · Cited by 116
Triplet adversarial domain adaptation for pixel-level classification of VHR remote sensing images
Yan, L., Fan, B., Liu, H., Huo, C., Xiang, S., & Pan, C. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2958123 · Cited by 115
Analyzing the quality and challenges of uncertainty estimations for brain tumor segmentation
Jungo, A., Balsiger, F., & Reyes, M. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00282 · Cited by 115
RTSeg: Real-Time Semantic Segmentation Comparative Study
Siam, M., Gamal, M., Abdel-Razek, M., Yogamani, S., & Jagersand, M. (2018) · 2018 25th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2018.8451495 · Cited by 112
Polarization-driven semantic segmentation via efficient attention-bridged fusion
Xiang, K., Yang, K., & Wang, K. (2021) · Optics Express · doi:10.1364/oe.416130 · Cited by 111
Balamuralidhar, N., Tilon, S., & Nex, F. (2021) · Remote Sensing · doi:10.3390/rs13040573 · Cited by 104
Morales, E. F., Murrieta-Cid, R., Becerra, I., & Esquivel-Basaldua, M. A. (2021) · Intelligent Service Robotics · doi:10.1007/s11370-021-00398-z · Cited by 101
Technical and clinical overview of deep learning in radiology
Ueda, D., Shimazaki, A., & Miki, Y. (2019) · Japanese Journal of Radiology · doi:10.1007/s11604-018-0795-3 · Cited by 100
Attention fusion network for multi-spectral semantic segmentation
Xu, J., Lu, K., & Wang, H. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.03.015 · Cited by 99
Online Model Distillation for Efficient Video Inference
Mullapudi, R. T., Chen, S., Zhang, K., Ramanan, D., & Fatahalian, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00367 · Cited by 96
Nassar, A., Amer, K., ElHakim, R., & ElHelw, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00201 · Cited by 94
Liang, Y., Schott, D., Zhang, Y., Wang, Z., Nasief, H., Paulson, E., Hall, W., Knechtges, P., Erickson, B., & Li, X. A. (2020) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2020.01.021 · Cited by 90
Detecting fake images by identifying potential texture difference
Yang, J., Xiao, S., Li, A., Lan, G., & Wang, H. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.06.043 · Cited by 86
Language-based colorization of scene sketches
Zou, C., Mo, H., Gao, C., Du, R., & Fu, H. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356561 · Cited by 86
Large-Scale Unsupervised Semantic Segmentation
Gao, S., Li, Z.-Y., Yang, M.-H., Cheng, M.-M., Han, J., & Torr, P. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3218275 · Cited by 88
Semi-supervised convolutional neural networks for human activity recognition
Zeng, M., Yu, T., Wang, X., Nguyen, L. T., Mengshoel, O. J., & Lane, I. (2017) · 2017 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2017.8257967 · Cited by 85
Designing efficient accelerator of depthwise separable convolutional neural network on FPGA
Ding, W., Huang, Z., Huang, Z., Tian, L., Wang, H., & Feng, S. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2018.12.008 · Cited by 85
Vision based pixel-level bridge structural damage detection using a link ASPP network
Deng, W., Mou, Y., Kashiwa, T., Escalera, S., Nagai, K., Nakayama, K., Matsuo, Y., & Prendinger, H. (2020) · Automation in Construction · doi:10.1016/j.autcon.2019.102973 · Cited by 84
Traffic Scene Segmentation Based on RGB-D Image and Deep Learning
Li, L., Qian, B., Lian, J., Zheng, W., & Zhou, Y. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2724138 · Cited by 77
ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions
Gao, H., Wang, Z., Cai, L., & Ji, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2975796 · Cited by 81
Dozen, A., Komatsu, M., Sakai, A., Komatsu, R., Shozu, K., Machino, H., Yasutomi, S., Arakaki, T., Asada, K., Kaneko, S., et al. (2020) · Biomolecules · doi:10.3390/biom10111526 · Cited by 79
Deep Learning-Based Applications for Safety Management in the AEC Industry: A Review
Hou, L., Chen, H., Zhang, G. (., & Wang, X. (2021) · Applied Sciences · doi:10.3390/app11020821 · Cited by 76
Betthauser, J. L., Krall, J. T., Bannowsky, S. G., Levay, G., Kaliki, R. R., Fifer, M. S., & Thakor, N. V. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2943309 · Cited by 73
SMSnet: Semantic motion segmentation using deep convolutional neural networks
Vertens, J., Valada, A., & Burgard, W. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202211 · Cited by 69
Bayesian convolutional neural network based MRI brain extraction on nonhuman primates
Zhao, G., Liu, F., Oler, J. A., Meyerand, M. E., Kalin, N. H., & Birn, R. M. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.065 · Cited by 68
Mohamed, E., Sirlantzis, K., & Howells, G. (2022) · Displays · doi:10.1016/j.displa.2022.102239 · Cited by 67
Deepfake forensics analysis: An explainable hierarchical ensemble of weakly supervised models
Silva, S. H., Bethany, M., Votto, A. M., Scarff, I. H., Beebe, N., & Najafirad, P. (2022) · Forensic Science International: Synergy · doi:10.1016/j.fsisyn.2022.100217 · Cited by 66
LMNet: Real-time Multiclass Object Detection on CPU Using 3D LiDAR
Minemura, K., Liau, H., Monrroy, A., & Kato, S. (2018) · 2018 3rd Asia-Pacific Conference on Intelligent Robot Systems (ACIRS) · doi:10.1109/acirs.2018.8467245 · Cited by 64
Deep semantic classification for 3D LiDAR data
Dewan, A., Oliveira, G. L., & Burgard, W. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206198 · Cited by 60
Technical Note: Deep learning based MRAC using rapid ultrashort echo time imaging
Jang, H., Liu, F., Zhao, G., Bradshaw, T., & McMillan, A. B. (2018) · Medical Physics · doi:10.1002/mp.12964 · Cited by 60
Relation Classification with Entity Type Restriction
Lyu, S., & Chen, H. (2021) · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · doi:10.18653/v1/2021.findings-acl.34 · Cited by 59
Pedestrian detection in automotive safety: Understanding state-of-the-art
Ragesh, N. K., & Rajesh, R. (2019) · IEEE Access · doi:10.1109/access.2019.2909992 · Cited by 57
Visual-based obstacle detection and tracking, and conflict detection for small UAS sense and avoid
Opromolla, R., & Fasano, G. (2021) · Aerospace Science and Technology · doi:10.1016/j.ast.2021.107167 · Cited by 54
Application of region-based video surveillance in smart cities using deep learning
Zahra, A., Ghafoor, M., Munir, K., Ullah, A., & Ul Abideen, Z. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11468-w · Cited by 53
Li, G., Jiang, S., Yun, I., Kim, J., & Kim, J. (2020) · IEEE Access · doi:10.1109/access.2020.2971760 · Cited by 53
Khoshboresh Masouleh, M., & Shah-Hosseini, R. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.07.009 · Cited by 51
Robust Semantic Segmentation in Adverse Weather Conditions by means of Sensor Data Fusion
Pfeuffer, A., & Dietmayer, K. (2019) · 2019 22th International Conference on Information Fusion (FUSION) · doi:10.23919/fusion43075.2019.9011192 · Cited by 51
Visual Scene Understanding for Autonomous Driving Using Semantic Segmentation
Hofmarcher, M., Unterthiner, T., Arjona-Medina, J., Klambauer, G., Hochreiter, S., & Nessler, B. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_15 · Cited by 51
Yi (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.11.056 · Cited by 49
“Combating deepfakes: multi-LSTM and blockchain as proof of authenticity for digital media,”
Ki Chan, C. C., Kumar, V., Delaney, S., & Gochoo, M. (2020) · 2020 IEEE / ITU International Conference on Artificial Intelligence for Good (AI4G) · doi:10.1109/ai4g50087.2020.9311067 · Cited by 48
Lei, X., Siringoringo, D. M., Sun, Z., & Fujino, Y. (2023) · Structural Health Monitoring · doi:10.1177/14759217221116637 · Cited by 45
Multimodal Neural Networks: RGB-D for Semantic Segmentation and Object Detection
Schneider, L., Jasch, M., Fröhlich, B., Weber, T., Franke, U., Pollefeys, M., & Rätsch, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59126-1_9 · Cited by 42
UNCERTAINTY MODELING AND INTERPRETABILITY IN CONVOLUTIONAL NEURAL NETWORKS FOR POLYP SEGMENTATION
Wickstrom, K., Kampffmeyer, M., & Jenssen, R. (2018) · 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP) · doi:10.1109/mlsp.2018.8516998 · Cited by 41
Assessment of a new GeoAI foundation model for flood inundation mapping
Li, W., Lee, H., Wang, S., Hsu, C.-Y., & Arundel, S. T. (2023) · arXiv · doi:10.48550/arxiv.2309.14500 · Cited by 40
Assessment of a new GeoAI foundation model for flood inundation mapping
Li, W., Lee, H., Wang, S., Hsu, C.-Y., & Arundel, S. T. (2023) · Proceedings of the 6th ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery · doi:10.1145/3615886.3627747 · Cited by 39
Motion and Depth Augmented Semantic Segmentation for Autonomous Navigation
Rashed, H., El Sallab, A., Yogamani, S., & ElHelw, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00049 · Cited by 38
Endometrium segmentation on transvaginal ultrasound image using key-point discriminator
Park, H., Lee, H. J., Kim, H. G., Ro, Y. M., Shin, D., Lee, S. R., Kim, S. H., & Kong, M. (2019) · Medical Physics · doi:10.1002/mp.13677 · Cited by 37
Mapping oil palm density at country scale: An active learning approach
Rodríguez, A. C., D'Aronco, S., Schindler, K., & Wegner, J. D. (2021) · Remote Sensing of Environment · doi:10.1016/j.rse.2021.112479 · Cited by 36
Paillassa, M., Bertin, E., & Bouy, H. (2020) · Astronomy & Astrophysics · doi:10.1051/0004-6361/201936345 · Cited by 35
“The neural network has a simple SegNet-like convolutional-deconvolutional architecture (Badrinarayanan et al. 2015), but it is not based on VGG hyper-parameters (Simonyan & Zisserman 2014).”
MethodThe Smart Black Box: A Value-Driven High-Bandwidth Automotive Event Data Recorder
Yao, Y., & Atkins, E. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2971385 · Cited by 33
de Hoog, J., Maetschke, S., Ilfrich, P., & Kolluri, R. R. (2020) · Proceedings of the Eleventh ACM International Conference on Future Energy Systems · doi:10.1145/3396851.3397681 · Cited by 32
Li, Y., Xu, R., Ohya, J., & Iwata, H. (2017) · 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2017.8037116 · Cited by 32
Rock Segmentation in the Navigation Vision of the Planetary Rovers
Kuang, B., Wisniewski, M., Rana, Z. A., & Zhao, Y. (2021) · Mathematics · doi:10.3390/math9233048 · Cited by 31
DooDLeNet: Double DeepLab Enhanced Feature Fusion for Thermal-color Semantic Segmentation
Frigo, O., Martin-Gaffe, L., & Wacongne, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00341 · Cited by 32
Karamitrou, A., Sturt, F., Bogiatzis, P., & Beresford-Jones, D. (2022) · Surface Topography: Metrology and Properties · doi:10.1088/2051-672x/ac9492 · Cited by 29
Multi-Scale Vehicle Detection in High-Resolution Aerial Images With Context Information
Li, X., Li, X., & Pan, H. (2020) · IEEE Access · doi:10.1109/access.2020.3036075 · Cited by 29
Nakhle, F., & Harfouche, A. L. (2021) · Patterns · doi:10.1016/j.patter.2021.100323 · Cited by 28
Hu, R., Singla, R., Yan, R., Mayer, C., & Rohling, R. N. (2019) · 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8857448 · Cited by 27
Diagonalwise Refactorization: An Efficient Training Method for Depthwise Convolutions
Qin, Z., Zhang, Z., Li, D., Zhang, Y., & Peng, Y. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489312 · Cited by 27
Collaborative Multi-Robot Systems for Search and Rescue: Coordination and Perception
Queralta, J. P., Taipalmaa, J., Pullinen, B. C., Sarker, V. K., Gia, T. N., Tenhunen, H., Gabbouj, M., Raitoharju, J., & Westerlund, T. (2020) · arXiv · doi:10.48550/arxiv.2008.12610 · Cited by 27
Global mapping of river sediment bars
Carbonneau, P. E., & Bizzi, S. (2024) · Earth Surface Processes and Landforms · doi:10.1002/esp.5739 · Cited by 27
Perspective-Adaptive Convolutions for Scene Parsing
Zhang, R., Tang, S., Zhang, Y., Li, J., & Yan, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2890637 · Cited by 25
AuxNet: Auxiliary Tasks Enhanced Semantic Segmentation for Automated Driving
Chennupati, S., Sistu, G., Yogamani, S., & Rawashdeh, S. (2019) · Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications · doi:10.5220/0007684106450652 · Cited by 42
Exposing DeepFakes Using Convolutional Neural Networks and Transfer Learning Approaches
Suratkar, S., Kazi, F., Sakhalkar, M., Abhyankar, N., & Kshirsagar, M. (2020) · 2020 IEEE 17th India Council International Conference (INDICON) · doi:10.1109/indicon49873.2020.9342252 · Cited by 25
A novel framework for segmentation of small targets in medical images
Zhao, L., Wang, T., Chen, Y., Zhang, X., Tang, H., Lin, F., Li, C., Li, Q., Tan, T., Kang, D., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-94437-9 · Cited by 24
Automatic Measurement of Endometrial Thickness From Transvaginal Ultrasound Images
Liu, Y., Zhou, Q., Peng, B., Jiang, J., Fang, L., Weng, W., Wang, W., Wang, S., & Zhu, X. (2022) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2022.853845 · Cited by 23
Dimitri, G. M. (2022) · Computers · doi:10.3390/computers11110163 · Cited by 22
Hidden Path Selection Network for Semantic Segmentation of Remote Sensing Images
Yang, K., Tong, X.-Y., Xia, G.-S., Shen, W., & Zhang, L. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3197334 · Cited by 22
Vision Transformers: From Semantic Segmentation to Dense Prediction
Zhang, L., Lu, J., Zheng, S., Zhao, X., Zhu, X., Fu, Y., Xiang, T., Feng, J., & Torr, P. H. S. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02173-w · Cited by 23
“This leads to different variants of the encoder-decoder structures [9, 28, 29] for multi-level feature fusion.”
BackgroundA computer-aided system for ocular myasthenia gravis diagnosis
Liu, G., Wei, Y., Xie, Y., Li, J., Qiao, L., & Yang, J.-J. (2021) · Tsinghua Science and Technology · doi:10.26599/tst.2021.9010025 · Cited by 21
Gray, M. E., Dickson, B. G., Nussear, K. E., Esque, T. C., & Chang, T. (2019) · Ecosphere · doi:10.1002/ecs2.2847 · Cited by 20
Bouget, D., Eijgelaar, R. S., Pedersen, A., Kommers, I., Ardon, H., Barkhof, F., Bello, L., Berger, M. S., Nibali, M. C., Furtner, J., et al. (2021) · Cancers · doi:10.3390/cancers13184674 · Cited by 19
Multimodal representation learning for place recognition using deep Hebbian predictive coding
Pearson, M. J., Dora, S., Struckmeier, O., Knowles, T. C., Mitchinson, B., Tiwari, K., Kyrki, V., Bohte, S., & Pennartz, C. M. A. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.732023 · Cited by 19
Sketch2code: Generating a website from a paper mockup
Robinson, A. (2019) · arXiv · doi:10.48550/arxiv.1905.13750 · Cited by 18
Yang, C., Yang, Z., Liao, S., Guo, J., Yin, S., Liu, C., & Kang, Y. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105801 · Cited by 16
Investigating Vulnerability to Adversarial Examples on Multimodal Data Fusion in Deep Learning
Yu, Y., Lee, H. J., Kim, B. C., Kim, J. U., & Ro, Y. M. (2020) · arXiv · doi:10.48550/arxiv.2005.10987 · Cited by 15
A Fusion Model for Road Detection based on Deep Learning and Fully Connected CRF
Yang, F., Yang, J., Jin, Z., & Wang, H. (2018) · 2018 13th Annual Conference on System of Systems Engineering (SoSE) · doi:10.1109/sysose.2018.8428696 · Cited by 13
Singh, V. K., Yousef Kalafi, E., Cheah, E., Wang, S., Wang, J., Ozturk, A., Li, Q., Eldar, Y. C., Samir, A. E., & Kumar, V. (2022) · Diagnostics · doi:10.3390/diagnostics12123213 · Cited by 11
Ding, Y., Dhawan, G., Jones, C., Ness, T., Nichols, E., Krasnogor, N., & Reynolds, N. J. (2023) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.18726 · Cited by 9
Huang, Z., Gan, Y., Lye, T., Zhang, H., Laine, A., Angelini, E. D., & Hendon, C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59710-8_76 · Cited by 9
Memory Efficient Grasping Point Detection of Nontrivial Objects
Dolezel, P., Stursa, D., Kopecky, D., & Jecha, J. (2021) · IEEE Access · doi:10.1109/access.2021.3086417 · Cited by 9
Defective samples simulation through neural style transfer for automatic surface defect segment
Wei, T., Cao, D., Jiang, X., Zheng, C., & Liu, L. (2020) · 2019 International Conference on Optical Instruments and Technology: Optoelectronic Measurement Technology and Systems · doi:10.1117/12.2540464 · Cited by 10
A central multimodal fusion framework for outdoor scene image segmentation
Zhang, Y., Morel, O., Seulin, R., Mériaudeau, F., & Sidibé, D. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10357-y · Cited by 5
Qiu, Y., Lu, H., Mei, J., Bao, S., & Xu, J. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124734 · Cited by 5
Artificial intelligence algorithm models for agents of embodiment for drone applications
Kourav, S., Verma, K., & Sundararajan, M. (2024) · Information Systems Engineering and Management · doi:10.1007/978-3-031-68256-8_4 · Cited by 4
Untying cable by combining 3D deep neural network with deep reinforcement learning
Fan, Z., Shao, W., Hayashi, T., & Ohashi, T. (2023) · Advanced Robotics · doi:10.1080/01691864.2022.2126729 · Cited by 2
Machine Learning Applications in Lung Cancer Diagnosis, Treatment and Prognosis
Li, Y., Wu, X., Yang, P., Jiang, G., & Luo, Y. (2022) · arXiv · doi:10.48550/arxiv.2203.02794 · Cited by 2
Median Filter Helps Lymph Node Segmentation in Deep Learning via PET/CT
Zhang, X., Liao, W., & Xu, G. (2021) · 2021 4th International Conference on Digital Medicine and Image Processing · doi:10.1145/3506651.3506662 · Cited by 1
EMERSK -- Explainable Multimodal Emotion Recognition with Situational Knowledge
Palash, M., & Bhargava, B. (2023) · arXiv · doi:10.48550/arxiv.2306.08657 · Cited by 25
“We constructed our encoder-decoder network by following the methods used in [44], [45], [46], [47] in image segmentation.”
Method
Metadata
- Authors
- Badrinarayanan, V., Kendall, A., & Cipolla, R.
- Affiliations
- University of Cambridge (GB)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-12-01
- Volume
- 39
- Issue
- 12
- Pages
- 2481-2495
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W1910657905
- Semantic Scholar
- b0c065cd43aa7280e766b5dcbcc7e26abce59330
- Cited by
- 19,631
- References
- 74
- Citations by year
- 2026: 1263 · 2025: 2194 · 2024: 2708 · 2023: 2727 · 2022: 2792 · 2021: 2633 · 2020: 2199 · 2019: 1747 · 2018: 935 · 2017: 356
- FWCI
- 594.57
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- arXiv (Cornell University)
- Apollo (cc-by)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Remote-Sensing Image Classification
- Keywords
- SegNet, semantic segmentation, pixel classification, encoder-decoder architecture, fully convolutional network, VGG16, memory-efficient inference, scene understanding, road scene segmentation, indoor scene segmentation, SUN RGB-D
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.