Fully Convolutional Networks for Semantic Segmentation
Open accessThe DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Abstract
Convolutional networks are powerful visual models that yield hierarchies of features. We show that convolutional networks by themselves, trained end-to-end, pixels-to-pixels, improve on the previous best result in semantic segmentation. Our key insight is to build "fully convolutional" networks that take input of arbitrary size and produce correspondingly-sized output with efficient inference and learning. We define and detail the space of fully convolutional networks, explain their application to spatially dense prediction tasks, and draw connections to prior models. We adapt contemporary classification networks (AlexNet, the VGG net, and GoogLeNet) into fully convolutional networks and transfer their learned representations by fine-tuning to the segmentation task. We then define a skip architecture that combines semantic information from a deep, coarse layer with appearance information from a shallow, fine layer to produce accurate and detailed segmentations. Our fully convolutional networks achieve improved segmentation of PASCAL VOC (30% relative improvement to 67.2% mean IU on 2012), NYUDv2, SIFT Flow, and PASCAL-Context, while inference takes one tenth of a second for a typical image.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Convolutional neural networks (CNNs) have excelled at detecting landmarks and performing semantic segmentation when sufficiently large annotated datasets are available for training [10,11].”
From Automatic Annotation of Hip Anatomy in Fluoroscopy for Robust and Efficient 2D/3D Registration (2020) · cites this paper as [11]
In the citing paper
“The first significant difference is that soiling on the lens can be removed by a camera cleaning system that either sprays water or uses a more sophisticated ultrasonic hardware [29].”
From Let’s Get Dirty: GAN Based Data Augmentation for Camera Lens Soiling Detection in Autonomous Driving (2021) · cites this paper as [29]
In the citing paper
“We want to emphasize that the soiling detection task is necessary for an autonomous driving system as it is used to trigger a camera cleaning system that restores the lens [29].”
From Let’s Get Dirty: GAN Based Data Augmentation for Camera Lens Soiling Detection in Autonomous Driving (2021) · cites this paper as [29]
In the citing paper
“Multi-scale features extracted from CNNs have been shown to be effective for improving segmentation accuracy [11], [22], [23].”
From DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation (2019) · cites this paper as [11]
In the citing paper
“However, current FCNN approaches [65], [66] lack adequate spatial resolution in their directly output label space.”
From Deep convolutional neural networks for computer-aided detection: cnn architectures, dataset characteristics and transfer learning (2016) · cites this paper as [65]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Self-citationRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Self-citationBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
A Wavelet Tour of Signal Processing
(1999) · Elsevier eBooks · doi:10.1016/b978-0-12-466606-1.x5000-4 · Cited by 16,227
Cited by
Items 401–462 of 462
Depth-Adaptive Deep Neural Network for Semantic Segmentation
Kang, B., Lee, Y., & Nguyen, T. Q. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2798282 · Cited by 71
Roy, M., Wang, F., Vo, H., Teng, D., Teodoro, G., Farris, A. B., Castillo-Leon, E., Vos, M. B., & Kong, J. (2020) · Laboratory Investigation · doi:10.1038/s41374-020-0463-y · Cited by 68
Bayesian convolutional neural network based MRI brain extraction on nonhuman primates
Zhao, G., Liu, F., Oler, J. A., Meyerand, M. E., Kalin, N. H., & Birn, R. M. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.03.065 · Cited by 68
Mohamed, E., Sirlantzis, K., & Howells, G. (2022) · Displays · doi:10.1016/j.displa.2022.102239 · Cited by 67
Fusion of tactile and visual information in deep learning models for object recognition
Babadian, R. P., Faez, K., Amiri, M., & Falotico, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.11.032 · Cited by 67
Let’s Get Dirty: GAN Based Data Augmentation for Camera Lens Soiling Detection in Autonomous Driving
Uricar, M., Sistu, G., Rashed, H., Vobecky, A., Kumar, V. R., Krizek, P., Burger, F., & Yogamani, S. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00081 · Cited by 66
Optimization by Self-Organized Criticality
Hoffmann, H., & Payton, D. W. (2018) · Scientific Reports · doi:10.1038/s41598-018-20275-7 · Cited by 65
Optical navigation for Lunar landing based on Convolutional Neural Network crater detector
Silvestrini, S., Piccinin, M., Zanotti, G., Brandonisio, A., Bloise, I., Feruglio, L., Lunghi, P., Lavagna, M., & Varile, M. (2022) · Aerospace Science and Technology · doi:10.1016/j.ast.2022.107503 · Cited by 65
Semantic and structural image segmentation for prosthetic vision
Sanchez-Garcia, M., Martinez-Cantin, R., & Guerrero, J. J. (2020) · PLOS ONE · doi:10.1371/journal.pone.0227677 · Cited by 62
Learning to denoise astronomical images with U-nets
Vojtekova, A., Lieu, M., Valtchanov, I., Altieri, B., Old, L., Chen, Q., & Hroch, F. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa3567 · Cited by 63
Weak Micro-Scratch Detection Based on Deep Convolutional Neural Network
Song, L., Lin, W., Yang, Y.-G., Zhu, X., Guo, Q., & Xi, J. (2019) · IEEE Access · doi:10.1109/access.2019.2894863 · Cited by 61
DESTINI: A deep-learning approach to contact-driven protein structure prediction
Gao, M., Zhou, H., & Skolnick, J. (2019) · Scientific Reports · doi:10.1038/s41598-019-40314-1 · Cited by 61
“Note that our network does not have any dropout layer, due to the fact that we need pixel-level resolution, unlike image segmentation problems 32 .”
BackgroundMethodTechnical Note: Deep learning based MRAC using rapid ultrashort echo time imaging
Jang, H., Liu, F., Zhao, G., Bradshaw, T., & McMillan, A. B. (2018) · Medical Physics · doi:10.1002/mp.12964 · Cited by 60
Kadam, K. D., Ahirrao, S., & Kotecha, K. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/6845326 · Cited by 59
RetractedZhao, Z., Wu, C.-M., Zhang, S., He, F., Liu, F., Wang, B., Huang, Y., Shi, W., Jian, D., Xie, H., et al. (2021) · JMIR Medical Informatics · doi:10.2196/23415 · Cited by 58
Revisiting Monocular Satellite Pose Estimation With Transformer
Wang, Z., Zhang, Z., Sun, X., Li, Z., & Yu, Q. (2022) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2022.3161605 · Cited by 59
Deep learning fetal ultrasound video model match human observers in biometric measurements
Płotka, S., Klasa, A., Lisowska, A., Seliga-Siwecka, J., Lipa, M., Trzciński, T., & Sitek, A. (2022) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ac4d85 · Cited by 57
Application of region-based video surveillance in smart cities using deep learning
Zahra, A., Ghafoor, M., Munir, K., Ullah, A., & Ul Abideen, Z. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11468-w · Cited by 53
Multi-Modal Sensor Fusion-Based Semantic Segmentation for Snow Driving Scenarios
Vachmanus, S., Ravankar, A. A., Emaru, T., & Kobayashi, Y. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3077029 · Cited by 53
Khoshboresh Masouleh, M., & Shah-Hosseini, R. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.07.009 · Cited by 51
[Retracted] An Automated Deep Learning Model for the Cerebellum Segmentation from Fetal Brain Images
Sreelakshmy, R., Titus, A., Sasirekha, N., Logashanmugam, E., Begam, R. B., Ramkumar, G., & Raju, R. (2022) · BioMed Research International · doi:10.1155/2022/8342767 · Cited by 51
RetractedRobust Semantic Segmentation in Adverse Weather Conditions by means of Sensor Data Fusion
Pfeuffer, A., & Dietmayer, K. (2019) · 2019 22th International Conference on Information Fusion (FUSION) · doi:10.23919/fusion43075.2019.9011192 · Cited by 51
Bayoudh, K., Hamdaoui, F., & Mtibaa, A. (2020) · Physical and Engineering Sciences in Medicine · doi:10.1007/s13246-020-00957-1 · Cited by 50
A Dynamic Deep Neural Network Design for Efficient Workload Allocation in Edge Computing
Lo, C., Su, Y.-Y., Lee, C.-Y., & Chang, S.-C. (2017) · 2017 IEEE International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2017.49 · Cited by 48
Real-time intraoperative diagnosis by deep neural network driven multiphoton virtual histology
You, S., Sun, Y., Yang, L., Park, J., Tu, H., Marjanovic, M., Sinha, S., & Boppart, S. A. (2019) · npj Precision Oncology · doi:10.1038/s41698-019-0104-3 · Cited by 46
EvalAI: Towards Better Evaluation Systems for AI Agents
Yadav, D., Jain, R., Agrawal, H., Chattopadhyay, P., Singh, T., Jain, A., Singh, S. B., Lee, S., & Batra, D. (2019) · arXiv · doi:10.48550/arxiv.1902.03570 · Cited by 42
UNCERTAINTY MODELING AND INTERPRETABILITY IN CONVOLUTIONAL NEURAL NETWORKS FOR POLYP SEGMENTATION
Wickstrom, K., Kampffmeyer, M., & Jenssen, R. (2018) · 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP) · doi:10.1109/mlsp.2018.8516998 · Cited by 41
Visual Semantic Information Pursuit: A Survey
Liu, D., Bober, M., & Kittler, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2950025 · Cited by 39
An automatic deep learning approach for coronary artery calcium segmentation
Santini, G., Latta, D. D., Martini, N., Valvano, G., Gori, A., Ripoli, A., Susini, C. L., Landini, L., & Chiappino, D. (2018) · IFMBE Proceedings · doi:10.1007/978-981-10-5122-7_94 · Cited by 39
Zhuo, X., Fraundorfer, F., Kurz, F., & Reinartz, P. (2018) · Remote Sensing · doi:10.3390/rs10040624 · Cited by 38
Lee, W.-K., Wu, C.-C., Lee, C.-C., Lu, C.-F., Yang, H.-C., Huang, T.-H., Lin, C.-Y., Chung, W.-Y., Wang, P.-S., Wu, H.-M., et al. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101911 · Cited by 35
Huang, B., Lin, X., Shen, J., Chen, X., Chen, J., Li, Z.-P., Wang, M., Yuan, C., Diao, X.-F., Luo, Y., et al. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3070708 · Cited by 35
Neural Batch Sampling with Reinforcement Learning for Semi-supervised Anomaly Detection
Chu, W.-H., & Kitani, K. M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58574-7_45 · Cited by 34
“Although supervised segmentation algorithms have seen significant advances in recent years [17, 22, 7], they are difficult to apply directly to such tasks due to the rare occurrence of anomalies during data collection.”
BackgroundThree-stage segmentation of lung region from CT images using deep neural networks
Osadebey, M., Andersen, H. K., Waaler, D., Fossaa, K., Martinsen, A. C. T., & Pedersen, M. (2021) · BMC Medical Imaging · doi:10.1186/s12880-021-00640-1 · Cited by 34
Zeng, W., Luo, J., Cheng, J., & Lu, Y. (2022) · Medical Physics · doi:10.1002/mp.15700 · Cited by 31
Luo, G., Dong, S., Wang, W., Wang, K., Cao, S., Tam, C., Zhang, H., Howey, J., Ohorodnyk, P., & Li, S. (2020) · Medical Image Analysis · doi:10.1016/j.media.2019.101591 · Cited by 30
DooDLeNet: Double DeepLab Enhanced Feature Fusion for Thermal-color Semantic Segmentation
Frigo, O., Martin-Gaffe, L., & Wacongne, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00341 · Cited by 32
Lunar Terrain Relative Navigation Using a Convolutional Neural Network for Visual Crater Detection
Downes, L. M., Steiner, T. J., & How, J. P. (2020) · 2020 American Control Conference (ACC) · doi:10.23919/acc45564.2020.9147595 · Cited by 35
Kim, Y.-G., Choi, G., Go, H., Cho, Y., Lee, H., Lee, A.-R., Park, B., & Kim, N. (2019) · Scientific Reports · doi:10.1038/s41598-019-41479-5 · Cited by 29
Detecting surface defects of heritage buildings based on deep learning
Fu, X., & Angkawisittpan, N. (2024) · Journal of Intelligent Systems · doi:10.1515/jisys-2023-0048 · Cited by 27
Zheng, H., Motch Perrine, S. M., Pitirri, M. K., Kawasaki, K., Wang, C., Richtsmeier, J. T., & Chen, D. Z. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59710-8_78 · Cited by 25
A novel framework for segmentation of small targets in medical images
Zhao, L., Wang, T., Chen, Y., Zhang, X., Tang, H., Lin, F., Li, C., Li, Q., Tan, T., Kang, D., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-94437-9 · Cited by 24
A Survey on Deep Learning for Precision Oncology
Wang, C.-W., Khalil, M.-A., & Firdi, N. (2022) · Diagnostics · doi:10.3390/diagnostics12061489 · Cited by 23
Hidden Path Selection Network for Semantic Segmentation of Remote Sensing Images
Yang, K., Tong, X.-Y., Xia, G.-S., Shen, W., & Zhang, L. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3197334 · Cited by 22
A simulation-based few samples learning method for surface defect segmentation
Wei, T., Cao, D., Zheng, C., & Yang, Q. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.06.090 · Cited by 21
A hybrid vision-map method for urban road detection
Fernández, C., Fernández-Llorca, D., & Sotelo, M. A. (2017) · Journal of Advanced Transportation · doi:10.1155/2017/7090549 · Cited by 20
Portable System for Box Volume Measurement Based on Line-Structured Light Vision and Deep Learning
Peng, T., Zhang, Z., Song, Y., Chen, F., & Zeng, D. (2019) · Sensors · doi:10.3390/s19183921 · Cited by 20
WebCode2M: A Real-World Dataset for Code Generation from Webpage Designs
Gui, Y., Li, Z., Wan, Y., Shi, Y., Zhang, H., Chen, B., Su, Y., Chen, D., Wu, S., Zhou, X., et al. (2025) · Proceedings of the ACM on Web Conference 2025 · doi:10.1145/3696410.3714889 · Cited by 17
Memory-Augmented Temporal Dynamic Learning for Action Recognition
Yuan, Y., Wang, D., & Wang, Q. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019167 · Cited by 17
Kuang, B., Gu, C., Rana, Z. A., Zhao, Y., Sun, S., & Nnabuife, S. G. (2022) · Sensors · doi:10.3390/s22218393 · Cited by 15
Lowe, M. E., Andersen, D. K., Caprioli, R. M., Choudhary, J., Cruz-Monserrate, Z., Dasyam, A. K., Forsmark, C. E., Gorelick, F. S., Gray, J. W., Haupt, M., et al. (2019) · Pancreas · doi:10.1097/mpa.0000000000001412 · Cited by 15
Pagnutti, G., Minto, L., & Zanuttigh, P. (2017) · IET Computer Vision · doi:10.1049/iet-cvi.2016.0502 · Cited by 14
A Fusion Model for Road Detection based on Deep Learning and Fully Connected CRF
Yang, F., Yang, J., Jin, Z., & Wang, H. (2018) · 2018 13th Annual Conference on System of Systems Engineering (SoSE) · doi:10.1109/sysose.2018.8428696 · Cited by 13
Vehicle Detection in UAV Traffic Video Based on Convolution Neural Network
Li, S., Zhang, W., Li, G., Su, L., & Huang, Q. (2018) · 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2018.00009 · Cited by 12
Zhou, Z., Jia, S., & Cao, L. (2022) · Sensors · doi:10.3390/s22207877 · Cited by 11
Xu, Y., Lee, L. H., Drukker, L., Yaqub, M., Papageorghiou, A. T., & Noble, A. J. (2020) · Journal of medical imaging · doi:10.1117/1.jmi.7.5.057001 · Cited by 8
A Bayesian Hierarchical Network for Combining Heterogeneous Data Sources in Medical Diagnoses
Donnat, C., Miolane, N., Bunbury, F., & Kreindler, J. (2020) · arXiv · doi:10.48550/arxiv.2007.13847 · Cited by 7
Residual Grounding Transformer Network for Terrain Recognition on the Lunar Surface
Qiu, L., Li, H., Li, Z., & Wang, C. (2021) · Applied Optics · doi:10.1364/ao.428232 · Cited by 7
Engineering the Neural Automatic Passenger Counter
Jahn, N., & Siebert, M. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105148 · Cited by 6
Median Filter Helps Lymph Node Segmentation in Deep Learning via PET/CT
Zhang, X., Liao, W., & Xu, G. (2021) · 2021 4th International Conference on Digital Medicine and Image Processing · doi:10.1145/3506651.3506662 · Cited by 1
Morphology–aware spatiotemporal prediction of cumulonimbus–related radar echoes using CSDP–Net
Wang, D., Wang, X., Cheng, Z., Chang, X., Yuan, H., Yang, J., Liang, Y., Hu, J., & Zhang, T. (2026) · Theoretical and Applied Climatology · doi:10.1007/s00704-026-06276-x
CSDP-Net: An Accurate Approach for Cumulonimbus Spatiotemporal Distribution Prediction
Wang, D., Wang, X., Chang, X., Cheng, Z., Yuan, H., Yang, J., Liang, Y., Hu, J., & Zhang, T. (2025) · doi:10.21203/rs.3.rs-7610452/v1
Metadata
- Authors
- Shelhamer, E., Long, J., & Darrell, T.
- Affiliations
- University of California, Berkeley (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2017-04-01
- Volume
- 39
- Issue
- 4
- Pages
- 640-651
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2395611524
- Cited by
- 11,898
- References
- 72
- Citations by year
- 2026: 475 · 2025: 963 · 2024: 1321 · 2023: 1477 · 2022: 1700 · 2021: 1653 · 2020: 1436 · 2019: 1278 · 2018: 930 · 2017: 463
- FWCI
- 631.95
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- DARPA's MSEE
- SMISC
- US National Science Foundation (IIS-1427425, IIS-1212798, IIS-1116411)
- NSF
- GRFP
- Toyota
- Berkeley Vision and Learning Center
- NVIDIA
- GPU
- SIFT
- IU
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Keywords
- fully convolutional network, semantic segmentation, skip connections, fine-tuning, representation transfer, AlexNet, VGG, GoogLeNet, inference efficiency, Pascal VOC, SIFT flow, Pascal Context
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.