CoChat

Fully Convolutional Networks for Semantic Segmentation

Open access
Shelhamer, Evan, Long, Jonathan, Darrell, Trevor · 2017 · IEEE Transactions on Pattern Analysis and Machine Intelligence

The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.

Abstract

Convolutional networks are powerful visual models that yield hierarchies of features. We show that convolutional networks by themselves, trained end-to-end, pixels-to-pixels, improve on the previous best result in semantic segmentation. Our key insight is to build "fully convolutional" networks that take input of arbitrary size and produce correspondingly-sized output with efficient inference and learning. We define and detail the space of fully convolutional networks, explain their application to spatially dense prediction tasks, and draw connections to prior models. We adapt contemporary classification networks (AlexNet, the VGG net, and GoogLeNet) into fully convolutional networks and transfer their learned representations by fine-tuning to the segmentation task. We then define a skip architecture that combines semantic information from a deep, coarse layer with appearance information from a shallow, fine layer to produce accurate and detailed segmentations. Our fully convolutional networks achieve improved segmentation of PASCAL VOC (30% relative improvement to 67.2% mean IU on 2012), NYUDv2, SIFT Flow, and PASCAL-Context, while inference takes one tenth of a second for a typical image.

Overview

Integrity signals

Registry

Crossref · 10.1109/tpami.2016.2572683

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Cited by

See all 11,898

Metadata

Authors
Shelhamer, E., Long, J., & Darrell, T.
Affiliations
University of California, Berkeley (US)
Venue
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2017-04-01
Volume
39
Issue
4
Pages
640-651
ISSN
  • 0162-8828 (ISSN-L)
  • 2160-9292
OpenAlex
W2395611524
Cited by
11,898
References
71
Citations by year
2026: 475 · 2025: 963 · 2024: 1321 · 2023: 1477 · 2022: 1700 · 2021: 1653 · 2020: 1436 · 2019: 1278 · 2018: 930 · 2017: 463
FWCI
631.95
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • DARPA's MSEE
  • SMISC
  • US National Science Foundation (IIS-1427425, IIS-1212798, IIS-1116411)
  • NSF
  • GRFP
  • Toyota
  • Berkeley Vision and Learning Center
  • NVIDIA
  • GPU
  • SIFT
  • IU
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
Keywords
fully convolutional network, semantic segmentation, skip connections, fine-tuning, representation transfer, AlexNet, VGG, GoogLeNet, inference efficiency, Pascal VOC, SIFT flow, Pascal Context

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.