Cited by 12,157Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningVisual Attention and Saliency Detection

Squeeze-and-Excitation Networks

Hu, Jie, Shen, Li, Albanie, Samuel, Sun, Gang, Wu, Enhua·2020·IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract

The central building block of convolutional neural networks (CNNs) is the convolution operator, which enables networks to construct informative features by fusing both spatial and channel-wise information within local receptive fields at each layer. A broad range of prior research has investigated the spatial component of this relationship, seeking to strengthen the representational power of a CNN by enhancing the quality of spatial encodings throughout its feature hierarchy. In this work, we focus instead on the channel relationship and propose a novel architectural unit, which we term the "Squeeze-and-Excitation" (SE) block, that adaptively recalibrates channel-wise feature responses by explicitly modelling interdependencies between channels. We show that these blocks can be stacked together to form SENet architectures that generalise extremely effectively across different datasets. We further demonstrate that SE blocks bring significant improvements in performance for existing state-of-the-art CNNs at slight additional computational cost. Squeeze-and-Excitation Networks formed the foundation of our ILSVRC 2017 classification submission which won first place and reduced the top-5 error to 2.251 percent, surpassing the winning entry of 2016 by a relative improvement of ∼ 25 percent. Models and code are available at https://github.com/hujie-frank/SENet.

Integrity signals

Registry

Crossref · 10.1109/tpami.2019.2913372

Cites

83 of 83 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The ImageNet-C benchmark includes 15 types of synthetically generated corruptions grouped into 4 categories.

    “The ImageNet-C benchmark [19] includes 15 types of synthetically generated corruptions, grouped into 4 categories: 'noise', 'blur', 'weather' and 'digital'.”
  • Each corruption type in the ImageNet-C benchmark has five levels of severity, resulting in 75 distinct corruptions.

    “Each corruption type has five levels of severity, resulting in 75 distinct corruptions.”
  • ImageNet-C, ImageNet-R, and ImageNet-A are designed to evaluate robustness in the presence of natural corruptions, naturally occurring distribution shifts, and natural adversarial examples, respectively.

    “ImageNet-C [19], ImageNet-R [18], and ImageNet-A [21] are designed to evaluate robustness in the presence of 'natural corruptions', 'naturally occurring distribution shifts', and 'natural adversarial examples', respectively.”
  • The ImageNet-C benchmark also includes an 'extra' group with additional corruptions.

    “The benchmark also includes an 'extra' group with additional corruptions.”
  • The channel-attention module combining space and channels achieves better results than SENet, which only pays attention to the channel.

    “In our model, these weights are learnable, which we accomplish through a channel-attention module to combine space and channels; this can achieve better results than SENet [44], which only pays attention to the channel.”

    From Multisemantic Path Neural Network for Deepfake Detection (2022) · cites this paper as [44]

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E.
Affiliations
  • Chinese Academy of Sciences (CN)
  • University of Oxford (GB)
Venue
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2020-08-01
Volume
42
Issue
8
Pages
2011-2023
ISSN
  • 0162-8828 (ISSN-L)
  • 2160-9292
  • 1939-3539
OpenAlex
W2963420686
Cited by
12,157
References
83
Citations by year
2026: 677 · 2025: 1050 · 2024: 1269 · 2023: 1472 · 2022: 1719 · 2021: 2997 · 2020: 1960 · 2019: 863 · 2018: 138 · 2017: 10 · 2012: 1
FWCI
843.49
Type
journal article
Language
en
Open access
closed
Locations
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • National Natural Science Foundation of China (61632003, 61620106003, 61672502, 61571439)
  • National Key R&D Program of China (2017YFB1002701)
  • Macao FDCT (068/2015/A2)
  • EPSRC AIMS (CDT EP/L015897/1)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
Keywords
SENet, channel attention, convolutional neural network architecture, image classification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review