CoChat
Sign Up
PreprintCited by 6,201Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningMachine Learning and Data Classification

SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size

Open access
Iandola, Forrest N., Han, Song, Moskewicz, Matthew W., Ashraf, Khalid, Dally, William J., Keutzer, Kurt·2016·arXiv
DOI 10.48550/arxiv.1602.07360arXiv 1602.07360
Open this paper in CoChat — free accountOpen PDF

Abstract

Recent research on deep neural networks has focused primarily on improving accuracy. For a given accuracy level, it is typically possible to identify multiple DNN architectures that achieve that accuracy level. With equivalent accuracy, smaller DNN architectures offer at least three advantages: (1) Smaller DNNs require less communication across servers during distributed training. (2) Smaller DNNs require less bandwidth to export a new model from the cloud to an autonomous car. (3) Smaller DNNs are more feasible to deploy on FPGAs and other hardware with limited memory. To provide all of these advantages, we propose a small DNN architecture called SqueezeNet. SqueezeNet achieves AlexNet-level accuracy on ImageNet with 50x fewer parameters. Additionally, with model compression techniques we are able to compress SqueezeNet to less than 0.5MB (510x smaller than AlexNet). The SqueezeNet architecture is available for download here: https://github.com/DeepScale/SqueezeNet

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1602.07360

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • SqueezeNet used 1 × 1 convolution and grouped convolution methods, and then used the Fire module for parameter compression.

    “Stanford University, DeepScale and UC Berkeley jointly proposed SqueezeNet [125], which was a relatively early and classic lightweight network that used the 1 × 1 convolution and grouped convolution methods, and then used the Fire module for parameter compression.”

    From A survey of model compression strategies for object detection (2023) · cites this paper as [125]

    Section 3.2 (p. 4) describes Fire modules with 1×1 squeeze filters and a mix of 1×1 and 3×3 expand filters; Section 3.3 (p. 4) says SqueezeNet contains eight Fire modules. The copy does not support the claim that SqueezeNet used grouped convolution: Section 3.3.1 (p. 5) instead describes implementing the expand layer as two separate convolution layers whose outputs are concatenated. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

  • The proposed CNN uses a modified fire module from SqueezeNet as the basic computation module.

    “The proposed CNN is optimized the number of operations and memory footprint using the modified fire module in SqueezeNet [13] as the basic computation module.”

    From A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition (2021) · cites this paper as [13]

  • The bottle-neck design has been widely used for designing lightweight networks.

    “In recent years, the bottle-neck design has been widely used for designing lightweight networks [50, 133, 146-148].”

    From Object Detection in 20 Years: A Survey (2023) · cites this paper as [146]

  • The input layer of a detector can be compressed to reduce the amount of computation from the very beginning of detection.

    “Among these methods, the input layer of a detector can be compressed to reduce the amount of computation from the very beginning of the detection [133, 146, 147].”

    From Object Detection in 20 Years: A Survey (2023) · cites this paper as [146]

    Section 3.1 (p. 3) describes reducing the input channels to 3×3 filters to lower parameter counts, but those are channels within convolutional layers, not a detector’s input layer. Section 3.3 (p. 4) describes SqueezeNet as a CNN with an initial convolution layer; neither passage addresses compressing a detector’s input layer to reduce computation at the start of detection. (LLM, conf=0.73)

    Experimental — accuracy not yet measured

  • Detectors such as SqueezeNet or [55] are optimized to run on embedded hardware, have a smaller neural network architecture, making it possible to detect objects using a reduced number of operations, at the cost of detection accuracy.

    “If in-vehicle computation resources are scarce, one can use detectors such as SqueezeNet [40] or [55], which are optimized to run on embedded hardware. These detectors usually have a smaller neural network architecture, making it possible to detect objects using a reduced number of operations, at the cost of detection accuracy.”

    From A survey of deep learning techniques for autonomous driving (2020) · cites this paper as [40]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 8

  1. [6]6. Forrest N. Iandola, Khalid Ashraf, Matthew W. Moskewicz, and Kurt Keutzer. FireCaffe: near-linear acceleration of deep neural network training on compute clusters. In CVPR , 2016.
  2. [7]7. Sergey Ioffe and Christian Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. JMLR , 2015.
  3. [9]9. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. ImageNet Classification with Deep Convolutional Neural Networks. In NIPS , 2012. - Y. LeCun, B.Boser, J.S. Denker, D. Henderson, R.E. Howard, W. Hubbard, and L.D. Jackel. Backpropagation applied to handwritten zip code recognition. Neural Computation , 1989.
  4. [12]12. T.B. Ludermir, A. Yamazaki, and C. Zanchettin. An optimization methodology for neural network weights and architectures. IEEE Trans. Neural Networks , 2006.
  5. [13]13. Dmytro Mishkin, Nikolay Sergievskiy, and Jiri Matas. Systematic evaluation of cnn advances on the imagenet. arXiv:1606.02228 , 2016. · arXiv
  6. [14]14. Vinod Nair and Geoffrey E. Hinton. Rectified linear units improve restricted boltzmann machines. In ICML , 2010.
  7. [15]15. Jiantao Qiu, Jie Wang, Song Yao, Kaiyuan Guo, Boxun Li, Erjin Zhou, Jincheng Yu, Tianqi Tang, Ningyi Xu, Sen Song, Yu Wang, and Huazhong Yang. Going deeper with embedded fpga platform for convolutional neural network. In ACM International Symposium on FPGA , 2016.
  8. [18]18. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. Dropout: a simple way to prevent neural networks from overfitting. JMLR , 2014. - R. K. Srivastava, K. Greff, and J. Schmidhuber. Highway networks. In ICML Deep Learning Workshop , 2015.

Cited by

Sorted by citations

Related

Authors
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2016
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1602.07360
arXiv
1602.07360
OpenAlex
W4394670654
Cited by
6,201
References
9
Citations by year
2026: 66 · 2025: 339 · 2024: 563 · 2023: 747 · 2022: 697 · 2021: 1162 · 2020: 1005 · 2019: 868 · 2018: 533 · 2017: 178 · 2016: 43
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
Keywords
SqueezeNet, model compression, lightweight neural networks, ImageNet classification, parameter reduction, model size reduction, FPGA deployment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review