The DOI matches its DataCite record; 10 of the 10 references it cites were found in a registry or an index.
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Open accessAbstract
Recent research on deep neural networks has focused primarily on improving accuracy. For a given accuracy level, it is typically possible to identify multiple DNN architectures that achieve that accuracy level. With equivalent accuracy, smaller DNN architectures offer at least three advantages: (1) Smaller DNNs require less communication across servers during distributed training. (2) Smaller DNNs require less bandwidth to export a new model from the cloud to an autonomous car. (3) Smaller DNNs are more feasible to deploy on FPGAs and other hardware with limited memory. To provide all of these advantages, we propose a small DNN architecture called SqueezeNet. SqueezeNet achieves AlexNet-level accuracy on ImageNet with 50x fewer parameters. Additionally, with model compression techniques we are able to compress SqueezeNet to less than 0.5MB (510x smaller than AlexNet). The SqueezeNet architecture is available for download here: https://github.com/DeepScale/SqueezeNet
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Stanford University, DeepScale and UC Berkeley jointly proposed SqueezeNet [125], which was a relatively early and classic lightweight network that used the 1 × 1 convolution and grouped convolution methods, and then used the Fire module for parameter compression.”
From A survey of model compression strategies for object detection (2023) · cites this paper as [125]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The proposed CNN is optimized the number of operations and memory footprint using the modified fire module in SqueezeNet [13] as the basic computation module.”
From A Resource Efficient Integer-Arithmetic-Only FPGA-Based CNN Accelerator for Real-Time Facial Emotion Recognition (2021) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“In recent years, the bottle-neck design has been widely used for designing lightweight networks [50, 133, 146-148].”
From Object Detection in 20 Years: A Survey (2023) · cites this paper as [146]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Among these methods, the input layer of a detector can be compressed to reduce the amount of computation from the very beginning of the detection [133, 146, 147].”
From Object Detection in 20 Years: A Survey (2023) · cites this paper as [146]
Experimental — accuracy not yet measuredIn the citing paper
“If in-vehicle computation resources are scarce, one can use detectors such as SqueezeNet [40] or [55], which are optimized to run on embedded hardware. These detectors usually have a smaller neural network architecture, making it possible to detect objects using a reduced number of operations, at the cost of detection accuracy.”
From A survey of deep learning techniques for autonomous driving (2020) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Caffe: Convolutional Architecture for Fast Feature EmbeddingPreprint
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 5,299
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Convolutional neural networks at constrained time cost
He, K., & Sun, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299173 · Cited by 1,558
DenseNet: Implementing Efficient ConvNet Descriptor PyramidsPreprint
Iandola, F., Moskewicz, M. W., Karayev, S., Girshick, R., Darrell, T., & Keutzer, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.1869 · Cited by 909
Self-citationLin, M., Chen, Q., & Yan, S. (2013) · arXiv · doi:10.48550/arxiv.1312.4400 · Cited by 252
DeepLogo: Hitting Logo Recognition with the Deep Neural Network HammerPreprint
Iandola, F., Shen, A., Gao, P., & Keutzer, K. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.02131 · Cited by 75
Self-citation
Research works printed but not linked: 8
- [6]6. Forrest N. Iandola, Khalid Ashraf, Matthew W. Moskewicz, and Kurt Keutzer. FireCaffe: near-linear acceleration of deep neural network training on compute clusters. In CVPR , 2016.
- [7]7. Sergey Ioffe and Christian Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. JMLR , 2015.
- [9]9. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. ImageNet Classification with Deep Convolutional Neural Networks. In NIPS , 2012. - Y. LeCun, B.Boser, J.S. Denker, D. Henderson, R.E. Howard, W. Hubbard, and L.D. Jackel. Backpropagation applied to handwritten zip code recognition. Neural Computation , 1989.
- [12]12. T.B. Ludermir, A. Yamazaki, and C. Zanchettin. An optimization methodology for neural network weights and architectures. IEEE Trans. Neural Networks , 2006.
- [13]13. Dmytro Mishkin, Nikolay Sergievskiy, and Jiri Matas. Systematic evaluation of cnn advances on the imagenet. arXiv:1606.02228 , 2016. · arXiv
- [14]14. Vinod Nair and Geoffrey E. Hinton. Rectified linear units improve restricted boltzmann machines. In ICML , 2010.
- [15]15. Jiantao Qiu, Jie Wang, Song Yao, Kaiyuan Guo, Boxun Li, Erjin Zhou, Jincheng Yu, Tianqi Tang, Ningyi Xu, Sen Song, Yu Wang, and Huazhong Yang. Going deeper with embedded fpga platform for convolutional neural network. In ACM International Symposium on FPGA , 2016.
- [18]18. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. Dropout: a simple way to prevent neural networks from overfitting. JMLR , 2014. - R. K. Srivastava, K. Greff, and J. Schmidhuber. Highway networks. In ICML Deep Learning Workshop , 2015.
Cited by
Sorted by citations
Items 101–115 of 115
A Generalization Performance Study Using Deep Learning Networks in Embedded Systems
Gorospe, J., Mulero, R., Arbelaitz, O., Muguerza, J., & Antón, M. Á. (2021) · Sensors · doi:10.3390/s21041031 · Cited by 32
A Deep Look into Logarithmic Quantization of Model Parameters in Neural Networks
Cai, J., Takemoto, M., & Nakajo, H. (2018) · Proceedings of the 10th International Conference on Advances in Information Technology · doi:10.1145/3291280.3291800 · Cited by 31
A Case for Managed and Model-less Inference Serving
Yadwadkar, N. J., Romero, F., Li, Q., & Kozyrakis, C. (2019) · Proceedings of the Workshop on Hot Topics in Operating Systems · doi:10.1145/3317550.3321443 · Cited by 31
Diagonalwise Refactorization: An Efficient Training Method for Depthwise Convolutions
Qin, Z., Zhang, Z., Li, D., Zhang, Y., & Peng, Y. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489312 · Cited by 27
From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks
Geng, X., Wang, Z., Chen, C., Xu, Q., Xu, K., Jin, C., Gupta, M., Yang, X., Chen, Z., Sabry Aly, M. M., et al. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3394494 · Cited by 26
Pre-trained Models for Sonar Images
Valdenegro-Toro, M., Preciado-Grijalva, A., & Wehbe, B. (2021) · OCEANS 2021: San Diego – Porto · doi:10.23919/oceans44145.2021.9705825 · Cited by 21
Deep Neural Network Model and FPGA Accelerator Co-Design: Opportunities and Challenges
Hao, C., & Chen, D. (2018) · 2018 14th IEEE International Conference on Solid-State and Integrated Circuit Technology (ICSICT) · doi:10.1109/icsict.2018.8564956 · Cited by 19
xYOLO: A Model For Real-Time Object Detection In Humanoid Soccer On Low-End Hardware
Barry, D., Shah, M., Keijsers, M., Khan, H., & Hopman, B. (2019) · 2019 International Conference on Image and Vision Computing New Zealand (IVCNZ) · doi:10.1109/ivcnz48456.2019.8960963 · Cited by 19
Li, S., Liu, F., Peng, G., Cheng, F., Zhao, B., & Ji, M. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3214300 · Cited by 18
A Review on Object Detection Based on Deep Convolutional Neural Networks for Autonomous Driving
Lu, J., Tang, S., Wang, J., Zhu, H., & Wang, Y. (2019) · 2019 Chinese Control And Decision Conference (CCDC) · doi:10.1109/ccdc.2019.8832398 · Cited by 17
A Note on Deepfake Detection with Low-Resources
Kawa, P., & Syga, P. (2020) · arXiv · doi:10.48550/arxiv.2006.05183 · Cited by 10
Training Compact Neural Networks with Binary Weights and Low Precision Activations
Zhuang, B., Shen, C., & Reid, I. (2018) · arXiv · doi:10.48550/arxiv.1808.02631 · Cited by 10
Communication-efficient federated learning for multi-institutional medical image classification
Zhou, S., Landman, B., Huo, Y., & Gokhale, A. (2022) · Medical Imaging 2022: Imaging Informatics for Healthcare, Research, and Applications · doi:10.1117/12.2611654 · Cited by 7
Towards lightweight deep neural network for smart agriculture on embedded systems
Du, P., Polonelli, T., Magno, M., & Cheng, Z. (2022) · 2022 IEEE Sensors Applications Symposium (SAS) · doi:10.1109/sas54819.2022.9881382 · Cited by 5
Saealal, M. S., Ibrahim, M. Z., Shapiai, M. I., & Fadilah, N. (2023) · 2023 5th International Conference on Computer Communication and the Internet (ICCCI) · doi:10.1109/iccci59363.2023.10210096 · Cited by 1
Metadata
- Authors
- Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1602.07360
- OpenAlex
- W4394670654
- Cited by
- 6,201
- References
- 10
- Citations by year
- 2026: 66 · 2025: 339 · 2024: 563 · 2023: 747 · 2022: 697 · 2021: 1162 · 2020: 1005 · 2019: 868 · 2018: 533 · 2017: 178 · 2016: 43
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- SqueezeNet, model compression, lightweight neural networks, ImageNet classification, parameter reduction, model size reduction, FPGA deployment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
