CoChat

The DOI matches its Crossref record; 279 of the 281 references it cites were found in a registry or an index; 20 of the 45 sources its claims cite were checked for support.

A survey of model compression strategies for object detection

Open access
Lyu, Zonglei, Yu, Tong, Pan, Fuxi, Zhang, Yilin, Luo, Jia, Zhang, Dan, Chen, Yiren, Zhang, Bo, Li, Guangyao · 2023 · Multimedia Tools and Applications

Abstract

Abstract Deep neural networks (DNNs) have achieved great success in many object detection tasks. However, such DNNS-based large object detection models are generally computationally expensive and memory intensive. It is difficult to deploy them to devices with low memory resources or scenarios with high real-time requirements, which greatly limits their application and promotion. In recent years, many researchers have focused on compressing large object detection models without significantly degrading their performance, and have made great progress. Therefore, this paper presents a survey of object detection model compression techniques in recent years. Firstly, these compression techniques were divided into six categories: network pruning, lightweight network design, neural architecture search (NAS), low-rank decomposition, network quantization, and Knowledge distillation (KD) methods. For each category, we select some representative state-of-the-art methods and compare and analyze their performance on public datasets. After that, we discuss the application scenarios and future directions of model compression techniques. Finally, this paper is further concluded by analyzing the advantages and disadvantages of six types of model compression techniques.

Overview

CoChat Summary

## TL;DR

This paper is a survey of object detection model compression methods, organized into six categories: pruning, lightweight network design, NAS, low-rank decomposition, quantization, and knowledge distillation. It reviews 252 papers and compares representative methods on public datasets to discuss trade-offs among accuracy, parameter count, FLOPs, and deployment suitability.

## Key findings

  • The authors collected 252 papers on model compression from top conferences and journals; they report 236 conference papers, 5 journal papers, and 11 arXiv papers.
  • They identify six compression strategies and note that network pruning and lightweight network design account for the largest proportions among the surveyed methods.
  • For network pruning, the paper says many methods achieve precision losses of less than 0.5% and can reduce model size by more than 90% in some cases; it also notes AOFP, SCP, and Lin as strong examples.
  • In the lightweight-object-detection comparison on COCO test-dev2015, PP-PicoDet is reported as the best overall among the listed lightweight models, with 0.99M parameters and 27.1% AP; YOLO-LITE has 0.6M parameters, 12.26 AP, and 1 FLOPs(B).
  • In the NAS comparison on CIFAR10, CP-NAS is reported as having 2.9M parameters and 96.35% accuracy; the paper also reports AutoFormer at 99.1% accuracy in the NAS comparison table.
  • In KD on ImageNet, the paper states that the compressed student model is generally not much lower than the teacher network; for one reported case, AIN drops only 0.15%.

## Methods

  • Survey design: the paper is a literature survey that categorizes object-detection compression methods into six groups and discusses representative methods in each group.
  • Data/sample: it reviews 252 papers and compares methods on public datasets including COCO test-dev2015, VOC 2007, ImageNet ILSVRC 2012, CIFAR10, and CIFAR100.
  • Main analysis: it compares methods using metrics such as Param, FLOPs, AccTop-1, AP, and mAP, and summarizes trade-offs plus application scenarios and future directions.

## Limitations

  • The paper states that performance varies by implementation, dataset, and application scenario, so results are not directly universal.
  • It also states that most compression methods trade off accuracy for smaller size or lower computation, and this accuracy-compression balance remains a central challenge.
  • Evident from the text: many comparisons are compiled from original papers’ reported results, not re-run under a single unified experimental protocol; the paper explicitly says it assumes published results are the best experimental results obtained by the original authors.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s11042-023-17192-x

Cites

279 of 281 references verified1 citation errors · 1 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

13 Valid · 24 Not valid · 25 Not checked · 144 Own results and interpretations

35 more claims

Create a free account to see all 206 claims and to verify the 15 references still open.

See all claims — free account
  • It may state two separate claims as one. 85
  • Probably not a substantial claim. 139
  • The quote only partly states this claim. 3

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

1 of 1

Citations

Cites

Show all 281 references

Research works printed but not linked: 23

  1. Han S, Pool J, Tran J, Dally W (2015a) Learning both weights and connections for efficient neural network. Adv Neural Inf Proces Syst 1:1135–1143
  2. Wang W, Chen M, Zhao S, Chen L, Hu J, Liu H, Liu W (2021) ACTD Accelerate cnns from three dimensions: a comprehensive pruning framework. International Conference on Machine Learning, vol 2021. PMLR, pp 10717–10726
  3. Frankle J, Dziugaite GK, Roy DM, Carbin M (2020) Pruning neural networks at initialization: why are we missing the mark? In Proceedings of International Conference on Learning Representations 535:6377–6389. https://doi.org/10.5555/3495724.3496259 · doi:10.5555/3495724.3496259
  4. Yoon J, Hwang SJ (2017) Combined group and exclusive sparsity for deep neural networks. In International Conference on Machine Learning (PMLR) 70:3958–3966
  5. Neklyudov K, Molchanov D, Ashukha A, Vetrov D (2017) Structured bayesian pruning via log-normal multiplicative noise. In Advances in Neural Information Processing Systems, pp 6778–6787
  6. Lin C, Zhong Z, Wu W, Yan J (2018) Synaptic strength for convolutional neural network. Adv Neural Inf Processing Syst 2018:10149–10158
  7. You Z, Yan K, Ye J, Ma M, Wang P (2019) Gate decorator: global filter pruning method for accelerating deep convolutional neural networks. Adv Neural Inf Proces Syst 32(191):2133–2144
  8. Zhuang Z, Tan M, Zhuang B, Liu J, Guo Y, Wu Q, Zhu J (2018) Discrimination-aware channel pruning for deep neural networks. In Advances in Neural Information Processing Systems 31:883–894.
  9. Peng H, Wu J, Chen S, Huang J (2019) Collaborative channel pruning for deep networks. In International Conference on Machine Learning 1:5113–5122 (PMLR)
  10. Kang M, Han B (2020) Operation-aware soft channel pruning using differentiable masks. In International Conference on Machine Learning 119:5122–5131
  11. Tan M, Le QV (2019b) Mixconv: mixed depthwise convolutional kernels. In British Machine Vision Conference (BMVC), 33(116):1–13. https://dx.doi.org/10.5244/C.33.116 · doi:10.5244/c.33.116
  12. Wang Y, Xu C, Xu C, Xu C, Tao D (2018) Learning versatile filters for efficient convolutional neural networks. In Advances in Neural Information Processing Systems 31:1608–1618
  13. Wang RJ, Li X, Ling CX (2018) Pelee: a real-time object detection system on mobile devices. In Adv Neural Inf Proces Syst 43(10):3349–3364. https://doi.org/10.1109/TPAMI.2020.2983686 · DOI · Paper page
  14. Cai H, Chen T, Zhang W, Yu Y, Wang J (2018) Efficient architecture search by network transformation. In Proceedings of the AAAI Conference on Artificial Intelligence 32(1):2787–794
  15. Wong C, Houlsby N, Lu Y, Gesmundo A (2018) Transfer learning with neural automl. In Adv Neural Inf Proces Syst 31:8366–8375
  16. Pham H, Guan M, Zoph B, Le Q, Dean J (2018) Efficient neural architecture search via parameters sharing. In International Conference on Machine Learning 80:4095–4104
  17. Hu Q, Wang P, Cheng J (2018) From hashing to cnns: training binary weight networks via hashing. In Proceedings of the AAAI Conference on Artificial Intelligence 32(1):3247–3254
  18. Wu J, Wang Y, Wu Z, Wang Z, Veeraraghavan A, Lin Y (2018) Deep k-means: re-training and parameter sharing with harder cluster assignments for compressing deep convolutions. In International Conference on Machine Learning 80:5363–5372
  19. Hinton G, Vinyals O, Dean J (2015) Distilling the knowledge in a neural network. In: Proc Adv Neural Inf Processing Syst Workshop 27:2014
  20. Denil M, Shakibi B, Dinh L, Ranzato M, de Freitas N (2013) Predicting parameters in deep learning. Adv Neural Inf Processing Syst. Lake Tahoe 26:2148–2156
  21. Denton EL, Zaremba W, Bruna J, LeCun Y, Fergus R (2014) Exploiting linear structure within convolutional networks for efficient evaluation. Neural information processing systems foundation (NIPS). 2014: 1269–1277
  22. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In Adv Neural Inf Proces Syst 60(6):84–90
  23. Yang K, Jiao Z, Liang J, Lei H, Li C, Zhong Z (2022) An application case of object detection model based on Yolov3-SPP model pruning. IEEE Int Conf Artif Intell Comput App (ICAICA) 2022:578–582

Cited by

See all 65

Metadata

Authors
Lyu, Z., Yu, T., Pan, F., Zhang, Y., Luo, J., Zhang, D., Chen, Y., Zhang, B., & Li, G.
Affiliations
Civil Aviation University of China (CN)
Corresponding author
Lyu, Zonglei
Venue
Multimedia Tools and Applications
Published
2023-11-02
Volume
83
Issue
16
Pages
48165-48236
ISSN
  • 1380-7501 (ISSN-L)
  • 1573-7721
OpenAlex
W4388229123
Cited by
65
References
228
Citations by year
2026: 24 · 2025: 26 · 2024: 15
FWCI
5.89
Type
journal article
Language
en
Open access
Licence
Locations
Multimedia Tools and Applications (publishedVersion, cc-by)
Funders
Fundamental Research Funds for Central Universities of the Civil Aviation University of China (3122021088)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
Keywords
model compression, object detection, network pruning, neural architecture search, low-rank decomposition, neural network quantization, knowledge distillation, deep neural network, edge deployment, real-time inference

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A survey of model compression strategies for object detection. https://app.cochat.ai/papers/10.1007/s11042-023-17192-x
The paper
Lyu, Z., Yu, T., Pan, F., Zhang, Y., Luo, J., Zhang, D., Chen, Y., Zhang, B., & Li, G. (2023). A survey of model compression strategies for object detection. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-023-17192-x

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.