The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Distilling Object Detectors via Decoupled Features
Open accessAbstract
Knowledge distillation is a widely used paradigm for inheriting information from a complicated teacher network to a compact student network and maintaining the strong performance. Different from image classification, object detectors are much more sophisticated with multiple loss functions in which features that semantic information rely on are tangled. In this paper, we point out that the information of features derived from regions excluding objects are also essential for distilling the student detector, which is usually ignored in existing approaches. In addition, we elucidate that features from different regions should be assigned with different importance during distillation. To this end, we present a novel distillation algorithm via decoupled features (DeFeat) for learning a better student detector. Specifically, two levels of decoupled features will be processed for embedding useful information into the student, i.e., decoupled features from neck and decoupled proposals from classification head. Extensive experiments on various detectors with different backbones show that the proposed DeFeat is able to surpass the state-of-the-art distillation methods for object detection. For example, DeFeat improves ResNet50 based Faster R-CNN from 37.4% to 40.9% mAP, and improves ResNet50 based RetinaNet from 36.5% to 39.7% mAP on COCO benchmark. Code will be released1,2.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
(2016) · Cited by 31,590
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 6×
“The input image is resized such that its shorter side has 800 pixels on COCO and 600 pixels on VOC.”
MethodResultInfluentialDistilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
(2017) · Cited by 11,625
EfficientDet: Scalable and Efficient Object Detection
Tan, M., Pang, R., & Le, Q. V. (2019) · arXiv · Cited by 9,841 · cited 1×
“Techniques such as quantization [19, 58, 31, 57, 62], pruning [2, 17, 20], network design [55, 49, 15, 18] and knowledge distillation [56, 6] have been developed to overcome this dilemma and achieve an efficient inference on detection task.”
BackgroundCascade R-CNN: Delving Into High Quality Object Detection
Cai, Z., & Vasconcelos, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00644 · Cited by 7,370
GhostNet: More Features From Cheap Operations
Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00165 · Cited by 5,222
Self-citationHan, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
CenterNet: Keypoint Triplets for Object Detection
Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., & Tian, Q. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00667 · Cited by 4,079
CornerNet: Detecting Objects as Paired Keypoints
Law, H., & Deng, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_45 · Cited by 3,852
FitNets: Hints for Thin Deep Nets
Romero, A., Ballas, N., Kahou, S. E., Chassang, A., Gatta, C., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.6550 · Cited by 2,859
Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors
Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.351 · Cited by 2,743 · cited 1×
“In the past few years, noticeable improvements in accuracy have been made in both one-stage [42, 36, 34, 29, 11, 67] and twostage [43, 21, 33, 26, 27, 5] detectors.”
BackgroundMMDetection: Open MMLab Detection Toolbox and Benchmark
Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., Xu, J., et al. (2019) · arXiv · doi:10.48550/arxiv.1906.07155 · Cited by 2,227
Buciluǎ, C., Caruana, R., & Niculescu-Mizil, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150464 · Cited by 2,068
Zagoruyko, S., & Komodakis, N. (2016) · arXiv · doi:10.48550/arxiv.1612.03928 · Cited by 2,027
Single-Shot Refinement Neural Network for Object Detection
Zhang, S., Wen, L., Bian, X., Lei, Z., & Li, S. Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00442 · Cited by 1,678
A Gift from Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning
Yim, J., Joo, D., Bae, J., & Kim, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.754 · Cited by 1,570
Relation Networks for Object Detection
Hu, H., Gu, J., Zhang, Z., Dai, J., & Wei, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00378 · Cited by 1,524
Quantized Convolutional Neural Networks for Mobile Devices
Wu, J., Leng, C., Wang, Y., Hu, Q., & Cheng, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.521 · Cited by 1,212
Self-citationSimilarity-Preserving Knowledge Distillation
Tung, F., & Mori, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00145 · Cited by 1,079
Contextual Priming for Object Detection
Torralba, A. (2003) · International Journal of Computer Vision · doi:10.1023/a:1023052124951 · Cited by 776
A Comprehensive Overhaul of Feature Distillation
Heo, B., Kim, J., Yun, S., Park, H., Kwak, N., & Choi, J. Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00201 · Cited by 706
Variational Information Distillation for Knowledge Transfer
Ahn, S., Hu, S. X., Damianou, A., Lawrence, N. D., & Dai, Z. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00938 · Cited by 671
Large scale distributed neural network training through online distillationPreprint
Anil, R., Pereyra, G., Passos, A., Ormándi, R., Dahl, G. E., & Hinton, G. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.03235 · Cited by 530
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons
Heo, B., Lee, M., Yun, S., & Choi, J. Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013779 · Cited by 522
Diagnosing Error in Object Detectors
Hoiem, D., Chodpathumwan, Y., & Dai, Q. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_25 · Cited by 520
Learning Deep Representations with Probabilistic Knowledge Transfer
Passalis, N., & Tefas, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_17 · Cited by 454
Distilling Object Detectors With Fine-Grained Feature Imitation
Wang, T., Yuan, L., Zhang, X., & Feng, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00507 · Cited by 452
Learning from Multiple Teacher Networks
You, S., Xu, C., Xu, C., & Tao, D. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098135 · Cited by 395
Self-citationMimicking Very Efficient Network for Object Detection
Li, Q., Jin, S., & Yan, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.776 · Cited by 379
ThunderNet: Towards Real-Time Generic Object Detection on Mobile Devices
Qin, Z., Li, Z., Zhang, Z., Bao, Y., Yu, G., Peng, Y., & Sun, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00682 · Cited by 295
CARS: Continuous Evolution for Efficient Neural Architecture Search
Yang, Z., Wang, Y., Chen, X., Shi, B., Xu, C., Xu, C., Tian, Q., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00190 · Cited by 273
Self-citationFully Quantized Network for Object Detection
Li, R., Wang, Y., Liang, F., Qin, H., Yan, J., & Fan, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00292 · Cited by 214 · cited 2×
“Techniques such as quantization [19, 58, 31, 57, 62], pruning [2, 17, 20], network design [55, 49, 15, 18] and knowledge distillation [56, 6] have been developed to overcome this dilemma and achieve an efficient inference on detection task.”
BackgroundSelf-citationBeyond Human Parts: Dual Part-Aligned Representations for Person Re-Identification
Guo, J., Yuan, Y., Huang, L., Zhang, C., Yao, J.-G., & Han, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00374 · Cited by 206
Self-citationData-Free Adversarial DistillationPreprint
Fang, G., Song, J., Shen, C., Wang, X., Chen, D., & Song, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.11006 · Cited by 203
Does Object Recognition Work for Everyone?Preprint
DeVries, T., Misra, I., Wang, C., & van der Maaten, L. J. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02659 · Cited by 189
Learning the Number of Neurons in Deep Networks
Álvarez, J. M., & Salzmann, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06321 · Cited by 164
GreedyNAS: Towards Fast One-Shot NAS With Greedy Supernet
You, S., Huang, T., Yang, M., Wang, F., Qian, C., & Zhang, C.-S. (2020) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr42600.2020.00207 · Cited by 161
Learning Student Networks via Feature Embedding
Chen, H., Wang, Y., Xu, C., Xu, C., & Tao, D. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2970494 · Cited by 139
Self-citationSCOP: Scientific Control for Reliable Neural Network PruningPreprint
Tang, Y., Wang, Y., Xu, Y., Tao, D., Xu, C., Xu, C., & Xu, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.10732 · Cited by 127
Self-citationManifold Regularized Dynamic Network Pruning
Tang, Y., Wang, Y., Xu, Y., Deng, Y., Xu, C., Tao, D., & Xu, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00498 · Cited by 122
Self-citationQuantization Mimic: Towards Very Tiny CNN for Object Detection
Wei, Y., Pan, X., Qin, H., Ouyang, W., & Yan, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_17 · Cited by 119
Hit-Detector: Hierarchical Trinity Architecture Search for Object Detection
Guo, J., Han, K., Wang, Y., Zhang, C., Yang, Z., Wu, H., Chen, X., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01142 · Cited by 110
Self-citationTiny-DSOD: Lightweight Object Detection for Resource-Restricted Usages
Li, Y., Li, J., Lin, W., & Li, J. (2018) · arXiv · doi:10.48550/arxiv.1807.11013 · Cited by 104
Improved Knowledge Distillation via Teacher Assistant
Mirzadeh, S. I., Farajtabar, M., Li, A., Levine, N., Matsukawa, A., & Ghasemzadeh, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5963 · Cited by 101 · cited 1×
“The information from soft label outputs [24, 28, 38, 13] or intermediate features [1, 23, 66] of a well-optimized teacher network have been well exploited to learn the student networks, but these methods cannot be directly extended to the detection task which needs to further figure out where the objects are.”
BackgroundObject Recognition with and without Objects
Zhu, Z., Xie, L., & Yuille, A. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/505 · Cited by 87
Agree to Disagree: Adaptive Ensemble Knowledge Distillation in Gradient Space
Du, S., You, S., Li, X., Wu, J., Wang, F., Qian, C., & Zhang, C. (2020) · neural information processing systems · Cited by 76
Detecting and Counting Sheep with a Convolutional Neural Network
Sarwar, F., Griffin, A., Periasamy, P., Portas, K., & Law, J. (2018) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639306 · Cited by 69
Searching for Low-Bit Weights in Quantized Neural Networks
Yang, Z., Wang, Y., Han, K., Xu, C., Xu, C., Tao, D., & Xu, C. (2020) · arXiv · doi:10.48550/arxiv.2009.08695 · Cited by 64
Self-citationPrime-Aware Adaptive Distillation
Zhang, Y., Lan, Z., Dai, Y., Zeng, F., Bai, Y., Chang, J., & Wei, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58529-7_39 · Cited by 64
CenterNet: Object Detection with Keypoint TripletsPreprint
Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., & Tian, Q. C. (2019) · arXiv (Cornell University) · Cited by 61
Distilling Object Detectors with Task Adaptive Regularization
Sun, R., Tang, F., Zhang, X., Xiong, H., & Tian, Q. (2020) · arXiv · doi:10.48550/arxiv.2006.13108 · Cited by 46
Localization-aware channel pruning for object detection
Xie, Z., Zhu, L., Zhao, L. F., Tao, B., Liu, L., & Tao, W. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.056 · Cited by 46
Deep Network Pruning for Object Detection
Ghosh, S. T., Srinivasa, S. K. K., Amon, P., Hutter, A., & Kaup, A. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803505 · Cited by 34
Learning Efficient Detector with Semi-supervised Adaptive DistillationPreprint
Tang, S., Feng, L., Shao, W., Kuang, Z., Zhang, W., & Chen, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00366 · Cited by 18
Research works printed but not linked: 6
- kim, 2018, Paraphrasing complex network: Network compression via factor transfer, Advances in neural information processing systems, 2760
- han, 2015, Learning both weights and connections for efficient neural network, Advances in neural information processing systems, 1135
- wang, 2018, Pelee: A real-time object detection system on mobile devices, Advances in neural information processing systems, 1963
- guo, 2016, Dynamic network surgery for efficient dnns, Advances in neural information processing systems, 1379
- chen, 2017, Learning efficient object detection models with knowledge distillation, Advances in neural information processing systems, 742
- 10.1109/CVPR42600.2020.01079 · doi:10.1109/cvpr42600.2020.01079 · Paper page
Cited by
A review of convolutional neural network architectures and their optimizations
Cong, S., & Zhou, Y. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10213-5 · Cited by 381
Focal and Global Knowledge Distillation for Detectors
Yang, Z., Li, Z., Jiang, X., Gong, Y., Yuan, Z., Zhao, D., & Yuan, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00460 · Cited by 380
Masked Generative Distillation
Yang, Z., Li, Z., Shao, M., Shi, D., Yuan, Z., & Yuan, C. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20083-0_4 · Cited by 269
Localization Distillation for Dense Object Detection
Zheng, Z., Ye, R., Wang, P., Ren, D., Zuo, W., Hou, Q., & Cheng, M.-M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00919 · Cited by 220
Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation
Feng, T., Wang, M., & Yuan, H. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00921 · Cited by 132
Metadata
- Authors
- Guo, J., Han, K., Wang, Y., Wu, H., Chen, X., Xu, C., & Xu, C.
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 2154-2164
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3176459575
- Cited by
- 266
- References
- 65
- FWCI
- 15.85
- Type
- conference paper
- Language
- en
- Open access
- green
- Funders
- Australian Research Council
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.