CoChat
Sign Up
PreprintCited by 292Advanced Neural Network ApplicationsVisual Attention and Saliency DetectionAdvanced Image and Video Retrieval Techniques

Light-Head R-CNN: In Defense of Two-Stage Object Detector

Open access
Li, Zeming, Peng, Chao, Yu, Gang, Zhang, Xiangyu, Deng, Yangdong, Sun, Jian·2017·arXiv
DOI 10.48550/arxiv.1711.07264arXiv 1711.07264
Open this paper in CoChat — free accountOpen PDF

Abstract

In this paper, we first investigate why typical two-stage methods are not as fast as single-stage, fast detectors like YOLO and SSD. We find that Faster R-CNN and R-FCN perform an intensive computation after or before RoI warping. Faster R-CNN involves two fully connected layers for RoI recognition, while R-FCN produces a large score maps. Thus, the speed of these networks is slow due to the heavy-head design in the architecture. Even if we significantly reduce the base model, the computation cost cannot be largely decreased accordingly. We propose a new two-stage detector, Light-Head R-CNN, to address the shortcoming in current two-stage approaches. In our design, we make the head of network as light as possible, by using a thin feature map and a cheap R-CNN subnet (pooling and single fully-connected layer). Our ResNet-101 based light-head R-CNN outperforms state-of-art object detectors on COCO while keeping time efficiency. More importantly, simply replacing the backbone with a tiny network (e.g, Xception), our Light-Head R-CNN gets 30.7 mmAP at 102 FPS on COCO, significantly outperforming the single-stage, fast detectors like YOLO and SSD on both speed and accuracy. Code will be made publicly available.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1711.07264

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The bottle-neck design has been widely used for designing lightweight networks.

    “In recent years, the bottle-neck design has been widely used for designing lightweight networks [50, 133, 146-148].”

    From Object Detection in 20 Years: A Survey (2023) · cites this paper as [50]

    Section 4.4 (p. 6) describes the authors’ efficient bottleneck Xception-like network, supporting bottleneck design as an example in a lightweight network. The paper does not say that bottleneck designs have been widely used for that purpose. (LLM, conf=0.83)

    Experimental — accuracy not yet measured

  • The feature map can be compressed to make it thinner, so as to speed up subsequent detection.

    “One can also compress the feature map to make it thinner, so that to speed up subsequent detection [50, 148].”

    From Object Detection in 20 Years: A Survey (2023) · cites this paper as [50]

  • In each ShuffleNet V2 block, half of the feature channels directly go through the block and join the next block, which can be regarded as feature reuse.

    “Second, in each block, half of feature channels (when c ′ = c/ 2) directly go through the block and join the next block. This can be regarded as a kind of feature reuse , in a similar spirit as in DenseNet [6] and CondenseNet [16].”

    From ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design (2018) · cites this paper as [16]

    The Introduction (p. 2) and §3.1.2 (p. 3) describe thin feature maps for a two-stage detector, not ShuffleNet V2 blocks. Searches for half-channel bypasses and feature reuse found no passage addressing the claimed block design; the References (p. 9) list an earlier ShuffleNet paper but do not describe this feature. (LLM, conf=0.77)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

References 1 · Cited by 292

Research works printed but not linked: 39

  1. [1][1] P. Arbel´ aez, J. Pont-Tuset, J. T. Barron, F. Marques, and J. Malik. Multiscale combinatorial grouping. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 328-335, 2014. Figure 5. Representative results of our large 'L' model. <!-- image --> Figure 6. Representative results of our small 'S' model. <!-- image --> -
  2. [2][2] L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv preprint arXiv:1412.7062 , 2014. - · arXiv
  3. [3][3] J. Dai, H. Qi, Y. Xiong, Y. Li, G. Zhang, H. Hu, and Y. Wei. Deformable convolutional networks. arXiv preprint arXiv:1703.06211 , 2017. - · arXiv
  4. [4][4] C.-Y. Fu, W. Liu, A. Ranga, A. Tyagi, and A. C. Berg. Dssd: Deconvolutional single shot detector. arXiv preprint arXiv:1701.06659 , 2017. - · arXiv
  5. [5][5] R. Girshick. Fast r-cnn. In Proceedings of the IEEE International Conference on Computer Vision , pages 1440-1448, 2015. -
  6. [6][6] R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 580-587, 2014. -
  7. [7][7] K. He, G. Gkioxari, P. Doll´ ar, and R. Girshick. Mask r-cnn. arXiv preprint arXiv:1703.06870 , 2017. - · arXiv
  8. [8][8] K. He, X. Zhang, S. Ren, and J. Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. In European Conference on Computer Vision , pages 346-361. Springer, 2014. -
  9. [9][9] K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 770-778, 2016. -
  10. [10][10] K. He, X. Zhang, S. Ren, and J. Sun. Identity mappings in deep residual networks. In European Conference on Computer Vision , pages 630-645. Springer, 2016. -
  11. [11][11] A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 , 2017. - · arXiv
  12. [12][12] J. Hu, L. Shen, and G. Sun. Squeeze-and-excitation networks. arXiv preprint arXiv:1709.01507 , 2017. - · arXiv
  13. [13][13] J. Huang, V. Rathod, C. Sun, M. Zhu, A. Korattikara, A. Fathi, I. Fischer, Z. Wojna, Y . Song, S. Guadarrama, et al. Speed/accuracy trade-offs for modern convolutional object detectors. arXiv preprint arXiv:1611.10012 , 2016. - · arXiv
  14. [14][14] F. N. Iandola, S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally, and K. Keutzer. Squeezenet: Alexnet-level accuracy with 50x fewer parameters and¡ 0.5 mb model size. arXiv preprint arXiv:1602.07360 , 2016. - · arXiv
  15. [15][15] S. Ioffe and C. Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International Conference on Machine Learning , pages 448456, 2015. -
  16. [16][16] A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems , pages 1097-1105, 2012. -
  17. [17][17] Y. Li, K. He, J. Sun, et al. R-fcn: Object detection via regionbased fully convolutional networks. In Advances in Neural Information Processing Systems , pages 379-387, 2016. -
  18. [19][19] T.-Y. Lin, P. Doll´ ar, R. Girshick, K. He, B. Hariharan, and S. Belongie. Feature pyramid networks for object detection. arXiv preprint arXiv:1612.03144 , 2016. - · arXiv
  19. [20][20] T.-Y. Lin, P. Goyal, R. Girshick, K. He, and P. Doll´ ar. Focal loss for dense object detection. arXiv preprint arXiv:1708.02002 , 2017. - · arXiv
  20. [21][21] T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Doll´ ar, and C. L. Zitnick. Microsoft coco: Common objects in context. In European Conference on Computer Vision , pages 740-755. Springer, 2014. -
  21. [22][22] W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.Y. Fu, and A. C. Berg. Ssd: Single shot multibox detector. In European Conference on Computer Vision , pages 21-37. Springer, 2016. -
  22. [23][23] J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 3431-3440, 2015. -
  23. [24][24] S. Mallat. A wavelet tour of signal processing . Academic press, 1999. -
  24. [25][25] C. Peng, X. Zhang, G. Yu, G. Luo, and J. Sun. Large kernel matters-improve semantic segmentation by global convolutional network. arXiv preprint arXiv:1703.02719 , 2017. - · arXiv
  25. [26][26] J. Redmon, S. Divvala, R. Girshick, and A. Farhadi. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 779-788, 2016. -
  26. [27][27] J. Redmon and A. Farhadi. Yolo9000: Better, faster, stronger. arXiv preprint arXiv:1612.08242 , 2016. - · arXiv
  27. [28][28] S. Ren, K. He, R. Girshick, and J. Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in neural information processing systems , pages 91-99, 2015. -
  28. [29][29] S. Ren, K. He, R. Girshick, X. Zhang, and J. Sun. Object detection networks on convolutional feature maps. IEEE transactions on pattern analysis and machine intelligence , 39(7):1476-1481, 2017. -
  29. [30][30] O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, et al. Imagenet large scale visual recognition challenge. International Journal of Computer Vision , 115(3):211-252, 2015. -
  30. [31][31] A. Shrivastava, A. Gupta, and R. Girshick. Training regionbased object detectors with online hard example mining. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 761-769, 2016. -
  31. [32][32] K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 , 2014. - · arXiv
  32. [33][33] C. Szegedy, S. Ioffe, V. Vanhoucke, and A. A. Alemi. Inception-v4, inception-resnet and the impact of residual connections on learning. In AAAI , pages 4278-4284, 2017. -
  33. [34][34] C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 1-9, 2015. -
  34. [35][35] C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 2818-2826, 2016. -
  35. [36][36] L. Tychsen-Smith and L. Petersson. Denet: Scalable realtime object detection with directed sparse sampling. arXiv preprint arXiv:1703.10295 , 2017. - · arXiv
  36. [37][37] J. R. Uijlings, K. E. Van De Sande, T. Gevers, and A. W. Smeulders. Selective search for object recognition. International journal of computer vision , 104(2):154-171, 2013. -
  37. [38][38] S. Xie, R. Girshick, P. Doll´ ar, Z. Tu, and K. He. Aggregated residual transformations for deep neural networks. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , pages 5987-5995. IEEE, 2017. -
  38. [39][39] X. Zhang, X. Zhou, M. Lin, and J. Sun. Shufflenet: An extremely efficient convolutional neural network for mobile devices. arXiv preprint arXiv:1707.01083 , 2017. - · arXiv
  39. [40][40] C. L. Zitnick and P. Doll´ ar. Edge boxes: Locating object proposals from edges. In European Conference on Computer Vision , pages 391-405. Springer, 2014.

Authors
Li, Z., Peng, C., Yu, G., Zhang, X., Deng, Y., & Sun, J.
Affiliations
  • Tsinghua University (CN)
  • Megvii (China) (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2017
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1711.07264
arXiv
1711.07264
OpenAlex
W2769291631
Cited by
292
References
1
Citations by year
2025: 14 · 2024: 37 · 2023: 33 · 2022: 31 · 2021: 57 · 2020: 57 · 2019: 49 · 2018: 14
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
Keywords
two-stage object detection, Faster R-CNN, R-FCN, lightweight network architecture, real-time object detection, speed-accuracy trade-off, COCO benchmark

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review