Cited by 2,099Advanced Neural Network ApplicationsAdvanced Image and Video Retrieval TechniquesVisual Attention and Saliency Detection

NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detection

Open access
Ghiasi, Golnaz, Lin, Tsung-Yi, Le, Quoc V.·2019·2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Abstract

Current state-of-the-art convolutional architectures for object detection are manually designed. Here we aim to learn a better architecture of feature pyramid network for object detection. We adopt Neural Architecture Search and discover a new feature pyramid architecture in a novel scalable search space covering all cross-scale connections. The discovered architecture, named NAS-FPN, consists of a combination of top-down and bottom-up connections to fuse features across scales. NAS-FPN, combined with various backbone models in the RetinaNet framework, achieves better accuracy and latency tradeoff compared to state-of-the-art object detection models. NAS-FPN improves mobile detection accuracy by 2 AP compared to state-of-the-art SSDLite with MobileNetV2 model in [32] and achieves 48.3 AP which surpasses Mask R-CNN [10] detection accuracy with less computation time.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/cvpr.2019.00720

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • When designing a detection model, NAS can reduce the need for human intervention on the design of the network backbone and anchor boxes.

    “When designing a detection model, NAS can reduce the need for human intervention on the design of the network backbone and anchor boxes [149-155].”

    From Object Detection in 20 Years: A Survey (2023) · cites this paper as [151]

    Section 3 (Method; page unavailable) says NAS searches the feature pyramid architecture for object detection, which supports reduced manual design for that component. It also says the backbone follows RetinaNet’s original design; the passages do not show a search of anchor boxes. The claim extends the paper’s result to components it did not report searching. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • Under a similar accuracy constraint, EfficientDet uses 28x fewer FLOPs than YOLOv3, 30x fewer FLOPs than RetinaNet, and 19x fewer FLOPs than ResNet-based NAS-FPN.

    “Under similar accuracy constraint, our EfficientDet uses 28x fewer FLOPs than YOLOv3 [34], 30x fewer FLOPs than RetinaNet [24], and 19x fewer FLOPs than the recent ResNet based NAS-FPN [10].”

    From EfficientDet: Scalable and Efficient Object Detection (2019) · cites this paper as [10]

    The Introduction identifies NAS-FPN as working with ResNet backbones, and the ‘Architectures for high detection accuracy’ section discusses its accuracy–FLOPs tradeoff. The cited paper does not compare NAS-FPN with EfficientDet or establish the claimed 19× FLOPs difference. The YOLOv3 and RetinaNet comparisons have separate citations in the citing sentence. (LLM, conf=0.83)

    Experimental — accuracy not yet measured
  • NAS-FPN requires thousands of GPU hours during search, and the resulting feature network is irregular and thus difficult to interpret.

    “Although it achieves better performance, NAS-FPN requires thousands of GPU hours during search, and the resulting feature network is irregular and thus difficult to interpret.”

    From EfficientDet: Scalable and Efficient Object Detection (2019) · cites this paper as [10]

    Section 4.2 reports one hour of TPU training per proxy task, a pool of 100 TPUs, and a selected architecture first sampled at about 8,000 search steps. That supports a costly search, but not the stated figure in GPU hours. The paper visualizes the discovered architecture (Figures 6–7) but does not say it is irregular or difficult to interpret; its reported detection gains support the opening performance comparison. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • NAS-FPN uses Neural Architecture Search to generate an uninterpretable FPN structure with more excellent performance.

    “NAS-FPN [10] uses Neural Architecture Search (NAS) technology to generate an uninterpretable FPN structure with more excellent performance.”

    From MME-YOLO: Multi-Sensor Multi-Level Enhanced YOLO for Robust Vehicle Detection in Traffic Surveillance (2020) · cites this paper as [10]

    The Method section says NAS-FPN uses neural architecture search to discover an FPN architecture, and the Conclusion reports improved detection performance. The copy does not describe the resulting structure as uninterpretable; Section 4.2 instead discusses recognizable cross-scale connections in the discovered architectures. Page numbers were not provided. (LLM, conf=0.87)

    Experimental — accuracy not yet measured
  • On high-accuracy regime, EfficientDet consistently outperforms recent object detectors [10, 45] with much fewer parameters and FLOPs.

    “On high-accuracy regime, our EfficientDet also consistently outperforms recent object detectors [10, 45] with much fewer parameters and FLOPs.”

    From EfficientDet: Scalable and Efficient Object Detection (2019) · cites this paper as [10]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 34

  1. B. Baker, O. Gupta, N. Naik, and R. Raskar. Designing neu- ral network architectures using reinforcement learning. In ICLR, 2016. 2
  2. T. Bolukbasi, J. Wang, O. Dekel, and V. Saligrama. Adaptive neural networks for efficient inference. In ICML, 2017. 2
  3. L.-C. Chen, M. D. Collins, Y. Zhu, G. Papandreou, B. Zoph, F. Schroff, H. Adam, and J. Shlens. Searching for effi- cient multi-scale architectures for dense image prediction. In NIPS, 2018. 2
  4. R. J. L.-S. D. Ooro-Rubio, M. Niepert. Learning short-cut connections for object counting. BMVC, 2018. 2
  5. T. Elsken, J. H. Metzen, and F. Hutter. Neural architecture search: A survey. arXiv preprint arXiv:1808.05377, 2018. 2 · arXiv
  6. C. Fu, W. Liu, A. Ranga, A. Tyagi, and A. C. Berg. DSSD : Deconvolutional single shot detector. CoRR, abs/1701.06659, 2017. · arXiv
  7. G. Ghiasi, T. Lin, and Q. V. Le. DropBlock: A regularization method for convolutional networks. NIPS, 2018. 4, 6, 8
  8. K. He, G. Gkioxari, P. Dollár, and R. Girshick. Mask R- CNN. In ICCV, 2017. 1, 2, 8
  9. G. Huang, D. Chen, T. Li, F. Wu, L. van der Maaten, and K. Weinberger. Multi-scale dense networks for resource ef- ficient image classification. In ICLR, 2018. 4
  10. G. Huang, D. Chen, T. Li, F. Wu, L. van der Maaten, and K. Q. Weinberger. Multi-scale dense networks for resource efficient image classification. In ICLR, 2017. 2
  11. G. Huang, Z. Liu, and K. Q. Weinberger. Densely connected convolutional networks. In CVPR, 2017. 1
  12. T. Kong, F. Sun, W. Huang, and H. Liu. Deep feature pyra- mid reconfiguration for object detection. In ECCV, 2018. 2
  13. T. Kong, F. Sun, A. Yao, H. Liu, M. Lu, and Y. Chen. RON: reverse connection with objectness prior networks for object detection. In CVPR, 2017. 2
  14. H. Law and J. Deng. Cornernet: Detecting objects as paired keypoints. In ECCV, 2018. 8
  15. C.-Y. Lee, S. Xie, P. Gallagher, Z. Zhang, and Z. Tu. Deeply- supervised nets. In AISTATS, 2015. 4
  16. H. Li, P. Xiong, J. An, and L. Wang. Pyramid attention net- work for semantic segmentation. BMVC, 2018. 4
  17. Z. Li, C. Peng, G. Yu, X. Zhang, Y. Deng, and J. Sun. Detnet: A backbone network for object detection. In ECCV, 2018. 1
  18. C. Liu, B. Zoph, J. Shlens, W. Hua, L.-J. Li, L. Fei-Fei, A. Yuille, J. Huang, and K. Murphy. Progressive neural ar- chitecture search. In ECCV, 2017. 2
  19. S. Liu, L. Qi, H. Qin, J. Shi, and J. Jia. Path aggregation network for instance segmentation. In CVPR, 2018. 1, 2
  20. W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.-Y. Fu, and A. C. Berg. SSD: single shot multibox detector. In ECCV, 2016. 1
  21. N. D. B. B. Md Amirul Islam, Mrigank Rochan and Y. Wang. Gated feedback refinement network for dense image label- ing. CVPR, 2017. 2
  22. E. Real, A. Aggarwal, Y. Huang, and Q. V. Le. Regularized evolution for image classifier architecture search. In AAAI, 2018. 2, 5
  23. J. Redmon and A. Farhadi. Yolov3: An incremental improve- ment. arXiv preprint arXiv:1804.02767, 2018. 8 · arXiv
  24. M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.- C. Chen. MobileNetV2: inverted residuals and linear bottl. CVPR, 2019. 1, 2, 7, 8
  25. J.-Y. S. M.-C. K. S.-J. K. Seung-Wook Kim, Hyong- Keun Kook. Parallel feature pyramid network for object de- tection. ECCV, 2018. 2
  26. S. Teerapittayanon, B. McDanel, and H. Kung. Branchynet: Fast inference via early exiting from deep neural networks. In ICPR, pages 2464-2469. IEEE, 2016. 2
  27. S. Woo, S. Hwang, and I. S. Kweon. StairNet: top-down semantic aggregation for accurate one shot detection. In WACV, 2018. 2
  28. D. K. Yonghyun Kim, Bong-Nam Kang. San: Learning re- lationship between convolutional features for multi-scale ob- ject detection. ECCV, 2018. 2
  29. F. Yu, D. Wang, E. Shelhamer, and T. Darrell. Deep layer aggregation. In CVPR, 2018. 2
  30. S. Zhang, L. Wen, X. Bian, Z. Lei, and S. Z. Li. Single-shot refinement neural network for object detection. In CVPR, 2018. 2, 8
  31. Q. Zhao, T. Sheng, Y. Wang, Z. Tang, Y. Chen, L. Cai, and H. Ling. M2det: A single-shot object detector based on multi-level feature pyramid network. AAAI, 2019. 2
  32. P. Zhou, B. Ni, C. Geng, J. Hu, and Y. Xu. Scale- transferrable object detection. In CVPR, 2018. 2
  33. B. Zoph and Q. V. Le. Neural architecture search with rein- forcement learning. In ICLR, 2017. 2, 3, 4, 5
  34. B. Zoph, V. Vasudevan, J. Shlens, and Q. V. Le. Learning transferable architectures for scalable image recognition. In CVPR, 2018. 2, 3, 4

Cited by

Sorted by citations

Authors
Ghiasi, G., Lin, T.-Y., & Le, Q. V.
Affiliations
Google (United States) (US)
Venue
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Publisher
IEEE
Published
2019-06
Pages
7029-7038
ISSN
1063-6919 (ISSN-L)
OpenAlex
W2936599103
Cited by
2,099
References
10
Citations by year
2026: 173 · 2025: 340 · 2024: 358 · 2023: 342 · 2022: 318 · 2021: 347 · 2020: 190 · 2019: 31
FWCI
72.21
Type
conference paper
Language
en
Open access
Locations
  • IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
Keywords
neural architecture search, feature pyramid network, object detection, cross-scale feature fusion, RetinaNet, accuracy-latency trade-off

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review