The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Learning to Match Anchors for Visual Object Detection
Abstract
Modern CNN-based object detectors assign anchors for ground-truth objects under the restriction of object-anchor Intersection-over-Union (IoU). In this study, we propose a learning-to-match (LTM) method to break IoU restriction, allowing objects to match anchors in a flexible manner. LTM updates hand-crafted anchor assignment to "free" anchor matching by formulating detector training in the Maximum Likelihood Estimation (MLE) framework. During the training phase, LTM is implemented by converting the detection likelihood to anchor matching loss functions which are plug-and-play. Minimizing the matching loss functions drives learning and selecting features which best explain a class of objects with respect to both classification and localization. LTM is extended from anchor-based detectors to anchor-free detectors, validating the general applicability of learnable object-feature matching mechanism for visual object detection. Experiments on MS COCO dataset demonstrate that LTM detectors consistently outperform counterpart detectors with significant margins. The last but not the least, LTM requires negligible computational cost in both training and inference phases as it does not involve any additional architecture or parameter. Code has been made publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Deformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513 · cited 1×
“Our work is related to the deformable convolutional network (DCN) [23], which augments the spatial sampling locations of feature with additional offsets and learns offsets from the target tasks.”
BackgroundCascade R-CNN: Delving Into High Quality Object Detection
Cai, Z., & Vasconcelos, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00644 · Cited by 7,370
FCOS: Fully Convolutional One-Stage Object Detection
Tian, Z., Shen, C., Chen, H., & He, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00972 · Cited by 7,013
Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression
Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00075 · Cited by 6,612
CornerNet: Detecting Objects as Paired Keypoints
Law, H., & Deng, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_45 · Cited by 3,852
Object Detection in 20 Years: A Survey
Zou, Z., Chen, K., Shi, Z., Guo, Y., & Ye, J. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3238524 · Cited by 3,689 · cited 1×
“According to recent survey papers [14]–[16], various tax-onomies can be used to category the large amount of CNN-based object detectors, e.g., one-stage [3] vs. two-stage [5], single-scale features [3] vs. Feature Pyramid Network (FPN) [6], and handcrafted network [7] vs. network architecture…”
Wu, Y., & He, K. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01198-w · Cited by 3,601
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01247-4 · Cited by 2,965 · cited 1×
“According to recent survey papers [14]–[16], various tax-onomies can be used to category the large amount of CNN-based object detectors, e.g., one-stage [3] vs. two-stage [5], single-scale features [3] vs. Feature Pyramid Network (FPN) [6], and handcrafted network [7] vs. network architecture…”
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2018) · arXiv · doi:10.48550/arxiv.1809.02165 · Cited by 2,965
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C. L., & Dollár, P. (2014) · arXiv · doi:10.48550/arxiv.1405.0312 · Cited by 2,579
Single-Shot Refinement Neural Network for Object Detection
Zhang, S., Wen, L., Bian, X., Lei, Z., & Li, S. Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00442 · Cited by 1,678
DSSD : Deconvolutional Single Shot Detector
Fu, C.-Y., Liu, W., Ranga, A., Tyagi, A., & Berg, A. C. (2017) · arXiv · doi:10.48550/arxiv.1701.06659 · Cited by 1,624 · cited 1×
“Anchor-based approach has been successfully demonstrated in modern detectors including Faster R-CNN [3], SSD [7], FPN [6], RetinaNet [5], DSSD [19], and YOLOv2 [20].”
MethodRepPoints: Point Set Representation for Object Detection
Yang, Z., Liu, S., Hu, H., Wang, L., & Lin, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00975 · Cited by 1,307 · cited 1×
“To improve adaptability, RepPoint [32] learned to automatically arrange keypoints in a manner which bounds the spatial extent of an object and indicates semantically significant local areas.”
MethodBottom-Up Object Detection by Grouping Extreme and Center Points
Zhou, X., Zhuo, J., & Krahenbuhl, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00094 · Cited by 1,088
Acquisition of Localization Confidence for Accurate Object Detection
Jiang, B., Luo, R., Mao, J., Xiao, T., & Jiang, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_48 · Cited by 1,059
CrowdHuman: A Benchmark for Detecting Human in a Crowd
Shao, S., Zhao, Z., Li, B., Xiao, T., Yu, G., Zhang, X., & Sun, J. (2018) · arXiv · doi:10.48550/arxiv.1805.00123 · Cited by 534 · cited 1×
“This demonstrated that our detector, with positive anchor matching, can select optimal anchors for objects in crowded scenes [39].”
BackgroundSelf-citationChoi, J., Chun, D., Kim, H., & Lee, H.-J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00059 · Cited by 505
Research works printed but not linked: 21
- Duan, Centernet: Object detection with keypoint triplets, 6568
- 10.1109/TPAMI.2019.2898858 · DOI
- 10.1109/CVPR.2019.00230 · DOI · Paper page
- 10.1098/rsta.1922.0009 · DOI · Paper page
- Maron, A framework for multiple-instance learning, 570
- Zhang, FreeAnchor: Learning to match anchors for visual object detection, 147
- 10.1109/CVPR.2019.00720 · DOI · Paper page
- Yang, Metaanchor: Learning to detect objects with customized anchors, 320
- 10.1109/CVPR.2017.690 · DOI · Paper page
- Vu, Cascade RPN: Delving into high-quality region proposal network with adaptive convolution, 1430
- 10.1109/CVPR.2019.00308 · DOI · Paper page
- 10.1109/TPAMI.2020.2981890 · DOI · Paper page
- 10.1109/CVPR.2017.283 · DOI · Paper page
- 10.1109/CVPR.2019.00093 · DOI · Paper page
- 10.1109/CVPR.2017.634 · DOI · Paper page
- 10.1007/978-3-319-10602-1_48 · DOI · Paper page
- 10.1007/978-3-030-01261-8_1 · doi:10.1007/978-3-030-01261-8_1 · Paper page
- 10.1109/CVPR.2019.00537 · DOI · Paper page
- 10.1109/CVPR.2019.00091 · DOI · Paper page
- 10.1109/ICCV.2019.00615 · DOI · Paper page
- 10.1109/CVPR.2019.00093 · DOI · Paper page
Cited by
YOLOX: Exceeding YOLO Series in 2021
Ge, Z., Liu, S., Wang, F., Li, Z., & Sun, J. (2021) · arXiv · doi:10.48550/arxiv.2107.08430 · Cited by 2,965
A review of object detection based on deep learning
Xiao, Y., Tian, Z., Yu, J., Zhang, Y., Liu, S., Du, S., & Lan, X. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08976-6 · Cited by 584
Oriented RepPoints for Aerial Object Detection
Li, W., Chen, Y., Hu, K., & Zhu, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00187 · Cited by 556
Object Detection Using Deep Learning, CNNs and Vision Transformers: A Review
Amjoud, A. B., & Amrouch, M. (2023) · IEEE Access · doi:10.1109/access.2023.3266093 · Cited by 318
RFLA: Gaussian Receptive Field Based Label Assignment for Tiny Object Detection
Xu, C., Wang, J., Yang, W., Yu, H., Yu, L., & Xia, G.-S. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20077-9_31 · Cited by 308
Metadata
- Authors
- Zhang, X., Wan, F., Liu, C., Ji, X., & Ye, Q.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2022-06-01
- Volume
- 44
- Issue
- 6
- Pages
- 3096-3109
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3120031785
- Cited by
- 186
- References
- 26
- FWCI
- 13.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Funders
- National Natural Science Foundation of China (61836012, 61620106005, 61771447)
- Strategic Priority Research Programme of Chinese Academy of Science (XDA27010303)
- Post Doctoral Innovative Talent Support Program of China (119103S304)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.