Non-Maximum Suppression Guided Label Assignment for Object Detection in Crowd Scenes
The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Abstract
The detection performance in crowd scenes is limited by recalling hard objects (e.g., occluded objects). It requires that this kind of objects can be successfully detected and retained by the non-maximum suppression (NMS) while controlling false positives. The existing dynamic label assignment algorithms can help recall these objects by adaptively allocating appropriate positive samples, however, they ignore the alignment with the selecting rules of NMS. This leads to the fact that detecting objects in crowd scenes are still very sensitive to the NMS threshold setting. As a result, the existing methods can only set a low NMS threshold to avoid the excessive false positives, causing some objects failed to be recalled. And these methods also generally lack more excitation for positive samples, which hinders further facilitating the recall of hard instances in crowd scenes. This article proposes a novel dynamic label assignment strategy for object detection in crowd scenes, called non-maximum suppression guided label assignment (NGLA), which aligns the assignment strategy with NMS process and learns more prominent positive samples. Following NMS, NGLA introduces the IoU between samples with their corresponding best samples to define positive and negative samples. To cooperate with NGLA, an NMS-aware loss is proposed to dynamically assign sample weights when supervising sample predictions, which also considers the IoU with the best sample. In addition, for better classification p…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Self-citationFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858826 · Cited by 9,556
Deformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513 · cited 1×
“The second modification is applying a 1 × 2 deformable conv [53] with supervised offset to perceive the similarity be-tween each sample and the corresponding best sample.”
MethodFCOS: Fully Convolutional One-Stage Object Detection
Tian, Z., Shen, C., Chen, H., & He, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00972 · Cited by 7,013
CornerNet: Detecting Objects as Paired Keypoints
Law, H., & Deng, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_45 · Cited by 3,852
Pedestrian Detection: An Evaluation of the State of the Art
Dollar, P., Wojek, C., Schiele, B., & Perona, P. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.155 · Cited by 3,190
R-FCN: Object Detection via Region-based Fully Convolutional Networks
Dai, J., Li, Y., He, K., & Sun, J. Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06409 · Cited by 3,149
Li, X., Wang, W., Hu, X., & Yang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00060 · Cited by 3,134
Zhang, S., Chi, C., Yao, Y., Lei, Z., & Li, S. Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00978 · Cited by 2,354
Sparse R-CNN: End-to-End Object Detection with Learnable Proposals
Sun, P., Zhang, R., Jiang, Y., Kong, T., Xu, C., Zhan, W., Tomizuka, M., Li, L., Yuan, Z., Wang, C., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01422 · Cited by 1,617 · cited 1×
“Recently, many works [36], [52], [57], [58], [59], [60], [61], [62] proposed end-to-end detectors without the requirement of NMS process.”
BackgroundDN-DETR: Accelerate DETR Training by Introducing Query DeNoising
Li, F., Zhang, H., Liu, S., Guo, J., Ni, L. M., & Zhang, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01325 · Cited by 1,102
Bottom-Up Object Detection by Grouping Extreme and Center Points
Zhou, X., Zhuo, J., & Krahenbuhl, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00094 · Cited by 1,088
CityPersons: A Diverse Dataset for Pedestrian Detection
Zhang, S., Benenson, R., & Schiele, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.474 · Cited by 1,061
Region Proposal by Guided Anchoring
Wang, J., Chen, K., Yang, S., Loy, C. C., & Lin, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00308 · Cited by 685
Repulsion Loss: Detecting Pedestrians in a Crowd
Wang, X., Xiao, T., Jiang, Y., Shao, S., Sun, J., & Shen, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00811 · Cited by 592
CrowdHuman: A Benchmark for Detecting Human in a Crowd
Shao, S., Zhao, Z., Li, B., Xiao, T., Yu, G., Zhang, X., & Sun, J. (2018) · arXiv · doi:10.48550/arxiv.1805.00123 · Cited by 534
Self-citationOTA: Optimal Transport Assignment for Object Detection
Ge, Z., Liu, S., Li, Z., Yoshie, O., & Sun, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00037 · Cited by 502
Occlusion-Aware R-CNN: Detecting Pedestrians in a Crowd
Zhang, S., Wen, L., Bian, X., Lei, Z., & Li, S. Z. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_39 · Cited by 488
Probabilistic Anchor Assignment with IoU Prediction for Object Detection
Kim, K., & Lee, H. S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58595-2_22 · Cited by 457
Detecting Masked Faces in the Wild with LLE-CNNs
Ge, S., Li, J., Ye, Q., & Luo, Z. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.53 · Cited by 454
High-Level Semantic Feature Detection: A New Perspective for Pedestrian Detection
Liu, W., Liao, S., Ren, W., Hu, W., & Yu, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00533 · Cited by 446
Adaptive NMS: Refining Pedestrian Detection in a Crowd
Liu, S., Huang, D., & Wang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00662 · Cited by 413 · cited 3×
“Thereare alsoseveralmethods[18],[19],[20],[44]tofocusonthecon-nectionbetweentrainingandNMSprocess.”
MethodDAB-DETR: Dynamic Anchor Boxes are Better Queries for DETR
Liu, S., Li, F., Zhang, H., Yang, X., Qi, X., Su, H., Zhu, J. J., & Zhang, L. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.12329 · Cited by 391
Occluded Pedestrian Detection Through Guided Attention in CNNs
Zhang, S., Yang, J., & Schiele, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00731 · Cited by 385
Zhou, X., Wang, D., & Krähenbühl, P. (2019) · arXiv · doi:10.48550/arxiv.1904.07850 · Cited by 288
End-to-End Object Detection with Fully Convolutional Network
Wang, J., Song, L., Li, Z., Sun, H., Sun, J., & Zheng, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01559 · Cited by 235 · cited 6×
“OneNet [52] and POTO [36] only chosen the best sample as the positive for each gt. FreeAnchor [37] proposed a detection-customized likelihood as the measure metric.”
BackgroundMethodInfluentialDetection in Crowded Scenes: One Proposal, Multiple Predictions
Chu, X., Zheng, A., Zhang, X., & Sun, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01223 · Cited by 231
Self-citationWiderPerson: A Diverse Dataset for Dense Pedestrian Detection in the Wild
Zhang, S., Xie, Y., Wan, J., Xia, H., Li, S. Z., & Guo, G. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2929005 · Cited by 222
Selective-Supervised Contrastive Learning with Noisy Labels
Li, S., Xia, X., Ge, S., & Liu, T. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00041 · Cited by 222
NMS by Representative Region: Towards Crowded Pedestrian Detection by Proposal Pairing
Huang, X., Ge, Z., Jie, Z., & Yoshie, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01076 · Cited by 197
Learning to Match Anchors for Visual Object Detection
Zhang, X., Wan, F., Liu, C., Ji, X., & Ye, Q. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3050494 · Cited by 186
Self-citationAutoAssign: Differentiable Label Assignment for Dense Object Detection
Zhu, B., Wang, J., Jiang, Z., Zong, F., Liu, S., Li, Z., & Sun, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03496 · Cited by 179
PedHunter: Occlusion Robust Pedestrian Detector in Crowded Scenes
Chi, C., Zhang, S., Xing, J., Lei, Z., Li, S. Z., & Zou, X. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6690 · Cited by 134
What Makes for End-to-End Object Detection?Preprint
Sun, P., Jiang, Y., Xie, E., Shao, W., Yuan, Z., Wang, C., & Luo, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.05780 · Cited by 120
Attribute-Aware Pedestrian Detection in a Crowd
Zhang, J., Lin, L., Zhu, J., Li, Y., Chen, Y.-C., Hu, Y., & Hoi, S. C. H. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3020691 · Cited by 80
CF-DETR: Coarse-to-Fine Transformers for End-to-End Object Detection
Cao, X., Yuan, P., Feng, B., & Niu, K. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19893 · Cited by 80
MetaAnchor: Learning to Detect Objects with Customized Anchors
Yang, T., Zhang, X., Li, Z., Zhang, W., & Sun, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00980 · Cited by 70
Self-citationDiscriminative Feature Transformation for Occluded Pedestrian Detection
Zhou, C., Yang, M., & Yuan, J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00965 · Cited by 68
IQDet: Instance-wise Quality Distribution Sampling for Object Detection
Ma, Y., Liu, S., Li, Z., & Sun, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00176 · Cited by 66
Double Anchor R-CNN for Human Detection in a CrowdPreprint
Zhang, K., Xiong, F., Sun, P., Hu, L., Li, B., & Yu, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.09998 · Cited by 60
Semantic head enhanced pedestrian detection in a crowd
Lu, R., Ma, H., & Wang, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.037 · Cited by 59
DN-DETR: Accelerate DETR Training by Introducing Query DeNoising
Li, F., Zhang, H., Liu, S., Guo, J., Ni, L. M., & Zhang, L. (2022) · arXiv · doi:10.48550/arxiv.2203.01305 · Cited by 57
Pedestrian Detection via Body Part Semantic and Contextual Information With DNN
Wang, S., Cheng, J., Liu, H., Feng, W., & Zhou, H. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2829602 · Cited by 54
LLA: Loss-aware label assignment for dense pedestrian detection
Ge, Z., Wang, J., Huang, X., Liu, S., & Yoshie, O. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.094 · Cited by 54
Prediction-Guided Distillation for Dense Object Detection
Yang, C., Ochal, M., Storkey, A., & Crowley, E. J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20077-9_8 · Cited by 51
Proposal pyramid networks for fast face detection
Zeng, D., Liu, H., Zhao, F., Ge, S., Shen, W., & Zhang, Z. (2019) · Information Sciences · doi:10.1016/j.ins.2019.01.083 · Cited by 21
Accurate UAV Tracking with Distance-Injected Overlap Maximization
Zhang, C., Ge, S., Zhang, K., & Zeng, D. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413959 · Cited by 18
Body-Part Joint Detection and Association via Extended Object Representation
Zhou, H., Jiang, F., & Lu, H. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00037 · Cited by 18
Deeply Tensor Compressed Transformers for End-to-End Object Detection
Zhen, P., Gao, Z., Hou, T., Cheng, Y. G., & Chen, H. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i4.20397 · Cited by 17
IoU-Enhanced Attention for End-to-End Task Specific Object Detection
Zhao, J., Wu, S., Li, S., & Li, Q. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26348-4_8 · Cited by 12
TSAA: A Two-Stage Anchor Assignment Method towards Anchor Drift in Crowded Object DetectionPreprint
Li, X., He, M., Haibo, L., Yang, H., & Xiao, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.00826 · Cited by 1
Research works printed but not linked: 2
- Xu, 2020, R-CNN: Looking into pedestrian detection from another perspective, 19953
- Li, 2022, Estimating noise transition matrix with label correlations for noisy multi-label learning, 24184
Cited by
A Comprehensive Survey of Machine Learning Techniques and Models for Object Detection
Τρίγκα, Μ., & Dritsas, E. (2025) · Sensors · doi:10.3390/s25010214 · Cited by 137
A survey on state-of-the-art deep learning applications and challenges
Noor, M. H. M., & Ige, A. O. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111225 · Cited by 122
Chou, J., Liu, C., & Guo, P.-J. (2024) · Case Studies in Construction Materials · doi:10.1016/j.cscm.2024.e04048 · Cited by 11
Baumgart, N., Lange‐Hegermann, M., & Mücke, M. (2025) · Machine Vision and Applications · doi:10.1007/s00138-025-01770-0 · Cited by 10
Gong, H., Li, M., Wang, L., Huang, S., & Li, M. (2025) · Applied Sciences · doi:10.3390/app15105518 · Cited by 7
Metadata
- Authors
- Jiang, H., Zhang, X., & Xiang, S.
- Affiliations
- University of Chinese Academy of Sciences (CN)
- Beijing Institute of Technology (CN)
- Venue
- IEEE Transactions on Multimedia
- Published
- 2024
- Volume
- 26
- Pages
- 2207-2218
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W4383503678
- Cited by
- 16
- References
- 59
- Citations by year
- 2026: 5 · 2025: 7 · 2024: 4
- FWCI
- 1.45
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Multimedia (publishedVersion)
- Funders
- National Key Research and Development Program of China (2018AAA0100400)
- National Natural Science Foundation of China (62076242)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- object detection, crowded scenes, non-maximum suppression, label assignment, occluded objects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.