Attribute-Aware Pedestrian Detection in a Crowd
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Pedestrian detection is an initial step to perform outdoor scene analysis, which plays an essential role in many real-world applications. Although having enjoyed the merits of deep learning frameworks from the generic object detectors, pedestrian detection is still a very challenging task due to heavy occlusions, and highly crowded group. Generally, the conventional detectors are unable to differentiate individuals from each other effectively under such a dense environment. To tackle this critical problem, we propose an attribute-aware pedestrian detector to explicitly model people's semantic attributes in a high-level feature detection fashion. Besides the typical semantic features, center position, target's scale, and offset, we introduce a pedestrian-oriented attribute feature to encode the high-level semantic differences among the crowd. Moreover, a novel attribute-feature-based Non-Maximum Suppression (NMS) is proposed to distinguish the person from a highly overlapped group by adaptively rejecting the false-positive results in a very crowd settings. Furthermore, an enhanced ground truth target is designed to alleviate the difficulties caused by the attribute configuration, and to ease the class imbalance issue during training. Finally, we evaluate our proposed attribute-aware pedestrian detector on three benchmark datasets including CityPerson, CrowdHuman, and EuroCityPerson, and achieves the state-of-the-art results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Tarvainen, A., & Valpola, H. (2017) · arXiv · doi:10.48550/arxiv.1703.01780 · Cited by 4,275
CornerNet: Detecting Objects as Paired Keypoints
Law, H., & Deng, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_45 · Cited by 3,852
Soft-NMS — Improving Object Detection with One Line of Code
Bodla, N., Singh, B., Chellappa, R., & Davis, L. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.593 · Cited by 2,274 · cited 1×
“Instead of discarding the predicted boxes during suppressing, soft-NMS [1] decreases the scores of neighbors by an increasing function of their overlap with the higher scored bounding box.”
BackgroundA Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection
Cai, Z., Fan, Q., Feris, R. S., & Vasconcelos, N. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_22 · Cited by 1,605 · cited 2×
“Being a special case of generic object detection, pedestrian detectors [2], [16], [46] inherit a lot of successful techniques from the conventional anchor-based approaches, such as Faster RCNN [44] and SSD [21].”
MethodRelation Networks for Object Detection
Hu, H., Gu, J., Zhang, Z., Dai, J., & Wei, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00378 · Cited by 1,524
A Trainable System for Object Detection
Papageorgiou, C., & Poggio, T. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008162616689 · Cited by 1,289 · cited 1×
“Early generic object detectors are based on the hand-crafted features [6], [8], [33], which aim at finding and classifying the candidates in a sliding window paradigm or region proposal strategy.”
BackgroundCityPersons: A Diverse Dataset for Pedestrian Detection
Zhang, S., Benenson, R., & Schiele, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.474 · Cited by 1,061
Acquisition of Localization Confidence for Accurate Object Detection
Jiang, B., Luo, R., Mao, J., Xiao, T., & Jiang, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_48 · Cited by 1,059
Learning Non-maximum Suppression
Hosang, J., Benenson, R., & Schiele, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.685 · Cited by 736
CrowdHuman: A Benchmark for Detecting Human in a Crowd
Shao, S., Zhao, Z., Li, B., Xiao, T., Yu, G., Zhang, X., & Sun, J. (2018) · arXiv · doi:10.48550/arxiv.1805.00123 · Cited by 534 · cited 5×
“Furthermore, we compare our approach with the state-of-the-art methods on both CityPerson, CrowdHuman [40] and EuroCityPerson [2].”
BackgroundMethodInfluentialOcclusion-Aware R-CNN: Detecting Pedestrians in a Crowd
Zhang, S., Wen, L., Bian, X., Lei, Z., & Li, S. Z. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_39 · Cited by 488
Adaptive NMS: Refining Pedestrian Detection in a Crowd
Liu, S., Huang, D., & Wang, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00662 · Cited by 413 · cited 10×
“We further conduct an experiment to compare our attributeaware pedestrian detector with the following three settings: 1) a density map that predicts density information together with density-aware NMS which follows the strategy of adaptiveNMS [20]; 2) a diversity map that predicts diversity information together with d…”
BackgroundMethodInfluentialFiltered channel features for pedestrian detection
Zhang, S., Benenson, R., & Schiele, B. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298784 · Cited by 395 · cited 1×
“Traditional pedestrian detectors [6], [30], [50] rely on integral channel features with sliding window strategy to localize each target.”
BackgroundEuroCity Persons: A Novel Benchmark for Person Detection in Traffic Scenes
Braun, M., Krebs, S., Flohr, F., & Gavrila, D. M. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2897684 · Cited by 307 · cited 7×
“Furthermore, we compare our approach with the state-of-the-art methods on both CityPerson, CrowdHuman [40] and EuroCityPerson [2].”
BackgroundMethodInfluentialWhat Can Help Pedestrian Detection?
Mao, J., Xiao, T., Jiang, Y., & Cao, Z. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.639 · Cited by 306
Zhou, X., Wang, D., & Krähenbühl, P. (2019) · arXiv · doi:10.48550/arxiv.1904.07850 · Cited by 288
A discriminative deep model for pedestrian detection with occlusion handling
Ouyang, W., & Wang, X. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248062 · Cited by 281
SP-NAS: Serial-to-Parallel Backbone Search for Object Detection
Jiang, C., Xu, H., Zhang, W., Liang, X., & Li, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01188 · Cited by 67
Cited by
Recent advances in deep learning for object detection
Wu, X., Sahoo, D., & Hoi, S. C. H. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.085 · Cited by 1,047
Self-citationOriented RepPoints for Aerial Object Detection
Li, W., Chen, Y., Hu, K., & Zhu, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00187 · Cited by 556
Self-citationDetecting 32 Pedestrian Attributes for Autonomous Vehicles
Mordan, T., Cord, M., Perez, P., & Alahi, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3107587 · Cited by 36
“, road crossing prediction [46], [47], [19], [48], [8], [20], detection [10], [11], and segmentation [12].”
BackgroundNon-Maximum Suppression Guided Label Assignment for Object Detection in Crowd Scenes
Jiang, H., Zhang, X., & Xiang, S. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3293333 · Cited by 16
Metadata
- Authors
- Zhang, J., Lin, L., Zhu, J., Li, Y., Chen, Y.-C., Hu, Y., & Hoi, S. C. H.
- Venue
- IEEE Transactions on Multimedia
- Published
- 2021
- Volume
- 23
- Pages
- 3085-3097
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W3082231033
- Cited by
- 80
- References
- 22
- FWCI
- 5.16
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.