The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Boosting Crowd Counting via Multifaceted Attention
Open accessAbstract
This paper focuses on the challenging crowd counting task. As large-scale variations often exist within crowd images, neither fixed-size convolution kernel of CNN nor fixed-size attention of recent vision transformers can well handle this kind of variations. To address this problem, we propose a Multifaceted Attention Network (MAN) to improve transformer models in local spatial relation encoding. MAN incorporates global attention from vanilla transformer, learnable local attention, and instance attention into a counting model. Firstly, the local Learnable Region Attention (LRA) is proposed to assign attention exclusive for each feature location dynamically. Secondly, we design the Local Attention Regularization to supervise the training of LRA by minimizing the deviation among the attention for different feature locations. Finally, we provide an Instance Attention mechanism to focus on the most important instances dynamically during training. Extensive experiments on four challenging crowd counting datasets namely ShanghaiTech, UCF-QNRF, JHU++, and NWPU have validated the proposed method. Code: https://github.com/LoraLinH/Boosting-Crowd-Counting-via-Multifaceted-Attention.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., Torr, P. H. S., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00681 · Cited by 4,008 · cited 1×
“[32,42,53] adopt transformers on instance or semantic segmentation.”
MethodSelf-citationLongformer: The Long-Document Transformer
Beltagy, I., Peters, M. E., & Cohan, A. (2020) · arXiv · doi:10.48550/arxiv.2004.05150 · Cited by 2,281
Single-Image Crowd Counting via Multi-Column Convolutional Neural Network
Zhang, Y., Zhou, D., Chen, S., Gao, S., & Ma, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.70 · Cited by 2,241
Segmenter: Transformer for Semantic Segmentation
Strudel, R., Garcia, R., Laptev, I., & Schmid, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00717 · Cited by 2,051
CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes
Li, Y., Zhang, X., & Chen, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00120 · Cited by 1,698
Chen, X., Yan, B., Zhu, J., Wang, D., Yang, X., & Lu, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00803 · Cited by 1,588
Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Tracking
Wang, N., Zhou, W., Wang, J., & Li, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00162 · Cited by 861
Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowds
Idrees, H., Tayyab, M., Athrey, K., Zhang, D., Al-Maadeed, S., Rajpoot, N., & Shah, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_33 · Cited by 851
ConViT: improving vision transformers with soft convolutional inductive biases
d’Ascoli, S., Touvron, H., Leavitt, M. L., Morcos, A. S., Biroli, G., & Sagun, L. (2022) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/ac9830 · Cited by 782
DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding
Shen, T., Zhou, T., Long, G., Jiang, J., Pan, S., & Zhang, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11941 · Cited by 779
Liu, W., Salzmann, M., & Fua, P. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00524 · Cited by 736
Scale Aggregation Network for Accurate and Efficient Crowd Counting
Cao, X., Wang, Z., Zhao, Y., & Su, F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_45 · Cited by 733
Generating High-Quality Crowd Density Maps Using Contextual Pyramid CNNs
Sindagi, V. A., & Patel, V. M. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.206 · Cited by 700
End-to-End Video Instance Segmentation with Transformers
Wang, Y., Xu, Z., Wang, X., Shen, C., Cheng, B., Shen, H., & Xia, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00863 · Cited by 679
Self-citationBayesian Loss for Crowd Count Estimation With Point Supervision
Ma, Z., Wei, X., Hong, X., & Gong, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00624 · Cited by 617
Self-citationNWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localization
Wang, Q., Gao, J., Lin, W., & Li, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3013269 · Cited by 510
Dehghani, M., Gouws, S., Vinyals, O., Uszkoreit, J., & Kaiser, Ł. (2018) · arXiv · doi:10.48550/arxiv.1807.03819 · Cited by 467
Scaling Local Self-Attention for Parameter Efficient Visual Backbones
Vaswani, A., Ramachandran, P., Srinivas, A., Parmar, N., Hechtman, B., & Shlens, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01270 · Cited by 453
DecideNet: Counting Varying Density Crowds Through Attention Guided Detection and Density Estimation
Liu, J., Gao, C., Meng, D., & Hauptmann, A. G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00545 · Cited by 416
Rethinking Counting and Localization in Crowds: A Purely Point-Based Framework
Song, Q., Wang, C., Jiang, Z., Wang, Y., Tai, Y., Wang, C., Li, J., Huang, F., & Wu, Y. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00335 · Cited by 381
Self-citationRethinking Transformer-based Set Prediction for Object Detection
Sun, Z., Cao, S., Yang, Y., & Kitani, K. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00359 · Cited by 356
Tensors : A brief introduction
Comon, P. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2298533 · Cited by 347
TransTrack: Multiple Object Tracking with Transformer
Sun, P., Cao, J., Jiang, Y., Zhang, R., Xie, E., Yuan, Z., Wang, C., & Luo, P. (2020) · arXiv · doi:10.48550/arxiv.2012.15460 · Cited by 345
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
Zhang, P., Dai, X., Yang, J., Xiao, B., Yuan, L., Zhang, L., & Gao, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00299 · Cited by 330
Focal Self-attention for Local-Global Interactions in Vision Transformers
Yang, J., Li, C., Zhang, P., Dai, X., Xiao, B., Yuan, L., & Gao, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.00641 · Cited by 256
Point in, Box Out: Beyond Counting Persons in Crowds
Liu, Y., Shi, M., Zhao, Q., & Wang, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00663 · Cited by 239
Multi-scale convolutional neural networks for crowd counting
Zeng, L., Xu, X., Cai, B., Qiu, S., & Zhang, T. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296324 · Cited by 220
Perspective-Guided Convolution Networks for Crowd Counting
Yan, Z., Yuan, Y., Zuo, W., Tan, X., Wang, Y., Wen, S., & Ding, E. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00104 · Cited by 218
Self-citationJHU-CROWD++: Large-Scale Crowd Counting Dataset and A Benchmark Method
Sindagi, V., Yasarla, R., & Patel, V. M. M. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3035969 · Cited by 211
A Generalized Loss Function for Crowd Counting and Localization
Wan, J., Liu, Z., & Chan, A. B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00201 · Cited by 210
End-to-End Object Detection with Adaptive Clustering TransformerPreprint
Zheng, M., Gao, P., Zhang, R., Li, K., Wang, X., Li, H., & Dong, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.09315 · Cited by 198
Distribution Matching for Crowd Counting
Wang, B., Liu, H., Samaras, D., & Hoai, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13077 · Cited by 164
Reverse Perspective Network for Perspective-Aware Object Counting
Yang, Y., Li, G., Wu, Z., Su, L., Huang, Q., & Sebe, N. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00443 · Cited by 152
Leveraging Heterogeneous Auxiliary Tasks to Assist Crowd Counting
Zhao, M., Zhang, J., Zhang, C., & Zhang, W. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01302 · Cited by 144
Learning to Count via Unbalanced Optimal Transport
Ma, Z., Wei, X., Hong, X., Lin, H., Qiu, Y., & Gong, Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16332 · Cited by 98
Self-citationSemi-supervised Crowd Counting via Self-training on Surrogate Tasks
Liu, Y., Liu, L., Wang, P., Zhang, P., & Lei, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_15 · Cited by 93
Towards A Universal Model for Cross-Dataset Crowd Counting
Ma, Z., Hong, X., Wei, X., Qiu, Y., & Gong, Y. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00319 · Cited by 59
Self-citationDynamic Self-Attention : Computing Attention over Words Dynamically for Sentence EmbeddingPreprint
Yoon, D., Lee, D., & Lee, S. K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07383 · Cited by 41
Attention scales according to inferred real-world object size
Collegio, A. J., Nah, J. C., Scotti, P. S., & Shomstein, S. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0485-2 · Cited by 40
Learning Scales from Points: A Scale-aware Probabilistic Model for Crowd Counting
Ma, Z., Wei, X., Hong, X., & Gong, Y. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413642 · Cited by 38
Self-citationECCNAS: Efficient Crowd Counting Neural Architecture Search
Wang, Y., Ma, Z., Wei, X., Zheng, S., Wang, Y., & Hong, X. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3465455 · Cited by 25
Self-citationDifferentiable Window for Dynamic Local Attention
Nguyen, T.-T., Nguyen, X.-P., Joty, S., & Li, X. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.589 · Cited by 13
Metadata
- Authors
- Lin, H., Ma, Z., Ji, R., Wang, Y., & Hong, X.
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 19596-19605
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4313182800
- Cited by
- 257
- References
- 49
- FWCI
- 20.47
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.