The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Dual Cross-Attention Learning for Fine-Grained Visual Categorization and Object Re-Identification
Open accessAbstract
Recently, self-attention mechanisms have shown impressive performance in various NLP and CV tasks, which can help capture sequential characteristics and derive global information. In this work, we explore how to extend self-attention modules to better learn subtle feature embeddings for recognizing fine-grained objects, e.g., different bird species or person identities. To this end, we propose a dual cross-attention learning (DCAL) algorithm to coordinate with self-attention learning. First, we propose global-local cross-attention (GLCA) to enhance the interactions between global images and local high-response regions, which can help reinforce the spatial-wise discriminative clues for recognition. Second, we propose pairwise cross-attention (PWCA) to establish the interactions between image pairs. PWCA can regularize the attention learning of an image by treating another image as distractor and will be removed during inference. We observe that DCAL can reduce misleading attentions and diffuse the attention response to discover more complementary parts for recognition. We conduct extensive evaluations on finegrained visual categorization and object reidentification. Experiments demonstrate that DCAL performs on par with state-of-the-art methods and consistently improves multiple self-attention baselines, e.g., surpassing DeiT-Tiny and ViT-Base by 2.8% and 2.4% mAP on MSMT17, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
Scalable Person Re-identification: A Benchmark
Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., & Tian, Q. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.133 · Cited by 4,506
Self-citationRethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., Torr, P. H. S., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00681 · Cited by 4,008 · cited 1×
“, image classification [5,12,19,37,45,51], object detection [2,41,44,68], semantic segmentation [23, 39, 50, 51, 63] and low-level tasks [4]) and shown competitive performance compared to the stateof-the-art CNNs.”
Background3D Object Representations for Fine-Grained Categorization
Krause, J., Stark, M., Deng, J., & Fei-Fei, L. (2013) · 2013 IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2013.77 · Cited by 3,496
CCNet: Criss-Cross Attention for Semantic Segmentation
Huang, Z., Wang, X., Huang, L., Huang, C., Wei, Y., & Liu, W. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00069 · Cited by 3,045
Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)
Sun, Y., Zheng, L., Yang, Y., Tian, Q., & Wang, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_30 · Cited by 2,522
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Yuan, L., Chen, Y., Wang, T., Yu, W., Shi, Y., Jiang, Z., Tay, F. E., Feng, J., & Yan, S. (2021) · arXiv · doi:10.48550/arxiv.2101.11986 · Cited by 2,415
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Yuan, L., Chen, Y., Wang, T., Yu, W., Shi, Y., Jiang, Z., Tay, F. E. H., Feng, J., & Yan, S. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00060 · Cited by 2,415
Pre-Trained Image Processing Transformer
Chen, H., Wang, Y., Guo, T., Xu, C., Deng, Y., Liu, Z., Ma, S., Xu, C., Xu, C., & Gao, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01212 · Cited by 2,308
Person Transfer GAN to Bridge Domain Gap for Person Re-identification
Wei, L., Zhang, S., Gao, W., & Tian, Q. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00016 · Cited by 2,118
Deep Networks with Stochastic Depth
Huang, G., Sun, Y., Liu, Z., Sedra, D., & Weinberger, K. Q. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_39 · Cited by 2,104
CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification
Chen, C.-F. R., Fan, Q., & Panda, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00041 · Cited by 2,074
Sparse R-CNN: End-to-End Object Detection with Learnable Proposals
Sun, P., Zhang, R., Jiang, Y., Kong, T., Xu, C., Zhan, W., Tomizuka, M., Li, L., Yuan, Z., Wang, C., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01422 · Cited by 1,617
Bag of Tricks and a Strong Baseline for Deep Person Re-Identification
Luo, H., Gu, Y., Liao, X., Lai, S., & Jiang, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00190 · Cited by 1,584
Fu, J., Zheng, H., & Mei, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.476 · Cited by 1,400
Bottleneck Transformers for Visual Recognition
Srinivas, A., Lin, T.-Y., Parmar, N., Shlens, J., Abbeel, P., & Vaswani, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01625 · Cited by 1,385
TransReID: Transformer-based Object Re-Identification
He, S., Luo, H., Wang, P., Wang, F., Li, H., & Jiang, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01474 · Cited by 1,244
Fine-Grained Visual Classification of Aircraft
Maji, S., Rahtu, E., Kannala, J., Blaschko, M. B., & Vedaldi, A. (2013) · INRIA a CCSD electronic archive server · doi:10.48550/arxiv.1306.5151 · Cited by 1,084
Learning Multi-attention Convolutional Neural Network for Fine-Grained Image Recognition
Zheng, H., Fu, J., Mei, T., & Luo, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.557 · Cited by 1,045
(2020) · International Conference on Machine Learning · Cited by 1,012
Quantifying Attention Flow in Transformers
Abnar, S., & Zuidema, W. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.385 · Cited by 995
Stand-Alone Self-Attention in Vision Models
Ramachandran, P., Parmar, N., Vaswani, A., Bello, I., Levskaya, A., & Shlens, J. (2019) · arXiv · doi:10.48550/arxiv.1906.05909 · Cited by 977
Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
Wang, H., Zhu, Y., Green, B., Adam, H., Yuille, A., & Chen, L.-C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_7 · Cited by 809
Learning to Navigate for Fine-Grained Classification
Yang, Z., Luo, T., Wang, D., Hu, Z., Gao, J., & Wang, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_26 · Cited by 616
Human Semantic Parsing for Person Re-identification
Kalayeh, M. M., Basaran, E., Gokmen, M., Kamasak, M. E., & Shah, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00117 · Cited by 584
Local Relation Networks for Image Recognition
Hu, H., Zhang, Z., Xie, Z., & Lin, S. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00356 · Cited by 570
ABD-Net: Attentive but Diverse Person Re-Identification
Chen, T., Ding, S., Xie, J., Yuan, Y., Chen, W., Yang, Y., Ren, Z., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00844 · Cited by 561
TransFG: A Transformer Architecture for Fine-Grained Recognition
He, J., Chen, J.-N., Liu, S., Kortylewski, A., Yang, C., Bai, Y., & Wang, C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19967 · Cited by 551
Destruction and Construction Learning for Fine-Grained Image Recognition
Chen, Y., Bai, Y., Zhang, W., & Mei, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00530 · Cited by 532
High-Order Information Matters: Learning Relation and Topology for Occluded Person Re-Identification
Wang, G., Yang, S., Liu, H., Wang, Z., Yang, Y., Wang, S., Yu, G., Zhou, E., & Sun, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00648 · Cited by 512
MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers
Wang, H., Zhu, Y., Adam, H., Yuille, A., & Chen, L.-C. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00542 · Cited by 497
Zheng, H., Fu, J., Zha, Z.-J., & Luo, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00515 · Cited by 488
End-to-End Comparative Attention Networks for Person Re-Identification
Liu, H., Feng, J., Qi, M., Jiang, J., & Yan, S. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2700762 · Cited by 482
Multi-Attention Multi-Class Constraint for Fine-grained Image Recognition
Sun, M., Yuan, Y., Zhou, F., & Ding, E. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01270-0_49 · Cited by 426
Learning Attentive Pairwise Interaction for Fine-Grained Classification
Zhuang, P., Wang, Y., & Qiao, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7016 · Cited by 415
Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identification
Rao, Y., Chen, G., Lu, J., & Zhou, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00106 · Cited by 380
Fine-Grained Visual Classification via Progressive Multi-granularity Training of Jigsaw Patches
Du, R., Chang, D., Bhunia, A. K., Xie, J., Ma, Z., Song, Y.-Z., & Guo, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58565-5_10 · Cited by 376
Rethinking Transformer-based Set Prediction for Object Detection
Sun, Z., Cao, S., Yang, Y., & Kitani, K. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00359 · Cited by 356
Identity-Guided Human Semantic Parsing for Person Re-identification
Zhu, K., Guo, H., Liu, Z., Tang, M., & Wang, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58580-8_21 · Cited by 329
Cross-X Learning for Fine-Grained Visual Categorization
Luo, W., Yang, X., Mo, X., Lu, Y., Davis, L., Li, J., Yang, J., & Lim, S.-N. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00833 · Cited by 278
Selective Sparse Sampling for Fine-Grained Image Recognition
Ding, Y., Zhou, Y., Zhu, Y., Ye, Q., & Jiao, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00670 · Cited by 278
Pairwise Confusion for Fine-Grained Visual Classification
Dubey, A., Gupta, O., Guo, P., Raskar, R., Farrell, R., & Naik, N. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01258-8_5 · Cited by 234
Beyond Triplet Loss: Person Re-Identification With Fine-Grained Difference-Aware Pairwise Loss
Yan, C., Pang, G., Bai, X., Liu, C., Ning, X., Gu, L., & Zhou, J. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3069562 · Cited by 230
Parsing-Based View-Aware Embedding Network for Vehicle Re-Identification
Meng, D., Li, L., Liu, X., Li, Y., Yang, S., Zha, Z.-J., Gao, X., Wang, S., & Huang, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00713 · Cited by 229
Jia, M., Cheng, X., Lu, S., & Zhang, J. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3141267 · Cited by 212
Learning a Mixture of Granularity-Specific Experts for Fine-Grained Categorization
Zhang, L., Huang, S., Liu, W., & Tao, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00842 · Cited by 205
Filtration and Distillation: Enhancing Region Attention for Fine-Grained Visual Categorization
Liu, C., Xie, H., Zha, Z.-J., Ma, L., Yu, L., & Zhang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6822 · Cited by 196
AAformer: Auto-Aligned Transformer for Person Re-Identification
Zhu, K., Guo, H., Zhang, S., Wang, Y., Liu, J., Wang, J., & Tang, M. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3301856 · Cited by 193
Self-citationVehicleNet: Learning Robust Visual Representation for Vehicle Re-Identification
Zheng, Z., Ruan, T., Wei, Y., Yang, Y., & Mei, T. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3014488 · Cited by 192
Channel Interaction Networks for Fine-Grained Image Categorization
Gao, Y., Han, X., Wang, X., Huang, W., & Scott, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6712 · Cited by 188
Combined Depth Space based Architecture Search For Person Re-identification
Li, H., Wu, G., & Zheng, W.-S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00666 · Cited by 168
RAMS-Trans: Recurrent Attention Multi-scale Transformer for Fine-grained Image Recognition
Hu, Y., Jin, X. H., Zhang⋆, Y., Hong, H., Zhang, J., He, Y., & Xue, H. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475561 · Cited by 160
Semantics-Aligned Representation Learning for Person Re-Identification
Jin, X., Lan, C., Zeng, W., Wei, G., & Chen, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6775 · Cited by 143
Luo, H., Jiang, W., Fan, X., & Zhang, C. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2965491 · Cited by 133
Beyond the Parts: Learning Multi-view Cross-part Correlation for Vehicle Re-identification
Liu, X., Liu, W., Zheng, J., Yan, C. C., & Mei, T. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413578 · Cited by 107
Feature Fusion Vision Transformer for Fine-Grained Visual Categorization
Wang, J., Yu, X., & Gao, Y. (2021) · Warwick Research Archive Portal (University of Warwick) · doi:10.48550/arxiv.2107.02341 · Cited by 106
Orientation-Aware Vehicle Re-Identification with Semantics-Guided Part Attention Network
Chen, T.-S., Liu, C., Wu, C.-W., & Chien, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_20 · Cited by 102
Look-Into-Object: Self-Supervised Structure Modeling for Object Recognition
Zhou, M., Bai, Y., Zhang, W., Zhao, T., & Mei, T. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01179 · Cited by 94
Huang, S., Wang, X., & Tao, D. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00066 · Cited by 74
Deep Coattention-Based Comparator for Relative Representation Learning in Person Re-Identification
Wu, L. Y., Wang, Y., Gao, J., et al. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979190 · Cited by 73
Cited by
CrossFuse: A novel cross attention mechanism based infrared and visible image fusion approach
Li, H., & Wu, X.-J. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102147 · Cited by 460
CLIP-Driven Fine-Grained Text-Image Person Re-Identification
Yan, S., Dong, N., Zhang, L., & Tang, J. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3327924 · Cited by 330
CLIP-ReID: Exploiting Vision-Language Model for Image Re-identification without Concrete Text Labels
Li, S., Sun, L., & Li, Q. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i1.25225 · Cited by 310
Metadata
- Authors
- Zhu, H., Ke, W., Li, D., Liu, J., Tian, L., & Shan, Y.
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 4682-4692
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4312361652
- Cited by
- 277
- References
- 66
- FWCI
- 22.98
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.