The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
CLIP-ReID: Exploiting Vision-Language Model for Image Re-identification without Concrete Text Labels
Open accessAbstract
Pre-trained vision-language models like CLIP have recently shown superior performances on various downstream tasks, including image classification and segmentation. However, in fine-grained image re-identification (ReID), the labels are indexes, lacking concrete text descriptions. Therefore, it remains to be determined how such models could be applied to these tasks. This paper first finds out that simply fine-tuning the visual model initialized by the image encoder in CLIP, has already obtained competitive performances in various ReID tasks. Then we propose a two-stage strategy to facilitate a better visual representation. The key idea is to fully exploit the cross-modal description ability in CLIP through a set of learnable text tokens for each ID and give them to the text encoder to form ambiguous descriptions. In the first training stage, image and text encoders from CLIP keep fixed, and only the text tokens are optimized from scratch by the contrastive loss computed within a batch. In the second stage, the ID-specific text tokens and their encoder become static, providing constraints for fine-tuning the image encoder. With the help of the designed loss in the downstream task, the image encoder is able to represent data as vectors in the feature embedding accurately. The effectiveness of the proposed strategy is validated on several datasets for the person or vehicle ReID tasks. Code is available at https://github.com/Syliz517/CLIP-ReID.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 47,472
(2008) · Journal of Machine Learning Research · Cited by 33,051
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Scalable Person Re-identification: A Benchmark
Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., & Tian, Q. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.133 · Cited by 4,506
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7000 · Cited by 3,617
Self-citationRandom Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2017) · arXiv · doi:10.48550/arxiv.1708.04896 · Cited by 3,617
Self-citationLearning to Prompt for Vision-Language Models
Zhou, K., Yang, J., Loy, C. C., & Liu, Z. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01653-1 · Cited by 3,304
Performance Measures and a Data Set for Multi-target, Multi-camera Tracking
Ristani, E., Solera, F., Zou, R., Cucchiara, R., & Tomasi, C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-48881-3_2 · Cited by 2,914
In Defense of the Triplet Loss for Person Re-Identification
Hermans, A., Beyer, L., & Leibe, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07737 · Cited by 2,687
Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)
Sun, Y., Zheng, L., Yang, Y., Tian, Q., & Wang, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_30 · Cited by 2,522
Person Transfer GAN to Bridge Domain Gap for Person Re-identification
Wei, L., Zhang, S., Gao, W., & Tian, Q. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00016 · Cited by 2,118
Person re-identification by Local Maximal Occurrence representation and metric learning
Liao, S., Hu, Y., Zhu, X., & Li, S. Z. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298832 · Cited by 2,091
Self-citationScaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision
Jia, C., Yang, Y., Xia, Y., Chen, Y.-T., Parekh, Z., Pham, H., Le, Q. V., Sung, Y., Li, Z., & Duerig, T. (2021) · arXiv · doi:10.48550/arxiv.2102.05918 · Cited by 1,977
Conditional Prompt Learning for Vision-Language Models
Zhou, K., Yang, J., Loy, C. C., & Liu, Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01631 · Cited by 1,796
Li, J., Li, D., Xiong, C., & Hoi, S. (2022) · arXiv · doi:10.48550/arxiv.2201.12086 · Cited by 1,741
Large scale metric learning from equivalence constraints
Kostinger, M., Hirzer, M., Wohlhart, P., Roth, P. M., & Bischof, H. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247939 · Cited by 1,606
Bag of Tricks and a Strong Baseline for Deep Person Re-Identification
Luo, H., Gu, Y., Liao, X., Lai, S., & Jiang, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00190 · Cited by 1,584
TransReID: Transformer-based Object Re-Identification
He, S., Luo, H., Wang, P., Wang, F., Li, H., & Jiang, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01474 · Cited by 1,244
CLIP-Adapter: Better Vision-Language Models with Feature Adapters
Gao, P., Geng, S., Zhang, R., Ma, T., Fang, R., Zhang, Y., Li, H., & Qiao, Y. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-023-01891-x · Cited by 1,197
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation
Li, J., Selvaraju, R. R., Gotmare, A. D., Joty, S., Xiong, C., & Hoi, S. (2021) · arXiv · doi:10.48550/arxiv.2107.07651 · Cited by 1,078
Omni-Scale Feature Learning for Person Re-Identification
Zhou, K., Yang, Y., Cavallaro, A., & Xiang, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00380 · Cited by 1,005
Neural Machine Translation of Rare Words with Subword Units
Sennrich, R., Haddow, B., & Birch, A. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1162 · Cited by 974
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision
Kim, W., Son, B., & Kim, I. (2021) · arXiv · doi:10.48550/arxiv.2102.03334 · Cited by 951
Neural Machine Translation of Rare Words with Subword Units
Sennrich, R., Haddow, B., & Birch, A. (2015) · arXiv · doi:10.48550/arxiv.1508.07909 · Cited by 950
Deep Metric Learning for Person Re-identification
Yi, D., Lei, Z., Liao, S., & Li, S. Z. (2014) · 2014 22nd International Conference on Pattern Recognition · doi:10.1109/icpr.2014.16 · Cited by 931
Self-citationTransformer Interpretability Beyond Attention Visualization
Chefer, H., Gur, S., & Wolf, L. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00084 · Cited by 903
Deep Relative Distance Learning: Tell the Difference between Similar Vehicles
Liu, H., Tian, Y., Wang, Y., Pang, L., & Huang, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.238 · Cited by 782
Relation-Aware Global Attention for Person Re-Identification
Zhang, Z., Lan, C., Zeng, W., Jin, X., & Chen, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00325 · Cited by 652
Pose-Guided Feature Alignment for Occluded Person Re-Identification
Miao, J., Wu, Y., Liu, P., Ding, Y., & Yang, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00063 · Cited by 638
DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting
Rao, Y., Zhao, W., Chen, G., Tang, Y., Zhu, Z., Huang, G., Zhou, J., & Lu, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01755 · Cited by 631
Hierarchical Gaussian Descriptor for Person Re-identification
Matsukawa, T., Okabe, T., Suzuki, E., & Sato, Y. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.152 · Cited by 564
ABD-Net: Attentive but Diverse Person Re-Identification
Chen, T., Ding, S., Xie, J., Yuan, Y., Chen, W., Yang, Y., Ren, Z., & Wang, Z. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00844 · Cited by 561
Large-scale vehicle re-identification in urban surveillance videos
Liu, X., Liu, W., Ma, H., & Fu, H. (2016) · 2016 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2016.7553002 · Cited by 513
High-Order Information Matters: Learning Relation and Topology for Occluded Person Re-Identification
Wang, G., Yang, S., Liu, H., Wang, Z., Yang, Y., Wang, S., Yu, G., Zhou, E., & Sun, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00648 · Cited by 512
Diverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformer
Li, Y., He, J., Zhang, T., Liu, X., Zhang, Y., & Wu, F. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00292 · Cited by 419
Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identification
Rao, Y., Chen, G., Lu, J., & Zhou, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00106 · Cited by 380
Identity-Guided Human Semantic Parsing for Person Re-identification
Zhu, K., Guo, H., Liu, Z., Tang, M., & Wang, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58580-8_21 · Cited by 329
SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
Wang, Z., Yu, J., Yu, A. W., Dai, Z., Tsvetkov, Y., & Cao, Y. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.10904 · Cited by 327
Part-Regularized Near-Duplicate Vehicle Re-Identification
He, B., Li, J., Zhao, Y., & Tian, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00412 · Cited by 310
Auto-ReID: Searching for a Part-Aware ConvNet for Person Re-Identification
Quan, R., Dong, X., Wu, Y., Zhu, L., & Yang, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00385 · Cited by 285
Dual Cross-Attention Learning for Fine-Grained Visual Categorization and Object Re-Identification
Zhu, H., Ke, W., Li, D., Liu, J., Tian, L., & Shan, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00465 · Cited by 277
Open-vocabulary Object Detection via Vision and Language Knowledge Distillation
Gu, X., Lin, T.-Y., Kuo, W., & Cui, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.13921 · Cited by 273
Batch DropBlock Network for Person Re-Identification and Beyond
Dai, Z., Chen, M., Gu, X., Zhu, S., & Tan, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00379 · Cited by 256
Beyond Triplet Loss: Person Re-Identification With Fine-Grained Difference-Aware Pairwise Loss
Yan, C., Pang, G., Bai, X., Liu, C., Ning, X., Gu, L., & Zhou, J. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3069562 · Cited by 230
Jia, M., Cheng, X., Lu, S., & Zhang, J. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3141267 · Cited by 212
AAformer: Auto-Aligned Transformer for Person Re-Identification
Zhu, K., Guo, H., Zhang, S., Wang, Y., Liu, J., Wang, J., & Tang, M. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3301856 · Cited by 193
Consistent Re-identification in a Camera Network
Das, A., Chakraborty, A., & Roy-Chowdhury, A. K. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_22 · Cited by 172
Semantics-Aligned Representation Learning for Person Re-Identification
Jin, X., Lan, C., Zeng, W., Wei, G., & Chen, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6775 · Cited by 172
Effective conditioned and composed image retrieval combining CLIP-based features
Baldrati, A., Bertini, M., Uricchio, T., & Del Bimbo, A. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.02080 · Cited by 164
The Devil Is in the Details: Self-supervised Attention for Vehicle Re-identification
Khorramshahi, P., Peri, N., Chen, J.-C., & Chellappa, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58568-6_22 · Cited by 158
Uncertainty-Aware Multi-Shot Knowledge Distillation for Image-Based Object Re-Identification
Jin, X., Lan, C., Zeng, W., & Chen, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6774 · Cited by 136
Orientation-Aware Vehicle Re-Identification with Semantics-Guided Part Attention Network
Chen, T.-S., Liu, C., Wu, C.-W., & Chien, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_20 · Cited by 121
Stripe-based and attribute-aware network: a two-branch deep model for vehicle re-identification
Qian, J., Jiang, W., Luo, H., & Yu, H. (2020) · Measurement Science and Technology · doi:10.1088/1361-6501/ab8b81 · Cited by 120
Omni-Scale Feature Learning for Person Re-IdentificationPreprint
Zhou, K., Yang, Y., Cavallaro, A., & Xiang, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.00953 · Cited by 113
Incomplete Descriptor Mining With Elastic Loss for Person Re-Identification
Tan, H., Liu, X., Bian, Y., Wang, H., & Yin, B. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3061412 · Cited by 108
EI-CLIP: Entity-aware Interventional Contrastive Learning for E-commerce Cross-modal Retrieval
Ma, H., Zhao, H., Lin, Z., Kale, A., Wang, Z., Yu, T., Gu, J., Choudhary, S., & Xie, X. S. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01752 · Cited by 101
TransReID: Transformer-based Object Re-IdentificationPreprint
He, S., Luo, H., Wang, P., Wang, F., Li, H., & Jiang, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04378 · Cited by 82
Wang, P., Zhao, Z., Su, F., & Meng, H. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3179902 · Cited by 44
DenseCLIP: Extract Free Dense Labels from CLIPPreprint
Zhou, C., Loy, C. C., & Dai, B. (2021) · arXiv (Cornell University) · Cited by 21
Parsing-based View-aware Embedding Network for Vehicle Re-IdentificationPreprint
Meng, D., Li, L., Liu, X., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.05021 · Cited by 10
Seeing Crucial Parts: Vehicle Model Verification via a Discriminative Representation Model
Liang, L., Lang, C., Li, Z., Zhao, J., Wang, T., & Feng, S. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3474596 · Cited by 9
Progressive Multi-Stage Feature Mix for Person Re-Identification
Zhang, Y., He, B., Li, S., & Li, Q. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413533 · Cited by 3
Self-citationProgressive Multi-stage Feature Mix for Person Re-IdentificationPreprint
Zhang, Y., He, B., & Li, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08779 · Cited by 1
Self-citation
Cited by
MARs: Multi-view Attention Regularizations for Patch-based Feature Recognition of Space Terrain
Chase, T., & Dantu, K. (2024) · arXiv · doi:10.48550/arxiv.2410.05182 · Cited by 5
Metadata
- Authors
- Li, S., Sun, L., & Li, Q.
- Venue
- Proceedings of the AAAI Conference on Artificial Intelligence
- Published
- 2023-06-26
- Volume
- 37
- Issue
- 1
- Pages
- 1405-1413
- ISSN
- 2159-5399 (ISSN-L)
- 2374-3468
- OpenAlex
- W4382460786
- Cited by
- 310
- References
- 64
- FWCI
- 35.25
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.