The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Models
Open accessAbstract
We extend the task of composed image retrieval, where an input query consists of an image and short textual description of how to modify the image. Existing methods have only been applied to non-complex images within narrow domains, such as fashion products, thereby limiting the scope of study on in-depth visual reasoning in rich image and language contexts. To address this issue, we collect the Compose Image Retrieval on Real-life images (CIRR) dataset, which consists of over 36,000 pairs of crowd-sourced, open-domain images with human-generated modifying text. To extend current methods to the open-domain, we propose CIRPLANT, a transformer based model that leverages rich pre-trained vision-and-language (V&L) knowledge for modifying visual features conditioned on natural language. Retrieval is then done by nearest neighbor lookup on the modified features. We demonstrate that with a relatively simple architecture, CIRPLANT outperforms existing methods on open-domain images, while matching state-of-the-art accuracy on the existing narrow datasets, such as fashion. Together with the release of CIRR, we believe this work will inspire further research on composed image retrieval. Our dataset, code and pre-trained models are available at https://cuberick-orion.github.io/CIRR/.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We note that the simple prediction-based late fusion [247], [248] is less adopted in MML Transformers.”
From Multimodal learning with transformers: A survey (2023) · cites this paper as [247]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Cited by
Sorted by citations
Multimodal learning with transformers: A survey
Xu, P., Zhu, X., & Clifton, D. A. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3275156 · Cited by 1,072
ZegCLIP: Towards Adapting CLIP for Zero-shot Semantic Segmentation
Zhou, Z., Lei, Y., Zhang, B., Liu, L., & Liu, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01075 · Cited by 270
Effective conditioned and composed image retrieval combining CLIP-based features
Baldrati, A., Bertini, M., Uricchio, T., & Bimbo, A. D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.02080 · Cited by 188
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI
Yao, J., Zhang, S., Yao, Y., Wang, F., Ma, J., Zhang, J., Chu, Y., Ji, L., Jia, K., Shen, T., et al. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3178211 · Cited by 161
Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrieval
Saito, K., Sohn, K., Zhang, X., Li, C.-L., Lee, C.-Y., Saenko, K., & Pfister, T. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01850 · Cited by 145
Zero-Shot Composed Image Retrieval with Textual Inversion
Baldrati, A., Agnolucci, L., Bertini, M., & Bimbo, A. D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01407 · Cited by 176
Conditioned and composed image retrieval combining and partially fine-tuning CLIP-based features
Baldrati, A., Bertini, M., Uricchio, T., & Bimbo, A. D. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00543 · Cited by 104
FashionVLP: Vision Language Transformer for Fashion Retrieval with Feedback
Goenka, S., Zheng, Z., Jaiswal, A., Chada, R., Wu, Y., Hedau, V., & Natarajan, P. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01371 · Cited by 109
Language-only Efficient Training of Zero-shot Composed Image Retrieval
Gu, G., Chun, S., Kim, W., Kang, Y., & Yun, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01256 · Cited by 85
Multi-Modal Transformer With Global-Local Alignment for Composed Query Image Retrieval
Xu, Y., Bin, Y., Wei, J., Yang, Y., Wang, G., & Shen, H. T. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3235495 · Cited by 64
Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Features
Baldrati, A., Bertini, M., Uricchio, T., & Bimbo, A. D. (2023) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3617597 · Cited by 69
Target-Guided Composed Image Retrieval
Wen, H., Zhang, X., Song, X., Wei, Y., & Nie, L. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611817 · Cited by 64
Bi-directional Training for Composed Image Retrieval via Text Prompt Learning
Liu, Z., Sun, W., Hong, Y., Teney, D., & Gould, S. J. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00565 · Cited by 57
Self-citationLDRE: LLM-based Divergent Reasoning and Ensemble for Zero-Shot Composed Image Retrieval
Yang, Z., Xue, D., Qian, S., Dong, W., & Xu, C. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657740 · Cited by 71
FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Tasks
Xiao, H., Zhu, X., Yu, L., Zhang, L., Song, Y.-Z., & Xiang, T. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00262 · Cited by 58
CoVR: Learning Composed Video Retrieval from Web Video Captions
Ventura, L., Yang, A., Schmid, C., & Varol, G. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28334 · Cited by 62
FashionViL: Fashion-Focused Vision-and-Language Representation Learning
Xiao, H. M., Yu, L., Zhu, X., Zhang, L., Song, Y.-Z., & Xiang, T. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19833-5_37 · Cited by 47
Data Roaming and Quality Assessment for Composed Image Retrieval
Levy, M., Ben‐Ari, R., Darshan, N., & Lischinski, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i4.28081 · Cited by 61
PoseFix: Correcting 3D Human Poses with Natural Language
Delmas, G., Weinzaepfel, P., Moreno-Noguer, F., & Rogez, G. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01379 · Cited by 40
Knowledge-Enhanced Dual-Stream Zero-Shot Composed Image Retrieval
Suo, Y., Ma, F., Zhu, L., & Yang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02545 · Cited by 45
Composed Image Retrieval via Cross Relation Network With Hierarchical Aggregation Transformer
Yang, Q., Ye, M., Cai, Z., Su, K., & Du, B. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3299791 · Cited by 34
Yu, C., & Shin, Y. (2024) · Remote Sensing · doi:10.3390/rs16173169 · Cited by 33
Caption-Aware Medical VQA via Semantic Focusing and Progressive Cross-Modality Comprehension
Cong, F., Xu, S., Guo, L., & Tian, Y. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548122 · Cited by 33
Simple but Effective Raw-Data Level Multimodal Fusion for Composed Image Retrieval
Wen, H., Song, X., Chen, X., Wei, Y., Nie, L., & Chua, T. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657727 · Cited by 39
Fine-grained Textual Inversion Network for Zero-Shot Composed Image Retrieval
Lin, H., Wen, H., Song, X., Liu, M., Hu, Y., & Nie, L. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657831 · Cited by 40
Multi-Grained Attention Network With Mutual Exclusion for Composed Query-Based Image Retrieval
Li, S., Xu, X., Jiang, X., Shen, F., Liu, X., & Shen, H. T. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3306738 · Cited by 32
GeneCIS: A Benchmark for General Conditional Image Similarity
Vaze, S., Carion, N., & Misra, I. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00663 · Cited by 35
Self-Training Boosted Multi-Factor Matching Network for Composed Image Retrieval
Wen, H., Song, X., Yin, J., Wu, J., Guan, W., & Nie, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3346434 · Cited by 34
Universal Adversarial Perturbations for Vision-Language Pre-trained Models
Zhang, P.-F., Huang, Z. H., & Bai, G. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657781 · Cited by 30
A Cross-View Geo-Localization Algorithm Using UAV Image and Satellite Image
Fan, J., Zheng, E., He, Y., & Yang, J. (2024) · Sensors · doi:10.3390/s24123719 · Cited by 37
Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt
Ying, Z., Liu, A., Zhang, T., Yu, Z., Liang, S., Liu, X., & Tao, D. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3583249 · Cited by 107
UniIR: Training and Benchmarking Universal Multimodal Information Retrievers
Wei, C., Chen, Y., Chen, H., Hu, H., Zhang, G., Fu, J., Ritter, A., & Chen, W. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73021-4_23 · Cited by 95
Attribute-Guided Pedestrian Retrieval: Bridging Person Re-ID with Internal Attribute Variability
Huang, Y., Zhang, Z., Wu, Q., Zhong, Y., & Wang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01675 · Cited by 27
Decomposing Semantic Shifts for Composed Image Retrieval
Xing-yu, Y., Liu, D., Zhang, H., Luo, Y. H., Wang, C., & Zhang, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28479 · Cited by 30
ZEETAD: Adapting Pretrained Vision-Language Model for Zero-Shot End-to-End Temporal Action Detection
Phan, T., Vo-Ho, V.-K., Le, D., Doretto, G., Adjeroh, D., & Le, N. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00689 · Cited by 25
Spherical Linear Interpolation and Text-Anchoring for Zero-Shot Composed Image Retrieval
Jang, Y. K., Huynh, D., Shah, A. K., Chen, W., & Lim, S.-N. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72655-2_14 · Cited by 42
LamRA: Large Multimodal Model as Your Advanced Retrieval Assistant
Liu, Y., Zhang, Y., Cai, J., Jiang, X., Hu, Y. G., Yao, J., Wang, Y., & Xie, W. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00380 · Cited by 54
Comprehensive Relationship Reasoning for Composed Query Based Image Retrieval
Zhang, F., Yan, M., Zhang, J., & Xu, C. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548126 · Cited by 21
Dynamic Weighted Combiner for Mixed-Modal Image Retrieval
Huang, F., Zhang, L., Fu, X., & Song, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i3.28004 · Cited by 21
A Comprehensive Survey on Composed Image Retrieval
Song, X., Lin, H., Wen, H., Hou, B., Xu, M., & Nie, L. (2025) · ACM Transactions on Information Systems · doi:10.1145/3767328 · Cited by 39
FashionSAP: Symbols and Attributes Prompt for Fine-Grained Fashion Vision-Language Pre-Training
Han, Y., Zhang, L., Chen, Q., Chen, Z., Li, Z., Yang, J., & Cao, Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01443 · Cited by 22
Spectral Prompt Tuning: Unveiling Unseen Classes for Zero-Shot Semantic Segmentation
Xu, W., Xu, R., Wang, C., Xu, S., Guo, L., Zhang, M., & Zhang, X. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i6.28456 · Cited by 20
MEDIAN: Adaptive Intermediate-grained Aggregation Network for Composed Image Retrieval
Huang, Q., Chen, Z., Li, Z., Wang, C., Song, X., Hu, Y., & Nie, L. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890642 · Cited by 18
Bridging Modalities: Improving Universal Multimodal Retrieval by Multimodal Large Language Models
Zhang, X., Zhang, Y., Xie, W., Li, M., Dai, Z., Long, D., Xie, P., Zhang, M., Li, W., & Zhang, M. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00866 · Cited by 225
Li, S., Xu, X., Jiang, X., Shen, F., Sun, Z., & Cichocki, A. S. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3639469 · Cited by 18
Align and Retrieve: Composition and Decomposition Learning in Image Retrieval With Text Feedback
Xu, Y., Bin, Y., Wei, J., Yang, Y., Wang, G., & Shen, H. T. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3417694 · Cited by 20
From text to mask: Localizing entities using the attention of text-to-image diffusion models
Xiao, C., Yang, Q., Zhou, F., & Zhang, C. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128437 · Cited by 25
CoVR-2: Automatic Data Construction for Composed Video Retrieval
Ventura, L., Yang, A., Schmid, C., & Varol, G. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3463799 · Cited by 31
SafeBench: A Safety Evaluation Framework for Multimodal Large Language Models
Ying, Z., Liu, A., Liang, S., Huang, L., Guo, J., Zhou, W., Liu, X., & Tao, D. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-025-02613-1 · Cited by 91
Composed Video Retrieval via Enriched Context and Discriminative Embeddings
Thawakar, O., Naseer, M., Anwer, R. M., Khan, S., Felsberg, M., Shah, M., & Khan, F. S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02540 · Cited by 20
Semantic Editing Increment Benefits Zero-Shot Composed Image Retrieval
Yang, Z., Qian, S., Xue, D., Wu, J., Yang, F., Dong, W., & Xu, C. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681649 · Cited by 20
PAIR: Complementarity-guided Disentanglement for Composed Image Retrieval
Fu, Z., Li, Z., Chen, Z., Wang, C., Song, X., Hu, Y., & Nie, L. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888153 · Cited by 16
Tang, Y., Zhang, J., Qin, X., Yu, J., Gou, G., GangXiong, G., Lin, Q., Rajmohan, S., Zhang, D., & Wu, Q. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01343 · Cited by 18
Fashion-GPT: Integrating LLMs with Fashion Retrieval System
Chen, Q., Zhang, T., Nie, M., Wang, Z., Xu, S., Shi, W., & Cao, Z. (2023) · doi:10.1145/3607827.3616844 · Cited by 16
Multimodal Composition Example Mining for Composed Query Image Retrieval
Zhang, G., Li, S., Wei, S., Ge, S., Cai, N., & Zhao, Y. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3359062 · Cited by 17
Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negatives
Feng, Z., Zhang, R., & Nie, Z. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680808 · Cited by 22
SPIRIT: Style-guided Patch Interaction for Fashion Image Retrieval with Text Feedback
Chen, Y., Zhou, J., & Peng, Y. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3640345 · Cited by 15
FontCLIP: A Semantic Typography Visual‐Language Model for Multilingual Font Applications
Tatsukawa, Y., Shen, I., Qi, A., Koyama, Y., Igarashi, T., & Shamir, A. (2024) · Computer Graphics Forum · doi:10.1111/cgf.15043 · Cited by 15
Visual Delta Generator with Large Multi-Modal Models for Semi-Supervised Composed Image Retrieval
Jang, Y. K., Kim, D., Meng, Z., Huynh, D., & Lim, S.-N. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01590 · Cited by 19
CaLa: Complementary Association Learning for Augmenting Comoposed Image Retrieval
Jiang, X., Wang, Y., Li, M., Wu, Y., Hu, B., & Qian, X. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657823 · Cited by 20
FashionERN: Enhance-and-Refine Network for Composed Fashion Image Retrieval
Chen, Y., Zhong, H., He, X., Peng, Y., Zhou, J., & Cheng, L. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i2.27885 · Cited by 13
SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining
Song, C. H., Hwang, T., Yoon, J., Choi, S., & Gu, Y. H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01323 · Cited by 14
iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval
Agnolucci, L., Baldrati, A., Bimbo, A. D., & Bertini, M. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3593539 · Cited by 41
FaD-VLP: Fashion Vision-and-Language Pre-training towards Unified Retrieval and Captioning
Mirchandani, S., Yu, L., Wang, M., Sinha, A., Jiang, W., Xiang, T., & Zhang, N. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.716 · Cited by 13
Unsupervised deep hashing with multiple similarity preservation for cross-modal image-text retrieval
Xiong, S., Pan, L., Ma, X., Hu, Q., & Beckman, E. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02154-y · Cited by 12
EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrieval
Hummel, T., Karthik, S., Georgescu, M.-I., & Akata, Z. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72913-3_1 · Cited by 18
Zhang, G., Wei, S., Pang, H., Qiu, S., & Zhao, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3273466 · Cited by 14
Efficient and Secure Content-Based Image Retrieval in Cloud-Assisted Internet of Things
Chen, L., Yang, Y., Yang, L., Xu, C., Miao, Y., Liu, Z., Liu, X., Choo, K. R., Liang, Z., & Hong, C. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3489957 · Cited by 11
Self-citationOFFSET: Segmentation-based Focus Shift Revision for Composed Image Retrieval
Chen, Z., Hu, Y., Li, Z., Fu, Z., Song, X., & Nie, L. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755366 · Cited by 11
Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles
Ye, S., Xie, Y., Chen, D., Yi‐chong, X., Yuan, L., Zhu, C., & Liao, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00259 · Cited by 16
The ECOLANG Multimodal Corpus of adult-child and adult-adult Language
Gu, Y., Donnellan, E., Grzyb, B. J., Brekelmans, G., Murgiano, M., Brieke, R., Perniss, P., & Vigliocco, G. (2025) · Scientific Data · doi:10.1038/s41597-025-04405-1 · Cited by 11
Generative Zero-Shot Composed Image Retrieval
Wang, L., Ao, W., Boddeti, V. N., & Lim, S.-N. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02764 · Cited by 14
TagCLIP: Improving Discrimination Ability of Zero-Shot Semantic Segmentation
Li, J., Chen, P., Qian, S., Liu, S., & Jia, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3454647 · Cited by 21
PhotoScout: Synthesis-Powered Multi-Modal Image Search
Barnaby, C., Chen, Q., Wang, C., & Dillig, I. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642319 · Cited by 12
Set of Diverse Queries With Uncertainty Regularization for Composed Image Retrieval
Xu, Y., Wei, J., Bin, Y., Yang, Y., Ma, Z., & Shen, H. T. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3401006 · Cited by 10
Attribute-Driven Multimodal Hierarchical Prompts for Image Aesthetic Quality Assessment
Zhu, H., Shi, J., Shao, Z., Yao, R., Zhou, Y. Z., Zhao, J., & Li, L. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681175 · Cited by 9
A survey of multimodal composite editing and retrieval
Li, S., Huang, F., & Zhang, L. (2025) · Visual Intelligence · doi:10.1007/s44267-025-00086-x · Cited by 16
Cheng, Z., Ma, Y., Lang, J., Zhang, K., Zhong, T., Wang, Y. J., & Zhou, F. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3736982 · Cited by 9
Training-Free Zero-Shot Composed Image Retrieval via Weighted Modality Fusion and Similarity
Wu, R.-D., Lin, Y.-Y., & Yang, H. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-4589-3_6 · Cited by 12
Learning-To-Rank Approach for Identifying Everyday Objects Using a Physical-World Search Engine
Kaneda, K., Nagashima, S., Korekata, R., Kambara, M., & Sugiura, K. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3352363 · Cited by 9
Visual-Linguistic Alignment and Composition for Image Retrieval with Text Feedback
Li, D., & Zhu, Y. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00027 · Cited by 7
Image Retrieval with Composed Query by Multi-Scale Multi-Modal Fusion
Sun, Z., Yang, G., Lu, Z., Jiang, H., Zhu, G., & Cao, Z. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446291 · Cited by 8
UIGR: Unified Interactive Garment Retrieval
Xiao, H. M., He, S., Zhang, L., Song, Y.-Z., & Xiang, T. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00241 · Cited by 7
Detours for Navigating Instructional Videos
Ashutosh, K., Xue, Z., Nagarajan, T., & Grauman, K. L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01779 · Cited by 7
Liu, J. X., Shah, A., Konidaris, G., Tellex, S., & Paulius, D. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802696 · Cited by 9
A Survey on Composed Image Retrieval
Du, L., Deng, S., Li, Y., Li, J., & Tian, Q. C. (2025) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3723879 · Cited by 8
Small object detection in remote sensing images through multi-scale feature fusion
Li, S., Lin, J., Gang, Y., & Pan, X. (2025) · The Computer Journal · doi:10.1093/comjnl/bxaf040 · Cited by 6
CoLLM: A Large Language Model for Composed Image Retrieval
Huynh, C., Yang, J., Tawari, A., Shah, M., Tran, S., Hamid, R., Chilimbi, T. M., & Shrivastava, A. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00378 · Cited by 12
CoTMR: Chain-of-Thought Multi-Scale Reasoning for Training-Free Zero-Shot Composed Image Retrieval
Sun, Z., Dong, J., & Lu, Z. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02105 · Cited by 6
Negative-Sensitive Framework With Semantic Enhancement for Composed Image Retrieval
Wang, Y., Liu, L., Yuan, C., Li, M., & Liu, J. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3369898 · Cited by 7
Composed image retrieval: a survey on recent research and development
Wan, Y., Zou, G., & Zhang, B. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06372-x · Cited by 7
SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentation
Huang, S., He, S., Qin, H., & Wen, B. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01167 · Cited by 5
FashionNTM: Multi-turn Fashion Image Retrieval via Cascaded Memory
Pal, A., Wadhwa, S., Jaiswal, A., Zhang, X., Wu, Y., Chada, R., Natarajan, P., & Christensen, H. I. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01040 · Cited by 7
Jeong, S., Park, J., Choi, M.-G., Kwon, Y., & Lim, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127926 · Cited by 6
Similarity Retrieval Based on Image Background Analysis
Zhu, C., Jiang, W., Zhou, W., & Xiao, H. Y. (2022) · International Journal of Software Science and Computational Intelligence · doi:10.4018/ijssci.309426 · Cited by 5
Zhang, H., Yanagi, R., Togo, R., Ogawa, T., & Haseyama, M. (2024) · Proceedings - International Conference on Image Processing · doi:10.1109/icip51287.2024.10648023 · Cited by 5
Li, Z., Zhang, L., Zhang, K., Chen, W., Zhang, Y., & Mao, Z. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3730074 · Cited by 13
Survey of Semantic-Based Image-to-Image Retrieval
Cao, D., Zhou, H., & Yang, H. (2024) · International Conference on Artificial Intelligence and Computer Engineering (ICAICE) · doi:10.1109/icaice63571.2024.10863997 · Cited by 4
FiRE: Enhancing MLLMs with Fine-Grained Context Learning for Complex Image Retrieval
Hou, B., Lin, H., Song, X., Wen, H., Liu, M., Hu, Y., & Zhao, X. (2025) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3726302.3729979 · Cited by 7
ConText-CIR: Learning from Concepts in Text for Composed Image Retrieval
Xing, E. P., Kolouju, P., Pless, R. B., Stylianou, A., & Jacobs, N. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01829 · Cited by 6
Metadata
- Authors
- Liu, Z., Rodriguez-Opazo, C., Teney, D., & Gould, S.
- Affiliations
- Australian National University (AU)
- University of Adelaide,Australian Institute for Machine Learning
- The University of Adelaide (AU)
- Venue
- 2021 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2021-10
- Pages
- 2105-2114
- OpenAlex
- W3203247393
- Cited by
- 238
- References
- 43
- Citations by year
- 2026: 47 · 2025: 91 · 2024: 55 · 2023: 28 · 2022: 16 · 2021: 1
- FWCI
- 8.18
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Keywords
- composed image retrieval, image modification, vision-language models, pre-trained language models, visual reasoning, nearest neighbor search
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
