Image retrieval using scene graphs
The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
This paper develops a novel framework for semantic image retrieval based on the notion of a scene graph. Our scene graphs represent objects (“man”, “boat”), attributes of objects (“boat is white”) and relationships between objects (“man standing on boat”). We use these scene graphs as queries to retrieve semantically related images. To this end, we design a conditional random field model that reasons about possible groundings of scene graphs to test images. The likelihoods of these groundings are used as ranking scores for retrieval. We introduce a novel dataset of 5,000 human-generated scene graphs grounded to images and use this dataset to evaluate our method for image retrieval. In particular, we evaluate retrieval using full scene graphs and small scene subgraphs, and show that our method outperforms retrieval methods that use only objects or low-level image features. In addition, we show that our full model can be used to improve object localization compared to baseline methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Self-citationDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Self-citationRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“Datasets have been a driving force of computer vision algorithms, ranging from classi-fication [64] to object recognition and segmentation [18, 12, 55, 15].”
MethodAre we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 1×
“Their sys-tem is constrained to the six object classes from KITTI [23] while our system uses an open-world vocabulary; our scene graphs also tend to be more complex than their semantic graphs.”
MethodConditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Research works printed but not linked: 5
- jurafsky, 2000, Speech & language processing
- lampert, 2013, Attribute-based classification for zero-shot learning of object categories, PAMI
- yao, 2011, Classifying actions and measuring action similarity by modeling the mutual context of objects and human poses, a) A 1(D2) D3
- 0, OpenSceneGraph
- 10.1145/1964921.1964929 · DOI · Paper page
Cited by
Items 401–500 of 1,001
Neural Trees for Learning on GraphsPreprint
Talak, R., Hu, S., Peng, L., & Carlone, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.07264 · Cited by 28
Zhou, H., Luo, T., Zhang, J., & Liu, L. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3559995 · Cited by 27
Yang, D., Kim, M., Kim, S., Kwak, B.-W., Park, M., Hong, J., Woo, W., & Yeo, J. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.1036 · Cited by 27
PatronuS: A System for Privacy-Preserving Cloud Video Surveillance
Du, H., Chen, L., Qian, J., Hou, J., Jung, T., & Li, X. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.2986665 · Cited by 27
Learning to transfer focus of graph neural network for scene graph parsing
Jiang, J., He, Z., Zhang, S., Zhao, X., & Tan, J. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107707 · Cited by 27
Adaptively Clustering-Driven Learning for Visual Relationship Detection
Liu, A.-A., Wang, Y., Xu, N., Nie, W., Nie, J., & Zhang, Y. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3043084 · Cited by 27
Two-stage content based image retrieval using sparse representation and feature fusion
Wang, W., Jiao, P., Liu, H., Ma, X., & Shang, Z. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12348-7 · Cited by 27
Spatial Commonsense Graph for Object Localisation in Partial Scenes
Giuliari, F., Skenderi, G., Cristani, M., Wang, Y., & Bue, A. D. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01891 · Cited by 27
Liu, J., & Liu, Q. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i4.28155 · Cited by 27
TD²-Net: Toward Denoising and Debiasing for Video Scene Graph Generation
Lin, X., Shi, C., Zhan, Y., Yang, Z., Wu, Y., & Tao, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i4.28137 · Cited by 27
Region-Based Image Retrieval Revisited
Hinami, R., Matsui, Y., & Satoh, S. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123312 · Cited by 27
Telling the What while Pointing to the Where: Multimodal Queries for Image Retrieval
Changpinyo, S., Pont-Tuset, J., Ferrari, V., & Soricut, R. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01192 · Cited by 27
Self-View Grounding Given a Narrated 360° Video
Chou, S.-H., Chen, Y., Zeng, K.-H., Hu, H.-N., Fu, J., & Sun, M. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12289 · Cited by 27
Universal Scene Graph Generation
Wu, S., Fei, H., & Chua, T. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.01321 · Cited by 26
Semantically Similarity-Wise Dual-Branch Network for Scene Graph Generation
Zhao, B., Mao, Z., Fang, S., Zang, W., & Zhang, Y. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3130197 · Cited by 26
Context Matters: Distilling Knowledge Graph for Enhanced Object Detection
Yang, A., Lin, S., Yeh, C., Shu, M., Yang, Y., & Chang, X. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3266897 · Cited by 26
Generating Holistic 3D Scene Abstractions for Text-Based Image Retrieval
Li, A., Sun, J., Ng, J. Y.-H., Yu, R., Morariu, V. I., & Davis, L. S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.210 · Cited by 26
Explanation-Based Weakly-Supervised Learning of Visual Relations with Graph Networks
Baldassarre, F., Smith, K., Sullivan, J., & Azizpour, H. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58604-1_37 · Cited by 26
Revisiting Image-Language Networks for Open-Ended Phrase Detection
Plummer, B. A., Shih, K. J., Li, Y., Xu, K., Lazebnik, S., Sclaroff, S., & Saenko, K. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3029008 · Cited by 26
Visual Relationship Detection using Scene Graphs: A SurveyPreprint
Agarwal, A., Mangal, A., & Vipul (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.08045 · Cited by 26
Visual Semantic Navigation using Scene Priors
Yang, W. P., Wang, X., Farhadi, A., Gupta, A., & Mottaghi, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.06543 · Cited by 25
Scene Graph tO Image Generation with Contextualized Object Layout Refinement
Ivgi, M., Benny, Y., David, A. B., Berant, J., & Wolf, L. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506651 · Cited by 25
SGTR+: End-to-End Scene Graph Generation With Transformer
Li, R., Zhang, S., & He, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3332246 · Cited by 25
S3C: Spatial Semantic Scene Coverage for Autonomous Vehicles
Woodlief, T., Toledo, F., Elbaum, S. G., & Dwyer, M. B. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639178 · Cited by 25
Task-Oriented Scene Graph-Based Semantic Communications With Adaptive Channel Coding
Sun, S., Qin, Z., Xie, H., & Tao, X. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3450697 · Cited by 25
Kim, J., Park, J., Park, J., Kim, J. Y., Kim, S., & Kim, H. J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02660 · Cited by 25
VEKG: Video Event Knowledge Graph to Represent Video Streams for Complex Event Pattern Matching
Yadav, P., & Curry, E. (2019) · IEEE International Conference on Graph Computing (GC) · doi:10.1109/gc46384.2019.00011 · Cited by 25
Captioning Transformer With Scene Graph Guiding
Chen, H., Wang, Y., Yang, X., & Li, J. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506193 · Cited by 25
Scene Graph Expansion for Semantics-Guided Image Outpainting
Yang, C.-A., Tan, C.-Y., Fan, W.-C., Yang, C.-F., Wu, M.-L., & Wang, Y.-C. F. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01517 · Cited by 25
Neural Self Talk: Image Understanding via Continuous Questioning and AnsweringPreprint
Yang, Y., Li, Y., Fermuller, C. M., & Aloimonos, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.03460 · Cited by 25
Computer vision-based structural assessment exploiting large volumes of images
Yeum, C. M. (2016) · Purdue e-Pubs (Purdue University System) · Cited by 25
Semi-Supervised Learning using Differentiable ReasoningPreprint
van Krieken, E., Acar, E., & van Harmelen, F. (2019) · Edinburgh Research Explorer (University of Edinburgh) · doi:10.48550/arxiv.1908.04700 · Cited by 25
SceneGen: Generative Contextual Scene Augmentation using Scene Graph PriorsPreprint
Keshavarzi, M., Parikh, A., Zhai, X., Mao, M., Caldas, L., & Yang, A. Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.12395 · Cited by 25
Towards Grounded Visual Spatial Reasoning in Multi-Modal Vision Language ModelsPreprint
Rajabi, N., & Košecká, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.09778 · Cited by 25
SceneLLM: Implicit language reasoning in LLM for dynamic scene graph generation
Zhang, H., Li, Z., & Liu, J. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111992 · Cited by 24
Adversarial Multi-Grained Embedding Network for Cross-Modal Text-Video Retrieval
Han, N., Chen, J., Zhang, H., Wang, H., & Chen, H. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3483381 · Cited by 24
Visual-Relation Conscious Image Generation from Structured-Text
Vo, D. M., & Sugimoto, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58604-1_18 · Cited by 24
Graph Edit Distance Reward: Learning to Edit Scene Graph
Chen, L., Lin, G., Wang, S., & Wu, Q. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58529-7_32 · Cited by 24
Object Relation Detection Based on One-shot LearningPreprint
Zhou, L., Zhao, J., Li, J., Li, Y., & Feng, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.05857 · Cited by 24
Object-Centric Diagnosis of Visual ReasoningPreprint
Yang, J., Mao, J., Wu, J., Parikh, D., Cox, D., Tenenbaum, J. B., & Gan, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.11587 · Cited by 24
Tackling the Challenges in Scene Graph Generation With Local-to-Global Interactions
Woo, S., Noh, J., & Kim, K. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3159990 · Cited by 23
Semantic Relation Model and Dataset for Remote Sensing Scene Understanding
Li, P., Zhang, D., Wulamu, A., Liu, X., & Chen, P. (2021) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi10070488 · Cited by 23
Improving Closed and Open-Vocabulary Attribute Prediction Using Transformers
Pham, K., Kafle, K., Lin, Z., Ding, Z., Cohen, S. D., Tran, Q., & Shrivastava, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19806-9_12 · Cited by 23
Image generation models from scene graphs and layouts: A comparative analysis
Hassan, M. U., Alaliyat, S., & Hameed, I. A. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.03.021 · Cited by 23
An Approach to Generate a Caption for an Image Collection Using Scene Graph Generation
Phueaksri, I., Kastner, M. A., Kawanishi, Y., Komamizu, T., & Ide, I. (2023) · IEEE Access · doi:10.1109/access.2023.3332098 · Cited by 23
Zhang, T., Liang, K., Du, R., Chen, W., & Ma, Z. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3487222 · Cited by 23
Uni-Retrieval: A Multi-Style Retrieval Framework for STEM’s Education
Jia, Y., Wu, X., Li, H., QinglinZhang, Q., Hu, Y., Zhao, S., & Fan, W. (2025) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2025.acl-long.502 · Cited by 23
Query is GAN: Scene Retrieval With Attentional Text-to-Image Generative Adversarial Network
Yanagi, R., Togo, R., Ogawa, T., & Haseyama, M. (2019) · IEEE Access · doi:10.1109/access.2019.2947409 · Cited by 23
Reinforcement Learning Based Navigation with Semantic Knowledge of Indoor Environments
Nguyen, T.-L., Nguyen, D.-V., & Le, T.-H. (2019) · International Conference on Knowledge and Systems Engineering/Proceedings · doi:10.1109/kse.2019.8919366 · Cited by 23
Scene Understanding for Safety Analysis in Human-Robot Collaborative Operations
Riaz, H., Terra, A., Raizer, K., Inam, R., & Hata, A. (2020) · International Conference on Control, Automation and Robotics (ICCAR) · doi:10.1109/iccar49639.2020.9108083 · Cited by 23
Topic Scene Graph Generation by Attention Distillation from Caption
Wang, W., Wang, R., & Chen, X. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01560 · Cited by 23
Controllable 3D Outdoor Scene Generation via Scene Graphs
Liu, Y., Li, X., Zhang, Y., Qi, L., Li, X., Wang, W., Li, C., Li, X., & Yang, M. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02604 · Cited by 22
A Review of Multi-Modal Learning from the Text-Guided Visual Processing Viewpoint
Ullah, U., Lee, J.-S., An, C.-H., Lee, H., Park, S.-Y., Baek, R., & Choi, H. (2022) · Sensors · doi:10.3390/s22186816 · Cited by 22
Image captioning based on scene graphs: A survey
Jia, J., Ding, X., Pang, S., Gao, X., Xin, X., Hu, R., & Nie, J. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120698 · Cited by 22
Joint Embeddings of Scene Graphs and Images
Belilovsky, E., Blaschko, M. B., Kiros, J., Urtasun, R., & Zemel, R. S. (2017) · Lirias · Cited by 22
Gao, W.-J., Zhu, Y., Zhang, W., Zhang, K., & Gao, H. (2019) · Computational Intelligence · doi:10.1111/coin.12202 · Cited by 22
Multimodal Logical Inference System for Visual-Textual Entailment
Suzuki, R., Yanaka, H., Yoshikawa, M., Mineshima, K., & Bekki, D. (2019) · Annual Meeting of the Association for Computational Linguistics: Student Research Workshop (ACL SRW) · doi:10.18653/v1/p19-2054 · Cited by 22
iPoet: interactive painting poetry creation with visual multimodal analysis
Feng, Y., Chen, J., Huang, K., Kam-Kwai, W., Ye, H., Zhang, W., Zhu, R., Luo, X., & Chen, W. (2021) · Journal of Visualization · doi:10.1007/s12650-021-00780-0 · Cited by 22
Amodeo, F., Caballero, F., Díaz-Rodríguez, N., & Merino, L. (2022) · IEEE Access · doi:10.1109/access.2022.3230590 · Cited by 22
Liang, W., Niu, F., Reganti, A., Thattai, G., & Tür, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.10731 · Cited by 22
Compile Scene Graphs with Reinforcement LearningPreprint
Chen, Z., Wu, J., Lei, Z., Pollefeys, M., & Chen, C. W. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.13617 · Cited by 22
RetrieveGAN: Image Synthesis via Differentiable Patch Retrieval
Tseng, H.-Y., Lee, H.-Y., Jiang, L., Yang, M.-H., & Yang, W. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58598-3_15 · Cited by 21
Xu, M., Wu, M., Zhao, Y., Li, J. C. L., & Ou, W. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00620 · Cited by 21
Semantic Diversity-Aware Prototype-Based Learning for Unbiased Scene Graph Generation
Jeon, J., Kim, K., Yoon, K., & Park, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73113-6_22 · Cited by 21
Semantic and Expressive Variation in Image Captions Across Languages
Ye, A., Santy, S., Hwang, J. D., Zhang, A. X., & Krishna, R. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02762 · Cited by 21
Self-citationContinuous Visual World Modeling for Autonomous Robot Manipulation
İnceoğlu, A., Koc, C., Kanat, B. O., Ersen, M., & Sarıel, S. (2018) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2017.2787482 · Cited by 21
Belz, A., Muscat, A., Anguill, P., Sow, M., Vincent, G., & Zinessabah, Y. (2018) · International Conference on Natural Language Generation · doi:10.18653/v1/w18-6516 · Cited by 21
Diverse and Relevant Visual Storytelling with Scene Graph Embeddings
Hong, X., Shetty, R., Sayeed, A., Mehra, K., Demberg, V., & Schiele, B. (2020) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2020.conll-1.34 · Cited by 21
NODIS: Neural Ordinary Differential Scene Understanding
Cong, Y., Ackermann, H., Liao, W., Yang, M. Y., & Rosenhahn, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58565-5_38 · Cited by 21
Exploiting Relationship for Complex-scene Image Generation
Hua, T., Zheng, H., Bai, Y., Zhang, W., Zhang, X.-P. S., & Mei, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16250 · Cited by 21
ESCA: Contextualizing Embodied Agents via Scene-Graph Generation
Huang, J., Sethi, A., Kuo, M., Keoliya, M., Velingker, N., Jung, J., Lim, S. N., Li, Z., & Naik, M. (2025) · neural information processing systems · doi:10.52202/085713-0099 · Cited by 20
Salient object detection via a local and global method based on deep residual network
Zhu, D., Luo, Y., Dai, L., Shao, X., Zhou, Q., Itti, L., & Lu, J. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.03.017 · Cited by 20
Long-term object search using incremental scene graph updating
Zhou, F., Liu, H., Zhao, H., & Liang, L. (2022) · Robotica · doi:10.1017/s0263574722001205 · Cited by 20
Zhou, Y., Zhang, Y., Zhao, Z., Zhang, K., & Gou, C. (2022) · IEEE Journal of Radio Frequency Identification · doi:10.1109/jrfid.2022.3207017 · Cited by 20
SGT++: Improved Scene Graph-Guided Transformer for Surgical Report Generation
Lin, C., Zhu, Z., Zhao, Y., Zhang, Y., He, K., & Zhao, Y. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3335909 · Cited by 20
Beyond Entities: A Large-Scale Multi-Modal Knowledge Graph with Triplet Fact Grounding
Liu, J., Zhang, M., Li, W., Wang, C., Li, S., Jiang, H., Jiang, S., Xiao, Y., & Chen, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29828 · Cited by 20
Heterogeneous Graph Learning for Scene Graph Prediction in 3D Point Clouds
Ma, Y., Liu, H., Pei, Y., & Guo, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73347-5_16 · Cited by 20
SGEdit: Bridging LLM with Text2Image Generative Model for Scene Graph-based Image Editing
Zhang, Z., Chen, D., & Liao, J. (2024) · ACM Transactions on Graphics · doi:10.1145/3687957 · Cited by 20
Graph-based Document Structure Analysis
Chen, Y., Liu, R., Zheng, J., Wen, D., Peng, K., Zhang, J., & Stiefelhagen, R. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2502.02501 · Cited by 20
An algorithm of image segmentation based on community detection in graphs
Белим, С. В., & Larionov, S. (2016) · Computer Optics · doi:10.18287/2412-6179-2016-40-6-904-910 · Cited by 20
Wang, Z., Li, J., & Jiang, Y. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3037461 · Cited by 20
VICTR: Visual Information Captured Text Representation for Text-to-Vision Multimodal Tasks
Han, C., Long, S., Luo, S., Wang, K., & Poon, J. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.277 · Cited by 20
Unified Questioner Transformer for Descriptive Question Generation in Goal-Oriented Visual Dialogue
Matsumori, S., Shingyouchi, K., Abe, Y., Fukuchi, Y., Sugiura, K., & Imai, M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00191 · Cited by 20
Qiao, Y., Chen, Q., Deng, C., Ding, N., Qi, Y., Tan, M., Ren, X., & Wu, Q. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475363 · Cited by 20
3D Compositional Zero-Shot Learning with DeCompositional Consensus
Naeem, M. F., Örnek, E. P., Xian, Y., Gool, L. V., & Tombari, F. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19815-1_41 · Cited by 20
DOST: a distributed object segmentation tool
Farid, M. S., Lucenteforte, M., & Grangetto, M. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-5546-4 · Cited by 20
One-Shot Learning for Long-Tail Visual Relation Detection
Wang, W., Wang, M., Wang, S., Long, G., Yao, L., Qi, G., & Chen, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6904 · Cited by 20
Controllable and Progressive Image Extrapolation
Li, Y., Jiang, L., & Yang, M. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00219 · Cited by 20
Learning Object Detection from Captions via Textual Scene AttributesPreprint
Jerbi, A., Herzig, R., Berant, J., Chechik, G., & Globerson, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.14558 · Cited by 20
FROSS: Faster-than-Real-Time Online 3D Semantic Scene Graph Generation from RGB-D Images
Hou, H.-Y., Lee, C., Sonogashira, M., & Kawanishi, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02676 · Cited by 19
Visual Relations Augmented Cross-modal Retrieval
Guo, Y., Chen, J., Zhang, H., & Jiang, Y. (2020) · International Conference on Multimedia Retrieval · doi:10.1145/3372278.3390709 · Cited by 19
An effective spatial relational reasoning networks for visual question answering
Shen, X., Han, D., Chen, C., Luo, G., & Wu, Z. (2022) · PLoS ONE · doi:10.1371/journal.pone.0277693 · Cited by 19
A Survey on 3D Scene Graphs: Definition, Generation and Application
Bae, J., Shin, D., Ko, K., Lee, J., & Kim, U.-H. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-26889-2_13 · Cited by 19
Specifying and Monitoring Safe Driving Properties with Scene Graphs
Toledo, F., Woodlief, T., Elbaum, S. G., & Dwyer, M. B. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610973 · Cited by 19
Shared visuo-tactile interactive perception for robust object pose estimation
Murali, P. K., Porr, B., & Kaboli, M. (2024) · The International Journal of Robotics Research · doi:10.1177/02783649241301443 · Cited by 19
Unambiguous Text Localization, Retrieval, and Recognition for Cluttered Scenes
Rong, X., Yi, C., & Tian, Y. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3018491 · Cited by 19
Image retrieval by dense caption reasoning
Wei, X., Qi, Y., Liu, J., & Liu, F. (2017) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip.2017.8305157 · Cited by 19
vtGraphNet: Learning weakly-supervised scene graph for complex visual grounding
Lyu, F., Feng, W., & Wang, S. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.06.091 · Cited by 19
Strecker, J., Akhunov, K., Carbone, F., García, K., Bektaş, K., Gomez, A., Mayer, S., & Yıldırım, K. S. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3610879 · Cited by 18
Metadata
- Authors
- Johnson, J., Krishna, R., Stark, M., Li, L.-J., Shamma, D. A., Bernstein, M. S., & Fei-Fei, L.
- Affiliations
- Stanford University (US)
- Max Planck Institute for Informatics (DE)
- Yahoo (United States) (US)
- ORCID
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 3668-3678
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2077069816
- Cited by
- 1,101
- References
- 68
- Citations by year
- 2026: 59 · 2025: 84 · 2024: 133 · 2023: 134 · 2022: 130 · 2021: 139 · 2020: 145 · 2019: 117 · 2018: 66 · 2017: 47 · 2016: 33 · 2015: 13
- FWCI
- 21.74
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Max Planck Digital Library (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- semantic image retrieval, scene graph, conditional random fields, object relations, image ranking, object localization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.