Image retrieval using scene graphs
The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
This paper develops a novel framework for semantic image retrieval based on the notion of a scene graph. Our scene graphs represent objects (“man”, “boat”), attributes of objects (“boat is white”) and relationships between objects (“man standing on boat”). We use these scene graphs as queries to retrieve semantically related images. To this end, we design a conditional random field model that reasons about possible groundings of scene graphs to test images. The likelihoods of these groundings are used as ranking scores for retrieval. We introduce a novel dataset of 5,000 human-generated scene graphs grounded to images and use this dataset to evaluate our method for image retrieval. In particular, we evaluate retrieval using full scene graphs and small scene subgraphs, and show that our method outperforms retrieval methods that use only objects or low-level image features. In addition, we show that our full model can be used to improve object localization compared to baseline methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Self-citationDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Self-citationRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“Datasets have been a driving force of computer vision algorithms, ranging from classi-fication [64] to object recognition and segmentation [18, 12, 55, 15].”
MethodAre we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 1×
“Their sys-tem is constrained to the six object classes from KITTI [23] while our system uses an open-world vocabulary; our scene graphs also tend to be more complex than their semantic graphs.”
MethodConditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Research works printed but not linked: 5
- jurafsky, 2000, Speech & language processing
- lampert, 2013, Attribute-based classification for zero-shot learning of object categories, PAMI
- yao, 2011, Classifying actions and measuring action similarity by modeling the mutual context of objects and human poses, a) A 1(D2) D3
- 0, OpenSceneGraph
- 10.1145/1964921.1964929 · DOI · Paper page
Cited by
Items 801–900 of 1,001
Temporal Scene Understanding using Contextually Unique Identification
Jha, S. S., García, K., Antille, Y. S., Solèr, M. E., Padua, S., & Mayer, S. (2024) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai62512.2024.00145 · Cited by 6
Quantifying the Amount of Visual Information Used by Neural Caption Generators
Tanti, M., Gatt, A., & Camilleri, K. P. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11018-5_11 · Cited by 6
Content Based Image Retrieval via Sparse Representation and Feature Fusion
Liu, H., Wang, W., & Jiao, P. (2019) · IEEE Data Driven Control and Learning Systems Conference (DDCLS) · doi:10.1109/ddcls.2019.8908926 · Cited by 6
Improving visual relationship detection using linguistic and spatial cues
Jung, J., & Park, J. (2019) · ETRI Journal · doi:10.4218/etrij.2019-0093 · Cited by 6
State Summarization of Video Streams for Spatiotemporal Query Matching in Complex Event Processing
Yadav, P., Das, D. P., & Curry, E. (2019) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2019.00022 · Cited by 6
AVR: attention based salient visual relationship detection
Li, H., Lv, J., Xiao, Q., Liu, Y., Wu, S., & Huang, X. (2022) · International Conference on Digital Image Processing · doi:10.1117/12.2644438 · Cited by 6
Generating Images from Arabic Story-Text using Scene Graph
Zakraoui, J., Saleh, M., Asghar, U., Alja’am, J. M., & Al-Maadeed, S. A. (2020) · IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT) · doi:10.1109/iciot48696.2020.9089495 · Cited by 6
Iterative Visual Relationship Detection via Commonsense Knowledge Graph
Wan, H., Liang, J., Du, J., Liu, Y., Ou, J., Wang, B., Pan, J. Z., & Zeng, J. (2020) · Big Data Research · doi:10.1016/j.bdr.2020.100175 · Cited by 6
Target-Tailored Source-Transformation for Scene Graph Generation
Liao, W., Lan, C., Yang, M. Y., Zeng, W., & Rosenhahn, B. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00182 · Cited by 6
A Bi-modal Automated Essay Scoring System for Handwritten Essays
Gao, J., Yang, Q., Zhang, Y., Zhang, L., & Wang, S. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533505 · Cited by 6
Image Generation from Scene Graph with Object Edges
Li, C., Duan, Y., Du, Q., Pan, C., Liu, G., & Tao, X. (2022) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2022-fall57202.2022.10012878 · Cited by 6
Leveraging Commonsense for Object Localisation in Partial Scenes
Giuliari, F., Skenderi, G., Cristani, M., Bue, A. D., & Wang, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3272523 · Cited by 6
From a Visual Scene to a Virtual Representation: A Cross-Domain Review
Pereira, A., Carvalho, P., Pereira, N., Viana, P., & Côrte-Real, L. (2023) · IEEE Access · doi:10.1109/access.2023.3283495 · Cited by 6
SRI-Graph: A Novel Scene-Robot Interaction Graph for Robust Scene Understanding
Yang, D. L., Xu, X. W., Xiong, M., Babaians, E., & Steinbach, E. G. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161085 · Cited by 6
Weakly-supervised Video Scene Graph Generation via Unbiased Cross-modal Learning
Wu, Z., Gao, J., & Xu, C. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612019 · Cited by 6
Wei, C. Y., & Deng, Z. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611454 · Cited by 6
SpatialSim: Recognizing Spatial Configurations of Objects With Graph Neural Networks
Teodorescu, L., Hofmann, K., & Oudeyer, P.-Y. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.782081 · Cited by 6
Semantics Preserving Hierarchy based Retrieval of Indian heritage monuments
Gupta, R., Mukherjee, P., Lall, B., & Gupta, V. (2020) · Workshop on Structuring and Understanding of Multimedia heritAge Contents (SUMAC) · doi:10.1145/3423323.3423409 · Cited by 6
Ergo: A Quest for Declarativity in Logic Programming
Grosof, B. N., Kifer, M., Swift, T. M., Fodor, P., & Bloomfield, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35254-6_18 · Cited by 6
Relationship Detection Based on Object Semantic Inference and Attention Mechanisms
Zhang, L., Zhang, S., Shen, P., Zhu, G., Shah, S. A. A., & Bennamoun, M. (2019) · International Conference on Multimedia Retrieval · doi:10.1145/3323873.3325025 · Cited by 6
Text-to-Image GAN-Based Scene Retrieval and Re-Ranking Considering Word Importance
Yanagi, R., Togo, R., Ogawa, T., & Haseyama, M. (2019) · IEEE Access · doi:10.1109/access.2019.2952676 · Cited by 6
Focusing Visual Relation Detection on Relevant Relations with Prior Potentials
Plesse, F., Ginsca, A., Delezoide, B., & Preteux, F. J. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093605 · Cited by 6
Grounded Objects and Interactions for Video CaptioningPreprint
Ma, C., Kadav, A., Melvin, I., Kira, Z., AlRegib, G., & Graf, H. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.06354 · Cited by 6
End-to-end Generative Floor-plan and Layout with Attributes and Relation GraphPreprint
Di, X., Yu, P., Yang, D., Zhu, H. C., Sun, C., & Liu, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.08514 · Cited by 6
1st Place Solution for PSG competition with ECCV'22 SenseHuman WorkshopPreprint
Wang, Q., Guo, X., & Wang, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.02651 · Cited by 6
Bridging Vision Language Models and Symbolic Grounding for Video Question AnsweringPreprint
Ma, H., Pathak, V., & Wang, D. Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.11862 · Cited by 6
From Pixels to Graphs: using Scene and Knowledge Graphs for HD-EPIC VQA ChallengePreprint
Taluzzi, A., Gesualdi, D., Santambrogio, R., Plizzari, C., Palermo, F., Mentasti, S., & Matteucci, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.08553 · Cited by 6
EgoGraph: Temporal Knowledge Graph for Egocentric Video UnderstandingPreprint
Sun, S., Han, K., Huang, Y., Cai, W., & Song, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.23709 · Cited by 6
FlowScene: Style-Consistent Indoor Scene Generation with Multimodal Graph Rectified FlowPreprint
Yang, Z., Zhai, G., Lu, K., Yin, Y., Zhang, C., Xiao, Z., Long, J., Navab, N., & Wang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.19598 · Cited by 6
Planetarium: A Rigorous Benchmark for Translating Text to Structured Planning Languages
Zuo, M., Velez, F. P., Li, X., Littman, M., & Bach, S. (2025) · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2025.naacl-long.560 · Cited by 5
“A scene graph is a data structure commonly used in fields such as computer vision and graphics (Johnson et al., 2015; Chang et al., 2023), rearrangement (Ramachandruni et al., 2023), and planning to represent objects, their attributes, and the relationships among them.”
A Digital Companion Architecture for Ambient Intelligence
Garcia, K., Vontobel, J., & Mayer, S. (2024) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3659610 · Cited by 5
Scene Graph Embeddings Using Relative Similarity Supervision
Maheshwari, P., Chaudhry, R., & Vinay, V. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16333 · Cited by 5
Difference-Aware Iterative Reasoning Network for Key Relation Detection
Zhao, B., Chen, W., Hu, B., Xie, H., & Mao, Z. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00055 · Cited by 5
Pham, Q. P. M., Nguyen, K. T. N., Ngo, L. C., Do, T., Song, D., & Hy, T.-S. (2024) · Transactions on machine learning research · doi:10.48550/arxiv.2411.10509 · Cited by 5
Generation of Scene Graph and Semantic Image: A Review and Challenge Ahead
Hsieh, S.-K., & Liu, H.-I. (2025) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic64266.2025.10920847 · Cited by 5
Vipera: Towards systematic auditing of generative text-to-image models at scale
Huang, Y., Deng, W. H., Xiao, S., Eslami, M., Hong, J., & Perer, A. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719757 · Cited by 5
Seeing Through the Brain: New Insights from Decoding Visual Stimuli with fMRI
Zheng, H., Zhang, E., Qiu, W., Cai, Y., Yang, C., Chen, E., Zhang, X., Ying, R., Zhou, D., & Yan, Y. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2510.16196 · Cited by 5
Human-Inspired Scene Understanding: A Grounded Cognition Method for Unbiased Scene Graph Generation
Zhang, R., Hao, Y., Zhang, F., An, G., Song, B., & Wu, D. O. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3635152 · Cited by 5
Enhancing image retrieval for complex queries using external knowledge sources
Samih, H., Rady, S., & Gharib, T. F. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09360-0 · Cited by 5
Deep Metric Learning for Multi-Label and Multi-Object Image Retrieval
Mojoo, J., & Kurita, T. (2021) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2020edp7226 · Cited by 5
RP-SG: Relation Prediction in 3D Scene Graphs for Unobserved Objects Localization
Ying, Z., Yuan, X., Yang, B., Song, Y. H., Xu, Q., Zhou, F., & Sheng, W. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3342666 · Cited by 5
Hidden Semi-Markov Models for Semantic-Graph Language Modeling
Yetim, S. Y., Duman, T. M., & Arıkan, O. (2024) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2024.107032 · Cited by 5
Wang, P., Yang, W., Zhao, Z., & Su, F. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650930 · Cited by 5
Silberer, C., Uijlings, J., & Lapata, M. (2018) · Natural Language Engineering · doi:10.1017/s1351324918000104 · Cited by 5
Deep learned Inter-Channel Colored Texture Pattern: a new chromatic-texture descriptor
Jacob, I. J., Srinivasagan, K. G., Darney, P. E., & Jayapriya, K. (2019) · Pattern Analysis and Applications · doi:10.1007/s10044-019-00780-9 · Cited by 5
Referring to Objects in Videos Using Spatio-Temporal Identifying Descriptions
Wiriyathammabhum, P., Shrivastava, A., Morariu, V. I., & Davis, L. S. (2019) · doi:10.18653/v1/w19-1802 · Cited by 5
Hierarchical Graph Convolutional Networks for Image Classification
Batisteli, J. P. O., Guimarães, S. J. F., & Patrocínio, Z. K. G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-45389-2_5 · Cited by 5
Does the Performance of Text-to-Image Retrieval Models Generalize Beyond Captions-as-a-Query?
Rodríguez, J. M., Tavassoli, N., Levy, E., Lederman, G., Sivov, D., Lissandrini, M., & Mottin, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-56066-8_15 · Cited by 5
Liang, N., Liu, Y., Sun, W., Xia, Y., & Wang, F. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446810 · Cited by 5
Haq, I. U., Pifarré, M., & Fraca, E. (2024) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v19i05.47465 · Cited by 5
Hierarchical Graph Neural Networks with Scale-Aware Readout for Image Classification
Batisteli, J. P. O., Guimarães, S. J. F., & Patrocínio, Z. K. G. (2024) · International Journal of Semantic Computing · doi:10.1142/s1793351x24450053 · Cited by 5
X-ACE: Explainable and Multi-factor Audio Captioning Evaluation
Wang, Q., Gu, J.-C., & Ling, Z.-H. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.729 · Cited by 5
Hu, H., Yang, X.-H., & Zhao, Y.-Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130130 · Cited by 5
SpaGBOL: Spatial-Graph-Based Orientated Localisation
Shore, T., Méndez, O., & Hadfield, S. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00667 · Cited by 5
Ensemble predicate decoding for unbiased scene graph generation
Feng, J., Wang, L., Xu, H., Xu, K., & Yin, B. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130496 · Cited by 5
Attributes as Semantic Units Between Natural Language and Visual Recognition
Rohrbach, M. (2017) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-319-50077-5_12 · Cited by 5
Towards Book Cover Design via Layout Graphs
Zhang, W., Zheng, Y., Miyazono, T., Uchida, S., & Iwana, B. K. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86334-0_42 · Cited by 5
Graph Representation for Order-aware Visual Transformation
Qiu, Y., Sun, Y., Matsuzawa, F., Iwata, K., & Kataoka, H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02183 · Cited by 5
Interactive Scene Graph Analysis for Future Intelligent Teleconferencing Systems
Wu, M., Lu, Y., Trivedi, S., Chen, B., Zhou, Q., Wang, L., Singh, S., Zink, M., Sitaraman, R. K., Chakareski, J., et al. (2023) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism59092.2023.00048 · Cited by 5
Addressing Class Imbalance in Scene Graph Parsing by Learning to Contrast and Score
Huang, H., Saito, S., Kikuchi, Y., Matsumoto, E., Tang, W., & Yu, P. S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69544-6_28 · Cited by 5
Interior Layout Generation Based on Scene Graph and Graph Generation Model
Su, X. K., Wu, C., Gao, W., & Huang, W. (2022) · Springer eBooks · doi:10.1007/978-3-030-90625-2_15 · Cited by 5
Few-Shot Referring Relationships in Videos
Kumar, Y., & Mishra, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00227 · Cited by 5
COFAR: Commonsense and Factual Reasoning in Image Search
Gatti, P., Penamakuri, A. S., Teotia, R., Mishra, A., Sengupta, S., & Ramnani, R. (2022) · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP) · doi:10.18653/v1/2022.aacl-main.87 · Cited by 5
Explainable Image Understanding Using Vision and Reasoning
Aditya, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10519 · Cited by 5
Scene Graph Prediction with Limited LabelsPreprint
Chen, V. S., Varma, P., Krishna, R., Bernstein, M. S., Ré, C., & Fei-Fei, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.11622 · Cited by 5
Self-citationOne-shot Scene Graph GenerationPreprint
Guo, Y., Song, J., Gao, L., & Shen, H. T. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.10824 · Cited by 5
Yadav, P. (2021) · Arrow@dit (Dublin Institute of Technology) · doi:10.13025/17114 · Cited by 5
IFR-Explore: Learning Inter-object Functional Relationships in 3D Indoor ScenesPreprint
Li, Q., Mo, K., Yang, Y., Zhao, H., & Guibas, L. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.05298 · Cited by 5
Thinking Like an Annotator: Generation of Dataset Labeling InstructionsPreprint
Chang, N., Ferroni, F., Tarr, M. J., Hebert, M., & Ramanan, D. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.14035 · Cited by 5
PoseAction: Action Recognition for Patients in the Ward using Deep Learning ApproachesPreprint
Li, Z., & Yeow, C. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.03288 · Cited by 5
Multimodal Perception for Goal-oriented Navigation: A SurveyPreprint
Ieong, I.-T., & Tang, H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.15643 · Cited by 5
Masala, M., & Leordeanu, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.04815 · Cited by 5
Synthetic Visual Genome 2: Extracting Large-scale Spatio-Temporal Scene Graphs from VideosPreprint
Gao, Z., Zhang, J., Ikezogwo, W. O., Park, J. S., You, T., Ogbu, D., Zheng, C., Huang, W., Yang, Y., Han, W., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.23543 · Cited by 5
Self-citation3-D Scene Graphs in Robotics: A Unified Representation Bridging Geometry, Semantics, and Action
Catalano, I., Zumaya, C. C., Placed, J. A., Civera, J., Bessa, W. M., & Peña-Queralta, J. (2026) · IEEE Transactions on Robotics · doi:10.1109/tro.2026.3731534 · Cited by 4
Huang, Y., Deng, W. H., Xiao, S., Eslami, M., Hong, J., Narechania, A. A., & Perer, A. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791942 · Cited by 4
Spatial Semantic Fuzzing for LiDAR-Based Autonomous Driving Perception Systems
Guo, A., Su, Z., Gao, X., Fang, C., Wang, S., Tian, H., Wen, W., Ma, L., & Chen, Z. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3627580 · Cited by 4
Lv, X., Zhao, Y., Yin, H., Chen, Y., & Liu, J. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112794 · Cited by 4
Scene graph-driven reasoning for action planning of humanoid robot
Yudin, D. A., Lazarev, A., Bakaeva, E. A., Kochetkova, A., Kovalev, A. K., & Panov, A. I. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.114150 · Cited by 4
Roles of MLLMs in Visually Rich Document Retrieval for RAG: A Survey
Zhang, X. (2025) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2025.ijcnlp-long.2 · Cited by 4
Response-G1: Explicit Scene Graph Modeling for Proactive Streaming Video Understanding
Ma, K., Tang, J., Guo, B., Han, X., Xu, R. R., He, Q., Wang, Z., Wang, X., Chen, Q., Yu, Z., et al. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.2042 · Cited by 4
Robot Localization Based on Semantic Information in Dynamic Indoor Environments with Similar Layouts
Song, R., Liu, J., Bi, W., Zhang, Y., Zhang, M., Zhang, C., & Hua, C. (2024) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio64047.2024.10907541 · Cited by 4
A knowledge graph-based approach for recognizing older adults’ behavior in urban parks
Zhang, K. J., Cao, K., & Li, W. (2025) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2025.2499084 · Cited by 4
Scene Graph Generation with Geometric Context
Kumar, V., Mundu, A., & Singh, S. K. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-11346-8_30 · Cited by 4
PMP-NET: Rethinking Visual Context for Scene Graph Generation
Tong, X., Wang, R., Wang, C., Zhang, S., & Cao, X. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747415 · Cited by 4
GTR: A Grafting-Then-Reassembling Framework for Dynamic Scene Graph Generation
Liang, J., Wang, Y., Wang, Z., Liu, M., Fu, R., Wang, Z., & Qin, B. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/131 · Cited by 4
Learning group interaction for sports video understanding from a perspective of athlete
He, R., Fu, Z., Liu, Q., Wang, Y., & Chen, X. (2023) · Frontiers of Computer Science · doi:10.1007/s11704-023-2525-y · Cited by 4
SCoRD: Subject-Conditional Relation Detection with Text-Augmented Data
Yang, Z., Kafle, K., Lin, Z., Cohen, S. D., Ding, Z., & Ordóñez, V. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00563 · Cited by 4
SGK-Net: A Novel Navigation Scene Graph Generation Network
Yang, W., Qiu, H., Luo, X., & Xie, S. (2024) · Sensors · doi:10.3390/s24134329 · Cited by 4
Path-Based Design Model for Constructing and Exploring Alternative Visualisations
Jackson, J., Ritsos, P. D., Butcher, P., & Roberts, J. C. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456323 · Cited by 4
Dense Captioning of Natural Scenes in Spanish
Gomez-Garay, A., Raducanu, B., & Salas, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-92198-3_15 · Cited by 4
Efficient and Interactive Spatial-Semantic Image Retrieval
Furuta, R., Inoue, N., & Yamasaki, T. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-73603-7_16 · Cited by 4
Improve Image Captioning by Modeling Dynamic Scene Graph Extension
Geng, M., & Zhao, Q. (2022) · International Conference on Multimedia Retrieval · doi:10.1145/3512527.3531401 · Cited by 4
Boosting Scene Graph Generation with Contextual Information
Sun, S., Huang, D., Tao, X., Pan, C., Liu, G., & Chen, C. W. (2023) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3615868 · Cited by 4
Neuro-Symbolic Reasoning for Multimodal Referring Expression Comprehension in HMI Systems
Jain, A., Kondapally, A. R., Yamada, K., & Yanaka, H. (2024) · New Generation Computing · doi:10.1007/s00354-024-00243-8 · Cited by 4
Batisteli, J. P. O., Guimarães, S. J. F., & Patrocínio, Z. K. G. (2023) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism59092.2023.00015 · Cited by 4
Dynamic Gated Graph Neural Networks for Scene Graph Generation
Khademi, M., & Schulte, O. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20876-9_42 · Cited by 4
Structured Neural Motifs: Scene Graph Parsing via Enhanced Context
Li, Y., Yang, X., & Xu, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-37734-2_15 · Cited by 4
Improving the representation of image descriptions for semantic image retrieval with RDF
Chen, H., Guo, A., Ni, W., & Cheng, Y. (2020) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2020.102934 · Cited by 4
TranstextNet: Transducing Text for Recognizing Unseen Visual Relationships
Kenigsfield, G. S., & El‐Yaniv, R. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00200 · Cited by 4
Neighbours Matter: Image Captioning with Similar Images
Wang, Q., Wang, J., Chan, A. B., Huang, S., Xiong, H., Li, X., & Dou, D. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.90 · Cited by 4
Metadata
- Authors
- Johnson, J., Krishna, R., Stark, M., Li, L.-J., Shamma, D. A., Bernstein, M. S., & Fei-Fei, L.
- Affiliations
- Stanford University (US)
- Max Planck Institute for Informatics (DE)
- Yahoo (United States) (US)
- ORCID
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 3668-3678
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2077069816
- Cited by
- 1,101
- References
- 68
- Citations by year
- 2026: 59 · 2025: 84 · 2024: 133 · 2023: 134 · 2022: 130 · 2021: 139 · 2020: 145 · 2019: 117 · 2018: 66 · 2017: 47 · 2016: 33 · 2015: 13
- FWCI
- 21.74
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Max Planck Digital Library (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- semantic image retrieval, scene graph, conditional random fields, object relations, image ranking, object localization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.