Image retrieval using scene graphs
The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
This paper develops a novel framework for semantic image retrieval based on the notion of a scene graph. Our scene graphs represent objects (“man”, “boat”), attributes of objects (“boat is white”) and relationships between objects (“man standing on boat”). We use these scene graphs as queries to retrieve semantically related images. To this end, we design a conditional random field model that reasons about possible groundings of scene graphs to test images. The likelihoods of these groundings are used as ranking scores for retrieval. We introduce a novel dataset of 5,000 human-generated scene graphs grounded to images and use this dataset to evaluate our method for image retrieval. In particular, we evaluate retrieval using full scene graphs and small scene subgraphs, and show that our method outperforms retrieval methods that use only objects or low-level image features. In addition, we show that our full model can be used to improve object localization compared to baseline methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Self-citationDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Self-citationRich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“Datasets have been a driving force of computer vision algorithms, ranging from classi-fication [64] to object recognition and segmentation [18, 12, 55, 15].”
MethodAre we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 1×
“Their sys-tem is constrained to the six object classes from KITTI [23] while our system uses an open-world vocabulary; our scene graphs also tend to be more complex than their semantic graphs.”
MethodConditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Research works printed but not linked: 5
- jurafsky, 2000, Speech & language processing
- lampert, 2013, Attribute-based classification for zero-shot learning of object categories, PAMI
- yao, 2011, Classifying actions and measuring action similarity by modeling the mutual context of objects and human poses, a) A 1(D2) D3
- 0, OpenSceneGraph
- 10.1145/1964921.1964929 · DOI · Paper page
Cited by
Items 601–700 of 1,001
Efficient Coarse-to-Fine Non-Local Module for the Detection of Small ObjectsPreprint
Levi, H., & Ullman, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.12152 · Cited by 13
Recognition of Indoor Scenes Using 3-D Scene Graphs
Yue, H., Lehtola, V., Wu, H., Vosselman, G., Li, J., & Liu, C. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3387556 · Cited by 12
Relation-aware Hierarchical Prompt for Open-vocabulary Scene Graph Generation
Liu, T., Li, R., Wang, C., & He, X. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i5.32594 · Cited by 12
Hydra-SGG: Hybrid Relation Assignment for One-stage Scene Graph Generation
Chen, M., Chen, G., Wang, W., & Yang, Y. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2409.10262 · Cited by 12
Uncertainty-Aware Scene Graph Generation
Li, X., Wu, T., Zheng, G., Yu, Y., & Li, X. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.12.011 · Cited by 12
CLIPREC: Graph-Based Domain Adaptive Network for Zero-Shot Referring Expression Comprehension
Ke, J., Wang, J., Chen, J.-C., Jhuo, I., Lin, C., & Lin, Y. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3297312 · Cited by 12
Li, X., Zheng, G., Yu, Y., Ji, N., & Li, X. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3384096 · Cited by 12
HAtt-Flow: Hierarchical Attention-Flow Mechanism for Group-Activity Scene Graph Generation in Videos
Chappa, N. V. S. R., Nguyen, P., Le, N., Dobbs, P. D., & Luu, K. (2024) · Sensors · doi:10.3390/s24113372 · Cited by 12
CAGNet: a context-aware graph neural network for detecting social relationships in videos
Yu, F., Fang, Y., Zhao, Z., Bei, J., Ren, T., & Wu, G. (2024) · Visual Intelligence · doi:10.1007/s44267-024-00056-9 · Cited by 12
MICap: A Unified Model for Identity-Aware Movie Descriptions
Raajesh, H., Desanur, N. R., Khan, Z., & Tapaswi, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01329 · Cited by 12
Wang, H., Guo, B., Zeng, Y., Chen, M., Ding, Y., Zhang, Y., Yao, L., & Yu, Z. (2025) · ACM Transactions on Information Systems · doi:10.1145/3715098 · Cited by 12
Generating Videos of Zero-Shot Compositions of Actions and Objects
Nawhal, M., Zhai, M., Lehrmann, A., Sigal, L., & Mori, G. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58610-2_23 · Cited by 12
Deep Hashing with Active Pairwise Supervision
Wang, Z., Zheng, Q. S., Lu, J., & Zhou, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58529-7_31 · Cited by 12
Scene-Graph-Guided message passing network for dense captioning
Liu, A.-A., Wang, Y., Xu, N., Liu, S., & Li, X. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.01.024 · Cited by 12
Caption TLSTMs: combining transformer with LSTMs for image captioning
Yan, J., Xie, Y., Luan, X., Guo, Y., Gong, Q., & Feng, S. (2022) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-022-00228-7 · Cited by 12
One-shot Video Graph Generation for Explainable Action Reasoning
Han, Y., Zhuo, T., Zhang, P., Huang, W., Zha, Y., Zhang, Y., & Kankanhalli, M. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.02.069 · Cited by 12
The Tensor Brain: A Unified Theory of Perception, Memory, and Semantic Decoding
Tresp, V., Sharifzadeh, S., Li, H., Konopatzki, D., & Ma, Y. (2023) · Neural Computation · doi:10.1162/neco_a_01552 · Cited by 12
Toward Computer Vision Systems That Understand Real-World Assembly Processes
Jones, J. D., Hager, G. D., & Khudanpur, S. P. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00051 · Cited by 12
Bootstrapping Knowledge Graphs From Images and Text
Mao, J., Yao, Y., Heinrich, S., Hinz, T., Weber, C., Wermter, S., Liu, Z., & Sun, M. (2019) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2019.00093 · Cited by 12
Scene Graph Parsing by Attention GraphPreprint
Andrews, M., Chia, Y. K., & Witteveen, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06273 · Cited by 12
Unbiased Scene Graph Generation via Rich and Fair Semantic ExtractionPreprint
Wen, B., Luo, J., Liu, X., & Huang, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.00176 · Cited by 12
Generating Triples With Adversarial Networks for Scene Graph Construction
Klawonn, M., & Heim, E. (2018) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v32i1.12321 · Cited by 21
Generate Any Scene: Scene Graph Driven Data Synthesis for Visual Generation Training
Gao, Z., Huang, W., Zhang, J., Kembhavi, A., & Krishna, R. (2024) · International Conference on Learning Representations · doi:10.48550/arxiv.2412.08221 · Cited by 11
Self-citationLiu, Y., Wang, J., & Torbaghan, M. E. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106181 · Cited by 11
BCTR: Bidirectional Conditioning Transformer for Scene Graph Generation
Hao, P., Wang, W., Wang, X., Jia, H., Jia, H., Cui, S., Wei, J., & Hao, X. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103260 · Cited by 11
Statistical Confidence Rescoring for Robust 3D Scene Graph Generation from Multi-View Images
Yeo, Q. X., Li, Y., & Lee, G. H. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02318 · Cited by 11
Scene Graph Generation Using Depth, Spatial, and Visual Cues in 2D Images
Kumar, A. S., & Nair, J. J. (2021) · IEEE Access · doi:10.1109/access.2021.3139000 · Cited by 11
Multi-Label Meta Weighting for Long-Tailed Dynamic Scene Graph Generation
Chen, S., Du, Y., Mettes, P., & Snoek, C. G. M. (2023) · International Conference on Multimedia Retrieval · doi:10.1145/3591106.3592267 · Cited by 11
Visual Semantic Parsing: From Images to Abstract Meaning Representation
Abdelsalam, M. A., Shi, Z., Fancellu, F., Basioti, K., Bhatt, D., Pavlović, V., & Fazly, A. (2022) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2022.conll-1.19 · Cited by 11
Zhu, Y., Zhu, Z., Lin, B., Liang, X., Zhao, F., & Liu, J. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.317 · Cited by 11
SketchQL: Video Moment Querying with a Visual Query Interface
Wu, R., Chunduri, P., Payani, A., Chu, X., Arulraj, J. J. P., & Rong, K. (2024) · Proceedings of the ACM on Management of Data · doi:10.1145/3677140 · Cited by 11
Fei, H., Luo, M., Xu, J., Wu, S., Ji, W., Lee, M. L., & Hsu, W. (2024) · Proceedings of the 1st ACM Multimedia Workshop on Multi-modal Misinformation Governance in the Era of Foundation Models · doi:10.1145/3689090.3689388 · Cited by 11
Towards a joint semantic analysis in mobile forensics environments
Xi, J., Siegel, M., Labudde, D., & Spranger, M. (2024) · Forensic Science International Digital Investigation · doi:10.1016/j.fsidi.2024.301846 · Cited by 11
What and when to look? Temporal span proposal network for video relation detection
Woo, S., Noh, J., & Kim, K. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129503 · Cited by 11
Seq-SG2SL: Inferring Semantic Layout From Scene Graph Through Sequence to Sequence Learning
Li, B., Zhuang, B., Li, M., & Gu, J. H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00753 · Cited by 11
Cross-modal video moment retrieval based on visual-textual relationship alignment
Xu, T. B., Du, H. Y., Chen, E., Chen, J., & Yufei, W. U. (2020) · Scientia Sinica Informationis · doi:10.1360/ssi-2019-0292 · Cited by 11
Exploiting structured high-level knowledge for domain-specific visual classification
Palazzo, S., Murabito, F., Pino, C., Rundo, F., Giordano, D., Shah, M. A., & Spampinato, C. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2020.107806 · Cited by 11
Auxiliary Bi-Level Graph Representation for Cross-Modal Image-Text Retrieval
Zhong, X., Yang, Z., Ye, M., Huang, W., Yuan, J., & Lin, C. (2021) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428380 · Cited by 11
Scene Designer: a Unified Model for Scene Search and Synthesis from Sketch
Ribeiro, L. S. F., Bui, T., Collomosse, J. P., & Ponti, M. A. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00275 · Cited by 11
3D scene graph prediction from point clouds
Wu, F., Yan, F., Shi, W., & Zhou, Z. (2022) · Virtual Reality & Intelligent Hardware · doi:10.1016/j.vrih.2022.01.005 · Cited by 11
QLEVR: A Diagnostic Dataset for Quantificational Language and Elementary Visual Reasoning
Li, Z., & Søgaard, A. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.73 · Cited by 11
Knowledge-Based Scene Graph Generation with Visual Contextual Dependency
Zhang, L., Yin, H., Hui, B., Liu, S., & Zhang, W. (2022) · Mathematics · doi:10.3390/math10142525 · Cited by 11
Single-Stage Visual Relationship Learning Using Conditional Queries
Desai, A., Wu, T.-Y., Tripathi, S., & Vasconcelos, N. M. (2022) · neural information processing systems · doi:10.52202/068431-0949 · Cited by 11
Efficient and interactive spatial-semantic image retrieval
Furuta, R., Inoue, N., & Yamasaki, T. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-7148-1 · Cited by 11
TSM: Topological Scene Map for Representation in Indoor Environment Understanding
Liao, Z., Zhang, Y., Luo, J., & Yuan, W. (2020) · IEEE Access · doi:10.1109/access.2020.3029324 · Cited by 11
Scene Dynamics: Counterfactual Critic Multi-Agent Training for Scene Graph Generation.Preprint
Chen, L., Zhang, H., Xiao, J., He, X., Pu, S., & Chang, S. (2018) · arXiv (Cornell University) · Cited by 11
Joint Visual Grounding with Language Scene GraphsPreprint
Liu, D., Zhang, H., Zha, Z.-J., Wang, M., & Sun, Q. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03561 · Cited by 11
SA-VQA: Structured Alignment of Visual and Semantic Representations for Visual Question AnsweringPreprint
Xiong, P., You, Q., Yu, P., Liu, Z., & Wu, Y. N. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.10654 · Cited by 11
GPT4SGG: Synthesizing Scene Graphs from Holistic and Region-specific NarrativesPreprint
Chen, Z., Wu, J., Lei, Z., Zhang, Z., & Chen, C. W. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.04314 · Cited by 11
AUG: A New Dataset and An Efficient Model for Aerial Image Urban Scene Graph GenerationPreprint
Li, Y., Li, K., Zhang, Y., Wang, L., & Zhang, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.07788 · Cited by 11
Scene Graph Generation Strategy with Co-occurrence Knowledge and Learnable Term FrequencyPreprint
Kim, H.-J., Kim, S., Ahn, D., Lee, J. T., & Ko, B. C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.12648 · Cited by 11
Explicit Reasoning over End-to-End Neural Architectures for Visual Question Answering
Aditya, S., Yang, Y., & Baral, C. R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11324 · Cited by 10
SPA: Spatially Pooled Attributes for image retrieval
Li, J., Xu, C., Yang, W., & Sun, C. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.10.074 · Cited by 10
A Plug-and-Play Method for Rare Human-Object Interactions Detection by Bridging Domain Gap
Zhang, L., Suo, W., Wang, P., & Zhang, Y. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680666 · Cited by 10
Representation Learning for Visual-Relational Knowledge Graphs.
Oñoro-Rubio, D., Niepert, M., García-Durán, A., González, R., & López-Sastre, R. J. (2017) · Cited by 10
Learning to Generate an Unbiased Scene Graph by Using Attribute-Guided Predicate Features
Wang, L., Yuan, Z., & Chen, B. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i2.25356 · Cited by 10
RSG-Search: Semantic Traffic Scene Retrieval Using Graph-Based Scene Representation
Tian, Y., Carballo, A., Li, R., & Takeda, K. (2023) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55152.2023.10186641 · Cited by 10
Task-Oriented Explainable Semantic Communications Based on Structured Scene Graphs
Sun, S., Qin, Z., Xie, H., & Tao, X. (2023) · Globecom · doi:10.1109/globecom54140.2023.10436793 · Cited by 10
Review of the application of machine learning to the automatic semantic annotation of images
Olaode, A. A., & Naghdy, G. A. (2019) · IET Image Processing · doi:10.1049/iet-ipr.2018.6153 · Cited by 10
RDBN: Visual relationship detection with inaccurate RGB-D images
Liu, X., & Gan, M.-G. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106142 · Cited by 10
ViCA: Combining visual, social, and task-oriented conversational AI in a healthcare setting
Pantazopoulos, G., Bruyere, J., Nikandrou, M., Boissier, T., Hemanthage, S., Sachish, B. K., Shah, V., Dondrup, C., & Lemon, O. (2021) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3462244.3479909 · Cited by 10
Partial Off-policy Learning: Balance Accuracy and Diversity for Human-Oriented Image Captioning
Shi, J., Li, Y., & Wang, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00219 · Cited by 10
Spatial-aware topic-driven-based image Chinese caption for disaster news
Zhou, J., Zhu, Y., Zhang, Y., Yang, C., & Pan, H. (2023) · Neural Computing and Applications · doi:10.1007/s00521-022-08072-w · Cited by 10
A Light Touch Approach to Teaching Transformers Multi-view Geometry
Bhalgat, Y. S., Henriques, J. F., & Zisserman, A. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00480 · Cited by 10
Yang, J., Wang, C., Liu, Z., Wu, J., Wang, D., Yang, L., & Cao, X. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612544 · Cited by 10
From Saturation to Zero-Shot Visual Relationship Detection Using Local Context
Gkanatsios, N., Pitsikalis, V., & Maragos, P. A. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.166 · Cited by 10
Tian, Y., Carballo, A., Li, R., & Takeda, K. (2021) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv48863.2021.9575491 · Cited by 10
Dual ResGCN for Balanced Scene GraphGenerationPreprint
Zhang, J., Zhang, Y., Wu, B., Fan, Y., Shen, F., & Shen, H. T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.04234 · Cited by 10
Scalable Optimal Transport in High Dimensions for Graph Distances, Embedding Alignment, and MorePreprint
Klicpera, J., Lienen, M., & Günnemann, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06876 · Cited by 10
Proceedings of the Fourth Workshop on Vision and Language
(2015) · doi:10.18653/v1/w15-28 · Cited by 10
SceneGenie: Scene Graph Guided Diffusion Models for Image SynthesisPreprint
Farshad, A., Yeganeh, Y., Chi, Y., Shen, C., Ommer, B., & Navab, N. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.14573 · Cited by 10
Graph-Based Captioning: Enhancing Visual Descriptions by Interconnecting Region CaptionsPreprint
Hsieh, Y.-G., Hsieh, C.-Y., Yeh, S.-Y., Béthune, L., Ansari, H. P., Vasu, P. K. A., Li, C., Krishna, R., Tuzel, O., & Cuturi, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.06723 · Cited by 10
Self-citationInferring Alt-text For UI Icons With Large Language Models During App DevelopmentPreprint
Haque, S., & Csallner, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.18060 · Cited by 10
GraphPilot: Grounded Scene Graph Conditioning for Language-Based Autonomous DrivingPreprint
Schmidt, F., Enzweiler, M., & Valada, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.11266 · Cited by 10
Hierarchical knowledge-guided reasoning for text-based person re-identification
Zeng, R., Ma, W., Zhou, T., Zhao, S., Mao, X., & Liu, J. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107888 · Cited by 9
Benetos, E., Font, F., Fuentes, M., Martín-Morató, I., & Rocamora, M. (2025) · Tampere University Institutional Repository (Tampere University) · doi:10.5281/zenodo.17251588 · Cited by 9
Merlo, E., Lagomarsino, M., Lamon, E., & Ajoudani, A. (2023) · IEEE RO-MAN · doi:10.1109/ro-man57019.2023.10309311 · Cited by 9
Image-Collection Summarization Using Scene-Graph Generation With External Knowledge
Phueaksri, I., Kastner, M. A., Kawanishi, Y., Komamizu, T., & Ide, I. (2024) · IEEE Access · doi:10.1109/access.2024.3360113 · Cited by 9
Bridging Visual and Textual Semantics: Towards Consistency for Unbiased Scene Graph Generation
Zhang, R., An, G., Hao, Y., & Wu, D. O. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3389030 · Cited by 9
Yan, Z., Wang, Z., Li, S., Li, M., Liang, X., & Liu, J. (2024) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case59546.2024.10711649 · Cited by 9
Woodlief, T., Toledo, F., Elbaum, S. G., & Dwyer, M. B. (2024) · Science of Computer Programming · doi:10.1016/j.scico.2024.103252 · Cited by 9
Enabling Perspective-Aware Ai with Contextual Scene Graph Generation
Platnick, D., Alirezaie, M., & Rahnama, H. (2024) · Information · doi:10.3390/info15120766 · Cited by 9
Situational Scene Graph for Structured Human-Centric Situation Understanding
Sugandhika, C., Li, C., Rajan, D., & Fernando, B. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00893 · Cited by 9
A Reverse Causal Framework to Mitigate Spurious Correlations for Debiasing Scene Graph Generation
Sun, S., Liu, L., Liu, T., Zhi, S., Cheng, M., Heikkilä, J., & Liu, Y. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3568644 · Cited by 9
Anticipating Next Goal for Robot Plan Prediction
Alati, E., Mauro, L., Ntouskos, V., & Pirri, F. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-29516-5_60 · Cited by 9
Multi-Camera Video Scene Graphs for Surveillance Videos Indexing and Retrieval
Patel, T., Yao, A. Y. H., Qiang, Y., Ooi, W. T., & Zimmermann, R. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506713 · Cited by 9
Scene-graph-driven semantic feature matching for monocular digestive endoscopy
Yang, Z., Pan, J., Li, R., & Qin, H. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105616 · Cited by 9
Learning Cooperative Neural Modules for Stylized Image Captioning
Wu, X., Zhao, W., & Luo, J. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01636-2 · Cited by 9
Semantic-aware visual scene representation
Parseh, M. J., Rahmanimanesh, M., Keshavarzi, P., & Azimifar, Z. (2022) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-022-00246-5 · Cited by 9
Vector Symbolic Scene Representation for Semantic Place Recognition
Kirilenko, D. E., Kovalev, A. K., Solomentsev, Y., Melekhin, A., Yudin, D. A., & Panov, A. I. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892761 · Cited by 9
Consistent Scene Graph Generation by Constraint Optimization
Chen, B., Marussy, K., Pilarski, S., Semeráth, O., & Varró, D. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3560433 · Cited by 9
Attentional Composition Networks for Long-Tailed Human Action Recognition
Wang, H., Wang, Y., Yu, B., Zhan, Y., Yuan, C., & Yang, W. (2023) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3603253 · Cited by 9
Importance First: Generating Scene Graph of Human Interest
Wang, W., Wang, R., Shan, S., & Chen, X. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01817-7 · Cited by 9
The Janus System: A Bridge to New Prolog Applications
Andersen, C., & Swift, T. M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35254-6_8 · Cited by 9
Instance-Incremental Scene Graph Generation From Real-World Point Clouds via Normalizing Flows
Qi, C., Yin, J., Xu, J., & Ding, P. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3289885 · Cited by 9
CLID: Controlled-Length Image Descriptions with Limited Data
Hirsch, E., & Tal, A. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00544 · Cited by 9
Location-Free Scene Graph Generation
Özsoy, E., Holm, F., Pellegrini, C., Czempiel, T., Saleh, M., Navab, N., & Busam, B. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00016 · Cited by 9
Aakur, S. N., de Souza, F. D., & Sarkar, S. (2019) · Quarterly of Applied Mathematics · doi:10.1090/qam/1530 · Cited by 9
Text-based indoor place recognition with deep neural network
Li, P., Li, X., Pan, H., Khyam, M. O., & Noor‐A‐Rahim, M. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.02.065 · Cited by 9
Metadata
- Authors
- Johnson, J., Krishna, R., Stark, M., Li, L.-J., Shamma, D. A., Bernstein, M. S., & Fei-Fei, L.
- Affiliations
- Stanford University (US)
- Max Planck Institute for Informatics (DE)
- Yahoo (United States) (US)
- ORCID
- Venue
- 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2015-06
- Pages
- 3668-3678
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2077069816
- Cited by
- 1,101
- References
- 68
- Citations by year
- 2026: 59 · 2025: 84 · 2024: 133 · 2023: 134 · 2022: 130 · 2021: 139 · 2020: 145 · 2019: 117 · 2018: 66 · 2017: 47 · 2016: 33 · 2015: 13
- FWCI
- 21.74
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- Max Planck Digital Library (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- semantic image retrieval, scene graph, conditional random fields, object relations, image ranking, object localization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.